2024-09-19T09:15:23.796 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T09:15:23.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:15:23.937 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911915 branch: squid description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911915' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e targets: smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN+Iy1ZwXeoSxPqXq6jjp8mo4Nc6bQqtcKY3BF2RJ6RPP33FJVi4c4voCFOnd3gZrGivacySlF9+iBvrq4WJpgs= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN31P/vDCl/3z7UF/WFCTHGsyok4r3Plqs02n6kLC40Ay1jK/R/MDCuvQFnHAnTXAC/U7WR78FK6q5Yr4CizFGM= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-19T09:15:23.938 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T09:15:23.938 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T09:15:23.938 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T09:15:23.940 INFO:teuthology.task.internal:Checking packages... 2024-09-19T09:15:23.961 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T09:15:23.961 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T09:15:23.962 INFO:teuthology.packaging:ref: None 2024-09-19T09:15:23.962 INFO:teuthology.packaging:tag: None 2024-09-19T09:15:23.962 INFO:teuthology.packaging:branch: squid 2024-09-19T09:15:23.962 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:15:23.962 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T09:15:24.193 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T09:15:24.195 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T09:15:24.201 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T09:15:24.201 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T09:15:24.209 INFO:teuthology.task.internal:Saving configuration 2024-09-19T09:15:24.229 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T09:15:24.236 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T09:15:24.261 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 09:10:26.330566', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN+Iy1ZwXeoSxPqXq6jjp8mo4Nc6bQqtcKY3BF2RJ6RPP33FJVi4c4voCFOnd3gZrGivacySlF9+iBvrq4WJpgs='} 2024-09-19T09:15:24.281 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 09:10:26.328910', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN31P/vDCl/3z7UF/WFCTHGsyok4r3Plqs02n6kLC40Ay1jK/R/MDCuvQFnHAnTXAC/U7WR78FK6q5Yr4CizFGM='} 2024-09-19T09:15:24.281 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T09:15:24.288 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-19T09:15:24.288 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-19T09:15:24.288 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T09:15:24.350 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9b6423feb0>, signals=[15]) 2024-09-19T09:15:24.351 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T09:15:24.356 INFO:teuthology.task.internal:Opening connections... 2024-09-19T09:15:24.357 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-09-19T09:15:24.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:15:24.432 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2024-09-19T09:15:24.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:15:24.509 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T09:15:24.516 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-09-19T09:15:24.533 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-09-19T09:15:24.534 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-09-19T09:15:24.591 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-09-19T09:15:24.591 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-09-19T09:15:24.592 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-09-19T09:15:24.592 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:15:24.592 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-09-19T09:15:24.592 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:15:24.592 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:15:24.592 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-09-19T09:15:24.592 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:15:24.592 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:15:24.592 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:15:24.592 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:15:24.592 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:15:24.592 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:15:24.593 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-09-19T09:15:24.615 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-09-19T09:15:24.632 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-09-19T09:15:24.633 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-09-19T09:15:24.689 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-09-19T09:15:24.689 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-09-19T09:15:24.689 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-09-19T09:15:24.689 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:15:24.689 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-09-19T09:15:24.689 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:15:24.689 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:15:24.689 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-09-19T09:15:24.690 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:15:24.690 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:15:24.690 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:15:24.690 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:15:24.690 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:15:24.690 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:15:24.690 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-09-19T09:15:24.715 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T09:15:24.728 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T09:15:24.870 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T09:15:24.870 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:15:24.872 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:15:24.889 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T09:15:24.897 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T09:15:24.897 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:15:24.930 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:15:24.957 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T09:15:25.010 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T09:15:25.024 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T09:15:25.024 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T09:15:25.025 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:15:25.025 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:15:25.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:15:25.042 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2024-09-19T09:15:25.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:15:25.043 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-19T09:15:25.099 INFO:teuthology.orchestra.run.smithi191.stdout:5.14.0-503.el9.x86_64 2024-09-19T09:15:25.099 INFO:teuthology.task.kernel:Running kernel on smithi191: 5.14.0-503.el9.x86_64 2024-09-19T09:15:25.100 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum install -y kernel 2024-09-19T09:15:25.101 INFO:teuthology.orchestra.run.smithi112.stdout:5.14.0-503.el9.x86_64 2024-09-19T09:15:25.101 INFO:teuthology.task.kernel:Running kernel on smithi112: 5.14.0-503.el9.x86_64 2024-09-19T09:15:25.101 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum install -y kernel 2024-09-19T09:15:27.495 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-19T09:15:27.809 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-19T09:15:30.153 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-09-19T09:15:34.420 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-19T09:15:36.088 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-19T09:15:36.951 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-19T09:15:41.928 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 1.5 MB/s | 20 MB 00:13 2024-09-19T09:15:42.299 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T09:15:44.197 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T09:15:44.198 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T09:15:44.286 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:15:44.297 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:15:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2024-09-19T09:15:44.297 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:15:44.297 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:15:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T09:15:44.298 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-09-19T09:15:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T09:15:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T09:15:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T09:15:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:15:44.298 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:15:44.298 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:15:44.298 INFO:teuthology.orchestra.run.smithi191.stdout:Install 4 Packages 2024-09-19T09:15:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:15:44.299 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 79 M 2024-09-19T09:15:44.299 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 126 M 2024-09-19T09:15:44.299 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:15:44.509 INFO:teuthology.orchestra.run.smithi191.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 428 kB/s | 36 kB 00:00 2024-09-19T09:15:47.212 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-19T09:15:48.484 INFO:teuthology.orchestra.run.smithi191.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.9 MB/s | 16 MB 00:04 2024-09-19T09:15:48.763 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-19T09:15:49.592 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-19T09:15:52.225 INFO:teuthology.orchestra.run.smithi191.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 3.7 MB/s | 29 MB 00:07 2024-09-19T09:15:53.884 INFO:teuthology.orchestra.run.smithi191.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.7 MB/s | 35 MB 00:09 2024-09-19T09:15:53.884 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:15:53.884 INFO:teuthology.orchestra.run.smithi191.stdout:Total 8.2 MB/s | 79 MB 00:09 2024-09-19T09:15:54.561 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:15:54.925 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:15:54.925 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:15:54.973 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-19T09:15:55.888 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:15:55.888 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:15:56.862 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T09:15:56.863 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T09:15:56.959 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:15:56.967 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:15:56.967 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-09-19T09:15:56.968 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:15:56.968 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:15:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T09:15:56.968 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-19T09:15:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T09:15:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T09:15:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T09:15:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:15:56.968 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:15:56.968 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:15:56.968 INFO:teuthology.orchestra.run.smithi112.stdout:Install 4 Packages 2024-09-19T09:15:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:15:56.969 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 79 M 2024-09-19T09:15:56.969 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 126 M 2024-09-19T09:15:56.969 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:15:57.200 INFO:teuthology.orchestra.run.smithi112.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 327 kB/s | 36 kB 00:00 2024-09-19T09:15:57.841 INFO:teuthology.orchestra.run.smithi112.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-19T09:15:58.338 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:15:58.431 INFO:teuthology.orchestra.run.smithi112.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 26 MB/s | 35 MB 00:01 2024-09-19T09:15:58.692 INFO:teuthology.orchestra.run.smithi112.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 19 MB/s | 29 MB 00:01 2024-09-19T09:15:58.692 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:15:58.693 INFO:teuthology.orchestra.run.smithi112.stdout:Total 46 MB/s | 79 MB 00:01 2024-09-19T09:15:58.985 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:15:59.067 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:15:59.371 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:15:59.729 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:15:59.729 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:16:00.727 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:16:00.727 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:16:01.850 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:16:01.997 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:16:03.161 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:16:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:16:03.868 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:16:06.613 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:16:06.756 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:16:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:16:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:16:11.569 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:16:11.681 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:16:11.719 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:16:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:16:50.034 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:16:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:16:50.428 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:16:50.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:16:50.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:16:50.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:16:51.266 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:16:51.266 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:16:51.266 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:16:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T09:16:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T09:16:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T09:16:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T09:16:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:16:51.267 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:16:51.607 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:16:51.751 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:16:51.751 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:16:51.751 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T09:16:51.752 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T09:16:51.752 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T09:16:51.752 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-19T09:16:51.752 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi191.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T09:16:51.752 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:16:51.810 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:16:51.811 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:16:51.811 DEBUG:teuthology.orchestra.run.smithi191:> sudo rpm -qi grub2-tools 2024-09-19T09:16:51.849 INFO:teuthology.orchestra.run.smithi191.stdout:Name : grub2-tools 2024-09-19T09:16:51.849 INFO:teuthology.orchestra.run.smithi191.stdout:Epoch : 1 2024-09-19T09:16:51.849 INFO:teuthology.orchestra.run.smithi191.stdout:Version : 2.06 2024-09-19T09:16:51.849 INFO:teuthology.orchestra.run.smithi191.stdout:Release : 82.el9 2024-09-19T09:16:51.849 INFO:teuthology.orchestra.run.smithi191.stdout:Architecture: x86_64 2024-09-19T09:16:51.849 INFO:teuthology.orchestra.run.smithi191.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T09:16:51.849 INFO:teuthology.orchestra.run.smithi191.stdout:Group : Unspecified 2024-09-19T09:16:51.849 INFO:teuthology.orchestra.run.smithi191.stdout:Size : 8274670 2024-09-19T09:16:51.849 INFO:teuthology.orchestra.run.smithi191.stdout:License : GPLv3+ 2024-09-19T09:16:51.850 INFO:teuthology.orchestra.run.smithi191.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T09:16:51.850 INFO:teuthology.orchestra.run.smithi191.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T09:16:51.850 INFO:teuthology.orchestra.run.smithi191.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T09:16:51.850 INFO:teuthology.orchestra.run.smithi191.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T09:16:51.850 INFO:teuthology.orchestra.run.smithi191.stdout:Packager : builder@centos.org 2024-09-19T09:16:51.850 INFO:teuthology.orchestra.run.smithi191.stdout:Vendor : CentOS 2024-09-19T09:16:51.850 INFO:teuthology.orchestra.run.smithi191.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T09:16:51.850 INFO:teuthology.orchestra.run.smithi191.stdout:Summary : Support tools for GRUB. 2024-09-19T09:16:51.850 INFO:teuthology.orchestra.run.smithi191.stdout:Description : 2024-09-19T09:16:51.850 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:16:51.850 INFO:teuthology.orchestra.run.smithi191.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T09:16:51.850 INFO:teuthology.orchestra.run.smithi191.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T09:16:51.850 INFO:teuthology.orchestra.run.smithi191.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T09:16:51.850 INFO:teuthology.orchestra.run.smithi191.stdout:hardware devices. 2024-09-19T09:16:51.851 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:16:51.851 INFO:teuthology.orchestra.run.smithi191.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T09:16:51.851 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T09:16:51.852 INFO:teuthology.task.kernel:Updating grub on smithi191 to boot 5.14.0-508.el9.x86_64 2024-09-19T09:16:51.852 DEBUG:teuthology.orchestra.run.smithi191:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T09:16:52.539 INFO:teuthology.orchestra.run.smithi191.stderr:Generating grub configuration file ... 2024-09-19T09:16:53.885 INFO:teuthology.orchestra.run.smithi191.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T09:16:53.931 INFO:teuthology.orchestra.run.smithi191.stderr:done 2024-09-19T09:16:53.934 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2024-09-19T09:16:53.951 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.KCkEweHTyX 2024-09-19T09:16:53.951 DEBUG:teuthology.orchestra.run.smithi191:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KCkEweHTyX 2024-09-19T09:16:54.018 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.KCkEweHTyX 2024-09-19T09:16:54.156 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.KCkEweHTyX is 6KB 2024-09-19T09:16:54.206 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.KCkEweHTyX 2024-09-19T09:16:54.221 DEBUG:teuthology.orchestra.run.smithi191:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T09:16:54.285 INFO:teuthology.orchestra.run.smithi191.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T09:16:54.285 INFO:teuthology.orchestra.run.smithi191.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T09:16:54.285 INFO:teuthology.orchestra.run.smithi191.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T09:16:54.285 INFO:teuthology.orchestra.run.smithi191.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T09:16:54.290 DEBUG:teuthology.orchestra.run.smithi191:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T09:16:54.455 DEBUG:teuthology.orchestra.run.smithi191:> sudo shutdown -r now 2024-09-19T09:16:54.587 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:16:54.626 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:16:54.925 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:16:54.926 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:16:54.926 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:16:54.926 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:16:55.707 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:16:55.707 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:16:55.707 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:16:55.707 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T09:16:55.708 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T09:16:55.708 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T09:16:55.708 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T09:16:55.708 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:16:55.709 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:16:56.059 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:16:56.149 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:16:56.149 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:16:56.150 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T09:16:56.150 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T09:16:56.150 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T09:16:56.150 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-19T09:16:56.150 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T09:16:56.150 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:16:56.209 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:16:56.209 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:16:56.209 DEBUG:teuthology.orchestra.run.smithi112:> sudo rpm -qi grub2-tools 2024-09-19T09:16:56.249 INFO:teuthology.orchestra.run.smithi112.stdout:Name : grub2-tools 2024-09-19T09:16:56.249 INFO:teuthology.orchestra.run.smithi112.stdout:Epoch : 1 2024-09-19T09:16:56.249 INFO:teuthology.orchestra.run.smithi112.stdout:Version : 2.06 2024-09-19T09:16:56.249 INFO:teuthology.orchestra.run.smithi112.stdout:Release : 82.el9 2024-09-19T09:16:56.249 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: x86_64 2024-09-19T09:16:56.249 INFO:teuthology.orchestra.run.smithi112.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T09:16:56.249 INFO:teuthology.orchestra.run.smithi112.stdout:Group : Unspecified 2024-09-19T09:16:56.249 INFO:teuthology.orchestra.run.smithi112.stdout:Size : 8274670 2024-09-19T09:16:56.249 INFO:teuthology.orchestra.run.smithi112.stdout:License : GPLv3+ 2024-09-19T09:16:56.250 INFO:teuthology.orchestra.run.smithi112.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T09:16:56.250 INFO:teuthology.orchestra.run.smithi112.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T09:16:56.250 INFO:teuthology.orchestra.run.smithi112.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T09:16:56.250 INFO:teuthology.orchestra.run.smithi112.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T09:16:56.250 INFO:teuthology.orchestra.run.smithi112.stdout:Packager : builder@centos.org 2024-09-19T09:16:56.250 INFO:teuthology.orchestra.run.smithi112.stdout:Vendor : CentOS 2024-09-19T09:16:56.250 INFO:teuthology.orchestra.run.smithi112.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T09:16:56.250 INFO:teuthology.orchestra.run.smithi112.stdout:Summary : Support tools for GRUB. 2024-09-19T09:16:56.250 INFO:teuthology.orchestra.run.smithi112.stdout:Description : 2024-09-19T09:16:56.250 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:16:56.250 INFO:teuthology.orchestra.run.smithi112.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T09:16:56.250 INFO:teuthology.orchestra.run.smithi112.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T09:16:56.250 INFO:teuthology.orchestra.run.smithi112.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T09:16:56.251 INFO:teuthology.orchestra.run.smithi112.stdout:hardware devices. 2024-09-19T09:16:56.251 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:16:56.251 INFO:teuthology.orchestra.run.smithi112.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T09:16:56.251 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T09:16:56.252 INFO:teuthology.task.kernel:Updating grub on smithi112 to boot 5.14.0-508.el9.x86_64 2024-09-19T09:16:56.252 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T09:16:56.898 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-09-19T09:16:58.237 INFO:teuthology.orchestra.run.smithi112.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T09:16:58.258 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-09-19T09:16:58.260 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-19T09:16:58.275 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.A3ENrqieDI 2024-09-19T09:16:58.275 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.A3ENrqieDI 2024-09-19T09:16:58.341 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.A3ENrqieDI 2024-09-19T09:16:58.481 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.A3ENrqieDI is 6KB 2024-09-19T09:16:58.529 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.A3ENrqieDI 2024-09-19T09:16:58.544 DEBUG:teuthology.orchestra.run.smithi112:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T09:16:58.610 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T09:16:58.610 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T09:16:58.610 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T09:16:58.610 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T09:16:58.611 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T09:16:58.775 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2024-09-19T09:17:24.483 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-19T09:17:24.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-19T09:17:24.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:17:28.865 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-19T09:17:28.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-19T09:17:28.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:17:42.849 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-09-19T09:17:47.197 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-19T09:17:51.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-19T09:17:51.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:17:54.913 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-09-19T09:17:56.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-19T09:17:56.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:18:06.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-19T09:18:06.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:18:09.985 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-09-19T09:18:25.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-19T09:18:25.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:18:28.062 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-09-19T09:18:46.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-19T09:18:46.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:18:46.475 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-09-19T09:18:46.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-19T09:18:46.839 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-19T09:18:46.839 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2024-09-19T09:18:46.854 INFO:teuthology.orchestra.run.smithi191.stdout:5.14.0-508.el9.x86_64 2024-09-19T09:18:46.855 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T09:18:46.855 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T09:18:46.855 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T09:18:47.855 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-19T09:18:47.856 DEBUG:teuthology.orchestra.run.smithi191:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T09:18:48.194 INFO:teuthology.orchestra.run.smithi191.stdout:ttyS1 2024-09-19T09:18:48.219 DEBUG:teuthology.parallel:result is None 2024-09-19T09:18:56.205 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T09:19:08.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-19T09:19:08.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:19:08.495 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-19T09:19:08.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-19T09:19:08.852 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-19T09:19:08.853 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-19T09:19:08.869 INFO:teuthology.orchestra.run.smithi112.stdout:5.14.0-508.el9.x86_64 2024-09-19T09:19:08.869 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T09:19:08.870 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T09:19:08.870 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T09:19:09.870 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-19T09:19:09.871 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T09:19:09.937 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2024-09-19T09:19:09.963 DEBUG:teuthology.parallel:result is None 2024-09-19T09:19:09.963 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T09:19:09.971 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T09:19:09.971 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:19:09.973 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:19:09.992 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T09:19:09.998 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T09:19:10.012 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T09:19:10.012 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:19:10.035 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:19:10.089 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T09:19:10.096 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T09:19:10.097 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:19:10.100 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:19:10.133 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:19:10.144 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:19:10.149 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:19:10.161 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:19:10.163 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T09:19:10.170 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T09:19:10.170 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:19:10.189 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:19:10.217 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T09:19:10.227 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T09:19:10.227 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:19:10.257 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:19:10.275 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:19:10.357 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:19:10.405 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:19:10.488 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:19:10.528 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:19:10.528 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:19:10.593 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:19:10.639 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:19:10.690 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:19:10.773 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:19:10.818 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:19:10.818 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:19:10.884 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-09-19T09:19:10.887 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2024-09-19T09:19:10.942 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:19:10.971 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:19:11.322 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T09:19:11.330 INFO:teuthology.task.internal:Starting timer... 2024-09-19T09:19:11.330 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T09:19:11.341 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T09:19:11.351 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T09:19:11.351 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2024-09-19T09:19:11.405 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2024-09-19T09:19:11.406 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2024-09-19T09:19:11.459 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2024-09-19T09:19:11.465 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T09:19:11.465 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2024-09-19T09:19:11.488 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2024-09-19T09:19:11.488 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2024-09-19T09:19:11.528 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2024-09-19T09:19:11.528 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi112.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2024-09-19T09:19:11.528 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:19:11.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:19:11.555 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:19:11.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:19:11.595 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T09:19:11.595 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:19:11.624 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:19:11.664 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T09:19:11.674 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T09:19:11.677 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T09:19:11.815 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T09:19:11.845 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T09:19:11.846 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi112.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T09:22:56.993 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2024-09-19T09:22:56.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-19T09:22:56.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:22:57.112 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-19T09:22:57.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-19T09:22:57.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-19T09:22:57.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:22:57.272 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-09-19T09:22:57.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-19T09:22:57.309 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T09:22:57.319 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T09:22:57.319 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:22:57.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:22:57.322 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:22:57.322 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:22:57.349 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:22:57.363 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:22:57.378 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:22:57.387 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2024-09-19T09:22:57.392 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:22:57.398 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2024-09-19T09:22:57.412 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:22:57.417 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2024-09-19T09:22:57.426 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:22:57.428 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2024-09-19T09:22:57.442 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:22:57.457 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:22:57.480 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:22:57.483 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:22:57.483 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-19T09:22:57.484 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:22:57.484 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:22:57.484 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:22:57.484 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:22:57.513 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:22:57.517 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:22:57.517 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-09-19T09:22:57.517 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:22:57.517 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:22:57.517 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:22:57.517 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:22:57.518 INFO:teuthology.run_tasks:Running task install... 2024-09-19T09:22:57.526 DEBUG:teuthology.task.install:project ceph 2024-09-19T09:22:57.526 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T09:22:57.526 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T09:22:57.526 INFO:teuthology.task.install:Using flavor: default 2024-09-19T09:22:57.532 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T09:22:57.532 INFO:teuthology.task.install:extra packages: [] 2024-09-19T09:22:57.532 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:22:57.533 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T09:22:57.533 INFO:teuthology.packaging:ref: None 2024-09-19T09:22:57.533 INFO:teuthology.packaging:tag: None 2024-09-19T09:22:57.533 INFO:teuthology.packaging:branch: quincy 2024-09-19T09:22:57.533 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:22:57.533 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-19T09:22:57.536 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:22:57.536 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T09:22:57.536 INFO:teuthology.packaging:ref: None 2024-09-19T09:22:57.536 INFO:teuthology.packaging:tag: None 2024-09-19T09:22:57.536 INFO:teuthology.packaging:branch: quincy 2024-09-19T09:22:57.536 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:22:57.536 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-19T09:22:57.750 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/ 2024-09-19T09:22:57.750 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1637.g6e06d1e0 2024-09-19T09:22:57.768 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/ 2024-09-19T09:22:57.768 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1637.g6e06d1e0 2024-09-19T09:22:57.861 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:22:57.861 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:22:57.861 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:22:57.876 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:22:57.876 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:22:57.876 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:22:57.887 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-19T09:22:57.887 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T09:22:57.887 INFO:teuthology.packaging:ref: None 2024-09-19T09:22:57.887 INFO:teuthology.packaging:tag: None 2024-09-19T09:22:57.887 INFO:teuthology.packaging:branch: quincy 2024-09-19T09:22:57.887 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:22:57.888 DEBUG:teuthology.orchestra.run.smithi191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:22:57.902 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-19T09:22:57.903 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T09:22:57.903 INFO:teuthology.packaging:ref: None 2024-09-19T09:22:57.903 INFO:teuthology.packaging:tag: None 2024-09-19T09:22:57.903 INFO:teuthology.packaging:branch: quincy 2024-09-19T09:22:57.903 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:22:57.903 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:22:57.953 DEBUG:teuthology.orchestra.run.smithi191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:22:57.968 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:22:58.028 DEBUG:teuthology.orchestra.run.smithi191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:22:58.043 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:22:58.092 INFO:teuthology.orchestra.run.smithi191.stdout:check_obsoletes = 1 2024-09-19T09:22:58.093 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum clean all 2024-09-19T09:22:58.107 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2024-09-19T09:22:58.108 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2024-09-19T09:22:58.337 INFO:teuthology.orchestra.run.smithi191.stdout:45 files removed 2024-09-19T09:22:58.340 INFO:teuthology.orchestra.run.smithi112.stdout:45 files removed 2024-09-19T09:22:58.363 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-radosgw 2024-09-19T09:22:58.367 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw 2024-09-19T09:22:58.918 INFO:teuthology.orchestra.run.smithi191.stdout:ceph packages for x86_64 286 kB/s | 77 kB 00:00 2024-09-19T09:22:58.924 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 280 kB/s | 77 kB 00:00 2024-09-19T09:22:59.202 INFO:teuthology.orchestra.run.smithi191.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-19T09:22:59.216 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 43 kB/s | 11 kB 00:00 2024-09-19T09:22:59.469 INFO:teuthology.orchestra.run.smithi191.stdout:ceph source packages 7.7 kB/s | 1.8 kB 00:00 2024-09-19T09:22:59.483 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 7.7 kB/s | 1.8 kB 00:00 2024-09-19T09:23:01.200 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.3 MB 00:01 2024-09-19T09:23:02.202 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.3 MB 00:02 2024-09-19T09:23:02.986 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-19T09:23:04.087 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-19T09:23:07.653 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 7.2 MB/s | 6.5 MB 00:00 2024-09-19T09:23:09.281 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-19T09:23:09.679 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-19T09:23:10.427 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-19T09:23:11.405 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 19 kB 00:00 2024-09-19T09:23:12.326 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T09:23:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T09:23:17.856 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T09:23:18.100 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:23:18.118 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:23:18.118 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-19T09:23:18.118 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:23:18.118 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:23:18.118 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 14 M 2024-09-19T09:23:18.118 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2024-09-19T09:23:18.118 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 3.1 M 2024-09-19T09:23:18.119 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.9 M 2024-09-19T09:23:18.119 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-19T09:23:18.119 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 5.0 M 2024-09-19T09:23:18.119 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 22 M 2024-09-19T09:23:18.119 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 25 k 2024-09-19T09:23:18.119 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:23:18.119 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 636 k 2024-09-19T09:23:18.119 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:23:18.119 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:23:18.119 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:23:18.120 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 457 k 2024-09-19T09:23:18.120 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:23:18.120 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 4.9 M 2024-09-19T09:23:18.120 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:23:18.120 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:23:18.120 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 45 k 2024-09-19T09:23:18.120 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 120 k 2024-09-19T09:23:18.120 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 156 k 2024-09-19T09:23:18.120 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:23:18.120 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 320 k 2024-09-19T09:23:18.120 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 295 k 2024-09-19T09:23:18.120 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 99 k 2024-09-19T09:23:18.120 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:23:18.121 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:23:18.121 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:23:18.121 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:23:18.121 INFO:teuthology.orchestra.run.smithi112.stdout:Install 22 Packages 2024-09-19T09:23:18.121 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 2 Packages 2024-09-19T09:23:18.121 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:23:18.121 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 58 M 2024-09-19T09:23:18.121 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:23:18.667 INFO:teuthology.orchestra.run.smithi112.stdout:(1/24): ceph-base-17.2.7-1637.g6e06d1e0.el9.x86 10 MB/s | 5.0 MB 00:00 2024-09-19T09:23:18.742 INFO:teuthology.orchestra.run.smithi112.stdout:(2/24): ceph-selinux-17.2.7-1637.g6e06d1e0.el9. 335 kB/s | 25 kB 00:00 2024-09-19T09:23:18.851 INFO:teuthology.orchestra.run.smithi112.stdout:(3/24): libcephfs2-17.2.7-1637.g6e06d1e0.el9.x8 5.7 MB/s | 636 kB 00:00 2024-09-19T09:23:18.968 INFO:teuthology.orchestra.run.smithi112.stdout:(4/24): libradosstriper1-17.2.7-1637.g6e06d1e0. 3.8 MB/s | 457 kB 00:00 2024-09-19T09:23:19.135 INFO:teuthology.orchestra.run.smithi112.stdout:(5/24): ceph-radosgw-17.2.7-1637.g6e06d1e0.el9. 15 MB/s | 14 MB 00:00 2024-09-19T09:23:19.177 INFO:teuthology.orchestra.run.smithi112.stdout:(6/24): python3-ceph-argparse-17.2.7-1637.g6e06 1.1 MB/s | 45 kB 00:00 2024-09-19T09:23:19.260 INFO:teuthology.orchestra.run.smithi112.stdout:(7/24): librgw2-17.2.7-1637.g6e06d1e0.el9.x86_6 17 MB/s | 4.9 MB 00:00 2024-09-19T09:23:19.277 INFO:teuthology.orchestra.run.smithi112.stdout:(8/24): python3-ceph-common-17.2.7-1637.g6e06d1 1.2 MB/s | 120 kB 00:00 2024-09-19T09:23:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:(9/24): python3-cephfs-17.2.7-1637.g6e06d1e0.el 3.0 MB/s | 156 kB 00:00 2024-09-19T09:23:19.520 INFO:teuthology.orchestra.run.smithi112.stdout:(10/24): ceph-common-17.2.7-1637.g6e06d1e0.el9. 17 MB/s | 22 MB 00:01 2024-09-19T09:23:19.544 INFO:teuthology.orchestra.run.smithi112.stdout:(11/24): python3-rados-17.2.7-1637.g6e06d1e0.el 1.2 MB/s | 320 kB 00:00 2024-09-19T09:23:19.578 INFO:teuthology.orchestra.run.smithi112.stdout:(12/24): python3-rbd-17.2.7-1637.g6e06d1e0.el9. 1.1 MB/s | 295 kB 00:00 2024-09-19T09:23:19.603 INFO:teuthology.orchestra.run.smithi112.stdout:(13/24): python3-rgw-17.2.7-1637.g6e06d1e0.el9. 1.2 MB/s | 99 kB 00:00 2024-09-19T09:23:19.754 INFO:teuthology.orchestra.run.smithi112.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 258 kB/s | 45 kB 00:00 2024-09-19T09:23:19.879 INFO:teuthology.orchestra.run.smithi112.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 479 kB/s | 160 kB 00:00 2024-09-19T09:23:19.954 INFO:teuthology.orchestra.run.smithi112.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 564 kB/s | 42 kB 00:00 2024-09-19T09:23:19.988 INFO:teuthology.orchestra.run.smithi112.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.2 MB/s | 292 kB 00:00 2024-09-19T09:23:20.030 INFO:teuthology.orchestra.run.smithi112.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 1.5 MB/s | 662 kB 00:00 2024-09-19T09:23:20.055 INFO:teuthology.orchestra.run.smithi112.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 729 kB/s | 49 kB 00:00 2024-09-19T09:23:20.080 INFO:teuthology.orchestra.run.smithi112.stdout:(20/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.4 MB/s | 308 kB 00:00 2024-09-19T09:23:20.105 INFO:teuthology.orchestra.run.smithi112.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 937 kB/s | 67 kB 00:00 2024-09-19T09:23:20.106 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:23:20.115 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:23:20.115 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-09-19T09:23:20.115 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:23:20.115 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:23:20.115 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 14 M 2024-09-19T09:23:20.115 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2024-09-19T09:23:20.116 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 3.1 M 2024-09-19T09:23:20.116 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.9 M 2024-09-19T09:23:20.116 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-09-19T09:23:20.116 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 5.0 M 2024-09-19T09:23:20.116 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 22 M 2024-09-19T09:23:20.116 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 25 k 2024-09-19T09:23:20.116 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:23:20.116 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 636 k 2024-09-19T09:23:20.116 INFO:teuthology.orchestra.run.smithi191.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:23:20.117 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:23:20.117 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:23:20.117 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 457 k 2024-09-19T09:23:20.117 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:23:20.117 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 4.9 M 2024-09-19T09:23:20.117 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:23:20.117 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:23:20.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 45 k 2024-09-19T09:23:20.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 120 k 2024-09-19T09:23:20.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 156 k 2024-09-19T09:23:20.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:23:20.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 320 k 2024-09-19T09:23:20.118 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 295 k 2024-09-19T09:23:20.118 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 99 k 2024-09-19T09:23:20.118 INFO:teuthology.orchestra.run.smithi191.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:23:20.118 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:23:20.118 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:23:20.118 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:23:20.118 INFO:teuthology.orchestra.run.smithi191.stdout:Install 22 Packages 2024-09-19T09:23:20.118 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 2 Packages 2024-09-19T09:23:20.118 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:23:20.119 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 58 M 2024-09-19T09:23:20.119 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:23:20.156 INFO:teuthology.orchestra.run.smithi112.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T09:23:20.273 INFO:teuthology.orchestra.run.smithi112.stdout:(23/24): librados2-17.2.7-1637.g6e06d1e0.el9.x8 16 MB/s | 3.1 MB 00:00 2024-09-19T09:23:20.340 INFO:teuthology.orchestra.run.smithi112.stdout:(24/24): librbd1-17.2.7-1637.g6e06d1e0.el9.x86_ 13 MB/s | 2.9 MB 00:00 2024-09-19T09:23:20.345 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:23:20.345 INFO:teuthology.orchestra.run.smithi112.stdout:Total 26 MB/s | 58 MB 00:02 2024-09-19T09:23:20.406 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:23:20.439 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:23:20.439 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:23:20.924 INFO:teuthology.orchestra.run.smithi191.stdout:(1/24): ceph-base-17.2.7-1637.g6e06d1e0.el9.x86 12 MB/s | 5.0 MB 00:00 2024-09-19T09:23:20.991 INFO:teuthology.orchestra.run.smithi191.stdout:(2/24): ceph-selinux-17.2.7-1637.g6e06d1e0.el9. 378 kB/s | 25 kB 00:00 2024-09-19T09:23:21.089 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:23:21.089 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:23:21.091 INFO:teuthology.orchestra.run.smithi191.stdout:(3/24): libcephfs2-17.2.7-1637.g6e06d1e0.el9.x8 6.2 MB/s | 636 kB 00:00 2024-09-19T09:23:21.166 INFO:teuthology.orchestra.run.smithi191.stdout:(4/24): libradosstriper1-17.2.7-1637.g6e06d1e0. 6.0 MB/s | 457 kB 00:00 2024-09-19T09:23:21.600 INFO:teuthology.orchestra.run.smithi191.stdout:(5/24): ceph-radosgw-17.2.7-1637.g6e06d1e0.el9. 13 MB/s | 14 MB 00:01 2024-09-19T09:23:21.666 INFO:teuthology.orchestra.run.smithi191.stdout:(6/24): librgw2-17.2.7-1637.g6e06d1e0.el9.x86_6 9.8 MB/s | 4.9 MB 00:00 2024-09-19T09:23:21.692 INFO:teuthology.orchestra.run.smithi191.stdout:(7/24): python3-ceph-argparse-17.2.7-1637.g6e06 492 kB/s | 45 kB 00:00 2024-09-19T09:23:21.717 INFO:teuthology.orchestra.run.smithi191.stdout:(8/24): python3-ceph-common-17.2.7-1637.g6e06d1 2.3 MB/s | 120 kB 00:00 2024-09-19T09:23:21.742 INFO:teuthology.orchestra.run.smithi191.stdout:(9/24): python3-cephfs-17.2.7-1637.g6e06d1e0.el 3.0 MB/s | 156 kB 00:00 2024-09-19T09:23:21.767 INFO:teuthology.orchestra.run.smithi191.stdout:(10/24): python3-rados-17.2.7-1637.g6e06d1e0.el 6.2 MB/s | 320 kB 00:00 2024-09-19T09:23:21.801 INFO:teuthology.orchestra.run.smithi191.stdout:(11/24): python3-rbd-17.2.7-1637.g6e06d1e0.el9. 4.9 MB/s | 295 kB 00:00 2024-09-19T09:23:21.826 INFO:teuthology.orchestra.run.smithi191.stdout:(12/24): python3-rgw-17.2.7-1637.g6e06d1e0.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T09:23:22.077 INFO:teuthology.orchestra.run.smithi191.stdout:(13/24): ceph-common-17.2.7-1637.g6e06d1e0.el9. 14 MB/s | 22 MB 00:01 2024-09-19T09:23:22.102 INFO:teuthology.orchestra.run.smithi191.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 164 kB/s | 45 kB 00:00 2024-09-19T09:23:22.136 INFO:teuthology.orchestra.run.smithi191.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 479 kB/s | 160 kB 00:00 2024-09-19T09:23:22.186 INFO:teuthology.orchestra.run.smithi191.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 844 kB/s | 42 kB 00:00 2024-09-19T09:23:22.211 INFO:teuthology.orchestra.run.smithi191.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-19T09:23:22.253 INFO:teuthology.orchestra.run.smithi191.stdout:(18/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.5 MB/s | 308 kB 00:00 2024-09-19T09:23:22.287 INFO:teuthology.orchestra.run.smithi191.stdout:(19/24): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-19T09:23:22.310 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:23:22.312 INFO:teuthology.orchestra.run.smithi191.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2024-09-19T09:23:22.346 INFO:teuthology.orchestra.run.smithi191.stdout:(21/24): liboath-2.6.7-2.el9.x86_64.rpm 362 kB/s | 49 kB 00:00 2024-09-19T09:23:22.404 INFO:teuthology.orchestra.run.smithi191.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-19T09:23:22.521 INFO:teuthology.orchestra.run.smithi191.stdout:(23/24): librados2-17.2.7-1637.g6e06d1e0.el9.x8 15 MB/s | 3.1 MB 00:00 2024-09-19T09:23:22.579 INFO:teuthology.orchestra.run.smithi191.stdout:(24/24): librbd1-17.2.7-1637.g6e06d1e0.el9.x86_ 13 MB/s | 2.9 MB 00:00 2024-09-19T09:23:22.584 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:23:22.584 INFO:teuthology.orchestra.run.smithi191.stdout:Total 24 MB/s | 58 MB 00:02 2024-09-19T09:23:22.644 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:23:22.676 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:23:22.677 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:23:22.707 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-19T09:23:22.767 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-19T09:23:22.865 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-19T09:23:22.945 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/26 2024-09-19T09:23:22.968 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-19T09:23:23.057 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-19T09:23:23.110 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-19T09:23:23.139 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-19T09:23:23.330 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:23:23.331 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:23:23.577 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-19T09:23:23.604 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 8/26 2024-09-19T09:23:23.670 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 8/26 2024-09-19T09:23:23.720 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-19T09:23:23.763 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9. 10/26 2024-09-19T09:23:23.800 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 11/26 2024-09-19T09:23:23.862 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 12/26 2024-09-19T09:23:23.890 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 13/26 2024-09-19T09:23:23.955 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 13/26 2024-09-19T09:23:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-19T09:23:24.048 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-19T09:23:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-19T09:23:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-19T09:23:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 18/26 2024-09-19T09:23:24.499 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 18/26 2024-09-19T09:23:24.571 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:23:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 19/26 2024-09-19T09:23:24.604 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x8 20/26 2024-09-19T09:23:24.918 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-19T09:23:25.031 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-19T09:23:25.116 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-19T09:23:25.194 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/26 2024-09-19T09:23:25.225 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-19T09:23:25.300 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-19T09:23:25.342 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-19T09:23:25.380 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-19T09:23:25.830 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-19T09:23:25.861 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 8/26 2024-09-19T09:23:25.924 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 8/26 2024-09-19T09:23:25.952 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-19T09:23:25.995 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9. 10/26 2024-09-19T09:23:26.032 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 11/26 2024-09-19T09:23:26.103 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 12/26 2024-09-19T09:23:26.131 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 13/26 2024-09-19T09:23:26.196 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 13/26 2024-09-19T09:23:26.256 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-19T09:23:26.289 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-19T09:23:26.325 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-19T09:23:26.625 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-19T09:23:26.659 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 18/26 2024-09-19T09:23:26.733 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 18/26 2024-09-19T09:23:26.806 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 19/26 2024-09-19T09:23:26.837 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x8 20/26 2024-09-19T09:23:27.069 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-19T09:23:27.109 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-19T09:23:27.638 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-19T09:23:27.687 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 22/26 2024-09-19T09:23:27.776 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 22/26 2024-09-19T09:23:27.776 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:23:27.777 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:23:27.777 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:23:27.805 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-19T09:23:29.332 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-19T09:23:29.383 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-19T09:23:29.908 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-19T09:23:29.953 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 22/26 2024-09-19T09:23:30.043 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 22/26 2024-09-19T09:23:30.043 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:23:30.043 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:23:30.043 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:23:30.071 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-19T09:23:37.797 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-19T09:23:37.797 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2024-09-19T09:23:37.798 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2024-09-19T09:23:37.798 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2024-09-19T09:23:37.798 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2024-09-19T09:23:37.798 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2024-09-19T09:23:37.798 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /root 2024-09-19T09:23:37.798 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2024-09-19T09:23:37.798 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:23:39.120 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 24/26 2024-09-19T09:23:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 24/26 2024-09-19T09:23:39.198 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:23:39.198 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:23:39.198 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:23:39.198 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:23:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:23:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-19T09:23:39.289 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-19T09:23:39.290 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-19T09:23:39.849 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-19T09:23:39.849 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /sys 2024-09-19T09:23:39.849 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /proc 2024-09-19T09:23:39.849 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /mnt 2024-09-19T09:23:39.849 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /var/tmp 2024-09-19T09:23:39.849 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /home 2024-09-19T09:23:39.849 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /root 2024-09-19T09:23:39.849 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /tmp 2024-09-19T09:23:39.849 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:23:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-19T09:23:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/26 2024-09-19T09:23:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-19T09:23:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/26 2024-09-19T09:23:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-19T09:23:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 5/26 2024-09-19T09:23:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 6/26 2024-09-19T09:23:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 7/26 2024-09-19T09:23:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9. 8/26 2024-09-19T09:23:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x8 9/26 2024-09-19T09:23:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 10/26 2024-09-19T09:23:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 11/26 2024-09-19T09:23:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 12/26 2024-09-19T09:23:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 13/26 2024-09-19T09:23:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-19T09:23:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-19T09:23:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-19T09:23:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-19T09:23:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-19T09:23:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-19T09:23:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-19T09:23:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-19T09:23:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-19T09:23:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-19T09:23:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-19T09:23:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 25/26 2024-09-19T09:23:41.153 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 24/26 2024-09-19T09:23:41.214 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 24/26 2024-09-19T09:23:41.214 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:23:41.214 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:23:41.214 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:23:41.215 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:23:41.215 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:23:41.217 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-19T09:23:41.330 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-19T09:23:41.330 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-19T09:23:41.471 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-19T09:23:41.471 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:23:41.471 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2024-09-19T09:23:41.471 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:41.472 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:23:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:23:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:23:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:23:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:23:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:23:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:23:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:23:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:23:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:23:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:23:41.474 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:23:41.823 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-test 2024-09-19T09:23:42.398 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:27 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:23:42.528 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:23:42.529 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:23:42.529 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-19T09:23:42.529 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:23:42.529 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:23:42.529 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 48 M 2024-09-19T09:23:42.529 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-19T09:23:42.529 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 163 k 2024-09-19T09:23:42.529 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:23:42.530 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:23:42.530 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:23:42.530 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:23:42.530 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:23:42.530 INFO:teuthology.orchestra.run.smithi112.stdout:Install 4 Packages 2024-09-19T09:23:42.530 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:23:42.530 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 48 M 2024-09-19T09:23:42.531 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 193 M 2024-09-19T09:23:42.531 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:23:42.745 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-19T09:23:42.746 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/26 2024-09-19T09:23:42.746 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-19T09:23:42.746 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/26 2024-09-19T09:23:42.746 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-19T09:23:42.746 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 5/26 2024-09-19T09:23:42.746 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 6/26 2024-09-19T09:23:42.746 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 7/26 2024-09-19T09:23:42.746 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9. 8/26 2024-09-19T09:23:42.746 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x8 9/26 2024-09-19T09:23:42.746 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 10/26 2024-09-19T09:23:42.746 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 11/26 2024-09-19T09:23:42.747 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 12/26 2024-09-19T09:23:42.747 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 13/26 2024-09-19T09:23:42.747 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-19T09:23:42.747 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-19T09:23:42.747 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-19T09:23:42.747 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-19T09:23:42.747 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-19T09:23:42.747 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-19T09:23:42.747 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-19T09:23:42.747 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-19T09:23:42.747 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-19T09:23:42.747 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-19T09:23:42.747 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-19T09:23:42.748 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 25/26 2024-09-19T09:23:43.027 INFO:teuthology.orchestra.run.smithi112.stdout:(1/4): libcephsqlite-17.2.7-1637.g6e06d1e0.el9. 755 kB/s | 163 kB 00:00 2024-09-19T09:23:43.060 INFO:teuthology.orchestra.run.smithi112.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-19T09:23:43.169 INFO:teuthology.orchestra.run.smithi112.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 449 kB/s | 64 kB 00:00 2024-09-19T09:23:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-19T09:23:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:23:43.677 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2024-09-19T09:23:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:43.677 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:23:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:23:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:23:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:23:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:23:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:23:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:23:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:23:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:23:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:23:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:23:43.682 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:23:44.073 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-test 2024-09-19T09:23:44.328 INFO:teuthology.orchestra.run.smithi112.stdout:(4/4): ceph-test-17.2.7-1637.g6e06d1e0.el9.x86_ 32 MB/s | 48 MB 00:01 2024-09-19T09:23:44.330 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:23:44.330 INFO:teuthology.orchestra.run.smithi112.stdout:Total 27 MB/s | 48 MB 00:01 2024-09-19T09:23:44.358 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:23:44.377 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:23:44.377 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:23:44.651 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:27 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:23:44.743 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:23:44.744 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:23:44.787 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:23:44.787 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:23:44.787 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-09-19T09:23:44.788 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:23:44.788 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:23:44.788 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 48 M 2024-09-19T09:23:44.788 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-09-19T09:23:44.788 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 163 k 2024-09-19T09:23:44.788 INFO:teuthology.orchestra.run.smithi191.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:23:44.788 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:23:44.788 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:23:44.788 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:23:44.788 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:23:44.788 INFO:teuthology.orchestra.run.smithi191.stdout:Install 4 Packages 2024-09-19T09:23:44.788 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:23:44.789 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 48 M 2024-09-19T09:23:44.789 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 193 M 2024-09-19T09:23:44.789 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:23:45.062 INFO:teuthology.orchestra.run.smithi191.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-19T09:23:45.088 INFO:teuthology.orchestra.run.smithi191.stdout:(2/4): libcephsqlite-17.2.7-1637.g6e06d1e0.el9. 676 kB/s | 163 kB 00:00 2024-09-19T09:23:45.113 INFO:teuthology.orchestra.run.smithi191.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T09:23:45.279 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:23:45.352 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-19T09:23:45.393 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-19T09:23:45.429 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/4 2024-09-19T09:23:46.388 INFO:teuthology.orchestra.run.smithi191.stdout:(4/4): ceph-test-17.2.7-1637.g6e06d1e0.el9.x86_ 31 MB/s | 48 MB 00:01 2024-09-19T09:23:46.390 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:23:46.391 INFO:teuthology.orchestra.run.smithi191.stdout:Total 30 MB/s | 48 MB 00:01 2024-09-19T09:23:46.418 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:23:46.437 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:23:46.437 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:23:46.802 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:23:46.802 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:23:47.330 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:23:47.420 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-19T09:23:47.462 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-19T09:23:47.498 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/4 2024-09-19T09:23:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/4 2024-09-19T09:23:49.910 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/4 2024-09-19T09:23:51.906 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/4 2024-09-19T09:23:51.978 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/4 2024-09-19T09:23:52.297 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/4 2024-09-19T09:23:52.297 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/4 2024-09-19T09:23:52.298 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/4 2024-09-19T09:23:52.298 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-19T09:23:52.595 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-19T09:23:52.595 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:23:52.595 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:23:52.595 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:52.595 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:52.595 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:23:52.595 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:23:52.595 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:23:52.595 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:23:52.888 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph 2024-09-19T09:23:53.467 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:38 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:23:53.600 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:23:53.602 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:23:53.602 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-19T09:23:53.602 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:23:53.602 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:23:53.603 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 6.5 k 2024-09-19T09:23:53.603 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-19T09:23:53.603 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.1 M 2024-09-19T09:23:53.603 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 1.4 M 2024-09-19T09:23:53.603 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 240 k 2024-09-19T09:23:53.603 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 3.9 M 2024-09-19T09:23:53.603 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 15 M 2024-09-19T09:23:53.603 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:23:53.604 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:23:53.604 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:23:53.604 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:23:53.604 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:23:53.604 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:23:53.604 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:23:53.604 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections 2024-09-19T09:23:53.604 INFO:teuthology.orchestra.run.smithi112.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:23:53.604 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:23:53.604 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:23:53.604 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:23:53.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:23:53.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:23:53.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:23:53.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:23:53.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:23:53.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:23:53.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:23:53.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:23:53.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:23:53.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:23:53.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:23:53.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:23:53.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:23:53.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:23:53.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:23:53.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:23:53.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:23:53.606 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:23:53.606 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:23:53.606 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:23:53.606 INFO:teuthology.orchestra.run.smithi112.stdout:Install 34 Packages 2024-09-19T09:23:53.606 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:23:53.607 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 27 M 2024-09-19T09:23:53.607 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 96 M 2024-09-19T09:23:53.607 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:23:54.069 INFO:teuthology.orchestra.run.smithi112.stdout:(1/34): ceph-17.2.7-1637.g6e06d1e0.el9.x86_64.r 54 kB/s | 6.5 kB 00:00 2024-09-19T09:23:54.236 INFO:teuthology.orchestra.run.smithi112.stdout:(2/34): ceph-mgr-17.2.7-1637.g6e06d1e0.el9.x86_ 4.9 MB/s | 1.4 MB 00:00 2024-09-19T09:23:54.286 INFO:teuthology.orchestra.run.smithi112.stdout:(3/34): ceph-mds-17.2.7-1637.g6e06d1e0.el9.x86_ 6.2 MB/s | 2.1 MB 00:00 2024-09-19T09:23:54.378 INFO:teuthology.orchestra.run.smithi112.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1637.g6e06 2.6 MB/s | 240 kB 00:00 2024-09-19T09:23:54.414 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/4 2024-09-19T09:23:54.414 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/4 2024-09-19T09:23:54.414 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/4 2024-09-19T09:23:54.414 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-19T09:23:54.445 INFO:teuthology.orchestra.run.smithi112.stdout:(5/34): ceph-mon-17.2.7-1637.g6e06d1e0.el9.x86_ 10 MB/s | 3.9 MB 00:00 2024-09-19T09:23:54.745 INFO:teuthology.orchestra.run.smithi112.stdout:(6/34): ceph-osd-17.2.7-1637.g6e06d1e0.el9.x86_ 30 MB/s | 15 MB 00:00 2024-09-19T09:23:54.749 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-19T09:23:54.749 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:23:54.749 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:23:54.749 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:54.749 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:23:54.749 INFO:teuthology.orchestra.run.smithi191.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:23:54.750 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:23:54.750 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:23:54.750 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:23:55.021 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph 2024-09-19T09:23:55.096 INFO:teuthology.orchestra.run.smithi112.stdout:(7/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 353 kB/s | 253 kB 00:00 2024-09-19T09:23:55.204 INFO:teuthology.orchestra.run.smithi112.stdout:(8/34): python3-ply-3.11-14.el9.noarch.rpm 232 kB/s | 106 kB 00:00 2024-09-19T09:23:55.229 INFO:teuthology.orchestra.run.smithi112.stdout:(9/34): python3-pycparser-2.20-6.el9.noarch.rpm 1.0 MB/s | 135 kB 00:00 2024-09-19T09:23:55.355 INFO:teuthology.orchestra.run.smithi112.stdout:(10/34): python3-urllib3-1.26.5-6.el9.noarch.rp 1.7 MB/s | 215 kB 00:00 2024-09-19T09:23:55.405 INFO:teuthology.orchestra.run.smithi112.stdout:(11/34): python3-requests-2.25.1-8.el9.noarch.r 623 kB/s | 125 kB 00:00 2024-09-19T09:23:55.439 INFO:teuthology.orchestra.run.smithi112.stdout:(12/34): python3-cryptography-36.0.1-4.el9.x86_ 1.2 MB/s | 1.2 MB 00:00 2024-09-19T09:23:55.608 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:38 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:23:55.743 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:23:55.745 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:23:55.746 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-09-19T09:23:55.746 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:23:55.746 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:23:55.746 INFO:teuthology.orchestra.run.smithi191.stdout: ceph x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 6.5 k 2024-09-19T09:23:55.746 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-09-19T09:23:55.746 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.1 M 2024-09-19T09:23:55.746 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 1.4 M 2024-09-19T09:23:55.746 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 240 k 2024-09-19T09:23:55.746 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 3.9 M 2024-09-19T09:23:55.746 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 15 M 2024-09-19T09:23:55.746 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:23:55.747 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:23:55.747 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:23:55.747 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:23:55.747 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:23:55.747 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:23:55.747 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:23:55.747 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections 2024-09-19T09:23:55.747 INFO:teuthology.orchestra.run.smithi191.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:23:55.747 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:23:55.747 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:23:55.747 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:23:55.747 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:23:55.747 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:23:55.748 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:23:55.748 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:23:55.748 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:23:55.748 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:23:55.748 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:23:55.748 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:23:55.748 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:23:55.748 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:23:55.748 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:23:55.748 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:23:55.748 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:23:55.748 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:23:55.748 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:23:55.749 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:23:55.749 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:23:55.749 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:23:55.749 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:23:55.749 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:23:55.749 INFO:teuthology.orchestra.run.smithi191.stdout:Install 34 Packages 2024-09-19T09:23:55.749 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:23:55.750 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 27 M 2024-09-19T09:23:55.750 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 96 M 2024-09-19T09:23:55.750 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:23:56.022 INFO:teuthology.orchestra.run.smithi112.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 56 kB/s | 35 kB 00:00 2024-09-19T09:23:56.089 INFO:teuthology.orchestra.run.smithi112.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 235 kB/s | 172 kB 00:00 2024-09-19T09:23:56.122 INFO:teuthology.orchestra.run.smithi112.stdout:(15/34): python3-packaging-20.9-5.el9.noarch.rp 113 kB/s | 77 kB 00:00 2024-09-19T09:23:56.164 INFO:teuthology.orchestra.run.smithi112.stdout:(16/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-09-19T09:23:56.190 INFO:teuthology.orchestra.run.smithi112.stdout:(17/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.7 MB/s | 172 kB 00:00 2024-09-19T09:23:56.223 INFO:teuthology.orchestra.run.smithi112.stdout:(18/34): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-09-19T09:23:56.249 INFO:teuthology.orchestra.run.smithi112.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-19T09:23:56.274 INFO:teuthology.orchestra.run.smithi112.stdout:(20/34): python3-jaraco-classes-3.2.1-5.el9.noa 710 kB/s | 18 kB 00:00 2024-09-19T09:23:56.299 INFO:teuthology.orchestra.run.smithi112.stdout:(21/34): python3-jaraco-collections-3.0.0-8.el9 935 kB/s | 23 kB 00:00 2024-09-19T09:23:56.332 INFO:teuthology.orchestra.run.smithi112.stdout:(22/34): python3-jaraco-functools-3.5.0-2.el9.n 772 kB/s | 19 kB 00:00 2024-09-19T09:23:56.358 INFO:teuthology.orchestra.run.smithi112.stdout:(23/34): python3-jaraco-text-3.2.0-6.el9.noarch 786 kB/s | 20 kB 00:00 2024-09-19T09:23:56.391 INFO:teuthology.orchestra.run.smithi112.stdout:(24/34): python3-logutils-0.3.5-21.el9.noarch.r 1.8 MB/s | 46 kB 00:00 2024-09-19T09:23:56.396 INFO:teuthology.orchestra.run.smithi191.stdout:(1/34): ceph-17.2.7-1637.g6e06d1e0.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-19T09:23:56.417 INFO:teuthology.orchestra.run.smithi112.stdout:(25/34): python3-more-itertools-8.12.0-2.el9.no 3.2 MB/s | 79 kB 00:00 2024-09-19T09:23:56.442 INFO:teuthology.orchestra.run.smithi112.stdout:(26/34): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-19T09:23:56.467 INFO:teuthology.orchestra.run.smithi112.stdout:(27/34): python3-portend-3.1.0-2.el9.noarch.rpm 656 kB/s | 16 kB 00:00 2024-09-19T09:23:56.492 INFO:teuthology.orchestra.run.smithi112.stdout:(28/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.6 MB/s | 90 kB 00:00 2024-09-19T09:23:56.518 INFO:teuthology.orchestra.run.smithi112.stdout:(29/34): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-19T09:23:56.551 INFO:teuthology.orchestra.run.smithi112.stdout:(30/34): python3-webob-1.8.8-2.el9.noarch.rpm 6.8 MB/s | 230 kB 00:00 2024-09-19T09:23:56.593 INFO:teuthology.orchestra.run.smithi112.stdout:(31/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 10 MB/s | 427 kB 00:00 2024-09-19T09:23:56.596 INFO:teuthology.orchestra.run.smithi191.stdout:(2/34): ceph-mds-17.2.7-1637.g6e06d1e0.el9.x86_ 6.3 MB/s | 2.1 MB 00:00 2024-09-19T09:23:56.619 INFO:teuthology.orchestra.run.smithi112.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 796 kB/s | 20 kB 00:00 2024-09-19T09:23:56.638 INFO:teuthology.orchestra.run.smithi191.stdout:(3/34): ceph-mgr-17.2.7-1637.g6e06d1e0.el9.x86_ 3.8 MB/s | 1.4 MB 00:00 2024-09-19T09:23:56.702 INFO:teuthology.orchestra.run.smithi112.stdout:(33/34): python3-pytz-2021.1-5.el9.noarch.rpm 75 kB/s | 51 kB 00:00 2024-09-19T09:23:56.747 INFO:teuthology.orchestra.run.smithi191.stdout:(4/34): ceph-mon-17.2.7-1637.g6e06d1e0.el9.x86_ 11 MB/s | 3.9 MB 00:00 2024-09-19T09:23:56.789 INFO:teuthology.orchestra.run.smithi191.stdout:(5/34): ceph-mgr-modules-core-17.2.7-1637.g6e06 1.6 MB/s | 240 kB 00:00 2024-09-19T09:23:56.794 INFO:teuthology.orchestra.run.smithi112.stdout:(34/34): python3-toml-0.10.2-6.el9.noarch.rpm 59 kB/s | 42 kB 00:00 2024-09-19T09:23:56.799 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:23:56.799 INFO:teuthology.orchestra.run.smithi112.stdout:Total 8.5 MB/s | 27 MB 00:03 2024-09-19T09:23:56.914 INFO:teuthology.orchestra.run.smithi191.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-19T09:23:56.934 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:23:56.973 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:23:56.973 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:23:57.123 INFO:teuthology.orchestra.run.smithi191.stdout:(7/34): ceph-osd-17.2.7-1637.g6e06d1e0.el9.x86_ 29 MB/s | 15 MB 00:00 2024-09-19T09:23:57.148 INFO:teuthology.orchestra.run.smithi191.stdout:(8/34): python3-ply-3.11-14.el9.noarch.rpm 456 kB/s | 106 kB 00:00 2024-09-19T09:23:57.190 INFO:teuthology.orchestra.run.smithi191.stdout:(9/34): python3-cryptography-36.0.1-4.el9.x86_6 3.1 MB/s | 1.2 MB 00:00 2024-09-19T09:23:57.224 INFO:teuthology.orchestra.run.smithi191.stdout:(10/34): python3-requests-2.25.1-8.el9.noarch.r 1.6 MB/s | 125 kB 00:00 2024-09-19T09:23:57.265 INFO:teuthology.orchestra.run.smithi191.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-09-19T09:23:57.290 INFO:teuthology.orchestra.run.smithi191.stdout:(12/34): python3-pycparser-2.20-6.el9.noarch.rp 807 kB/s | 135 kB 00:00 2024-09-19T09:23:57.349 INFO:teuthology.orchestra.run.smithi191.stdout:(13/34): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-19T09:23:57.366 INFO:teuthology.orchestra.run.smithi191.stdout:(14/34): python3-markupsafe-1.1.1-12.el9.x86_64 345 kB/s | 35 kB 00:00 2024-09-19T09:23:57.392 INFO:teuthology.orchestra.run.smithi191.stdout:(15/34): python3-packaging-20.9-5.el9.noarch.rp 765 kB/s | 77 kB 00:00 2024-09-19T09:23:57.396 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:23:57.397 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:23:57.417 INFO:teuthology.orchestra.run.smithi191.stdout:(16/34): python3-pytz-2021.1-5.el9.noarch.rpm 758 kB/s | 51 kB 00:00 2024-09-19T09:23:57.442 INFO:teuthology.orchestra.run.smithi191.stdout:(17/34): python3-toml-0.10.2-6.el9.noarch.rpm 550 kB/s | 42 kB 00:00 2024-09-19T09:23:57.484 INFO:teuthology.orchestra.run.smithi191.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 472 kB/s | 43 kB 00:00 2024-09-19T09:23:57.509 INFO:teuthology.orchestra.run.smithi191.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 465 kB/s | 11 kB 00:00 2024-09-19T09:23:57.535 INFO:teuthology.orchestra.run.smithi191.stdout:(20/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-19T09:23:57.560 INFO:teuthology.orchestra.run.smithi191.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-09-19T09:23:57.585 INFO:teuthology.orchestra.run.smithi191.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-19T09:23:57.610 INFO:teuthology.orchestra.run.smithi191.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 385 kB/s | 19 kB 00:00 2024-09-19T09:23:57.627 INFO:teuthology.orchestra.run.smithi191.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 469 kB/s | 20 kB 00:00 2024-09-19T09:23:57.653 INFO:teuthology.orchestra.run.smithi191.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2024-09-19T09:23:57.678 INFO:teuthology.orchestra.run.smithi191.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-19T09:23:57.703 INFO:teuthology.orchestra.run.smithi191.stdout:(27/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-19T09:23:57.720 INFO:teuthology.orchestra.run.smithi191.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 391 kB/s | 16 kB 00:00 2024-09-19T09:23:57.745 INFO:teuthology.orchestra.run.smithi191.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-19T09:23:57.762 INFO:teuthology.orchestra.run.smithi191.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 852 kB/s | 36 kB 00:00 2024-09-19T09:23:57.796 INFO:teuthology.orchestra.run.smithi191.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-19T09:23:57.821 INFO:teuthology.orchestra.run.smithi191.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 798 kB/s | 20 kB 00:00 2024-09-19T09:23:57.855 INFO:teuthology.orchestra.run.smithi191.stdout:(33/34): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-19T09:23:57.888 INFO:teuthology.orchestra.run.smithi191.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-09-19T09:23:57.892 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:23:57.892 INFO:teuthology.orchestra.run.smithi191.stdout:Total 13 MB/s | 27 MB 00:02 2024-09-19T09:23:58.016 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:23:58.054 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:23:58.054 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:23:58.449 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:23:58.450 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:23:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:23:58.722 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-19T09:23:58.754 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-19T09:23:58.795 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-19T09:23:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-19T09:23:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-19T09:23:59.015 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-19T09:23:59.050 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-19T09:23:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-19T09:23:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-19T09:23:59.147 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-19T09:23:59.188 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-19T09:23:59.242 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-19T09:23:59.277 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-19T09:23:59.325 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-19T09:23:59.357 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-19T09:23:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-19T09:23:59.577 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-19T09:23:59.665 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-19T09:23:59.707 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:23:59.718 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-19T09:23:59.756 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-19T09:23:59.766 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-19T09:23:59.798 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-19T09:23:59.806 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-19T09:23:59.839 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-19T09:23:59.869 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-19T09:23:59.931 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-19T09:24:00.018 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-19T09:24:00.056 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-19T09:24:00.059 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-19T09:24:00.093 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-19T09:24:00.111 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-19T09:24:00.123 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-19T09:24:00.158 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-19T09:24:00.188 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-19T09:24:00.191 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-19T09:24:00.224 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-19T09:24:00.267 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-19T09:24:00.277 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-19T09:24:00.301 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-19T09:24:00.319 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-19T09:24:00.345 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-19T09:24:00.377 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-19T09:24:00.434 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-19T09:24:00.474 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-19T09:24:00.588 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9. 29/34 2024-09-19T09:24:00.619 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 30/34 2024-09-19T09:24:00.622 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-19T09:24:00.645 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 30/34 2024-09-19T09:24:00.646 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:24:00.646 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:24:00.646 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:24:00.646 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:24:00.646 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:00.702 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-19T09:24:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-19T09:24:00.793 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-19T09:24:00.851 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-19T09:24:00.906 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-19T09:24:01.105 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-19T09:24:01.149 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-19T09:24:01.228 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-19T09:24:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-19T09:24:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-19T09:24:01.498 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-19T09:24:01.645 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9. 29/34 2024-09-19T09:24:01.675 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 30/34 2024-09-19T09:24:01.701 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 30/34 2024-09-19T09:24:01.701 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:24:01.701 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:24:01.701 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:24:01.701 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:24:01.702 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:01.956 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 31/34 2024-09-19T09:24:01.982 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 31/34 2024-09-19T09:24:01.982 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:24:01.982 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:24:01.982 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:24:01.982 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:24:01.982 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:02.355 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 32/34 2024-09-19T09:24:02.378 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 32/34 2024-09-19T09:24:02.379 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:24:02.379 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:24:02.379 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:24:02.379 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:24:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:02.589 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 33/34 2024-09-19T09:24:02.612 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 33/34 2024-09-19T09:24:02.612 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:24:02.612 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:24:02.612 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:24:02.612 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:24:02.612 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:02.677 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 34/34 2024-09-19T09:24:03.035 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 31/34 2024-09-19T09:24:03.064 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 31/34 2024-09-19T09:24:03.064 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:24:03.064 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:24:03.065 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:24:03.065 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:24:03.065 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:03.436 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 32/34 2024-09-19T09:24:03.460 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 32/34 2024-09-19T09:24:03.460 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:24:03.460 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:24:03.460 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:24:03.460 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:24:03.460 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:03.662 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 33/34 2024-09-19T09:24:03.685 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 33/34 2024-09-19T09:24:03.685 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:24:03.686 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:24:03.686 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:24:03.686 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:24:03.686 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:03.750 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 34/34 2024-09-19T09:24:04.318 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 34/34 2024-09-19T09:24:04.318 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/34 2024-09-19T09:24:04.318 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/34 2024-09-19T09:24:04.319 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/34 2024-09-19T09:24:04.319 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/34 2024-09-19T09:24:04.319 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 5/34 2024-09-19T09:24:04.319 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9. 6/34 2024-09-19T09:24:04.319 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-19T09:24:04.319 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-19T09:24:04.319 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-19T09:24:04.319 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-19T09:24:04.319 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-19T09:24:04.319 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-19T09:24:04.319 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-19T09:24:04.319 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-19T09:24:04.320 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-19T09:24:04.320 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-19T09:24:04.320 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-19T09:24:04.320 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-19T09:24:04.320 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-19T09:24:04.320 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-19T09:24:04.320 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-19T09:24:04.320 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-19T09:24:04.320 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-19T09:24:04.320 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-19T09:24:04.320 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-19T09:24:04.320 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-19T09:24:04.321 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-19T09:24:04.321 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-19T09:24:04.321 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-19T09:24:04.321 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-19T09:24:04.322 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-19T09:24:04.322 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-19T09:24:04.322 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-19T09:24:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-19T09:24:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:05.239 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:24:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:24:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:24:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:24:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:24:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:24:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:24:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:24:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:24:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:24:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:24:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:24:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:24:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:24:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:24:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:24:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:24:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:24:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:24:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:24:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:24:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:24:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:24:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:24:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:24:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:24:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:24:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:24:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:24:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:05.242 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 34/34 2024-09-19T09:24:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/34 2024-09-19T09:24:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/34 2024-09-19T09:24:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/34 2024-09-19T09:24:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/34 2024-09-19T09:24:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 5/34 2024-09-19T09:24:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9. 6/34 2024-09-19T09:24:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-19T09:24:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-19T09:24:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-19T09:24:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-19T09:24:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-19T09:24:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-19T09:24:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-19T09:24:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-19T09:24:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-19T09:24:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-19T09:24:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-19T09:24:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-19T09:24:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-19T09:24:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-19T09:24:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-19T09:24:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-19T09:24:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-19T09:24:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-19T09:24:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-19T09:24:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-19T09:24:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-19T09:24:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-19T09:24:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-19T09:24:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-19T09:24:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-19T09:24:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-19T09:24:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-19T09:24:05.600 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-base 2024-09-19T09:24:06.181 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:51 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:06.271 INFO:teuthology.orchestra.run.smithi112.stdout:Package ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:06.312 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:06.313 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-19T09:24:06.313 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:06.386 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install cephadm 2024-09-19T09:24:06.422 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-19T09:24:06.422 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:06.423 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:24:06.423 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:06.423 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:06.423 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:06.423 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:06.423 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:06.423 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:06.423 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:24:06.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:24:06.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:24:06.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:24:06.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:24:06.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:24:06.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:24:06.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:24:06.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:24:06.425 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:24:06.425 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:24:06.425 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:24:06.425 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:24:06.425 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:24:06.425 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:24:06.425 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:24:06.425 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:24:06.426 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:24:06.426 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:24:06.426 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:24:06.426 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:24:06.426 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:24:06.426 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:24:06.426 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:24:06.426 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:24:06.427 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:24:06.427 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:24:06.427 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:24:06.427 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:06.427 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:06.783 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-base 2024-09-19T09:24:06.959 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:51 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:07.089 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:07.090 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:07.090 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-19T09:24:07.090 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:07.090 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:24:07.090 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 83 k 2024-09-19T09:24:07.090 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:07.090 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:24:07.090 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:07.090 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-19T09:24:07.090 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:07.090 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 83 k 2024-09-19T09:24:07.090 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 375 k 2024-09-19T09:24:07.091 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:24:07.277 INFO:teuthology.orchestra.run.smithi112.stdout:cephadm-17.2.7-1637.g6e06d1e0.el9.noarch.rpm 443 kB/s | 83 kB 00:00 2024-09-19T09:24:07.278 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:07.278 INFO:teuthology.orchestra.run.smithi112.stdout:Total 440 kB/s | 83 kB 00:00 2024-09-19T09:24:07.278 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:24:07.283 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:24:07.283 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:24:07.285 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:24:07.285 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:24:07.365 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:50 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:07.368 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:24:07.454 INFO:teuthology.orchestra.run.smithi191.stdout:Package ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:07.496 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:07.497 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-09-19T09:24:07.497 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:07.565 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install cephadm 2024-09-19T09:24:07.760 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T09:24:07.856 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T09:24:08.241 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:51 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:08.272 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:08.273 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:08.273 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 83 k 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 83 k 2024-09-19T09:24:08.275 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 375 k 2024-09-19T09:24:08.275 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:24:08.316 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T09:24:08.461 INFO:teuthology.orchestra.run.smithi191.stdout:cephadm-17.2.7-1637.g6e06d1e0.el9.noarch.rpm 443 kB/s | 83 kB 00:00 2024-09-19T09:24:08.461 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:08.462 INFO:teuthology.orchestra.run.smithi191.stdout:Total 439 kB/s | 83 kB 00:00 2024-09-19T09:24:08.462 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:24:08.467 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:24:08.467 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:24:08.468 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:24:08.469 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:24:08.547 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:24:08.568 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T09:24:08.569 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:08.569 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:24:08.569 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:08.569 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:08.569 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:08.779 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-immutable-object-cache 2024-09-19T09:24:09.035 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T09:24:09.138 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T09:24:09.364 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:54 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:09.499 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:09.500 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-09-19T09:24:09.501 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:09.501 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:24:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 137 k 2024-09-19T09:24:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:09.502 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:24:09.502 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:09.502 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-19T09:24:09.502 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:09.502 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 137 k 2024-09-19T09:24:09.502 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 379 k 2024-09-19T09:24:09.503 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:24:09.512 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T09:24:09.716 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-immutable-object-cache-17.2.7-1637.g6e06d1 641 kB/s | 137 kB 00:00 2024-09-19T09:24:09.717 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:09.717 INFO:teuthology.orchestra.run.smithi112.stdout:Total 636 kB/s | 137 kB 00:00 2024-09-19T09:24:09.718 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:24:09.724 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:24:09.724 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:24:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T09:24:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:09.758 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:24:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:09.758 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:09.782 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:24:09.782 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:24:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:24:09.946 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-immutable-object-cache 2024-09-19T09:24:09.983 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-19T09:24:10.008 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-19T09:24:10.008 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:24:10.008 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:24:10.008 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:10.539 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:53 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:10.674 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:10.674 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:10.675 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repo Size 2024-09-19T09:24:10.675 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:10.675 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:24:10.675 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 137 k 2024-09-19T09:24:10.675 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:10.675 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:24:10.675 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:10.675 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2024-09-19T09:24:10.675 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:10.676 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 137 k 2024-09-19T09:24:10.676 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 379 k 2024-09-19T09:24:10.676 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:24:10.883 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-immutable-object-cache-17.2.7-1637.g6e06d1 664 kB/s | 137 kB 00:00 2024-09-19T09:24:10.884 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:10.885 INFO:teuthology.orchestra.run.smithi191.stdout:Total 659 kB/s | 137 kB 00:00 2024-09-19T09:24:10.885 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:24:10.891 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:24:10.892 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:24:10.925 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-19T09:24:10.925 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:10.925 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:24:10.925 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:10.925 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:10.925 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:10.948 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:24:10.948 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:24:11.087 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:24:11.136 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr 2024-09-19T09:24:11.142 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-19T09:24:11.167 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-19T09:24:11.167 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:24:11.167 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:24:11.167 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:11.724 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:56 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:11.815 INFO:teuthology.orchestra.run.smithi112.stdout:Package ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:11.856 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:11.857 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-19T09:24:11.857 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:11.920 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-dashboard 2024-09-19T09:24:12.158 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-19T09:24:12.158 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:12.158 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:24:12.158 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:12.158 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:12.158 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:12.387 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-mgr 2024-09-19T09:24:12.484 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:57 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:12.613 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:12.613 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:12.614 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-19T09:24:12.614 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:12.614 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:24:12.614 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 3.4 M 2024-09-19T09:24:12.614 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-19T09:24:12.614 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 24 k 2024-09-19T09:24:12.614 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 15 k 2024-09-19T09:24:12.614 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-19T09:24:12.614 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:24:12.614 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:24:12.614 INFO:teuthology.orchestra.run.smithi112.stdout:Installing weak dependencies: 2024-09-19T09:24:12.614 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-19T09:24:12.614 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:12.614 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:24:12.615 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:12.615 INFO:teuthology.orchestra.run.smithi112.stdout:Install 7 Packages 2024-09-19T09:24:12.615 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:12.615 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 3.7 M 2024-09-19T09:24:12.615 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 80 M 2024-09-19T09:24:12.615 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:24:12.835 INFO:teuthology.orchestra.run.smithi112.stdout:(1/7): ceph-prometheus-alerts-17.2.7-1637.g6e06 99 kB/s | 15 kB 00:00 2024-09-19T09:24:12.861 INFO:teuthology.orchestra.run.smithi112.stdout:(2/7): ceph-grafana-dashboards-17.2.7-1637.g6e0 141 kB/s | 24 kB 00:00 2024-09-19T09:24:12.903 INFO:teuthology.orchestra.run.smithi112.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-19T09:24:12.928 INFO:teuthology.orchestra.run.smithi112.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-19T09:24:12.953 INFO:teuthology.orchestra.run.smithi112.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 444 kB/s | 41 kB 00:00 2024-09-19T09:24:12.978 INFO:teuthology.orchestra.run.smithi112.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-19T09:24:13.003 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:56 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:13.093 INFO:teuthology.orchestra.run.smithi191.stdout:Package ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:13.095 INFO:teuthology.orchestra.run.smithi112.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1637.g6e06d1e0 8.2 MB/s | 3.4 MB 00:00 2024-09-19T09:24:13.099 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:13.099 INFO:teuthology.orchestra.run.smithi112.stdout:Total 7.5 MB/s | 3.7 MB 00:00 2024-09-19T09:24:13.099 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:24:13.107 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:24:13.107 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:24:13.135 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:13.136 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-09-19T09:24:13.136 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:13.192 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:24:13.192 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:24:13.210 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-mgr-dashboard 2024-09-19T09:24:13.496 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:24:13.563 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-19T09:24:13.619 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-19T09:24:13.671 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-19T09:24:13.703 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-19T09:24:13.740 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.n 5/7 2024-09-19T09:24:13.789 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:56 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:13.920 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:13.921 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:13.921 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-09-19T09:24:13.921 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:13.921 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:24:13.921 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 3.4 M 2024-09-19T09:24:13.921 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-09-19T09:24:13.921 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 24 k 2024-09-19T09:24:13.922 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 15 k 2024-09-19T09:24:13.922 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-19T09:24:13.922 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:24:13.922 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:24:13.922 INFO:teuthology.orchestra.run.smithi191.stdout:Installing weak dependencies: 2024-09-19T09:24:13.922 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-19T09:24:13.922 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:13.922 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:24:13.922 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:13.922 INFO:teuthology.orchestra.run.smithi191.stdout:Install 7 Packages 2024-09-19T09:24:13.922 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:13.923 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 3.7 M 2024-09-19T09:24:13.923 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 80 M 2024-09-19T09:24:13.923 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:24:14.095 INFO:teuthology.orchestra.run.smithi191.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1637.g6e0 173 kB/s | 24 kB 00:00 2024-09-19T09:24:14.121 INFO:teuthology.orchestra.run.smithi191.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1637.g6e06 88 kB/s | 15 kB 00:00 2024-09-19T09:24:14.163 INFO:teuthology.orchestra.run.smithi191.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-19T09:24:14.188 INFO:teuthology.orchestra.run.smithi191.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-19T09:24:14.213 INFO:teuthology.orchestra.run.smithi191.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 443 kB/s | 41 kB 00:00 2024-09-19T09:24:14.238 INFO:teuthology.orchestra.run.smithi191.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-19T09:24:14.364 INFO:teuthology.orchestra.run.smithi191.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1637.g6e06d1e0 8.2 MB/s | 3.4 MB 00:00 2024-09-19T09:24:14.367 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:14.368 INFO:teuthology.orchestra.run.smithi191.stdout:Total 8.2 MB/s | 3.7 MB 00:00 2024-09-19T09:24:14.368 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:24:14.376 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:24:14.376 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:24:14.453 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:24:14.453 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:24:14.729 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9. 6/7 2024-09-19T09:24:14.752 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:24:14.768 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 7/7 2024-09-19T09:24:14.831 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-19T09:24:14.865 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-19T09:24:14.921 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-19T09:24:14.952 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-19T09:24:14.981 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.n 5/7 2024-09-19T09:24:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 7/7 2024-09-19T09:24:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9. 1/7 2024-09-19T09:24:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 2/7 2024-09-19T09:24:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.n 3/7 2024-09-19T09:24:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-19T09:24:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-19T09:24:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-19T09:24:15.987 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9. 6/7 2024-09-19T09:24:16.026 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 7/7 2024-09-19T09:24:16.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-19T09:24:16.109 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:16.109 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:24:16.109 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:16.109 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:16.109 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:16.109 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-19T09:24:16.109 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-19T09:24:16.110 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:24:16.110 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:24:16.110 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:16.110 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:16.323 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-19T09:24:16.898 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:01 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:17.033 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:17.034 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-09-19T09:24:17.034 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-19T09:24:17.034 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-09-19T09:24:17.034 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:24:17.034 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 7.4 M 2024-09-19T09:24:17.034 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-19T09:24:17.034 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:24:17.034 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:24:17.035 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:24:17.035 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:24:17.035 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:24:17.035 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:24:17.035 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:24:17.035 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:24:17.035 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:24:17.035 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:24:17.035 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:24:17.035 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:17.035 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:24:17.035 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-09-19T09:24:17.035 INFO:teuthology.orchestra.run.smithi112.stdout:Install 12 Packages 2024-09-19T09:24:17.036 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:17.036 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 38 M 2024-09-19T09:24:17.036 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 212 M 2024-09-19T09:24:17.036 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:24:17.117 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 7/7 2024-09-19T09:24:17.117 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9. 1/7 2024-09-19T09:24:17.117 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 2/7 2024-09-19T09:24:17.117 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.n 3/7 2024-09-19T09:24:17.117 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-19T09:24:17.118 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-19T09:24:17.118 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-19T09:24:17.408 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-19T09:24:17.408 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:17.408 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:24:17.409 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:17.409 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:17.409 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:17.409 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-19T09:24:17.409 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-19T09:24:17.409 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:24:17.409 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:24:17.409 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:17.409 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:17.454 INFO:teuthology.orchestra.run.smithi112.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-19T09:24:17.496 INFO:teuthology.orchestra.run.smithi112.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.2 MB/s | 801 kB 00:00 2024-09-19T09:24:17.563 INFO:teuthology.orchestra.run.smithi112.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-19T09:24:17.605 INFO:teuthology.orchestra.run.smithi112.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 436 kB/s | 18 kB 00:00 2024-09-19T09:24:17.627 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-19T09:24:17.664 INFO:teuthology.orchestra.run.smithi112.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 662 kB/s | 38 kB 00:00 2024-09-19T09:24:17.748 INFO:teuthology.orchestra.run.smithi112.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-09-19T09:24:17.840 INFO:teuthology.orchestra.run.smithi112.stdout:(7/12): ceph-mgr-diskprediction-local-17.2.7-16 14 MB/s | 7.4 MB 00:00 2024-09-19T09:24:17.865 INFO:teuthology.orchestra.run.smithi112.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-19T09:24:17.907 INFO:teuthology.orchestra.run.smithi112.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 5.9 MB/s | 250 kB 00:00 2024-09-19T09:24:17.999 INFO:teuthology.orchestra.run.smithi112.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 15 MB/s | 4.9 MB 00:00 2024-09-19T09:24:18.199 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:01 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:18.233 INFO:teuthology.orchestra.run.smithi112.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 50 MB/s | 16 MB 00:00 2024-09-19T09:24:18.308 INFO:teuthology.orchestra.run.smithi112.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-19T09:24:18.308 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:18.309 INFO:teuthology.orchestra.run.smithi112.stdout:Total 30 MB/s | 38 MB 00:01 2024-09-19T09:24:18.333 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:18.335 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-09-19T09:24:18.335 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-09-19T09:24:18.335 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-09-19T09:24:18.335 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:24:18.335 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 7.4 M 2024-09-19T09:24:18.335 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-09-19T09:24:18.335 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:24:18.335 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:24:18.335 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:24:18.335 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:24:18.335 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:24:18.335 INFO:teuthology.orchestra.run.smithi191.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:24:18.336 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:24:18.336 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:24:18.336 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:24:18.336 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:24:18.336 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:24:18.336 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:18.336 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:24:18.336 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-09-19T09:24:18.336 INFO:teuthology.orchestra.run.smithi191.stdout:Install 12 Packages 2024-09-19T09:24:18.336 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:18.337 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 38 M 2024-09-19T09:24:18.337 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 212 M 2024-09-19T09:24:18.337 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:24:18.662 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:24:18.688 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:24:18.688 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:24:18.746 INFO:teuthology.orchestra.run.smithi191.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-19T09:24:18.830 INFO:teuthology.orchestra.run.smithi191.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.4 MB/s | 801 kB 00:00 2024-09-19T09:24:18.914 INFO:teuthology.orchestra.run.smithi191.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 196 kB/s | 33 kB 00:00 2024-09-19T09:24:18.964 INFO:teuthology.orchestra.run.smithi191.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-09-19T09:24:19.023 INFO:teuthology.orchestra.run.smithi191.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 660 kB/s | 38 kB 00:00 2024-09-19T09:24:19.131 INFO:teuthology.orchestra.run.smithi191.stdout:(6/12): ceph-mgr-diskprediction-local-17.2.7-16 14 MB/s | 7.4 MB 00:00 2024-09-19T09:24:19.187 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:24:19.187 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:24:19.306 INFO:teuthology.orchestra.run.smithi191.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.3 MB/s | 3.0 MB 00:00 2024-09-19T09:24:19.357 INFO:teuthology.orchestra.run.smithi191.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-09-19T09:24:19.440 INFO:teuthology.orchestra.run.smithi191.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-19T09:24:19.515 INFO:teuthology.orchestra.run.smithi191.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 10 MB/s | 4.9 MB 00:00 2024-09-19T09:24:19.682 INFO:teuthology.orchestra.run.smithi191.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-19T09:24:19.944 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:24:20.020 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-19T09:24:20.064 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-19T09:24:20.170 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-19T09:24:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-19T09:24:20.299 INFO:teuthology.orchestra.run.smithi191.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-19T09:24:20.300 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:20.300 INFO:teuthology.orchestra.run.smithi191.stdout:Total 19 MB/s | 38 MB 00:01 2024-09-19T09:24:20.391 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-19T09:24:20.422 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-19T09:24:20.499 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-19T09:24:20.652 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:24:20.678 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:24:20.678 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:24:21.159 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-19T09:24:21.170 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:24:21.170 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:24:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-19T09:24:21.927 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:24:21.998 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-19T09:24:22.047 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-19T09:24:22.154 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-19T09:24:22.198 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-19T09:24:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-19T09:24:22.414 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-19T09:24:22.517 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T09:24:22.521 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-19T09:24:23.173 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-19T09:24:23.293 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-19T09:24:23.557 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-19T09:24:23.588 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 12/12 2024-09-19T09:24:24.543 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T09:24:25.591 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-19T09:24:25.613 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 12/12 2024-09-19T09:24:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 12/12 2024-09-19T09:24:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 1/12 2024-09-19T09:24:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-19T09:24:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-19T09:24:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-19T09:24:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-19T09:24:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-19T09:24:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-19T09:24:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-19T09:24:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-19T09:24:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T09:24:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-19T09:24:26.592 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-19T09:24:26.592 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:26.592 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:24:26.592 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:26.592 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:24:26.592 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:24:26.592 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:24:26.592 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:24:26.593 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:24:26.593 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:24:26.593 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:24:26.593 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:24:26.593 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:24:26.593 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:24:26.593 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:24:26.593 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:26.593 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:26.941 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-rook 2024-09-19T09:24:27.537 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:12 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:27.676 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:27.677 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:27.677 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-19T09:24:27.677 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:27.677 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:24:27.677 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 47 k 2024-09-19T09:24:27.677 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-19T09:24:27.677 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:24:27.678 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:24:27.678 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:24:27.678 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:24:27.678 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:24:27.678 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:24:27.678 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:24:27.678 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:24:27.678 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:24:27.678 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:24:27.678 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:24:27.678 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:24:27.678 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:27.678 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:24:27.678 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:27.679 INFO:teuthology.orchestra.run.smithi112.stdout:Install 13 Packages 2024-09-19T09:24:27.679 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:27.679 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 2.2 M 2024-09-19T09:24:27.679 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 26 M 2024-09-19T09:24:27.679 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:24:28.080 INFO:teuthology.orchestra.run.smithi112.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 224 kB/s | 19 kB 00:00 2024-09-19T09:24:28.105 INFO:teuthology.orchestra.run.smithi112.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 231 kB/s | 26 kB 00:00 2024-09-19T09:24:28.164 INFO:teuthology.orchestra.run.smithi112.stdout:(3/13): ceph-mgr-rook-17.2.7-1637.g6e06d1e0.el9 280 kB/s | 47 kB 00:00 2024-09-19T09:24:28.189 INFO:teuthology.orchestra.run.smithi112.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-19T09:24:28.214 INFO:teuthology.orchestra.run.smithi112.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-19T09:24:28.231 INFO:teuthology.orchestra.run.smithi112.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.2 MB/s | 54 kB 00:00 2024-09-19T09:24:28.252 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 12/12 2024-09-19T09:24:28.252 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 1/12 2024-09-19T09:24:28.252 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-19T09:24:28.252 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-19T09:24:28.252 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-19T09:24:28.252 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-19T09:24:28.252 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-19T09:24:28.252 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-19T09:24:28.253 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-19T09:24:28.253 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-19T09:24:28.253 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T09:24:28.253 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-19T09:24:28.265 INFO:teuthology.orchestra.run.smithi112.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 640 kB/s | 32 kB 00:00 2024-09-19T09:24:28.282 INFO:teuthology.orchestra.run.smithi112.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 325 kB/s | 14 kB 00:00 2024-09-19T09:24:28.316 INFO:teuthology.orchestra.run.smithi112.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.4 MB/s | 220 kB 00:00 2024-09-19T09:24:28.341 INFO:teuthology.orchestra.run.smithi112.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T09:24:28.374 INFO:teuthology.orchestra.run.smithi112.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-09-19T09:24:28.400 INFO:teuthology.orchestra.run.smithi112.stdout:(12/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.2 MB/s | 279 kB 00:00 2024-09-19T09:24:28.451 INFO:teuthology.orchestra.run.smithi112.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.1 MB/s | 1.0 MB 00:00 2024-09-19T09:24:28.453 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:28.453 INFO:teuthology.orchestra.run.smithi112.stdout:Total 2.9 MB/s | 2.2 MB 00:00 2024-09-19T09:24:28.521 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:24:28.536 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:24:28.536 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:24:28.623 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:24:28.623 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:24:28.696 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-19T09:24:28.696 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:28.696 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:24:28.696 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:28.697 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:24:28.697 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:24:28.697 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:24:28.697 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:24:28.697 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:24:28.697 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:24:28.697 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:24:28.697 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:24:28.697 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:24:28.697 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:24:28.697 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:24:28.697 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:28.698 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:29.058 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-mgr-rook 2024-09-19T09:24:29.121 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:24:29.298 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-19T09:24:29.351 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-19T09:24:29.415 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-19T09:24:29.452 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-19T09:24:29.502 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-19T09:24:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-19T09:24:29.656 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:12 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-19T09:24:29.762 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-19T09:24:29.789 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:29.790 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:29.790 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-09-19T09:24:29.791 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:29.791 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:24:29.791 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 47 k 2024-09-19T09:24:29.791 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-09-19T09:24:29.791 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:24:29.792 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:24:29.792 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:24:29.792 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:24:29.792 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:24:29.792 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:24:29.792 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:24:29.793 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:24:29.793 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:24:29.793 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:24:29.793 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:24:29.793 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:24:29.793 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:29.794 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:24:29.794 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:29.794 INFO:teuthology.orchestra.run.smithi191.stdout:Install 13 Packages 2024-09-19T09:24:29.794 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:29.795 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 2.2 M 2024-09-19T09:24:29.795 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 26 M 2024-09-19T09:24:29.796 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:24:30.096 INFO:teuthology.orchestra.run.smithi191.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 158 kB/s | 19 kB 00:00 2024-09-19T09:24:30.121 INFO:teuthology.orchestra.run.smithi191.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 175 kB/s | 26 kB 00:00 2024-09-19T09:24:30.146 INFO:teuthology.orchestra.run.smithi191.stdout:(3/13): ceph-mgr-rook-17.2.7-1637.g6e06d1e0.el9 277 kB/s | 47 kB 00:00 2024-09-19T09:24:30.205 INFO:teuthology.orchestra.run.smithi191.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-19T09:24:30.255 INFO:teuthology.orchestra.run.smithi191.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-19T09:24:30.280 INFO:teuthology.orchestra.run.smithi191.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 711 kB/s | 54 kB 00:00 2024-09-19T09:24:30.322 INFO:teuthology.orchestra.run.smithi191.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 482 kB/s | 32 kB 00:00 2024-09-19T09:24:30.348 INFO:teuthology.orchestra.run.smithi191.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-19T09:24:30.373 INFO:teuthology.orchestra.run.smithi191.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 153 kB/s | 14 kB 00:00 2024-09-19T09:24:30.406 INFO:teuthology.orchestra.run.smithi191.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2024-09-19T09:24:30.432 INFO:teuthology.orchestra.run.smithi191.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-19T09:24:30.457 INFO:teuthology.orchestra.run.smithi191.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-19T09:24:30.485 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-19T09:24:30.498 INFO:teuthology.orchestra.run.smithi191.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-19T09:24:30.501 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:30.501 INFO:teuthology.orchestra.run.smithi191.stdout:Total 3.1 MB/s | 2.2 MB 00:00 2024-09-19T09:24:30.534 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-19T09:24:30.566 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:24:30.567 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-19T09:24:30.581 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:24:30.581 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:24:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-19T09:24:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 13/13 2024-09-19T09:24:30.668 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:24:30.669 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:24:31.173 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:24:31.337 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-19T09:24:31.395 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 13/13 2024-09-19T09:24:31.395 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/13 2024-09-19T09:24:31.395 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-19T09:24:31.395 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-19T09:24:31.395 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-19T09:24:31.395 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-19T09:24:31.395 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-19T09:24:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-19T09:24:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-19T09:24:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-19T09:24:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-19T09:24:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-19T09:24:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-19T09:24:31.401 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-19T09:24:31.463 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-19T09:24:31.500 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-19T09:24:31.542 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-19T09:24:31.651 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-19T09:24:31.733 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-19T09:24:31.733 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:31.733 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:24:31.733 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:31.733 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:24:31.733 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:24:31.733 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:24:31.733 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:24:31.733 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:24:31.734 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:24:31.734 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:24:31.734 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:24:31.734 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:24:31.734 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:24:31.734 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:24:31.734 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:24:31.734 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:31.734 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:31.762 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-19T09:24:31.827 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-19T09:24:31.996 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-cephadm 2024-09-19T09:24:32.543 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-19T09:24:32.577 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:17 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:32.591 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-19T09:24:32.624 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-19T09:24:32.670 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-19T09:24:32.694 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 13/13 2024-09-19T09:24:32.709 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:32.710 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-19T09:24:32.710 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:32.710 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:24:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 124 k 2024-09-19T09:24:32.710 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-19T09:24:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:24:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:24:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:24:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:24:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:24:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:32.711 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:24:32.711 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:32.711 INFO:teuthology.orchestra.run.smithi112.stdout:Install 6 Packages 2024-09-19T09:24:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:32.711 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 7.0 M 2024-09-19T09:24:32.711 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 33 M 2024-09-19T09:24:32.712 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:24:32.960 INFO:teuthology.orchestra.run.smithi112.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1637.g6e06d1e0.e 627 kB/s | 124 kB 00:00 2024-09-19T09:24:32.985 INFO:teuthology.orchestra.run.smithi112.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-19T09:24:33.035 INFO:teuthology.orchestra.run.smithi112.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-19T09:24:33.060 INFO:teuthology.orchestra.run.smithi112.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 768 kB/s | 58 kB 00:00 2024-09-19T09:24:33.086 INFO:teuthology.orchestra.run.smithi112.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-19T09:24:33.468 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 13/13 2024-09-19T09:24:33.468 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/13 2024-09-19T09:24:33.468 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-19T09:24:33.468 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-19T09:24:33.468 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-19T09:24:33.469 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-19T09:24:33.469 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-19T09:24:33.469 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-19T09:24:33.469 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-19T09:24:33.469 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-19T09:24:33.469 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-19T09:24:33.469 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-19T09:24:33.469 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-19T09:24:33.837 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-19T09:24:33.838 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:33.838 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:24:33.838 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:33.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:24:33.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:24:33.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:24:33.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:24:33.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:24:33.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:24:33.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:24:33.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:24:33.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:24:33.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:24:33.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:24:33.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:24:33.839 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:33.839 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:34.099 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-mgr-cephadm 2024-09-19T09:24:34.428 INFO:teuthology.orchestra.run.smithi112.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.6 MB/s | 6.0 MB 00:01 2024-09-19T09:24:34.429 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:34.430 INFO:teuthology.orchestra.run.smithi112.stdout:Total 4.1 MB/s | 7.0 MB 00:01 2024-09-19T09:24:34.501 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:24:34.512 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:24:34.512 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:24:34.612 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:24:34.613 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:24:34.681 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:17 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:34.814 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:34.815 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:34.815 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-09-19T09:24:34.815 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:34.815 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:24:34.815 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 124 k 2024-09-19T09:24:34.815 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-09-19T09:24:34.815 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:24:34.815 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:24:34.815 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:24:34.816 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:24:34.816 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:24:34.816 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:34.816 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:24:34.816 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:34.816 INFO:teuthology.orchestra.run.smithi191.stdout:Install 6 Packages 2024-09-19T09:24:34.816 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:34.816 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 7.0 M 2024-09-19T09:24:34.817 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 33 M 2024-09-19T09:24:34.817 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:24:34.919 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:24:35.092 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-19T09:24:35.137 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-19T09:24:35.318 INFO:teuthology.orchestra.run.smithi191.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1637.g6e06d1e0.e 643 kB/s | 124 kB 00:00 2024-09-19T09:24:35.376 INFO:teuthology.orchestra.run.smithi191.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-19T09:24:35.401 INFO:teuthology.orchestra.run.smithi191.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-19T09:24:35.427 INFO:teuthology.orchestra.run.smithi191.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-19T09:24:35.655 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-19T09:24:35.748 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-19T09:24:35.804 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-19T09:24:35.833 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 6/6 2024-09-19T09:24:35.894 INFO:teuthology.orchestra.run.smithi191.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 323 kB/s | 248 kB 00:00 2024-09-19T09:24:36.269 INFO:teuthology.orchestra.run.smithi191.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.2 MB/s | 6.0 MB 00:01 2024-09-19T09:24:36.271 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:36.271 INFO:teuthology.orchestra.run.smithi191.stdout:Total 4.8 MB/s | 7.0 MB 00:01 2024-09-19T09:24:36.345 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:24:36.357 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:24:36.357 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:24:36.456 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:24:36.456 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:24:36.623 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 6/6 2024-09-19T09:24:36.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/6 2024-09-19T09:24:36.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-19T09:24:36.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-19T09:24:36.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-19T09:24:36.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-19T09:24:36.762 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:24:36.914 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-19T09:24:36.914 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:36.914 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:24:36.914 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:36.914 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:24:36.915 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:24:36.915 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:24:36.915 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:24:36.915 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:24:36.915 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:36.915 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:36.941 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-19T09:24:36.995 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-19T09:24:37.178 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-fuse 2024-09-19T09:24:37.518 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-19T09:24:37.597 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-19T09:24:37.661 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-19T09:24:37.691 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 6/6 2024-09-19T09:24:37.762 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:22 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:37.895 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:37.895 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:37.895 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-19T09:24:37.895 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:37.895 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:24:37.895 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 813 k 2024-09-19T09:24:37.895 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-19T09:24:37.896 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:24:37.896 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:37.896 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:24:37.896 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:37.896 INFO:teuthology.orchestra.run.smithi112.stdout:Install 2 Packages 2024-09-19T09:24:37.896 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:37.896 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 893 k 2024-09-19T09:24:37.897 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 2.6 M 2024-09-19T09:24:37.897 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:24:38.095 INFO:teuthology.orchestra.run.smithi112.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 521 kB/s | 80 kB 00:00 2024-09-19T09:24:38.229 INFO:teuthology.orchestra.run.smithi112.stdout:(2/2): ceph-fuse-17.2.7-1637.g6e06d1e0.el9.x86_ 2.8 MB/s | 813 kB 00:00 2024-09-19T09:24:38.229 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:38.230 INFO:teuthology.orchestra.run.smithi112.stdout:Total 2.6 MB/s | 893 kB 00:00 2024-09-19T09:24:38.241 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:24:38.263 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:24:38.263 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:24:38.341 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:24:38.342 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:24:38.536 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 6/6 2024-09-19T09:24:38.536 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/6 2024-09-19T09:24:38.536 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-19T09:24:38.536 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-19T09:24:38.536 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-19T09:24:38.536 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-19T09:24:38.539 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:24:38.665 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-19T09:24:38.727 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/2 2024-09-19T09:24:38.801 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-19T09:24:38.801 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:38.802 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:24:38.802 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T09:24:38.802 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:24:38.802 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:24:38.802 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:24:38.802 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:24:38.802 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:24:38.802 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:38.802 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:39.049 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-fuse 2024-09-19T09:24:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/2 2024-09-19T09:24:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/2 2024-09-19T09:24:39.629 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:22 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:39.656 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-19T09:24:39.656 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:39.656 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:24:39.656 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-19T09:24:39.656 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:39.656 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:39.760 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:39.761 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-09-19T09:24:39.761 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:39.761 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:24:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 813 k 2024-09-19T09:24:39.761 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-09-19T09:24:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:24:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:39.761 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:24:39.761 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:39.761 INFO:teuthology.orchestra.run.smithi191.stdout:Install 2 Packages 2024-09-19T09:24:39.762 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:39.762 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 893 k 2024-09-19T09:24:39.762 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 2.6 M 2024-09-19T09:24:39.762 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:24:39.957 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install librados-devel 2024-09-19T09:24:40.045 INFO:teuthology.orchestra.run.smithi191.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 337 kB/s | 80 kB 00:00 2024-09-19T09:24:40.103 INFO:teuthology.orchestra.run.smithi191.stdout:(2/2): ceph-fuse-17.2.7-1637.g6e06d1e0.el9.x86_ 2.7 MB/s | 813 kB 00:00 2024-09-19T09:24:40.104 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:40.104 INFO:teuthology.orchestra.run.smithi191.stdout:Total 2.5 MB/s | 893 kB 00:00 2024-09-19T09:24:40.115 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:24:40.137 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:24:40.137 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:24:40.216 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:24:40.216 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:24:40.395 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:24:40.531 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-19T09:24:40.542 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:25 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:40.593 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/2 2024-09-19T09:24:40.677 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:40.678 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:40.678 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-09-19T09:24:40.678 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:40.679 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:24:40.679 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 126 k 2024-09-19T09:24:40.679 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:40.679 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:24:40.679 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:40.679 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-19T09:24:40.679 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:40.679 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 126 k 2024-09-19T09:24:40.679 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 448 k 2024-09-19T09:24:40.679 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:24:40.892 INFO:teuthology.orchestra.run.smithi112.stdout:librados-devel-17.2.7-1637.g6e06d1e0.el9.x86_64 596 kB/s | 126 kB 00:00 2024-09-19T09:24:40.892 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:40.892 INFO:teuthology.orchestra.run.smithi112.stdout:Total 591 kB/s | 126 kB 00:00 2024-09-19T09:24:40.892 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:24:40.898 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:24:40.898 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:24:40.961 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:24:40.962 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:24:41.110 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:24:41.206 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:41.289 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/2 2024-09-19T09:24:41.289 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/2 2024-09-19T09:24:41.552 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-19T09:24:41.552 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:41.552 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:24:41.552 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-19T09:24:41.552 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:41.552 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:41.655 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:41.857 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install librados-devel 2024-09-19T09:24:41.907 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:41.907 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:41.908 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:24:41.908 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:41.908 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:41.908 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:42.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install libcephfs2 2024-09-19T09:24:42.447 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:25 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:42.582 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:42.583 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:42.583 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repo Size 2024-09-19T09:24:42.583 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:42.583 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:24:42.583 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 126 k 2024-09-19T09:24:42.583 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:42.584 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:24:42.584 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:42.584 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2024-09-19T09:24:42.584 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:42.584 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 126 k 2024-09-19T09:24:42.584 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 448 k 2024-09-19T09:24:42.584 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:24:42.752 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:27 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:42.792 INFO:teuthology.orchestra.run.smithi191.stdout:librados-devel-17.2.7-1637.g6e06d1e0.el9.x86_64 608 kB/s | 126 kB 00:00 2024-09-19T09:24:42.793 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:42.793 INFO:teuthology.orchestra.run.smithi191.stdout:Total 604 kB/s | 126 kB 00:00 2024-09-19T09:24:42.793 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:24:42.798 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:24:42.798 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:24:42.843 INFO:teuthology.orchestra.run.smithi112.stdout:Package libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:42.860 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:24:42.861 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:24:42.888 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:42.889 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-19T09:24:42.889 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:42.969 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install libcephfs-devel 2024-09-19T09:24:43.012 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:24:43.122 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:43.542 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:43.549 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:28 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:43.681 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:43.681 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:43.681 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-09-19T09:24:43.682 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:43.682 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:24:43.682 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 25 k 2024-09-19T09:24:43.682 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:43.682 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:24:43.682 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:43.682 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-19T09:24:43.682 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:43.683 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 25 k 2024-09-19T09:24:43.683 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 110 k 2024-09-19T09:24:43.683 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:24:43.811 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:43.811 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:43.811 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:24:43.811 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:43.811 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:43.812 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:43.844 INFO:teuthology.orchestra.run.smithi112.stdout:libcephfs-devel-17.2.7-1637.g6e06d1e0.el9.x86_6 154 kB/s | 25 kB 00:00 2024-09-19T09:24:43.844 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:43.845 INFO:teuthology.orchestra.run.smithi112.stdout:Total 153 kB/s | 25 kB 00:00 2024-09-19T09:24:43.845 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:24:43.848 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:24:43.848 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:24:43.849 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:24:43.850 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:24:43.939 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:24:44.057 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:44.071 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install libcephfs2 2024-09-19T09:24:44.437 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:44.662 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:44.663 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:24:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:44.663 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:44.672 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:27 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:44.764 INFO:teuthology.orchestra.run.smithi191.stdout:Package libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:44.809 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:44.810 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-09-19T09:24:44.810 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:44.850 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install librados2 2024-09-19T09:24:44.877 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install libcephfs-devel 2024-09-19T09:24:45.425 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:30 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:45.453 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:28 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:45.513 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:45.556 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:45.557 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-19T09:24:45.557 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:45.585 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:45.586 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:45.586 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repo Size 2024-09-19T09:24:45.586 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:45.586 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:24:45.586 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 25 k 2024-09-19T09:24:45.587 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:45.587 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:24:45.587 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:45.587 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2024-09-19T09:24:45.587 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:45.587 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 25 k 2024-09-19T09:24:45.588 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 110 k 2024-09-19T09:24:45.588 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:24:45.643 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install librbd1 2024-09-19T09:24:45.745 INFO:teuthology.orchestra.run.smithi191.stdout:libcephfs-devel-17.2.7-1637.g6e06d1e0.el9.x86_6 157 kB/s | 25 kB 00:00 2024-09-19T09:24:45.746 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:45.746 INFO:teuthology.orchestra.run.smithi191.stdout:Total 156 kB/s | 25 kB 00:00 2024-09-19T09:24:45.746 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:24:45.751 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:24:45.751 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:24:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:24:45.951 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:46.229 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:31 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:46.319 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:46.338 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:46.361 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:46.443 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-rados 2024-09-19T09:24:46.564 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:46.564 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:46.564 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:24:46.564 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:46.564 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:46.565 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:46.759 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install librados2 2024-09-19T09:24:47.012 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:32 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:47.101 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:47.144 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:47.145 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-19T09:24:47.145 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:47.217 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-rgw 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:30 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:47.428 INFO:teuthology.orchestra.run.smithi191.stdout:Package librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:47.471 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:47.471 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-09-19T09:24:47.471 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:47.540 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install librbd1 2024-09-19T09:24:47.794 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:32 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:47.884 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:47.927 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:47.928 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-19T09:24:47.928 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:47.992 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-cephfs 2024-09-19T09:24:48.118 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:31 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:48.208 INFO:teuthology.orchestra.run.smithi191.stdout:Package librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:48.251 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:48.252 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-09-19T09:24:48.252 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:48.333 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install python3-rados 2024-09-19T09:24:48.568 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:33 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:48.656 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:48.698 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:48.699 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-19T09:24:48.699 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:48.762 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-rbd 2024-09-19T09:24:48.910 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:31 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:49.000 INFO:teuthology.orchestra.run.smithi191.stdout:Package python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:49.043 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:49.044 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-09-19T09:24:49.044 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:49.117 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install python3-rgw 2024-09-19T09:24:49.337 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:34 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:49.429 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:49.471 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:49.472 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-19T09:24:49.473 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:49.541 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install rbd-fuse 2024-09-19T09:24:49.689 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:32 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:49.777 INFO:teuthology.orchestra.run.smithi191.stdout:Package python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:49.819 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:49.820 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-09-19T09:24:49.820 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:49.892 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install python3-cephfs 2024-09-19T09:24:50.114 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:35 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:50.246 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:50.247 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:50.247 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-09-19T09:24:50.248 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:50.248 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:24:50.248 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 82 k 2024-09-19T09:24:50.248 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:50.248 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:24:50.248 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:50.249 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-19T09:24:50.249 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:50.249 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 82 k 2024-09-19T09:24:50.249 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 222 k 2024-09-19T09:24:50.249 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:24:50.448 INFO:teuthology.orchestra.run.smithi112.stdout:rbd-fuse-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 411 kB/s | 82 kB 00:00 2024-09-19T09:24:50.448 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:50.449 INFO:teuthology.orchestra.run.smithi112.stdout:Total 408 kB/s | 82 kB 00:00 2024-09-19T09:24:50.449 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:24:50.455 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:24:50.455 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:24:50.471 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:33 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:50.518 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:24:50.518 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:24:50.561 INFO:teuthology.orchestra.run.smithi191.stdout:Package python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:50.603 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:50.604 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-09-19T09:24:50.605 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:50.673 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:24:50.678 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install python3-rbd 2024-09-19T09:24:50.787 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:51.164 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:51.261 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:34 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:51.351 INFO:teuthology.orchestra.run.smithi191.stdout:Package python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T09:24:51.395 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:51.396 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-09-19T09:24:51.396 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:51.421 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:24:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:51.421 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:51.464 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install rbd-fuse 2024-09-19T09:24:51.659 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install rbd-mirror 2024-09-19T09:24:52.042 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:35 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:52.174 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:52.175 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2024-09-19T09:24:52.175 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:52.175 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:24:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 82 k 2024-09-19T09:24:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:52.176 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:24:52.176 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:52.176 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2024-09-19T09:24:52.176 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:52.176 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 82 k 2024-09-19T09:24:52.176 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 222 k 2024-09-19T09:24:52.176 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:24:52.241 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:37 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:52.365 INFO:teuthology.orchestra.run.smithi191.stdout:rbd-fuse-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 435 kB/s | 82 kB 00:00 2024-09-19T09:24:52.365 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:52.365 INFO:teuthology.orchestra.run.smithi191.stdout:Total 432 kB/s | 82 kB 00:00 2024-09-19T09:24:52.366 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:24:52.372 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:24:52.372 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:24:52.378 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:52.378 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:52.378 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-09-19T09:24:52.378 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:52.378 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:24:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.9 M 2024-09-19T09:24:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:52.379 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:24:52.379 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:52.379 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-19T09:24:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:52.379 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 2.9 M 2024-09-19T09:24:52.380 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 12 M 2024-09-19T09:24:52.380 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:24:52.436 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:24:52.436 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:24:52.596 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:24:52.695 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:53.017 INFO:teuthology.orchestra.run.smithi112.stdout:rbd-mirror-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 4.6 MB/s | 2.9 MB 00:00 2024-09-19T09:24:53.018 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:53.018 INFO:teuthology.orchestra.run.smithi112.stdout:Total 4.6 MB/s | 2.9 MB 00:00 2024-09-19T09:24:53.018 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:24:53.027 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:24:53.027 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:24:53.103 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:53.105 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:24:53.105 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:24:53.380 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:53.381 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:53.381 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:24:53.381 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:53.381 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:53.381 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:53.522 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:24:53.593 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:53.606 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install rbd-mirror 2024-09-19T09:24:53.617 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:53.618 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:24:53.618 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:24:53.618 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:24:53.618 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:24:53.618 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:54.195 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:37 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:54.330 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:54.331 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:54.331 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repo Size 2024-09-19T09:24:54.331 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:54.331 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:24:54.331 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.9 M 2024-09-19T09:24:54.331 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:54.331 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:24:54.331 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:54.332 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2024-09-19T09:24:54.332 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:54.332 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 2.9 M 2024-09-19T09:24:54.332 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 12 M 2024-09-19T09:24:54.332 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:24:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:54.713 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:24:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:54.713 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:54.996 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install rbd-nbd 2024-09-19T09:24:55.591 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:40 ago on Thu 19 Sep 2024 09:23:15 AM UTC. 2024-09-19T09:24:55.723 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-19T09:24:55.724 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:55.724 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-09-19T09:24:55.724 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:55.724 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-19T09:24:55.724 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 165 k 2024-09-19T09:24:55.724 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:55.725 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-19T09:24:55.725 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-19T09:24:55.725 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-19T09:24:55.725 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:55.725 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 165 k 2024-09-19T09:24:55.725 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 477 k 2024-09-19T09:24:55.725 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-19T09:24:55.937 INFO:teuthology.orchestra.run.smithi112.stdout:rbd-nbd-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 779 kB/s | 165 kB 00:00 2024-09-19T09:24:55.938 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:55.938 INFO:teuthology.orchestra.run.smithi112.stdout:Total 774 kB/s | 165 kB 00:00 2024-09-19T09:24:55.938 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-19T09:24:55.945 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-19T09:24:55.946 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-19T09:24:56.009 INFO:teuthology.orchestra.run.smithi191.stdout:rbd-mirror-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 1.8 MB/s | 2.9 MB 00:01 2024-09-19T09:24:56.010 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-19T09:24:56.010 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-19T09:24:56.010 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:56.010 INFO:teuthology.orchestra.run.smithi191.stdout:Total 1.8 MB/s | 2.9 MB 00:01 2024-09-19T09:24:56.011 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:24:56.021 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:24:56.021 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:24:56.104 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:24:56.105 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:24:56.173 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-19T09:24:56.275 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:24:56.576 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:56.602 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:56.602 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:24:56.602 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:24:56.602 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:24:56.602 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:24:56.602 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:56.684 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:56.946 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-19T09:24:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:24:56.947 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-19T09:24:57.193 DEBUG:teuthology.parallel:result is None 2024-09-19T09:24:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:57.708 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:24:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:57.708 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:24:57.976 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install rbd-nbd 2024-09-19T09:24:58.575 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:41 ago on Thu 19 Sep 2024 09:23:17 AM UTC. 2024-09-19T09:24:58.709 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-19T09:24:58.709 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:58.710 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2024-09-19T09:24:58.710 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:58.710 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-19T09:24:58.710 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 165 k 2024-09-19T09:24:58.710 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:58.710 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-19T09:24:58.710 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-19T09:24:58.710 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2024-09-19T09:24:58.710 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:58.710 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 165 k 2024-09-19T09:24:58.710 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 477 k 2024-09-19T09:24:58.710 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-19T09:24:58.913 INFO:teuthology.orchestra.run.smithi191.stdout:rbd-nbd-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 817 kB/s | 165 kB 00:00 2024-09-19T09:24:58.913 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:24:58.914 INFO:teuthology.orchestra.run.smithi191.stdout:Total 812 kB/s | 165 kB 00:00 2024-09-19T09:24:58.914 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-19T09:24:58.921 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-19T09:24:58.921 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-19T09:24:58.983 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-19T09:24:58.984 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-19T09:24:59.136 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-19T09:24:59.234 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:59.657 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:59.914 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T09:24:59.914 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:59.914 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-19T09:24:59.914 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T09:24:59.914 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:24:59.914 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-19T09:25:00.149 DEBUG:teuthology.parallel:result is None 2024-09-19T09:25:00.150 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T09:25:00.150 INFO:teuthology.packaging:ref: None 2024-09-19T09:25:00.150 INFO:teuthology.packaging:tag: None 2024-09-19T09:25:00.150 INFO:teuthology.packaging:branch: quincy 2024-09-19T09:25:00.150 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:25:00.150 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-19T09:25:00.374 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:25:00.400 INFO:teuthology.orchestra.run.smithi112.stdout:17.2.7-1637.g6e06d1e0.el9 2024-09-19T09:25:00.401 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1637.g6e06d1e0.el9 2024-09-19T09:25:00.401 INFO:teuthology.task.install:The correct ceph version 17.2.7-1637.g6e06d1e0 is installed. 2024-09-19T09:25:00.403 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T09:25:00.403 INFO:teuthology.packaging:ref: None 2024-09-19T09:25:00.403 INFO:teuthology.packaging:tag: None 2024-09-19T09:25:00.403 INFO:teuthology.packaging:branch: quincy 2024-09-19T09:25:00.403 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:25:00.403 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-19T09:25:00.607 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:25:00.630 INFO:teuthology.orchestra.run.smithi191.stdout:17.2.7-1637.g6e06d1e0.el9 2024-09-19T09:25:00.631 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1637.g6e06d1e0.el9 2024-09-19T09:25:00.631 INFO:teuthology.task.install:The correct ceph version 17.2.7-1637.g6e06d1e0 is installed. 2024-09-19T09:25:00.632 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T09:25:00.633 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:25:00.633 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:25:00.665 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:25:00.665 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:25:00.697 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T09:25:00.698 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:25:00.698 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:25:00.734 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:25:00.803 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:25:00.803 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:25:00.829 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:25:00.928 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T09:25:00.928 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:25:00.929 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:25:00.958 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:25:01.027 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:25:01.027 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:25:01.053 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:25:01.118 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T09:25:01.119 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:25:01.119 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:25:01.148 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:25:01.217 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:25:01.217 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:25:01.242 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:25:01.308 INFO:teuthology.run_tasks:Running task print... 2024-09-19T09:25:01.317 INFO:teuthology.task.print:**** done install task... 2024-09-19T09:25:01.317 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T09:25:01.421 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T09:25:01.422 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-09-19T09:25:01.422 INFO:tasks.cephadm:Cluster fsid is 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:25:01.422 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T09:25:01.422 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-19T09:25:01.423 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi112': '172.21.15.112', 'mon.smithi191': '172.21.15.191'} 2024-09-19T09:25:01.423 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T09:25:01.423 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname $(hostname -s) 2024-09-19T09:25:01.453 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname $(hostname -s) 2024-09-19T09:25:01.478 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-09-19T09:25:01.479 DEBUG:teuthology.orchestra.run.smithi112:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:25:01.733 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 19 09:25 /home/ubuntu/cephtest/cephadm 2024-09-19T09:25:01.734 DEBUG:teuthology.orchestra.run.smithi191:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:25:01.860 INFO:teuthology.orchestra.run.smithi191.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 19 09:25 /home/ubuntu/cephtest/cephadm 2024-09-19T09:25:01.861 DEBUG:teuthology.orchestra.run.smithi112:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:25:01.880 DEBUG:teuthology.orchestra.run.smithi191:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:25:01.905 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-09-19T09:25:01.905 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-19T09:25:01.923 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-19T09:25:03.441 INFO:teuthology.orchestra.run.smithi112.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-19T09:25:03.598 INFO:teuthology.orchestra.run.smithi191.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-19T09:25:32.602 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:25:32.602 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)", 2024-09-19T09:25:32.602 INFO:teuthology.orchestra.run.smithi112.stdout: "image_id": "f63ad14e4e434a3de1d471d2841f01aa4ae27e9a9e20f9a042bea34292493ec9", 2024-09-19T09:25:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: "repo_digests": [ 2024-09-19T09:25:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8" 2024-09-19T09:25:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-19T09:25:32.603 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:25:33.272 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-09-19T09:25:33.272 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_version": "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)", 2024-09-19T09:25:33.272 INFO:teuthology.orchestra.run.smithi191.stdout: "image_id": "f63ad14e4e434a3de1d471d2841f01aa4ae27e9a9e20f9a042bea34292493ec9", 2024-09-19T09:25:33.272 INFO:teuthology.orchestra.run.smithi191.stdout: "repo_digests": [ 2024-09-19T09:25:33.272 INFO:teuthology.orchestra.run.smithi191.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8" 2024-09-19T09:25:33.272 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-09-19T09:25:33.273 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-09-19T09:25:33.290 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph 2024-09-19T09:25:33.323 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph 2024-09-19T09:25:33.351 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /etc/ceph 2024-09-19T09:25:33.393 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /etc/ceph 2024-09-19T09:25:33.417 INFO:tasks.cephadm:Writing seed config... 2024-09-19T09:25:33.419 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-19T09:25:33.419 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-19T09:25:33.419 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T09:25:33.419 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T09:25:33.419 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T09:25:33.420 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T09:25:33.420 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T09:25:33.420 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T09:25:33.420 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T09:25:33.420 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T09:25:33.420 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T09:25:33.420 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T09:25:33.420 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T09:25:33.420 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T09:25:33.420 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T09:25:33.420 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T09:25:33.421 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T09:25:33.421 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T09:25:33.421 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T09:25:33.421 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T09:25:33.421 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T09:25:33.421 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T09:25:33.421 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T09:25:33.421 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-19T09:25:33.421 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T09:25:33.421 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T09:25:33.421 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T09:25:33.422 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T09:25:33.422 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T09:25:33.422 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T09:25:33.422 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T09:25:33.422 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T09:25:33.422 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T09:25:33.422 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T09:25:33.422 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T09:25:33.422 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T09:25:33.422 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T09:25:33.422 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T09:25:33.422 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T09:25:33.423 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T09:25:33.423 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T09:25:33.423 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T09:25:33.423 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T09:25:33.424 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:25:33.424 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T09:25:33.451 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 0bd98d30-7669-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T09:25:33.451 DEBUG:teuthology.orchestra.run.smithi112:mon.smithi112> sudo journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mon.smithi112.service 2024-09-19T09:25:33.494 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T09:25:33.494 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.112 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:25:33.697 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:25:33.697 INFO:teuthology.orchestra.run.smithi112.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '0bd98d30-7669-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.112', '--skip-admin-label'] 2024-09-19T09:25:33.720 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stdout 5.2.2 2024-09-19T09:25:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T09:25:33.721 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying podman|docker is present... 2024-09-19T09:25:33.742 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stdout 5.2.2 2024-09-19T09:25:33.742 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying lvm2 is present... 2024-09-19T09:25:33.742 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying time synchronization is in place... 2024-09-19T09:25:33.750 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T09:25:33.750 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T09:25:33.756 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T09:25:33.757 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout inactive 2024-09-19T09:25:33.764 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout enabled 2024-09-19T09:25:33.770 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout active 2024-09-19T09:25:33.770 INFO:teuthology.orchestra.run.smithi112.stdout:Unit chronyd.service is enabled and running 2024-09-19T09:25:33.771 INFO:teuthology.orchestra.run.smithi112.stdout:Repeating the final host check... 2024-09-19T09:25:33.793 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stdout 5.2.2 2024-09-19T09:25:33.793 INFO:teuthology.orchestra.run.smithi112.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T09:25:33.793 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl is present 2024-09-19T09:25:33.793 INFO:teuthology.orchestra.run.smithi112.stdout:lvcreate is present 2024-09-19T09:25:33.799 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T09:25:33.799 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T09:25:33.806 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T09:25:33.806 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout inactive 2024-09-19T09:25:33.813 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout enabled 2024-09-19T09:25:33.820 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout active 2024-09-19T09:25:33.820 INFO:teuthology.orchestra.run.smithi112.stdout:Unit chronyd.service is enabled and running 2024-09-19T09:25:33.820 INFO:teuthology.orchestra.run.smithi112.stdout:Host looks OK 2024-09-19T09:25:33.820 INFO:teuthology.orchestra.run.smithi112.stdout:Cluster fsid: 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:25:33.820 INFO:teuthology.orchestra.run.smithi112.stdout:Acquiring lock 140361867927904 on /run/cephadm/0bd98d30-7669-11ef-bceb-c7b262605968.lock 2024-09-19T09:25:33.820 INFO:teuthology.orchestra.run.smithi112.stdout:Lock 140361867927904 acquired on /run/cephadm/0bd98d30-7669-11ef-bceb-c7b262605968.lock 2024-09-19T09:25:33.821 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying IP 172.21.15.112 port 3300 ... 2024-09-19T09:25:33.821 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying IP 172.21.15.112 port 6789 ... 2024-09-19T09:25:33.821 INFO:teuthology.orchestra.run.smithi112.stdout:Base mon IP(s) is [172.21.15.112:3300, 172.21.15.112:6789], mon addrv is [v2:172.21.15.112:3300,v1:172.21.15.112:6789] 2024-09-19T09:25:33.824 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.112 metric 100 2024-09-19T09:25:33.825 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.112 metric 100 2024-09-19T09:25:33.827 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T09:25:33.827 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-19T09:25:33.827 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-19T09:25:33.830 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T09:25:33.830 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T09:25:33.830 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T09:25:33.830 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-19T09:25:33.830 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-19T09:25:33.830 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T09:25:33.831 INFO:teuthology.orchestra.run.smithi112.stdout:Mon IP `172.21.15.112` is in CIDR network `172.21.0.0/20` 2024-09-19T09:25:33.831 INFO:teuthology.orchestra.run.smithi112.stdout:Mon IP `172.21.15.112` is in CIDR network `172.21.0.0/20` 2024-09-19T09:25:33.831 INFO:teuthology.orchestra.run.smithi112.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T09:25:33.831 INFO:teuthology.orchestra.run.smithi112.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T09:25:33.832 INFO:teuthology.orchestra.run.smithi112.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-19T09:25:34.311 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stdout f63ad14e4e434a3de1d471d2841f01aa4ae27e9a9e20f9a042bea34292493ec9 2024-09-19T09:25:34.311 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-19T09:25:34.311 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T09:25:34.311 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stderr Copying blob sha256:a57b58ef5be3c9891294d677a25cda6c34cb1998d8001d986a2725631ea2d32e 2024-09-19T09:25:34.311 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T09:25:34.311 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stderr Copying config sha256:f63ad14e4e434a3de1d471d2841f01aa4ae27e9a9e20f9a042bea34292493ec9 2024-09-19T09:25:34.311 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T09:25:35.182 INFO:teuthology.orchestra.run.smithi112.stdout:ceph: stdout ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable) 2024-09-19T09:25:35.182 INFO:teuthology.orchestra.run.smithi112.stdout:Ceph version: ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable) 2024-09-19T09:25:35.182 INFO:teuthology.orchestra.run.smithi112.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T09:25:36.171 INFO:teuthology.orchestra.run.smithi112.stdout:stat: stdout 167 167 2024-09-19T09:25:36.172 INFO:teuthology.orchestra.run.smithi112.stdout:Creating initial keys... 2024-09-19T09:25:37.019 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph-authtool: stdout AQAQ7utm+TpdGxAA+0p5eF2H7IYwrvnOzTwW+g== 2024-09-19T09:25:38.017 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph-authtool: stdout AQAR7utmkNDfExAAqJjWaw1+qc3CBXaH4SHUdA== 2024-09-19T09:25:39.041 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph-authtool: stdout AQAS7utm94YxFBAALpr+VXwbnDF11KvFOK69ZQ== 2024-09-19T09:25:39.041 INFO:teuthology.orchestra.run.smithi112.stdout:Creating initial monmap... 2024-09-19T09:25:39.971 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T09:25:39.971 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-09-19T09:25:39.971 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:25:39.971 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T09:25:39.971 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool for smithi112 [v2:172.21.15.112:3300,v1:172.21.15.112:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T09:25:39.972 INFO:teuthology.orchestra.run.smithi112.stdout:setting min_mon_release = octopus 2024-09-19T09:25:39.972 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/monmaptool: set fsid to 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:25:39.972 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T09:25:39.972 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:25:39.972 INFO:teuthology.orchestra.run.smithi112.stdout:Creating mon... 2024-09-19T09:25:41.019 INFO:teuthology.orchestra.run.smithi112.stdout:create mon.smithi112 on 2024-09-19T09:25:41.220 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T09:25:41.361 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T09:25:41.510 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-0bd98d30-7669-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-0bd98d30-7669-11ef-bceb-c7b262605968.target. 2024-09-19T09:25:41.511 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-0bd98d30-7669-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-0bd98d30-7669-11ef-bceb-c7b262605968.target. 2024-09-19T09:25:41.679 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mon.smithi112 2024-09-19T09:25:41.679 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mon.smithi112.service: Unit ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mon.smithi112.service not loaded. 2024-09-19T09:25:41.839 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0bd98d30-7669-11ef-bceb-c7b262605968.target.wants/ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mon.smithi112.service → /etc/systemd/system/ceph-0bd98d30-7669-11ef-bceb-c7b262605968@.service. 2024-09-19T09:25:42.328 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:42 smithi112 podman[27212]: 2024-09-19 09:25:42.289904154 +0000 UTC m=+0.322223205 container start d74a1969d26bcdc1a5f58e2397fa05df2fa82187103a13f29630d01ee9fe5645 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=quincy-6e06d1e, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:25:42.359 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:25:42.359 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout disabled 2024-09-19T09:25:42.367 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:25:42.368 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout inactive 2024-09-19T09:25:42.368 INFO:teuthology.orchestra.run.smithi112.stdout:firewalld.service is not enabled 2024-09-19T09:25:42.368 INFO:teuthology.orchestra.run.smithi112.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T09:25:42.368 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for mon to start... 2024-09-19T09:25:42.368 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for mon... 2024-09-19T09:25:42.615 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:42 smithi112 ceph-mon[27233]: mkfs 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:25:42.615 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:42 smithi112 ceph-mon[27233]: mon.smithi112 is new leader, mons smithi112 in quorum (ranks 0) 2024-09-19T09:25:42.615 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:42 smithi112 bash[27212]: d74a1969d26bcdc1a5f58e2397fa05df2fa82187103a13f29630d01ee9fe5645 2024-09-19T09:25:42.616 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:42 smithi112 systemd[1]: Started Ceph mon.smithi112 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:25:43.436 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T09:25:43.437 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout id: 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:25:43.437 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T09:25:43.437 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-19T09:25:43.437 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout services: 2024-09-19T09:25:43.437 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi112 (age 0.567968s) 2024-09-19T09:25:43.437 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T09:25:43.437 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T09:25:43.437 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-19T09:25:43.438 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout data: 2024-09-19T09:25:43.438 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T09:25:43.438 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T09:25:43.438 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T09:25:43.438 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T09:25:43.438 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-19T09:25:43.438 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.822+0000 7f9785744640 1 Processor -- start 2024-09-19T09:25:43.438 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.822+0000 7f9785744640 1 -- start start 2024-09-19T09:25:43.438 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.822+0000 7f9785744640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97801013a0 0x7f97801017b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.438 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.822+0000 7f9785744640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9780101cf0 con 0x7f97801013a0 2024-09-19T09:25:43.438 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.823+0000 7f977effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97801013a0 0x7f97801017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.438 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.823+0000 7f977effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97801013a0 0x7f97801017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36446/0 (socket says 172.21.15.112:36446) 2024-09-19T09:25:43.439 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.823+0000 7f977effd640 1 -- 172.21.15.112:0/2941596785 learned_addr learned my addr 172.21.15.112:0/2941596785 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:25:43.439 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.823+0000 7f977effd640 1 -- 172.21.15.112:0/2941596785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9780101e30 con 0x7f97801013a0 2024-09-19T09:25:43.439 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.825+0000 7f977effd640 1 --2- 172.21.15.112:0/2941596785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97801013a0 0x7f97801017b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9770009840 tx=0x7f97700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3b632480e9ba15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:43.439 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.825+0000 7f977e7fc640 1 -- 172.21.15.112:0/2941596785 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9770032440 con 0x7f97801013a0 2024-09-19T09:25:43.439 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.825+0000 7f977e7fc640 1 -- 172.21.15.112:0/2941596785 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97700325a0 con 0x7f97801013a0 2024-09-19T09:25:43.439 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.825+0000 7f977e7fc640 1 -- 172.21.15.112:0/2941596785 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97700328d0 con 0x7f97801013a0 2024-09-19T09:25:43.439 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.826+0000 7f9785744640 1 -- 172.21.15.112:0/2941596785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97801013a0 msgr2=0x7f97801017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:43.439 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.826+0000 7f9785744640 1 --2- 172.21.15.112:0/2941596785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97801013a0 0x7f97801017b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9770009840 tx=0x7f97700091d0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.439 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.826+0000 7f9785744640 1 -- 172.21.15.112:0/2941596785 shutdown_connections 2024-09-19T09:25:43.440 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.826+0000 7f9785744640 1 --2- 172.21.15.112:0/2941596785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97801013a0 0x7f97801017b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.440 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.826+0000 7f9785744640 1 -- 172.21.15.112:0/2941596785 >> 172.21.15.112:0/2941596785 conn(0x7f97800fbdd0 msgr2=0x7f97800fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:43.440 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.826+0000 7f9785744640 1 -- 172.21.15.112:0/2941596785 shutdown_connections 2024-09-19T09:25:43.440 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.826+0000 7f9785744640 1 -- 172.21.15.112:0/2941596785 wait complete. 2024-09-19T09:25:43.440 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.827+0000 7f9785744640 1 Processor -- start 2024-09-19T09:25:43.440 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.827+0000 7f9785744640 1 -- start start 2024-09-19T09:25:43.440 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.827+0000 7f9785744640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97801013a0 0x7f9780105010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.440 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.827+0000 7f9785744640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9780105550 con 0x7f97801013a0 2024-09-19T09:25:43.440 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.827+0000 7f977effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97801013a0 0x7f9780105010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.441 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.827+0000 7f977effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97801013a0 0x7f9780105010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36460/0 (socket says 172.21.15.112:36460) 2024-09-19T09:25:43.441 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.827+0000 7f977effd640 1 -- 172.21.15.112:0/3282139441 learned_addr learned my addr 172.21.15.112:0/3282139441 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:25:43.441 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.827+0000 7f977effd640 1 -- 172.21.15.112:0/3282139441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9770009450 con 0x7f97801013a0 2024-09-19T09:25:43.441 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.827+0000 7f977effd640 1 --2- 172.21.15.112:0/3282139441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97801013a0 0x7f9780105010 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f977002a700 tx=0x7f9770032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:43.441 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.828+0000 7f97777fe640 1 -- 172.21.15.112:0/3282139441 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9770031be0 con 0x7f97801013a0 2024-09-19T09:25:43.441 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.828+0000 7f97777fe640 1 -- 172.21.15.112:0/3282139441 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9770031d40 con 0x7f97801013a0 2024-09-19T09:25:43.441 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.828+0000 7f9785744640 1 -- 172.21.15.112:0/3282139441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97801035e0 con 0x7f97801013a0 2024-09-19T09:25:43.441 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.828+0000 7f97777fe640 1 -- 172.21.15.112:0/3282139441 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f977003b5a0 con 0x7f97801013a0 2024-09-19T09:25:43.441 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.828+0000 7f9785744640 1 -- 172.21.15.112:0/3282139441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97801039f0 con 0x7f97801013a0 2024-09-19T09:25:43.441 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.828+0000 7f97777fe640 1 -- 172.21.15.112:0/3282139441 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9770039040 con 0x7f97801013a0 2024-09-19T09:25:43.442 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.828+0000 7f97777fe640 1 -- 172.21.15.112:0/3282139441 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9770041030 con 0x7f97801013a0 2024-09-19T09:25:43.442 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.829+0000 7f9785744640 1 -- 172.21.15.112:0/3282139441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978005ed70 con 0x7f97801013a0 2024-09-19T09:25:43.442 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.831+0000 7f97777fe640 1 -- 172.21.15.112:0/3282139441 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f9770037070 con 0x7f97801013a0 2024-09-19T09:25:43.442 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.889+0000 7f9785744640 1 -- 172.21.15.112:0/3282139441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f9780109bb0 con 0x7f97801013a0 2024-09-19T09:25:43.442 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.889+0000 7f97777fe640 1 -- 172.21.15.112:0/3282139441 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f977003bb80 con 0x7f97801013a0 2024-09-19T09:25:43.442 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.891+0000 7f9785744640 1 -- 172.21.15.112:0/3282139441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97801013a0 msgr2=0x7f9780105010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:43.442 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.891+0000 7f9785744640 1 --2- 172.21.15.112:0/3282139441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97801013a0 0x7f9780105010 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f977002a700 tx=0x7f9770032000 comp rx=0 tx=0).stop 2024-09-19T09:25:43.442 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.891+0000 7f9785744640 1 -- 172.21.15.112:0/3282139441 shutdown_connections 2024-09-19T09:25:43.442 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.891+0000 7f9785744640 1 --2- 172.21.15.112:0/3282139441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97801013a0 0x7f9780105010 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.442 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.891+0000 7f9785744640 1 -- 172.21.15.112:0/3282139441 >> 172.21.15.112:0/3282139441 conn(0x7f97800fbdd0 msgr2=0x7f9780100520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:43.442 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.891+0000 7f9785744640 1 -- 172.21.15.112:0/3282139441 shutdown_connections 2024-09-19T09:25:43.442 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:42.891+0000 7f9785744640 1 -- 172.21.15.112:0/3282139441 wait complete. 2024-09-19T09:25:43.442 INFO:teuthology.orchestra.run.smithi112.stdout:mon is available 2024-09-19T09:25:43.443 INFO:teuthology.orchestra.run.smithi112.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T09:25:43.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:43 smithi112 ceph-mon[27233]: mon.smithi112 is new leader, mons smithi112 in quorum (ranks 0) 2024-09-19T09:25:43.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:43 smithi112 ceph-mon[27233]: monmap e1: 1 mons at {smithi112=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-19T09:25:43.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:43 smithi112 ceph-mon[27233]: fsmap 2024-09-19T09:25:43.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:43 smithi112 ceph-mon[27233]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T09:25:43.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:43 smithi112 ceph-mon[27233]: mgrmap e1: no daemons active 2024-09-19T09:25:43.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:43 smithi112 ceph-mon[27233]: from='client.? 172.21.15.112:0/3282139441' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T09:25:44.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:44 smithi112 ceph-mon[27233]: from='client.? 172.21.15.112:0/2546841143' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T09:25:44.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:44 smithi112 ceph-mon[27233]: from='client.? 172.21.15.112:0/2546841143' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T09:25:44.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-19T09:25:44.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T09:25:44.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout fsid = 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:25:44.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-19T09:25:44.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.112:3300,v1:172.21.15.112:6789] 2024-09-19T09:25:44.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T09:25:44.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T09:25:44.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T09:25:44.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T09:25:44.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-19T09:25:44.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T09:25:44.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T09:25:44.470 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-19T09:25:44.471 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T09:25:44.471 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T09:25:44.471 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T09:25:44.471 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T09:25:44.471 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T09:25:44.471 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T09:25:44.471 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.843+0000 7f72c03f1640 1 Processor -- start 2024-09-19T09:25:44.471 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.843+0000 7f72c03f1640 1 -- start start 2024-09-19T09:25:44.471 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.843+0000 7f72c03f1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102410 0x7f72b8102820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:44.471 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.843+0000 7f72c03f1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8102d60 con 0x7f72b8102410 2024-09-19T09:25:44.471 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.844+0000 7f72be18d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102410 0x7f72b8102820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:44.471 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.844+0000 7f72be18d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102410 0x7f72b8102820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36474/0 (socket says 172.21.15.112:36474) 2024-09-19T09:25:44.471 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.844+0000 7f72be18d640 1 -- 172.21.15.112:0/1760086419 learned_addr learned my addr 172.21.15.112:0/1760086419 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:25:44.472 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.844+0000 7f72be18d640 1 -- 172.21.15.112:0/1760086419 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b8102ea0 con 0x7f72b8102410 2024-09-19T09:25:44.472 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.845+0000 7f72be18d640 1 --2- 172.21.15.112:0/1760086419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102410 0x7f72b8102820 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009e50 tx=0x7f72a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1ea3fbeec711fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:44.472 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.845+0000 7f72bd18b640 1 -- 172.21.15.112:0/1760086419 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72a8031560 con 0x7f72b8102410 2024-09-19T09:25:44.472 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.845+0000 7f72bd18b640 1 -- 172.21.15.112:0/1760086419 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a802d050 con 0x7f72b8102410 2024-09-19T09:25:44.472 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.845+0000 7f72bd18b640 1 -- 172.21.15.112:0/1760086419 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72a8031880 con 0x7f72b8102410 2024-09-19T09:25:44.472 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.845+0000 7f72c03f1640 1 -- 172.21.15.112:0/1760086419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102410 msgr2=0x7f72b8102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:44.472 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.845+0000 7f72c03f1640 1 --2- 172.21.15.112:0/1760086419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102410 0x7f72b8102820 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009e50 tx=0x7f72a8009840 comp rx=0 tx=0).stop 2024-09-19T09:25:44.472 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.846+0000 7f72c03f1640 1 -- 172.21.15.112:0/1760086419 shutdown_connections 2024-09-19T09:25:44.472 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.846+0000 7f72c03f1640 1 --2- 172.21.15.112:0/1760086419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102410 0x7f72b8102820 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:44.472 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.846+0000 7f72c03f1640 1 -- 172.21.15.112:0/1760086419 >> 172.21.15.112:0/1760086419 conn(0x7f72b80fbd90 msgr2=0x7f72b80fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:44.472 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.846+0000 7f72c03f1640 1 -- 172.21.15.112:0/1760086419 shutdown_connections 2024-09-19T09:25:44.472 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.846+0000 7f72c03f1640 1 -- 172.21.15.112:0/1760086419 wait complete. 2024-09-19T09:25:44.473 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.846+0000 7f72c03f1640 1 Processor -- start 2024-09-19T09:25:44.473 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.846+0000 7f72c03f1640 1 -- start start 2024-09-19T09:25:44.473 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.846+0000 7f72c03f1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102410 0x7f72b81105c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:44.473 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.846+0000 7f72c03f1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8110b00 con 0x7f72b8102410 2024-09-19T09:25:44.473 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.846+0000 7f72be18d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102410 0x7f72b81105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:44.473 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.846+0000 7f72be18d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102410 0x7f72b81105c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36490/0 (socket says 172.21.15.112:36490) 2024-09-19T09:25:44.473 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.846+0000 7f72be18d640 1 -- 172.21.15.112:0/2546841143 learned_addr learned my addr 172.21.15.112:0/2546841143 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:25:44.473 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.847+0000 7f72be18d640 1 -- 172.21.15.112:0/2546841143 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a8009ae0 con 0x7f72b8102410 2024-09-19T09:25:44.473 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.847+0000 7f72be18d640 1 --2- 172.21.15.112:0/2546841143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102410 0x7f72b81105c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f72a802abe0 tx=0x7f72a8036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:44.473 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.847+0000 7f72b6ffd640 1 -- 172.21.15.112:0/2546841143 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72a8007a10 con 0x7f72b8102410 2024-09-19T09:25:44.473 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.847+0000 7f72b6ffd640 1 -- 172.21.15.112:0/2546841143 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a8007b70 con 0x7f72b8102410 2024-09-19T09:25:44.473 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.847+0000 7f72c03f1640 1 -- 172.21.15.112:0/2546841143 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b8110d00 con 0x7f72b8102410 2024-09-19T09:25:44.473 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.847+0000 7f72b6ffd640 1 -- 172.21.15.112:0/2546841143 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72a8007e80 con 0x7f72b8102410 2024-09-19T09:25:44.473 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.847+0000 7f72c03f1640 1 -- 172.21.15.112:0/2546841143 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b8111890 con 0x7f72b8102410 2024-09-19T09:25:44.474 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.847+0000 7f72b6ffd640 1 -- 172.21.15.112:0/2546841143 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f72a8038070 con 0x7f72b8102410 2024-09-19T09:25:44.474 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.847+0000 7f72b6ffd640 1 -- 172.21.15.112:0/2546841143 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f72a8045bc0 con 0x7f72b8102410 2024-09-19T09:25:44.474 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.848+0000 7f72c03f1640 1 -- 172.21.15.112:0/2546841143 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b80ffa10 con 0x7f72b8102410 2024-09-19T09:25:44.474 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.850+0000 7f72b6ffd640 1 -- 172.21.15.112:0/2546841143 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f72a8040070 con 0x7f72b8102410 2024-09-19T09:25:44.474 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.906+0000 7f72c03f1640 1 -- 172.21.15.112:0/2546841143 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f72b8101320 con 0x7f72b8102410 2024-09-19T09:25:44.474 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.909+0000 7f72b6ffd640 1 -- 172.21.15.112:0/2546841143 <== mon.0 v2:172.21.15.112:3300/0 7 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f72a8045460 con 0x7f72b8102410 2024-09-19T09:25:44.474 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.909+0000 7f72b6ffd640 1 -- 172.21.15.112:0/2546841143 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+467 (secure 0 0 0) 0x7f72b8101320 con 0x7f72b8102410 2024-09-19T09:25:44.474 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.910+0000 7f72c03f1640 1 -- 172.21.15.112:0/2546841143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102410 msgr2=0x7f72b81105c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:44.474 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.910+0000 7f72c03f1640 1 --2- 172.21.15.112:0/2546841143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102410 0x7f72b81105c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f72a802abe0 tx=0x7f72a8036000 comp rx=0 tx=0).stop 2024-09-19T09:25:44.474 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.910+0000 7f72c03f1640 1 -- 172.21.15.112:0/2546841143 shutdown_connections 2024-09-19T09:25:44.474 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.910+0000 7f72c03f1640 1 --2- 172.21.15.112:0/2546841143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102410 0x7f72b81105c0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:44.474 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.910+0000 7f72c03f1640 1 -- 172.21.15.112:0/2546841143 >> 172.21.15.112:0/2546841143 conn(0x7f72b80fbd90 msgr2=0x7f72b8100560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:44.474 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.910+0000 7f72c03f1640 1 -- 172.21.15.112:0/2546841143 shutdown_connections 2024-09-19T09:25:44.474 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:43.910+0000 7f72c03f1640 1 -- 172.21.15.112:0/2546841143 wait complete. 2024-09-19T09:25:44.475 INFO:teuthology.orchestra.run.smithi112.stdout:Generating new minimal ceph.conf... 2024-09-19T09:25:45.507 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:45 smithi112 ceph-mon[27233]: from='client.? 172.21.15.112:0/2246486292' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:25:45.513 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.858+0000 7f323f5bf640 1 Processor -- start 2024-09-19T09:25:45.513 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.858+0000 7f323f5bf640 1 -- start start 2024-09-19T09:25:45.513 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.859+0000 7f323f5bf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3238078b20 0x7f3238077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:45.513 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.859+0000 7f323f5bf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3238078fc0 con 0x7f3238078b20 2024-09-19T09:25:45.513 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.859+0000 7f323d35b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3238078b20 0x7f3238077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:45.513 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.859+0000 7f323d35b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3238078b20 0x7f3238077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36504/0 (socket says 172.21.15.112:36504) 2024-09-19T09:25:45.513 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.859+0000 7f323d35b640 1 -- 172.21.15.112:0/444676326 learned_addr learned my addr 172.21.15.112:0/444676326 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:25:45.513 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.859+0000 7f323d35b640 1 -- 172.21.15.112:0/444676326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3238079100 con 0x7f3238078b20 2024-09-19T09:25:45.514 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.860+0000 7f323d35b640 1 --2- 172.21.15.112:0/444676326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3238078b20 0x7f3238077230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3228009840 tx=0x7f32280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8488e025da464ed4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:45.514 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.860+0000 7f322ffff640 1 -- 172.21.15.112:0/444676326 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3228032440 con 0x7f3238078b20 2024-09-19T09:25:45.514 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.860+0000 7f322ffff640 1 -- 172.21.15.112:0/444676326 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f3228032a00 con 0x7f3238078b20 2024-09-19T09:25:45.514 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.860+0000 7f322ffff640 1 -- 172.21.15.112:0/444676326 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32280319e0 con 0x7f3238078b20 2024-09-19T09:25:45.514 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.860+0000 7f323f5bf640 1 -- 172.21.15.112:0/444676326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3238078b20 msgr2=0x7f3238077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:45.514 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.860+0000 7f323f5bf640 1 --2- 172.21.15.112:0/444676326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3238078b20 0x7f3238077230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3228009840 tx=0x7f32280091d0 comp rx=0 tx=0).stop 2024-09-19T09:25:45.514 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.860+0000 7f323f5bf640 1 -- 172.21.15.112:0/444676326 shutdown_connections 2024-09-19T09:25:45.514 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.860+0000 7f323f5bf640 1 --2- 172.21.15.112:0/444676326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3238078b20 0x7f3238077230 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:45.514 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.860+0000 7f323f5bf640 1 -- 172.21.15.112:0/444676326 >> 172.21.15.112:0/444676326 conn(0x7f32380fd880 msgr2=0x7f32380ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:45.514 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.861+0000 7f323f5bf640 1 -- 172.21.15.112:0/444676326 shutdown_connections 2024-09-19T09:25:45.514 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.861+0000 7f323f5bf640 1 -- 172.21.15.112:0/444676326 wait complete. 2024-09-19T09:25:45.514 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.861+0000 7f323f5bf640 1 Processor -- start 2024-09-19T09:25:45.514 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.861+0000 7f323f5bf640 1 -- start start 2024-09-19T09:25:45.514 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.861+0000 7f323f5bf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3238078b20 0x7f3238112ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:45.515 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.861+0000 7f323f5bf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3238113530 con 0x7f3238078b20 2024-09-19T09:25:45.515 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.861+0000 7f323d35b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3238078b20 0x7f3238112ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:45.515 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.861+0000 7f323d35b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3238078b20 0x7f3238112ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36506/0 (socket says 172.21.15.112:36506) 2024-09-19T09:25:45.515 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.861+0000 7f323d35b640 1 -- 172.21.15.112:0/2246486292 learned_addr learned my addr 172.21.15.112:0/2246486292 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:25:45.515 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.862+0000 7f323d35b640 1 -- 172.21.15.112:0/2246486292 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3228009450 con 0x7f3238078b20 2024-09-19T09:25:45.515 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.862+0000 7f323d35b640 1 --2- 172.21.15.112:0/2246486292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3238078b20 0x7f3238112ff0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3228006f00 tx=0x7f3228008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:45.515 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.862+0000 7f322dffb640 1 -- 172.21.15.112:0/2246486292 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f322803b470 con 0x7f3238078b20 2024-09-19T09:25:45.515 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.862+0000 7f323f5bf640 1 -- 172.21.15.112:0/2246486292 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3238113730 con 0x7f3238078b20 2024-09-19T09:25:45.515 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.862+0000 7f322dffb640 1 -- 172.21.15.112:0/2246486292 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f322803ba30 con 0x7f3238078b20 2024-09-19T09:25:45.515 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.862+0000 7f322dffb640 1 -- 172.21.15.112:0/2246486292 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f322803a820 con 0x7f3238078b20 2024-09-19T09:25:45.515 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.862+0000 7f323f5bf640 1 -- 172.21.15.112:0/2246486292 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3238113ba0 con 0x7f3238078b20 2024-09-19T09:25:45.515 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.862+0000 7f322dffb640 1 -- 172.21.15.112:0/2246486292 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f322803ad30 con 0x7f3238078b20 2024-09-19T09:25:45.515 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.862+0000 7f322dffb640 1 -- 172.21.15.112:0/2246486292 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f32280443c0 con 0x7f3238078b20 2024-09-19T09:25:45.515 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.863+0000 7f323f5bf640 1 -- 172.21.15.112:0/2246486292 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323804b720 con 0x7f3238078b20 2024-09-19T09:25:45.516 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.865+0000 7f322dffb640 1 -- 172.21.15.112:0/2246486292 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f3238113ba0 con 0x7f3238078b20 2024-09-19T09:25:45.516 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.921+0000 7f323f5bf640 1 -- 172.21.15.112:0/2246486292 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f3238114380 con 0x7f3238078b20 2024-09-19T09:25:45.516 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.921+0000 7f322dffb640 1 -- 172.21.15.112:0/2246486292 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f3228037070 con 0x7f3238078b20 2024-09-19T09:25:45.516 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.922+0000 7f323f5bf640 1 -- 172.21.15.112:0/2246486292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3238078b20 msgr2=0x7f3238112ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:45.516 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.922+0000 7f323f5bf640 1 --2- 172.21.15.112:0/2246486292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3238078b20 0x7f3238112ff0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3228006f00 tx=0x7f3228008040 comp rx=0 tx=0).stop 2024-09-19T09:25:45.516 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.922+0000 7f323f5bf640 1 -- 172.21.15.112:0/2246486292 shutdown_connections 2024-09-19T09:25:45.516 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.922+0000 7f323f5bf640 1 --2- 172.21.15.112:0/2246486292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3238078b20 0x7f3238112ff0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:45.516 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.922+0000 7f323f5bf640 1 -- 172.21.15.112:0/2246486292 >> 172.21.15.112:0/2246486292 conn(0x7f32380fd880 msgr2=0x7f32380fe490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:45.516 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.922+0000 7f323f5bf640 1 -- 172.21.15.112:0/2246486292 shutdown_connections 2024-09-19T09:25:45.516 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:44.922+0000 7f323f5bf640 1 -- 172.21.15.112:0/2246486292 wait complete. 2024-09-19T09:25:45.516 INFO:teuthology.orchestra.run.smithi112.stdout:Restarting the monitor... 2024-09-19T09:25:45.769 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:45 smithi112 systemd[1]: Stopping Ceph mon.smithi112 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:25:46.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:45 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112[27228]: 2024-09-19T09:25:45.767+0000 7f926d00b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi112 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:25:46.471 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:45 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112[27228]: 2024-09-19T09:25:45.767+0000 7f926d00b640 -1 mon.smithi112@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T09:25:46.472 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:45 smithi112 podman[27481]: 2024-09-19 09:25:45.931418482 +0000 UTC m=+0.249266505 container died d74a1969d26bcdc1a5f58e2397fa05df2fa82187103a13f29630d01ee9fe5645 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112, RELEASE=quincy-6e06d1e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T09:25:46.545 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:46 smithi112 podman[27481]: 2024-09-19 09:25:46.275872155 +0000 UTC m=+0.593720168 container cleanup d74a1969d26bcdc1a5f58e2397fa05df2fa82187103a13f29630d01ee9fe5645 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=quincy-6e06d1e) 2024-09-19T09:25:46.545 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:46 smithi112 bash[27481]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112 2024-09-19T09:25:46.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:46 smithi112 podman[27494]: 2024-09-19 09:25:46.544630577 +0000 UTC m=+0.611096470 container remove d74a1969d26bcdc1a5f58e2397fa05df2fa82187103a13f29630d01ee9fe5645 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-6e06d1e, org.label-schema.license=GPLv2) 2024-09-19T09:25:46.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:46 smithi112 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mon.smithi112.service: Deactivated successfully. 2024-09-19T09:25:46.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:46 smithi112 systemd[1]: Stopped Ceph mon.smithi112 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:25:46.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:46 smithi112 systemd[1]: Starting Ceph mon.smithi112 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:25:47.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:46 smithi112 podman[27587]: 2024-09-19 09:25:46.887239356 +0000 UTC m=+0.111884450 container create 34676d67b66963873ddcd2d625151939d68061f559889773357b7fce288664bf (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=quincy-6e06d1e, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T09:25:47.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:46 smithi112 podman[27587]: 2024-09-19 09:25:46.790537475 +0000 UTC m=+0.015182536 image pull f63ad14e4e434a3de1d471d2841f01aa4ae27e9a9e20f9a042bea34292493ec9 quay.ceph.io/ceph-ci/ceph:quincy 2024-09-19T09:25:47.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 podman[27587]: 2024-09-19 09:25:47.105991268 +0000 UTC m=+0.330636327 container init 34676d67b66963873ddcd2d625151939d68061f559889773357b7fce288664bf (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112, ceph=True, CEPH_POINT_RELEASE=, RELEASE=quincy-6e06d1e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:25:47.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 podman[27587]: 2024-09-19 09:25:47.109238247 +0000 UTC m=+0.333883298 container start 34676d67b66963873ddcd2d625151939d68061f559889773357b7fce288664bf (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112, CEPH_POINT_RELEASE=, RELEASE=quincy-6e06d1e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:25:47.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T09:25:47.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable), process ceph-mon, pid 2 2024-09-19T09:25:47.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: pidfile_write: ignore empty --pid-file 2024-09-19T09:25:47.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: load: jerasure load: lrc 2024-09-19T09:25:47.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: RocksDB version: 6.15.5 2024-09-19T09:25:47.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-19T09:25:47.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Compile date Sep 18 2024 2024-09-19T09:25:47.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: DB SUMMARY 2024-09-19T09:25:47.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: DB Session ID: NT35N4VVDT26HAF6AAK8 2024-09-19T09:25:47.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: CURRENT file: CURRENT 2024-09-19T09:25:47.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T09:25:47.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-19T09:25:47.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi112/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T09:25:47.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi112/store.db: 000010.log size: 98150 ; 2024-09-19T09:25:47.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.error_if_exists: 0 2024-09-19T09:25:47.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.create_if_missing: 0 2024-09-19T09:25:47.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.paranoid_checks: 1 2024-09-19T09:25:47.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T09:25:47.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.env: 0x556dd9d89440 2024-09-19T09:25:47.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.fs: Posix File System 2024-09-19T09:25:47.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.info_log: 0x556ddaf070c0 2024-09-19T09:25:47.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T09:25:47.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.statistics: (nil) 2024-09-19T09:25:47.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.use_fsync: 0 2024-09-19T09:25:47.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_log_file_size: 0 2024-09-19T09:25:47.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T09:25:47.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T09:25:47.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T09:25:47.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T09:25:47.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.allow_fallocate: 1 2024-09-19T09:25:47.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T09:25:47.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T09:25:47.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.use_direct_reads: 0 2024-09-19T09:25:47.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T09:25:47.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T09:25:47.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.db_log_dir: 2024-09-19T09:25:47.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi112/store.db 2024-09-19T09:25:47.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T09:25:47.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T09:25:47.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T09:25:47.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T09:25:47.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T09:25:47.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T09:25:47.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T09:25:47.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T09:25:47.187 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.write_buffer_manager: 0x556ddafc4810 2024-09-19T09:25:47.187 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T09:25:47.187 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-19T09:25:47.187 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T09:25:47.187 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T09:25:47.187 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T09:25:47.187 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T09:25:47.187 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T09:25:47.187 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T09:25:47.187 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T09:25:47.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.unordered_write: 0 2024-09-19T09:25:47.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T09:25:47.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T09:25:47.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T09:25:47.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T09:25:47.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.row_cache: None 2024-09-19T09:25:47.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.wal_filter: None 2024-09-19T09:25:47.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T09:25:47.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T09:25:47.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.preserve_deletes: 0 2024-09-19T09:25:47.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.two_write_queues: 0 2024-09-19T09:25:47.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T09:25:47.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.atomic_flush: 0 2024-09-19T09:25:47.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T09:25:47.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T09:25:47.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T09:25:47.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.log_readahead_size: 0 2024-09-19T09:25:47.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T09:25:47.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T09:25:47.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T09:25:47.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T09:25:47.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T09:25:47.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T09:25:47.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_background_jobs: 2 2024-09-19T09:25:47.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_background_compactions: -1 2024-09-19T09:25:47.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_subcompactions: 1 2024-09-19T09:25:47.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T09:25:47.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T09:25:47.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T09:25:47.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T09:25:47.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T09:25:47.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T09:25:47.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T09:25:47.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T09:25:47.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_open_files: -1 2024-09-19T09:25:47.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T09:25:47.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T09:25:47.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T09:25:47.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T09:25:47.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_background_flushes: -1 2024-09-19T09:25:47.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Compression algorithms supported: 2024-09-19T09:25:47.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: kZSTD supported: 0 2024-09-19T09:25:47.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: kXpressCompression supported: 0 2024-09-19T09:25:47.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: kBZip2Compression supported: 0 2024-09-19T09:25:47.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T09:25:47.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: kLZ4Compression supported: 1 2024-09-19T09:25:47.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: kZlibCompression supported: 1 2024-09-19T09:25:47.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T09:25:47.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: kSnappyCompression supported: 1 2024-09-19T09:25:47.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T09:25:47.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000009 2024-09-19T09:25:47.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-19T09:25:47.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T09:25:47.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.merge_operator: 2024-09-19T09:25:47.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compaction_filter: None 2024-09-19T09:25:47.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T09:25:47.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T09:25:47.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T09:25:47.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T09:25:47.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556ddaeada38) 2024-09-19T09:25:47.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks: 1 2024-09-19T09:25:47.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T09:25:47.196 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T09:25:47.196 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_top_level_index_and_filter: 1 2024-09-19T09:25:47.196 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_type: 0 2024-09-19T09:25:47.196 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_index_type: 0 2024-09-19T09:25:47.196 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_shortening: 1 2024-09-19T09:25:47.196 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T09:25:47.196 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: hash_index_allow_collision: 1 2024-09-19T09:25:47.196 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: checksum: 1 2024-09-19T09:25:47.196 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: no_block_cache: 0 2024-09-19T09:25:47.196 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache: 0x556ddaee31f0 2024-09-19T09:25:47.196 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_name: BinnedLRUCache 2024-09-19T09:25:47.196 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_options: 2024-09-19T09:25:47.196 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: capacity : 536870912 2024-09-19T09:25:47.197 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: num_shard_bits : 4 2024-09-19T09:25:47.197 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: strict_capacity_limit : 0 2024-09-19T09:25:47.197 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: high_pri_pool_ratio: 0.000 2024-09-19T09:25:47.197 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_compressed: (nil) 2024-09-19T09:25:47.197 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: persistent_cache: (nil) 2024-09-19T09:25:47.197 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size: 4096 2024-09-19T09:25:47.197 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size_deviation: 10 2024-09-19T09:25:47.197 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_restart_interval: 16 2024-09-19T09:25:47.197 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_block_restart_interval: 1 2024-09-19T09:25:47.197 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: metadata_block_size: 4096 2024-09-19T09:25:47.197 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: partition_filters: 0 2024-09-19T09:25:47.197 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: use_delta_encoding: 1 2024-09-19T09:25:47.197 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-19T09:25:47.197 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: whole_key_filtering: 1 2024-09-19T09:25:47.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: verify_compression: 0 2024-09-19T09:25:47.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: read_amp_bytes_per_bit: 0 2024-09-19T09:25:47.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: format_version: 4 2024-09-19T09:25:47.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_index_compression: 1 2024-09-19T09:25:47.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_align: 0 2024-09-19T09:25:47.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T09:25:47.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T09:25:47.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compression: NoCompression 2024-09-19T09:25:47.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T09:25:47.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T09:25:47.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T09:25:47.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.num_levels: 7 2024-09-19T09:25:47.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T09:25:47.199 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T09:25:47.199 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T09:25:47.199 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T09:25:47.199 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T09:25:47.199 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T09:25:47.199 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T09:25:47.199 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:25:47.199 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T09:25:47.199 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T09:25:47.199 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T09:25:47.199 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T09:25:47.199 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T09:25:47.199 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T09:25:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:25:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T09:25:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T09:25:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T09:25:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T09:25:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T09:25:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T09:25:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T09:25:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T09:25:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T09:25:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T09:25:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T09:25:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T09:25:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T09:25:47.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T09:25:47.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T09:25:47.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T09:25:47.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T09:25:47.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T09:25:47.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T09:25:47.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.arena_block_size: 4194304 2024-09-19T09:25:47.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T09:25:47.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T09:25:47.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-19T09:25:47.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T09:25:47.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T09:25:47.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T09:25:47.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T09:25:47.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T09:25:47.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T09:25:47.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T09:25:47.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T09:25:47.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T09:25:47.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T09:25:47.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T09:25:47.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T09:25:47.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.inplace_update_support: 0 2024-09-19T09:25:47.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T09:25:47.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T09:25:47.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T09:25:47.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T09:25:47.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.bloom_locality: 0 2024-09-19T09:25:47.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.max_successive_merges: 0 2024-09-19T09:25:47.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T09:25:47.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T09:25:47.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T09:25:47.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T09:25:47.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.ttl: 2592000 2024-09-19T09:25:47.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T09:25:47.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.enable_blob_files: false 2024-09-19T09:25:47.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.min_blob_size: 0 2024-09-19T09:25:47.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T09:25:47.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T09:25:47.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T09:25:47.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T09:25:47.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T09:25:47.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-09-19T09:25:47.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-09-19T09:25:47.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726737947132170, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-19T09:25:47.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-09-19T09:25:47.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-19T09:25:47.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726737947133037, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93382, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91462, "index_size": 254, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13564, "raw_average_key_size": 49, "raw_value_size": 84044, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726737947, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "2368659a-0336-440e-9af0-6386197a5183", "db_session_id": "NT35N4VVDT26HAF6AAK8"}} 2024-09-19T09:25:47.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-09-19T09:25:47.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726737947133379, "job": 1, "event": "recovery_finished"} 2024-09-19T09:25:47.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi112/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T09:25:47.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x556ddaf16700 2024-09-19T09:25:47.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: DB pointer 0x556ddaee6000 2024-09-19T09:25:47.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-19T09:25:47.205 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-19T09:25:47.205 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** DB Stats ** 2024-09-19T09:25:47.205 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:25:47.205 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T09:25:47.205 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:25:47.205 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:25:47.205 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T09:25:47.205 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-19T09:25:47.205 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:25:47.205 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:25:47.205 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-19T09:25:47.205 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-19T09:25:47.205 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T09:25:47.205 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: L0 2/0 93.02 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.2 0.00 0.00 1 0.001 0 0 2024-09-19T09:25:47.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Sum 2/0 93.02 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.2 0.00 0.00 1 0.001 0 0 2024-09-19T09:25:47.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.2 0.00 0.00 1 0.001 0 0 2024-09-19T09:25:47.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:25:47.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-19T09:25:47.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-19T09:25:47.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T09:25:47.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 146.2 0.00 0.00 1 0.001 0 0 2024-09-19T09:25:47.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:25:47.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T09:25:47.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T09:25:47.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T09:25:47.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T09:25:47.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T09:25:47.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative compaction: 0.00 GB write, 28.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:25:47.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval compaction: 0.00 GB write, 28.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:25:47.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T09:25:47.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:25:47.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T09:25:47.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:25:47.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-19T09:25:47.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-19T09:25:47.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T09:25:47.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: L0 2/0 93.02 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.2 0.00 0.00 1 0.001 0 0 2024-09-19T09:25:47.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Sum 2/0 93.02 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.2 0.00 0.00 1 0.001 0 0 2024-09-19T09:25:47.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-19T09:25:47.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:25:47.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-19T09:25:47.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-19T09:25:47.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T09:25:47.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 146.2 0.00 0.00 1 0.001 0 0 2024-09-19T09:25:47.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:25:47.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T09:25:47.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T09:25:47.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T09:25:47.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T09:25:47.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T09:25:47.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative compaction: 0.00 GB write, 28.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:25:47.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:25:47.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T09:25:47.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:25:47.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T09:25:47.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: starting mon.smithi112 rank 0 at public addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] at bind addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi112 fsid 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:25:47.209 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: mon.smithi112@-1(???) e1 preinit fsid 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:25:47.209 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: mon.smithi112@-1(???).mds e1 new map 2024-09-19T09:25:47.209 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: mon.smithi112@-1(???).mds e1 print_map 2024-09-19T09:25:47.209 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: e1 2024-09-19T09:25:47.209 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:25:47.209 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:25:47.209 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: legacy client fscid: -1 2024-09-19T09:25:47.209 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:25:47.209 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: No filesystems configured 2024-09-19T09:25:47.209 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: mon.smithi112@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T09:25:47.209 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: mon.smithi112@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:25:47.209 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: mon.smithi112@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:25:47.209 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: mon.smithi112@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:25:47.209 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: mon.smithi112@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T09:25:47.210 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 bash[27587]: 34676d67b66963873ddcd2d625151939d68061f559889773357b7fce288664bf 2024-09-19T09:25:47.210 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 systemd[1]: Started Ceph mon.smithi112 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:25:47.210 INFO:teuthology.orchestra.run.smithi112.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T09:25:47.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: mon.smithi112 is new leader, mons smithi112 in quorum (ranks 0) 2024-09-19T09:25:47.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: monmap e1: 1 mons at {smithi112=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-19T09:25:47.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: fsmap 2024-09-19T09:25:47.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T09:25:47.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:47 smithi112 ceph-mon[27605]: mgrmap e1: no daemons active 2024-09-19T09:25:48.249 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.602+0000 7f6035f11640 1 Processor -- start 2024-09-19T09:25:48.254 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.602+0000 7f6035f11640 1 -- start start 2024-09-19T09:25:48.254 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.602+0000 7f6035f11640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6030100330 0x7f6030100740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:48.254 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.602+0000 7f6035f11640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6030100c80 con 0x7f6030100330 2024-09-19T09:25:48.254 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.603+0000 7f602f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6030100330 0x7f6030100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:48.254 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.603+0000 7f602f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6030100330 0x7f6030100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36520/0 (socket says 172.21.15.112:36520) 2024-09-19T09:25:48.254 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.603+0000 7f602f7fe640 1 -- 172.21.15.112:0/4137116574 learned_addr learned my addr 172.21.15.112:0/4137116574 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:25:48.254 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.603+0000 7f602f7fe640 1 -- 172.21.15.112:0/4137116574 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6030100dc0 con 0x7f6030100330 2024-09-19T09:25:48.255 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.605+0000 7f602f7fe640 1 --2- 172.21.15.112:0/4137116574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6030100330 0x7f6030100740 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6020009840 tx=0x7f60200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f074b84f3c117c9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:48.255 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.605+0000 7f602effd640 1 -- 172.21.15.112:0/4137116574 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6020032440 con 0x7f6030100330 2024-09-19T09:25:48.255 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.605+0000 7f602effd640 1 -- 172.21.15.112:0/4137116574 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6020032a00 con 0x7f6030100330 2024-09-19T09:25:48.255 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.605+0000 7f602effd640 1 -- 172.21.15.112:0/4137116574 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60200319e0 con 0x7f6030100330 2024-09-19T09:25:48.255 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.606+0000 7f6035f11640 1 -- 172.21.15.112:0/4137116574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6030100330 msgr2=0x7f6030100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:48.255 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.606+0000 7f6035f11640 1 --2- 172.21.15.112:0/4137116574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6030100330 0x7f6030100740 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6020009840 tx=0x7f60200091d0 comp rx=0 tx=0).stop 2024-09-19T09:25:48.255 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.606+0000 7f6035f11640 1 -- 172.21.15.112:0/4137116574 shutdown_connections 2024-09-19T09:25:48.255 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.606+0000 7f6035f11640 1 --2- 172.21.15.112:0/4137116574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6030100330 0x7f6030100740 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:48.255 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.606+0000 7f6035f11640 1 -- 172.21.15.112:0/4137116574 >> 172.21.15.112:0/4137116574 conn(0x7f60300fbdd0 msgr2=0x7f60300fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:48.256 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.606+0000 7f6035f11640 1 -- 172.21.15.112:0/4137116574 shutdown_connections 2024-09-19T09:25:48.256 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.606+0000 7f6035f11640 1 -- 172.21.15.112:0/4137116574 wait complete. 2024-09-19T09:25:48.256 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.606+0000 7f6035f11640 1 Processor -- start 2024-09-19T09:25:48.256 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.606+0000 7f6035f11640 1 -- start start 2024-09-19T09:25:48.256 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.606+0000 7f6035f11640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6030100330 0x7f6030110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:48.256 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.606+0000 7f6035f11640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6030111310 con 0x7f6030100330 2024-09-19T09:25:48.256 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.607+0000 7f602f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6030100330 0x7f6030110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:48.256 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.607+0000 7f602f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6030100330 0x7f6030110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36528/0 (socket says 172.21.15.112:36528) 2024-09-19T09:25:48.256 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.607+0000 7f602f7fe640 1 -- 172.21.15.112:0/1789413805 learned_addr learned my addr 172.21.15.112:0/1789413805 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:25:48.256 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.607+0000 7f602f7fe640 1 -- 172.21.15.112:0/1789413805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6020009450 con 0x7f6030100330 2024-09-19T09:25:48.256 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.607+0000 7f602f7fe640 1 --2- 172.21.15.112:0/1789413805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6030100330 0x7f6030110dd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6020000c00 tx=0x7f6020008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:48.256 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.607+0000 7f602cff9640 1 -- 172.21.15.112:0/1789413805 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f602003d450 con 0x7f6030100330 2024-09-19T09:25:48.257 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.607+0000 7f602cff9640 1 -- 172.21.15.112:0/1789413805 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f602003da10 con 0x7f6030100330 2024-09-19T09:25:48.257 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.607+0000 7f6035f11640 1 -- 172.21.15.112:0/1789413805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6030111510 con 0x7f6030100330 2024-09-19T09:25:48.257 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.607+0000 7f602cff9640 1 -- 172.21.15.112:0/1789413805 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f602003b8e0 con 0x7f6030100330 2024-09-19T09:25:48.257 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.607+0000 7f6035f11640 1 -- 172.21.15.112:0/1789413805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6030111f60 con 0x7f6030100330 2024-09-19T09:25:48.257 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.607+0000 7f602cff9640 1 -- 172.21.15.112:0/1789413805 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6020039070 con 0x7f6030100330 2024-09-19T09:25:48.257 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.608+0000 7f602cff9640 1 -- 172.21.15.112:0/1789413805 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6020046760 con 0x7f6030100330 2024-09-19T09:25:48.257 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.608+0000 7f6035f11640 1 -- 172.21.15.112:0/1789413805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60300ffa30 con 0x7f6030100330 2024-09-19T09:25:48.257 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.610+0000 7f602cff9640 1 -- 172.21.15.112:0/1789413805 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f60200657a0 con 0x7f6030100330 2024-09-19T09:25:48.257 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.665+0000 7f6035f11640 1 -- 172.21.15.112:0/1789413805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f6030105f00 con 0x7f6030100330 2024-09-19T09:25:48.257 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.669+0000 7f602cff9640 1 -- 172.21.15.112:0/1789413805 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6020054020 con 0x7f6030100330 2024-09-19T09:25:48.258 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.670+0000 7f6035f11640 1 -- 172.21.15.112:0/1789413805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6030100330 msgr2=0x7f6030110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:48.258 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.670+0000 7f6035f11640 1 --2- 172.21.15.112:0/1789413805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6030100330 0x7f6030110dd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6020000c00 tx=0x7f6020008040 comp rx=0 tx=0).stop 2024-09-19T09:25:48.258 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.670+0000 7f6035f11640 1 -- 172.21.15.112:0/1789413805 shutdown_connections 2024-09-19T09:25:48.258 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.670+0000 7f6035f11640 1 --2- 172.21.15.112:0/1789413805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6030100330 0x7f6030110dd0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:48.258 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.670+0000 7f6035f11640 1 -- 172.21.15.112:0/1789413805 >> 172.21.15.112:0/1789413805 conn(0x7f60300fbdd0 msgr2=0x7f60300fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:48.258 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.670+0000 7f6035f11640 1 -- 172.21.15.112:0/1789413805 shutdown_connections 2024-09-19T09:25:48.258 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:47.670+0000 7f6035f11640 1 -- 172.21.15.112:0/1789413805 wait complete. 2024-09-19T09:25:48.258 INFO:teuthology.orchestra.run.smithi112.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T09:25:48.258 INFO:teuthology.orchestra.run.smithi112.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:25:48.258 INFO:teuthology.orchestra.run.smithi112.stdout:Creating mgr... 2024-09-19T09:25:48.258 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T09:25:48.258 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T09:25:48.258 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-19T09:25:48.498 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mgr.smithi112.puhuua 2024-09-19T09:25:48.499 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mgr.smithi112.puhuua.service: Unit ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mgr.smithi112.puhuua.service not loaded. 2024-09-19T09:25:48.748 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0bd98d30-7669-11ef-bceb-c7b262605968.target.wants/ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mgr.smithi112.puhuua.service → /etc/systemd/system/ceph-0bd98d30-7669-11ef-bceb-c7b262605968@.service. 2024-09-19T09:25:48.765 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:48 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1789413805' entity='client.admin' 2024-09-19T09:25:52.809 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:25:52.809 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout disabled 2024-09-19T09:25:52.816 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:25:52.816 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout inactive 2024-09-19T09:25:52.817 INFO:teuthology.orchestra.run.smithi112.stdout:firewalld.service is not enabled 2024-09-19T09:25:52.817 INFO:teuthology.orchestra.run.smithi112.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T09:25:52.825 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:25:52.826 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout disabled 2024-09-19T09:25:52.834 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:25:52.834 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout inactive 2024-09-19T09:25:52.834 INFO:teuthology.orchestra.run.smithi112.stdout:firewalld.service is not enabled 2024-09-19T09:25:52.834 INFO:teuthology.orchestra.run.smithi112.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-19T09:25:52.834 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for mgr to start... 2024-09-19T09:25:52.834 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for mgr... 2024-09-19T09:25:56.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:56 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3304146561' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:25:56.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:56 smithi112 ceph-mon[27605]: Activating manager daemon smithi112.puhuua 2024-09-19T09:25:56.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:56 smithi112 ceph-mon[27605]: mgrmap e2: smithi112.puhuua(active, starting, since 0.00415765s) 2024-09-19T09:25:56.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:56 smithi112 ceph-mon[27605]: from='mgr.14100 172.21.15.112:0/3474532925' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:25:56.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:56 smithi112 ceph-mon[27605]: from='mgr.14100 172.21.15.112:0/3474532925' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:25:56.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:56 smithi112 ceph-mon[27605]: from='mgr.14100 172.21.15.112:0/3474532925' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:25:56.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:56 smithi112 ceph-mon[27605]: from='mgr.14100 172.21.15.112:0/3474532925' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:25:56.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:56 smithi112 ceph-mon[27605]: from='mgr.14100 172.21.15.112:0/3474532925' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr metadata", "who": "smithi112.puhuua", "id": "smithi112.puhuua"}]: dispatch 2024-09-19T09:25:56.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:56 smithi112 ceph-mon[27605]: Manager daemon smithi112.puhuua is now available 2024-09-19T09:25:56.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:56 smithi112 ceph-mon[27605]: from='mgr.14100 172.21.15.112:0/3474532925' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:25:56.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:56 smithi112 ceph-mon[27605]: from='mgr.14100 172.21.15.112:0/3474532925' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/trash_purge_schedule"}]: dispatch 2024-09-19T09:25:56.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:56 smithi112 ceph-mon[27605]: from='mgr.14100 172.21.15.112:0/3474532925' entity='mgr.smithi112.puhuua' 2024-09-19T09:25:56.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:56 smithi112 ceph-mon[27605]: from='mgr.14100 172.21.15.112:0/3474532925' entity='mgr.smithi112.puhuua' 2024-09-19T09:25:56.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:56 smithi112 ceph-mon[27605]: from='mgr.14100 172.21.15.112:0/3474532925' entity='mgr.smithi112.puhuua' 2024-09-19T09:25:58.081 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-19T09:25:58.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:25:58.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "fsid": "0bd98d30-7669-11ef-bceb-c7b262605968", 2024-09-19T09:25:58.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:25:58.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:25:58.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:25:58.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:25:58.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:25:58.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:25:58.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:25:58.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:25:58.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:25:58.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:25:58.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "smithi112" 2024-09-19T09:25:58.083 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:25:58.083 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-19T09:25:58.083 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:25:58.083 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:25:58.083 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-19T09:25:58.083 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:25:58.083 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:25:58.083 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:25:58.083 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:25:58.084 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:25:58.084 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:25:58.084 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:25:58.084 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:25:58.084 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:25:58.084 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:25:58.084 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:25:58.084 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:25:58.084 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:25:58.084 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:25:58.084 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:25:58.084 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:25:58.084 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:25:58.084 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:25:58.085 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:25:58.085 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:25:58.085 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:25:58.085 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:25:58.085 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:25:58.085 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:25:58.085 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:25:58.085 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:25:58.085 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:25:58.085 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T09:25:58.085 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:25:58.086 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:25:58.086 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:25:58.086 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:25:58.086 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:25:58.086 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:25:58.086 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:25:58.086 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:25:58.086 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:25:58.086 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:25:58.086 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:25:42.323928+0000", 2024-09-19T09:25:58.086 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:25:58.086 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:25:58.087 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:25:58.087 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:25:58.087 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.077+0000 7f3e8caf9640 1 Processor -- start 2024-09-19T09:25:58.087 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.077+0000 7f3e8caf9640 1 -- start start 2024-09-19T09:25:58.087 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.077+0000 7f3e8caf9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e88076a90 0x7f3e88104c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:58.087 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.077+0000 7f3e8caf9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e88076ea0 con 0x7f3e88076a90 2024-09-19T09:25:58.087 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.078+0000 7f3e8659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e88076a90 0x7f3e88104c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:58.087 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.078+0000 7f3e8659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e88076a90 0x7f3e88104c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46556/0 (socket says 172.21.15.112:46556) 2024-09-19T09:25:58.087 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.078+0000 7f3e8659c640 1 -- 172.21.15.112:0/75159794 learned_addr learned my addr 172.21.15.112:0/75159794 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:25:58.087 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.078+0000 7f3e8659c640 1 -- 172.21.15.112:0/75159794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e881051a0 con 0x7f3e88076a90 2024-09-19T09:25:58.087 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.079+0000 7f3e8659c640 1 --2- 172.21.15.112:0/75159794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e88076a90 0x7f3e88104c60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3e78009840 tx=0x7f3e780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a3aab1dfa8c861 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:58.088 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.079+0000 7f3e8559a640 1 -- 172.21.15.112:0/75159794 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e78032440 con 0x7f3e88076a90 2024-09-19T09:25:58.088 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.079+0000 7f3e8559a640 1 -- 172.21.15.112:0/75159794 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f3e78032a00 con 0x7f3e88076a90 2024-09-19T09:25:58.088 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.079+0000 7f3e8559a640 1 -- 172.21.15.112:0/75159794 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e78031a10 con 0x7f3e88076a90 2024-09-19T09:25:58.088 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.079+0000 7f3e8caf9640 1 -- 172.21.15.112:0/75159794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e88076a90 msgr2=0x7f3e88104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:58.088 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.079+0000 7f3e8caf9640 1 --2- 172.21.15.112:0/75159794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e88076a90 0x7f3e88104c60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3e78009840 tx=0x7f3e780091d0 comp rx=0 tx=0).stop 2024-09-19T09:25:58.088 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.079+0000 7f3e8caf9640 1 -- 172.21.15.112:0/75159794 shutdown_connections 2024-09-19T09:25:58.088 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.080+0000 7f3e8caf9640 1 --2- 172.21.15.112:0/75159794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e88076a90 0x7f3e88104c60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:58.088 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.080+0000 7f3e8caf9640 1 -- 172.21.15.112:0/75159794 >> 172.21.15.112:0/75159794 conn(0x7f3e880fc6d0 msgr2=0x7f3e880feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:58.088 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.080+0000 7f3e8caf9640 1 -- 172.21.15.112:0/75159794 shutdown_connections 2024-09-19T09:25:58.088 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.080+0000 7f3e8caf9640 1 -- 172.21.15.112:0/75159794 wait complete. 2024-09-19T09:25:58.088 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.080+0000 7f3e8caf9640 1 Processor -- start 2024-09-19T09:25:58.089 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.080+0000 7f3e8caf9640 1 -- start start 2024-09-19T09:25:58.089 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.080+0000 7f3e8caf9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e88076a90 0x7f3e88110cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:58.089 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.080+0000 7f3e8caf9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e88111230 con 0x7f3e88076a90 2024-09-19T09:25:58.089 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.080+0000 7f3e8659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e88076a90 0x7f3e88110cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:58.089 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.080+0000 7f3e8659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e88076a90 0x7f3e88110cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46566/0 (socket says 172.21.15.112:46566) 2024-09-19T09:25:58.089 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.080+0000 7f3e8659c640 1 -- 172.21.15.112:0/3304146561 learned_addr learned my addr 172.21.15.112:0/3304146561 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:25:58.089 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.081+0000 7f3e8659c640 1 -- 172.21.15.112:0/3304146561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e78009450 con 0x7f3e88076a90 2024-09-19T09:25:58.089 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.081+0000 7f3e8659c640 1 --2- 172.21.15.112:0/3304146561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e88076a90 0x7f3e88110cf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3e780098a0 tx=0x7f3e7802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:58.089 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.081+0000 7f3e76ffd640 1 -- 172.21.15.112:0/3304146561 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e780327b0 con 0x7f3e88076a90 2024-09-19T09:25:58.089 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.081+0000 7f3e8caf9640 1 -- 172.21.15.112:0/3304146561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e88111430 con 0x7f3e88076a90 2024-09-19T09:25:58.090 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.081+0000 7f3e76ffd640 1 -- 172.21.15.112:0/3304146561 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f3e7803b870 con 0x7f3e88076a90 2024-09-19T09:25:58.090 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.081+0000 7f3e76ffd640 1 -- 172.21.15.112:0/3304146561 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e7803a530 con 0x7f3e88076a90 2024-09-19T09:25:58.090 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.081+0000 7f3e8caf9640 1 -- 172.21.15.112:0/3304146561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e88111fc0 con 0x7f3e88076a90 2024-09-19T09:25:58.090 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.081+0000 7f3e76ffd640 1 -- 172.21.15.112:0/3304146561 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3e78039040 con 0x7f3e88076a90 2024-09-19T09:25:58.090 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.081+0000 7f3e76ffd640 1 -- 172.21.15.112:0/3304146561 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3e780447a0 con 0x7f3e88076a90 2024-09-19T09:25:58.090 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.082+0000 7f3e8caf9640 1 -- 172.21.15.112:0/3304146561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e881002f0 con 0x7f3e88076a90 2024-09-19T09:25:58.090 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.084+0000 7f3e76ffd640 1 -- 172.21.15.112:0/3304146561 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f3e78049060 con 0x7f3e88076a90 2024-09-19T09:25:58.090 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.142+0000 7f3e8caf9640 1 -- 172.21.15.112:0/3304146561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f3e88105ec0 con 0x7f3e88076a90 2024-09-19T09:25:58.090 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.142+0000 7f3e76ffd640 1 -- 172.21.15.112:0/3304146561 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f3e7803f070 con 0x7f3e88076a90 2024-09-19T09:25:58.090 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.143+0000 7f3e8caf9640 1 -- 172.21.15.112:0/3304146561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e88076a90 msgr2=0x7f3e88110cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:58.090 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.143+0000 7f3e8caf9640 1 --2- 172.21.15.112:0/3304146561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e88076a90 0x7f3e88110cf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3e780098a0 tx=0x7f3e7802c040 comp rx=0 tx=0).stop 2024-09-19T09:25:58.090 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.143+0000 7f3e8caf9640 1 -- 172.21.15.112:0/3304146561 shutdown_connections 2024-09-19T09:25:58.091 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.143+0000 7f3e8caf9640 1 --2- 172.21.15.112:0/3304146561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e88076a90 0x7f3e88110cf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:58.091 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.143+0000 7f3e8caf9640 1 -- 172.21.15.112:0/3304146561 >> 172.21.15.112:0/3304146561 conn(0x7f3e880fc6d0 msgr2=0x7f3e880fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:58.091 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.143+0000 7f3e8caf9640 1 -- 172.21.15.112:0/3304146561 shutdown_connections 2024-09-19T09:25:58.091 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:25:56.143+0000 7f3e8caf9640 1 -- 172.21.15.112:0/3304146561 wait complete. 2024-09-19T09:25:58.091 INFO:teuthology.orchestra.run.smithi112.stdout:mgr not available, waiting (1/15)... 2024-09-19T09:25:58.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:58 smithi112 ceph-mon[27605]: mgrmap e3: smithi112.puhuua(active, since 1.00778s) 2024-09-19T09:25:59.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:25:59 smithi112 ceph-mon[27605]: mgrmap e4: smithi112.puhuua(active, since 2s) 2024-09-19T09:26:01.100 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:00 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2583511310' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:26:01.371 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-19T09:26:01.372 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:26:01.372 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "fsid": "0bd98d30-7669-11ef-bceb-c7b262605968", 2024-09-19T09:26:01.372 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:26:01.372 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:26:01.372 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:26:01.372 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:26:01.372 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:26:01.372 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:26:01.372 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:26:01.372 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:26:01.372 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:26:01.372 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:26:01.373 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "smithi112" 2024-09-19T09:26:01.373 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:26:01.373 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-09-19T09:26:01.373 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:26:01.373 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:26:01.373 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-19T09:26:01.373 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:26:01.373 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:26:01.373 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:26:01.373 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:26:01.373 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:26:01.373 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:26:01.373 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:26:01.382 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:26:01.382 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:26:01.382 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:26:01.382 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:26:01.382 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:26:01.382 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:26:01.382 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:26:01.382 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:26:01.382 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:26:01.382 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:26:01.382 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:26:01.382 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:26:01.383 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:26:01.383 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:26:01.383 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:26:01.383 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:26:01.383 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:26:01.383 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:26:01.383 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:26:01.383 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:26:01.383 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:26:01.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:26:01.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:26:01.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:26:01.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:26:01.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:26:01.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:26:01.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:26:01.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:26:01.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:26:01.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:26:01.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:25:42.323928+0000", 2024-09-19T09:26:01.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:26:01.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:26:01.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:26:01.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:26:01.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.516+0000 7f70a6bcc640 1 Processor -- start 2024-09-19T09:26:01.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.517+0000 7f70a6bcc640 1 -- start start 2024-09-19T09:26:01.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.517+0000 7f70a6bcc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a0076b70 0x7f70a0104b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:01.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.517+0000 7f70a6bcc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a01050c0 con 0x7f70a0076b70 2024-09-19T09:26:01.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.517+0000 7f70a4968640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a0076b70 0x7f70a0104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:01.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.517+0000 7f70a4968640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a0076b70 0x7f70a0104b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46670/0 (socket says 172.21.15.112:46670) 2024-09-19T09:26:01.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.517+0000 7f70a4968640 1 -- 172.21.15.112:0/3368556053 learned_addr learned my addr 172.21.15.112:0/3368556053 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:01.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.517+0000 7f70a4968640 1 -- 172.21.15.112:0/3368556053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a0105200 con 0x7f70a0076b70 2024-09-19T09:26:01.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.518+0000 7f70a4968640 1 --2- 172.21.15.112:0/3368556053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a0076b70 0x7f70a0104b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7088009840 tx=0x7f70880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2708ce92cbfdc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:01.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.518+0000 7f709f7fe640 1 -- 172.21.15.112:0/3368556053 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7088032440 con 0x7f70a0076b70 2024-09-19T09:26:01.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.518+0000 7f709f7fe640 1 -- 172.21.15.112:0/3368556053 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f7088032a00 con 0x7f70a0076b70 2024-09-19T09:26:01.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.518+0000 7f709f7fe640 1 -- 172.21.15.112:0/3368556053 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7088031a10 con 0x7f70a0076b70 2024-09-19T09:26:01.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.519+0000 7f70a6bcc640 1 -- 172.21.15.112:0/3368556053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a0076b70 msgr2=0x7f70a0104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:01.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.519+0000 7f70a6bcc640 1 --2- 172.21.15.112:0/3368556053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a0076b70 0x7f70a0104b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7088009840 tx=0x7f70880091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:01.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.519+0000 7f70a6bcc640 1 -- 172.21.15.112:0/3368556053 shutdown_connections 2024-09-19T09:26:01.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.519+0000 7f70a6bcc640 1 --2- 172.21.15.112:0/3368556053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a0076b70 0x7f70a0104b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:01.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.519+0000 7f70a6bcc640 1 -- 172.21.15.112:0/3368556053 >> 172.21.15.112:0/3368556053 conn(0x7f70a00fc6d0 msgr2=0x7f70a00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:01.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.519+0000 7f70a6bcc640 1 -- 172.21.15.112:0/3368556053 shutdown_connections 2024-09-19T09:26:01.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.519+0000 7f70a6bcc640 1 -- 172.21.15.112:0/3368556053 wait complete. 2024-09-19T09:26:01.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.519+0000 7f70a6bcc640 1 Processor -- start 2024-09-19T09:26:01.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.520+0000 7f70a6bcc640 1 -- start start 2024-09-19T09:26:01.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.520+0000 7f70a6bcc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a0076b70 0x7f70a01024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:01.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.520+0000 7f70a6bcc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a01029f0 con 0x7f70a0076b70 2024-09-19T09:26:01.387 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.520+0000 7f70a4968640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a0076b70 0x7f70a01024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:01.387 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.520+0000 7f70a4968640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a0076b70 0x7f70a01024b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46678/0 (socket says 172.21.15.112:46678) 2024-09-19T09:26:01.387 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.520+0000 7f70a4968640 1 -- 172.21.15.112:0/2583511310 learned_addr learned my addr 172.21.15.112:0/2583511310 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:01.387 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.520+0000 7f70a4968640 1 -- 172.21.15.112:0/2583511310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7088009450 con 0x7f70a0076b70 2024-09-19T09:26:01.387 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.520+0000 7f70a4968640 1 --2- 172.21.15.112:0/2583511310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a0076b70 0x7f70a01024b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f70880098a0 tx=0x7f708802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:01.387 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.521+0000 7f709d7fa640 1 -- 172.21.15.112:0/2583511310 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70880327b0 con 0x7f70a0076b70 2024-09-19T09:26:01.387 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.521+0000 7f709d7fa640 1 -- 172.21.15.112:0/2583511310 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f708803b870 con 0x7f70a0076b70 2024-09-19T09:26:01.387 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.521+0000 7f70a6bcc640 1 -- 172.21.15.112:0/2583511310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a0100a80 con 0x7f70a0076b70 2024-09-19T09:26:01.388 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.521+0000 7f709d7fa640 1 -- 172.21.15.112:0/2583511310 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f708803a550 con 0x7f70a0076b70 2024-09-19T09:26:01.388 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.521+0000 7f70a6bcc640 1 -- 172.21.15.112:0/2583511310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a0100ef0 con 0x7f70a0076b70 2024-09-19T09:26:01.388 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.521+0000 7f709d7fa640 1 -- 172.21.15.112:0/2583511310 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f7088039040 con 0x7f70a0076b70 2024-09-19T09:26:01.388 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.522+0000 7f70a6bcc640 1 -- 172.21.15.112:0/2583511310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a004b720 con 0x7f70a0076b70 2024-09-19T09:26:01.388 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.522+0000 7f709d7fa640 1 --2- 172.21.15.112:0/2583511310 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f708c039450 0x7f708c03b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:01.388 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.522+0000 7f709d7fa640 1 -- 172.21.15.112:0/2583511310 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f708806c8b0 con 0x7f70a0076b70 2024-09-19T09:26:01.388 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.522+0000 7f709ffff640 1 --2- 172.21.15.112:0/2583511310 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f708c039450 0x7f708c03b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:01.388 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.522+0000 7f709ffff640 1 --2- 172.21.15.112:0/2583511310 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f708c039450 0x7f708c03b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7090006fd0 tx=0x7f7090006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:01.388 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.527+0000 7f709d7fa640 1 -- 172.21.15.112:0/2583511310 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7088042360 con 0x7f70a0076b70 2024-09-19T09:26:01.388 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.738+0000 7f70a6bcc640 1 -- 172.21.15.112:0/2583511310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f70a0105ec0 con 0x7f70a0076b70 2024-09-19T09:26:01.388 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.738+0000 7f709d7fa640 1 -- 172.21.15.112:0/2583511310 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f708803f030 con 0x7f70a0076b70 2024-09-19T09:26:01.388 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.741+0000 7f70a6bcc640 1 -- 172.21.15.112:0/2583511310 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f708c039450 msgr2=0x7f708c03b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:01.389 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.741+0000 7f70a6bcc640 1 --2- 172.21.15.112:0/2583511310 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f708c039450 0x7f708c03b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7090006fd0 tx=0x7f7090006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:01.389 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.741+0000 7f70a6bcc640 1 -- 172.21.15.112:0/2583511310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a0076b70 msgr2=0x7f70a01024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:01.389 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.741+0000 7f70a6bcc640 1 --2- 172.21.15.112:0/2583511310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a0076b70 0x7f70a01024b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f70880098a0 tx=0x7f708802c040 comp rx=0 tx=0).stop 2024-09-19T09:26:01.389 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.741+0000 7f70a6bcc640 1 -- 172.21.15.112:0/2583511310 shutdown_connections 2024-09-19T09:26:01.389 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.741+0000 7f70a6bcc640 1 --2- 172.21.15.112:0/2583511310 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f708c039450 0x7f708c03b900 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:01.389 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.741+0000 7f70a6bcc640 1 --2- 172.21.15.112:0/2583511310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a0076b70 0x7f70a01024b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:01.389 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.741+0000 7f70a6bcc640 1 -- 172.21.15.112:0/2583511310 >> 172.21.15.112:0/2583511310 conn(0x7f70a00fc6d0 msgr2=0x7f70a00fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:01.389 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.741+0000 7f70a6bcc640 1 -- 172.21.15.112:0/2583511310 shutdown_connections 2024-09-19T09:26:01.389 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:00.741+0000 7f70a6bcc640 1 -- 172.21.15.112:0/2583511310 wait complete. 2024-09-19T09:26:01.389 INFO:teuthology.orchestra.run.smithi112.stdout:mgr is available 2024-09-19T09:26:02.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:02 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1097643244' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T09:26:02.719 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-19T09:26:02.720 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T09:26:02.720 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout fsid = 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:26:02.720 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-19T09:26:02.720 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T09:26:02.720 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T09:26:02.720 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T09:26:02.720 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T09:26:02.720 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-19T09:26:02.720 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T09:26:02.721 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T09:26:02.721 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-19T09:26:02.721 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T09:26:02.721 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T09:26:02.721 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T09:26:02.721 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T09:26:02.721 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T09:26:02.721 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T09:26:02.721 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.809+0000 7f36849be640 1 Processor -- start 2024-09-19T09:26:02.721 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.809+0000 7f36849be640 1 -- start start 2024-09-19T09:26:02.721 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.809+0000 7f36849be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3680101f80 0x7f3680102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:02.721 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.809+0000 7f36849be640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36801028d0 con 0x7f3680101f80 2024-09-19T09:26:02.721 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.809+0000 7f367e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3680101f80 0x7f3680102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:02.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.809+0000 7f367e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3680101f80 0x7f3680102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46686/0 (socket says 172.21.15.112:46686) 2024-09-19T09:26:02.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.809+0000 7f367e59c640 1 -- 172.21.15.112:0/1261735329 learned_addr learned my addr 172.21.15.112:0/1261735329 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:02.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.810+0000 7f367e59c640 1 -- 172.21.15.112:0/1261735329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680102a10 con 0x7f3680101f80 2024-09-19T09:26:02.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.810+0000 7f367e59c640 1 --2- 172.21.15.112:0/1261735329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3680101f80 0x7f3680102390 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3670009840 tx=0x7f36700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d752c2a417899cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:02.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.811+0000 7f367d59a640 1 -- 172.21.15.112:0/1261735329 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3670032440 con 0x7f3680101f80 2024-09-19T09:26:02.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.811+0000 7f367d59a640 1 -- 172.21.15.112:0/1261735329 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f3670032a00 con 0x7f3680101f80 2024-09-19T09:26:02.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.811+0000 7f367d59a640 1 -- 172.21.15.112:0/1261735329 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36700319e0 con 0x7f3680101f80 2024-09-19T09:26:02.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.811+0000 7f36849be640 1 -- 172.21.15.112:0/1261735329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3680101f80 msgr2=0x7f3680102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:02.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.811+0000 7f36849be640 1 --2- 172.21.15.112:0/1261735329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3680101f80 0x7f3680102390 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3670009840 tx=0x7f36700091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:02.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.811+0000 7f36849be640 1 -- 172.21.15.112:0/1261735329 shutdown_connections 2024-09-19T09:26:02.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.811+0000 7f36849be640 1 --2- 172.21.15.112:0/1261735329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3680101f80 0x7f3680102390 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:02.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.811+0000 7f36849be640 1 -- 172.21.15.112:0/1261735329 >> 172.21.15.112:0/1261735329 conn(0x7f36800fd7a0 msgr2=0x7f36800ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:02.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.811+0000 7f36849be640 1 -- 172.21.15.112:0/1261735329 shutdown_connections 2024-09-19T09:26:02.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.811+0000 7f36849be640 1 -- 172.21.15.112:0/1261735329 wait complete. 2024-09-19T09:26:02.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.812+0000 7f36849be640 1 Processor -- start 2024-09-19T09:26:02.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.812+0000 7f36849be640 1 -- start start 2024-09-19T09:26:02.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.812+0000 7f36849be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3680101f80 0x7f3680110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:02.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.812+0000 7f36849be640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3680111370 con 0x7f3680101f80 2024-09-19T09:26:02.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.812+0000 7f367e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3680101f80 0x7f3680110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:02.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.812+0000 7f367e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3680101f80 0x7f3680110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46692/0 (socket says 172.21.15.112:46692) 2024-09-19T09:26:02.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.812+0000 7f367e59c640 1 -- 172.21.15.112:0/1097643244 learned_addr learned my addr 172.21.15.112:0/1097643244 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:02.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.812+0000 7f367e59c640 1 -- 172.21.15.112:0/1097643244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670009450 con 0x7f3680101f80 2024-09-19T09:26:02.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.812+0000 7f367e59c640 1 --2- 172.21.15.112:0/1097643244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3680101f80 0x7f3680110e30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3670000c00 tx=0x7f3670008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:02.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.813+0000 7f366effd640 1 -- 172.21.15.112:0/1097643244 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f367003d450 con 0x7f3680101f80 2024-09-19T09:26:02.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.813+0000 7f366effd640 1 -- 172.21.15.112:0/1097643244 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f367003da10 con 0x7f3680101f80 2024-09-19T09:26:02.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.813+0000 7f36849be640 1 -- 172.21.15.112:0/1097643244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3680111570 con 0x7f3680101f80 2024-09-19T09:26:02.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.813+0000 7f366effd640 1 -- 172.21.15.112:0/1097643244 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f367003b880 con 0x7f3680101f80 2024-09-19T09:26:02.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.813+0000 7f36849be640 1 -- 172.21.15.112:0/1097643244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3680111fc0 con 0x7f3680101f80 2024-09-19T09:26:02.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.814+0000 7f366effd640 1 -- 172.21.15.112:0/1097643244 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f3670039070 con 0x7f3680101f80 2024-09-19T09:26:02.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.814+0000 7f36849be640 1 -- 172.21.15.112:0/1097643244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36801013e0 con 0x7f3680101f80 2024-09-19T09:26:02.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.814+0000 7f366effd640 1 --2- 172.21.15.112:0/1097643244 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f3668039450 0x7f366803b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:02.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.814+0000 7f366effd640 1 -- 172.21.15.112:0/1097643244 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f367006cfb0 con 0x7f3680101f80 2024-09-19T09:26:02.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.814+0000 7f367dd9b640 1 --2- 172.21.15.112:0/1097643244 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f3668039450 0x7f366803b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:02.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.814+0000 7f367dd9b640 1 --2- 172.21.15.112:0/1097643244 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f3668039450 0x7f366803b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3674006fd0 tx=0x7f3674006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:02.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.818+0000 7f366effd640 1 -- 172.21.15.112:0/1097643244 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f367003cba0 con 0x7f3680101f80 2024-09-19T09:26:02.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.975+0000 7f36849be640 1 -- 172.21.15.112:0/1097643244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f368004b720 con 0x7f3680101f80 2024-09-19T09:26:02.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.976+0000 7f366effd640 1 -- 172.21.15.112:0/1097643244 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+409 (secure 0 0 0) 0x7f3670041030 con 0x7f3680101f80 2024-09-19T09:26:02.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.978+0000 7f36849be640 1 -- 172.21.15.112:0/1097643244 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f3668039450 msgr2=0x7f366803b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:02.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.978+0000 7f36849be640 1 --2- 172.21.15.112:0/1097643244 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f3668039450 0x7f366803b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3674006fd0 tx=0x7f3674006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:02.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.978+0000 7f36849be640 1 -- 172.21.15.112:0/1097643244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3680101f80 msgr2=0x7f3680110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:02.725 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.978+0000 7f36849be640 1 --2- 172.21.15.112:0/1097643244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3680101f80 0x7f3680110e30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3670000c00 tx=0x7f3670008040 comp rx=0 tx=0).stop 2024-09-19T09:26:02.725 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.978+0000 7f36849be640 1 -- 172.21.15.112:0/1097643244 shutdown_connections 2024-09-19T09:26:02.725 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.978+0000 7f36849be640 1 --2- 172.21.15.112:0/1097643244 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f3668039450 0x7f366803b900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:02.725 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.978+0000 7f36849be640 1 --2- 172.21.15.112:0/1097643244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3680101f80 0x7f3680110e30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:02.726 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.978+0000 7f36849be640 1 -- 172.21.15.112:0/1097643244 >> 172.21.15.112:0/1097643244 conn(0x7f36800fd7a0 msgr2=0x7f36800fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:02.726 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.978+0000 7f36849be640 1 -- 172.21.15.112:0/1097643244 shutdown_connections 2024-09-19T09:26:02.726 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:01.978+0000 7f36849be640 1 -- 172.21.15.112:0/1097643244 wait complete. 2024-09-19T09:26:02.726 INFO:teuthology.orchestra.run.smithi112.stdout:Enabling cephadm module... 2024-09-19T09:26:06.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:06 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3856902118' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T09:26:07.113 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.199+0000 7f86dcc2c640 1 Processor -- start 2024-09-19T09:26:07.113 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.199+0000 7f86dcc2c640 1 -- start start 2024-09-19T09:26:07.113 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.200+0000 7f86dcc2c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d8100ea0 0x7f86d81012b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:07.113 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.200+0000 7f86dcc2c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d81017f0 con 0x7f86d8100ea0 2024-09-19T09:26:07.113 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.200+0000 7f86d659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d8100ea0 0x7f86d81012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:07.114 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.200+0000 7f86d659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d8100ea0 0x7f86d81012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46708/0 (socket says 172.21.15.112:46708) 2024-09-19T09:26:07.114 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.200+0000 7f86d659c640 1 -- 172.21.15.112:0/792478151 learned_addr learned my addr 172.21.15.112:0/792478151 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:07.114 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.200+0000 7f86d659c640 1 -- 172.21.15.112:0/792478151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d8101930 con 0x7f86d8100ea0 2024-09-19T09:26:07.114 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.201+0000 7f86d659c640 1 --2- 172.21.15.112:0/792478151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d8100ea0 0x7f86d81012b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009e50 tx=0x7f86c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457b66ad3b3782e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:07.114 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.201+0000 7f86d559a640 1 -- 172.21.15.112:0/792478151 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86c8031560 con 0x7f86d8100ea0 2024-09-19T09:26:07.114 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.201+0000 7f86d559a640 1 -- 172.21.15.112:0/792478151 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f86c802d050 con 0x7f86d8100ea0 2024-09-19T09:26:07.114 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.201+0000 7f86d559a640 1 -- 172.21.15.112:0/792478151 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86c80079b0 con 0x7f86d8100ea0 2024-09-19T09:26:07.114 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.202+0000 7f86dcc2c640 1 -- 172.21.15.112:0/792478151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d8100ea0 msgr2=0x7f86d81012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:07.114 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.202+0000 7f86dcc2c640 1 --2- 172.21.15.112:0/792478151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d8100ea0 0x7f86d81012b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009e50 tx=0x7f86c8009840 comp rx=0 tx=0).stop 2024-09-19T09:26:07.114 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.202+0000 7f86dcc2c640 1 -- 172.21.15.112:0/792478151 shutdown_connections 2024-09-19T09:26:07.114 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.202+0000 7f86dcc2c640 1 --2- 172.21.15.112:0/792478151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d8100ea0 0x7f86d81012b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:07.114 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.202+0000 7f86dcc2c640 1 -- 172.21.15.112:0/792478151 >> 172.21.15.112:0/792478151 conn(0x7f86d80fc700 msgr2=0x7f86d80feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:07.114 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.202+0000 7f86dcc2c640 1 -- 172.21.15.112:0/792478151 shutdown_connections 2024-09-19T09:26:07.114 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.202+0000 7f86dcc2c640 1 -- 172.21.15.112:0/792478151 wait complete. 2024-09-19T09:26:07.115 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.202+0000 7f86dcc2c640 1 Processor -- start 2024-09-19T09:26:07.115 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.203+0000 7f86dcc2c640 1 -- start start 2024-09-19T09:26:07.115 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.203+0000 7f86dcc2c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d8100ea0 0x7f86d8076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:07.115 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.203+0000 7f86dcc2c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d8113af0 con 0x7f86d8100ea0 2024-09-19T09:26:07.115 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.203+0000 7f86d659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d8100ea0 0x7f86d8076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:07.115 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.203+0000 7f86d659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d8100ea0 0x7f86d8076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46714/0 (socket says 172.21.15.112:46714) 2024-09-19T09:26:07.115 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.203+0000 7f86d659c640 1 -- 172.21.15.112:0/3856902118 learned_addr learned my addr 172.21.15.112:0/3856902118 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:07.115 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.203+0000 7f86d659c640 1 -- 172.21.15.112:0/3856902118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8009ae0 con 0x7f86d8100ea0 2024-09-19T09:26:07.115 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.203+0000 7f86d659c640 1 --2- 172.21.15.112:0/3856902118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d8100ea0 0x7f86d8076ae0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f86c8007690 tx=0x7f86c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:07.115 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.203+0000 7f86ceffd640 1 -- 172.21.15.112:0/3856902118 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86c8031b70 con 0x7f86d8100ea0 2024-09-19T09:26:07.115 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.203+0000 7f86ceffd640 1 -- 172.21.15.112:0/3856902118 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f86c8031cd0 con 0x7f86d8100ea0 2024-09-19T09:26:07.115 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.204+0000 7f86dcc2c640 1 -- 172.21.15.112:0/3856902118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d8113c30 con 0x7f86d8100ea0 2024-09-19T09:26:07.115 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.204+0000 7f86ceffd640 1 -- 172.21.15.112:0/3856902118 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86c80445a0 con 0x7f86d8100ea0 2024-09-19T09:26:07.115 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.204+0000 7f86dcc2c640 1 -- 172.21.15.112:0/3856902118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d8114040 con 0x7f86d8100ea0 2024-09-19T09:26:07.116 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.204+0000 7f86ceffd640 1 -- 172.21.15.112:0/3856902118 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f86c8038040 con 0x7f86d8100ea0 2024-09-19T09:26:07.116 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.205+0000 7f86ceffd640 1 --2- 172.21.15.112:0/3856902118 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f86c4039450 0x7f86c403b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:07.116 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.205+0000 7f86dcc2c640 1 -- 172.21.15.112:0/3856902118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d804b720 con 0x7f86d8100ea0 2024-09-19T09:26:07.116 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.205+0000 7f86ceffd640 1 -- 172.21.15.112:0/3856902118 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f86c8040030 con 0x7f86d8100ea0 2024-09-19T09:26:07.116 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.205+0000 7f86d5d9b640 1 --2- 172.21.15.112:0/3856902118 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f86c4039450 0x7f86c403b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:07.116 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.205+0000 7f86d5d9b640 1 --2- 172.21.15.112:0/3856902118 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f86c4039450 0x7f86c403b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f86c0006fd0 tx=0x7f86c0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:07.116 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.209+0000 7f86ceffd640 1 -- 172.21.15.112:0/3856902118 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f86c8042ad0 con 0x7f86d8100ea0 2024-09-19T09:26:07.116 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.403+0000 7f86dcc2c640 1 -- 172.21.15.112:0/3856902118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f86d8102b20 con 0x7f86d8100ea0 2024-09-19T09:26:07.116 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.456+0000 7f86ceffd640 1 -- 172.21.15.112:0/3856902118 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f86c804bd60 con 0x7f86d8100ea0 2024-09-19T09:26:07.116 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.457+0000 7f86ceffd640 1 -- 172.21.15.112:0/3856902118 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f86c8033a20 con 0x7f86d8100ea0 2024-09-19T09:26:07.116 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.460+0000 7f86dcc2c640 1 -- 172.21.15.112:0/3856902118 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f86c4039450 msgr2=0x7f86c403b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:07.117 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.460+0000 7f86dcc2c640 1 --2- 172.21.15.112:0/3856902118 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f86c4039450 0x7f86c403b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f86c0006fd0 tx=0x7f86c0006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:07.117 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.460+0000 7f86dcc2c640 1 -- 172.21.15.112:0/3856902118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d8100ea0 msgr2=0x7f86d8076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:07.117 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.460+0000 7f86dcc2c640 1 --2- 172.21.15.112:0/3856902118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d8100ea0 0x7f86d8076ae0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f86c8007690 tx=0x7f86c8009840 comp rx=0 tx=0).stop 2024-09-19T09:26:07.117 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.460+0000 7f86dcc2c640 1 -- 172.21.15.112:0/3856902118 shutdown_connections 2024-09-19T09:26:07.117 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.460+0000 7f86dcc2c640 1 --2- 172.21.15.112:0/3856902118 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f86c4039450 0x7f86c403b900 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:07.117 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.460+0000 7f86dcc2c640 1 --2- 172.21.15.112:0/3856902118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d8100ea0 0x7f86d8076ae0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:07.117 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.460+0000 7f86dcc2c640 1 -- 172.21.15.112:0/3856902118 >> 172.21.15.112:0/3856902118 conn(0x7f86d80fc700 msgr2=0x7f86d80fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:07.117 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.460+0000 7f86dcc2c640 1 -- 172.21.15.112:0/3856902118 shutdown_connections 2024-09-19T09:26:07.117 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:06.460+0000 7f86dcc2c640 1 -- 172.21.15.112:0/3856902118 wait complete. 2024-09-19T09:26:07.507 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:07 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3856902118' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T09:26:07.507 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:07 smithi112 ceph-mon[27605]: mgrmap e5: smithi112.puhuua(active, since 10s) 2024-09-19T09:26:08.406 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:26:08.406 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T09:26:08.406 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:26:08.406 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "active_name": "smithi112.puhuua", 2024-09-19T09:26:08.406 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T09:26:08.406 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:26:08.406 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.505+0000 7fad9ac32640 1 Processor -- start 2024-09-19T09:26:08.406 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.505+0000 7fad9ac32640 1 -- start start 2024-09-19T09:26:08.406 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.506+0000 7fad9ac32640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad94100fd0 0x7fad941013e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.506+0000 7fad9ac32640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad94101920 con 0x7fad94100fd0 2024-09-19T09:26:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.506+0000 7fad989ce640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad94100fd0 0x7fad941013e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.506+0000 7fad989ce640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad94100fd0 0x7fad941013e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46750/0 (socket says 172.21.15.112:46750) 2024-09-19T09:26:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.506+0000 7fad989ce640 1 -- 172.21.15.112:0/62236981 learned_addr learned my addr 172.21.15.112:0/62236981 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.506+0000 7fad989ce640 1 -- 172.21.15.112:0/62236981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad94101a60 con 0x7fad94100fd0 2024-09-19T09:26:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.507+0000 7fad989ce640 1 --2- 172.21.15.112:0/62236981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad94100fd0 0x7fad941013e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad88009840 tx=0x7fad880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90bfea310c53252f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.507+0000 7fad937fe640 1 -- 172.21.15.112:0/62236981 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad88032440 con 0x7fad94100fd0 2024-09-19T09:26:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.507+0000 7fad937fe640 1 -- 172.21.15.112:0/62236981 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fad88032a00 con 0x7fad94100fd0 2024-09-19T09:26:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.507+0000 7fad937fe640 1 -- 172.21.15.112:0/62236981 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad88031a10 con 0x7fad94100fd0 2024-09-19T09:26:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.508+0000 7fad9ac32640 1 -- 172.21.15.112:0/62236981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad94100fd0 msgr2=0x7fad941013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.508+0000 7fad9ac32640 1 --2- 172.21.15.112:0/62236981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad94100fd0 0x7fad941013e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad88009840 tx=0x7fad880091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.508+0000 7fad9ac32640 1 -- 172.21.15.112:0/62236981 shutdown_connections 2024-09-19T09:26:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.508+0000 7fad9ac32640 1 --2- 172.21.15.112:0/62236981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad94100fd0 0x7fad941013e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.508+0000 7fad9ac32640 1 -- 172.21.15.112:0/62236981 >> 172.21.15.112:0/62236981 conn(0x7fad940fc710 msgr2=0x7fad940feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.508+0000 7fad9ac32640 1 -- 172.21.15.112:0/62236981 shutdown_connections 2024-09-19T09:26:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.508+0000 7fad9ac32640 1 -- 172.21.15.112:0/62236981 wait complete. 2024-09-19T09:26:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.508+0000 7fad9ac32640 1 Processor -- start 2024-09-19T09:26:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.509+0000 7fad9ac32640 1 -- start start 2024-09-19T09:26:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.509+0000 7fad9ac32640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad94100fd0 0x7fad94076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.509+0000 7fad9ac32640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad94113a40 con 0x7fad94100fd0 2024-09-19T09:26:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.509+0000 7fad989ce640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad94100fd0 0x7fad94076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.509+0000 7fad989ce640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad94100fd0 0x7fad94076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46766/0 (socket says 172.21.15.112:46766) 2024-09-19T09:26:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.509+0000 7fad989ce640 1 -- 172.21.15.112:0/3370992106 learned_addr learned my addr 172.21.15.112:0/3370992106 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.509+0000 7fad989ce640 1 -- 172.21.15.112:0/3370992106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88009450 con 0x7fad94100fd0 2024-09-19T09:26:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.509+0000 7fad989ce640 1 --2- 172.21.15.112:0/3370992106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad94100fd0 0x7fad94076ae0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad880098a0 tx=0x7fad8802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.510+0000 7fad917fa640 1 -- 172.21.15.112:0/3370992106 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad880327b0 con 0x7fad94100fd0 2024-09-19T09:26:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.510+0000 7fad917fa640 1 -- 172.21.15.112:0/3370992106 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fad8803b870 con 0x7fad94100fd0 2024-09-19T09:26:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.510+0000 7fad9ac32640 1 -- 172.21.15.112:0/3370992106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad94113b80 con 0x7fad94100fd0 2024-09-19T09:26:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.510+0000 7fad917fa640 1 -- 172.21.15.112:0/3370992106 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad8803a550 con 0x7fad94100fd0 2024-09-19T09:26:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.510+0000 7fad9ac32640 1 -- 172.21.15.112:0/3370992106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad94113f90 con 0x7fad94100fd0 2024-09-19T09:26:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.511+0000 7fad917fa640 1 -- 172.21.15.112:0/3370992106 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fad88039040 con 0x7fad94100fd0 2024-09-19T09:26:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.511+0000 7fad9ac32640 1 -- 172.21.15.112:0/3370992106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9404b720 con 0x7fad94100fd0 2024-09-19T09:26:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.511+0000 7fad917fa640 1 --2- 172.21.15.112:0/3370992106 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7fad840394e0 0x7fad8403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.511+0000 7fad93fff640 1 -- 172.21.15.112:0/3370992106 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7fad840394e0 msgr2=0x7fad8403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/2336666418 2024-09-19T09:26:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.511+0000 7fad917fa640 1 -- 172.21.15.112:0/3370992106 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fad8806cf50 con 0x7fad94100fd0 2024-09-19T09:26:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.511+0000 7fad93fff640 1 --2- 172.21.15.112:0/3370992106 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7fad840394e0 0x7fad8403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:26:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.515+0000 7fad917fa640 1 -- 172.21.15.112:0/3370992106 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fad88030520 con 0x7fad94100fd0 2024-09-19T09:26:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.712+0000 7fad93fff640 1 -- 172.21.15.112:0/3370992106 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7fad840394e0 msgr2=0x7fad8403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/2336666418 2024-09-19T09:26:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.712+0000 7fad93fff640 1 --2- 172.21.15.112:0/3370992106 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7fad840394e0 0x7fad8403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:26:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.712+0000 7fad9ac32640 1 -- 172.21.15.112:0/3370992106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fad94102c70 con 0x7fad94100fd0 2024-09-19T09:26:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.712+0000 7fad917fa640 1 -- 172.21.15.112:0/3370992106 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fad88037030 con 0x7fad94100fd0 2024-09-19T09:26:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.714+0000 7fad9ac32640 1 -- 172.21.15.112:0/3370992106 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7fad840394e0 msgr2=0x7fad8403b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:26:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.714+0000 7fad9ac32640 1 --2- 172.21.15.112:0/3370992106 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7fad840394e0 0x7fad8403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.714+0000 7fad9ac32640 1 -- 172.21.15.112:0/3370992106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad94100fd0 msgr2=0x7fad94076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.714+0000 7fad9ac32640 1 --2- 172.21.15.112:0/3370992106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad94100fd0 0x7fad94076ae0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad880098a0 tx=0x7fad8802c040 comp rx=0 tx=0).stop 2024-09-19T09:26:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.714+0000 7fad9ac32640 1 -- 172.21.15.112:0/3370992106 shutdown_connections 2024-09-19T09:26:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.714+0000 7fad9ac32640 1 --2- 172.21.15.112:0/3370992106 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7fad840394e0 0x7fad8403b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.714+0000 7fad9ac32640 1 --2- 172.21.15.112:0/3370992106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad94100fd0 0x7fad94076ae0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.714+0000 7fad9ac32640 1 -- 172.21.15.112:0/3370992106 >> 172.21.15.112:0/3370992106 conn(0x7fad940fc710 msgr2=0x7fad940fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:08.412 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.714+0000 7fad9ac32640 1 -- 172.21.15.112:0/3370992106 shutdown_connections 2024-09-19T09:26:08.412 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:07.714+0000 7fad9ac32640 1 -- 172.21.15.112:0/3370992106 wait complete. 2024-09-19T09:26:08.412 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for the mgr to restart... 2024-09-19T09:26:08.412 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for mgr epoch 5... 2024-09-19T09:26:08.523 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:08 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3370992106' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T09:26:11.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: Active manager daemon smithi112.puhuua restarted 2024-09-19T09:26:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: Activating manager daemon smithi112.puhuua 2024-09-19T09:26:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T09:26:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: mgrmap e6: smithi112.puhuua(active, starting, since 0.00361495s) 2024-09-19T09:26:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:26:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr metadata", "who": "smithi112.puhuua", "id": "smithi112.puhuua"}]: dispatch 2024-09-19T09:26:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:26:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:26:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:26:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: Manager daemon smithi112.puhuua is now available 2024-09-19T09:26:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:26:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:26:11.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:26:11.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:10 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/trash_purge_schedule"}]: dispatch 2024-09-19T09:26:12.129 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:11 smithi112 ceph-mon[27605]: Found migration_current of "None". Setting to last migration. 2024-09-19T09:26:12.129 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:11 smithi112 ceph-mon[27605]: mgrmap e7: smithi112.puhuua(active, since 1.00541s) 2024-09-19T09:26:12.410 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:26:12.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T09:26:12.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T09:26:12.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:26:12.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.863+0000 7f269e441640 1 Processor -- start 2024-09-19T09:26:12.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.863+0000 7f269e441640 1 -- start start 2024-09-19T09:26:12.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.863+0000 7f269e441640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2698102410 0x7f2698102820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:12.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.863+0000 7f269e441640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2698102d60 con 0x7f2698102410 2024-09-19T09:26:12.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.863+0000 7f2697fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2698102410 0x7f2698102820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:12.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.863+0000 7f2697fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2698102410 0x7f2698102820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33780/0 (socket says 172.21.15.112:33780) 2024-09-19T09:26:12.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.863+0000 7f2697fff640 1 -- 172.21.15.112:0/711634024 learned_addr learned my addr 172.21.15.112:0/711634024 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:12.411 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.864+0000 7f2697fff640 1 -- 172.21.15.112:0/711634024 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2698102ea0 con 0x7f2698102410 2024-09-19T09:26:12.412 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.864+0000 7f2697fff640 1 --2- 172.21.15.112:0/711634024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2698102410 0x7f2698102820 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2688009840 tx=0x7f26880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec3b25848d6a15b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:12.412 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.864+0000 7f26977fe640 1 -- 172.21.15.112:0/711634024 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2688032440 con 0x7f2698102410 2024-09-19T09:26:12.412 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.864+0000 7f26977fe640 1 -- 172.21.15.112:0/711634024 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f2688032a00 con 0x7f2698102410 2024-09-19T09:26:12.412 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.864+0000 7f26977fe640 1 -- 172.21.15.112:0/711634024 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26880319e0 con 0x7f2698102410 2024-09-19T09:26:12.412 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.865+0000 7f269e441640 1 -- 172.21.15.112:0/711634024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2698102410 msgr2=0x7f2698102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:12.412 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.865+0000 7f269e441640 1 --2- 172.21.15.112:0/711634024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2698102410 0x7f2698102820 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2688009840 tx=0x7f26880091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.412 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.865+0000 7f269e441640 1 -- 172.21.15.112:0/711634024 shutdown_connections 2024-09-19T09:26:12.412 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.865+0000 7f269e441640 1 --2- 172.21.15.112:0/711634024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2698102410 0x7f2698102820 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.412 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.865+0000 7f269e441640 1 -- 172.21.15.112:0/711634024 >> 172.21.15.112:0/711634024 conn(0x7f26980fbd90 msgr2=0x7f26980fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:12.412 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.865+0000 7f269e441640 1 -- 172.21.15.112:0/711634024 shutdown_connections 2024-09-19T09:26:12.412 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.865+0000 7f269e441640 1 -- 172.21.15.112:0/711634024 wait complete. 2024-09-19T09:26:12.412 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.866+0000 7f269e441640 1 Processor -- start 2024-09-19T09:26:12.412 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.866+0000 7f269e441640 1 -- start start 2024-09-19T09:26:12.413 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.866+0000 7f269e441640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2698102410 0x7f2698107100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:12.413 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.866+0000 7f269e441640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2698107640 con 0x7f2698102410 2024-09-19T09:26:12.413 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.866+0000 7f2697fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2698102410 0x7f2698107100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:12.413 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.866+0000 7f2697fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2698102410 0x7f2698107100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33788/0 (socket says 172.21.15.112:33788) 2024-09-19T09:26:12.413 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.866+0000 7f2697fff640 1 -- 172.21.15.112:0/3651217754 learned_addr learned my addr 172.21.15.112:0/3651217754 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:12.413 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.866+0000 7f2697fff640 1 -- 172.21.15.112:0/3651217754 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2688009450 con 0x7f2698102410 2024-09-19T09:26:12.413 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.866+0000 7f2697fff640 1 --2- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2698102410 0x7f2698107100 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f26880098a0 tx=0x7f2688008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:12.413 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.867+0000 7f26957fa640 1 -- 172.21.15.112:0/3651217754 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2688032880 con 0x7f2698102410 2024-09-19T09:26:12.413 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.867+0000 7f269e441640 1 -- 172.21.15.112:0/3651217754 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26981056d0 con 0x7f2698102410 2024-09-19T09:26:12.413 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.867+0000 7f26957fa640 1 -- 172.21.15.112:0/3651217754 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f268803d8b0 con 0x7f2698102410 2024-09-19T09:26:12.413 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.867+0000 7f26957fa640 1 -- 172.21.15.112:0/3651217754 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f268803b910 con 0x7f2698102410 2024-09-19T09:26:12.414 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.867+0000 7f269e441640 1 -- 172.21.15.112:0/3651217754 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2698105b40 con 0x7f2698102410 2024-09-19T09:26:12.414 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.868+0000 7f26957fa640 1 -- 172.21.15.112:0/3651217754 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f2688039070 con 0x7f2698102410 2024-09-19T09:26:12.414 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.868+0000 7f26957fa640 1 --2- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f2684039490 0x7f268403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:12.414 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.868+0000 7f26957fa640 1 -- 172.21.15.112:0/3651217754 --> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f268403c050 con 0x7f2684039490 2024-09-19T09:26:12.414 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.868+0000 7f26957fa640 1 -- 172.21.15.112:0/3651217754 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f268806cfe0 con 0x7f2698102410 2024-09-19T09:26:12.414 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.868+0000 7f268ffff640 1 -- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f2684039490 msgr2=0x7f268403b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/2336666418 2024-09-19T09:26:12.415 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:08.868+0000 7f268ffff640 1 --2- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f2684039490 0x7f268403b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:26:12.415 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:09.069+0000 7f268ffff640 1 -- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f2684039490 msgr2=0x7f268403b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/2336666418 2024-09-19T09:26:12.415 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:09.069+0000 7f268ffff640 1 --2- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f2684039490 0x7f268403b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:26:12.415 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:09.470+0000 7f268ffff640 1 -- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f2684039490 msgr2=0x7f268403b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/2336666418 2024-09-19T09:26:12.415 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:09.470+0000 7f268ffff640 1 --2- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f2684039490 0x7f268403b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:26:12.415 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:10.271+0000 7f268ffff640 1 -- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f2684039490 msgr2=0x7f268403b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/2336666418 2024-09-19T09:26:12.415 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:10.271+0000 7f268ffff640 1 --2- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f2684039490 0x7f268403b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:26:12.415 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:10.765+0000 7f26957fa640 1 -- 172.21.15.112:0/3651217754 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mgrmap(e 6) v1 ==== 45274+0+0 (secure 0 0 0) 0x7f268806c4e0 con 0x7f2698102410 2024-09-19T09:26:12.415 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:10.765+0000 7f26957fa640 1 -- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f2684039490 msgr2=0x7f268403b940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:26:12.415 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:10.765+0000 7f26957fa640 1 --2- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f2684039490 0x7f268403b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.415 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.765+0000 7f26957fa640 1 -- 172.21.15.112:0/3651217754 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7f268806e940 con 0x7f2698102410 2024-09-19T09:26:12.415 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.765+0000 7f26957fa640 1 --2- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f268403cdf0 0x7f268403f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:12.415 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.765+0000 7f26957fa640 1 -- 172.21.15.112:0/3651217754 --> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f268403c050 con 0x7f268403cdf0 2024-09-19T09:26:12.416 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.766+0000 7f268ffff640 1 --2- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f268403cdf0 0x7f268403f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:12.416 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.767+0000 7f268ffff640 1 --2- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f268403cdf0 0x7f268403f1d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2680003940 tx=0x7f2680009350 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:12.416 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.767+0000 7f26957fa640 1 -- 172.21.15.112:0/3651217754 <== mgr.14116 v2:172.21.15.112:6800/1627571174 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f268403c050 con 0x7f268403cdf0 2024-09-19T09:26:12.416 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.772+0000 7f269e441640 1 -- 172.21.15.112:0/3651217754 --> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f269804b720 con 0x7f268403cdf0 2024-09-19T09:26:12.416 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.772+0000 7f26957fa640 1 -- 172.21.15.112:0/3651217754 <== mgr.14116 v2:172.21.15.112:6800/1627571174 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f269804b720 con 0x7f268403cdf0 2024-09-19T09:26:12.416 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.773+0000 7f269e441640 1 -- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f268403cdf0 msgr2=0x7f268403f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:12.416 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.773+0000 7f269e441640 1 --2- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f268403cdf0 0x7f268403f1d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2680003940 tx=0x7f2680009350 comp rx=0 tx=0).stop 2024-09-19T09:26:12.416 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.773+0000 7f269e441640 1 -- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2698102410 msgr2=0x7f2698107100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:12.416 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.773+0000 7f269e441640 1 --2- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2698102410 0x7f2698107100 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f26880098a0 tx=0x7f2688008040 comp rx=0 tx=0).stop 2024-09-19T09:26:12.416 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.773+0000 7f269e441640 1 -- 172.21.15.112:0/3651217754 shutdown_connections 2024-09-19T09:26:12.416 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.773+0000 7f269e441640 1 --2- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f268403cdf0 0x7f268403f1d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.416 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.773+0000 7f269e441640 1 --2- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:6800/2336666418,v1:172.21.15.112:6801/2336666418] conn(0x7f2684039490 0x7f268403b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.416 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.773+0000 7f269e441640 1 --2- 172.21.15.112:0/3651217754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2698102410 0x7f2698107100 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.417 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.773+0000 7f269e441640 1 -- 172.21.15.112:0/3651217754 >> 172.21.15.112:0/3651217754 conn(0x7f26980fbd90 msgr2=0x7f26980fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:12.417 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.773+0000 7f269e441640 1 -- 172.21.15.112:0/3651217754 shutdown_connections 2024-09-19T09:26:12.417 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:11.773+0000 7f269e441640 1 -- 172.21.15.112:0/3651217754 wait complete. 2024-09-19T09:26:12.417 INFO:teuthology.orchestra.run.smithi112.stdout:mgr epoch 5 is available 2024-09-19T09:26:12.417 INFO:teuthology.orchestra.run.smithi112.stdout:Setting orchestrator backend to cephadm... 2024-09-19T09:26:13.014 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:12 smithi112 ceph-mon[27605]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T09:26:13.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:12 smithi112 ceph-mon[27605]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T09:26:13.615 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.827+0000 7ff39932d640 1 Processor -- start 2024-09-19T09:26:13.615 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.828+0000 7ff39932d640 1 -- start start 2024-09-19T09:26:13.616 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.828+0000 7ff39932d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff394101f80 0x7ff394102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.616 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.828+0000 7ff39932d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3941028d0 con 0x7ff394101f80 2024-09-19T09:26:13.616 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.828+0000 7ff392ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff394101f80 0x7ff394102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.616 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.828+0000 7ff392ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff394101f80 0x7ff394102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33880/0 (socket says 172.21.15.112:33880) 2024-09-19T09:26:13.616 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.828+0000 7ff392ffd640 1 -- 172.21.15.112:0/128426822 learned_addr learned my addr 172.21.15.112:0/128426822 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:13.616 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.828+0000 7ff392ffd640 1 -- 172.21.15.112:0/128426822 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff394102a10 con 0x7ff394101f80 2024-09-19T09:26:13.616 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.829+0000 7ff392ffd640 1 --2- 172.21.15.112:0/128426822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff394101f80 0x7ff394102390 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009840 tx=0x7ff38c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96396e74d0584e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:13.616 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.829+0000 7ff391ffb640 1 -- 172.21.15.112:0/128426822 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff38c032440 con 0x7ff394101f80 2024-09-19T09:26:13.616 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.829+0000 7ff391ffb640 1 -- 172.21.15.112:0/128426822 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff38c032a00 con 0x7ff394101f80 2024-09-19T09:26:13.616 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.829+0000 7ff391ffb640 1 -- 172.21.15.112:0/128426822 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff38c0319e0 con 0x7ff394101f80 2024-09-19T09:26:13.616 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.830+0000 7ff39932d640 1 -- 172.21.15.112:0/128426822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff394101f80 msgr2=0x7ff394102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:13.616 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.830+0000 7ff39932d640 1 --2- 172.21.15.112:0/128426822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff394101f80 0x7ff394102390 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009840 tx=0x7ff38c0091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.616 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.830+0000 7ff39932d640 1 -- 172.21.15.112:0/128426822 shutdown_connections 2024-09-19T09:26:13.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.830+0000 7ff39932d640 1 --2- 172.21.15.112:0/128426822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff394101f80 0x7ff394102390 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.830+0000 7ff39932d640 1 -- 172.21.15.112:0/128426822 >> 172.21.15.112:0/128426822 conn(0x7ff3940fd7a0 msgr2=0x7ff3940ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:13.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.830+0000 7ff39932d640 1 -- 172.21.15.112:0/128426822 shutdown_connections 2024-09-19T09:26:13.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.830+0000 7ff39932d640 1 -- 172.21.15.112:0/128426822 wait complete. 2024-09-19T09:26:13.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.831+0000 7ff39932d640 1 Processor -- start 2024-09-19T09:26:13.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.831+0000 7ff39932d640 1 -- start start 2024-09-19T09:26:13.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.831+0000 7ff39932d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff394101f80 0x7ff394110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.831+0000 7ff39932d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff394111370 con 0x7ff394101f80 2024-09-19T09:26:13.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.831+0000 7ff392ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff394101f80 0x7ff394110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.831+0000 7ff392ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff394101f80 0x7ff394110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33882/0 (socket says 172.21.15.112:33882) 2024-09-19T09:26:13.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.831+0000 7ff392ffd640 1 -- 172.21.15.112:0/988248061 learned_addr learned my addr 172.21.15.112:0/988248061 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:13.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.831+0000 7ff392ffd640 1 -- 172.21.15.112:0/988248061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c009450 con 0x7ff394101f80 2024-09-19T09:26:13.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.832+0000 7ff392ffd640 1 --2- 172.21.15.112:0/988248061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff394101f80 0x7ff394110e30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff38c000c00 tx=0x7ff38c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:13.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.832+0000 7ff37b7fe640 1 -- 172.21.15.112:0/988248061 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff38c03d450 con 0x7ff394101f80 2024-09-19T09:26:13.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.832+0000 7ff37b7fe640 1 -- 172.21.15.112:0/988248061 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff38c03da10 con 0x7ff394101f80 2024-09-19T09:26:13.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.832+0000 7ff39932d640 1 -- 172.21.15.112:0/988248061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff394111570 con 0x7ff394101f80 2024-09-19T09:26:13.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.832+0000 7ff37b7fe640 1 -- 172.21.15.112:0/988248061 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff38c03b880 con 0x7ff394101f80 2024-09-19T09:26:13.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.832+0000 7ff39932d640 1 -- 172.21.15.112:0/988248061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff394111fc0 con 0x7ff394101f80 2024-09-19T09:26:13.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.833+0000 7ff37b7fe640 1 -- 172.21.15.112:0/988248061 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7ff38c039070 con 0x7ff394101f80 2024-09-19T09:26:13.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.833+0000 7ff37b7fe640 1 --2- 172.21.15.112:0/988248061 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7ff37c0394e0 0x7ff37c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.833+0000 7ff39932d640 1 -- 172.21.15.112:0/988248061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3941013e0 con 0x7ff394101f80 2024-09-19T09:26:13.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.833+0000 7ff37b7fe640 1 -- 172.21.15.112:0/988248061 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff38c06d480 con 0x7ff394101f80 2024-09-19T09:26:13.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.833+0000 7ff3927fc640 1 --2- 172.21.15.112:0/988248061 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7ff37c0394e0 0x7ff37c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.833+0000 7ff3927fc640 1 --2- 172.21.15.112:0/988248061 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7ff37c0394e0 0x7ff37c03b990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff38800ad90 tx=0x7ff388009410 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:13.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:12.838+0000 7ff37b7fe640 1 -- 172.21.15.112:0/988248061 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff38c041070 con 0x7ff394101f80 2024-09-19T09:26:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:13.013+0000 7ff39932d640 1 -- 172.21.15.112:0/988248061 --> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3940feaf0 con 0x7ff37c0394e0 2024-09-19T09:26:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:13.021+0000 7ff37b7fe640 1 -- 172.21.15.112:0/988248061 <== mgr.14116 v2:172.21.15.112:6800/1627571174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff3940feaf0 con 0x7ff37c0394e0 2024-09-19T09:26:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:13.024+0000 7ff39932d640 1 -- 172.21.15.112:0/988248061 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7ff37c0394e0 msgr2=0x7ff37c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:13.024+0000 7ff39932d640 1 --2- 172.21.15.112:0/988248061 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7ff37c0394e0 0x7ff37c03b990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff38800ad90 tx=0x7ff388009410 comp rx=0 tx=0).stop 2024-09-19T09:26:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:13.024+0000 7ff39932d640 1 -- 172.21.15.112:0/988248061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff394101f80 msgr2=0x7ff394110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:13.024+0000 7ff39932d640 1 --2- 172.21.15.112:0/988248061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff394101f80 0x7ff394110e30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff38c000c00 tx=0x7ff38c008040 comp rx=0 tx=0).stop 2024-09-19T09:26:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:13.024+0000 7ff39932d640 1 -- 172.21.15.112:0/988248061 shutdown_connections 2024-09-19T09:26:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:13.024+0000 7ff39932d640 1 --2- 172.21.15.112:0/988248061 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7ff37c0394e0 0x7ff37c03b990 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:13.024+0000 7ff39932d640 1 --2- 172.21.15.112:0/988248061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff394101f80 0x7ff394110e30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:13.024+0000 7ff39932d640 1 -- 172.21.15.112:0/988248061 >> 172.21.15.112:0/988248061 conn(0x7ff3940fd7a0 msgr2=0x7ff3940fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:13.024+0000 7ff39932d640 1 -- 172.21.15.112:0/988248061 shutdown_connections 2024-09-19T09:26:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:13.024+0000 7ff39932d640 1 -- 172.21.15.112:0/988248061 wait complete. 2024-09-19T09:26:13.935 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:13 smithi112 ceph-mon[27605]: mgrmap e8: smithi112.puhuua(active, since 2s) 2024-09-19T09:26:13.935 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:13 smithi112 ceph-mon[27605]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:26:13.935 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:13 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:13.936 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:13 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:26:13.936 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:13 smithi112 ceph-mon[27605]: [19/Sep/2024:09:26:13] ENGINE Bus STARTING 2024-09-19T09:26:13.936 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:13 smithi112 ceph-mon[27605]: [19/Sep/2024:09:26:13] ENGINE Serving on https://172.21.15.112:7150 2024-09-19T09:26:13.936 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:13 smithi112 ceph-mon[27605]: [19/Sep/2024:09:26:13] ENGINE Bus STARTED 2024-09-19T09:26:13.936 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:13 smithi112 ceph-mon[27605]: [19/Sep/2024:09:26:13] ENGINE Error in HTTPServer.serve 2024-09-19T09:26:13.936 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Traceback (most recent call last): 2024-09-19T09:26:13.936 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:26:13.936 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:26:13.936 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:26:13.936 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._run(expiration_interval) 2024-09-19T09:26:13.936 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:26:13.936 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:26:13.936 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:26:13.936 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:26:13.937 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:26:13.937 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s = self.context.wrap_socket( 2024-09-19T09:26:13.937 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:26:13.937 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: return self.sslsocket_class._create( 2024-09-19T09:26:13.937 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:26:13.937 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self.do_handshake() 2024-09-19T09:26:13.937 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:26:13.937 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._sslobj.do_handshake() 2024-09-19T09:26:13.937 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:26:13.937 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:13 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:13.937 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:13 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:26:14.771 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T09:26:14.772 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.007+0000 7f58def3e640 1 Processor -- start 2024-09-19T09:26:14.772 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.007+0000 7f58def3e640 1 -- start start 2024-09-19T09:26:14.772 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.007+0000 7f58def3e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d8078c60 0x7f58d8077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:14.772 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.007+0000 7f58def3e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d8079070 con 0x7f58d8078c60 2024-09-19T09:26:14.772 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.007+0000 7f58dccda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d8078c60 0x7f58d8077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:14.772 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.007+0000 7f58dccda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d8078c60 0x7f58d8077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33898/0 (socket says 172.21.15.112:33898) 2024-09-19T09:26:14.772 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.007+0000 7f58dccda640 1 -- 172.21.15.112:0/1994360701 learned_addr learned my addr 172.21.15.112:0/1994360701 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:14.772 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.007+0000 7f58dccda640 1 -- 172.21.15.112:0/1994360701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d8077770 con 0x7f58d8078c60 2024-09-19T09:26:14.772 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.008+0000 7f58dccda640 1 --2- 172.21.15.112:0/1994360701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d8078c60 0x7f58d8077230 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f58d4009840 tx=0x7f58d40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7945a7c5b335b85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:14.772 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.008+0000 7f58cf7fe640 1 -- 172.21.15.112:0/1994360701 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58d4032440 con 0x7f58d8078c60 2024-09-19T09:26:14.772 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.008+0000 7f58cf7fe640 1 -- 172.21.15.112:0/1994360701 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f58d4032a00 con 0x7f58d8078c60 2024-09-19T09:26:14.772 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.008+0000 7f58cf7fe640 1 -- 172.21.15.112:0/1994360701 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58d40319e0 con 0x7f58d8078c60 2024-09-19T09:26:14.772 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.009+0000 7f58def3e640 1 -- 172.21.15.112:0/1994360701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d8078c60 msgr2=0x7f58d8077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:14.773 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.009+0000 7f58def3e640 1 --2- 172.21.15.112:0/1994360701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d8078c60 0x7f58d8077230 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f58d4009840 tx=0x7f58d40091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:14.773 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.009+0000 7f58def3e640 1 -- 172.21.15.112:0/1994360701 shutdown_connections 2024-09-19T09:26:14.773 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.009+0000 7f58def3e640 1 --2- 172.21.15.112:0/1994360701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d8078c60 0x7f58d8077230 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:14.773 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.009+0000 7f58def3e640 1 -- 172.21.15.112:0/1994360701 >> 172.21.15.112:0/1994360701 conn(0x7f58d80fd710 msgr2=0x7f58d80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:14.773 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.009+0000 7f58def3e640 1 -- 172.21.15.112:0/1994360701 shutdown_connections 2024-09-19T09:26:14.773 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.009+0000 7f58def3e640 1 -- 172.21.15.112:0/1994360701 wait complete. 2024-09-19T09:26:14.773 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.009+0000 7f58def3e640 1 Processor -- start 2024-09-19T09:26:14.773 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.010+0000 7f58def3e640 1 -- start start 2024-09-19T09:26:14.773 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.010+0000 7f58def3e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d8078c60 0x7f58d8112f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:14.773 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.010+0000 7f58def3e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d8113460 con 0x7f58d8078c60 2024-09-19T09:26:14.773 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.010+0000 7f58dccda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d8078c60 0x7f58d8112f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:14.773 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.010+0000 7f58dccda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d8078c60 0x7f58d8112f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33900/0 (socket says 172.21.15.112:33900) 2024-09-19T09:26:14.773 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.010+0000 7f58dccda640 1 -- 172.21.15.112:0/3737821528 learned_addr learned my addr 172.21.15.112:0/3737821528 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:14.774 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.010+0000 7f58dccda640 1 -- 172.21.15.112:0/3737821528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d4009450 con 0x7f58d8078c60 2024-09-19T09:26:14.774 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.010+0000 7f58dccda640 1 --2- 172.21.15.112:0/3737821528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d8078c60 0x7f58d8112f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f58d40098a0 tx=0x7f58d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:14.774 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.010+0000 7f58cd7fa640 1 -- 172.21.15.112:0/3737821528 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58d4032880 con 0x7f58d8078c60 2024-09-19T09:26:14.774 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.010+0000 7f58cd7fa640 1 -- 172.21.15.112:0/3737821528 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f58d403d8b0 con 0x7f58d8078c60 2024-09-19T09:26:14.774 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.010+0000 7f58def3e640 1 -- 172.21.15.112:0/3737821528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d8113660 con 0x7f58d8078c60 2024-09-19T09:26:14.774 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.010+0000 7f58cd7fa640 1 -- 172.21.15.112:0/3737821528 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58d403b8e0 con 0x7f58d8078c60 2024-09-19T09:26:14.774 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.011+0000 7f58def3e640 1 -- 172.21.15.112:0/3737821528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d8113ad0 con 0x7f58d8078c60 2024-09-19T09:26:14.774 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.011+0000 7f58cd7fa640 1 -- 172.21.15.112:0/3737821528 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f58d4039070 con 0x7f58d8078c60 2024-09-19T09:26:14.774 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.011+0000 7f58def3e640 1 -- 172.21.15.112:0/3737821528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d804b720 con 0x7f58d8078c60 2024-09-19T09:26:14.774 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.011+0000 7f58cd7fa640 1 --2- 172.21.15.112:0/3737821528 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f58c0039490 0x7f58c003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:14.774 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.012+0000 7f58cd7fa640 1 -- 172.21.15.112:0/3737821528 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f58d406d110 con 0x7f58d8078c60 2024-09-19T09:26:14.774 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.012+0000 7f58cffff640 1 --2- 172.21.15.112:0/3737821528 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f58c0039490 0x7f58c003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:14.775 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.012+0000 7f58cffff640 1 --2- 172.21.15.112:0/3737821528 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f58c0039490 0x7f58c003b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58c8006fd0 tx=0x7f58c8006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:14.775 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.016+0000 7f58cd7fa640 1 -- 172.21.15.112:0/3737821528 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f58d403ca00 con 0x7f58d8078c60 2024-09-19T09:26:14.775 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.172+0000 7f58def3e640 1 -- 172.21.15.112:0/3737821528 --> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f58d8113ad0 con 0x7f58c0039490 2024-09-19T09:26:14.775 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.173+0000 7f58cd7fa640 1 -- 172.21.15.112:0/3737821528 <== mgr.14116 v2:172.21.15.112:6800/1627571174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f58d8113ad0 con 0x7f58c0039490 2024-09-19T09:26:14.775 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.175+0000 7f58def3e640 1 -- 172.21.15.112:0/3737821528 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f58c0039490 msgr2=0x7f58c003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:14.775 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.175+0000 7f58def3e640 1 --2- 172.21.15.112:0/3737821528 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f58c0039490 0x7f58c003b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58c8006fd0 tx=0x7f58c8006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:14.775 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.175+0000 7f58def3e640 1 -- 172.21.15.112:0/3737821528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d8078c60 msgr2=0x7f58d8112f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:14.775 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.175+0000 7f58def3e640 1 --2- 172.21.15.112:0/3737821528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d8078c60 0x7f58d8112f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f58d40098a0 tx=0x7f58d4008040 comp rx=0 tx=0).stop 2024-09-19T09:26:14.775 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.175+0000 7f58def3e640 1 -- 172.21.15.112:0/3737821528 shutdown_connections 2024-09-19T09:26:14.775 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.175+0000 7f58def3e640 1 --2- 172.21.15.112:0/3737821528 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f58c0039490 0x7f58c003b940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:14.775 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.175+0000 7f58def3e640 1 --2- 172.21.15.112:0/3737821528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d8078c60 0x7f58d8112f20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:14.775 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.175+0000 7f58def3e640 1 -- 172.21.15.112:0/3737821528 >> 172.21.15.112:0/3737821528 conn(0x7f58d80fd710 msgr2=0x7f58d80fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:14.775 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.175+0000 7f58def3e640 1 -- 172.21.15.112:0/3737821528 shutdown_connections 2024-09-19T09:26:14.775 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:14.175+0000 7f58def3e640 1 -- 172.21.15.112:0/3737821528 wait complete. 2024-09-19T09:26:14.776 INFO:teuthology.orchestra.run.smithi112.stdout:Generating ssh key... 2024-09-19T09:26:15.133 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:14 smithi112 ceph-mon[27605]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:26:16.062 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.205+0000 7f3b0ad4c640 1 Processor -- start 2024-09-19T09:26:16.062 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.205+0000 7f3b0ad4c640 1 -- start start 2024-09-19T09:26:16.062 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.205+0000 7f3b0ad4c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b04102070 0x7f3b04102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:16.062 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.205+0000 7f3b0ad4c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b041029c0 con 0x7f3b04102070 2024-09-19T09:26:16.062 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.205+0000 7f3b08ae8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b04102070 0x7f3b04102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:16.062 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.205+0000 7f3b08ae8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b04102070 0x7f3b04102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33906/0 (socket says 172.21.15.112:33906) 2024-09-19T09:26:16.062 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.205+0000 7f3b08ae8640 1 -- 172.21.15.112:0/2488124597 learned_addr learned my addr 172.21.15.112:0/2488124597 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:16.062 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.205+0000 7f3b08ae8640 1 -- 172.21.15.112:0/2488124597 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b04102b00 con 0x7f3b04102070 2024-09-19T09:26:16.063 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.206+0000 7f3b08ae8640 1 --2- 172.21.15.112:0/2488124597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b04102070 0x7f3b04102480 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009840 tx=0x7f3afc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c63d33429f10494 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:16.063 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.206+0000 7f3b037fe640 1 -- 172.21.15.112:0/2488124597 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3afc032440 con 0x7f3b04102070 2024-09-19T09:26:16.063 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.206+0000 7f3b037fe640 1 -- 172.21.15.112:0/2488124597 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f3afc032a00 con 0x7f3b04102070 2024-09-19T09:26:16.063 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.206+0000 7f3b037fe640 1 -- 172.21.15.112:0/2488124597 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3afc031a10 con 0x7f3b04102070 2024-09-19T09:26:16.063 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.207+0000 7f3b0ad4c640 1 -- 172.21.15.112:0/2488124597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b04102070 msgr2=0x7f3b04102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:16.063 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.207+0000 7f3b0ad4c640 1 --2- 172.21.15.112:0/2488124597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b04102070 0x7f3b04102480 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009840 tx=0x7f3afc0091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:16.063 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.207+0000 7f3b0ad4c640 1 -- 172.21.15.112:0/2488124597 shutdown_connections 2024-09-19T09:26:16.063 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.207+0000 7f3b0ad4c640 1 --2- 172.21.15.112:0/2488124597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b04102070 0x7f3b04102480 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:16.063 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.207+0000 7f3b0ad4c640 1 -- 172.21.15.112:0/2488124597 >> 172.21.15.112:0/2488124597 conn(0x7f3b040fd850 msgr2=0x7f3b040ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:16.064 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.207+0000 7f3b0ad4c640 1 -- 172.21.15.112:0/2488124597 shutdown_connections 2024-09-19T09:26:16.064 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.207+0000 7f3b0ad4c640 1 -- 172.21.15.112:0/2488124597 wait complete. 2024-09-19T09:26:16.064 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.207+0000 7f3b0ad4c640 1 Processor -- start 2024-09-19T09:26:16.064 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.207+0000 7f3b0ad4c640 1 -- start start 2024-09-19T09:26:16.064 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.208+0000 7f3b0ad4c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b04102070 0x7f3b04078c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:16.064 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.208+0000 7f3b0ad4c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b04079140 con 0x7f3b04102070 2024-09-19T09:26:16.064 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.208+0000 7f3b08ae8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b04102070 0x7f3b04078c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:16.064 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.208+0000 7f3b08ae8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b04102070 0x7f3b04078c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33918/0 (socket says 172.21.15.112:33918) 2024-09-19T09:26:16.064 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.208+0000 7f3b08ae8640 1 -- 172.21.15.112:0/1573524896 learned_addr learned my addr 172.21.15.112:0/1573524896 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:16.064 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.208+0000 7f3b08ae8640 1 -- 172.21.15.112:0/1573524896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc009450 con 0x7f3b04102070 2024-09-19T09:26:16.064 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.208+0000 7f3b08ae8640 1 --2- 172.21.15.112:0/1573524896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b04102070 0x7f3b04078c00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0098a0 tx=0x7f3afc02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:16.064 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.208+0000 7f3b017fa640 1 -- 172.21.15.112:0/1573524896 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3afc0327b0 con 0x7f3b04102070 2024-09-19T09:26:16.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.208+0000 7f3b017fa640 1 -- 172.21.15.112:0/1573524896 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f3afc03b870 con 0x7f3b04102070 2024-09-19T09:26:16.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.208+0000 7f3b0ad4c640 1 -- 172.21.15.112:0/1573524896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b040771d0 con 0x7f3b04102070 2024-09-19T09:26:16.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.208+0000 7f3b017fa640 1 -- 172.21.15.112:0/1573524896 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3afc03a550 con 0x7f3b04102070 2024-09-19T09:26:16.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.209+0000 7f3b0ad4c640 1 -- 172.21.15.112:0/1573524896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b04077640 con 0x7f3b04102070 2024-09-19T09:26:16.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.209+0000 7f3b017fa640 1 -- 172.21.15.112:0/1573524896 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f3afc039040 con 0x7f3b04102070 2024-09-19T09:26:16.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.209+0000 7f3b0ad4c640 1 -- 172.21.15.112:0/1573524896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0404b720 con 0x7f3b04102070 2024-09-19T09:26:16.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.210+0000 7f3b017fa640 1 --2- 172.21.15.112:0/1573524896 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f3af0039490 0x7f3af003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:16.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.210+0000 7f3b017fa640 1 -- 172.21.15.112:0/1573524896 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3afc06c9b0 con 0x7f3b04102070 2024-09-19T09:26:16.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.210+0000 7f3b03fff640 1 --2- 172.21.15.112:0/1573524896 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f3af0039490 0x7f3af003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:16.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.210+0000 7f3b03fff640 1 --2- 172.21.15.112:0/1573524896 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f3af0039490 0x7f3af003b940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00ad90 tx=0x7f3aec009410 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:16.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.214+0000 7f3b017fa640 1 -- 172.21.15.112:0/1573524896 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3afc04c350 con 0x7f3b04102070 2024-09-19T09:26:16.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.371+0000 7f3b0ad4c640 1 -- 172.21.15.112:0/1573524896 --> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b04077df0 con 0x7f3af0039490 2024-09-19T09:26:16.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.459+0000 7f3b017fa640 1 -- 172.21.15.112:0/1573524896 <== mgr.14116 v2:172.21.15.112:6800/1627571174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3b04077df0 con 0x7f3af0039490 2024-09-19T09:26:16.066 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.461+0000 7f3b0ad4c640 1 -- 172.21.15.112:0/1573524896 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f3af0039490 msgr2=0x7f3af003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:16.066 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.461+0000 7f3b0ad4c640 1 --2- 172.21.15.112:0/1573524896 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f3af0039490 0x7f3af003b940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00ad90 tx=0x7f3aec009410 comp rx=0 tx=0).stop 2024-09-19T09:26:16.066 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.461+0000 7f3b0ad4c640 1 -- 172.21.15.112:0/1573524896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b04102070 msgr2=0x7f3b04078c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:16.066 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.461+0000 7f3b0ad4c640 1 --2- 172.21.15.112:0/1573524896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b04102070 0x7f3b04078c00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0098a0 tx=0x7f3afc02c040 comp rx=0 tx=0).stop 2024-09-19T09:26:16.066 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.461+0000 7f3b0ad4c640 1 -- 172.21.15.112:0/1573524896 shutdown_connections 2024-09-19T09:26:16.066 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.461+0000 7f3b0ad4c640 1 --2- 172.21.15.112:0/1573524896 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f3af0039490 0x7f3af003b940 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:16.066 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.461+0000 7f3b0ad4c640 1 --2- 172.21.15.112:0/1573524896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b04102070 0x7f3b04078c00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:16.066 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.461+0000 7f3b0ad4c640 1 -- 172.21.15.112:0/1573524896 >> 172.21.15.112:0/1573524896 conn(0x7f3b040fd850 msgr2=0x7f3b040fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:16.066 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.461+0000 7f3b0ad4c640 1 -- 172.21.15.112:0/1573524896 shutdown_connections 2024-09-19T09:26:16.066 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:15.461+0000 7f3b0ad4c640 1 -- 172.21.15.112:0/1573524896 wait complete. 2024-09-19T09:26:16.631 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:16 smithi112 ceph-mon[27605]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:26:16.631 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:16 smithi112 ceph-mon[27605]: Generating ssh key... 2024-09-19T09:26:16.631 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:16 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:16.631 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:16 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:17.273 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCz4DY/MkY6kDlFntT8XAsMTa7iJ1tJKDctz5ss+w0fLf/yyHsepRDKclqG8Pa24IBySkGPj4hkXDUK3hjJnQkaX50UPiY+1aTguuglyudcZ81A47JdBRfBB+Wre66fETzcAYKI54YYDYM/+0M2rbTBV/ZGdWdgSFHSlN/HZoRaTZIRN08Pg9tK6gEJn0OHGuLGoqhTmKPFfApC+m/S61L66Wgi6uO6z/vEFplfBQPNQxa45nrlEF1Rr00Yc2y3fyUoK+7Jv5pam1kfdlXrhhIR4D4JYfE8Sk+fd59miDMGMLg4jRUaBGrbWcxV2SgXEMLV27w/vX1BmZLTYesjEhMBBqdAHb9YsW55I5JGKdz/s/AzCGtdXh9KJgZqrl7ZrHLAe+BLPn8jdA538lEt3l9G03Y6ft249TWGow4nS01cQNuNTXRB8jnItzR4+PNw8xcq/psqGqMmRQ2lD68HJZCeB2JcRcT9kKa0UyyRsahkHKd3B8/3G2YbyWuWo4xTsRk= ceph-0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:26:17.273 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.450+0000 7f54a60be640 1 Processor -- start 2024-09-19T09:26:17.273 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.450+0000 7f54a60be640 1 -- start start 2024-09-19T09:26:17.273 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.450+0000 7f54a60be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54a01005d0 0x7f54a01009e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.274 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.450+0000 7f54a60be640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a0100f20 con 0x7f54a01005d0 2024-09-19T09:26:17.274 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.450+0000 7f549f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54a01005d0 0x7f54a01009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.274 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.450+0000 7f549f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54a01005d0 0x7f54a01009e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33924/0 (socket says 172.21.15.112:33924) 2024-09-19T09:26:17.274 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.450+0000 7f549f7fe640 1 -- 172.21.15.112:0/1237382477 learned_addr learned my addr 172.21.15.112:0/1237382477 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:17.274 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.451+0000 7f549f7fe640 1 -- 172.21.15.112:0/1237382477 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a0101060 con 0x7f54a01005d0 2024-09-19T09:26:17.274 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.451+0000 7f549f7fe640 1 --2- 172.21.15.112:0/1237382477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54a01005d0 0x7f54a01009e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f549000bae0 tx=0x7f549000b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6265255ab35bc8d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:17.278 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.452+0000 7f549e7fc640 1 -- 172.21.15.112:0/1237382477 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54900325e0 con 0x7f54a01005d0 2024-09-19T09:26:17.278 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.452+0000 7f549e7fc640 1 -- 172.21.15.112:0/1237382477 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f549002f030 con 0x7f54a01005d0 2024-09-19T09:26:17.278 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.452+0000 7f549e7fc640 1 -- 172.21.15.112:0/1237382477 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5490035b50 con 0x7f54a01005d0 2024-09-19T09:26:17.278 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.452+0000 7f54a60be640 1 -- 172.21.15.112:0/1237382477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54a01005d0 msgr2=0x7f54a01009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:17.283 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.452+0000 7f54a60be640 1 --2- 172.21.15.112:0/1237382477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54a01005d0 0x7f54a01009e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f549000bae0 tx=0x7f549000b4b0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.283 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.452+0000 7f54a60be640 1 -- 172.21.15.112:0/1237382477 shutdown_connections 2024-09-19T09:26:17.283 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.452+0000 7f54a60be640 1 --2- 172.21.15.112:0/1237382477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54a01005d0 0x7f54a01009e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.283 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.452+0000 7f54a60be640 1 -- 172.21.15.112:0/1237382477 >> 172.21.15.112:0/1237382477 conn(0x7f54a00fbdd0 msgr2=0x7f54a00fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:17.283 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.452+0000 7f54a60be640 1 -- 172.21.15.112:0/1237382477 shutdown_connections 2024-09-19T09:26:17.283 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.452+0000 7f54a60be640 1 -- 172.21.15.112:0/1237382477 wait complete. 2024-09-19T09:26:17.283 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.453+0000 7f54a60be640 1 Processor -- start 2024-09-19T09:26:17.283 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.453+0000 7f54a60be640 1 -- start start 2024-09-19T09:26:17.284 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.453+0000 7f54a60be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54a01005d0 0x7f54a010eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.284 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.453+0000 7f54a60be640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a010f040 con 0x7f54a01005d0 2024-09-19T09:26:17.284 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.453+0000 7f549f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54a01005d0 0x7f54a010eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.284 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.453+0000 7f549f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54a01005d0 0x7f54a010eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33940/0 (socket says 172.21.15.112:33940) 2024-09-19T09:26:17.284 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.453+0000 7f549f7fe640 1 -- 172.21.15.112:0/2983293109 learned_addr learned my addr 172.21.15.112:0/2983293109 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:17.284 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.454+0000 7f549f7fe640 1 -- 172.21.15.112:0/2983293109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549000b6f0 con 0x7f54a01005d0 2024-09-19T09:26:17.284 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.454+0000 7f549f7fe640 1 --2- 172.21.15.112:0/2983293109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54a01005d0 0x7f54a010eb00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5490035830 tx=0x7f549000b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:17.284 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.454+0000 7f5487fff640 1 -- 172.21.15.112:0/2983293109 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5490049430 con 0x7f54a01005d0 2024-09-19T09:26:17.284 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.455+0000 7f5487fff640 1 -- 172.21.15.112:0/2983293109 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f54900499f0 con 0x7f54a01005d0 2024-09-19T09:26:17.284 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.455+0000 7f54a60be640 1 -- 172.21.15.112:0/2983293109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a010f240 con 0x7f54a01005d0 2024-09-19T09:26:17.284 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.455+0000 7f5487fff640 1 -- 172.21.15.112:0/2983293109 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f549003e7e0 con 0x7f54a01005d0 2024-09-19T09:26:17.284 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.455+0000 7f54a60be640 1 -- 172.21.15.112:0/2983293109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a010f6b0 con 0x7f54a01005d0 2024-09-19T09:26:17.285 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.455+0000 7f5487fff640 1 -- 172.21.15.112:0/2983293109 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f549003c040 con 0x7f54a01005d0 2024-09-19T09:26:17.285 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.456+0000 7f5487fff640 1 --2- 172.21.15.112:0/2983293109 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f54880394e0 0x7f548803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.285 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.456+0000 7f5487fff640 1 -- 172.21.15.112:0/2983293109 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5490044030 con 0x7f54a01005d0 2024-09-19T09:26:17.285 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.456+0000 7f549effd640 1 --2- 172.21.15.112:0/2983293109 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f54880394e0 0x7f548803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.285 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.456+0000 7f54a60be640 1 -- 172.21.15.112:0/2983293109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a00ffa30 con 0x7f54a01005d0 2024-09-19T09:26:17.285 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.456+0000 7f549effd640 1 --2- 172.21.15.112:0/2983293109 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f54880394e0 0x7f548803b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5494006fd0 tx=0x7f5494006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:17.285 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.460+0000 7f5487fff640 1 -- 172.21.15.112:0/2983293109 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f549003a030 con 0x7f54a01005d0 2024-09-19T09:26:17.285 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.617+0000 7f54a60be640 1 -- 172.21.15.112:0/2983293109 --> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f54a0108150 con 0x7f54880394e0 2024-09-19T09:26:17.285 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.618+0000 7f5487fff640 1 -- 172.21.15.112:0/2983293109 <== mgr.14116 v2:172.21.15.112:6800/1627571174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f54a0108150 con 0x7f54880394e0 2024-09-19T09:26:17.285 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.620+0000 7f54a60be640 1 -- 172.21.15.112:0/2983293109 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f54880394e0 msgr2=0x7f548803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:17.285 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.620+0000 7f54a60be640 1 --2- 172.21.15.112:0/2983293109 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f54880394e0 0x7f548803b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5494006fd0 tx=0x7f5494006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.285 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.620+0000 7f54a60be640 1 -- 172.21.15.112:0/2983293109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54a01005d0 msgr2=0x7f54a010eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:17.285 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.620+0000 7f54a60be640 1 --2- 172.21.15.112:0/2983293109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54a01005d0 0x7f54a010eb00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5490035830 tx=0x7f549000b4b0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.286 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.620+0000 7f54a60be640 1 -- 172.21.15.112:0/2983293109 shutdown_connections 2024-09-19T09:26:17.286 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.620+0000 7f54a60be640 1 --2- 172.21.15.112:0/2983293109 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f54880394e0 0x7f548803b990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.286 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.620+0000 7f54a60be640 1 --2- 172.21.15.112:0/2983293109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54a01005d0 0x7f54a010eb00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.286 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.620+0000 7f54a60be640 1 -- 172.21.15.112:0/2983293109 >> 172.21.15.112:0/2983293109 conn(0x7f54a00fbdd0 msgr2=0x7f54a0103070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:17.286 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.620+0000 7f54a60be640 1 -- 172.21.15.112:0/2983293109 shutdown_connections 2024-09-19T09:26:17.286 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:16.620+0000 7f54a60be640 1 -- 172.21.15.112:0/2983293109 wait complete. 2024-09-19T09:26:17.286 INFO:teuthology.orchestra.run.smithi112.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:26:17.286 INFO:teuthology.orchestra.run.smithi112.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T09:26:17.286 INFO:teuthology.orchestra.run.smithi112.stdout:Adding host smithi112... 2024-09-19T09:26:17.813 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:17 smithi112 ceph-mon[27605]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:26:18.590 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:18 smithi112 ceph-mon[27605]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi112", "addr": "172.21.15.112", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:26:19.882 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:19 smithi112 ceph-mon[27605]: Deploying cephadm binary to smithi112 2024-09-19T09:26:21.064 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Added host 'smithi112' with addr '172.21.15.112' 2024-09-19T09:26:21.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.641+0000 7f1adaac3640 1 Processor -- start 2024-09-19T09:26:21.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.641+0000 7f1adaac3640 1 -- start start 2024-09-19T09:26:21.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.642+0000 7f1adaac3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4102070 0x7f1ad4102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.642+0000 7f1adaac3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad41029c0 con 0x7f1ad4102070 2024-09-19T09:26:21.065 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.642+0000 7f1ad885f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4102070 0x7f1ad4102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.066 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.642+0000 7f1ad885f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4102070 0x7f1ad4102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33948/0 (socket says 172.21.15.112:33948) 2024-09-19T09:26:21.066 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.642+0000 7f1ad885f640 1 -- 172.21.15.112:0/1737023898 learned_addr learned my addr 172.21.15.112:0/1737023898 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:21.066 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.642+0000 7f1ad885f640 1 -- 172.21.15.112:0/1737023898 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4102b00 con 0x7f1ad4102070 2024-09-19T09:26:21.066 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.643+0000 7f1ad885f640 1 --2- 172.21.15.112:0/1737023898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4102070 0x7f1ad4102480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009840 tx=0x7f1ac80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257a6e6f7be7a479 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:21.066 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.643+0000 7f1ad37fe640 1 -- 172.21.15.112:0/1737023898 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ac8032440 con 0x7f1ad4102070 2024-09-19T09:26:21.067 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.643+0000 7f1ad37fe640 1 -- 172.21.15.112:0/1737023898 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f1ac8032a00 con 0x7f1ad4102070 2024-09-19T09:26:21.067 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.643+0000 7f1ad37fe640 1 -- 172.21.15.112:0/1737023898 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ac8031a10 con 0x7f1ad4102070 2024-09-19T09:26:21.067 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.643+0000 7f1adaac3640 1 -- 172.21.15.112:0/1737023898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4102070 msgr2=0x7f1ad4102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:21.067 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.643+0000 7f1adaac3640 1 --2- 172.21.15.112:0/1737023898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4102070 0x7f1ad4102480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009840 tx=0x7f1ac80091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.067 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.643+0000 7f1adaac3640 1 -- 172.21.15.112:0/1737023898 shutdown_connections 2024-09-19T09:26:21.068 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.643+0000 7f1adaac3640 1 --2- 172.21.15.112:0/1737023898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4102070 0x7f1ad4102480 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.068 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.643+0000 7f1adaac3640 1 -- 172.21.15.112:0/1737023898 >> 172.21.15.112:0/1737023898 conn(0x7f1ad40fd850 msgr2=0x7f1ad40ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:21.068 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.644+0000 7f1adaac3640 1 -- 172.21.15.112:0/1737023898 shutdown_connections 2024-09-19T09:26:21.068 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.644+0000 7f1adaac3640 1 -- 172.21.15.112:0/1737023898 wait complete. 2024-09-19T09:26:21.068 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.644+0000 7f1adaac3640 1 Processor -- start 2024-09-19T09:26:21.068 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.644+0000 7f1adaac3640 1 -- start start 2024-09-19T09:26:21.069 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.644+0000 7f1adaac3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4102070 0x7f1ad4110cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.069 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.644+0000 7f1adaac3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4111230 con 0x7f1ad4102070 2024-09-19T09:26:21.069 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.645+0000 7f1ad885f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4102070 0x7f1ad4110cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.069 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.645+0000 7f1ad885f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4102070 0x7f1ad4110cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33950/0 (socket says 172.21.15.112:33950) 2024-09-19T09:26:21.069 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.645+0000 7f1ad885f640 1 -- 172.21.15.112:0/1186934208 learned_addr learned my addr 172.21.15.112:0/1186934208 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:21.069 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.645+0000 7f1ad885f640 1 -- 172.21.15.112:0/1186934208 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac8009450 con 0x7f1ad4102070 2024-09-19T09:26:21.069 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.645+0000 7f1ad885f640 1 --2- 172.21.15.112:0/1186934208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4102070 0x7f1ad4110cf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8006a70 tx=0x7f1ac802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:21.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.645+0000 7f1ad17fa640 1 -- 172.21.15.112:0/1186934208 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ac8031d10 con 0x7f1ad4102070 2024-09-19T09:26:21.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.645+0000 7f1ad17fa640 1 -- 172.21.15.112:0/1186934208 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f1ac8031e70 con 0x7f1ad4102070 2024-09-19T09:26:21.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.645+0000 7f1adaac3640 1 -- 172.21.15.112:0/1186934208 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad4111430 con 0x7f1ad4102070 2024-09-19T09:26:21.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.645+0000 7f1ad17fa640 1 -- 172.21.15.112:0/1186934208 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ac803b6f0 con 0x7f1ad4102070 2024-09-19T09:26:21.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.645+0000 7f1adaac3640 1 -- 172.21.15.112:0/1186934208 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad41118a0 con 0x7f1ad4102070 2024-09-19T09:26:21.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.646+0000 7f1ad17fa640 1 -- 172.21.15.112:0/1186934208 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f1ac8039070 con 0x7f1ad4102070 2024-09-19T09:26:21.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.646+0000 7f1ad17fa640 1 --2- 172.21.15.112:0/1186934208 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f1ac40394e0 0x7f1ac403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.646+0000 7f1adaac3640 1 -- 172.21.15.112:0/1186934208 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad41118a0 con 0x7f1ad4102070 2024-09-19T09:26:21.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.646+0000 7f1ad17fa640 1 -- 172.21.15.112:0/1186934208 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1ac806cbc0 con 0x7f1ad4102070 2024-09-19T09:26:21.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.646+0000 7f1ad3fff640 1 --2- 172.21.15.112:0/1186934208 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f1ac40394e0 0x7f1ac403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.647+0000 7f1ad3fff640 1 --2- 172.21.15.112:0/1186934208 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f1ac40394e0 0x7f1ac403b990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0006fd0 tx=0x7f1ac0006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:21.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.651+0000 7f1ad17fa640 1 -- 172.21.15.112:0/1186934208 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1ad41118a0 con 0x7f1ad4102070 2024-09-19T09:26:21.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:17.811+0000 7f1adaac3640 1 -- 172.21.15.112:0/1186934208 --> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi112", "addr": "172.21.15.112", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ad41118a0 con 0x7f1ac40394e0 2024-09-19T09:26:21.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:20.437+0000 7f1ad17fa640 1 -- 172.21.15.112:0/1186934208 <== mgr.14116 v2:172.21.15.112:6800/1627571174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1ad41118a0 con 0x7f1ac40394e0 2024-09-19T09:26:21.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:20.440+0000 7f1adaac3640 1 -- 172.21.15.112:0/1186934208 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f1ac40394e0 msgr2=0x7f1ac403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:21.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:20.440+0000 7f1adaac3640 1 --2- 172.21.15.112:0/1186934208 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f1ac40394e0 0x7f1ac403b990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0006fd0 tx=0x7f1ac0006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:20.440+0000 7f1adaac3640 1 -- 172.21.15.112:0/1186934208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4102070 msgr2=0x7f1ad4110cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:21.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:20.440+0000 7f1adaac3640 1 --2- 172.21.15.112:0/1186934208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4102070 0x7f1ad4110cf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8006a70 tx=0x7f1ac802c040 comp rx=0 tx=0).stop 2024-09-19T09:26:21.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:20.440+0000 7f1adaac3640 1 -- 172.21.15.112:0/1186934208 shutdown_connections 2024-09-19T09:26:21.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:20.440+0000 7f1adaac3640 1 --2- 172.21.15.112:0/1186934208 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f1ac40394e0 0x7f1ac403b990 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:20.440+0000 7f1adaac3640 1 --2- 172.21.15.112:0/1186934208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4102070 0x7f1ad4110cf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:20.440+0000 7f1adaac3640 1 -- 172.21.15.112:0/1186934208 >> 172.21.15.112:0/1186934208 conn(0x7f1ad40fd850 msgr2=0x7f1ad40fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:21.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:20.440+0000 7f1adaac3640 1 -- 172.21.15.112:0/1186934208 shutdown_connections 2024-09-19T09:26:21.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:20.440+0000 7f1adaac3640 1 -- 172.21.15.112:0/1186934208 wait complete. 2024-09-19T09:26:21.071 INFO:teuthology.orchestra.run.smithi112.stdout:Deploying mon service with default placement... 2024-09-19T09:26:21.638 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:21 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:21.638 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:21 smithi112 ceph-mon[27605]: Added host smithi112 2024-09-19T09:26:21.638 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:21 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:26:22.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:22 smithi112 ceph-mon[27605]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:26:22.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:22 smithi112 ceph-mon[27605]: Saving service mon spec with placement count:5 2024-09-19T09:26:22.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:22 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:22.981 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T09:26:22.982 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.464+0000 7fa084ae1640 1 Processor -- start 2024-09-19T09:26:22.982 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.464+0000 7fa084ae1640 1 -- start start 2024-09-19T09:26:22.982 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.464+0000 7fa084ae1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080102010 0x7fa080102420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:22.982 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.464+0000 7fa084ae1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa080102960 con 0x7fa080102010 2024-09-19T09:26:22.982 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.464+0000 7fa07e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080102010 0x7fa080102420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:22.982 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.464+0000 7fa07e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080102010 0x7fa080102420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51328/0 (socket says 172.21.15.112:51328) 2024-09-19T09:26:22.982 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.464+0000 7fa07e59c640 1 -- 172.21.15.112:0/382116359 learned_addr learned my addr 172.21.15.112:0/382116359 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:22.982 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.464+0000 7fa07e59c640 1 -- 172.21.15.112:0/382116359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa080102aa0 con 0x7fa080102010 2024-09-19T09:26:22.982 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.465+0000 7fa07e59c640 1 --2- 172.21.15.112:0/382116359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080102010 0x7fa080102420 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa070009840 tx=0x7fa0700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36bb74b5bf1117f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:22.983 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.465+0000 7fa07d59a640 1 -- 172.21.15.112:0/382116359 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa070032440 con 0x7fa080102010 2024-09-19T09:26:22.983 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.465+0000 7fa07d59a640 1 -- 172.21.15.112:0/382116359 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa070032a00 con 0x7fa080102010 2024-09-19T09:26:22.983 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.465+0000 7fa07d59a640 1 -- 172.21.15.112:0/382116359 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0700319e0 con 0x7fa080102010 2024-09-19T09:26:22.983 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.466+0000 7fa084ae1640 1 -- 172.21.15.112:0/382116359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080102010 msgr2=0x7fa080102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:22.983 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.466+0000 7fa084ae1640 1 --2- 172.21.15.112:0/382116359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080102010 0x7fa080102420 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa070009840 tx=0x7fa0700091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:22.983 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.466+0000 7fa084ae1640 1 -- 172.21.15.112:0/382116359 shutdown_connections 2024-09-19T09:26:22.983 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.466+0000 7fa084ae1640 1 --2- 172.21.15.112:0/382116359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080102010 0x7fa080102420 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:22.983 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.466+0000 7fa084ae1640 1 -- 172.21.15.112:0/382116359 >> 172.21.15.112:0/382116359 conn(0x7fa0800fd790 msgr2=0x7fa0800ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:22.983 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.466+0000 7fa084ae1640 1 -- 172.21.15.112:0/382116359 shutdown_connections 2024-09-19T09:26:22.983 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.466+0000 7fa084ae1640 1 -- 172.21.15.112:0/382116359 wait complete. 2024-09-19T09:26:22.983 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.466+0000 7fa084ae1640 1 Processor -- start 2024-09-19T09:26:22.983 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.467+0000 7fa084ae1640 1 -- start start 2024-09-19T09:26:22.984 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.467+0000 7fa084ae1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080102010 0x7fa080110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:22.984 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.467+0000 7fa084ae1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa080111330 con 0x7fa080102010 2024-09-19T09:26:22.984 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.467+0000 7fa07e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080102010 0x7fa080110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:22.984 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.467+0000 7fa07e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080102010 0x7fa080110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51342/0 (socket says 172.21.15.112:51342) 2024-09-19T09:26:22.984 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.467+0000 7fa07e59c640 1 -- 172.21.15.112:0/4251402323 learned_addr learned my addr 172.21.15.112:0/4251402323 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:22.984 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.467+0000 7fa07e59c640 1 -- 172.21.15.112:0/4251402323 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa070009450 con 0x7fa080102010 2024-09-19T09:26:22.984 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.467+0000 7fa07e59c640 1 --2- 172.21.15.112:0/4251402323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080102010 0x7fa080110df0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa0700098a0 tx=0x7fa070008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:22.984 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.467+0000 7fa06effd640 1 -- 172.21.15.112:0/4251402323 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa070032880 con 0x7fa080102010 2024-09-19T09:26:22.984 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.467+0000 7fa06effd640 1 -- 172.21.15.112:0/4251402323 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa07003d8b0 con 0x7fa080102010 2024-09-19T09:26:22.984 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.467+0000 7fa084ae1640 1 -- 172.21.15.112:0/4251402323 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa080111530 con 0x7fa080102010 2024-09-19T09:26:22.984 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.467+0000 7fa06effd640 1 -- 172.21.15.112:0/4251402323 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa07003b910 con 0x7fa080102010 2024-09-19T09:26:22.984 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.467+0000 7fa084ae1640 1 -- 172.21.15.112:0/4251402323 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa080111f80 con 0x7fa080102010 2024-09-19T09:26:22.984 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.468+0000 7fa06effd640 1 -- 172.21.15.112:0/4251402323 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fa070039070 con 0x7fa080102010 2024-09-19T09:26:22.985 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.468+0000 7fa084ae1640 1 -- 172.21.15.112:0/4251402323 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa080101470 con 0x7fa080102010 2024-09-19T09:26:22.985 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.468+0000 7fa06effd640 1 --2- 172.21.15.112:0/4251402323 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fa0680394e0 0x7fa06803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:22.985 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.468+0000 7fa06effd640 1 -- 172.21.15.112:0/4251402323 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa07006d3e0 con 0x7fa080102010 2024-09-19T09:26:22.985 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.469+0000 7fa07dd9b640 1 --2- 172.21.15.112:0/4251402323 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fa0680394e0 0x7fa06803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:22.985 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.469+0000 7fa07dd9b640 1 --2- 172.21.15.112:0/4251402323 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fa0680394e0 0x7fa06803b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa074006fd0 tx=0x7fa074006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:22.985 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.473+0000 7fa06effd640 1 -- 172.21.15.112:0/4251402323 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa07004e530 con 0x7fa080102010 2024-09-19T09:26:22.985 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.637+0000 7fa084ae1640 1 -- 172.21.15.112:0/4251402323 --> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0800feac0 con 0x7fa0680394e0 2024-09-19T09:26:22.985 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.641+0000 7fa06effd640 1 -- 172.21.15.112:0/4251402323 <== mgr.14116 v2:172.21.15.112:6800/1627571174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa0800feac0 con 0x7fa0680394e0 2024-09-19T09:26:22.985 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.643+0000 7fa084ae1640 1 -- 172.21.15.112:0/4251402323 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fa0680394e0 msgr2=0x7fa06803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:22.985 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.643+0000 7fa084ae1640 1 --2- 172.21.15.112:0/4251402323 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fa0680394e0 0x7fa06803b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa074006fd0 tx=0x7fa074006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:22.985 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.643+0000 7fa084ae1640 1 -- 172.21.15.112:0/4251402323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080102010 msgr2=0x7fa080110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:22.985 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.643+0000 7fa084ae1640 1 --2- 172.21.15.112:0/4251402323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080102010 0x7fa080110df0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa0700098a0 tx=0x7fa070008040 comp rx=0 tx=0).stop 2024-09-19T09:26:22.985 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.643+0000 7fa084ae1640 1 -- 172.21.15.112:0/4251402323 shutdown_connections 2024-09-19T09:26:22.986 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.643+0000 7fa084ae1640 1 --2- 172.21.15.112:0/4251402323 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fa0680394e0 0x7fa06803b990 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:22.986 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.643+0000 7fa084ae1640 1 --2- 172.21.15.112:0/4251402323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080102010 0x7fa080110df0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:22.986 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.643+0000 7fa084ae1640 1 -- 172.21.15.112:0/4251402323 >> 172.21.15.112:0/4251402323 conn(0x7fa0800fd790 msgr2=0x7fa0800fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:22.986 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.643+0000 7fa084ae1640 1 -- 172.21.15.112:0/4251402323 shutdown_connections 2024-09-19T09:26:22.986 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:21.643+0000 7fa084ae1640 1 -- 172.21.15.112:0/4251402323 wait complete. 2024-09-19T09:26:22.986 INFO:teuthology.orchestra.run.smithi112.stdout:Deploying mgr service with default placement... 2024-09-19T09:26:24.425 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T09:26:24.425 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.386+0000 7f35cbdf1640 1 Processor -- start 2024-09-19T09:26:24.425 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.386+0000 7f35cbdf1640 1 -- start start 2024-09-19T09:26:24.425 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.386+0000 7f35cbdf1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c4100ee0 0x7f35c41012f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.426 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.386+0000 7f35cbdf1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c4101830 con 0x7f35c4100ee0 2024-09-19T09:26:24.426 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.387+0000 7f35c9b8d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c4100ee0 0x7f35c41012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.426 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.387+0000 7f35c9b8d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c4100ee0 0x7f35c41012f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51356/0 (socket says 172.21.15.112:51356) 2024-09-19T09:26:24.426 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.387+0000 7f35c9b8d640 1 -- 172.21.15.112:0/3763593895 learned_addr learned my addr 172.21.15.112:0/3763593895 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:24.426 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.387+0000 7f35c9b8d640 1 -- 172.21.15.112:0/3763593895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c4101970 con 0x7f35c4100ee0 2024-09-19T09:26:24.426 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.387+0000 7f35c9b8d640 1 --2- 172.21.15.112:0/3763593895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c4100ee0 0x7f35c41012f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009e50 tx=0x7f35b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235baf27a3227f7c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:24.426 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.388+0000 7f35c8b8b640 1 -- 172.21.15.112:0/3763593895 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35b4031560 con 0x7f35c4100ee0 2024-09-19T09:26:24.426 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.388+0000 7f35c8b8b640 1 -- 172.21.15.112:0/3763593895 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f35b402d050 con 0x7f35c4100ee0 2024-09-19T09:26:24.426 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.388+0000 7f35c8b8b640 1 -- 172.21.15.112:0/3763593895 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35b40079b0 con 0x7f35c4100ee0 2024-09-19T09:26:24.426 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.388+0000 7f35cbdf1640 1 -- 172.21.15.112:0/3763593895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c4100ee0 msgr2=0x7f35c41012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:24.426 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.388+0000 7f35cbdf1640 1 --2- 172.21.15.112:0/3763593895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c4100ee0 0x7f35c41012f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009e50 tx=0x7f35b4009840 comp rx=0 tx=0).stop 2024-09-19T09:26:24.426 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.388+0000 7f35cbdf1640 1 -- 172.21.15.112:0/3763593895 shutdown_connections 2024-09-19T09:26:24.426 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.388+0000 7f35cbdf1640 1 --2- 172.21.15.112:0/3763593895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c4100ee0 0x7f35c41012f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.427 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.388+0000 7f35cbdf1640 1 -- 172.21.15.112:0/3763593895 >> 172.21.15.112:0/3763593895 conn(0x7f35c40fc620 msgr2=0x7f35c40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:24.427 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.388+0000 7f35cbdf1640 1 -- 172.21.15.112:0/3763593895 shutdown_connections 2024-09-19T09:26:24.427 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.388+0000 7f35cbdf1640 1 -- 172.21.15.112:0/3763593895 wait complete. 2024-09-19T09:26:24.427 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.389+0000 7f35cbdf1640 1 Processor -- start 2024-09-19T09:26:24.427 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.389+0000 7f35cbdf1640 1 -- start start 2024-09-19T09:26:24.427 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.389+0000 7f35cbdf1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c4100ee0 0x7f35c4110e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.427 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.389+0000 7f35cbdf1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c4111350 con 0x7f35c4100ee0 2024-09-19T09:26:24.427 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.389+0000 7f35c9b8d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c4100ee0 0x7f35c4110e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.427 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.389+0000 7f35c9b8d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c4100ee0 0x7f35c4110e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51358/0 (socket says 172.21.15.112:51358) 2024-09-19T09:26:24.427 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.389+0000 7f35c9b8d640 1 -- 172.21.15.112:0/1283964329 learned_addr learned my addr 172.21.15.112:0/1283964329 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:24.427 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.389+0000 7f35c9b8d640 1 -- 172.21.15.112:0/1283964329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4009ae0 con 0x7f35c4100ee0 2024-09-19T09:26:24.427 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.390+0000 7f35c9b8d640 1 --2- 172.21.15.112:0/1283964329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c4100ee0 0x7f35c4110e10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f35b4007030 tx=0x7f35b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:24.427 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.390+0000 7f35c27fc640 1 -- 172.21.15.112:0/1283964329 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35b4045430 con 0x7f35c4100ee0 2024-09-19T09:26:24.427 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.390+0000 7f35c27fc640 1 -- 172.21.15.112:0/1283964329 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f35b40459f0 con 0x7f35c4100ee0 2024-09-19T09:26:24.428 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.390+0000 7f35cbdf1640 1 -- 172.21.15.112:0/1283964329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c4111550 con 0x7f35c4100ee0 2024-09-19T09:26:24.428 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.390+0000 7f35c27fc640 1 -- 172.21.15.112:0/1283964329 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35b403a7f0 con 0x7f35c4100ee0 2024-09-19T09:26:24.428 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.390+0000 7f35cbdf1640 1 -- 172.21.15.112:0/1283964329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c4111fa0 con 0x7f35c4100ee0 2024-09-19T09:26:24.428 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.391+0000 7f35c27fc640 1 -- 172.21.15.112:0/1283964329 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f35b4038040 con 0x7f35c4100ee0 2024-09-19T09:26:24.428 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.391+0000 7f35c27fc640 1 --2- 172.21.15.112:0/1283964329 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f35ac0394e0 0x7f35ac03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.428 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.391+0000 7f35cbdf1640 1 -- 172.21.15.112:0/1283964329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c41002a0 con 0x7f35c4100ee0 2024-09-19T09:26:24.428 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.391+0000 7f35c27fc640 1 -- 172.21.15.112:0/1283964329 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f35b4040030 con 0x7f35c4100ee0 2024-09-19T09:26:24.428 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.391+0000 7f35c938c640 1 --2- 172.21.15.112:0/1283964329 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f35ac0394e0 0x7f35ac03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.428 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.391+0000 7f35c938c640 1 --2- 172.21.15.112:0/1283964329 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f35ac0394e0 0x7f35ac03b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f35b8006fd0 tx=0x7f35b8006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:24.428 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.396+0000 7f35c27fc640 1 -- 172.21.15.112:0/1283964329 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f35b404ee40 con 0x7f35c4100ee0 2024-09-19T09:26:24.428 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.560+0000 7f35cbdf1640 1 -- 172.21.15.112:0/1283964329 --> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f35c40fd870 con 0x7f35ac0394e0 2024-09-19T09:26:24.428 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.563+0000 7f35c27fc640 1 -- 172.21.15.112:0/1283964329 <== mgr.14116 v2:172.21.15.112:6800/1627571174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f35c40fd870 con 0x7f35ac0394e0 2024-09-19T09:26:24.428 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.566+0000 7f35cbdf1640 1 -- 172.21.15.112:0/1283964329 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f35ac0394e0 msgr2=0x7f35ac03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:24.429 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.566+0000 7f35cbdf1640 1 --2- 172.21.15.112:0/1283964329 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f35ac0394e0 0x7f35ac03b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f35b8006fd0 tx=0x7f35b8006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.429 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.566+0000 7f35cbdf1640 1 -- 172.21.15.112:0/1283964329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c4100ee0 msgr2=0x7f35c4110e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:24.429 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.566+0000 7f35cbdf1640 1 --2- 172.21.15.112:0/1283964329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c4100ee0 0x7f35c4110e10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f35b4007030 tx=0x7f35b4009840 comp rx=0 tx=0).stop 2024-09-19T09:26:24.429 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.566+0000 7f35cbdf1640 1 -- 172.21.15.112:0/1283964329 shutdown_connections 2024-09-19T09:26:24.429 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.566+0000 7f35cbdf1640 1 --2- 172.21.15.112:0/1283964329 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f35ac0394e0 0x7f35ac03b990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.429 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.566+0000 7f35cbdf1640 1 --2- 172.21.15.112:0/1283964329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c4100ee0 0x7f35c4110e10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.429 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.566+0000 7f35cbdf1640 1 -- 172.21.15.112:0/1283964329 >> 172.21.15.112:0/1283964329 conn(0x7f35c40fc620 msgr2=0x7f35c40fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:24.429 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.566+0000 7f35cbdf1640 1 -- 172.21.15.112:0/1283964329 shutdown_connections 2024-09-19T09:26:24.429 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:23.566+0000 7f35cbdf1640 1 -- 172.21.15.112:0/1283964329 wait complete. 2024-09-19T09:26:24.429 INFO:teuthology.orchestra.run.smithi112.stdout:Deploying crash service with default placement... 2024-09-19T09:26:24.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:24 smithi112 ceph-mon[27605]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:26:24.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:24 smithi112 ceph-mon[27605]: Saving service mgr spec with placement count:2 2024-09-19T09:26:24.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:24 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:24.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:24 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:25.840 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-19T09:26:25.840 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.826+0000 7f6e5afb0640 1 Processor -- start 2024-09-19T09:26:25.840 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.826+0000 7f6e5afb0640 1 -- start start 2024-09-19T09:26:25.840 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.827+0000 7f6e5afb0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e54102010 0x7f6e54102420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:25.840 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.827+0000 7f6e5afb0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54102960 con 0x7f6e54102010 2024-09-19T09:26:25.840 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.827+0000 7f6e58d4c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e54102010 0x7f6e54102420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:25.841 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.827+0000 7f6e58d4c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e54102010 0x7f6e54102420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51370/0 (socket says 172.21.15.112:51370) 2024-09-19T09:26:25.841 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.827+0000 7f6e58d4c640 1 -- 172.21.15.112:0/934903329 learned_addr learned my addr 172.21.15.112:0/934903329 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:25.841 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.827+0000 7f6e58d4c640 1 -- 172.21.15.112:0/934903329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e54102aa0 con 0x7f6e54102010 2024-09-19T09:26:25.841 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.828+0000 7f6e58d4c640 1 --2- 172.21.15.112:0/934903329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e54102010 0x7f6e54102420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009840 tx=0x7f6e500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805239b5ab4ede22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:25.841 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.828+0000 7f6e4b7fe640 1 -- 172.21.15.112:0/934903329 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e50032440 con 0x7f6e54102010 2024-09-19T09:26:25.841 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.828+0000 7f6e4b7fe640 1 -- 172.21.15.112:0/934903329 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6e50032a40 con 0x7f6e54102010 2024-09-19T09:26:25.841 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.828+0000 7f6e4b7fe640 1 -- 172.21.15.112:0/934903329 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e50031a70 con 0x7f6e54102010 2024-09-19T09:26:25.841 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.828+0000 7f6e5afb0640 1 -- 172.21.15.112:0/934903329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e54102010 msgr2=0x7f6e54102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:25.841 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.828+0000 7f6e5afb0640 1 --2- 172.21.15.112:0/934903329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e54102010 0x7f6e54102420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009840 tx=0x7f6e500091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:25.841 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.828+0000 7f6e5afb0640 1 -- 172.21.15.112:0/934903329 shutdown_connections 2024-09-19T09:26:25.841 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.828+0000 7f6e5afb0640 1 --2- 172.21.15.112:0/934903329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e54102010 0x7f6e54102420 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:25.841 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.828+0000 7f6e5afb0640 1 -- 172.21.15.112:0/934903329 >> 172.21.15.112:0/934903329 conn(0x7f6e540fd790 msgr2=0x7f6e540ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:25.842 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.828+0000 7f6e5afb0640 1 -- 172.21.15.112:0/934903329 shutdown_connections 2024-09-19T09:26:25.842 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.828+0000 7f6e5afb0640 1 -- 172.21.15.112:0/934903329 wait complete. 2024-09-19T09:26:25.842 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.829+0000 7f6e5afb0640 1 Processor -- start 2024-09-19T09:26:25.842 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.829+0000 7f6e5afb0640 1 -- start start 2024-09-19T09:26:25.842 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.829+0000 7f6e5afb0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e54102010 0x7f6e54110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:25.842 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.829+0000 7f6e5afb0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54111370 con 0x7f6e54102010 2024-09-19T09:26:25.842 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.829+0000 7f6e58d4c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e54102010 0x7f6e54110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:25.842 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.830+0000 7f6e58d4c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e54102010 0x7f6e54110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51384/0 (socket says 172.21.15.112:51384) 2024-09-19T09:26:25.842 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.830+0000 7f6e58d4c640 1 -- 172.21.15.112:0/1233087109 learned_addr learned my addr 172.21.15.112:0/1233087109 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:25.842 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.830+0000 7f6e58d4c640 1 -- 172.21.15.112:0/1233087109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e50009450 con 0x7f6e54102010 2024-09-19T09:26:25.843 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.830+0000 7f6e58d4c640 1 --2- 172.21.15.112:0/1233087109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e54102010 0x7f6e54110e30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6e50006a70 tx=0x7f6e500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:25.843 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.830+0000 7f6e497fa640 1 -- 172.21.15.112:0/1233087109 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e5003c400 con 0x7f6e54102010 2024-09-19T09:26:25.843 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.830+0000 7f6e497fa640 1 -- 172.21.15.112:0/1233087109 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6e5003ca00 con 0x7f6e54102010 2024-09-19T09:26:25.843 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.830+0000 7f6e5afb0640 1 -- 172.21.15.112:0/1233087109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e54111570 con 0x7f6e54102010 2024-09-19T09:26:25.843 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.830+0000 7f6e497fa640 1 -- 172.21.15.112:0/1233087109 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e5003a9a0 con 0x7f6e54102010 2024-09-19T09:26:25.843 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.830+0000 7f6e5afb0640 1 -- 172.21.15.112:0/1233087109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e54111fc0 con 0x7f6e54102010 2024-09-19T09:26:25.843 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.831+0000 7f6e497fa640 1 -- 172.21.15.112:0/1233087109 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f6e5003abd0 con 0x7f6e54102010 2024-09-19T09:26:25.843 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.831+0000 7f6e497fa640 1 --2- 172.21.15.112:0/1233087109 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f6e3c0394e0 0x7f6e3c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:25.843 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.831+0000 7f6e497fa640 1 -- 172.21.15.112:0/1233087109 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6e5006cee0 con 0x7f6e54102010 2024-09-19T09:26:25.843 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.831+0000 7f6e4bfff640 1 --2- 172.21.15.112:0/1233087109 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f6e3c0394e0 0x7f6e3c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:25.843 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.831+0000 7f6e5afb0640 1 -- 172.21.15.112:0/1233087109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e54101470 con 0x7f6e54102010 2024-09-19T09:26:25.843 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.832+0000 7f6e4bfff640 1 --2- 172.21.15.112:0/1233087109 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f6e3c0394e0 0x7f6e3c03b990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6e44006fd0 tx=0x7f6e44006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:25.843 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:24.836+0000 7f6e497fa640 1 -- 172.21.15.112:0/1233087109 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6e50037070 con 0x7f6e54102010 2024-09-19T09:26:25.844 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:25.011+0000 7f6e5afb0640 1 -- 172.21.15.112:0/1233087109 --> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e540feac0 con 0x7f6e3c0394e0 2024-09-19T09:26:25.844 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:25.018+0000 7f6e497fa640 1 -- 172.21.15.112:0/1233087109 <== mgr.14116 v2:172.21.15.112:6800/1627571174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f6e540feac0 con 0x7f6e3c0394e0 2024-09-19T09:26:25.844 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:25.019+0000 7f6e5afb0640 1 -- 172.21.15.112:0/1233087109 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f6e3c0394e0 msgr2=0x7f6e3c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:25.844 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:25.019+0000 7f6e5afb0640 1 --2- 172.21.15.112:0/1233087109 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f6e3c0394e0 0x7f6e3c03b990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6e44006fd0 tx=0x7f6e44006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:25.844 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:25.019+0000 7f6e5afb0640 1 -- 172.21.15.112:0/1233087109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e54102010 msgr2=0x7f6e54110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:25.844 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:25.019+0000 7f6e5afb0640 1 --2- 172.21.15.112:0/1233087109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e54102010 0x7f6e54110e30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6e50006a70 tx=0x7f6e500091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:25.844 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:25.020+0000 7f6e5afb0640 1 -- 172.21.15.112:0/1233087109 shutdown_connections 2024-09-19T09:26:25.844 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:25.020+0000 7f6e5afb0640 1 --2- 172.21.15.112:0/1233087109 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f6e3c0394e0 0x7f6e3c03b990 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:25.844 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:25.020+0000 7f6e5afb0640 1 --2- 172.21.15.112:0/1233087109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e54102010 0x7f6e54110e30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:25.844 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:25.020+0000 7f6e5afb0640 1 -- 172.21.15.112:0/1233087109 >> 172.21.15.112:0/1233087109 conn(0x7f6e540fd790 msgr2=0x7f6e540fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:25.844 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:25.020+0000 7f6e5afb0640 1 -- 172.21.15.112:0/1233087109 shutdown_connections 2024-09-19T09:26:25.844 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:25.020+0000 7f6e5afb0640 1 -- 172.21.15.112:0/1233087109 wait complete. 2024-09-19T09:26:25.844 INFO:teuthology.orchestra.run.smithi112.stdout:Deploying prometheus service with default placement... 2024-09-19T09:26:26.085 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:25 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:26.085 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:25 smithi112 ceph-mon[27605]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:26:26.085 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:25 smithi112 ceph-mon[27605]: Saving service crash spec with placement * 2024-09-19T09:26:26.085 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:25 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:27.642 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:27 smithi112 ceph-mon[27605]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:26:27.642 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:27 smithi112 ceph-mon[27605]: Saving service prometheus spec with placement count:1 2024-09-19T09:26:27.642 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:27 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:27.643 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:27 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:27.649 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-19T09:26:27.649 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.250+0000 7f34c84a3640 1 Processor -- start 2024-09-19T09:26:27.649 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.250+0000 7f34c84a3640 1 -- start start 2024-09-19T09:26:27.649 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.250+0000 7f34c84a3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34c0101f90 0x7f34c01023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.649 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.250+0000 7f34c84a3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c01028e0 con 0x7f34c0101f90 2024-09-19T09:26:27.649 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.250+0000 7f34c623f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34c0101f90 0x7f34c01023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.649 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.250+0000 7f34c623f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34c0101f90 0x7f34c01023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51386/0 (socket says 172.21.15.112:51386) 2024-09-19T09:26:27.650 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.250+0000 7f34c623f640 1 -- 172.21.15.112:0/1535500396 learned_addr learned my addr 172.21.15.112:0/1535500396 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:27.650 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.251+0000 7f34c623f640 1 -- 172.21.15.112:0/1535500396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c0102a20 con 0x7f34c0101f90 2024-09-19T09:26:27.650 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.251+0000 7f34c623f640 1 --2- 172.21.15.112:0/1535500396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34c0101f90 0x7f34c01023a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009840 tx=0x7f34bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa8a609a1ba9e15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:27.650 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.251+0000 7f34c523d640 1 -- 172.21.15.112:0/1535500396 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34bc032440 con 0x7f34c0101f90 2024-09-19T09:26:27.650 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.251+0000 7f34c523d640 1 -- 172.21.15.112:0/1535500396 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f34bc032a40 con 0x7f34c0101f90 2024-09-19T09:26:27.650 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.251+0000 7f34c523d640 1 -- 172.21.15.112:0/1535500396 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34bc031a70 con 0x7f34c0101f90 2024-09-19T09:26:27.650 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.252+0000 7f34c84a3640 1 -- 172.21.15.112:0/1535500396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34c0101f90 msgr2=0x7f34c01023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:27.650 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.252+0000 7f34c84a3640 1 --2- 172.21.15.112:0/1535500396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34c0101f90 0x7f34c01023a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009840 tx=0x7f34bc0091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.650 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.252+0000 7f34c84a3640 1 -- 172.21.15.112:0/1535500396 shutdown_connections 2024-09-19T09:26:27.651 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.252+0000 7f34c84a3640 1 --2- 172.21.15.112:0/1535500396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34c0101f90 0x7f34c01023a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.651 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.252+0000 7f34c84a3640 1 -- 172.21.15.112:0/1535500396 >> 172.21.15.112:0/1535500396 conn(0x7f34c00fd710 msgr2=0x7f34c00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:27.651 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.252+0000 7f34c84a3640 1 -- 172.21.15.112:0/1535500396 shutdown_connections 2024-09-19T09:26:27.651 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.252+0000 7f34c84a3640 1 -- 172.21.15.112:0/1535500396 wait complete. 2024-09-19T09:26:27.651 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.252+0000 7f34c84a3640 1 Processor -- start 2024-09-19T09:26:27.651 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.253+0000 7f34c84a3640 1 -- start start 2024-09-19T09:26:27.651 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.253+0000 7f34c84a3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34c0101f90 0x7f34c0110d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.651 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.253+0000 7f34c84a3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c0111260 con 0x7f34c0101f90 2024-09-19T09:26:27.651 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.253+0000 7f34c623f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34c0101f90 0x7f34c0110d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.651 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.253+0000 7f34c623f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34c0101f90 0x7f34c0110d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51398/0 (socket says 172.21.15.112:51398) 2024-09-19T09:26:27.651 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.253+0000 7f34c623f640 1 -- 172.21.15.112:0/2354152688 learned_addr learned my addr 172.21.15.112:0/2354152688 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:27.651 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.253+0000 7f34c623f640 1 -- 172.21.15.112:0/2354152688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc009450 con 0x7f34c0101f90 2024-09-19T09:26:27.651 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.253+0000 7f34c623f640 1 --2- 172.21.15.112:0/2354152688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34c0101f90 0x7f34c0110d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f34bc006a70 tx=0x7f34bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:27.651 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.253+0000 7f34b6ffd640 1 -- 172.21.15.112:0/2354152688 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34bc03c400 con 0x7f34c0101f90 2024-09-19T09:26:27.652 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.253+0000 7f34b6ffd640 1 -- 172.21.15.112:0/2354152688 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f34bc03ca00 con 0x7f34c0101f90 2024-09-19T09:26:27.652 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.253+0000 7f34c84a3640 1 -- 172.21.15.112:0/2354152688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c0111460 con 0x7f34c0101f90 2024-09-19T09:26:27.652 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.253+0000 7f34b6ffd640 1 -- 172.21.15.112:0/2354152688 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34bc03a9a0 con 0x7f34c0101f90 2024-09-19T09:26:27.652 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.253+0000 7f34c84a3640 1 -- 172.21.15.112:0/2354152688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c01118d0 con 0x7f34c0101f90 2024-09-19T09:26:27.652 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.254+0000 7f34b6ffd640 1 -- 172.21.15.112:0/2354152688 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f34bc03ac20 con 0x7f34c0101f90 2024-09-19T09:26:27.652 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.254+0000 7f34b6ffd640 1 --2- 172.21.15.112:0/2354152688 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f34ac039490 0x7f34ac03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.652 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.254+0000 7f34b6ffd640 1 -- 172.21.15.112:0/2354152688 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f34bc06ce30 con 0x7f34c0101f90 2024-09-19T09:26:27.652 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.254+0000 7f34c84a3640 1 -- 172.21.15.112:0/2354152688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c01013f0 con 0x7f34c0101f90 2024-09-19T09:26:27.652 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.254+0000 7f34c5a3e640 1 --2- 172.21.15.112:0/2354152688 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f34ac039490 0x7f34ac03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.652 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.255+0000 7f34c5a3e640 1 --2- 172.21.15.112:0/2354152688 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f34ac039490 0x7f34ac03b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f34b0006fd0 tx=0x7f34b0006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:27.652 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.259+0000 7f34b6ffd640 1 -- 172.21.15.112:0/2354152688 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f34bc037070 con 0x7f34c0101f90 2024-09-19T09:26:27.652 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.432+0000 7f34c84a3640 1 -- 172.21.15.112:0/2354152688 --> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f34c00fe970 con 0x7f34ac039490 2024-09-19T09:26:27.653 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.437+0000 7f34b6ffd640 1 -- 172.21.15.112:0/2354152688 <== mgr.14116 v2:172.21.15.112:6800/1627571174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f34c00fe970 con 0x7f34ac039490 2024-09-19T09:26:27.653 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.439+0000 7f34c84a3640 1 -- 172.21.15.112:0/2354152688 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f34ac039490 msgr2=0x7f34ac03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:27.653 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.439+0000 7f34c84a3640 1 --2- 172.21.15.112:0/2354152688 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f34ac039490 0x7f34ac03b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f34b0006fd0 tx=0x7f34b0006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.653 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.439+0000 7f34c84a3640 1 -- 172.21.15.112:0/2354152688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34c0101f90 msgr2=0x7f34c0110d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:27.653 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.439+0000 7f34c84a3640 1 --2- 172.21.15.112:0/2354152688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34c0101f90 0x7f34c0110d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f34bc006a70 tx=0x7f34bc0091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.653 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.439+0000 7f34c84a3640 1 -- 172.21.15.112:0/2354152688 shutdown_connections 2024-09-19T09:26:27.653 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.439+0000 7f34c84a3640 1 --2- 172.21.15.112:0/2354152688 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f34ac039490 0x7f34ac03b940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.653 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.439+0000 7f34c84a3640 1 --2- 172.21.15.112:0/2354152688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34c0101f90 0x7f34c0110d20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.653 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.439+0000 7f34c84a3640 1 -- 172.21.15.112:0/2354152688 >> 172.21.15.112:0/2354152688 conn(0x7f34c00fd710 msgr2=0x7f34c00fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:27.653 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.439+0000 7f34c84a3640 1 -- 172.21.15.112:0/2354152688 shutdown_connections 2024-09-19T09:26:27.653 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:26.439+0000 7f34c84a3640 1 -- 172.21.15.112:0/2354152688 wait complete. 2024-09-19T09:26:27.653 INFO:teuthology.orchestra.run.smithi112.stdout:Deploying grafana service with default placement... 2024-09-19T09:26:28.908 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-19T09:26:28.909 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.050+0000 7f226dca2640 1 Processor -- start 2024-09-19T09:26:28.909 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.050+0000 7f226dca2640 1 -- start start 2024-09-19T09:26:28.909 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.050+0000 7f226dca2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2268101f90 0x7f22681023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:28.909 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.050+0000 7f226dca2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22681028e0 con 0x7f2268101f90 2024-09-19T09:26:28.909 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.050+0000 7f22677fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2268101f90 0x7f22681023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:28.909 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.050+0000 7f22677fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2268101f90 0x7f22681023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51402/0 (socket says 172.21.15.112:51402) 2024-09-19T09:26:28.909 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.050+0000 7f22677fe640 1 -- 172.21.15.112:0/305929722 learned_addr learned my addr 172.21.15.112:0/305929722 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:28.909 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.050+0000 7f22677fe640 1 -- 172.21.15.112:0/305929722 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2268102a20 con 0x7f2268101f90 2024-09-19T09:26:28.910 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.051+0000 7f22677fe640 1 --2- 172.21.15.112:0/305929722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2268101f90 0x7f22681023a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f225800fa00 tx=0x7f22580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9e1f877bdad3fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:28.910 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.051+0000 7f2266ffd640 1 -- 172.21.15.112:0/305929722 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2258033670 con 0x7f2268101f90 2024-09-19T09:26:28.910 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.051+0000 7f2266ffd640 1 -- 172.21.15.112:0/305929722 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2258031050 con 0x7f2268101f90 2024-09-19T09:26:28.910 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.051+0000 7f2266ffd640 1 -- 172.21.15.112:0/305929722 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2258035c20 con 0x7f2268101f90 2024-09-19T09:26:28.910 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.052+0000 7f226dca2640 1 -- 172.21.15.112:0/305929722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2268101f90 msgr2=0x7f22681023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:28.910 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.052+0000 7f226dca2640 1 --2- 172.21.15.112:0/305929722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2268101f90 0x7f22681023a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f225800fa00 tx=0x7f22580091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:28.910 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.052+0000 7f226dca2640 1 -- 172.21.15.112:0/305929722 shutdown_connections 2024-09-19T09:26:28.910 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.052+0000 7f226dca2640 1 --2- 172.21.15.112:0/305929722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2268101f90 0x7f22681023a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:28.910 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.052+0000 7f226dca2640 1 -- 172.21.15.112:0/305929722 >> 172.21.15.112:0/305929722 conn(0x7f22680fd710 msgr2=0x7f22680ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:28.910 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.052+0000 7f226dca2640 1 -- 172.21.15.112:0/305929722 shutdown_connections 2024-09-19T09:26:28.910 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.052+0000 7f226dca2640 1 -- 172.21.15.112:0/305929722 wait complete. 2024-09-19T09:26:28.910 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.052+0000 7f226dca2640 1 Processor -- start 2024-09-19T09:26:28.910 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.052+0000 7f226dca2640 1 -- start start 2024-09-19T09:26:28.911 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.053+0000 7f226dca2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2268101f90 0x7f226810eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:28.911 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.053+0000 7f226dca2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226810f0b0 con 0x7f2268101f90 2024-09-19T09:26:28.911 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.053+0000 7f22677fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2268101f90 0x7f226810eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:28.911 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.053+0000 7f22677fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2268101f90 0x7f226810eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51416/0 (socket says 172.21.15.112:51416) 2024-09-19T09:26:28.911 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.053+0000 7f22677fe640 1 -- 172.21.15.112:0/773951061 learned_addr learned my addr 172.21.15.112:0/773951061 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:28.911 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.053+0000 7f22677fe640 1 -- 172.21.15.112:0/773951061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225800f610 con 0x7f2268101f90 2024-09-19T09:26:28.911 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.053+0000 7f22677fe640 1 --2- 172.21.15.112:0/773951061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2268101f90 0x7f226810eb70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2258006f00 tx=0x7f22580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:28.911 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.053+0000 7f2264ff9640 1 -- 172.21.15.112:0/773951061 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f225803e430 con 0x7f2268101f90 2024-09-19T09:26:28.911 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.053+0000 7f226dca2640 1 -- 172.21.15.112:0/773951061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226810f2b0 con 0x7f2268101f90 2024-09-19T09:26:28.911 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.053+0000 7f2264ff9640 1 -- 172.21.15.112:0/773951061 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f225803ea30 con 0x7f2268101f90 2024-09-19T09:26:28.911 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.053+0000 7f2264ff9640 1 -- 172.21.15.112:0/773951061 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f225803d960 con 0x7f2268101f90 2024-09-19T09:26:28.911 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.053+0000 7f226dca2640 1 -- 172.21.15.112:0/773951061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226810f720 con 0x7f2268101f90 2024-09-19T09:26:28.911 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.054+0000 7f2264ff9640 1 -- 172.21.15.112:0/773951061 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f225803dc20 con 0x7f2268101f90 2024-09-19T09:26:28.912 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.054+0000 7f2264ff9640 1 --2- 172.21.15.112:0/773951061 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f2254039490 0x7f225403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:28.912 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.054+0000 7f226dca2640 1 -- 172.21.15.112:0/773951061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226804b720 con 0x7f2268101f90 2024-09-19T09:26:28.912 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.054+0000 7f2264ff9640 1 -- 172.21.15.112:0/773951061 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2258070fa0 con 0x7f2268101f90 2024-09-19T09:26:28.912 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.054+0000 7f225ffff640 1 --2- 172.21.15.112:0/773951061 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f2254039490 0x7f225403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:28.912 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.055+0000 7f225ffff640 1 --2- 172.21.15.112:0/773951061 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f2254039490 0x7f225403b940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2250006fd0 tx=0x7f2250006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:28.912 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.059+0000 7f2264ff9640 1 -- 172.21.15.112:0/773951061 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f22580343a0 con 0x7f2268101f90 2024-09-19T09:26:28.912 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.249+0000 7f226dca2640 1 -- 172.21.15.112:0/773951061 --> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f22680feb80 con 0x7f2254039490 2024-09-19T09:26:28.912 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.254+0000 7f2264ff9640 1 -- 172.21.15.112:0/773951061 <== mgr.14116 v2:172.21.15.112:6800/1627571174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f22680feb80 con 0x7f2254039490 2024-09-19T09:26:28.912 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.255+0000 7f226dca2640 1 -- 172.21.15.112:0/773951061 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f2254039490 msgr2=0x7f225403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:28.912 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.255+0000 7f226dca2640 1 --2- 172.21.15.112:0/773951061 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f2254039490 0x7f225403b940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2250006fd0 tx=0x7f2250006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:28.912 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.256+0000 7f226dca2640 1 -- 172.21.15.112:0/773951061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2268101f90 msgr2=0x7f226810eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:28.912 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.256+0000 7f226dca2640 1 --2- 172.21.15.112:0/773951061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2268101f90 0x7f226810eb70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2258006f00 tx=0x7f22580091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:28.913 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.256+0000 7f226dca2640 1 -- 172.21.15.112:0/773951061 shutdown_connections 2024-09-19T09:26:28.913 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.256+0000 7f226dca2640 1 --2- 172.21.15.112:0/773951061 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f2254039490 0x7f225403b940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:28.913 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.256+0000 7f226dca2640 1 --2- 172.21.15.112:0/773951061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2268101f90 0x7f226810eb70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:28.913 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.256+0000 7f226dca2640 1 -- 172.21.15.112:0/773951061 >> 172.21.15.112:0/773951061 conn(0x7f22680fd710 msgr2=0x7f22680fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:28.913 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.256+0000 7f226dca2640 1 -- 172.21.15.112:0/773951061 shutdown_connections 2024-09-19T09:26:28.913 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:28.256+0000 7f226dca2640 1 -- 172.21.15.112:0/773951061 wait complete. 2024-09-19T09:26:28.913 INFO:teuthology.orchestra.run.smithi112.stdout:Deploying node-exporter service with default placement... 2024-09-19T09:26:29.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:29 smithi112 ceph-mon[27605]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:26:29.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:29 smithi112 ceph-mon[27605]: Saving service grafana spec with placement count:1 2024-09-19T09:26:29.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:29 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:30.078 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-19T09:26:30.078 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.279+0000 7fc731fc1640 1 Processor -- start 2024-09-19T09:26:30.078 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.279+0000 7fc731fc1640 1 -- start start 2024-09-19T09:26:30.078 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.279+0000 7fc731fc1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c101f80 0x7fc72c102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.079 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.279+0000 7fc731fc1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c1028d0 con 0x7fc72c101f80 2024-09-19T09:26:30.079 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.280+0000 7fc72b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c101f80 0x7fc72c102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.079 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.280+0000 7fc72b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c101f80 0x7fc72c102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41160/0 (socket says 172.21.15.112:41160) 2024-09-19T09:26:30.079 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.280+0000 7fc72b7fe640 1 -- 172.21.15.112:0/2711692787 learned_addr learned my addr 172.21.15.112:0/2711692787 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:30.079 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.280+0000 7fc72b7fe640 1 -- 172.21.15.112:0/2711692787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c102a10 con 0x7fc72c101f80 2024-09-19T09:26:30.079 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.281+0000 7fc72b7fe640 1 --2- 172.21.15.112:0/2711692787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c101f80 0x7fc72c102390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009840 tx=0x7fc71c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623aeb938b964024 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:30.079 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.281+0000 7fc72a7fc640 1 -- 172.21.15.112:0/2711692787 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc71c032440 con 0x7fc72c101f80 2024-09-19T09:26:30.079 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.281+0000 7fc72a7fc640 1 -- 172.21.15.112:0/2711692787 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc71c032a40 con 0x7fc72c101f80 2024-09-19T09:26:30.079 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.281+0000 7fc72a7fc640 1 -- 172.21.15.112:0/2711692787 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc71c031a70 con 0x7fc72c101f80 2024-09-19T09:26:30.079 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.281+0000 7fc731fc1640 1 -- 172.21.15.112:0/2711692787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c101f80 msgr2=0x7fc72c102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:30.079 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.281+0000 7fc731fc1640 1 --2- 172.21.15.112:0/2711692787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c101f80 0x7fc72c102390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009840 tx=0x7fc71c0091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.079 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.281+0000 7fc731fc1640 1 -- 172.21.15.112:0/2711692787 shutdown_connections 2024-09-19T09:26:30.080 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.281+0000 7fc731fc1640 1 --2- 172.21.15.112:0/2711692787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c101f80 0x7fc72c102390 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.080 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.281+0000 7fc731fc1640 1 -- 172.21.15.112:0/2711692787 >> 172.21.15.112:0/2711692787 conn(0x7fc72c0fd7a0 msgr2=0x7fc72c0ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:30.080 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.281+0000 7fc731fc1640 1 -- 172.21.15.112:0/2711692787 shutdown_connections 2024-09-19T09:26:30.080 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.281+0000 7fc731fc1640 1 -- 172.21.15.112:0/2711692787 wait complete. 2024-09-19T09:26:30.080 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.282+0000 7fc731fc1640 1 Processor -- start 2024-09-19T09:26:30.080 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.282+0000 7fc731fc1640 1 -- start start 2024-09-19T09:26:30.080 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.282+0000 7fc731fc1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c101f80 0x7fc72c078c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.080 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.282+0000 7fc731fc1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c079140 con 0x7fc72c101f80 2024-09-19T09:26:30.080 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.282+0000 7fc72b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c101f80 0x7fc72c078c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.080 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.282+0000 7fc72b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c101f80 0x7fc72c078c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41164/0 (socket says 172.21.15.112:41164) 2024-09-19T09:26:30.080 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.282+0000 7fc72b7fe640 1 -- 172.21.15.112:0/238639464 learned_addr learned my addr 172.21.15.112:0/238639464 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:30.080 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.283+0000 7fc72b7fe640 1 -- 172.21.15.112:0/238639464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c009450 con 0x7fc72c101f80 2024-09-19T09:26:30.080 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.283+0000 7fc72b7fe640 1 --2- 172.21.15.112:0/238639464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c101f80 0x7fc72c078c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009420 tx=0x7fc71c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:30.081 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.283+0000 7fc713fff640 1 -- 172.21.15.112:0/238639464 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc71c03c400 con 0x7fc72c101f80 2024-09-19T09:26:30.081 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.283+0000 7fc731fc1640 1 -- 172.21.15.112:0/238639464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72c0771d0 con 0x7fc72c101f80 2024-09-19T09:26:30.081 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.283+0000 7fc713fff640 1 -- 172.21.15.112:0/238639464 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc71c03ca00 con 0x7fc72c101f80 2024-09-19T09:26:30.081 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.283+0000 7fc713fff640 1 -- 172.21.15.112:0/238639464 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc71c03a850 con 0x7fc72c101f80 2024-09-19T09:26:30.081 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.283+0000 7fc731fc1640 1 -- 172.21.15.112:0/238639464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72c077640 con 0x7fc72c101f80 2024-09-19T09:26:30.081 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.284+0000 7fc713fff640 1 -- 172.21.15.112:0/238639464 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fc71c03ab10 con 0x7fc72c101f80 2024-09-19T09:26:30.081 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.284+0000 7fc731fc1640 1 -- 172.21.15.112:0/238639464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72c103d50 con 0x7fc72c101f80 2024-09-19T09:26:30.081 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.284+0000 7fc713fff640 1 --2- 172.21.15.112:0/238639464 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fc714039490 0x7fc71403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.081 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.284+0000 7fc713fff640 1 -- 172.21.15.112:0/238639464 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc71c06cee0 con 0x7fc72c101f80 2024-09-19T09:26:30.081 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.284+0000 7fc72affd640 1 --2- 172.21.15.112:0/238639464 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fc714039490 0x7fc71403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.081 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.284+0000 7fc72affd640 1 --2- 172.21.15.112:0/238639464 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fc714039490 0x7fc71403b940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc720006fd0 tx=0x7fc720006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:30.081 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.288+0000 7fc713fff640 1 -- 172.21.15.112:0/238639464 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc71c030570 con 0x7fc72c101f80 2024-09-19T09:26:30.081 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.461+0000 7fc731fc1640 1 -- 172.21.15.112:0/238639464 --> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fc72c0febe0 con 0x7fc714039490 2024-09-19T09:26:30.081 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.466+0000 7fc713fff640 1 -- 172.21.15.112:0/238639464 <== mgr.14116 v2:172.21.15.112:6800/1627571174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fc72c0febe0 con 0x7fc714039490 2024-09-19T09:26:30.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.467+0000 7fc731fc1640 1 -- 172.21.15.112:0/238639464 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fc714039490 msgr2=0x7fc71403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:30.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.467+0000 7fc731fc1640 1 --2- 172.21.15.112:0/238639464 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fc714039490 0x7fc71403b940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc720006fd0 tx=0x7fc720006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.467+0000 7fc731fc1640 1 -- 172.21.15.112:0/238639464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c101f80 msgr2=0x7fc72c078c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:30.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.467+0000 7fc731fc1640 1 --2- 172.21.15.112:0/238639464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c101f80 0x7fc72c078c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009420 tx=0x7fc71c0091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.468+0000 7fc731fc1640 1 -- 172.21.15.112:0/238639464 shutdown_connections 2024-09-19T09:26:30.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.468+0000 7fc731fc1640 1 --2- 172.21.15.112:0/238639464 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fc714039490 0x7fc71403b940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.468+0000 7fc731fc1640 1 --2- 172.21.15.112:0/238639464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c101f80 0x7fc72c078c00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.468+0000 7fc731fc1640 1 -- 172.21.15.112:0/238639464 >> 172.21.15.112:0/238639464 conn(0x7fc72c0fd7a0 msgr2=0x7fc72c0fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:30.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.468+0000 7fc731fc1640 1 -- 172.21.15.112:0/238639464 shutdown_connections 2024-09-19T09:26:30.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:29.468+0000 7fc731fc1640 1 -- 172.21.15.112:0/238639464 wait complete. 2024-09-19T09:26:30.082 INFO:teuthology.orchestra.run.smithi112.stdout:Deploying alertmanager service with default placement... 2024-09-19T09:26:30.646 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:30 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:30.646 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:30 smithi112 ceph-mon[27605]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:26:30.646 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:30 smithi112 ceph-mon[27605]: Saving service node-exporter spec with placement * 2024-09-19T09:26:30.646 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:30 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:31.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:31 smithi112 ceph-mon[27605]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:26:31.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:31 smithi112 ceph-mon[27605]: Saving service alertmanager spec with placement count:1 2024-09-19T09:26:31.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:31 smithi112 ceph-mon[27605]: from='mgr.14116 172.21.15.112:0/71622330' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:31.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:31 smithi112 ceph-mon[27605]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:26:32.250 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-19T09:26:32.250 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.463+0000 7fe59360c640 1 Processor -- start 2024-09-19T09:26:32.250 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.463+0000 7fe59360c640 1 -- start start 2024-09-19T09:26:32.250 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.463+0000 7fe59360c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe58c078b40 0x7fe58c077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:32.250 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.463+0000 7fe59360c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c078fe0 con 0x7fe58c078b40 2024-09-19T09:26:32.250 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.464+0000 7fe5913a8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe58c078b40 0x7fe58c077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:32.250 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.464+0000 7fe5913a8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe58c078b40 0x7fe58c077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41180/0 (socket says 172.21.15.112:41180) 2024-09-19T09:26:32.250 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.464+0000 7fe5913a8640 1 -- 172.21.15.112:0/2141762420 learned_addr learned my addr 172.21.15.112:0/2141762420 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:32.250 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.464+0000 7fe5913a8640 1 -- 172.21.15.112:0/2141762420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c079120 con 0x7fe58c078b40 2024-09-19T09:26:32.250 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.464+0000 7fe5913a8640 1 --2- 172.21.15.112:0/2141762420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe58c078b40 0x7fe58c077250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009840 tx=0x7fe57c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673b921652fb2e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:32.251 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.465+0000 7fe58bfff640 1 -- 172.21.15.112:0/2141762420 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe57c032440 con 0x7fe58c078b40 2024-09-19T09:26:32.251 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.465+0000 7fe58bfff640 1 -- 172.21.15.112:0/2141762420 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe57c032a40 con 0x7fe58c078b40 2024-09-19T09:26:32.251 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.465+0000 7fe58bfff640 1 -- 172.21.15.112:0/2141762420 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe57c031a70 con 0x7fe58c078b40 2024-09-19T09:26:32.251 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.465+0000 7fe59360c640 1 -- 172.21.15.112:0/2141762420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe58c078b40 msgr2=0x7fe58c077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:32.251 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.465+0000 7fe59360c640 1 --2- 172.21.15.112:0/2141762420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe58c078b40 0x7fe58c077250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009840 tx=0x7fe57c0091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:32.251 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.465+0000 7fe59360c640 1 -- 172.21.15.112:0/2141762420 shutdown_connections 2024-09-19T09:26:32.251 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.465+0000 7fe59360c640 1 --2- 172.21.15.112:0/2141762420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe58c078b40 0x7fe58c077250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:32.251 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.465+0000 7fe59360c640 1 -- 172.21.15.112:0/2141762420 >> 172.21.15.112:0/2141762420 conn(0x7fe58c0fd880 msgr2=0x7fe58c0ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:32.251 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.465+0000 7fe59360c640 1 -- 172.21.15.112:0/2141762420 shutdown_connections 2024-09-19T09:26:32.251 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.465+0000 7fe59360c640 1 -- 172.21.15.112:0/2141762420 wait complete. 2024-09-19T09:26:32.251 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.466+0000 7fe59360c640 1 Processor -- start 2024-09-19T09:26:32.251 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.466+0000 7fe59360c640 1 -- start start 2024-09-19T09:26:32.251 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.466+0000 7fe59360c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe58c078b40 0x7fe58c113020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:32.252 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.466+0000 7fe59360c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c113560 con 0x7fe58c078b40 2024-09-19T09:26:32.252 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.466+0000 7fe5913a8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe58c078b40 0x7fe58c113020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:32.252 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.466+0000 7fe5913a8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe58c078b40 0x7fe58c113020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41182/0 (socket says 172.21.15.112:41182) 2024-09-19T09:26:32.252 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.466+0000 7fe5913a8640 1 -- 172.21.15.112:0/4070946410 learned_addr learned my addr 172.21.15.112:0/4070946410 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:32.252 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.466+0000 7fe5913a8640 1 -- 172.21.15.112:0/4070946410 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c009450 con 0x7fe58c078b40 2024-09-19T09:26:32.252 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.466+0000 7fe5913a8640 1 --2- 172.21.15.112:0/4070946410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe58c078b40 0x7fe58c113020 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009420 tx=0x7fe57c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:32.252 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.467+0000 7fe589ffb640 1 -- 172.21.15.112:0/4070946410 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe57c03b470 con 0x7fe58c078b40 2024-09-19T09:26:32.252 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.467+0000 7fe589ffb640 1 -- 172.21.15.112:0/4070946410 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe57c03ba70 con 0x7fe58c078b40 2024-09-19T09:26:32.252 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.467+0000 7fe59360c640 1 -- 172.21.15.112:0/4070946410 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58c113760 con 0x7fe58c078b40 2024-09-19T09:26:32.252 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.467+0000 7fe589ffb640 1 -- 172.21.15.112:0/4070946410 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe57c03a930 con 0x7fe58c078b40 2024-09-19T09:26:32.252 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.467+0000 7fe59360c640 1 -- 172.21.15.112:0/4070946410 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58c113bd0 con 0x7fe58c078b40 2024-09-19T09:26:32.252 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.468+0000 7fe589ffb640 1 -- 172.21.15.112:0/4070946410 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fe57c03bbe0 con 0x7fe58c078b40 2024-09-19T09:26:32.252 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.468+0000 7fe59360c640 1 -- 172.21.15.112:0/4070946410 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe58c04b720 con 0x7fe58c078b40 2024-09-19T09:26:32.252 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.468+0000 7fe589ffb640 1 --2- 172.21.15.112:0/4070946410 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fe574039490 0x7fe57403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:32.253 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.468+0000 7fe589ffb640 1 -- 172.21.15.112:0/4070946410 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe57c06cd30 con 0x7fe58c078b40 2024-09-19T09:26:32.253 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.468+0000 7fe590ba7640 1 --2- 172.21.15.112:0/4070946410 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fe574039490 0x7fe57403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:32.253 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.468+0000 7fe590ba7640 1 --2- 172.21.15.112:0/4070946410 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fe574039490 0x7fe57403b940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe580006fd0 tx=0x7fe580006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:32.253 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.472+0000 7fe589ffb640 1 -- 172.21.15.112:0/4070946410 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe57c04c350 con 0x7fe58c078b40 2024-09-19T09:26:32.253 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.644+0000 7fe59360c640 1 -- 172.21.15.112:0/4070946410 --> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fe58c079120 con 0x7fe574039490 2024-09-19T09:26:32.253 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.649+0000 7fe589ffb640 1 -- 172.21.15.112:0/4070946410 <== mgr.14116 v2:172.21.15.112:6800/1627571174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fe58c079120 con 0x7fe574039490 2024-09-19T09:26:32.253 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.651+0000 7fe59360c640 1 -- 172.21.15.112:0/4070946410 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fe574039490 msgr2=0x7fe57403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:32.253 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.651+0000 7fe59360c640 1 --2- 172.21.15.112:0/4070946410 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fe574039490 0x7fe57403b940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe580006fd0 tx=0x7fe580006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:32.253 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.651+0000 7fe59360c640 1 -- 172.21.15.112:0/4070946410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe58c078b40 msgr2=0x7fe58c113020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:32.253 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.651+0000 7fe59360c640 1 --2- 172.21.15.112:0/4070946410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe58c078b40 0x7fe58c113020 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009420 tx=0x7fe57c0091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:32.253 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.651+0000 7fe59360c640 1 -- 172.21.15.112:0/4070946410 shutdown_connections 2024-09-19T09:26:32.253 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.651+0000 7fe59360c640 1 --2- 172.21.15.112:0/4070946410 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fe574039490 0x7fe57403b940 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:32.254 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.651+0000 7fe59360c640 1 --2- 172.21.15.112:0/4070946410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe58c078b40 0x7fe58c113020 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:32.254 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.651+0000 7fe59360c640 1 -- 172.21.15.112:0/4070946410 >> 172.21.15.112:0/4070946410 conn(0x7fe58c0fd880 msgr2=0x7fe58c0fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:32.254 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.651+0000 7fe59360c640 1 -- 172.21.15.112:0/4070946410 shutdown_connections 2024-09-19T09:26:32.254 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:30.652+0000 7fe59360c640 1 -- 172.21.15.112:0/4070946410 wait complete. 2024-09-19T09:26:33.465 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.739+0000 7f64d6575640 1 Processor -- start 2024-09-19T09:26:33.466 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.739+0000 7f64d6575640 1 -- start start 2024-09-19T09:26:33.466 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.739+0000 7f64d6575640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64d0102070 0x7f64d0102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:33.466 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.739+0000 7f64d6575640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d01029c0 con 0x7f64d0102070 2024-09-19T09:26:33.466 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.740+0000 7f64cffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64d0102070 0x7f64d0102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:33.466 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.740+0000 7f64cffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64d0102070 0x7f64d0102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41186/0 (socket says 172.21.15.112:41186) 2024-09-19T09:26:33.466 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.740+0000 7f64cffff640 1 -- 172.21.15.112:0/381859550 learned_addr learned my addr 172.21.15.112:0/381859550 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:33.466 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.740+0000 7f64cffff640 1 -- 172.21.15.112:0/381859550 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d0102b00 con 0x7f64d0102070 2024-09-19T09:26:33.466 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.741+0000 7f64cffff640 1 --2- 172.21.15.112:0/381859550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64d0102070 0x7f64d0102480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009840 tx=0x7f64c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222863690a8c1db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:33.466 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.741+0000 7f64ceffd640 1 -- 172.21.15.112:0/381859550 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64c0032440 con 0x7f64d0102070 2024-09-19T09:26:33.466 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.741+0000 7f64ceffd640 1 -- 172.21.15.112:0/381859550 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f64c0032a40 con 0x7f64d0102070 2024-09-19T09:26:33.466 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.741+0000 7f64ceffd640 1 -- 172.21.15.112:0/381859550 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64c0031aa0 con 0x7f64d0102070 2024-09-19T09:26:33.466 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.742+0000 7f64d6575640 1 -- 172.21.15.112:0/381859550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64d0102070 msgr2=0x7f64d0102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:33.467 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.742+0000 7f64d6575640 1 --2- 172.21.15.112:0/381859550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64d0102070 0x7f64d0102480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009840 tx=0x7f64c00091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:33.467 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.742+0000 7f64d6575640 1 -- 172.21.15.112:0/381859550 shutdown_connections 2024-09-19T09:26:33.467 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.742+0000 7f64d6575640 1 --2- 172.21.15.112:0/381859550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64d0102070 0x7f64d0102480 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:33.467 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.742+0000 7f64d6575640 1 -- 172.21.15.112:0/381859550 >> 172.21.15.112:0/381859550 conn(0x7f64d00fd850 msgr2=0x7f64d00ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:33.467 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.742+0000 7f64d6575640 1 -- 172.21.15.112:0/381859550 shutdown_connections 2024-09-19T09:26:33.467 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.742+0000 7f64d6575640 1 -- 172.21.15.112:0/381859550 wait complete. 2024-09-19T09:26:33.467 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.742+0000 7f64d6575640 1 Processor -- start 2024-09-19T09:26:33.467 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.742+0000 7f64d6575640 1 -- start start 2024-09-19T09:26:33.467 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.743+0000 7f64d6575640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64d0102070 0x7f64d0078c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:33.467 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.743+0000 7f64d6575640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d0079140 con 0x7f64d0102070 2024-09-19T09:26:33.467 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.743+0000 7f64cffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64d0102070 0x7f64d0078c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:33.467 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.743+0000 7f64cffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64d0102070 0x7f64d0078c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41200/0 (socket says 172.21.15.112:41200) 2024-09-19T09:26:33.467 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.743+0000 7f64cffff640 1 -- 172.21.15.112:0/3591697535 learned_addr learned my addr 172.21.15.112:0/3591697535 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:33.468 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.743+0000 7f64cffff640 1 -- 172.21.15.112:0/3591697535 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c0009450 con 0x7f64d0102070 2024-09-19T09:26:33.468 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.743+0000 7f64cffff640 1 --2- 172.21.15.112:0/3591697535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64d0102070 0x7f64d0078c00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f64c0006a70 tx=0x7f64c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:33.468 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.743+0000 7f64ccff9640 1 -- 172.21.15.112:0/3591697535 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64c0031d20 con 0x7f64d0102070 2024-09-19T09:26:33.468 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.743+0000 7f64d6575640 1 -- 172.21.15.112:0/3591697535 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d00771d0 con 0x7f64d0102070 2024-09-19T09:26:33.468 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.743+0000 7f64ccff9640 1 -- 172.21.15.112:0/3591697535 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f64c0031e80 con 0x7f64d0102070 2024-09-19T09:26:33.468 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.743+0000 7f64ccff9640 1 -- 172.21.15.112:0/3591697535 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64c003a750 con 0x7f64d0102070 2024-09-19T09:26:33.468 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.743+0000 7f64d6575640 1 -- 172.21.15.112:0/3591697535 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d0077640 con 0x7f64d0102070 2024-09-19T09:26:33.468 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.744+0000 7f64ccff9640 1 -- 172.21.15.112:0/3591697535 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f64c0039040 con 0x7f64d0102070 2024-09-19T09:26:33.468 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.745+0000 7f64d6575640 1 -- 172.21.15.112:0/3591697535 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d004b720 con 0x7f64d0102070 2024-09-19T09:26:33.468 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.745+0000 7f64ccff9640 1 --2- 172.21.15.112:0/3591697535 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f64bc039490 0x7f64bc03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:33.468 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.745+0000 7f64ccff9640 1 -- 172.21.15.112:0/3591697535 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f64c006cb30 con 0x7f64d0102070 2024-09-19T09:26:33.468 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.745+0000 7f64cf7fe640 1 --2- 172.21.15.112:0/3591697535 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f64bc039490 0x7f64bc03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:33.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.745+0000 7f64cf7fe640 1 --2- 172.21.15.112:0/3591697535 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f64bc039490 0x7f64bc03b940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f64b8006fd0 tx=0x7f64b8006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:33.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.749+0000 7f64ccff9640 1 -- 172.21.15.112:0/3591697535 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f64c004b900 con 0x7f64d0102070 2024-09-19T09:26:33.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.926+0000 7f64d6575640 1 -- 172.21.15.112:0/3591697535 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f64d0103d60 con 0x7f64d0102070 2024-09-19T09:26:33.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.930+0000 7f64ccff9640 1 -- 172.21.15.112:0/3591697535 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f64c003f030 con 0x7f64d0102070 2024-09-19T09:26:33.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.932+0000 7f64d6575640 1 -- 172.21.15.112:0/3591697535 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f64bc039490 msgr2=0x7f64bc03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:33.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.932+0000 7f64d6575640 1 --2- 172.21.15.112:0/3591697535 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f64bc039490 0x7f64bc03b940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f64b8006fd0 tx=0x7f64b8006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:33.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.932+0000 7f64d6575640 1 -- 172.21.15.112:0/3591697535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64d0102070 msgr2=0x7f64d0078c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:33.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.932+0000 7f64d6575640 1 --2- 172.21.15.112:0/3591697535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64d0102070 0x7f64d0078c00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f64c0006a70 tx=0x7f64c00091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:33.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.932+0000 7f64d6575640 1 -- 172.21.15.112:0/3591697535 shutdown_connections 2024-09-19T09:26:33.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.932+0000 7f64d6575640 1 --2- 172.21.15.112:0/3591697535 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f64bc039490 0x7f64bc03b940 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:33.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.932+0000 7f64d6575640 1 --2- 172.21.15.112:0/3591697535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64d0102070 0x7f64d0078c00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:33.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.932+0000 7f64d6575640 1 -- 172.21.15.112:0/3591697535 >> 172.21.15.112:0/3591697535 conn(0x7f64d00fd850 msgr2=0x7f64d00fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:33.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.933+0000 7f64d6575640 1 -- 172.21.15.112:0/3591697535 shutdown_connections 2024-09-19T09:26:33.469 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:32.933+0000 7f64d6575640 1 -- 172.21.15.112:0/3591697535 wait complete. 2024-09-19T09:26:34.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:33 smithi112 ceph-mon[27605]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:26:34.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:33 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3591697535' entity='client.admin' 2024-09-19T09:26:34.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.885+0000 7fc4a4135640 1 Processor -- start 2024-09-19T09:26:34.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.885+0000 7fc4a4135640 1 -- start start 2024-09-19T09:26:34.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.885+0000 7fc4a4135640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc49c100f30 0x7fc49c101340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:34.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.885+0000 7fc4a4135640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c101880 con 0x7fc49c100f30 2024-09-19T09:26:34.617 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.885+0000 7fc4a1ed1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc49c100f30 0x7fc49c101340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:34.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.885+0000 7fc4a1ed1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc49c100f30 0x7fc49c101340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41204/0 (socket says 172.21.15.112:41204) 2024-09-19T09:26:34.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.885+0000 7fc4a1ed1640 1 -- 172.21.15.112:0/112406712 learned_addr learned my addr 172.21.15.112:0/112406712 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:34.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.885+0000 7fc4a1ed1640 1 -- 172.21.15.112:0/112406712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c1019c0 con 0x7fc49c100f30 2024-09-19T09:26:34.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.886+0000 7fc4a1ed1640 1 --2- 172.21.15.112:0/112406712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc49c100f30 0x7fc49c101340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc498009840 tx=0x7fc4980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a7e895fc8fb929 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:34.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.886+0000 7fc4a0ecf640 1 -- 172.21.15.112:0/112406712 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc498032440 con 0x7fc49c100f30 2024-09-19T09:26:34.618 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.886+0000 7fc4a0ecf640 1 -- 172.21.15.112:0/112406712 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc498032a40 con 0x7fc49c100f30 2024-09-19T09:26:34.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.886+0000 7fc4a0ecf640 1 -- 172.21.15.112:0/112406712 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc498031a70 con 0x7fc49c100f30 2024-09-19T09:26:34.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.887+0000 7fc4a4135640 1 -- 172.21.15.112:0/112406712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc49c100f30 msgr2=0x7fc49c101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:34.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.887+0000 7fc4a4135640 1 --2- 172.21.15.112:0/112406712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc49c100f30 0x7fc49c101340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc498009840 tx=0x7fc4980091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:34.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.887+0000 7fc4a4135640 1 -- 172.21.15.112:0/112406712 shutdown_connections 2024-09-19T09:26:34.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.887+0000 7fc4a4135640 1 --2- 172.21.15.112:0/112406712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc49c100f30 0x7fc49c101340 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:34.619 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.887+0000 7fc4a4135640 1 -- 172.21.15.112:0/112406712 >> 172.21.15.112:0/112406712 conn(0x7fc49c0fc730 msgr2=0x7fc49c0feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:34.620 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.887+0000 7fc4a4135640 1 -- 172.21.15.112:0/112406712 shutdown_connections 2024-09-19T09:26:34.620 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.887+0000 7fc4a4135640 1 -- 172.21.15.112:0/112406712 wait complete. 2024-09-19T09:26:34.620 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.887+0000 7fc4a4135640 1 Processor -- start 2024-09-19T09:26:34.620 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.888+0000 7fc4a4135640 1 -- start start 2024-09-19T09:26:34.620 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.888+0000 7fc4a4135640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc49c100f30 0x7fc49c076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:34.620 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.888+0000 7fc4a4135640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c113ae0 con 0x7fc49c100f30 2024-09-19T09:26:34.620 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.888+0000 7fc4a1ed1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc49c100f30 0x7fc49c076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:34.620 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.888+0000 7fc4a1ed1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc49c100f30 0x7fc49c076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41208/0 (socket says 172.21.15.112:41208) 2024-09-19T09:26:34.621 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.888+0000 7fc4a1ed1640 1 -- 172.21.15.112:0/556562903 learned_addr learned my addr 172.21.15.112:0/556562903 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:34.621 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.888+0000 7fc4a1ed1640 1 -- 172.21.15.112:0/556562903 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc498009450 con 0x7fc49c100f30 2024-09-19T09:26:34.621 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.888+0000 7fc4a1ed1640 1 --2- 172.21.15.112:0/556562903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc49c100f30 0x7fc49c076ae0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc498009810 tx=0x7fc4980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:34.621 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.888+0000 7fc4927fc640 1 -- 172.21.15.112:0/556562903 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc49803c400 con 0x7fc49c100f30 2024-09-19T09:26:34.621 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.888+0000 7fc4927fc640 1 -- 172.21.15.112:0/556562903 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc49803ca00 con 0x7fc49c100f30 2024-09-19T09:26:34.621 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.888+0000 7fc4a4135640 1 -- 172.21.15.112:0/556562903 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49c113c20 con 0x7fc49c100f30 2024-09-19T09:26:34.621 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.888+0000 7fc4927fc640 1 -- 172.21.15.112:0/556562903 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc49803a870 con 0x7fc49c100f30 2024-09-19T09:26:34.621 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.888+0000 7fc4a4135640 1 -- 172.21.15.112:0/556562903 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49c114030 con 0x7fc49c100f30 2024-09-19T09:26:34.621 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.889+0000 7fc4927fc640 1 -- 172.21.15.112:0/556562903 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fc49803ab30 con 0x7fc49c100f30 2024-09-19T09:26:34.621 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.889+0000 7fc4927fc640 1 --2- 172.21.15.112:0/556562903 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fc488039490 0x7fc48803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:34.621 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.889+0000 7fc4927fc640 1 -- 172.21.15.112:0/556562903 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc49806cef0 con 0x7fc49c100f30 2024-09-19T09:26:34.621 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.889+0000 7fc4a4135640 1 -- 172.21.15.112:0/556562903 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49c04b720 con 0x7fc49c100f30 2024-09-19T09:26:34.621 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.889+0000 7fc4a16d0640 1 --2- 172.21.15.112:0/556562903 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fc488039490 0x7fc48803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:34.622 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.890+0000 7fc4a16d0640 1 --2- 172.21.15.112:0/556562903 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fc488039490 0x7fc48803b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc48c006fd0 tx=0x7fc48c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:34.622 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:33.894+0000 7fc4927fc640 1 -- 172.21.15.112:0/556562903 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc498037030 con 0x7fc49c100f30 2024-09-19T09:26:34.622 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:34.050+0000 7fc4a4135640 1 -- 172.21.15.112:0/556562903 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fc49c102c60 con 0x7fc49c100f30 2024-09-19T09:26:34.622 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:34.054+0000 7fc4927fc640 1 -- 172.21.15.112:0/556562903 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fc49803ae30 con 0x7fc49c100f30 2024-09-19T09:26:34.622 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:34.056+0000 7fc4a4135640 1 -- 172.21.15.112:0/556562903 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fc488039490 msgr2=0x7fc48803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:34.622 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:34.056+0000 7fc4a4135640 1 --2- 172.21.15.112:0/556562903 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fc488039490 0x7fc48803b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc48c006fd0 tx=0x7fc48c006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:34.622 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:34.056+0000 7fc4a4135640 1 -- 172.21.15.112:0/556562903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc49c100f30 msgr2=0x7fc49c076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:34.622 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:34.056+0000 7fc4a4135640 1 --2- 172.21.15.112:0/556562903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc49c100f30 0x7fc49c076ae0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc498009810 tx=0x7fc4980091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:34.622 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:34.056+0000 7fc4a4135640 1 -- 172.21.15.112:0/556562903 shutdown_connections 2024-09-19T09:26:34.622 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:34.056+0000 7fc4a4135640 1 --2- 172.21.15.112:0/556562903 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7fc488039490 0x7fc48803b940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:34.622 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:34.056+0000 7fc4a4135640 1 --2- 172.21.15.112:0/556562903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc49c100f30 0x7fc49c076ae0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:34.622 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:34.056+0000 7fc4a4135640 1 -- 172.21.15.112:0/556562903 >> 172.21.15.112:0/556562903 conn(0x7fc49c0fc730 msgr2=0x7fc49c0fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:34.622 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:34.056+0000 7fc4a4135640 1 -- 172.21.15.112:0/556562903 shutdown_connections 2024-09-19T09:26:34.623 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:34.056+0000 7fc4a4135640 1 -- 172.21.15.112:0/556562903 wait complete. 2024-09-19T09:26:34.623 INFO:teuthology.orchestra.run.smithi112.stdout:Enabling the dashboard module... 2024-09-19T09:26:35.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:35 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/556562903' entity='client.admin' 2024-09-19T09:26:36.323 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:36 smithi112 ceph-mon[27605]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:26:36.323 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:36 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1148483170' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T09:26:36.728 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.029+0000 7f087185b640 1 Processor -- start 2024-09-19T09:26:36.728 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.029+0000 7f087185b640 1 -- start start 2024-09-19T09:26:36.728 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.030+0000 7f087185b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086c101fa0 0x7f086c1023b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.728 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.030+0000 7f087185b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c1028f0 con 0x7f086c101fa0 2024-09-19T09:26:36.728 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.030+0000 7f086affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086c101fa0 0x7f086c1023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.030+0000 7f086affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086c101fa0 0x7f086c1023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41216/0 (socket says 172.21.15.112:41216) 2024-09-19T09:26:36.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.030+0000 7f086affd640 1 -- 172.21.15.112:0/2834129301 learned_addr learned my addr 172.21.15.112:0/2834129301 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:36.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.030+0000 7f086affd640 1 -- 172.21.15.112:0/2834129301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c102a30 con 0x7f086c101fa0 2024-09-19T09:26:36.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.031+0000 7f086affd640 1 --2- 172.21.15.112:0/2834129301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086c101fa0 0x7f086c1023b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f085c009840 tx=0x7f085c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a66d36dfffc558 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:36.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.031+0000 7f0869ffb640 1 -- 172.21.15.112:0/2834129301 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f085c032440 con 0x7f086c101fa0 2024-09-19T09:26:36.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.031+0000 7f0869ffb640 1 -- 172.21.15.112:0/2834129301 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f085c032a40 con 0x7f086c101fa0 2024-09-19T09:26:36.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.031+0000 7f0869ffb640 1 -- 172.21.15.112:0/2834129301 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f085c031a70 con 0x7f086c101fa0 2024-09-19T09:26:36.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.032+0000 7f087185b640 1 -- 172.21.15.112:0/2834129301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086c101fa0 msgr2=0x7f086c1023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:36.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.032+0000 7f087185b640 1 --2- 172.21.15.112:0/2834129301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086c101fa0 0x7f086c1023b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f085c009840 tx=0x7f085c0091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.032+0000 7f087185b640 1 -- 172.21.15.112:0/2834129301 shutdown_connections 2024-09-19T09:26:36.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.032+0000 7f087185b640 1 --2- 172.21.15.112:0/2834129301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086c101fa0 0x7f086c1023b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.032+0000 7f087185b640 1 -- 172.21.15.112:0/2834129301 >> 172.21.15.112:0/2834129301 conn(0x7f086c0fd740 msgr2=0x7f086c0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:36.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.032+0000 7f087185b640 1 -- 172.21.15.112:0/2834129301 shutdown_connections 2024-09-19T09:26:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.032+0000 7f087185b640 1 -- 172.21.15.112:0/2834129301 wait complete. 2024-09-19T09:26:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.032+0000 7f087185b640 1 Processor -- start 2024-09-19T09:26:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.032+0000 7f087185b640 1 -- start start 2024-09-19T09:26:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.033+0000 7f087185b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086c101fa0 0x7f086c110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.033+0000 7f087185b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c111330 con 0x7f086c101fa0 2024-09-19T09:26:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.033+0000 7f086affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086c101fa0 0x7f086c110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.033+0000 7f086affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086c101fa0 0x7f086c110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41218/0 (socket says 172.21.15.112:41218) 2024-09-19T09:26:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.033+0000 7f086affd640 1 -- 172.21.15.112:0/1148483170 learned_addr learned my addr 172.21.15.112:0/1148483170 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.033+0000 7f086affd640 1 -- 172.21.15.112:0/1148483170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c009450 con 0x7f086c101fa0 2024-09-19T09:26:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.033+0000 7f086affd640 1 --2- 172.21.15.112:0/1148483170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086c101fa0 0x7f086c110df0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f085c006a70 tx=0x7f085c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.033+0000 7f08637fe640 1 -- 172.21.15.112:0/1148483170 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f085c03c400 con 0x7f086c101fa0 2024-09-19T09:26:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.033+0000 7f08637fe640 1 -- 172.21.15.112:0/1148483170 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f085c03ca00 con 0x7f086c101fa0 2024-09-19T09:26:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.033+0000 7f087185b640 1 -- 172.21.15.112:0/1148483170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c111530 con 0x7f086c101fa0 2024-09-19T09:26:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.033+0000 7f08637fe640 1 -- 172.21.15.112:0/1148483170 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f085c03a9a0 con 0x7f086c101fa0 2024-09-19T09:26:36.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.033+0000 7f087185b640 1 -- 172.21.15.112:0/1148483170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c111f80 con 0x7f086c101fa0 2024-09-19T09:26:36.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.034+0000 7f08637fe640 1 -- 172.21.15.112:0/1148483170 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f085c03abd0 con 0x7f086c101fa0 2024-09-19T09:26:36.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.034+0000 7f087185b640 1 -- 172.21.15.112:0/1148483170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c101400 con 0x7f086c101fa0 2024-09-19T09:26:36.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.034+0000 7f08637fe640 1 --2- 172.21.15.112:0/1148483170 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f08580394e0 0x7f085803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.034+0000 7f08637fe640 1 -- 172.21.15.112:0/1148483170 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f085c06cf30 con 0x7f086c101fa0 2024-09-19T09:26:36.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.035+0000 7f086a7fc640 1 --2- 172.21.15.112:0/1148483170 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f08580394e0 0x7f085803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.035+0000 7f086a7fc640 1 --2- 172.21.15.112:0/1148483170 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f08580394e0 0x7f085803b990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0854006fd0 tx=0x7f0854006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:36.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.039+0000 7f08637fe640 1 -- 172.21.15.112:0/1148483170 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f085c030b20 con 0x7f086c101fa0 2024-09-19T09:26:36.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:35.237+0000 7f087185b640 1 -- 172.21.15.112:0/1148483170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f086c04b720 con 0x7f086c101fa0 2024-09-19T09:26:36.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:36.061+0000 7f08637fe640 1 -- 172.21.15.112:0/1148483170 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f085c030d50 con 0x7f086c101fa0 2024-09-19T09:26:36.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:36.062+0000 7f08637fe640 1 -- 172.21.15.112:0/1148483170 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f085c046460 con 0x7f086c101fa0 2024-09-19T09:26:36.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:36.065+0000 7f087185b640 1 -- 172.21.15.112:0/1148483170 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f08580394e0 msgr2=0x7f085803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:36.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:36.065+0000 7f087185b640 1 --2- 172.21.15.112:0/1148483170 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f08580394e0 0x7f085803b990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0854006fd0 tx=0x7f0854006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.732 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:36.065+0000 7f087185b640 1 -- 172.21.15.112:0/1148483170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086c101fa0 msgr2=0x7f086c110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:36.732 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:36.065+0000 7f087185b640 1 --2- 172.21.15.112:0/1148483170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086c101fa0 0x7f086c110df0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f085c006a70 tx=0x7f085c0091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.732 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:36.065+0000 7f087185b640 1 -- 172.21.15.112:0/1148483170 shutdown_connections 2024-09-19T09:26:36.732 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:36.065+0000 7f087185b640 1 --2- 172.21.15.112:0/1148483170 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f08580394e0 0x7f085803b990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.732 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:36.065+0000 7f087185b640 1 --2- 172.21.15.112:0/1148483170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086c101fa0 0x7f086c110df0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.732 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:36.065+0000 7f087185b640 1 -- 172.21.15.112:0/1148483170 >> 172.21.15.112:0/1148483170 conn(0x7f086c0fd740 msgr2=0x7f086c0fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:36.732 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:36.065+0000 7f087185b640 1 -- 172.21.15.112:0/1148483170 shutdown_connections 2024-09-19T09:26:36.732 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:36.065+0000 7f087185b640 1 -- 172.21.15.112:0/1148483170 wait complete. 2024-09-19T09:26:37.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:37 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1148483170' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T09:26:37.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:37 smithi112 ceph-mon[27605]: mgrmap e9: smithi112.puhuua(active, since 25s) 2024-09-19T09:26:38.043 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:26:38.043 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T09:26:38.044 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:26:38.044 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "active_name": "smithi112.puhuua", 2024-09-19T09:26:38.044 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T09:26:38.044 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:26:38.044 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.155+0000 7f0a4cb16640 1 Processor -- start 2024-09-19T09:26:38.044 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.155+0000 7f0a4cb16640 1 -- start start 2024-09-19T09:26:38.044 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.155+0000 7f0a4cb16640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a48100e90 0x7f0a481012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:38.044 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.155+0000 7f0a4cb16640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a481017e0 con 0x7f0a48100e90 2024-09-19T09:26:38.044 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.156+0000 7f0a4659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a48100e90 0x7f0a481012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:38.044 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.156+0000 7f0a4659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a48100e90 0x7f0a481012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41238/0 (socket says 172.21.15.112:41238) 2024-09-19T09:26:38.044 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.156+0000 7f0a4659c640 1 -- 172.21.15.112:0/3955783919 learned_addr learned my addr 172.21.15.112:0/3955783919 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:38.045 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.156+0000 7f0a4659c640 1 -- 172.21.15.112:0/3955783919 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a48101920 con 0x7f0a48100e90 2024-09-19T09:26:38.045 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.157+0000 7f0a4659c640 1 --2- 172.21.15.112:0/3955783919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a48100e90 0x7f0a481012a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009840 tx=0x7f0a380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30c6f259e7b1630 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:38.045 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.157+0000 7f0a45d9b640 1 -- 172.21.15.112:0/3955783919 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a38032440 con 0x7f0a48100e90 2024-09-19T09:26:38.045 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.157+0000 7f0a45d9b640 1 -- 172.21.15.112:0/3955783919 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0a38032a40 con 0x7f0a48100e90 2024-09-19T09:26:38.045 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.157+0000 7f0a45d9b640 1 -- 172.21.15.112:0/3955783919 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a38031aa0 con 0x7f0a48100e90 2024-09-19T09:26:38.045 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.158+0000 7f0a4cb16640 1 -- 172.21.15.112:0/3955783919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a48100e90 msgr2=0x7f0a481012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:38.045 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.158+0000 7f0a4cb16640 1 --2- 172.21.15.112:0/3955783919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a48100e90 0x7f0a481012a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009840 tx=0x7f0a380091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:38.045 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.158+0000 7f0a4cb16640 1 -- 172.21.15.112:0/3955783919 shutdown_connections 2024-09-19T09:26:38.045 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.158+0000 7f0a4cb16640 1 --2- 172.21.15.112:0/3955783919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a48100e90 0x7f0a481012a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:38.045 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.158+0000 7f0a4cb16640 1 -- 172.21.15.112:0/3955783919 >> 172.21.15.112:0/3955783919 conn(0x7f0a480fc6d0 msgr2=0x7f0a480feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:38.045 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.158+0000 7f0a4cb16640 1 -- 172.21.15.112:0/3955783919 shutdown_connections 2024-09-19T09:26:38.045 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.158+0000 7f0a4cb16640 1 -- 172.21.15.112:0/3955783919 wait complete. 2024-09-19T09:26:38.045 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.158+0000 7f0a4cb16640 1 Processor -- start 2024-09-19T09:26:38.045 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.158+0000 7f0a4cb16640 1 -- start start 2024-09-19T09:26:38.046 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.159+0000 7f0a4cb16640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a48100e90 0x7f0a48076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:38.046 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.159+0000 7f0a4cb16640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a48113ab0 con 0x7f0a48100e90 2024-09-19T09:26:38.046 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.159+0000 7f0a4659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a48100e90 0x7f0a48076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:38.046 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.159+0000 7f0a4659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a48100e90 0x7f0a48076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41244/0 (socket says 172.21.15.112:41244) 2024-09-19T09:26:38.046 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.159+0000 7f0a4659c640 1 -- 172.21.15.112:0/2863896263 learned_addr learned my addr 172.21.15.112:0/2863896263 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:38.046 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.159+0000 7f0a4659c640 1 -- 172.21.15.112:0/2863896263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a38009450 con 0x7f0a48100e90 2024-09-19T09:26:38.046 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.159+0000 7f0a4659c640 1 --2- 172.21.15.112:0/2863896263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a48100e90 0x7f0a48076ae0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009810 tx=0x7f0a380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:38.047 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.159+0000 7f0a3effd640 1 -- 172.21.15.112:0/2863896263 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a380327b0 con 0x7f0a48100e90 2024-09-19T09:26:38.047 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.159+0000 7f0a4cb16640 1 -- 172.21.15.112:0/2863896263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a48113bf0 con 0x7f0a48100e90 2024-09-19T09:26:38.047 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.159+0000 7f0a3effd640 1 -- 172.21.15.112:0/2863896263 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0a3803b8d0 con 0x7f0a48100e90 2024-09-19T09:26:38.047 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.159+0000 7f0a3effd640 1 -- 172.21.15.112:0/2863896263 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a3803a6f0 con 0x7f0a48100e90 2024-09-19T09:26:38.047 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.159+0000 7f0a4cb16640 1 -- 172.21.15.112:0/2863896263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a48114000 con 0x7f0a48100e90 2024-09-19T09:26:38.047 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.160+0000 7f0a4cb16640 1 -- 172.21.15.112:0/2863896263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4804b720 con 0x7f0a48100e90 2024-09-19T09:26:38.047 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.160+0000 7f0a3effd640 1 -- 172.21.15.112:0/2863896263 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f0a38039040 con 0x7f0a48100e90 2024-09-19T09:26:38.047 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.161+0000 7f0a3effd640 1 --2- 172.21.15.112:0/2863896263 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f0a340394e0 0x7f0a3403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:38.047 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.161+0000 7f0a3effd640 1 -- 172.21.15.112:0/2863896263 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0a3806cb40 con 0x7f0a48100e90 2024-09-19T09:26:38.048 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.161+0000 7f0a3ffff640 1 -- 172.21.15.112:0/2863896263 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f0a340394e0 msgr2=0x7f0a3403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1627571174 2024-09-19T09:26:38.048 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.161+0000 7f0a3ffff640 1 --2- 172.21.15.112:0/2863896263 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f0a340394e0 0x7f0a3403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:26:38.048 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.165+0000 7f0a3effd640 1 -- 172.21.15.112:0/2863896263 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0a38030990 con 0x7f0a48100e90 2024-09-19T09:26:38.048 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.362+0000 7f0a3ffff640 1 -- 172.21.15.112:0/2863896263 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f0a340394e0 msgr2=0x7f0a3403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1627571174 2024-09-19T09:26:38.048 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.362+0000 7f0a3ffff640 1 --2- 172.21.15.112:0/2863896263 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f0a340394e0 0x7f0a3403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:26:38.048 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.369+0000 7f0a4cb16640 1 -- 172.21.15.112:0/2863896263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f0a48102b80 con 0x7f0a48100e90 2024-09-19T09:26:38.048 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.369+0000 7f0a3effd640 1 -- 172.21.15.112:0/2863896263 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f0a3806ce60 con 0x7f0a48100e90 2024-09-19T09:26:38.048 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.371+0000 7f0a4cb16640 1 -- 172.21.15.112:0/2863896263 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f0a340394e0 msgr2=0x7f0a3403b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:26:38.048 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.371+0000 7f0a4cb16640 1 --2- 172.21.15.112:0/2863896263 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f0a340394e0 0x7f0a3403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:38.048 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.371+0000 7f0a4cb16640 1 -- 172.21.15.112:0/2863896263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a48100e90 msgr2=0x7f0a48076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:38.048 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.371+0000 7f0a4cb16640 1 --2- 172.21.15.112:0/2863896263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a48100e90 0x7f0a48076ae0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009810 tx=0x7f0a380091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:38.048 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.371+0000 7f0a4cb16640 1 -- 172.21.15.112:0/2863896263 shutdown_connections 2024-09-19T09:26:38.048 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.371+0000 7f0a4cb16640 1 --2- 172.21.15.112:0/2863896263 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f0a340394e0 0x7f0a3403b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:38.049 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.371+0000 7f0a4cb16640 1 --2- 172.21.15.112:0/2863896263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a48100e90 0x7f0a48076ae0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:38.049 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.371+0000 7f0a4cb16640 1 -- 172.21.15.112:0/2863896263 >> 172.21.15.112:0/2863896263 conn(0x7f0a480fc6d0 msgr2=0x7f0a480fd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:38.049 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.372+0000 7f0a4cb16640 1 -- 172.21.15.112:0/2863896263 shutdown_connections 2024-09-19T09:26:38.049 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:37.372+0000 7f0a4cb16640 1 -- 172.21.15.112:0/2863896263 wait complete. 2024-09-19T09:26:38.049 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for the mgr to restart... 2024-09-19T09:26:38.049 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for mgr epoch 9... 2024-09-19T09:26:38.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:38 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2863896263' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T09:26:40.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:40 smithi112 ceph-mon[27605]: Active manager daemon smithi112.puhuua restarted 2024-09-19T09:26:40.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:40 smithi112 ceph-mon[27605]: Activating manager daemon smithi112.puhuua 2024-09-19T09:26:40.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:40 smithi112 ceph-mon[27605]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T09:26:40.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:40 smithi112 ceph-mon[27605]: mgrmap e10: smithi112.puhuua(active, starting, since 0.00310038s) 2024-09-19T09:26:40.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:40 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:26:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:40 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr metadata", "who": "smithi112.puhuua", "id": "smithi112.puhuua"}]: dispatch 2024-09-19T09:26:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:40 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:26:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:40 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:26:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:40 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:26:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:40 smithi112 ceph-mon[27605]: Manager daemon smithi112.puhuua is now available 2024-09-19T09:26:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:40 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:26:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:40 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:26:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:40 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/trash_purge_schedule"}]: dispatch 2024-09-19T09:26:42.307 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:26:42.307 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T09:26:42.307 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T09:26:42.307 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:26:42.307 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.479+0000 7f557de0e640 1 Processor -- start 2024-09-19T09:26:42.307 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.479+0000 7f557de0e640 1 -- start start 2024-09-19T09:26:42.308 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.479+0000 7f557de0e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5578076b10 0x7f5578104be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:42.308 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.479+0000 7f557de0e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5578076f20 con 0x7f5578076b10 2024-09-19T09:26:42.308 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.479+0000 7f55777fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5578076b10 0x7f5578104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:42.308 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.479+0000 7f55777fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5578076b10 0x7f5578104be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37758/0 (socket says 172.21.15.112:37758) 2024-09-19T09:26:42.308 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.479+0000 7f55777fe640 1 -- 172.21.15.112:0/299217365 learned_addr learned my addr 172.21.15.112:0/299217365 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:42.308 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.479+0000 7f55777fe640 1 -- 172.21.15.112:0/299217365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5578105120 con 0x7f5578076b10 2024-09-19T09:26:42.308 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.480+0000 7f55777fe640 1 --2- 172.21.15.112:0/299217365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5578076b10 0x7f5578104be0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5568009840 tx=0x7f55680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7e11c4d58c532b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:42.308 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.480+0000 7f5576ffd640 1 -- 172.21.15.112:0/299217365 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5568032440 con 0x7f5578076b10 2024-09-19T09:26:42.308 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.480+0000 7f5576ffd640 1 -- 172.21.15.112:0/299217365 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5568032a40 con 0x7f5578076b10 2024-09-19T09:26:42.308 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.480+0000 7f5576ffd640 1 -- 172.21.15.112:0/299217365 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5568031aa0 con 0x7f5578076b10 2024-09-19T09:26:42.308 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.481+0000 7f557de0e640 1 -- 172.21.15.112:0/299217365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5578076b10 msgr2=0x7f5578104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:42.308 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.481+0000 7f557de0e640 1 --2- 172.21.15.112:0/299217365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5578076b10 0x7f5578104be0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5568009840 tx=0x7f55680091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:42.308 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.481+0000 7f557de0e640 1 -- 172.21.15.112:0/299217365 shutdown_connections 2024-09-19T09:26:42.309 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.481+0000 7f557de0e640 1 --2- 172.21.15.112:0/299217365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5578076b10 0x7f5578104be0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:42.309 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.481+0000 7f557de0e640 1 -- 172.21.15.112:0/299217365 >> 172.21.15.112:0/299217365 conn(0x7f55780fc6d0 msgr2=0x7f55780feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:42.309 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.481+0000 7f557de0e640 1 -- 172.21.15.112:0/299217365 shutdown_connections 2024-09-19T09:26:42.309 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.481+0000 7f557de0e640 1 -- 172.21.15.112:0/299217365 wait complete. 2024-09-19T09:26:42.309 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.481+0000 7f557de0e640 1 Processor -- start 2024-09-19T09:26:42.309 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.482+0000 7f557de0e640 1 -- start start 2024-09-19T09:26:42.309 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.482+0000 7f557de0e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5578076b10 0x7f5578102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:42.309 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.482+0000 7f557de0e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5578102a50 con 0x7f5578076b10 2024-09-19T09:26:42.309 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.482+0000 7f55777fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5578076b10 0x7f5578102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:42.309 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.482+0000 7f55777fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5578076b10 0x7f5578102510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37766/0 (socket says 172.21.15.112:37766) 2024-09-19T09:26:42.309 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.482+0000 7f55777fe640 1 -- 172.21.15.112:0/1571031470 learned_addr learned my addr 172.21.15.112:0/1571031470 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:42.310 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.482+0000 7f55777fe640 1 -- 172.21.15.112:0/1571031470 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5568009450 con 0x7f5578076b10 2024-09-19T09:26:42.310 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.482+0000 7f55777fe640 1 --2- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5578076b10 0x7f5578102510 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5568006a70 tx=0x7f55680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:42.310 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.482+0000 7f5574ff9640 1 -- 172.21.15.112:0/1571031470 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5568031d20 con 0x7f5578076b10 2024-09-19T09:26:42.310 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.482+0000 7f557de0e640 1 -- 172.21.15.112:0/1571031470 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5578100ae0 con 0x7f5578076b10 2024-09-19T09:26:42.310 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.482+0000 7f5574ff9640 1 -- 172.21.15.112:0/1571031470 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5568031e80 con 0x7f5578076b10 2024-09-19T09:26:42.310 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.482+0000 7f5574ff9640 1 -- 172.21.15.112:0/1571031470 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f556803a750 con 0x7f5578076b10 2024-09-19T09:26:42.310 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.482+0000 7f557de0e640 1 -- 172.21.15.112:0/1571031470 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5578100f50 con 0x7f5578076b10 2024-09-19T09:26:42.310 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.483+0000 7f5574ff9640 1 -- 172.21.15.112:0/1571031470 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f5568039040 con 0x7f5578076b10 2024-09-19T09:26:42.310 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.483+0000 7f5574ff9640 1 --2- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f55640394e0 0x7f556403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:42.310 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.483+0000 7f557de0e640 1 -- 172.21.15.112:0/1571031470 --> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f557804b720 con 0x7f55640394e0 2024-09-19T09:26:42.310 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.483+0000 7f5574ff9640 1 -- 172.21.15.112:0/1571031470 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f556806cb50 con 0x7f5578076b10 2024-09-19T09:26:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.483+0000 7f556ffff640 1 -- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f55640394e0 msgr2=0x7f556403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1627571174 2024-09-19T09:26:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.483+0000 7f556ffff640 1 --2- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f55640394e0 0x7f556403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:26:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.684+0000 7f556ffff640 1 -- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f55640394e0 msgr2=0x7f556403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1627571174 2024-09-19T09:26:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:38.684+0000 7f556ffff640 1 --2- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f55640394e0 0x7f556403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:26:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:39.085+0000 7f556ffff640 1 -- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f55640394e0 msgr2=0x7f556403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1627571174 2024-09-19T09:26:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:39.085+0000 7f556ffff640 1 --2- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f55640394e0 0x7f556403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:26:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:39.886+0000 7f556ffff640 1 -- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f55640394e0 msgr2=0x7f556403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1627571174 2024-09-19T09:26:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:39.886+0000 7f556ffff640 1 --2- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f55640394e0 0x7f556403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:26:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:40.442+0000 7f5574ff9640 1 -- 172.21.15.112:0/1571031470 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mgrmap(e 10) v1 ==== 45287+0+0 (secure 0 0 0) 0x7f5568039db0 con 0x7f5578076b10 2024-09-19T09:26:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:40.442+0000 7f5574ff9640 1 -- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f55640394e0 msgr2=0x7f556403b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:26:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:40.442+0000 7f5574ff9640 1 --2- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f55640394e0 0x7f556403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.444+0000 7f5574ff9640 1 -- 172.21.15.112:0/1571031470 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f556806c550 con 0x7f5578076b10 2024-09-19T09:26:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.444+0000 7f5574ff9640 1 --2- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f556403cdd0 0x7f556403f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.444+0000 7f5574ff9640 1 -- 172.21.15.112:0/1571031470 --> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f557804b720 con 0x7f556403cdd0 2024-09-19T09:26:42.312 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.444+0000 7f556ffff640 1 --2- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f556403cdd0 0x7f556403f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:42.312 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.445+0000 7f556ffff640 1 --2- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f556403cdd0 0x7f556403f1b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5560003940 tx=0x7f5560009350 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:42.312 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.445+0000 7f5574ff9640 1 -- 172.21.15.112:0/1571031470 <== mgr.14158 v2:172.21.15.112:6800/3210372910 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f557804b720 con 0x7f556403cdd0 2024-09-19T09:26:42.312 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.450+0000 7f557de0e640 1 -- 172.21.15.112:0/1571031470 --> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f5578105f20 con 0x7f556403cdd0 2024-09-19T09:26:42.312 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.450+0000 7f5574ff9640 1 -- 172.21.15.112:0/1571031470 <== mgr.14158 v2:172.21.15.112:6800/3210372910 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f5578105f20 con 0x7f556403cdd0 2024-09-19T09:26:42.312 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.451+0000 7f557de0e640 1 -- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f556403cdd0 msgr2=0x7f556403f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:42.312 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.451+0000 7f557de0e640 1 --2- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f556403cdd0 0x7f556403f1b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5560003940 tx=0x7f5560009350 comp rx=0 tx=0).stop 2024-09-19T09:26:42.312 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.451+0000 7f557de0e640 1 -- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5578076b10 msgr2=0x7f5578102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:42.312 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.451+0000 7f557de0e640 1 --2- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5578076b10 0x7f5578102510 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5568006a70 tx=0x7f55680091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:42.312 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.451+0000 7f557de0e640 1 -- 172.21.15.112:0/1571031470 shutdown_connections 2024-09-19T09:26:42.312 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.451+0000 7f557de0e640 1 --2- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f556403cdd0 0x7f556403f1b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:42.312 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.451+0000 7f557de0e640 1 --2- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:6800/1627571174,v1:172.21.15.112:6801/1627571174] conn(0x7f55640394e0 0x7f556403b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:42.313 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.451+0000 7f557de0e640 1 --2- 172.21.15.112:0/1571031470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5578076b10 0x7f5578102510 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:42.313 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.451+0000 7f557de0e640 1 -- 172.21.15.112:0/1571031470 >> 172.21.15.112:0/1571031470 conn(0x7f55780fc6d0 msgr2=0x7f55780fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:42.313 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.451+0000 7f557de0e640 1 -- 172.21.15.112:0/1571031470 shutdown_connections 2024-09-19T09:26:42.313 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:41.451+0000 7f557de0e640 1 -- 172.21.15.112:0/1571031470 wait complete. 2024-09-19T09:26:42.313 INFO:teuthology.orchestra.run.smithi112.stdout:mgr epoch 9 is available 2024-09-19T09:26:42.313 INFO:teuthology.orchestra.run.smithi112.stdout:Generating a dashboard self-signed certificate... 2024-09-19T09:26:42.555 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:42 smithi112 ceph-mon[27605]: [19/Sep/2024:09:26:41] ENGINE Bus STARTING 2024-09-19T09:26:42.555 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:42 smithi112 ceph-mon[27605]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T09:26:42.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:42 smithi112 ceph-mon[27605]: mgrmap e11: smithi112.puhuua(active, since 1.00561s) 2024-09-19T09:26:42.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:42 smithi112 ceph-mon[27605]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T09:26:42.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:42 smithi112 ceph-mon[27605]: [19/Sep/2024:09:26:41] ENGINE Serving on https://172.21.15.112:7150 2024-09-19T09:26:42.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:42 smithi112 ceph-mon[27605]: [19/Sep/2024:09:26:41] ENGINE Bus STARTED 2024-09-19T09:26:42.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:42 smithi112 ceph-mon[27605]: [19/Sep/2024:09:26:41] ENGINE Error in HTTPServer.serve 2024-09-19T09:26:42.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Traceback (most recent call last): 2024-09-19T09:26:42.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:26:42.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:26:42.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:26:42.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._run(expiration_interval) 2024-09-19T09:26:42.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:26:42.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:26:42.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:26:42.557 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:26:42.557 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:26:42.557 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s = self.context.wrap_socket( 2024-09-19T09:26:42.557 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:26:42.557 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: return self.sslsocket_class._create( 2024-09-19T09:26:42.557 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:26:42.557 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self.do_handshake() 2024-09-19T09:26:42.557 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:26:42.557 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._sslobj.do_handshake() 2024-09-19T09:26:42.557 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:26:42.557 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:42 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:42.557 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:42 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:44.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:43 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:44.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:43 smithi112 ceph-mon[27605]: mgrmap e12: smithi112.puhuua(active, since 2s) 2024-09-19T09:26:44.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:43 smithi112 ceph-mon[27605]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:26:44.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:43 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:43 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:44.631 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T09:26:44.631 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.766+0000 7f7279764640 1 Processor -- start 2024-09-19T09:26:44.632 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.767+0000 7f7279764640 1 -- start start 2024-09-19T09:26:44.632 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.767+0000 7f7279764640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72741035d0 0x7f72741039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:44.632 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.767+0000 7f7279764640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7274103f20 con 0x7f72741035d0 2024-09-19T09:26:44.632 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.767+0000 7f7272ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72741035d0 0x7f72741039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:44.632 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.767+0000 7f7272ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72741035d0 0x7f72741039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37832/0 (socket says 172.21.15.112:37832) 2024-09-19T09:26:44.632 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.767+0000 7f7272ffd640 1 -- 172.21.15.112:0/2783506983 learned_addr learned my addr 172.21.15.112:0/2783506983 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:44.633 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.767+0000 7f7272ffd640 1 -- 172.21.15.112:0/2783506983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7274104060 con 0x7f72741035d0 2024-09-19T09:26:44.633 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.768+0000 7f7272ffd640 1 --2- 172.21.15.112:0/2783506983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72741035d0 0x7f72741039e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7264009840 tx=0x7f72640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b859b92633b102eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:44.633 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.768+0000 7f7271ffb640 1 -- 172.21.15.112:0/2783506983 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7264032440 con 0x7f72741035d0 2024-09-19T09:26:44.633 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.768+0000 7f7271ffb640 1 -- 172.21.15.112:0/2783506983 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7264032a40 con 0x7f72741035d0 2024-09-19T09:26:44.633 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.768+0000 7f7271ffb640 1 -- 172.21.15.112:0/2783506983 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7264031a70 con 0x7f72741035d0 2024-09-19T09:26:44.633 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.769+0000 7f7279764640 1 -- 172.21.15.112:0/2783506983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72741035d0 msgr2=0x7f72741039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:44.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.769+0000 7f7279764640 1 --2- 172.21.15.112:0/2783506983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72741035d0 0x7f72741039e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7264009840 tx=0x7f72640091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:44.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.769+0000 7f7279764640 1 -- 172.21.15.112:0/2783506983 shutdown_connections 2024-09-19T09:26:44.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.769+0000 7f7279764640 1 --2- 172.21.15.112:0/2783506983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72741035d0 0x7f72741039e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:44.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.769+0000 7f7279764640 1 -- 172.21.15.112:0/2783506983 >> 172.21.15.112:0/2783506983 conn(0x7f72740fbd90 msgr2=0x7f72740fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:44.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.769+0000 7f7279764640 1 -- 172.21.15.112:0/2783506983 shutdown_connections 2024-09-19T09:26:44.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.769+0000 7f7279764640 1 -- 172.21.15.112:0/2783506983 wait complete. 2024-09-19T09:26:44.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.770+0000 7f7279764640 1 Processor -- start 2024-09-19T09:26:44.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.770+0000 7f7279764640 1 -- start start 2024-09-19T09:26:44.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.770+0000 7f7279764640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72741035d0 0x7f7274102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:44.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.770+0000 7f7279764640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7274103220 con 0x7f72741035d0 2024-09-19T09:26:44.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.770+0000 7f7272ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72741035d0 0x7f7274102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:44.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.770+0000 7f7272ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72741035d0 0x7f7274102ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37848/0 (socket says 172.21.15.112:37848) 2024-09-19T09:26:44.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.770+0000 7f7272ffd640 1 -- 172.21.15.112:0/3505025576 learned_addr learned my addr 172.21.15.112:0/3505025576 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:44.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.770+0000 7f7272ffd640 1 -- 172.21.15.112:0/3505025576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264009450 con 0x7f72741035d0 2024-09-19T09:26:44.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.770+0000 7f7272ffd640 1 --2- 172.21.15.112:0/3505025576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72741035d0 0x7f7274102ce0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7264031750 tx=0x7f72640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:44.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.770+0000 7f725b7fe640 1 -- 172.21.15.112:0/3505025576 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f726403c400 con 0x7f72741035d0 2024-09-19T09:26:44.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.771+0000 7f7279764640 1 -- 172.21.15.112:0/3505025576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72741012b0 con 0x7f72741035d0 2024-09-19T09:26:44.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.771+0000 7f725b7fe640 1 -- 172.21.15.112:0/3505025576 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f726403ca00 con 0x7f72741035d0 2024-09-19T09:26:44.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.771+0000 7f725b7fe640 1 -- 172.21.15.112:0/3505025576 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f726403a880 con 0x7f72741035d0 2024-09-19T09:26:44.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.771+0000 7f7279764640 1 -- 172.21.15.112:0/3505025576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72741016c0 con 0x7f72741035d0 2024-09-19T09:26:44.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.771+0000 7f725b7fe640 1 -- 172.21.15.112:0/3505025576 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f726403aaf0 con 0x7f72741035d0 2024-09-19T09:26:44.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.772+0000 7f725b7fe640 1 --2- 172.21.15.112:0/3505025576 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f725c0393d0 0x7f725c03b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:44.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.772+0000 7f7279764640 1 -- 172.21.15.112:0/3505025576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727404b720 con 0x7f72741035d0 2024-09-19T09:26:44.638 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.772+0000 7f725b7fe640 1 -- 172.21.15.112:0/3505025576 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f726406d1b0 con 0x7f72741035d0 2024-09-19T09:26:44.638 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.772+0000 7f72727fc640 1 --2- 172.21.15.112:0/3505025576 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f725c0393d0 0x7f725c03b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:44.638 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.772+0000 7f72727fc640 1 --2- 172.21.15.112:0/3505025576 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f725c0393d0 0x7f725c03b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7268006fd0 tx=0x7f7268006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:44.638 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.776+0000 7f725b7fe640 1 -- 172.21.15.112:0/3505025576 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7264037020 con 0x7f72741035d0 2024-09-19T09:26:44.638 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.878+0000 7f725b7fe640 1 -- 172.21.15.112:0/3505025576 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f7264046460 con 0x7f72741035d0 2024-09-19T09:26:44.638 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:42.945+0000 7f7279764640 1 -- 172.21.15.112:0/3505025576 --> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f7274101d70 con 0x7f725c0393d0 2024-09-19T09:26:44.639 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:43.110+0000 7f725b7fe640 1 -- 172.21.15.112:0/3505025576 <== mgr.14158 v2:172.21.15.112:6800/3210372910 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f7274101d70 con 0x7f725c0393d0 2024-09-19T09:26:44.639 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:43.111+0000 7f7279764640 1 -- 172.21.15.112:0/3505025576 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f725c0393d0 msgr2=0x7f725c03b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:44.639 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:43.111+0000 7f7279764640 1 --2- 172.21.15.112:0/3505025576 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f725c0393d0 0x7f725c03b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7268006fd0 tx=0x7f7268006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:44.639 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:43.111+0000 7f7279764640 1 -- 172.21.15.112:0/3505025576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72741035d0 msgr2=0x7f7274102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:44.639 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:43.111+0000 7f7279764640 1 --2- 172.21.15.112:0/3505025576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72741035d0 0x7f7274102ce0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7264031750 tx=0x7f72640091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:44.639 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:43.112+0000 7f7279764640 1 -- 172.21.15.112:0/3505025576 shutdown_connections 2024-09-19T09:26:44.640 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:43.112+0000 7f7279764640 1 --2- 172.21.15.112:0/3505025576 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f725c0393d0 0x7f725c03b880 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:44.640 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:43.112+0000 7f7279764640 1 --2- 172.21.15.112:0/3505025576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72741035d0 0x7f7274102ce0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:44.640 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:43.112+0000 7f7279764640 1 -- 172.21.15.112:0/3505025576 >> 172.21.15.112:0/3505025576 conn(0x7f72740fbd90 msgr2=0x7f72740fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:44.640 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:43.112+0000 7f7279764640 1 -- 172.21.15.112:0/3505025576 shutdown_connections 2024-09-19T09:26:44.640 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:43.112+0000 7f7279764640 1 -- 172.21.15.112:0/3505025576 wait complete. 2024-09-19T09:26:44.640 INFO:teuthology.orchestra.run.smithi112.stdout:Creating initial admin user... 2024-09-19T09:26:46.067 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$OOpuuFqZSUGREB/QZQymWeJPvXc9kaiu6pyN97TmuYXniG8DBtktG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726738005, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T09:26:46.068 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.056+0000 7f4df681a640 1 Processor -- start 2024-09-19T09:26:46.068 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.057+0000 7f4df681a640 1 -- start start 2024-09-19T09:26:46.068 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.057+0000 7f4df681a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df0101f80 0x7f4df0102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:46.068 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.057+0000 7f4df681a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df01028d0 con 0x7f4df0101f80 2024-09-19T09:26:46.069 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.057+0000 7f4deffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df0101f80 0x7f4df0102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:46.069 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.057+0000 7f4deffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df0101f80 0x7f4df0102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37852/0 (socket says 172.21.15.112:37852) 2024-09-19T09:26:46.069 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.057+0000 7f4deffff640 1 -- 172.21.15.112:0/1910060388 learned_addr learned my addr 172.21.15.112:0/1910060388 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:46.069 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.057+0000 7f4deffff640 1 -- 172.21.15.112:0/1910060388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df0102a10 con 0x7f4df0101f80 2024-09-19T09:26:46.069 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.058+0000 7f4deffff640 1 --2- 172.21.15.112:0/1910060388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df0101f80 0x7f4df0102390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009840 tx=0x7f4de00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0607e077c6558d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:46.069 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.058+0000 7f4def7fe640 1 -- 172.21.15.112:0/1910060388 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4de0032440 con 0x7f4df0101f80 2024-09-19T09:26:46.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.058+0000 7f4def7fe640 1 -- 172.21.15.112:0/1910060388 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4de0032a40 con 0x7f4df0101f80 2024-09-19T09:26:46.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.058+0000 7f4def7fe640 1 -- 172.21.15.112:0/1910060388 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4de0031a70 con 0x7f4df0101f80 2024-09-19T09:26:46.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.059+0000 7f4df681a640 1 -- 172.21.15.112:0/1910060388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df0101f80 msgr2=0x7f4df0102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:46.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.059+0000 7f4df681a640 1 --2- 172.21.15.112:0/1910060388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df0101f80 0x7f4df0102390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009840 tx=0x7f4de00091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:46.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.059+0000 7f4df681a640 1 -- 172.21.15.112:0/1910060388 shutdown_connections 2024-09-19T09:26:46.070 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.059+0000 7f4df681a640 1 --2- 172.21.15.112:0/1910060388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df0101f80 0x7f4df0102390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:46.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.059+0000 7f4df681a640 1 -- 172.21.15.112:0/1910060388 >> 172.21.15.112:0/1910060388 conn(0x7f4df00fd7a0 msgr2=0x7f4df00ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:46.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.059+0000 7f4df681a640 1 -- 172.21.15.112:0/1910060388 shutdown_connections 2024-09-19T09:26:46.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.059+0000 7f4df681a640 1 -- 172.21.15.112:0/1910060388 wait complete. 2024-09-19T09:26:46.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.059+0000 7f4df681a640 1 Processor -- start 2024-09-19T09:26:46.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.059+0000 7f4df681a640 1 -- start start 2024-09-19T09:26:46.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.059+0000 7f4df681a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df0101f80 0x7f4df0110e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:46.072 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.059+0000 7f4df681a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df0111380 con 0x7f4df0101f80 2024-09-19T09:26:46.072 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.060+0000 7f4deffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df0101f80 0x7f4df0110e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:46.072 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.060+0000 7f4deffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df0101f80 0x7f4df0110e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37866/0 (socket says 172.21.15.112:37866) 2024-09-19T09:26:46.072 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.060+0000 7f4deffff640 1 -- 172.21.15.112:0/806379109 learned_addr learned my addr 172.21.15.112:0/806379109 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:46.072 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.060+0000 7f4deffff640 1 -- 172.21.15.112:0/806379109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de0009450 con 0x7f4df0101f80 2024-09-19T09:26:46.072 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.060+0000 7f4deffff640 1 --2- 172.21.15.112:0/806379109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df0101f80 0x7f4df0110e40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4de0031670 tx=0x7f4de00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:46.073 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.060+0000 7f4ded7fa640 1 -- 172.21.15.112:0/806379109 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4de003c400 con 0x7f4df0101f80 2024-09-19T09:26:46.073 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.060+0000 7f4ded7fa640 1 -- 172.21.15.112:0/806379109 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4de003ca00 con 0x7f4df0101f80 2024-09-19T09:26:46.073 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.060+0000 7f4df681a640 1 -- 172.21.15.112:0/806379109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df0111580 con 0x7f4df0101f80 2024-09-19T09:26:46.073 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.060+0000 7f4ded7fa640 1 -- 172.21.15.112:0/806379109 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4de003a910 con 0x7f4df0101f80 2024-09-19T09:26:46.073 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.060+0000 7f4df681a640 1 -- 172.21.15.112:0/806379109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df0112060 con 0x7f4df0101f80 2024-09-19T09:26:46.073 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.061+0000 7f4ded7fa640 1 -- 172.21.15.112:0/806379109 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f4de003cb70 con 0x7f4df0101f80 2024-09-19T09:26:46.074 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.061+0000 7f4df681a640 1 -- 172.21.15.112:0/806379109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df01013e0 con 0x7f4df0101f80 2024-09-19T09:26:46.074 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.061+0000 7f4ded7fa640 1 --2- 172.21.15.112:0/806379109 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f4ddc0394e0 0x7f4ddc03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:46.074 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.061+0000 7f4ded7fa640 1 -- 172.21.15.112:0/806379109 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4de006cf40 con 0x7f4df0101f80 2024-09-19T09:26:46.074 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.062+0000 7f4de7fff640 1 --2- 172.21.15.112:0/806379109 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f4ddc0394e0 0x7f4ddc03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:46.074 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.062+0000 7f4de7fff640 1 --2- 172.21.15.112:0/806379109 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f4ddc0394e0 0x7f4ddc03b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8006fd0 tx=0x7f4dd8006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:46.074 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.066+0000 7f4ded7fa640 1 -- 172.21.15.112:0/806379109 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4de003bb00 con 0x7f4df0101f80 2024-09-19T09:26:46.074 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.235+0000 7f4df681a640 1 -- 172.21.15.112:0/806379109 --> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4df005eb60 con 0x7f4ddc0394e0 2024-09-19T09:26:46.076 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.455+0000 7f4ded7fa640 1 -- 172.21.15.112:0/806379109 <== mgr.14158 v2:172.21.15.112:6800/3210372910 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f4df005eb60 con 0x7f4ddc0394e0 2024-09-19T09:26:46.076 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.457+0000 7f4df681a640 1 -- 172.21.15.112:0/806379109 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f4ddc0394e0 msgr2=0x7f4ddc03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:46.076 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.457+0000 7f4df681a640 1 --2- 172.21.15.112:0/806379109 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f4ddc0394e0 0x7f4ddc03b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8006fd0 tx=0x7f4dd8006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:46.076 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.457+0000 7f4df681a640 1 -- 172.21.15.112:0/806379109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df0101f80 msgr2=0x7f4df0110e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:46.077 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.457+0000 7f4df681a640 1 --2- 172.21.15.112:0/806379109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df0101f80 0x7f4df0110e40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4de0031670 tx=0x7f4de00091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:46.077 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.457+0000 7f4df681a640 1 -- 172.21.15.112:0/806379109 shutdown_connections 2024-09-19T09:26:46.077 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.457+0000 7f4df681a640 1 --2- 172.21.15.112:0/806379109 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f4ddc0394e0 0x7f4ddc03b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:46.077 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.457+0000 7f4df681a640 1 --2- 172.21.15.112:0/806379109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df0101f80 0x7f4df0110e40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:46.077 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.457+0000 7f4df681a640 1 -- 172.21.15.112:0/806379109 >> 172.21.15.112:0/806379109 conn(0x7f4df00fd7a0 msgr2=0x7f4df00fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:46.077 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.457+0000 7f4df681a640 1 -- 172.21.15.112:0/806379109 shutdown_connections 2024-09-19T09:26:46.078 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:45.457+0000 7f4df681a640 1 -- 172.21.15.112:0/806379109 wait complete. 2024-09-19T09:26:46.078 INFO:teuthology.orchestra.run.smithi112.stdout:Fetching dashboard port number... 2024-09-19T09:26:46.646 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:46 smithi112 ceph-mon[27605]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:26:46.646 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:46 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:47.196 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T09:26:47.196 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.467+0000 7f62b90bd640 1 Processor -- start 2024-09-19T09:26:47.196 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.467+0000 7f62b90bd640 1 -- start start 2024-09-19T09:26:47.196 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.467+0000 7f62b90bd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b4100ea0 0x7f62b41012b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:47.196 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.467+0000 7f62b90bd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b41017f0 con 0x7f62b4100ea0 2024-09-19T09:26:47.196 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.468+0000 7f62b2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b4100ea0 0x7f62b41012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:47.196 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.468+0000 7f62b2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b4100ea0 0x7f62b41012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37868/0 (socket says 172.21.15.112:37868) 2024-09-19T09:26:47.196 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.468+0000 7f62b2d9d640 1 -- 172.21.15.112:0/3332876847 learned_addr learned my addr 172.21.15.112:0/3332876847 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:47.196 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.468+0000 7f62b2d9d640 1 -- 172.21.15.112:0/3332876847 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b4101930 con 0x7f62b4100ea0 2024-09-19T09:26:47.197 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.469+0000 7f62b2d9d640 1 --2- 172.21.15.112:0/3332876847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b4100ea0 0x7f62b41012b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009e50 tx=0x7f62a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bdd139d6ef204bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:47.197 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.469+0000 7f62b1d9b640 1 -- 172.21.15.112:0/3332876847 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62a4031560 con 0x7f62b4100ea0 2024-09-19T09:26:47.197 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.469+0000 7f62b1d9b640 1 -- 172.21.15.112:0/3332876847 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f62a402d050 con 0x7f62b4100ea0 2024-09-19T09:26:47.197 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.469+0000 7f62b1d9b640 1 -- 172.21.15.112:0/3332876847 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62a4007a60 con 0x7f62b4100ea0 2024-09-19T09:26:47.197 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.469+0000 7f62b90bd640 1 -- 172.21.15.112:0/3332876847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b4100ea0 msgr2=0x7f62b41012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:47.197 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.469+0000 7f62b90bd640 1 --2- 172.21.15.112:0/3332876847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b4100ea0 0x7f62b41012b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009e50 tx=0x7f62a4009840 comp rx=0 tx=0).stop 2024-09-19T09:26:47.197 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.469+0000 7f62b90bd640 1 -- 172.21.15.112:0/3332876847 shutdown_connections 2024-09-19T09:26:47.197 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.469+0000 7f62b90bd640 1 --2- 172.21.15.112:0/3332876847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b4100ea0 0x7f62b41012b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:47.197 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.469+0000 7f62b90bd640 1 -- 172.21.15.112:0/3332876847 >> 172.21.15.112:0/3332876847 conn(0x7f62b40fc700 msgr2=0x7f62b40feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:47.197 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.469+0000 7f62b90bd640 1 -- 172.21.15.112:0/3332876847 shutdown_connections 2024-09-19T09:26:47.197 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.469+0000 7f62b90bd640 1 -- 172.21.15.112:0/3332876847 wait complete. 2024-09-19T09:26:47.197 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.470+0000 7f62b90bd640 1 Processor -- start 2024-09-19T09:26:47.198 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.470+0000 7f62b90bd640 1 -- start start 2024-09-19T09:26:47.198 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.470+0000 7f62b90bd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b4100ea0 0x7f62b4110e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:47.198 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.470+0000 7f62b90bd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b41113a0 con 0x7f62b4100ea0 2024-09-19T09:26:47.198 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.470+0000 7f62b2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b4100ea0 0x7f62b4110e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:47.198 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.470+0000 7f62b2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b4100ea0 0x7f62b4110e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37870/0 (socket says 172.21.15.112:37870) 2024-09-19T09:26:47.198 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.470+0000 7f62b2d9d640 1 -- 172.21.15.112:0/3225827357 learned_addr learned my addr 172.21.15.112:0/3225827357 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:47.198 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.471+0000 7f62b2d9d640 1 -- 172.21.15.112:0/3225827357 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a4009ae0 con 0x7f62b4100ea0 2024-09-19T09:26:47.198 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.471+0000 7f62b2d9d640 1 --2- 172.21.15.112:0/3225827357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b4100ea0 0x7f62b4110e60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f62a4007660 tx=0x7f62a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:47.198 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.471+0000 7f62ab7fe640 1 -- 172.21.15.112:0/3225827357 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62a4031e70 con 0x7f62b4100ea0 2024-09-19T09:26:47.198 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.471+0000 7f62ab7fe640 1 -- 172.21.15.112:0/3225827357 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f62a403b8b0 con 0x7f62b4100ea0 2024-09-19T09:26:47.198 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.471+0000 7f62b90bd640 1 -- 172.21.15.112:0/3225827357 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b41115a0 con 0x7f62b4100ea0 2024-09-19T09:26:47.198 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.471+0000 7f62ab7fe640 1 -- 172.21.15.112:0/3225827357 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62a40456c0 con 0x7f62b4100ea0 2024-09-19T09:26:47.198 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.471+0000 7f62b90bd640 1 -- 172.21.15.112:0/3225827357 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b4111ff0 con 0x7f62b4100ea0 2024-09-19T09:26:47.198 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.472+0000 7f62ab7fe640 1 -- 172.21.15.112:0/3225827357 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f62a4038050 con 0x7f62b4100ea0 2024-09-19T09:26:47.199 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.472+0000 7f62b90bd640 1 -- 172.21.15.112:0/3225827357 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b4100300 con 0x7f62b4100ea0 2024-09-19T09:26:47.199 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.472+0000 7f62ab7fe640 1 --2- 172.21.15.112:0/3225827357 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f62a0039580 0x7f62a003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:47.199 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.472+0000 7f62ab7fe640 1 -- 172.21.15.112:0/3225827357 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f62a406d240 con 0x7f62b4100ea0 2024-09-19T09:26:47.199 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.472+0000 7f62b259c640 1 --2- 172.21.15.112:0/3225827357 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f62a0039580 0x7f62a003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:47.199 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.472+0000 7f62b259c640 1 --2- 172.21.15.112:0/3225827357 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f62a0039580 0x7f62a003ba30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f629c006fd0 tx=0x7f629c006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:47.199 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.476+0000 7f62ab7fe640 1 -- 172.21.15.112:0/3225827357 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f62a403a370 con 0x7f62b4100ea0 2024-09-19T09:26:47.199 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.633+0000 7f62b90bd640 1 -- 172.21.15.112:0/3225827357 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f62b404b720 con 0x7f62b4100ea0 2024-09-19T09:26:47.199 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.633+0000 7f62ab7fe640 1 -- 172.21.15.112:0/3225827357 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f62a4041070 con 0x7f62b4100ea0 2024-09-19T09:26:47.199 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.636+0000 7f62b90bd640 1 -- 172.21.15.112:0/3225827357 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f62a0039580 msgr2=0x7f62a003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:47.199 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.636+0000 7f62b90bd640 1 --2- 172.21.15.112:0/3225827357 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f62a0039580 0x7f62a003ba30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f629c006fd0 tx=0x7f629c006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:47.199 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.636+0000 7f62b90bd640 1 -- 172.21.15.112:0/3225827357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b4100ea0 msgr2=0x7f62b4110e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:47.199 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.636+0000 7f62b90bd640 1 --2- 172.21.15.112:0/3225827357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b4100ea0 0x7f62b4110e60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f62a4007660 tx=0x7f62a4009840 comp rx=0 tx=0).stop 2024-09-19T09:26:47.199 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.636+0000 7f62b90bd640 1 -- 172.21.15.112:0/3225827357 shutdown_connections 2024-09-19T09:26:47.199 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.636+0000 7f62b90bd640 1 --2- 172.21.15.112:0/3225827357 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f62a0039580 0x7f62a003ba30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:47.200 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.636+0000 7f62b90bd640 1 --2- 172.21.15.112:0/3225827357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b4100ea0 0x7f62b4110e60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:47.200 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.636+0000 7f62b90bd640 1 -- 172.21.15.112:0/3225827357 >> 172.21.15.112:0/3225827357 conn(0x7f62b40fc700 msgr2=0x7f62b40fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:47.200 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.636+0000 7f62b90bd640 1 -- 172.21.15.112:0/3225827357 shutdown_connections 2024-09-19T09:26:47.200 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:46.636+0000 7f62b90bd640 1 -- 172.21.15.112:0/3225827357 wait complete. 2024-09-19T09:26:47.203 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:26:47.204 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout disabled 2024-09-19T09:26:47.211 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:26:47.212 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout inactive 2024-09-19T09:26:47.212 INFO:teuthology.orchestra.run.smithi112.stdout:firewalld.service is not enabled 2024-09-19T09:26:47.212 INFO:teuthology.orchestra.run.smithi112.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T09:26:47.213 INFO:teuthology.orchestra.run.smithi112.stdout:Ceph Dashboard is now available at: 2024-09-19T09:26:47.213 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:26:47.213 INFO:teuthology.orchestra.run.smithi112.stdout: URL: https://smithi112.front.sepia.ceph.com:8443/ 2024-09-19T09:26:47.214 INFO:teuthology.orchestra.run.smithi112.stdout: User: admin 2024-09-19T09:26:47.214 INFO:teuthology.orchestra.run.smithi112.stdout: Password: 5kgyg2iu4w 2024-09-19T09:26:47.214 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:26:47.214 INFO:teuthology.orchestra.run.smithi112.stdout:Saving cluster configuration to /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config directory 2024-09-19T09:26:47.214 INFO:teuthology.orchestra.run.smithi112.stdout:Enabling autotune for osd_memory_target 2024-09-19T09:26:47.804 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:47 smithi112 ceph-mon[27605]: mgrmap e13: smithi112.puhuua(active, since 6s) 2024-09-19T09:26:47.804 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:47 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3225827357' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T09:26:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.636+0000 7f0c62f7c640 1 Processor -- start 2024-09-19T09:26:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.636+0000 7f0c62f7c640 1 -- start start 2024-09-19T09:26:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.636+0000 7f0c62f7c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c5c076af0 0x7f0c5c104c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.636+0000 7f0c62f7c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c076f00 con 0x7f0c5c076af0 2024-09-19T09:26:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.637+0000 7f0c60d18640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c5c076af0 0x7f0c5c104c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.637+0000 7f0c60d18640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c5c076af0 0x7f0c5c104c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37874/0 (socket says 172.21.15.112:37874) 2024-09-19T09:26:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.637+0000 7f0c60d18640 1 -- 172.21.15.112:0/1034830526 learned_addr learned my addr 172.21.15.112:0/1034830526 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.637+0000 7f0c60d18640 1 -- 172.21.15.112:0/1034830526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c1051c0 con 0x7f0c5c076af0 2024-09-19T09:26:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.637+0000 7f0c60d18640 1 --2- 172.21.15.112:0/1034830526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c5c076af0 0x7f0c5c104c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009840 tx=0x7f0c4c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86aa0026eb3a55f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.638+0000 7f0c5b7fe640 1 -- 172.21.15.112:0/1034830526 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c4c032440 con 0x7f0c5c076af0 2024-09-19T09:26:48.379 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.638+0000 7f0c5b7fe640 1 -- 172.21.15.112:0/1034830526 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0c4c032a40 con 0x7f0c5c076af0 2024-09-19T09:26:48.379 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.638+0000 7f0c5b7fe640 1 -- 172.21.15.112:0/1034830526 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c4c031aa0 con 0x7f0c5c076af0 2024-09-19T09:26:48.379 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.638+0000 7f0c62f7c640 1 -- 172.21.15.112:0/1034830526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c5c076af0 msgr2=0x7f0c5c104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.638+0000 7f0c62f7c640 1 --2- 172.21.15.112:0/1034830526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c5c076af0 0x7f0c5c104c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009840 tx=0x7f0c4c0091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.638+0000 7f0c62f7c640 1 -- 172.21.15.112:0/1034830526 shutdown_connections 2024-09-19T09:26:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.638+0000 7f0c62f7c640 1 --2- 172.21.15.112:0/1034830526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c5c076af0 0x7f0c5c104c80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.638+0000 7f0c62f7c640 1 -- 172.21.15.112:0/1034830526 >> 172.21.15.112:0/1034830526 conn(0x7f0c5c0fc790 msgr2=0x7f0c5c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.638+0000 7f0c62f7c640 1 -- 172.21.15.112:0/1034830526 shutdown_connections 2024-09-19T09:26:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.638+0000 7f0c62f7c640 1 -- 172.21.15.112:0/1034830526 wait complete. 2024-09-19T09:26:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.639+0000 7f0c62f7c640 1 Processor -- start 2024-09-19T09:26:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.639+0000 7f0c62f7c640 1 -- start start 2024-09-19T09:26:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.639+0000 7f0c62f7c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c5c076af0 0x7f0c5c110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.639+0000 7f0c62f7c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c111340 con 0x7f0c5c076af0 2024-09-19T09:26:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.639+0000 7f0c60d18640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c5c076af0 0x7f0c5c110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.639+0000 7f0c60d18640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c5c076af0 0x7f0c5c110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37880/0 (socket says 172.21.15.112:37880) 2024-09-19T09:26:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.639+0000 7f0c60d18640 1 -- 172.21.15.112:0/509939541 learned_addr learned my addr 172.21.15.112:0/509939541 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.640+0000 7f0c60d18640 1 -- 172.21.15.112:0/509939541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c009450 con 0x7f0c5c076af0 2024-09-19T09:26:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.640+0000 7f0c60d18640 1 --2- 172.21.15.112:0/509939541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c5c076af0 0x7f0c5c110e00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c031780 tx=0x7f0c4c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.640+0000 7f0c597fa640 1 -- 172.21.15.112:0/509939541 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c4c0327b0 con 0x7f0c5c076af0 2024-09-19T09:26:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.640+0000 7f0c597fa640 1 -- 172.21.15.112:0/509939541 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0c4c03b8d0 con 0x7f0c5c076af0 2024-09-19T09:26:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.640+0000 7f0c62f7c640 1 -- 172.21.15.112:0/509939541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5c1115a0 con 0x7f0c5c076af0 2024-09-19T09:26:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.640+0000 7f0c597fa640 1 -- 172.21.15.112:0/509939541 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c4c03a790 con 0x7f0c5c076af0 2024-09-19T09:26:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.640+0000 7f0c62f7c640 1 -- 172.21.15.112:0/509939541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5c111f90 con 0x7f0c5c076af0 2024-09-19T09:26:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.641+0000 7f0c597fa640 1 -- 172.21.15.112:0/509939541 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f0c4c039040 con 0x7f0c5c076af0 2024-09-19T09:26:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.641+0000 7f0c62f7c640 1 -- 172.21.15.112:0/509939541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5c04b720 con 0x7f0c5c076af0 2024-09-19T09:26:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.641+0000 7f0c597fa640 1 --2- 172.21.15.112:0/509939541 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f0c440395d0 0x7f0c4403ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.641+0000 7f0c597fa640 1 -- 172.21.15.112:0/509939541 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0c4c06cdb0 con 0x7f0c5c076af0 2024-09-19T09:26:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.641+0000 7f0c5bfff640 1 --2- 172.21.15.112:0/509939541 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f0c440395d0 0x7f0c4403ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.641+0000 7f0c5bfff640 1 --2- 172.21.15.112:0/509939541 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f0c440395d0 0x7f0c4403ba80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0c50006fd0 tx=0x7f0c50006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.645+0000 7f0c597fa640 1 -- 172.21.15.112:0/509939541 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0c4c044400 con 0x7f0c5c076af0 2024-09-19T09:26:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.802+0000 7f0c62f7c640 1 -- 172.21.15.112:0/509939541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f0c5c112120 con 0x7f0c5c076af0 2024-09-19T09:26:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.803+0000 7f0c597fa640 1 -- 172.21.15.112:0/509939541 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f0c4c03f070 con 0x7f0c5c076af0 2024-09-19T09:26:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.805+0000 7f0c62f7c640 1 -- 172.21.15.112:0/509939541 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f0c440395d0 msgr2=0x7f0c4403ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.805+0000 7f0c62f7c640 1 --2- 172.21.15.112:0/509939541 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f0c440395d0 0x7f0c4403ba80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0c50006fd0 tx=0x7f0c50006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.805+0000 7f0c62f7c640 1 -- 172.21.15.112:0/509939541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c5c076af0 msgr2=0x7f0c5c110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.805+0000 7f0c62f7c640 1 --2- 172.21.15.112:0/509939541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c5c076af0 0x7f0c5c110e00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c031780 tx=0x7f0c4c0091d0 comp rx=0 tx=0).stop 2024-09-19T09:26:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.805+0000 7f0c62f7c640 1 -- 172.21.15.112:0/509939541 shutdown_connections 2024-09-19T09:26:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.805+0000 7f0c62f7c640 1 --2- 172.21.15.112:0/509939541 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f0c440395d0 0x7f0c4403ba80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.805+0000 7f0c62f7c640 1 --2- 172.21.15.112:0/509939541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c5c076af0 0x7f0c5c110e00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.805+0000 7f0c62f7c640 1 -- 172.21.15.112:0/509939541 >> 172.21.15.112:0/509939541 conn(0x7f0c5c0fc790 msgr2=0x7f0c5c0fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.805+0000 7f0c62f7c640 1 -- 172.21.15.112:0/509939541 shutdown_connections 2024-09-19T09:26:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:47.805+0000 7f0c62f7c640 1 -- 172.21.15.112:0/509939541 wait complete. 2024-09-19T09:26:49.633 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.795+0000 7f3ff4bd0640 1 Processor -- start 2024-09-19T09:26:49.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.795+0000 7f3ff4bd0640 1 -- start start 2024-09-19T09:26:49.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.795+0000 7f3ff4bd0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ff0101470 0x7f3ff0101880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.795+0000 7f3ff4bd0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff0101dc0 con 0x7f3ff0101470 2024-09-19T09:26:49.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.795+0000 7f3fee59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ff0101470 0x7f3ff0101880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.795+0000 7f3fee59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ff0101470 0x7f3ff0101880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36944/0 (socket says 172.21.15.112:36944) 2024-09-19T09:26:49.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.795+0000 7f3fee59c640 1 -- 172.21.15.112:0/1750788693 learned_addr learned my addr 172.21.15.112:0/1750788693 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:49.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.795+0000 7f3fee59c640 1 -- 172.21.15.112:0/1750788693 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff0101f00 con 0x7f3ff0101470 2024-09-19T09:26:49.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.796+0000 7f3fee59c640 1 --2- 172.21.15.112:0/1750788693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ff0101470 0x7f3ff0101880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000baf0 tx=0x7f3fe000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1324391d1569e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:49.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.796+0000 7f3fed59a640 1 -- 172.21.15.112:0/1750788693 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3fe00327a0 con 0x7f3ff0101470 2024-09-19T09:26:49.634 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.796+0000 7f3fed59a640 1 -- 172.21.15.112:0/1750788693 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3fe0032da0 con 0x7f3ff0101470 2024-09-19T09:26:49.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.796+0000 7f3fed59a640 1 -- 172.21.15.112:0/1750788693 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3fe0031e60 con 0x7f3ff0101470 2024-09-19T09:26:49.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.797+0000 7f3ff4bd0640 1 -- 172.21.15.112:0/1750788693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ff0101470 msgr2=0x7f3ff0101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:49.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.797+0000 7f3ff4bd0640 1 --2- 172.21.15.112:0/1750788693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ff0101470 0x7f3ff0101880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000baf0 tx=0x7f3fe000b460 comp rx=0 tx=0).stop 2024-09-19T09:26:49.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.797+0000 7f3ff4bd0640 1 -- 172.21.15.112:0/1750788693 shutdown_connections 2024-09-19T09:26:49.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.797+0000 7f3ff4bd0640 1 --2- 172.21.15.112:0/1750788693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ff0101470 0x7f3ff0101880 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.797+0000 7f3ff4bd0640 1 -- 172.21.15.112:0/1750788693 >> 172.21.15.112:0/1750788693 conn(0x7f3ff00fbdc0 msgr2=0x7f3ff00fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:49.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.797+0000 7f3ff4bd0640 1 -- 172.21.15.112:0/1750788693 shutdown_connections 2024-09-19T09:26:49.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.797+0000 7f3ff4bd0640 1 -- 172.21.15.112:0/1750788693 wait complete. 2024-09-19T09:26:49.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.798+0000 7f3ff4bd0640 1 Processor -- start 2024-09-19T09:26:49.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.798+0000 7f3ff4bd0640 1 -- start start 2024-09-19T09:26:49.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.798+0000 7f3ff4bd0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ff0101470 0x7f3ff0112f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.798+0000 7f3ff4bd0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff01134b0 con 0x7f3ff0101470 2024-09-19T09:26:49.635 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.798+0000 7f3fee59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ff0101470 0x7f3ff0112f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.798+0000 7f3fee59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ff0101470 0x7f3ff0112f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36952/0 (socket says 172.21.15.112:36952) 2024-09-19T09:26:49.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.798+0000 7f3fee59c640 1 -- 172.21.15.112:0/291212282 learned_addr learned my addr 172.21.15.112:0/291212282 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:49.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.798+0000 7f3fee59c640 1 -- 172.21.15.112:0/291212282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe000b700 con 0x7f3ff0101470 2024-09-19T09:26:49.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.799+0000 7f3fee59c640 1 --2- 172.21.15.112:0/291212282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ff0101470 0x7f3ff0112f70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0031b40 tx=0x7f3fe0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:49.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.799+0000 7f3fdeffd640 1 -- 172.21.15.112:0/291212282 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3fe0032a80 con 0x7f3ff0101470 2024-09-19T09:26:49.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.799+0000 7f3fdeffd640 1 -- 172.21.15.112:0/291212282 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3fe0032be0 con 0x7f3ff0101470 2024-09-19T09:26:49.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.799+0000 7f3ff4bd0640 1 -- 172.21.15.112:0/291212282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff01136b0 con 0x7f3ff0101470 2024-09-19T09:26:49.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.799+0000 7f3fdeffd640 1 -- 172.21.15.112:0/291212282 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3fe00456b0 con 0x7f3ff0101470 2024-09-19T09:26:49.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.799+0000 7f3ff4bd0640 1 -- 172.21.15.112:0/291212282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff0113b20 con 0x7f3ff0101470 2024-09-19T09:26:49.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.800+0000 7f3fdeffd640 1 -- 172.21.15.112:0/291212282 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f3fe00458e0 con 0x7f3ff0101470 2024-09-19T09:26:49.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.800+0000 7f3fdeffd640 1 --2- 172.21.15.112:0/291212282 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f3fd80395d0 0x7f3fd803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.800+0000 7f3ff4bd0640 1 -- 172.21.15.112:0/291212282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff004b720 con 0x7f3ff0101470 2024-09-19T09:26:49.636 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.800+0000 7f3fdeffd640 1 -- 172.21.15.112:0/291212282 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3fe006dac0 con 0x7f3ff0101470 2024-09-19T09:26:49.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.800+0000 7f3fedd9b640 1 --2- 172.21.15.112:0/291212282 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f3fd80395d0 0x7f3fd803ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.800+0000 7f3fedd9b640 1 --2- 172.21.15.112:0/291212282 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f3fd80395d0 0x7f3fd803ba80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4006fd0 tx=0x7f3fe4006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:49.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:48.804+0000 7f3fdeffd640 1 -- 172.21.15.112:0/291212282 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3fe0036030 con 0x7f3ff0101470 2024-09-19T09:26:49.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:49.042+0000 7f3ff4bd0640 1 -- 172.21.15.112:0/291212282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f3ff0100c70 con 0x7f3ff0101470 2024-09-19T09:26:49.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:49.044+0000 7f3fdeffd640 1 -- 172.21.15.112:0/291212282 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f3fe0039b40 con 0x7f3ff0101470 2024-09-19T09:26:49.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T09:26:49.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:49.046+0000 7f3ff4bd0640 1 -- 172.21.15.112:0/291212282 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f3fd80395d0 msgr2=0x7f3fd803ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:49.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:49.046+0000 7f3ff4bd0640 1 --2- 172.21.15.112:0/291212282 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f3fd80395d0 0x7f3fd803ba80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4006fd0 tx=0x7f3fe4006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:49.046+0000 7f3ff4bd0640 1 -- 172.21.15.112:0/291212282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ff0101470 msgr2=0x7f3ff0112f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:49.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:49.046+0000 7f3ff4bd0640 1 --2- 172.21.15.112:0/291212282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ff0101470 0x7f3ff0112f70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0031b40 tx=0x7f3fe0008040 comp rx=0 tx=0).stop 2024-09-19T09:26:49.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:49.046+0000 7f3ff4bd0640 1 -- 172.21.15.112:0/291212282 shutdown_connections 2024-09-19T09:26:49.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:49.046+0000 7f3ff4bd0640 1 --2- 172.21.15.112:0/291212282 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f3fd80395d0 0x7f3fd803ba80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.637 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:49.046+0000 7f3ff4bd0640 1 --2- 172.21.15.112:0/291212282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ff0101470 0x7f3ff0112f70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.638 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:49.046+0000 7f3ff4bd0640 1 -- 172.21.15.112:0/291212282 >> 172.21.15.112:0/291212282 conn(0x7f3ff00fbdc0 msgr2=0x7f3ff0105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:49.638 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:49.047+0000 7f3ff4bd0640 1 -- 172.21.15.112:0/291212282 shutdown_connections 2024-09-19T09:26:49.638 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr 2024-09-19T09:26:49.047+0000 7f3ff4bd0640 1 -- 172.21.15.112:0/291212282 wait complete. 2024-09-19T09:26:49.638 INFO:teuthology.orchestra.run.smithi112.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T09:26:49.638 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:26:49.638 INFO:teuthology.orchestra.run.smithi112.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:26:49.638 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:26:49.638 INFO:teuthology.orchestra.run.smithi112.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T09:26:49.638 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:26:49.638 INFO:teuthology.orchestra.run.smithi112.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T09:26:49.638 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:26:49.638 INFO:teuthology.orchestra.run.smithi112.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T09:26:49.638 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:26:49.638 INFO:teuthology.orchestra.run.smithi112.stdout: ceph telemetry on 2024-09-19T09:26:49.638 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:26:49.639 INFO:teuthology.orchestra.run.smithi112.stdout:For more information see: 2024-09-19T09:26:49.639 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:26:49.639 INFO:teuthology.orchestra.run.smithi112.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-19T09:26:49.639 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:26:49.639 INFO:teuthology.orchestra.run.smithi112.stdout:Bootstrap complete. 2024-09-19T09:26:49.670 INFO:tasks.cephadm:Fetching config... 2024-09-19T09:26:49.671 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:26:49.671 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T09:26:49.687 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T09:26:49.687 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:26:49.687 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T09:26:49.743 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T09:26:49.743 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:26:49.743 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/keyring of=/dev/stdout 2024-09-19T09:26:49.808 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T09:26:49.808 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:26:49.808 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T09:26:49.863 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T09:26:49.864 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCz4DY/MkY6kDlFntT8XAsMTa7iJ1tJKDctz5ss+w0fLf/yyHsepRDKclqG8Pa24IBySkGPj4hkXDUK3hjJnQkaX50UPiY+1aTguuglyudcZ81A47JdBRfBB+Wre66fETzcAYKI54YYDYM/+0M2rbTBV/ZGdWdgSFHSlN/HZoRaTZIRN08Pg9tK6gEJn0OHGuLGoqhTmKPFfApC+m/S61L66Wgi6uO6z/vEFplfBQPNQxa45nrlEF1Rr00Yc2y3fyUoK+7Jv5pam1kfdlXrhhIR4D4JYfE8Sk+fd59miDMGMLg4jRUaBGrbWcxV2SgXEMLV27w/vX1BmZLTYesjEhMBBqdAHb9YsW55I5JGKdz/s/AzCGtdXh9KJgZqrl7ZrHLAe+BLPn8jdA538lEt3l9G03Y6ft249TWGow4nS01cQNuNTXRB8jnItzR4+PNw8xcq/psqGqMmRQ2lD68HJZCeB2JcRcT9kKa0UyyRsahkHKd3B8/3G2YbyWuWo4xTsRk= ceph-0bd98d30-7669-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:26:49.942 INFO:teuthology.orchestra.run.smithi112.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCz4DY/MkY6kDlFntT8XAsMTa7iJ1tJKDctz5ss+w0fLf/yyHsepRDKclqG8Pa24IBySkGPj4hkXDUK3hjJnQkaX50UPiY+1aTguuglyudcZ81A47JdBRfBB+Wre66fETzcAYKI54YYDYM/+0M2rbTBV/ZGdWdgSFHSlN/HZoRaTZIRN08Pg9tK6gEJn0OHGuLGoqhTmKPFfApC+m/S61L66Wgi6uO6z/vEFplfBQPNQxa45nrlEF1Rr00Yc2y3fyUoK+7Jv5pam1kfdlXrhhIR4D4JYfE8Sk+fd59miDMGMLg4jRUaBGrbWcxV2SgXEMLV27w/vX1BmZLTYesjEhMBBqdAHb9YsW55I5JGKdz/s/AzCGtdXh9KJgZqrl7ZrHLAe+BLPn8jdA538lEt3l9G03Y6ft249TWGow4nS01cQNuNTXRB8jnItzR4+PNw8xcq/psqGqMmRQ2lD68HJZCeB2JcRcT9kKa0UyyRsahkHKd3B8/3G2YbyWuWo4xTsRk= ceph-0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:26:49.956 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCz4DY/MkY6kDlFntT8XAsMTa7iJ1tJKDctz5ss+w0fLf/yyHsepRDKclqG8Pa24IBySkGPj4hkXDUK3hjJnQkaX50UPiY+1aTguuglyudcZ81A47JdBRfBB+Wre66fETzcAYKI54YYDYM/+0M2rbTBV/ZGdWdgSFHSlN/HZoRaTZIRN08Pg9tK6gEJn0OHGuLGoqhTmKPFfApC+m/S61L66Wgi6uO6z/vEFplfBQPNQxa45nrlEF1Rr00Yc2y3fyUoK+7Jv5pam1kfdlXrhhIR4D4JYfE8Sk+fd59miDMGMLg4jRUaBGrbWcxV2SgXEMLV27w/vX1BmZLTYesjEhMBBqdAHb9YsW55I5JGKdz/s/AzCGtdXh9KJgZqrl7ZrHLAe+BLPn8jdA538lEt3l9G03Y6ft249TWGow4nS01cQNuNTXRB8jnItzR4+PNw8xcq/psqGqMmRQ2lD68HJZCeB2JcRcT9kKa0UyyRsahkHKd3B8/3G2YbyWuWo4xTsRk= ceph-0bd98d30-7669-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:26:50.010 INFO:teuthology.orchestra.run.smithi191.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCz4DY/MkY6kDlFntT8XAsMTa7iJ1tJKDctz5ss+w0fLf/yyHsepRDKclqG8Pa24IBySkGPj4hkXDUK3hjJnQkaX50UPiY+1aTguuglyudcZ81A47JdBRfBB+Wre66fETzcAYKI54YYDYM/+0M2rbTBV/ZGdWdgSFHSlN/HZoRaTZIRN08Pg9tK6gEJn0OHGuLGoqhTmKPFfApC+m/S61L66Wgi6uO6z/vEFplfBQPNQxa45nrlEF1Rr00Yc2y3fyUoK+7Jv5pam1kfdlXrhhIR4D4JYfE8Sk+fd59miDMGMLg4jRUaBGrbWcxV2SgXEMLV27w/vX1BmZLTYesjEhMBBqdAHb9YsW55I5JGKdz/s/AzCGtdXh9KJgZqrl7ZrHLAe+BLPn8jdA538lEt3l9G03Y6ft249TWGow4nS01cQNuNTXRB8jnItzR4+PNw8xcq/psqGqMmRQ2lD68HJZCeB2JcRcT9kKa0UyyRsahkHKd3B8/3G2YbyWuWo4xTsRk= ceph-0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:26:50.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T09:26:50.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:50 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/291212282' entity='client.admin' 2024-09-19T09:26:50.266 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:26:52.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.474+0000 7f13a1b02640 1 -- 172.21.15.112:0/14630298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c0fb6a0 msgr2=0x7f139c0fbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:52.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.474+0000 7f13a1b02640 1 --2- 172.21.15.112:0/14630298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c0fb6a0 0x7f139c0fbab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f138c004850 tx=0x7f138c009da0 comp rx=0 tx=0).stop 2024-09-19T09:26:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.474+0000 7f13a1b02640 1 -- 172.21.15.112:0/14630298 shutdown_connections 2024-09-19T09:26:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.474+0000 7f13a1b02640 1 --2- 172.21.15.112:0/14630298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c0fb6a0 0x7f139c0fbab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.474+0000 7f13a1b02640 1 -- 172.21.15.112:0/14630298 >> 172.21.15.112:0/14630298 conn(0x7f139c0f6010 msgr2=0x7f139c0f8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.474+0000 7f13a1b02640 1 -- 172.21.15.112:0/14630298 shutdown_connections 2024-09-19T09:26:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.474+0000 7f13a1b02640 1 -- 172.21.15.112:0/14630298 wait complete. 2024-09-19T09:26:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.474+0000 7f13a1b02640 1 Processor -- start 2024-09-19T09:26:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.474+0000 7f13a1b02640 1 -- start start 2024-09-19T09:26:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.475+0000 7f13a1b02640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c0fb6a0 0x7f139c10c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.475+0000 7f13a1b02640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c10cca0 con 0x7f139c0fb6a0 2024-09-19T09:26:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.475+0000 7f139b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c0fb6a0 0x7f139c10c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.475+0000 7f139b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c0fb6a0 0x7f139c10c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36964/0 (socket says 172.21.15.112:36964) 2024-09-19T09:26:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.475+0000 7f139b7fe640 1 -- 172.21.15.112:0/501762674 learned_addr learned my addr 172.21.15.112:0/501762674 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.475+0000 7f139b7fe640 1 -- 172.21.15.112:0/501762674 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c005040 con 0x7f139c0fb6a0 2024-09-19T09:26:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.475+0000 7f139b7fe640 1 --2- 172.21.15.112:0/501762674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c0fb6a0 0x7f139c10c760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f138c02a6d0 tx=0x7f138c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.475+0000 7f1383fff640 1 -- 172.21.15.112:0/501762674 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f138c033630 con 0x7f139c0fb6a0 2024-09-19T09:26:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.475+0000 7f13a1b02640 1 -- 172.21.15.112:0/501762674 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c10cea0 con 0x7f139c0fb6a0 2024-09-19T09:26:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.475+0000 7f13a1b02640 1 -- 172.21.15.112:0/501762674 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139c10d310 con 0x7f139c0fb6a0 2024-09-19T09:26:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.476+0000 7f1383fff640 1 -- 172.21.15.112:0/501762674 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f138c033c30 con 0x7f139c0fb6a0 2024-09-19T09:26:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.476+0000 7f1383fff640 1 -- 172.21.15.112:0/501762674 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f138c03dc30 con 0x7f139c0fb6a0 2024-09-19T09:26:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.477+0000 7f1383fff640 1 -- 172.21.15.112:0/501762674 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f138c030020 con 0x7f139c0fb6a0 2024-09-19T09:26:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.477+0000 7f1383fff640 1 --2- 172.21.15.112:0/501762674 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f13840395d0 0x7f138403ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.477+0000 7f1383fff640 1 -- 172.21.15.112:0/501762674 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f138c06d880 con 0x7f139c0fb6a0 2024-09-19T09:26:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.477+0000 7f139affd640 1 --2- 172.21.15.112:0/501762674 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f13840395d0 0x7f138403ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.477+0000 7f13a1b02640 1 -- 172.21.15.112:0/501762674 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1388005240 con 0x7f139c0fb6a0 2024-09-19T09:26:52.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.478+0000 7f139affd640 1 --2- 172.21.15.112:0/501762674 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f13840395d0 0x7f138403ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1390006fd0 tx=0x7f1390006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:52.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.482+0000 7f1383fff640 1 -- 172.21.15.112:0/501762674 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f138c03b570 con 0x7f139c0fb6a0 2024-09-19T09:26:52.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.645+0000 7f13a1b02640 1 -- 172.21.15.112:0/501762674 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f1388005a70 con 0x7f139c0fb6a0 2024-09-19T09:26:52.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.649+0000 7f1383fff640 1 -- 172.21.15.112:0/501762674 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f138c045c20 con 0x7f139c0fb6a0 2024-09-19T09:26:52.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.651+0000 7f13a1b02640 1 -- 172.21.15.112:0/501762674 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f13840395d0 msgr2=0x7f138403ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:52.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.651+0000 7f13a1b02640 1 --2- 172.21.15.112:0/501762674 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f13840395d0 0x7f138403ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1390006fd0 tx=0x7f1390006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:52.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.651+0000 7f13a1b02640 1 -- 172.21.15.112:0/501762674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c0fb6a0 msgr2=0x7f139c10c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:52.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.651+0000 7f13a1b02640 1 --2- 172.21.15.112:0/501762674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c0fb6a0 0x7f139c10c760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f138c02a6d0 tx=0x7f138c009da0 comp rx=0 tx=0).stop 2024-09-19T09:26:52.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.651+0000 7f13a1b02640 1 -- 172.21.15.112:0/501762674 shutdown_connections 2024-09-19T09:26:52.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.651+0000 7f13a1b02640 1 --2- 172.21.15.112:0/501762674 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f13840395d0 0x7f138403ba80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:52.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.651+0000 7f13a1b02640 1 --2- 172.21.15.112:0/501762674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c0fb6a0 0x7f139c10c760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:52.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.651+0000 7f13a1b02640 1 -- 172.21.15.112:0/501762674 >> 172.21.15.112:0/501762674 conn(0x7f139c0f6010 msgr2=0x7f139c0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:52.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.651+0000 7f13a1b02640 1 -- 172.21.15.112:0/501762674 shutdown_connections 2024-09-19T09:26:52.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:52.651+0000 7f13a1b02640 1 -- 172.21.15.112:0/501762674 wait complete. 2024-09-19T09:26:53.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:53 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:53.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:53 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:53.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:53 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:26:53.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:53 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:53.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:53 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:26:53.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:53 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-19T09:26:53.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:53 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:26:53.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:53 smithi112 ceph-mon[27605]: Deploying daemon crash.smithi112 on smithi112 2024-09-19T09:26:53.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:53 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/501762674' entity='client.admin' 2024-09-19T09:26:53.564 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T09:26:53.564 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T09:26:54.345 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:26:56.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.834+0000 7fcfeb44b640 1 -- 172.21.15.112:0/2132072591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfe4064c50 msgr2=0x7fcfe40fa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:56.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.834+0000 7fcfeb44b640 1 --2- 172.21.15.112:0/2132072591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfe4064c50 0x7fcfe40fa860 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0004850 tx=0x7fcfe0009da0 comp rx=0 tx=0).stop 2024-09-19T09:26:56.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.834+0000 7fcfeb44b640 1 -- 172.21.15.112:0/2132072591 shutdown_connections 2024-09-19T09:26:56.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.834+0000 7fcfeb44b640 1 --2- 172.21.15.112:0/2132072591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfe4064c50 0x7fcfe40fa860 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:56.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.834+0000 7fcfeb44b640 1 -- 172.21.15.112:0/2132072591 >> 172.21.15.112:0/2132072591 conn(0x7fcfe40f6040 msgr2=0x7fcfe40f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:56.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.834+0000 7fcfeb44b640 1 -- 172.21.15.112:0/2132072591 shutdown_connections 2024-09-19T09:26:56.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.835+0000 7fcfeb44b640 1 -- 172.21.15.112:0/2132072591 wait complete. 2024-09-19T09:26:56.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.835+0000 7fcfeb44b640 1 Processor -- start 2024-09-19T09:26:56.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.835+0000 7fcfeb44b640 1 -- start start 2024-09-19T09:26:56.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.835+0000 7fcfeb44b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfe4064c50 0x7fcfe410b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:56.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.835+0000 7fcfeb44b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe410bb70 con 0x7fcfe4064c50 2024-09-19T09:26:56.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.835+0000 7fcfe91e7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfe4064c50 0x7fcfe410b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:56.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.835+0000 7fcfe91e7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfe4064c50 0x7fcfe410b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36986/0 (socket says 172.21.15.112:36986) 2024-09-19T09:26:56.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.835+0000 7fcfe91e7640 1 -- 172.21.15.112:0/3718742607 learned_addr learned my addr 172.21.15.112:0/3718742607 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:56.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.836+0000 7fcfe91e7640 1 -- 172.21.15.112:0/3718742607 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe0005040 con 0x7fcfe4064c50 2024-09-19T09:26:56.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.836+0000 7fcfe91e7640 1 --2- 172.21.15.112:0/3718742607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfe4064c50 0x7fcfe410b630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0000c00 tx=0x7fcfe0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:56.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.836+0000 7fcfd9ffb640 1 -- 172.21.15.112:0/3718742607 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfe0033630 con 0x7fcfe4064c50 2024-09-19T09:26:56.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.836+0000 7fcfd9ffb640 1 -- 172.21.15.112:0/3718742607 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcfe0033c30 con 0x7fcfe4064c50 2024-09-19T09:26:56.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.836+0000 7fcfeb44b640 1 -- 172.21.15.112:0/3718742607 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe410bd70 con 0x7fcfe4064c50 2024-09-19T09:26:56.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.836+0000 7fcfd9ffb640 1 -- 172.21.15.112:0/3718742607 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfe003fbc0 con 0x7fcfe4064c50 2024-09-19T09:26:56.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.836+0000 7fcfeb44b640 1 -- 172.21.15.112:0/3718742607 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe410c1e0 con 0x7fcfe4064c50 2024-09-19T09:26:56.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.837+0000 7fcfd9ffb640 1 -- 172.21.15.112:0/3718742607 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fcfe0030020 con 0x7fcfe4064c50 2024-09-19T09:26:56.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.837+0000 7fcfd9ffb640 1 --2- 172.21.15.112:0/3718742607 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fcfd00395d0 0x7fcfd003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:56.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.837+0000 7fcfd9ffb640 1 -- 172.21.15.112:0/3718742607 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcfe006e630 con 0x7fcfe4064c50 2024-09-19T09:26:56.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.837+0000 7fcfe89e6640 1 --2- 172.21.15.112:0/3718742607 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fcfd00395d0 0x7fcfd003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:56.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.837+0000 7fcfeb44b640 1 -- 172.21.15.112:0/3718742607 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe4101510 con 0x7fcfe4064c50 2024-09-19T09:26:56.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.838+0000 7fcfe89e6640 1 --2- 172.21.15.112:0/3718742607 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fcfd00395d0 0x7fcfd003ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4006fd0 tx=0x7fcfd4006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:56.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:56.842+0000 7fcfd9ffb640 1 -- 172.21.15.112:0/3718742607 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcfe003d5a0 con 0x7fcfe4064c50 2024-09-19T09:26:57.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:57.004+0000 7fcfeb44b640 1 -- 172.21.15.112:0/3718742607 --> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfe410c900 con 0x7fcfd00395d0 2024-09-19T09:26:57.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:57.007+0000 7fcfd9ffb640 1 -- 172.21.15.112:0/3718742607 <== mgr.14158 v2:172.21.15.112:6800/3210372910 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcfe410c900 con 0x7fcfd00395d0 2024-09-19T09:26:57.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:57.010+0000 7fcfeb44b640 1 -- 172.21.15.112:0/3718742607 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fcfd00395d0 msgr2=0x7fcfd003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:57.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:57.010+0000 7fcfeb44b640 1 --2- 172.21.15.112:0/3718742607 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fcfd00395d0 0x7fcfd003ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4006fd0 tx=0x7fcfd4006db0 comp rx=0 tx=0).stop 2024-09-19T09:26:57.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:57.010+0000 7fcfeb44b640 1 -- 172.21.15.112:0/3718742607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfe4064c50 msgr2=0x7fcfe410b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:57.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:57.010+0000 7fcfeb44b640 1 --2- 172.21.15.112:0/3718742607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfe4064c50 0x7fcfe410b630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0000c00 tx=0x7fcfe0009da0 comp rx=0 tx=0).stop 2024-09-19T09:26:57.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:57.010+0000 7fcfeb44b640 1 -- 172.21.15.112:0/3718742607 shutdown_connections 2024-09-19T09:26:57.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:57.010+0000 7fcfeb44b640 1 --2- 172.21.15.112:0/3718742607 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fcfd00395d0 0x7fcfd003ba80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:57.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:57.010+0000 7fcfeb44b640 1 --2- 172.21.15.112:0/3718742607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfe4064c50 0x7fcfe410b630 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:57.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:57.010+0000 7fcfeb44b640 1 -- 172.21.15.112:0/3718742607 >> 172.21.15.112:0/3718742607 conn(0x7fcfe40f6040 msgr2=0x7fcfe40f68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:57.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:57.010+0000 7fcfeb44b640 1 -- 172.21.15.112:0/3718742607 shutdown_connections 2024-09-19T09:26:57.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:57.010+0000 7fcfeb44b640 1 -- 172.21.15.112:0/3718742607 wait complete. 2024-09-19T09:26:58.026 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi191 2024-09-19T09:26:58.026 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:26:58.027 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.conf 2024-09-19T09:26:58.046 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:26:58.046 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:26:58.105 INFO:tasks.cephadm:Adding host smithi191 to orchestrator... 2024-09-19T09:26:58.106 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph orch host add smithi191 2024-09-19T09:26:58.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:58 smithi112 ceph-mon[27605]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:26:58.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:58 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:58.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:58 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:58.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:58 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:58 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:58 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:26:58.363 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:26:59.383 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:26:59 smithi112 ceph-mon[27605]: Deploying daemon node-exporter.smithi112 on smithi112 2024-09-19T09:26:59.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.872+0000 7feca47da640 1 -- 172.21.15.112:0/1851413823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec9c0fc1b0 msgr2=0x7fec9c0fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:59.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.872+0000 7feca47da640 1 --2- 172.21.15.112:0/1851413823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec9c0fc1b0 0x7fec9c0fc5c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009bd0 tx=0x7fec8c004d10 comp rx=0 tx=0).stop 2024-09-19T09:26:59.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.872+0000 7feca47da640 1 -- 172.21.15.112:0/1851413823 shutdown_connections 2024-09-19T09:26:59.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.872+0000 7feca47da640 1 --2- 172.21.15.112:0/1851413823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec9c0fc1b0 0x7fec9c0fc5c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:59.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.872+0000 7feca47da640 1 -- 172.21.15.112:0/1851413823 >> 172.21.15.112:0/1851413823 conn(0x7fec9c0f7990 msgr2=0x7fec9c0f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:59.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.872+0000 7feca47da640 1 -- 172.21.15.112:0/1851413823 shutdown_connections 2024-09-19T09:26:59.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.872+0000 7feca47da640 1 -- 172.21.15.112:0/1851413823 wait complete. 2024-09-19T09:26:59.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.872+0000 7feca47da640 1 Processor -- start 2024-09-19T09:26:59.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.872+0000 7feca47da640 1 -- start start 2024-09-19T09:26:59.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.873+0000 7feca47da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec9c0fc1b0 0x7fec9c10c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:59.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.873+0000 7feca47da640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c10cc30 con 0x7fec9c0fc1b0 2024-09-19T09:26:59.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.873+0000 7feca2576640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec9c0fc1b0 0x7fec9c10c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:59.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.873+0000 7feca2576640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec9c0fc1b0 0x7fec9c10c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48010/0 (socket says 172.21.15.112:48010) 2024-09-19T09:26:59.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.873+0000 7feca2576640 1 -- 172.21.15.112:0/4246514169 learned_addr learned my addr 172.21.15.112:0/4246514169 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:26:59.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.873+0000 7feca2576640 1 -- 172.21.15.112:0/4246514169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c0098b0 con 0x7fec9c0fc1b0 2024-09-19T09:26:59.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.873+0000 7feca2576640 1 --2- 172.21.15.112:0/4246514169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec9c0fc1b0 0x7fec9c10c6f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fec8c003400 tx=0x7fec8c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:59.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.873+0000 7fec9affd640 1 -- 172.21.15.112:0/4246514169 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec8c032910 con 0x7fec9c0fc1b0 2024-09-19T09:26:59.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.873+0000 7fec9affd640 1 -- 172.21.15.112:0/4246514169 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fec8c03d420 con 0x7fec9c0fc1b0 2024-09-19T09:26:59.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.873+0000 7fec9affd640 1 -- 172.21.15.112:0/4246514169 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec8c031590 con 0x7fec9c0fc1b0 2024-09-19T09:26:59.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.873+0000 7feca47da640 1 -- 172.21.15.112:0/4246514169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9c10ce30 con 0x7fec9c0fc1b0 2024-09-19T09:26:59.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.873+0000 7feca47da640 1 -- 172.21.15.112:0/4246514169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9c10d9c0 con 0x7fec9c0fc1b0 2024-09-19T09:26:59.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.874+0000 7fec9affd640 1 -- 172.21.15.112:0/4246514169 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fec8c02f030 con 0x7fec9c0fc1b0 2024-09-19T09:26:59.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.874+0000 7feca47da640 1 -- 172.21.15.112:0/4246514169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9c1025d0 con 0x7fec9c0fc1b0 2024-09-19T09:26:59.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.874+0000 7fec9affd640 1 --2- 172.21.15.112:0/4246514169 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fec840395d0 0x7fec8403ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:59.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.874+0000 7fec9affd640 1 -- 172.21.15.112:0/4246514169 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fec8c06d730 con 0x7fec9c0fc1b0 2024-09-19T09:26:59.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.875+0000 7feca1d75640 1 --2- 172.21.15.112:0/4246514169 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fec840395d0 0x7fec8403ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:59.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.875+0000 7feca1d75640 1 --2- 172.21.15.112:0/4246514169 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fec840395d0 0x7fec8403ba80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fec90006fd0 tx=0x7fec90006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:59.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:26:59.879+0000 7fec9affd640 1 -- 172.21.15.112:0/4246514169 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fec8c04e530 con 0x7fec9c0fc1b0 2024-09-19T09:27:00.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:00.038+0000 7feca47da640 1 -- 172.21.15.112:0/4246514169 --> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}) v1 -- 0x7fec9c10db50 con 0x7fec840395d0 2024-09-19T09:27:00.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:00 smithi112 ceph-mon[27605]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:27:01.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:01 smithi112 ceph-mon[27605]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:01.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:01 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:01.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:01 smithi112 ceph-mon[27605]: Deploying cephadm binary to smithi191 2024-09-19T09:27:02.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:02.862+0000 7fec9affd640 1 -- 172.21.15.112:0/4246514169 <== mgr.14158 v2:172.21.15.112:6800/3210372910 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fec9c10db50 con 0x7fec840395d0 2024-09-19T09:27:02.866 INFO:teuthology.orchestra.run.smithi112.stdout:Added host 'smithi191' with addr '172.21.15.191' 2024-09-19T09:27:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:02.864+0000 7feca47da640 1 -- 172.21.15.112:0/4246514169 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fec840395d0 msgr2=0x7fec8403ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:02.864+0000 7feca47da640 1 --2- 172.21.15.112:0/4246514169 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fec840395d0 0x7fec8403ba80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fec90006fd0 tx=0x7fec90006db0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:02.864+0000 7feca47da640 1 -- 172.21.15.112:0/4246514169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec9c0fc1b0 msgr2=0x7fec9c10c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:02.864+0000 7feca47da640 1 --2- 172.21.15.112:0/4246514169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec9c0fc1b0 0x7fec9c10c6f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fec8c003400 tx=0x7fec8c004d10 comp rx=0 tx=0).stop 2024-09-19T09:27:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:02.864+0000 7feca47da640 1 -- 172.21.15.112:0/4246514169 shutdown_connections 2024-09-19T09:27:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:02.864+0000 7feca47da640 1 --2- 172.21.15.112:0/4246514169 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fec840395d0 0x7fec8403ba80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:02.864+0000 7feca47da640 1 --2- 172.21.15.112:0/4246514169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec9c0fc1b0 0x7fec9c10c6f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:02.864+0000 7feca47da640 1 -- 172.21.15.112:0/4246514169 >> 172.21.15.112:0/4246514169 conn(0x7fec9c0f7990 msgr2=0x7fec9c0f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:02.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:02.864+0000 7feca47da640 1 -- 172.21.15.112:0/4246514169 shutdown_connections 2024-09-19T09:27:02.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:02.864+0000 7feca47da640 1 -- 172.21.15.112:0/4246514169 wait complete. 2024-09-19T09:27:03.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:03 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:03.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:03 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:03.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:03 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:03.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:03 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:03.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:03 smithi112 ceph-mon[27605]: Deploying daemon alertmanager.smithi112 on smithi112 2024-09-19T09:27:03.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:03 smithi112 ceph-mon[27605]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:03.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:03 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:03.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:03 smithi112 ceph-mon[27605]: Added host smithi191 2024-09-19T09:27:03.610 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T09:27:03.850 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:27:05.792 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:05 smithi112 ceph-mon[27605]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:05.792 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:05 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:06.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.269+0000 7f2a2ced2640 1 -- 172.21.15.112:0/30116817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a280fa830 msgr2=0x7f2a280fac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:06.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.269+0000 7f2a2ced2640 1 --2- 172.21.15.112:0/30116817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a280fa830 0x7f2a280fac40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2a18004850 tx=0x7f2a18009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.269+0000 7f2a2ced2640 1 -- 172.21.15.112:0/30116817 shutdown_connections 2024-09-19T09:27:06.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.269+0000 7f2a2ced2640 1 --2- 172.21.15.112:0/30116817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a280fa830 0x7f2a280fac40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.269+0000 7f2a2ced2640 1 -- 172.21.15.112:0/30116817 >> 172.21.15.112:0/30116817 conn(0x7f2a280f6010 msgr2=0x7f2a280f8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:06.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.269+0000 7f2a2ced2640 1 -- 172.21.15.112:0/30116817 shutdown_connections 2024-09-19T09:27:06.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.269+0000 7f2a2ced2640 1 -- 172.21.15.112:0/30116817 wait complete. 2024-09-19T09:27:06.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.270+0000 7f2a2ced2640 1 Processor -- start 2024-09-19T09:27:06.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.270+0000 7f2a2ced2640 1 -- start start 2024-09-19T09:27:06.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.270+0000 7f2a2ced2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a280fa830 0x7f2a2810c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.270+0000 7f2a2ced2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2810cc70 con 0x7f2a280fa830 2024-09-19T09:27:06.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.270+0000 7f2a2659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a280fa830 0x7f2a2810c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.270+0000 7f2a2659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a280fa830 0x7f2a2810c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48030/0 (socket says 172.21.15.112:48030) 2024-09-19T09:27:06.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.270+0000 7f2a2659c640 1 -- 172.21.15.112:0/3654079182 learned_addr learned my addr 172.21.15.112:0/3654079182 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:27:06.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.271+0000 7f2a2659c640 1 -- 172.21.15.112:0/3654079182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a18005040 con 0x7f2a280fa830 2024-09-19T09:27:06.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.271+0000 7f2a2659c640 1 --2- 172.21.15.112:0/3654079182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a280fa830 0x7f2a2810c730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009920 tx=0x7f2a18009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:06.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.271+0000 7f2a1effd640 1 -- 172.21.15.112:0/3654079182 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a18033630 con 0x7f2a280fa830 2024-09-19T09:27:06.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.272+0000 7f2a1effd640 1 -- 172.21.15.112:0/3654079182 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2a18033c30 con 0x7f2a280fa830 2024-09-19T09:27:06.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.272+0000 7f2a1effd640 1 -- 172.21.15.112:0/3654079182 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a1803dc40 con 0x7f2a280fa830 2024-09-19T09:27:06.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.272+0000 7f2a2ced2640 1 -- 172.21.15.112:0/3654079182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2810ce70 con 0x7f2a280fa830 2024-09-19T09:27:06.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.272+0000 7f2a2ced2640 1 -- 172.21.15.112:0/3654079182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2810d2e0 con 0x7f2a280fa830 2024-09-19T09:27:06.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.273+0000 7f2a1effd640 1 -- 172.21.15.112:0/3654079182 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f2a18030020 con 0x7f2a280fa830 2024-09-19T09:27:06.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.273+0000 7f2a1effd640 1 --2- 172.21.15.112:0/3654079182 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f2a14039580 0x7f2a1403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.273+0000 7f2a1effd640 1 -- 172.21.15.112:0/3654079182 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2a1806c7f0 con 0x7f2a280fa830 2024-09-19T09:27:06.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.273+0000 7f2a2ced2640 1 -- 172.21.15.112:0/3654079182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a281014d0 con 0x7f2a280fa830 2024-09-19T09:27:06.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.273+0000 7f2a1ffff640 1 --2- 172.21.15.112:0/3654079182 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f2a14039580 0x7f2a1403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.274+0000 7f2a1ffff640 1 --2- 172.21.15.112:0/3654079182 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f2a14039580 0x7f2a1403ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2a10006fd0 tx=0x7f2a10006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:06.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.280+0000 7f2a1effd640 1 -- 172.21.15.112:0/3654079182 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2a18033790 con 0x7f2a280fa830 2024-09-19T09:27:06.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.460+0000 7f2a2ced2640 1 -- 172.21.15.112:0/3654079182 --> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a280fed30 con 0x7f2a14039580 2024-09-19T09:27:06.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.461+0000 7f2a1effd640 1 -- 172.21.15.112:0/3654079182 <== mgr.14158 v2:172.21.15.112:6800/3210372910 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f2a280fed30 con 0x7f2a14039580 2024-09-19T09:27:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:27:06.462 INFO:teuthology.orchestra.run.smithi112.stdout:[{"addr": "172.21.15.112", "hostname": "smithi112", "labels": [], "status": ""}, {"addr": "172.21.15.191", "hostname": "smithi191", "labels": [], "status": ""}] 2024-09-19T09:27:06.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.463+0000 7f2a2ced2640 1 -- 172.21.15.112:0/3654079182 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f2a14039580 msgr2=0x7f2a1403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:06.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.463+0000 7f2a2ced2640 1 --2- 172.21.15.112:0/3654079182 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f2a14039580 0x7f2a1403ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2a10006fd0 tx=0x7f2a10006db0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.463+0000 7f2a2ced2640 1 -- 172.21.15.112:0/3654079182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a280fa830 msgr2=0x7f2a2810c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:06.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.463+0000 7f2a2ced2640 1 --2- 172.21.15.112:0/3654079182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a280fa830 0x7f2a2810c730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009920 tx=0x7f2a18009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.463+0000 7f2a2ced2640 1 -- 172.21.15.112:0/3654079182 shutdown_connections 2024-09-19T09:27:06.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.463+0000 7f2a2ced2640 1 --2- 172.21.15.112:0/3654079182 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f2a14039580 0x7f2a1403ba30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.463+0000 7f2a2ced2640 1 --2- 172.21.15.112:0/3654079182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a280fa830 0x7f2a2810c730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.463+0000 7f2a2ced2640 1 -- 172.21.15.112:0/3654079182 >> 172.21.15.112:0/3654079182 conn(0x7f2a280f6010 msgr2=0x7f2a280fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:06.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.463+0000 7f2a2ced2640 1 -- 172.21.15.112:0/3654079182 shutdown_connections 2024-09-19T09:27:06.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:06.463+0000 7f2a2ced2640 1 -- 172.21.15.112:0/3654079182 wait complete. 2024-09-19T09:27:07.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:07 smithi112 ceph-mon[27605]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:07.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:07 smithi112 ceph-mon[27605]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:27:07.974 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T09:27:07.975 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T09:27:09.481 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:27:09.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:09 smithi112 ceph-mon[27605]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:11.811 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:11 smithi112 ceph-mon[27605]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:12.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.275+0000 7fee2ae3c640 1 -- 172.21.15.112:0/1780919368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee240fb0c0 msgr2=0x7fee240fb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:12.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.275+0000 7fee2ae3c640 1 --2- 172.21.15.112:0/1780919368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee240fb0c0 0x7fee240fb4d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fee18004850 tx=0x7fee18009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.275+0000 7fee2ae3c640 1 -- 172.21.15.112:0/1780919368 shutdown_connections 2024-09-19T09:27:12.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.275+0000 7fee2ae3c640 1 --2- 172.21.15.112:0/1780919368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee240fb0c0 0x7fee240fb4d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.275+0000 7fee2ae3c640 1 -- 172.21.15.112:0/1780919368 >> 172.21.15.112:0/1780919368 conn(0x7fee240f6880 msgr2=0x7fee240f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.275+0000 7fee2ae3c640 1 -- 172.21.15.112:0/1780919368 shutdown_connections 2024-09-19T09:27:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.275+0000 7fee2ae3c640 1 -- 172.21.15.112:0/1780919368 wait complete. 2024-09-19T09:27:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.275+0000 7fee2ae3c640 1 Processor -- start 2024-09-19T09:27:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.275+0000 7fee2ae3c640 1 -- start start 2024-09-19T09:27:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.276+0000 7fee2ae3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee240fb0c0 0x7fee2410c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.276+0000 7fee2ae3c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2410cc30 con 0x7fee240fb0c0 2024-09-19T09:27:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.276+0000 7fee28bd8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee240fb0c0 0x7fee2410c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.276+0000 7fee28bd8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee240fb0c0 0x7fee2410c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37666/0 (socket says 172.21.15.112:37666) 2024-09-19T09:27:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.276+0000 7fee28bd8640 1 -- 172.21.15.112:0/606750973 learned_addr learned my addr 172.21.15.112:0/606750973 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:27:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.276+0000 7fee28bd8640 1 -- 172.21.15.112:0/606750973 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee18005040 con 0x7fee240fb0c0 2024-09-19T09:27:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.276+0000 7fee28bd8640 1 --2- 172.21.15.112:0/606750973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee240fb0c0 0x7fee2410c6f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fee1802a6d0 tx=0x7fee18009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.276+0000 7fee217fa640 1 -- 172.21.15.112:0/606750973 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee18033630 con 0x7fee240fb0c0 2024-09-19T09:27:12.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.276+0000 7fee217fa640 1 -- 172.21.15.112:0/606750973 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fee18033c30 con 0x7fee240fb0c0 2024-09-19T09:27:12.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.276+0000 7fee2ae3c640 1 -- 172.21.15.112:0/606750973 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2410ce30 con 0x7fee240fb0c0 2024-09-19T09:27:12.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.276+0000 7fee217fa640 1 -- 172.21.15.112:0/606750973 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee1803dc00 con 0x7fee240fb0c0 2024-09-19T09:27:12.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.276+0000 7fee2ae3c640 1 -- 172.21.15.112:0/606750973 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2410d2a0 con 0x7fee240fb0c0 2024-09-19T09:27:12.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.277+0000 7fee217fa640 1 -- 172.21.15.112:0/606750973 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fee18030020 con 0x7fee240fb0c0 2024-09-19T09:27:12.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.277+0000 7fee217fa640 1 --2- 172.21.15.112:0/606750973 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fee14039580 0x7fee1403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.277+0000 7fee2ae3c640 1 -- 172.21.15.112:0/606750973 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2405ed70 con 0x7fee240fb0c0 2024-09-19T09:27:12.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.278+0000 7fee217fa640 1 -- 172.21.15.112:0/606750973 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fee1806c9c0 con 0x7fee240fb0c0 2024-09-19T09:27:12.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.278+0000 7fee23fff640 1 --2- 172.21.15.112:0/606750973 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fee14039580 0x7fee1403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.278+0000 7fee23fff640 1 --2- 172.21.15.112:0/606750973 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fee14039580 0x7fee1403ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fee10006fd0 tx=0x7fee10006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:12.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.282+0000 7fee217fa640 1 -- 172.21.15.112:0/606750973 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fee1803bb50 con 0x7fee240fb0c0 2024-09-19T09:27:12.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.446+0000 7fee2ae3c640 1 -- 172.21.15.112:0/606750973 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fee2410d2a0 con 0x7fee240fb0c0 2024-09-19T09:27:12.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.508+0000 7fee217fa640 1 -- 172.21.15.112:0/606750973 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fee18042210 con 0x7fee240fb0c0 2024-09-19T09:27:12.510 INFO:teuthology.orchestra.run.smithi112.stderr:adjusted tunables profile to default 2024-09-19T09:27:12.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.510+0000 7fee2ae3c640 1 -- 172.21.15.112:0/606750973 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fee14039580 msgr2=0x7fee1403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:12.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.510+0000 7fee2ae3c640 1 --2- 172.21.15.112:0/606750973 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fee14039580 0x7fee1403ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fee10006fd0 tx=0x7fee10006db0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.510+0000 7fee2ae3c640 1 -- 172.21.15.112:0/606750973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee240fb0c0 msgr2=0x7fee2410c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:12.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.510+0000 7fee2ae3c640 1 --2- 172.21.15.112:0/606750973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee240fb0c0 0x7fee2410c6f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fee1802a6d0 tx=0x7fee18009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.510+0000 7fee2ae3c640 1 -- 172.21.15.112:0/606750973 shutdown_connections 2024-09-19T09:27:12.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.510+0000 7fee2ae3c640 1 --2- 172.21.15.112:0/606750973 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fee14039580 0x7fee1403ba30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.510+0000 7fee2ae3c640 1 --2- 172.21.15.112:0/606750973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee240fb0c0 0x7fee2410c6f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.510+0000 7fee2ae3c640 1 -- 172.21.15.112:0/606750973 >> 172.21.15.112:0/606750973 conn(0x7fee240f6880 msgr2=0x7fee24065500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:12.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.510+0000 7fee2ae3c640 1 -- 172.21.15.112:0/606750973 shutdown_connections 2024-09-19T09:27:12.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:27:12.510+0000 7fee2ae3c640 1 -- 172.21.15.112:0/606750973 wait complete. 2024-09-19T09:27:12.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:12 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/606750973' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T09:27:13.597 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:13 smithi112 ceph-mon[27605]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:13.598 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:13 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/606750973' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T09:27:13.598 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:13 smithi112 ceph-mon[27605]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:27:13.598 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:13 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:13.598 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:13 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:13.598 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:13 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:13.598 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:13 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:13.598 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:13 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:13.598 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:13 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:13.598 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:13 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-19T09:27:13.598 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:13 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:13.623 INFO:tasks.cephadm:Adding mon.smithi112 on smithi112 2024-09-19T09:27:13.624 INFO:tasks.cephadm:Adding mon.smithi191 on smithi191 2024-09-19T09:27:13.624 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi112:172.21.15.112=smithi112;smithi191:172.21.15.191=smithi191' 2024-09-19T09:27:13.866 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:13.912 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:14.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:14 smithi112 ceph-mon[27605]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-19T09:27:14.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:14 smithi112 ceph-mon[27605]: Deploying daemon grafana.smithi112 on smithi112 2024-09-19T09:27:15.477 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.453+0000 7fa1dddb2640 1 -- 172.21.15.191:0/739263805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1d80fc1d0 msgr2=0x7fa1d80fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.477 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.454+0000 7fa1dddb2640 1 --2- 172.21.15.191:0/739263805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1d80fc1d0 0x7fa1d80fc5e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8004850 tx=0x7fa1c8009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.477 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.454+0000 7fa1dddb2640 1 -- 172.21.15.191:0/739263805 shutdown_connections 2024-09-19T09:27:15.477 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.454+0000 7fa1dddb2640 1 --2- 172.21.15.191:0/739263805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1d80fc1d0 0x7fa1d80fc5e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.477 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.454+0000 7fa1dddb2640 1 -- 172.21.15.191:0/739263805 >> 172.21.15.191:0/739263805 conn(0x7fa1d80f79b0 msgr2=0x7fa1d80f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:15.477 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.454+0000 7fa1dddb2640 1 -- 172.21.15.191:0/739263805 shutdown_connections 2024-09-19T09:27:15.477 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.454+0000 7fa1dddb2640 1 -- 172.21.15.191:0/739263805 wait complete. 2024-09-19T09:27:15.477 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.455+0000 7fa1dddb2640 1 Processor -- start 2024-09-19T09:27:15.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.455+0000 7fa1dddb2640 1 -- start start 2024-09-19T09:27:15.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.455+0000 7fa1dddb2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1d80fc1d0 0x7fa1d810c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.455+0000 7fa1dddb2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d810cc10 con 0x7fa1d80fc1d0 2024-09-19T09:27:15.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.455+0000 7fa1d77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1d80fc1d0 0x7fa1d810c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.455+0000 7fa1d77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1d80fc1d0 0x7fa1d810c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.191:54654/0 (socket says 172.21.15.191:54654) 2024-09-19T09:27:15.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.455+0000 7fa1d77fe640 1 -- 172.21.15.191:0/1395686671 learned_addr learned my addr 172.21.15.191:0/1395686671 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:27:15.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.456+0000 7fa1d77fe640 1 -- 172.21.15.191:0/1395686671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c8005040 con 0x7fa1d80fc1d0 2024-09-19T09:27:15.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.456+0000 7fa1d77fe640 1 --2- 172.21.15.191:0/1395686671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1d80fc1d0 0x7fa1d810c6d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa1c802a6d0 tx=0x7fa1c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:15.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.456+0000 7fa1bffff640 1 -- 172.21.15.191:0/1395686671 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1c8033630 con 0x7fa1d80fc1d0 2024-09-19T09:27:15.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.456+0000 7fa1bffff640 1 -- 172.21.15.191:0/1395686671 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa1c8033c30 con 0x7fa1d80fc1d0 2024-09-19T09:27:15.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.456+0000 7fa1dddb2640 1 -- 172.21.15.191:0/1395686671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d810ce10 con 0x7fa1d80fc1d0 2024-09-19T09:27:15.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.456+0000 7fa1bffff640 1 -- 172.21.15.191:0/1395686671 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1c803dc00 con 0x7fa1d80fc1d0 2024-09-19T09:27:15.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.456+0000 7fa1dddb2640 1 -- 172.21.15.191:0/1395686671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d810d280 con 0x7fa1d80fc1d0 2024-09-19T09:27:15.479 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.457+0000 7fa1bffff640 1 -- 172.21.15.191:0/1395686671 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fa1c8030020 con 0x7fa1d80fc1d0 2024-09-19T09:27:15.479 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.457+0000 7fa1dddb2640 1 -- 172.21.15.191:0/1395686671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d805ed70 con 0x7fa1d80fc1d0 2024-09-19T09:27:15.479 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.457+0000 7fa1bffff640 1 --2- 172.21.15.191:0/1395686671 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fa1c00395d0 0x7fa1c003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.479 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.457+0000 7fa1bffff640 1 -- 172.21.15.191:0/1395686671 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa1c806c9f0 con 0x7fa1d80fc1d0 2024-09-19T09:27:15.479 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.457+0000 7fa1d6ffd640 1 --2- 172.21.15.191:0/1395686671 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fa1c00395d0 0x7fa1c003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.479 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.458+0000 7fa1d6ffd640 1 --2- 172.21.15.191:0/1395686671 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fa1c00395d0 0x7fa1c003ba80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc006fd0 tx=0x7fa1cc006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:15.479 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.463+0000 7fa1bffff640 1 -- 172.21.15.191:0/1395686671 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa1c8045b80 con 0x7fa1d80fc1d0 2024-09-19T09:27:15.627 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.626+0000 7fa1dddb2640 1 -- 172.21.15.191:0/1395686671 --> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi112:172.21.15.112=smithi112;smithi191:172.21.15.191=smithi191", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1d8106520 con 0x7fa1c00395d0 2024-09-19T09:27:15.636 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.635+0000 7fa1bffff640 1 -- 172.21.15.191:0/1395686671 <== mgr.14158 v2:172.21.15.112:6800/3210372910 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa1d8106520 con 0x7fa1c00395d0 2024-09-19T09:27:15.637 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mon update... 2024-09-19T09:27:15.638 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.637+0000 7fa1dddb2640 1 -- 172.21.15.191:0/1395686671 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fa1c00395d0 msgr2=0x7fa1c003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.638 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.637+0000 7fa1dddb2640 1 --2- 172.21.15.191:0/1395686671 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fa1c00395d0 0x7fa1c003ba80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc006fd0 tx=0x7fa1cc006db0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.637+0000 7fa1dddb2640 1 -- 172.21.15.191:0/1395686671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1d80fc1d0 msgr2=0x7fa1d810c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.637+0000 7fa1dddb2640 1 --2- 172.21.15.191:0/1395686671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1d80fc1d0 0x7fa1d810c6d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa1c802a6d0 tx=0x7fa1c8009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.637+0000 7fa1dddb2640 1 -- 172.21.15.191:0/1395686671 shutdown_connections 2024-09-19T09:27:15.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.637+0000 7fa1dddb2640 1 --2- 172.21.15.191:0/1395686671 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fa1c00395d0 0x7fa1c003ba80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.637+0000 7fa1dddb2640 1 --2- 172.21.15.191:0/1395686671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1d80fc1d0 0x7fa1d810c6d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.637+0000 7fa1dddb2640 1 -- 172.21.15.191:0/1395686671 >> 172.21.15.191:0/1395686671 conn(0x7fa1d80f79b0 msgr2=0x7fa1d80f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:15.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.637+0000 7fa1dddb2640 1 -- 172.21.15.191:0/1395686671 shutdown_connections 2024-09-19T09:27:15.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:15.637+0000 7fa1dddb2640 1 -- 172.21.15.191:0/1395686671 wait complete. 2024-09-19T09:27:15.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:15 smithi112 ceph-mon[27605]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:15.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:15 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:16.147 DEBUG:teuthology.orchestra.run.smithi191:mon.smithi191> sudo journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mon.smithi191.service 2024-09-19T09:27:16.149 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T09:27:16.150 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:27:16.418 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:16.462 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:16.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:16 smithi112 ceph-mon[27605]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi112:172.21.15.112=smithi112;smithi191:172.21.15.191=smithi191", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:27:16.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:16 smithi112 ceph-mon[27605]: Saving service mon spec with placement smithi112:172.21.15.112=smithi112;smithi191:172.21.15.191=smithi191;count:2 2024-09-19T09:27:16.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:16 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:17.793 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.789+0000 7f049d406640 1 -- 172.21.15.191:0/2100940086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04980fc1d0 msgr2=0x7f04980fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:17.794 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.789+0000 7f049d406640 1 --2- 172.21.15.191:0/2100940086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04980fc1d0 0x7f04980fc5e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0488004850 tx=0x7f0488009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:17.794 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.789+0000 7f049d406640 1 -- 172.21.15.191:0/2100940086 shutdown_connections 2024-09-19T09:27:17.794 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.789+0000 7f049d406640 1 --2- 172.21.15.191:0/2100940086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04980fc1d0 0x7f04980fc5e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:17.794 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.789+0000 7f049d406640 1 -- 172.21.15.191:0/2100940086 >> 172.21.15.191:0/2100940086 conn(0x7f04980f79b0 msgr2=0x7f04980f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:17.794 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.789+0000 7f049d406640 1 -- 172.21.15.191:0/2100940086 shutdown_connections 2024-09-19T09:27:17.794 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.789+0000 7f049d406640 1 -- 172.21.15.191:0/2100940086 wait complete. 2024-09-19T09:27:17.794 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.789+0000 7f049d406640 1 Processor -- start 2024-09-19T09:27:17.794 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.789+0000 7f049d406640 1 -- start start 2024-09-19T09:27:17.794 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.790+0000 7f049d406640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04980fc1d0 0x7f0498071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:17.794 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.790+0000 7f049d406640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04980719d0 con 0x7f04980fc1d0 2024-09-19T09:27:17.794 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.790+0000 7f0496ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04980fc1d0 0x7f0498071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:17.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.790+0000 7f0496ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04980fc1d0 0x7f0498071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.191:54670/0 (socket says 172.21.15.191:54670) 2024-09-19T09:27:17.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.790+0000 7f0496ffd640 1 -- 172.21.15.191:0/655527041 learned_addr learned my addr 172.21.15.191:0/655527041 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:27:17.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.790+0000 7f0496ffd640 1 -- 172.21.15.191:0/655527041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0488005040 con 0x7f04980fc1d0 2024-09-19T09:27:17.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.790+0000 7f0496ffd640 1 --2- 172.21.15.191:0/655527041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04980fc1d0 0x7f0498071490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0488009920 tx=0x7f0488009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:17.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.790+0000 7f048f7fe640 1 -- 172.21.15.191:0/655527041 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0488033630 con 0x7f04980fc1d0 2024-09-19T09:27:17.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.790+0000 7f048f7fe640 1 -- 172.21.15.191:0/655527041 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0488033c30 con 0x7f04980fc1d0 2024-09-19T09:27:17.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.790+0000 7f049d406640 1 -- 172.21.15.191:0/655527041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049806fa60 con 0x7f04980fc1d0 2024-09-19T09:27:17.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.791+0000 7f048f7fe640 1 -- 172.21.15.191:0/655527041 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f048803dc40 con 0x7f04980fc1d0 2024-09-19T09:27:17.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.791+0000 7f049d406640 1 -- 172.21.15.191:0/655527041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049806fed0 con 0x7f04980fc1d0 2024-09-19T09:27:17.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.791+0000 7f048f7fe640 1 -- 172.21.15.191:0/655527041 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f0488030020 con 0x7f04980fc1d0 2024-09-19T09:27:17.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.791+0000 7f049d406640 1 -- 172.21.15.191:0/655527041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04981025f0 con 0x7f04980fc1d0 2024-09-19T09:27:17.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.792+0000 7f048f7fe640 1 --2- 172.21.15.191:0/655527041 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f0484039580 0x7f048403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:17.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.792+0000 7f048f7fe640 1 -- 172.21.15.191:0/655527041 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f048806cb00 con 0x7f04980fc1d0 2024-09-19T09:27:17.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.792+0000 7f048ffff640 1 --2- 172.21.15.191:0/655527041 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f0484039580 0x7f048403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:17.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.792+0000 7f048ffff640 1 --2- 172.21.15.191:0/655527041 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f0484039580 0x7f048403ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0480006fd0 tx=0x7f0480006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:17.799 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:17.798+0000 7f048f7fe640 1 -- 172.21.15.191:0/655527041 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f048806ee60 con 0x7f04980fc1d0 2024-09-19T09:27:17.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:17 smithi112 ceph-mon[27605]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:18.017 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:18.015+0000 7f049d406640 1 -- 172.21.15.191:0/655527041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f049805ed70 con 0x7f04980fc1d0 2024-09-19T09:27:18.017 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:18.016+0000 7f048f7fe640 1 -- 172.21.15.191:0/655527041 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f048803b930 con 0x7f04980fc1d0 2024-09-19T09:27:18.018 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:27:18.018 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:25:39.367095Z","created":"2024-09-19T09:25:39.367095Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:27:18.018 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-19T09:27:18.019 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:18.018+0000 7f049d406640 1 -- 172.21.15.191:0/655527041 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f0484039580 msgr2=0x7f048403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:18.020 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:18.018+0000 7f049d406640 1 --2- 172.21.15.191:0/655527041 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f0484039580 0x7f048403ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0480006fd0 tx=0x7f0480006db0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.020 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:18.018+0000 7f049d406640 1 -- 172.21.15.191:0/655527041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04980fc1d0 msgr2=0x7f0498071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:18.020 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:18.018+0000 7f049d406640 1 --2- 172.21.15.191:0/655527041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04980fc1d0 0x7f0498071490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0488009920 tx=0x7f0488009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.020 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:18.018+0000 7f049d406640 1 -- 172.21.15.191:0/655527041 shutdown_connections 2024-09-19T09:27:18.020 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:18.018+0000 7f049d406640 1 --2- 172.21.15.191:0/655527041 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f0484039580 0x7f048403ba30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.020 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:18.018+0000 7f049d406640 1 --2- 172.21.15.191:0/655527041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04980fc1d0 0x7f0498071490 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.020 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:18.018+0000 7f049d406640 1 -- 172.21.15.191:0/655527041 >> 172.21.15.191:0/655527041 conn(0x7f04980f79b0 msgr2=0x7f04980f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:18.020 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:18.018+0000 7f049d406640 1 -- 172.21.15.191:0/655527041 shutdown_connections 2024-09-19T09:27:18.021 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:18.018+0000 7f049d406640 1 -- 172.21.15.191:0/655527041 wait complete. 2024-09-19T09:27:18.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:18 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/655527041' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:27:19.690 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T09:27:19.691 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:27:19.932 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:19.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:19 smithi112 ceph-mon[27605]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:19.977 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:21.590 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.587+0000 7fee87617640 1 -- 172.21.15.191:0/1720477267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee800fb2e0 msgr2=0x7fee800fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:21.590 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.587+0000 7fee87617640 1 --2- 172.21.15.191:0/1720477267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee800fb2e0 0x7fee800fb6f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fee70004850 tx=0x7fee70009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:21.590 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.587+0000 7fee87617640 1 -- 172.21.15.191:0/1720477267 shutdown_connections 2024-09-19T09:27:21.590 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.587+0000 7fee87617640 1 --2- 172.21.15.191:0/1720477267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee800fb2e0 0x7fee800fb6f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:21.590 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.587+0000 7fee87617640 1 -- 172.21.15.191:0/1720477267 >> 172.21.15.191:0/1720477267 conn(0x7fee800f6ac0 msgr2=0x7fee800f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:21.590 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.587+0000 7fee87617640 1 -- 172.21.15.191:0/1720477267 shutdown_connections 2024-09-19T09:27:21.590 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.587+0000 7fee87617640 1 -- 172.21.15.191:0/1720477267 wait complete. 2024-09-19T09:27:21.590 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.588+0000 7fee87617640 1 Processor -- start 2024-09-19T09:27:21.590 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.588+0000 7fee87617640 1 -- start start 2024-09-19T09:27:21.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.588+0000 7fee87617640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee800fb2e0 0x7fee8010b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:21.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.588+0000 7fee87617640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8010bd60 con 0x7fee800fb2e0 2024-09-19T09:27:21.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.588+0000 7fee853b3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee800fb2e0 0x7fee8010b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:21.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.588+0000 7fee853b3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee800fb2e0 0x7fee8010b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.191:54694/0 (socket says 172.21.15.191:54694) 2024-09-19T09:27:21.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.588+0000 7fee853b3640 1 -- 172.21.15.191:0/2945333856 learned_addr learned my addr 172.21.15.191:0/2945333856 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:27:21.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.588+0000 7fee853b3640 1 -- 172.21.15.191:0/2945333856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70005040 con 0x7fee800fb2e0 2024-09-19T09:27:21.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.589+0000 7fee853b3640 1 --2- 172.21.15.191:0/2945333856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee800fb2e0 0x7fee8010b820 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fee7002a6d0 tx=0x7fee70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:21.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.589+0000 7fee75ffb640 1 -- 172.21.15.191:0/2945333856 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee70033630 con 0x7fee800fb2e0 2024-09-19T09:27:21.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.589+0000 7fee87617640 1 -- 172.21.15.191:0/2945333856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8010bf60 con 0x7fee800fb2e0 2024-09-19T09:27:21.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.589+0000 7fee75ffb640 1 -- 172.21.15.191:0/2945333856 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fee70033c30 con 0x7fee800fb2e0 2024-09-19T09:27:21.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.589+0000 7fee75ffb640 1 -- 172.21.15.191:0/2945333856 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee7003dc00 con 0x7fee800fb2e0 2024-09-19T09:27:21.592 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.589+0000 7fee87617640 1 -- 172.21.15.191:0/2945333856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8010c3d0 con 0x7fee800fb2e0 2024-09-19T09:27:21.592 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.590+0000 7fee75ffb640 1 -- 172.21.15.191:0/2945333856 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fee70030020 con 0x7fee800fb2e0 2024-09-19T09:27:21.593 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.590+0000 7fee87617640 1 -- 172.21.15.191:0/2945333856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8005ed70 con 0x7fee800fb2e0 2024-09-19T09:27:21.593 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.590+0000 7fee75ffb640 1 --2- 172.21.15.191:0/2945333856 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fee6c039580 0x7fee6c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:21.593 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.590+0000 7fee75ffb640 1 -- 172.21.15.191:0/2945333856 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fee7006c9d0 con 0x7fee800fb2e0 2024-09-19T09:27:21.593 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.591+0000 7fee84bb2640 1 --2- 172.21.15.191:0/2945333856 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fee6c039580 0x7fee6c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:21.593 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.591+0000 7fee84bb2640 1 --2- 172.21.15.191:0/2945333856 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fee6c039580 0x7fee6c03ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fee7c006fd0 tx=0x7fee7c006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:21.596 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.595+0000 7fee75ffb640 1 -- 172.21.15.191:0/2945333856 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fee70045b80 con 0x7fee800fb2e0 2024-09-19T09:27:21.817 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.815+0000 7fee87617640 1 -- 172.21.15.191:0/2945333856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fee8004b720 con 0x7fee800fb2e0 2024-09-19T09:27:21.817 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.816+0000 7fee75ffb640 1 -- 172.21.15.191:0/2945333856 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fee70045b80 con 0x7fee800fb2e0 2024-09-19T09:27:21.817 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:27:21.817 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:25:39.367095Z","created":"2024-09-19T09:25:39.367095Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:27:21.818 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-19T09:27:21.819 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.818+0000 7fee87617640 1 -- 172.21.15.191:0/2945333856 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fee6c039580 msgr2=0x7fee6c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:21.819 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.818+0000 7fee87617640 1 --2- 172.21.15.191:0/2945333856 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fee6c039580 0x7fee6c03ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fee7c006fd0 tx=0x7fee7c006db0 comp rx=0 tx=0).stop 2024-09-19T09:27:21.819 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.818+0000 7fee87617640 1 -- 172.21.15.191:0/2945333856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee800fb2e0 msgr2=0x7fee8010b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:21.819 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.818+0000 7fee87617640 1 --2- 172.21.15.191:0/2945333856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee800fb2e0 0x7fee8010b820 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fee7002a6d0 tx=0x7fee70009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:21.819 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.818+0000 7fee87617640 1 -- 172.21.15.191:0/2945333856 shutdown_connections 2024-09-19T09:27:21.819 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.818+0000 7fee87617640 1 --2- 172.21.15.191:0/2945333856 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fee6c039580 0x7fee6c03ba30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:21.819 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.818+0000 7fee87617640 1 --2- 172.21.15.191:0/2945333856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee800fb2e0 0x7fee8010b820 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:21.820 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.818+0000 7fee87617640 1 -- 172.21.15.191:0/2945333856 >> 172.21.15.191:0/2945333856 conn(0x7fee800f6ac0 msgr2=0x7fee800f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:21.820 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.818+0000 7fee87617640 1 -- 172.21.15.191:0/2945333856 shutdown_connections 2024-09-19T09:27:21.820 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:21.818+0000 7fee87617640 1 -- 172.21.15.191:0/2945333856 wait complete. 2024-09-19T09:27:21.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:21 smithi112 ceph-mon[27605]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:22.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:22 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/2945333856' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:27:23.409 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T09:27:23.409 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:27:23.652 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:23.696 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:23.895 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:23 smithi112 ceph-mon[27605]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:25.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.097+0000 7fd7e9d61640 1 -- 172.21.15.191:0/875679608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7e40fc1d0 msgr2=0x7fd7e40fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:25.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.097+0000 7fd7e9d61640 1 --2- 172.21.15.191:0/875679608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7e40fc1d0 0x7fd7e40fc5e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4004850 tx=0x7fd7d4009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.097+0000 7fd7e9d61640 1 -- 172.21.15.191:0/875679608 shutdown_connections 2024-09-19T09:27:25.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.097+0000 7fd7e9d61640 1 --2- 172.21.15.191:0/875679608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7e40fc1d0 0x7fd7e40fc5e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.097+0000 7fd7e9d61640 1 -- 172.21.15.191:0/875679608 >> 172.21.15.191:0/875679608 conn(0x7fd7e40f79b0 msgr2=0x7fd7e40f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:25.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.097+0000 7fd7e9d61640 1 -- 172.21.15.191:0/875679608 shutdown_connections 2024-09-19T09:27:25.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.097+0000 7fd7e9d61640 1 -- 172.21.15.191:0/875679608 wait complete. 2024-09-19T09:27:25.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.098+0000 7fd7e9d61640 1 Processor -- start 2024-09-19T09:27:25.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.098+0000 7fd7e9d61640 1 -- start start 2024-09-19T09:27:25.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.098+0000 7fd7e9d61640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7e40fc1d0 0x7fd7e410c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:25.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.098+0000 7fd7e9d61640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e410cc10 con 0x7fd7e40fc1d0 2024-09-19T09:27:25.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.098+0000 7fd7e37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7e40fc1d0 0x7fd7e410c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:25.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.098+0000 7fd7e37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7e40fc1d0 0x7fd7e410c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.191:54708/0 (socket says 172.21.15.191:54708) 2024-09-19T09:27:25.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.098+0000 7fd7e37fe640 1 -- 172.21.15.191:0/3263297276 learned_addr learned my addr 172.21.15.191:0/3263297276 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:27:25.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.098+0000 7fd7e37fe640 1 -- 172.21.15.191:0/3263297276 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d4005040 con 0x7fd7e40fc1d0 2024-09-19T09:27:25.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.099+0000 7fd7e37fe640 1 --2- 172.21.15.191:0/3263297276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7e40fc1d0 0x7fd7e410c6d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd7d402a6d0 tx=0x7fd7d4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:25.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.099+0000 7fd7e0ff9640 1 -- 172.21.15.191:0/3263297276 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7d4033630 con 0x7fd7e40fc1d0 2024-09-19T09:27:25.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.099+0000 7fd7e0ff9640 1 -- 172.21.15.191:0/3263297276 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd7d4033c30 con 0x7fd7e40fc1d0 2024-09-19T09:27:25.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.099+0000 7fd7e9d61640 1 -- 172.21.15.191:0/3263297276 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e410ce10 con 0x7fd7e40fc1d0 2024-09-19T09:27:25.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.099+0000 7fd7e0ff9640 1 -- 172.21.15.191:0/3263297276 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7d403dc00 con 0x7fd7e40fc1d0 2024-09-19T09:27:25.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.099+0000 7fd7e9d61640 1 -- 172.21.15.191:0/3263297276 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e410d280 con 0x7fd7e40fc1d0 2024-09-19T09:27:25.104 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.100+0000 7fd7e0ff9640 1 -- 172.21.15.191:0/3263297276 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fd7d4030020 con 0x7fd7e40fc1d0 2024-09-19T09:27:25.104 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.100+0000 7fd7e9d61640 1 -- 172.21.15.191:0/3263297276 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e405ed70 con 0x7fd7e40fc1d0 2024-09-19T09:27:25.104 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.100+0000 7fd7e0ff9640 1 --2- 172.21.15.191:0/3263297276 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fd7d0039580 0x7fd7d003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:25.104 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.100+0000 7fd7e0ff9640 1 -- 172.21.15.191:0/3263297276 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd7d406c980 con 0x7fd7e40fc1d0 2024-09-19T09:27:25.104 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.100+0000 7fd7dbfff640 1 --2- 172.21.15.191:0/3263297276 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fd7d0039580 0x7fd7d003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:25.105 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.101+0000 7fd7dbfff640 1 --2- 172.21.15.191:0/3263297276 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fd7d0039580 0x7fd7d003ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc006fd0 tx=0x7fd7cc006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:25.109 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.107+0000 7fd7e0ff9640 1 -- 172.21.15.191:0/3263297276 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd7d4033790 con 0x7fd7e40fc1d0 2024-09-19T09:27:25.327 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.325+0000 7fd7e9d61640 1 -- 172.21.15.191:0/3263297276 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd7e404b720 con 0x7fd7e40fc1d0 2024-09-19T09:27:25.327 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.326+0000 7fd7e0ff9640 1 -- 172.21.15.191:0/3263297276 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fd7d4042210 con 0x7fd7e40fc1d0 2024-09-19T09:27:25.327 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:27:25.328 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:25:39.367095Z","created":"2024-09-19T09:25:39.367095Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:27:25.328 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-19T09:27:25.330 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.328+0000 7fd7e9d61640 1 -- 172.21.15.191:0/3263297276 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fd7d0039580 msgr2=0x7fd7d003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:25.330 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.328+0000 7fd7e9d61640 1 --2- 172.21.15.191:0/3263297276 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fd7d0039580 0x7fd7d003ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc006fd0 tx=0x7fd7cc006db0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.330 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.328+0000 7fd7e9d61640 1 -- 172.21.15.191:0/3263297276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7e40fc1d0 msgr2=0x7fd7e410c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:25.330 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.328+0000 7fd7e9d61640 1 --2- 172.21.15.191:0/3263297276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7e40fc1d0 0x7fd7e410c6d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd7d402a6d0 tx=0x7fd7d4009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.330 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.328+0000 7fd7e9d61640 1 -- 172.21.15.191:0/3263297276 shutdown_connections 2024-09-19T09:27:25.331 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.328+0000 7fd7e9d61640 1 --2- 172.21.15.191:0/3263297276 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7fd7d0039580 0x7fd7d003ba30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.331 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.328+0000 7fd7e9d61640 1 --2- 172.21.15.191:0/3263297276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7e40fc1d0 0x7fd7e410c6d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.331 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.328+0000 7fd7e9d61640 1 -- 172.21.15.191:0/3263297276 >> 172.21.15.191:0/3263297276 conn(0x7fd7e40f79b0 msgr2=0x7fd7e40f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:25.331 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.328+0000 7fd7e9d61640 1 -- 172.21.15.191:0/3263297276 shutdown_connections 2024-09-19T09:27:25.331 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:25.328+0000 7fd7e9d61640 1 -- 172.21.15.191:0/3263297276 wait complete. 2024-09-19T09:27:25.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:25 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:25.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:25 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:25.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:25 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:25.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:25 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:25.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:25 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:25.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:25 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:25.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:25 smithi112 ceph-mon[27605]: Deploying daemon prometheus.smithi112 on smithi112 2024-09-19T09:27:26.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:26 smithi112 ceph-mon[27605]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:26.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:26 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/3263297276' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:27:26.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:26 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:26.986 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T09:27:26.986 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:27:27.249 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:27.294 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:28.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:28 smithi112 ceph-mon[27605]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:28.663 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.652+0000 7f8159aaf640 1 -- 172.21.15.191:0/3855712121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81540fd800 msgr2=0x7f81540fdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.663 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.652+0000 7f8159aaf640 1 --2- 172.21.15.191:0/3855712121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81540fd800 0x7f81540fdc10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8144004850 tx=0x7f8144009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.663 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.652+0000 7f8159aaf640 1 -- 172.21.15.191:0/3855712121 shutdown_connections 2024-09-19T09:27:28.663 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.652+0000 7f8159aaf640 1 --2- 172.21.15.191:0/3855712121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81540fd800 0x7f81540fdc10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.663 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.652+0000 7f8159aaf640 1 -- 172.21.15.191:0/3855712121 >> 172.21.15.191:0/3855712121 conn(0x7f81540f6000 msgr2=0x7f81540f8430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:28.663 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.652+0000 7f8159aaf640 1 -- 172.21.15.191:0/3855712121 shutdown_connections 2024-09-19T09:27:28.664 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.652+0000 7f8159aaf640 1 -- 172.21.15.191:0/3855712121 wait complete. 2024-09-19T09:27:28.664 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.653+0000 7f8159aaf640 1 Processor -- start 2024-09-19T09:27:28.664 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.653+0000 7f8159aaf640 1 -- start start 2024-09-19T09:27:28.664 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.653+0000 7f8159aaf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81540fd800 0x7f815410c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.664 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.653+0000 7f8159aaf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815410cc50 con 0x7f81540fd800 2024-09-19T09:27:28.664 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.653+0000 7f81537fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81540fd800 0x7f815410c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.664 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.653+0000 7f81537fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81540fd800 0x7f815410c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.191:57946/0 (socket says 172.21.15.191:57946) 2024-09-19T09:27:28.665 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.653+0000 7f81537fe640 1 -- 172.21.15.191:0/2459770964 learned_addr learned my addr 172.21.15.191:0/2459770964 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:27:28.665 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.653+0000 7f81537fe640 1 -- 172.21.15.191:0/2459770964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8144005040 con 0x7f81540fd800 2024-09-19T09:27:28.665 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.654+0000 7f81537fe640 1 --2- 172.21.15.191:0/2459770964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81540fd800 0x7f815410c710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f814402a6d0 tx=0x7f8144009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:28.665 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.654+0000 7f8150ff9640 1 -- 172.21.15.191:0/2459770964 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8144033630 con 0x7f81540fd800 2024-09-19T09:27:28.665 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.654+0000 7f8159aaf640 1 -- 172.21.15.191:0/2459770964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815410ce50 con 0x7f81540fd800 2024-09-19T09:27:28.665 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.654+0000 7f8150ff9640 1 -- 172.21.15.191:0/2459770964 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8144033c30 con 0x7f81540fd800 2024-09-19T09:27:28.665 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.654+0000 7f8150ff9640 1 -- 172.21.15.191:0/2459770964 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f814403dc30 con 0x7f81540fd800 2024-09-19T09:27:28.666 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.654+0000 7f8159aaf640 1 -- 172.21.15.191:0/2459770964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815410d2c0 con 0x7f81540fd800 2024-09-19T09:27:28.666 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.655+0000 7f8150ff9640 1 -- 172.21.15.191:0/2459770964 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f8144030020 con 0x7f81540fd800 2024-09-19T09:27:28.666 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.655+0000 7f8159aaf640 1 -- 172.21.15.191:0/2459770964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815405ed70 con 0x7f81540fd800 2024-09-19T09:27:28.666 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.655+0000 7f8150ff9640 1 --2- 172.21.15.191:0/2459770964 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f8140039580 0x7f814003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.666 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.655+0000 7f8150ff9640 1 -- 172.21.15.191:0/2459770964 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f814406c860 con 0x7f81540fd800 2024-09-19T09:27:28.666 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.655+0000 7f814affd640 1 --2- 172.21.15.191:0/2459770964 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f8140039580 0x7f814003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.666 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.656+0000 7f814affd640 1 --2- 172.21.15.191:0/2459770964 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f8140039580 0x7f814003ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f813c006fd0 tx=0x7f813c006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:28.667 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.661+0000 7f8150ff9640 1 -- 172.21.15.191:0/2459770964 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8144045800 con 0x7f81540fd800 2024-09-19T09:27:28.875 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.874+0000 7f8159aaf640 1 -- 172.21.15.191:0/2459770964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f815404b720 con 0x7f81540fd800 2024-09-19T09:27:28.876 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.875+0000 7f8150ff9640 1 -- 172.21.15.191:0/2459770964 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f8144045800 con 0x7f81540fd800 2024-09-19T09:27:28.876 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:27:28.876 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:25:39.367095Z","created":"2024-09-19T09:25:39.367095Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:27:28.876 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-19T09:27:28.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.876+0000 7f8159aaf640 1 -- 172.21.15.191:0/2459770964 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f8140039580 msgr2=0x7f814003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.876+0000 7f8159aaf640 1 --2- 172.21.15.191:0/2459770964 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f8140039580 0x7f814003ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f813c006fd0 tx=0x7f813c006db0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.876+0000 7f8159aaf640 1 -- 172.21.15.191:0/2459770964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81540fd800 msgr2=0x7f815410c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.876+0000 7f8159aaf640 1 --2- 172.21.15.191:0/2459770964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81540fd800 0x7f815410c710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f814402a6d0 tx=0x7f8144009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.876+0000 7f8159aaf640 1 -- 172.21.15.191:0/2459770964 shutdown_connections 2024-09-19T09:27:28.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.876+0000 7f8159aaf640 1 --2- 172.21.15.191:0/2459770964 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f8140039580 0x7f814003ba30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.876+0000 7f8159aaf640 1 --2- 172.21.15.191:0/2459770964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81540fd800 0x7f815410c710 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.876+0000 7f8159aaf640 1 -- 172.21.15.191:0/2459770964 >> 172.21.15.191:0/2459770964 conn(0x7f81540f6000 msgr2=0x7f81540f68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:28.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.877+0000 7f8159aaf640 1 -- 172.21.15.191:0/2459770964 shutdown_connections 2024-09-19T09:27:28.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:28.877+0000 7f8159aaf640 1 -- 172.21.15.191:0/2459770964 wait complete. 2024-09-19T09:27:29.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:29 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/2459770964' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:27:30.351 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:30 smithi112 ceph-mon[27605]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:30.458 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T09:27:30.458 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:27:30.698 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:30.743 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:32.070 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.069+0000 7f9da6037640 1 -- 172.21.15.191:0/3175721011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9da00fc1b0 msgr2=0x7f9da00fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:32.070 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.069+0000 7f9da6037640 1 --2- 172.21.15.191:0/3175721011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9da00fc1b0 0x7f9da00fc5c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d90004850 tx=0x7f9d90009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.071 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.069+0000 7f9da6037640 1 -- 172.21.15.191:0/3175721011 shutdown_connections 2024-09-19T09:27:32.071 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.069+0000 7f9da6037640 1 --2- 172.21.15.191:0/3175721011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9da00fc1b0 0x7f9da00fc5c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.071 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.069+0000 7f9da6037640 1 -- 172.21.15.191:0/3175721011 >> 172.21.15.191:0/3175721011 conn(0x7f9da00f7990 msgr2=0x7f9da00f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:32.071 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.069+0000 7f9da6037640 1 -- 172.21.15.191:0/3175721011 shutdown_connections 2024-09-19T09:27:32.071 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.069+0000 7f9da6037640 1 -- 172.21.15.191:0/3175721011 wait complete. 2024-09-19T09:27:32.071 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.069+0000 7f9da6037640 1 Processor -- start 2024-09-19T09:27:32.071 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.069+0000 7f9da6037640 1 -- start start 2024-09-19T09:27:32.073 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.070+0000 7f9da6037640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9da00fc1b0 0x7f9da010c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.073 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.070+0000 7f9da6037640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da010cc30 con 0x7f9da00fc1b0 2024-09-19T09:27:32.073 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.070+0000 7f9d9f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9da00fc1b0 0x7f9da010c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.073 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.070+0000 7f9d9f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9da00fc1b0 0x7f9da010c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.191:57962/0 (socket says 172.21.15.191:57962) 2024-09-19T09:27:32.073 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.070+0000 7f9d9f7fe640 1 -- 172.21.15.191:0/3068656222 learned_addr learned my addr 172.21.15.191:0/3068656222 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:27:32.073 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.070+0000 7f9d9f7fe640 1 -- 172.21.15.191:0/3068656222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d90005040 con 0x7f9da00fc1b0 2024-09-19T09:27:32.073 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.070+0000 7f9d9f7fe640 1 --2- 172.21.15.191:0/3068656222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9da00fc1b0 0x7f9da010c6f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d9002a6d0 tx=0x7f9d90009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:32.073 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.070+0000 7f9d9cff9640 1 -- 172.21.15.191:0/3068656222 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d90033630 con 0x7f9da00fc1b0 2024-09-19T09:27:32.073 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.070+0000 7f9da6037640 1 -- 172.21.15.191:0/3068656222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da010ce30 con 0x7f9da00fc1b0 2024-09-19T09:27:32.073 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.070+0000 7f9d9cff9640 1 -- 172.21.15.191:0/3068656222 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9d90033c30 con 0x7f9da00fc1b0 2024-09-19T09:27:32.074 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.070+0000 7f9d9cff9640 1 -- 172.21.15.191:0/3068656222 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d9003dc00 con 0x7f9da00fc1b0 2024-09-19T09:27:32.074 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.071+0000 7f9da6037640 1 -- 172.21.15.191:0/3068656222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da010d2a0 con 0x7f9da00fc1b0 2024-09-19T09:27:32.074 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.071+0000 7f9d9cff9640 1 -- 172.21.15.191:0/3068656222 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f9d90030020 con 0x7f9da00fc1b0 2024-09-19T09:27:32.074 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.071+0000 7f9da6037640 1 -- 172.21.15.191:0/3068656222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da005ed70 con 0x7f9da00fc1b0 2024-09-19T09:27:32.074 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.072+0000 7f9d9cff9640 1 --2- 172.21.15.191:0/3068656222 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f9d8c0395d0 0x7f9d8c03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.074 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.072+0000 7f9d9cff9640 1 -- 172.21.15.191:0/3068656222 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9d9006ca60 con 0x7f9da00fc1b0 2024-09-19T09:27:32.074 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.072+0000 7f9d96ffd640 1 --2- 172.21.15.191:0/3068656222 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f9d8c0395d0 0x7f9d8c03ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.074 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.072+0000 7f9d96ffd640 1 --2- 172.21.15.191:0/3068656222 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f9d8c0395d0 0x7f9d8c03ba80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9d88006fd0 tx=0x7f9d88006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:32.078 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.076+0000 7f9d9cff9640 1 -- 172.21.15.191:0/3068656222 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9d9003bb50 con 0x7f9da00fc1b0 2024-09-19T09:27:32.291 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.290+0000 7f9da6037640 1 -- 172.21.15.191:0/3068656222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9da004b720 con 0x7f9da00fc1b0 2024-09-19T09:27:32.292 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.291+0000 7f9d9cff9640 1 -- 172.21.15.191:0/3068656222 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f9d9003b370 con 0x7f9da00fc1b0 2024-09-19T09:27:32.292 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:27:32.292 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:25:39.367095Z","created":"2024-09-19T09:25:39.367095Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:27:32.293 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-19T09:27:32.294 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.293+0000 7f9da6037640 1 -- 172.21.15.191:0/3068656222 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f9d8c0395d0 msgr2=0x7f9d8c03ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:32.294 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.293+0000 7f9da6037640 1 --2- 172.21.15.191:0/3068656222 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f9d8c0395d0 0x7f9d8c03ba80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9d88006fd0 tx=0x7f9d88006db0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.294 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.293+0000 7f9da6037640 1 -- 172.21.15.191:0/3068656222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9da00fc1b0 msgr2=0x7f9da010c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:32.294 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.293+0000 7f9da6037640 1 --2- 172.21.15.191:0/3068656222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9da00fc1b0 0x7f9da010c6f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d9002a6d0 tx=0x7f9d90009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.294 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.293+0000 7f9da6037640 1 -- 172.21.15.191:0/3068656222 shutdown_connections 2024-09-19T09:27:32.294 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.293+0000 7f9da6037640 1 --2- 172.21.15.191:0/3068656222 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f9d8c0395d0 0x7f9d8c03ba80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.295 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.293+0000 7f9da6037640 1 --2- 172.21.15.191:0/3068656222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9da00fc1b0 0x7f9da010c6f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.295 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.293+0000 7f9da6037640 1 -- 172.21.15.191:0/3068656222 >> 172.21.15.191:0/3068656222 conn(0x7f9da00f7990 msgr2=0x7f9da00f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:32.295 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.293+0000 7f9da6037640 1 -- 172.21.15.191:0/3068656222 shutdown_connections 2024-09-19T09:27:32.295 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:32.293+0000 7f9da6037640 1 -- 172.21.15.191:0/3068656222 wait complete. 2024-09-19T09:27:32.415 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:32 smithi112 ceph-mon[27605]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:33.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:33 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/3068656222' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:27:33.816 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T09:27:33.817 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:27:34.060 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:34.104 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:34.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:34 smithi112 ceph-mon[27605]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:35.374 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.364+0000 7f129d163640 1 -- 172.21.15.191:0/2866239161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12980fb060 msgr2=0x7f12980fb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:35.374 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.364+0000 7f129d163640 1 --2- 172.21.15.191:0/2866239161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12980fb060 0x7f12980fb470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1288004850 tx=0x7f1288009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.374 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.364+0000 7f129d163640 1 -- 172.21.15.191:0/2866239161 shutdown_connections 2024-09-19T09:27:35.374 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.364+0000 7f129d163640 1 --2- 172.21.15.191:0/2866239161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12980fb060 0x7f12980fb470 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.374 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.364+0000 7f129d163640 1 -- 172.21.15.191:0/2866239161 >> 172.21.15.191:0/2866239161 conn(0x7f12980f6820 msgr2=0x7f12980f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:35.375 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.364+0000 7f129d163640 1 -- 172.21.15.191:0/2866239161 shutdown_connections 2024-09-19T09:27:35.375 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.364+0000 7f129d163640 1 -- 172.21.15.191:0/2866239161 wait complete. 2024-09-19T09:27:35.375 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.365+0000 7f129d163640 1 Processor -- start 2024-09-19T09:27:35.375 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.365+0000 7f129d163640 1 -- start start 2024-09-19T09:27:35.375 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.365+0000 7f129d163640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12980fb060 0x7f129810b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:35.375 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.365+0000 7f129d163640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129810bab0 con 0x7f12980fb060 2024-09-19T09:27:35.375 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.365+0000 7f1296d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12980fb060 0x7f129810b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:35.375 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.365+0000 7f1296d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12980fb060 0x7f129810b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.191:34610/0 (socket says 172.21.15.191:34610) 2024-09-19T09:27:35.375 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.365+0000 7f1296d9d640 1 -- 172.21.15.191:0/2628984008 learned_addr learned my addr 172.21.15.191:0/2628984008 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:27:35.375 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.366+0000 7f1296d9d640 1 -- 172.21.15.191:0/2628984008 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288005040 con 0x7f12980fb060 2024-09-19T09:27:35.375 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.366+0000 7f1296d9d640 1 --2- 172.21.15.191:0/2628984008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12980fb060 0x7f129810b570 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f128802a6d0 tx=0x7f1288009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:35.375 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.366+0000 7f128f7fe640 1 -- 172.21.15.191:0/2628984008 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1288033630 con 0x7f12980fb060 2024-09-19T09:27:35.375 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.366+0000 7f129d163640 1 -- 172.21.15.191:0/2628984008 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129810bcb0 con 0x7f12980fb060 2024-09-19T09:27:35.375 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.366+0000 7f128f7fe640 1 -- 172.21.15.191:0/2628984008 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1288033c30 con 0x7f12980fb060 2024-09-19T09:27:35.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.366+0000 7f128f7fe640 1 -- 172.21.15.191:0/2628984008 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f128803dc00 con 0x7f12980fb060 2024-09-19T09:27:35.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.366+0000 7f129d163640 1 -- 172.21.15.191:0/2628984008 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129810c120 con 0x7f12980fb060 2024-09-19T09:27:35.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.367+0000 7f129d163640 1 -- 172.21.15.191:0/2628984008 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129805ed70 con 0x7f12980fb060 2024-09-19T09:27:35.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.367+0000 7f128f7fe640 1 -- 172.21.15.191:0/2628984008 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f1288030020 con 0x7f12980fb060 2024-09-19T09:27:35.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.368+0000 7f128f7fe640 1 --2- 172.21.15.191:0/2628984008 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f1284039580 0x7f128403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:35.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.368+0000 7f128f7fe640 1 -- 172.21.15.191:0/2628984008 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f128806c8a0 con 0x7f12980fb060 2024-09-19T09:27:35.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.368+0000 7f129659c640 1 --2- 172.21.15.191:0/2628984008 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f1284039580 0x7f128403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:35.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.368+0000 7f129659c640 1 --2- 172.21.15.191:0/2628984008 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f1284039580 0x7f128403ba30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1280006fd0 tx=0x7f1280006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:35.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.373+0000 7f128f7fe640 1 -- 172.21.15.191:0/2628984008 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1288033790 con 0x7f12980fb060 2024-09-19T09:27:35.588 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.586+0000 7f129d163640 1 -- 172.21.15.191:0/2628984008 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f129804b720 con 0x7f12980fb060 2024-09-19T09:27:35.589 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.586+0000 7f128f7fe640 1 -- 172.21.15.191:0/2628984008 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f1288045800 con 0x7f12980fb060 2024-09-19T09:27:35.589 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:27:35.589 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:25:39.367095Z","created":"2024-09-19T09:25:39.367095Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:27:35.589 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-19T09:27:35.590 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.588+0000 7f129d163640 1 -- 172.21.15.191:0/2628984008 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f1284039580 msgr2=0x7f128403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:35.590 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.588+0000 7f129d163640 1 --2- 172.21.15.191:0/2628984008 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f1284039580 0x7f128403ba30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1280006fd0 tx=0x7f1280006db0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.588+0000 7f129d163640 1 -- 172.21.15.191:0/2628984008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12980fb060 msgr2=0x7f129810b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:35.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.588+0000 7f129d163640 1 --2- 172.21.15.191:0/2628984008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12980fb060 0x7f129810b570 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f128802a6d0 tx=0x7f1288009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.588+0000 7f129d163640 1 -- 172.21.15.191:0/2628984008 shutdown_connections 2024-09-19T09:27:35.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.588+0000 7f129d163640 1 --2- 172.21.15.191:0/2628984008 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7f1284039580 0x7f128403ba30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.588+0000 7f129d163640 1 --2- 172.21.15.191:0/2628984008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12980fb060 0x7f129810b570 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.588+0000 7f129d163640 1 -- 172.21.15.191:0/2628984008 >> 172.21.15.191:0/2628984008 conn(0x7f12980f6820 msgr2=0x7f12980f73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:35.591 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.588+0000 7f129d163640 1 -- 172.21.15.191:0/2628984008 shutdown_connections 2024-09-19T09:27:35.592 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:35.588+0000 7f129d163640 1 -- 172.21.15.191:0/2628984008 wait complete. 2024-09-19T09:27:36.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:36 smithi112 ceph-mon[27605]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:36.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:36 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/2628984008' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:27:37.146 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T09:27:37.146 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:27:37.387 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:37.431 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:38.352 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:38 smithi112 ceph-mon[27605]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:38.653 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.643+0000 7ffaf0dbe640 1 -- 172.21.15.191:0/3832514802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffaec0fc1b0 msgr2=0x7ffaec0fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:38.653 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.643+0000 7ffaf0dbe640 1 --2- 172.21.15.191:0/3832514802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffaec0fc1b0 0x7ffaec0fc5c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffadc004850 tx=0x7ffadc009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.653 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.643+0000 7ffaf0dbe640 1 -- 172.21.15.191:0/3832514802 shutdown_connections 2024-09-19T09:27:38.653 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.643+0000 7ffaf0dbe640 1 --2- 172.21.15.191:0/3832514802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffaec0fc1b0 0x7ffaec0fc5c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.653 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.643+0000 7ffaf0dbe640 1 -- 172.21.15.191:0/3832514802 >> 172.21.15.191:0/3832514802 conn(0x7ffaec0f7990 msgr2=0x7ffaec0f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:38.653 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.643+0000 7ffaf0dbe640 1 -- 172.21.15.191:0/3832514802 shutdown_connections 2024-09-19T09:27:38.654 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.643+0000 7ffaf0dbe640 1 -- 172.21.15.191:0/3832514802 wait complete. 2024-09-19T09:27:38.654 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.643+0000 7ffaf0dbe640 1 Processor -- start 2024-09-19T09:27:38.654 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.643+0000 7ffaf0dbe640 1 -- start start 2024-09-19T09:27:38.654 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.644+0000 7ffaf0dbe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffaec0fc1b0 0x7ffaec071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.654 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.644+0000 7ffaf0dbe640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec0719d0 con 0x7ffaec0fc1b0 2024-09-19T09:27:38.654 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.644+0000 7ffaea59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffaec0fc1b0 0x7ffaec071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.654 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.644+0000 7ffaea59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffaec0fc1b0 0x7ffaec071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.191:34624/0 (socket says 172.21.15.191:34624) 2024-09-19T09:27:38.654 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.644+0000 7ffaea59c640 1 -- 172.21.15.191:0/1727618385 learned_addr learned my addr 172.21.15.191:0/1727618385 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:27:38.654 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.644+0000 7ffaea59c640 1 -- 172.21.15.191:0/1727618385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc005040 con 0x7ffaec0fc1b0 2024-09-19T09:27:38.654 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.644+0000 7ffaea59c640 1 --2- 172.21.15.191:0/1727618385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffaec0fc1b0 0x7ffaec071490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009920 tx=0x7ffadc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:38.654 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.644+0000 7ffae2ffd640 1 -- 172.21.15.191:0/1727618385 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffadc033630 con 0x7ffaec0fc1b0 2024-09-19T09:27:38.654 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.645+0000 7ffaf0dbe640 1 -- 172.21.15.191:0/1727618385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec06fa60 con 0x7ffaec0fc1b0 2024-09-19T09:27:38.654 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.645+0000 7ffae2ffd640 1 -- 172.21.15.191:0/1727618385 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffadc033c30 con 0x7ffaec0fc1b0 2024-09-19T09:27:38.655 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.645+0000 7ffae2ffd640 1 -- 172.21.15.191:0/1727618385 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffadc03dc40 con 0x7ffaec0fc1b0 2024-09-19T09:27:38.655 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.645+0000 7ffaf0dbe640 1 -- 172.21.15.191:0/1727618385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec06fed0 con 0x7ffaec0fc1b0 2024-09-19T09:27:38.655 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.645+0000 7ffaf0dbe640 1 -- 172.21.15.191:0/1727618385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaec1025d0 con 0x7ffaec0fc1b0 2024-09-19T09:27:38.655 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.645+0000 7ffae2ffd640 1 -- 172.21.15.191:0/1727618385 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7ffadc030020 con 0x7ffaec0fc1b0 2024-09-19T09:27:38.655 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.646+0000 7ffae2ffd640 1 --2- 172.21.15.191:0/1727618385 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7ffad8039580 0x7ffad803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.655 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.646+0000 7ffae2ffd640 1 -- 172.21.15.191:0/1727618385 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ffadc06ca50 con 0x7ffaec0fc1b0 2024-09-19T09:27:38.655 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.646+0000 7ffae3fff640 1 --2- 172.21.15.191:0/1727618385 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7ffad8039580 0x7ffad803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.655 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.646+0000 7ffae3fff640 1 --2- 172.21.15.191:0/1727618385 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7ffad8039580 0x7ffad803ba30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffad4006fd0 tx=0x7ffad4006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:38.655 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.651+0000 7ffae2ffd640 1 -- 172.21.15.191:0/1727618385 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffadc033da0 con 0x7ffaec0fc1b0 2024-09-19T09:27:38.865 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.863+0000 7ffaf0dbe640 1 -- 172.21.15.191:0/1727618385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ffaec05ed70 con 0x7ffaec0fc1b0 2024-09-19T09:27:38.866 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.864+0000 7ffae2ffd640 1 -- 172.21.15.191:0/1727618385 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7ffadc045800 con 0x7ffaec0fc1b0 2024-09-19T09:27:38.866 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:27:38.866 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:25:39.367095Z","created":"2024-09-19T09:25:39.367095Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:27:38.866 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-19T09:27:38.868 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.866+0000 7ffaf0dbe640 1 -- 172.21.15.191:0/1727618385 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7ffad8039580 msgr2=0x7ffad803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:38.868 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.866+0000 7ffaf0dbe640 1 --2- 172.21.15.191:0/1727618385 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7ffad8039580 0x7ffad803ba30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffad4006fd0 tx=0x7ffad4006db0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.868 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.866+0000 7ffaf0dbe640 1 -- 172.21.15.191:0/1727618385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffaec0fc1b0 msgr2=0x7ffaec071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:38.868 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.866+0000 7ffaf0dbe640 1 --2- 172.21.15.191:0/1727618385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffaec0fc1b0 0x7ffaec071490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009920 tx=0x7ffadc009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.868 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.866+0000 7ffaf0dbe640 1 -- 172.21.15.191:0/1727618385 shutdown_connections 2024-09-19T09:27:38.868 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.866+0000 7ffaf0dbe640 1 --2- 172.21.15.191:0/1727618385 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7ffad8039580 0x7ffad803ba30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.868 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.866+0000 7ffaf0dbe640 1 --2- 172.21.15.191:0/1727618385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffaec0fc1b0 0x7ffaec071490 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.868 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.866+0000 7ffaf0dbe640 1 -- 172.21.15.191:0/1727618385 >> 172.21.15.191:0/1727618385 conn(0x7ffaec0f7990 msgr2=0x7ffaec0f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:38.869 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.866+0000 7ffaf0dbe640 1 -- 172.21.15.191:0/1727618385 shutdown_connections 2024-09-19T09:27:38.869 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:38.866+0000 7ffaf0dbe640 1 -- 172.21.15.191:0/1727618385 wait complete. 2024-09-19T09:27:39.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:39 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:39.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:39 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:39.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:39 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:39.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:39 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-19T09:27:39.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:39 smithi112 ceph-mon[27605]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:27:39.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:39 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/1727618385' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:27:40.459 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T09:27:40.460 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:27:40.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:40 smithi112 ceph-mon[27605]: from='mgr.14158 172.21.15.112:0/1962129613' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-19T09:27:40.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:40 smithi112 ceph-mon[27605]: mgrmap e14: smithi112.puhuua(active, since 58s) 2024-09-19T09:27:40.694 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:40.739 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:42.099 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.089+0000 7ff46ecd4640 1 -- 172.21.15.191:0/3490825942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4680fb0d0 msgr2=0x7ff4680fb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:42.099 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.089+0000 7ff46ecd4640 1 --2- 172.21.15.191:0/3490825942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4680fb0d0 0x7ff4680fb4e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff45c004850 tx=0x7ff45c009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.099 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.089+0000 7ff46ecd4640 1 -- 172.21.15.191:0/3490825942 shutdown_connections 2024-09-19T09:27:42.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.089+0000 7ff46ecd4640 1 --2- 172.21.15.191:0/3490825942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4680fb0d0 0x7ff4680fb4e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.089+0000 7ff46ecd4640 1 -- 172.21.15.191:0/3490825942 >> 172.21.15.191:0/3490825942 conn(0x7ff4680f6890 msgr2=0x7ff4680f8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:42.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.089+0000 7ff46ecd4640 1 -- 172.21.15.191:0/3490825942 shutdown_connections 2024-09-19T09:27:42.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.089+0000 7ff46ecd4640 1 -- 172.21.15.191:0/3490825942 wait complete. 2024-09-19T09:27:42.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.090+0000 7ff46ecd4640 1 Processor -- start 2024-09-19T09:27:42.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.090+0000 7ff46ecd4640 1 -- start start 2024-09-19T09:27:42.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.090+0000 7ff46ecd4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4680fb0d0 0x7ff46810c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.090+0000 7ff46ecd4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46810cc90 con 0x7ff4680fb0d0 2024-09-19T09:27:42.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.090+0000 7ff46ca70640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4680fb0d0 0x7ff46810c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.090+0000 7ff46ca70640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4680fb0d0 0x7ff46810c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.191:34634/0 (socket says 172.21.15.191:34634) 2024-09-19T09:27:42.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.090+0000 7ff46ca70640 1 -- 172.21.15.191:0/2834746773 learned_addr learned my addr 172.21.15.191:0/2834746773 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:27:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.090+0000 7ff46ca70640 1 -- 172.21.15.191:0/2834746773 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c005040 con 0x7ff4680fb0d0 2024-09-19T09:27:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.091+0000 7ff46ca70640 1 --2- 172.21.15.191:0/2834746773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4680fb0d0 0x7ff46810c750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff45c02a6d0 tx=0x7ff45c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.091+0000 7ff4657fa640 1 -- 172.21.15.191:0/2834746773 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff45c033630 con 0x7ff4680fb0d0 2024-09-19T09:27:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.091+0000 7ff4657fa640 1 -- 172.21.15.191:0/2834746773 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff45c033c30 con 0x7ff4680fb0d0 2024-09-19T09:27:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.091+0000 7ff46ecd4640 1 -- 172.21.15.191:0/2834746773 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46810ce90 con 0x7ff4680fb0d0 2024-09-19T09:27:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.091+0000 7ff4657fa640 1 -- 172.21.15.191:0/2834746773 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff45c03dc00 con 0x7ff4680fb0d0 2024-09-19T09:27:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.091+0000 7ff46ecd4640 1 -- 172.21.15.191:0/2834746773 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46810d300 con 0x7ff4680fb0d0 2024-09-19T09:27:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.092+0000 7ff4657fa640 1 -- 172.21.15.191:0/2834746773 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 14) v1 ==== 45578+0+0 (secure 0 0 0) 0x7ff45c030020 con 0x7ff4680fb0d0 2024-09-19T09:27:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.092+0000 7ff46ecd4640 1 -- 172.21.15.191:0/2834746773 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46805ed70 con 0x7ff4680fb0d0 2024-09-19T09:27:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.092+0000 7ff4657fa640 1 --2- 172.21.15.191:0/2834746773 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7ff4580395d0 0x7ff45803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.092+0000 7ff4657fa640 1 -- 172.21.15.191:0/2834746773 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff45c06c950 con 0x7ff4680fb0d0 2024-09-19T09:27:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.092+0000 7ff467fff640 1 -- 172.21.15.191:0/2834746773 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7ff4580395d0 msgr2=0x7ff45803ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/3210372910 2024-09-19T09:27:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.092+0000 7ff467fff640 1 --2- 172.21.15.191:0/2834746773 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7ff4580395d0 0x7ff45803ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:27:42.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.097+0000 7ff4657fa640 1 -- 172.21.15.191:0/2834746773 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff45c033790 con 0x7ff4680fb0d0 2024-09-19T09:27:42.295 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.293+0000 7ff467fff640 1 -- 172.21.15.191:0/2834746773 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7ff4580395d0 msgr2=0x7ff45803ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/3210372910 2024-09-19T09:27:42.295 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.293+0000 7ff467fff640 1 --2- 172.21.15.191:0/2834746773 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7ff4580395d0 0x7ff45803ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:27:42.315 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.313+0000 7ff46ecd4640 1 -- 172.21.15.191:0/2834746773 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff46804b720 con 0x7ff4680fb0d0 2024-09-19T09:27:42.316 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.314+0000 7ff4657fa640 1 -- 172.21.15.191:0/2834746773 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7ff45c042210 con 0x7ff4680fb0d0 2024-09-19T09:27:42.316 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:27:42.317 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:25:39.367095Z","created":"2024-09-19T09:25:39.367095Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:27:42.317 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-19T09:27:42.318 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.317+0000 7ff46ecd4640 1 -- 172.21.15.191:0/2834746773 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7ff4580395d0 msgr2=0x7ff45803ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:27:42.318 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.317+0000 7ff46ecd4640 1 --2- 172.21.15.191:0/2834746773 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7ff4580395d0 0x7ff45803ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.318 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.317+0000 7ff46ecd4640 1 -- 172.21.15.191:0/2834746773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4680fb0d0 msgr2=0x7ff46810c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:42.318 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.317+0000 7ff46ecd4640 1 --2- 172.21.15.191:0/2834746773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4680fb0d0 0x7ff46810c750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff45c02a6d0 tx=0x7ff45c009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.318 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.317+0000 7ff46ecd4640 1 -- 172.21.15.191:0/2834746773 shutdown_connections 2024-09-19T09:27:42.319 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.317+0000 7ff46ecd4640 1 --2- 172.21.15.191:0/2834746773 >> [v2:172.21.15.112:6800/3210372910,v1:172.21.15.112:6801/3210372910] conn(0x7ff4580395d0 0x7ff45803ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.319 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.317+0000 7ff46ecd4640 1 --2- 172.21.15.191:0/2834746773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4680fb0d0 0x7ff46810c750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.319 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.317+0000 7ff46ecd4640 1 -- 172.21.15.191:0/2834746773 >> 172.21.15.191:0/2834746773 conn(0x7ff4680f6890 msgr2=0x7ff4680654e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:42.319 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.317+0000 7ff46ecd4640 1 -- 172.21.15.191:0/2834746773 shutdown_connections 2024-09-19T09:27:42.319 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:42.317+0000 7ff46ecd4640 1 -- 172.21.15.191:0/2834746773 wait complete. 2024-09-19T09:27:42.654 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:42 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/2834746773' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:27:43.853 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T09:27:43.854 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:27:43.999 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:43 smithi112 ceph-mon[27605]: Active manager daemon smithi112.puhuua restarted 2024-09-19T09:27:44.000 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:43 smithi112 ceph-mon[27605]: Activating manager daemon smithi112.puhuua 2024-09-19T09:27:44.000 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:43 smithi112 ceph-mon[27605]: osdmap e5: 0 total, 0 up, 0 in 2024-09-19T09:27:44.000 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:43 smithi112 ceph-mon[27605]: mgrmap e15: smithi112.puhuua(active, starting, since 0.00558543s) 2024-09-19T09:27:44.000 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:43 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:27:44.000 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:43 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr metadata", "who": "smithi112.puhuua", "id": "smithi112.puhuua"}]: dispatch 2024-09-19T09:27:44.000 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:43 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:27:44.000 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:43 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:27:44.000 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:43 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:27:44.000 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:43 smithi112 ceph-mon[27605]: Manager daemon smithi112.puhuua is now available 2024-09-19T09:27:44.000 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:43 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:27:44.000 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:43 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:44.000 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:43 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:27:44.001 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:43 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:27:44.107 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:44.152 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:44.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:44 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/trash_purge_schedule"}]: dispatch 2024-09-19T09:27:44.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:44 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:44.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:44 smithi112 ceph-mon[27605]: mgrmap e16: smithi112.puhuua(active, since 1.00513s) 2024-09-19T09:27:45.681 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.679+0000 7fa60e770640 1 -- 172.21.15.191:0/855859835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6080fc1d0 msgr2=0x7fa6080fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:45.681 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.679+0000 7fa60e770640 1 --2- 172.21.15.191:0/855859835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6080fc1d0 0x7fa6080fc5e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8004850 tx=0x7fa5f8009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:45.681 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.679+0000 7fa60e770640 1 -- 172.21.15.191:0/855859835 shutdown_connections 2024-09-19T09:27:45.681 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.679+0000 7fa60e770640 1 --2- 172.21.15.191:0/855859835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6080fc1d0 0x7fa6080fc5e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:45.681 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.679+0000 7fa60e770640 1 -- 172.21.15.191:0/855859835 >> 172.21.15.191:0/855859835 conn(0x7fa6080f79b0 msgr2=0x7fa6080f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:45.681 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.679+0000 7fa60e770640 1 -- 172.21.15.191:0/855859835 shutdown_connections 2024-09-19T09:27:45.681 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.679+0000 7fa60e770640 1 -- 172.21.15.191:0/855859835 wait complete. 2024-09-19T09:27:45.682 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.679+0000 7fa60e770640 1 Processor -- start 2024-09-19T09:27:45.682 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.679+0000 7fa60e770640 1 -- start start 2024-09-19T09:27:45.682 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.679+0000 7fa60e770640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6080fc1d0 0x7fa60810c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:45.682 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.679+0000 7fa60e770640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60810cc10 con 0x7fa6080fc1d0 2024-09-19T09:27:45.682 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.680+0000 7fa607fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6080fc1d0 0x7fa60810c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:45.682 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.680+0000 7fa607fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6080fc1d0 0x7fa60810c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.191:48108/0 (socket says 172.21.15.191:48108) 2024-09-19T09:27:45.682 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.680+0000 7fa607fff640 1 -- 172.21.15.191:0/4010967599 learned_addr learned my addr 172.21.15.191:0/4010967599 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:27:45.682 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.680+0000 7fa607fff640 1 -- 172.21.15.191:0/4010967599 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f8005040 con 0x7fa6080fc1d0 2024-09-19T09:27:45.682 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.680+0000 7fa607fff640 1 --2- 172.21.15.191:0/4010967599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6080fc1d0 0x7fa60810c6d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa5f802a6d0 tx=0x7fa5f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:45.683 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.680+0000 7fa6057fa640 1 -- 172.21.15.191:0/4010967599 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5f8033630 con 0x7fa6080fc1d0 2024-09-19T09:27:45.684 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.680+0000 7fa6057fa640 1 -- 172.21.15.191:0/4010967599 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa5f8033c30 con 0x7fa6080fc1d0 2024-09-19T09:27:45.684 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.680+0000 7fa60e770640 1 -- 172.21.15.191:0/4010967599 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60810ce10 con 0x7fa6080fc1d0 2024-09-19T09:27:45.684 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.680+0000 7fa6057fa640 1 -- 172.21.15.191:0/4010967599 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5f803dc00 con 0x7fa6080fc1d0 2024-09-19T09:27:45.684 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.680+0000 7fa60e770640 1 -- 172.21.15.191:0/4010967599 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60810d280 con 0x7fa6080fc1d0 2024-09-19T09:27:45.684 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.681+0000 7fa6057fa640 1 -- 172.21.15.191:0/4010967599 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) v1 ==== 45428+0+0 (secure 0 0 0) 0x7fa5f8030020 con 0x7fa6080fc1d0 2024-09-19T09:27:45.684 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.681+0000 7fa60e770640 1 -- 172.21.15.191:0/4010967599 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60805ed70 con 0x7fa6080fc1d0 2024-09-19T09:27:45.684 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.681+0000 7fa6057fa640 1 --2- 172.21.15.191:0/4010967599 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa5f4039420 0x7fa5f403b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:45.684 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.681+0000 7fa6057fa640 1 -- 172.21.15.191:0/4010967599 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fa5f806c7c0 con 0x7fa6080fc1d0 2024-09-19T09:27:45.684 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.682+0000 7fa5fffff640 1 --2- 172.21.15.191:0/4010967599 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa5f4039420 0x7fa5f403b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:45.684 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.682+0000 7fa5fffff640 1 --2- 172.21.15.191:0/4010967599 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa5f4039420 0x7fa5f403b8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0006fd0 tx=0x7fa5f0006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:45.687 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.686+0000 7fa6057fa640 1 -- 172.21.15.191:0/4010967599 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa5f8045570 con 0x7fa6080fc1d0 2024-09-19T09:27:45.914 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.912+0000 7fa60e770640 1 -- 172.21.15.191:0/4010967599 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa60804b720 con 0x7fa6080fc1d0 2024-09-19T09:27:45.914 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.913+0000 7fa6057fa640 1 -- 172.21.15.191:0/4010967599 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa5f8045390 con 0x7fa6080fc1d0 2024-09-19T09:27:45.914 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:27:45.915 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:25:39.367095Z","created":"2024-09-19T09:25:39.367095Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:27:45.915 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-19T09:27:45.916 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.915+0000 7fa60e770640 1 -- 172.21.15.191:0/4010967599 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa5f4039420 msgr2=0x7fa5f403b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:45.916 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.915+0000 7fa60e770640 1 --2- 172.21.15.191:0/4010967599 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa5f4039420 0x7fa5f403b8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0006fd0 tx=0x7fa5f0006db0 comp rx=0 tx=0).stop 2024-09-19T09:27:45.917 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.915+0000 7fa60e770640 1 -- 172.21.15.191:0/4010967599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6080fc1d0 msgr2=0x7fa60810c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:45.917 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.915+0000 7fa60e770640 1 --2- 172.21.15.191:0/4010967599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6080fc1d0 0x7fa60810c6d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa5f802a6d0 tx=0x7fa5f8009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:45.917 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.915+0000 7fa60e770640 1 -- 172.21.15.191:0/4010967599 shutdown_connections 2024-09-19T09:27:45.917 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.915+0000 7fa60e770640 1 --2- 172.21.15.191:0/4010967599 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa5f4039420 0x7fa5f403b8d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:45.917 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.915+0000 7fa60e770640 1 --2- 172.21.15.191:0/4010967599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6080fc1d0 0x7fa60810c6d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:45.917 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.915+0000 7fa60e770640 1 -- 172.21.15.191:0/4010967599 >> 172.21.15.191:0/4010967599 conn(0x7fa6080f79b0 msgr2=0x7fa6080f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:45.917 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.915+0000 7fa60e770640 1 -- 172.21.15.191:0/4010967599 shutdown_connections 2024-09-19T09:27:45.917 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:45.915+0000 7fa60e770640 1 -- 172.21.15.191:0/4010967599 wait complete. 2024-09-19T09:27:46.329 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:45 smithi112 ceph-mon[27605]: [19/Sep/2024:09:27:44] ENGINE Bus STARTING 2024-09-19T09:27:46.329 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:45 smithi112 ceph-mon[27605]: [19/Sep/2024:09:27:44] ENGINE Serving on https://172.21.15.112:7150 2024-09-19T09:27:46.329 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:45 smithi112 ceph-mon[27605]: [19/Sep/2024:09:27:44] ENGINE Bus STARTED 2024-09-19T09:27:46.329 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:45 smithi112 ceph-mon[27605]: [19/Sep/2024:09:27:44] ENGINE Error in HTTPServer.serve 2024-09-19T09:27:46.329 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Traceback (most recent call last): 2024-09-19T09:27:46.329 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:27:46.329 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:27:46.329 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:27:46.329 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._run(expiration_interval) 2024-09-19T09:27:46.329 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:27:46.329 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:27:46.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:27:46.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:27:46.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:27:46.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s = self.context.wrap_socket( 2024-09-19T09:27:46.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:27:46.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: return self.sslsocket_class._create( 2024-09-19T09:27:46.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:27:46.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self.do_handshake() 2024-09-19T09:27:46.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:27:46.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._sslobj.do_handshake() 2024-09-19T09:27:46.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:27:46.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:45 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:46.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:45 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:46.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:45 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/4010967599' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:27:47.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:46 smithi112 ceph-mon[27605]: mgrmap e17: smithi112.puhuua(active, since 2s) 2024-09-19T09:27:47.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:46 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:47.479 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T09:27:47.479 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:27:47.769 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:48.186 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:27:49.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:49.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:49.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:49.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:49.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:27:50.391 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.357+0000 7f0cec89b640 1 -- 172.21.15.191:0/674232102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ce81010e0 msgr2=0x7f0ce81014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:50.392 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.357+0000 7f0cec89b640 1 --2- 172.21.15.191:0/674232102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ce81010e0 0x7f0ce81014b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8004850 tx=0x7f0cd8009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:50.392 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.357+0000 7f0cec89b640 1 -- 172.21.15.191:0/674232102 shutdown_connections 2024-09-19T09:27:50.392 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.357+0000 7f0cec89b640 1 --2- 172.21.15.191:0/674232102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ce81010e0 0x7f0ce81014b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:50.392 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.357+0000 7f0cec89b640 1 -- 172.21.15.191:0/674232102 >> 172.21.15.191:0/674232102 conn(0x7f0ce80710b0 msgr2=0x7f0ce80714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:50.392 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.357+0000 7f0cec89b640 1 -- 172.21.15.191:0/674232102 shutdown_connections 2024-09-19T09:27:50.392 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.357+0000 7f0cec89b640 1 -- 172.21.15.191:0/674232102 wait complete. 2024-09-19T09:27:50.392 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.357+0000 7f0cec89b640 1 Processor -- start 2024-09-19T09:27:50.392 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.357+0000 7f0cec89b640 1 -- start start 2024-09-19T09:27:50.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.358+0000 7f0cec89b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ce81010e0 0x7f0ce80fcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:50.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.358+0000 7f0cec89b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80fed60 con 0x7f0ce81010e0 2024-09-19T09:27:50.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.358+0000 7f0ce659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ce81010e0 0x7f0ce80fcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:50.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.358+0000 7f0ce659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ce81010e0 0x7f0ce80fcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.191:48130/0 (socket says 172.21.15.191:48130) 2024-09-19T09:27:50.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.358+0000 7f0ce659c640 1 -- 172.21.15.191:0/284139093 learned_addr learned my addr 172.21.15.191:0/284139093 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:27:50.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.358+0000 7f0ce659c640 1 -- 172.21.15.191:0/284139093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd8005040 con 0x7f0ce81010e0 2024-09-19T09:27:50.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.358+0000 7f0ce659c640 1 --2- 172.21.15.191:0/284139093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ce81010e0 0x7f0ce80fcd80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8004820 tx=0x7f0cd8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:50.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.358+0000 7f0cd6ffd640 1 -- 172.21.15.191:0/284139093 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cd8033630 con 0x7f0ce81010e0 2024-09-19T09:27:50.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.358+0000 7f0cd6ffd640 1 -- 172.21.15.191:0/284139093 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0cd8033c30 con 0x7f0ce81010e0 2024-09-19T09:27:50.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.358+0000 7f0cd6ffd640 1 -- 172.21.15.191:0/284139093 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cd803dcc0 con 0x7f0ce81010e0 2024-09-19T09:27:50.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.358+0000 7f0cec89b640 1 -- 172.21.15.191:0/284139093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce80fd320 con 0x7f0ce81010e0 2024-09-19T09:27:50.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.358+0000 7f0cec89b640 1 -- 172.21.15.191:0/284139093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce80fd7f0 con 0x7f0ce81010e0 2024-09-19T09:27:50.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.359+0000 7f0cd6ffd640 1 -- 172.21.15.191:0/284139093 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f0cd8030020 con 0x7f0ce81010e0 2024-09-19T09:27:50.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.360+0000 7f0cd6ffd640 1 --2- 172.21.15.191:0/284139093 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f0cd0039670 0x7f0cd003bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:50.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.360+0000 7f0cec89b640 1 -- 172.21.15.191:0/284139093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce80fc850 con 0x7f0ce81010e0 2024-09-19T09:27:50.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.360+0000 7f0cd6ffd640 1 -- 172.21.15.191:0/284139093 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f0cd806cb50 con 0x7f0ce81010e0 2024-09-19T09:27:50.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.360+0000 7f0ce5d9b640 1 --2- 172.21.15.191:0/284139093 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f0cd0039670 0x7f0cd003bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:50.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.360+0000 7f0ce5d9b640 1 --2- 172.21.15.191:0/284139093 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f0cd0039670 0x7f0cd003bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc006fd0 tx=0x7f0cdc006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:50.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.364+0000 7f0cd6ffd640 1 -- 172.21.15.191:0/284139093 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0cd803bd80 con 0x7f0ce81010e0 2024-09-19T09:27:50.593 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.592+0000 7f0cec89b640 1 -- 172.21.15.191:0/284139093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0ce80fe420 con 0x7f0ce81010e0 2024-09-19T09:27:50.594 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.593+0000 7f0cd6ffd640 1 -- 172.21.15.191:0/284139093 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f0cd803b7e0 con 0x7f0ce81010e0 2024-09-19T09:27:50.594 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:27:50.594 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:25:39.367095Z","created":"2024-09-19T09:25:39.367095Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:27:50.595 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-19T09:27:50.597 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.596+0000 7f0cec89b640 1 -- 172.21.15.191:0/284139093 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f0cd0039670 msgr2=0x7f0cd003bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:50.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.596+0000 7f0cec89b640 1 --2- 172.21.15.191:0/284139093 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f0cd0039670 0x7f0cd003bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc006fd0 tx=0x7f0cdc006db0 comp rx=0 tx=0).stop 2024-09-19T09:27:50.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.596+0000 7f0cec89b640 1 -- 172.21.15.191:0/284139093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ce81010e0 msgr2=0x7f0ce80fcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:50.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.596+0000 7f0cec89b640 1 --2- 172.21.15.191:0/284139093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ce81010e0 0x7f0ce80fcd80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8004820 tx=0x7f0cd8009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:50.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.596+0000 7f0cec89b640 1 -- 172.21.15.191:0/284139093 shutdown_connections 2024-09-19T09:27:50.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.596+0000 7f0cec89b640 1 --2- 172.21.15.191:0/284139093 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f0cd0039670 0x7f0cd003bb20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:50.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.596+0000 7f0cec89b640 1 --2- 172.21.15.191:0/284139093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ce81010e0 0x7f0ce80fcd80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:50.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.596+0000 7f0cec89b640 1 -- 172.21.15.191:0/284139093 >> 172.21.15.191:0/284139093 conn(0x7f0ce80710b0 msgr2=0x7f0ce8064ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:50.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.596+0000 7f0cec89b640 1 -- 172.21.15.191:0/284139093 shutdown_connections 2024-09-19T09:27:50.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:50.596+0000 7f0cec89b640 1 -- 172.21.15.191:0/284139093 wait complete. 2024-09-19T09:27:50.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:50.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:50.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:50.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:50.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:27:50.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:27:50.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:27:50.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:50.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:50.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:50.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:50.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:50.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi191", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:27:50.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi191", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-19T09:27:50.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:27:51.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:51 smithi112 ceph-mon[27605]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-19T09:27:51.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:51 smithi112 ceph-mon[27605]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-19T09:27:51.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:51 smithi112 ceph-mon[27605]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:27:51.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:51 smithi112 ceph-mon[27605]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:27:51.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:51 smithi112 ceph-mon[27605]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:27:51.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:51 smithi112 ceph-mon[27605]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:27:51.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:51 smithi112 ceph-mon[27605]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:27:51.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:51 smithi112 ceph-mon[27605]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:27:51.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:51 smithi112 ceph-mon[27605]: Deploying daemon crash.smithi191 on smithi191 2024-09-19T09:27:51.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:51 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/284139093' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:27:52.220 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T09:27:52.221 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:27:52.537 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:27:54.583 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.571+0000 7fb831753640 1 -- 172.21.15.191:0/2811178569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb82c1021e0 msgr2=0x7fb82c1025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:54.583 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.571+0000 7fb831753640 1 --2- 172.21.15.191:0/2811178569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb82c1021e0 0x7fb82c1025b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb81c004850 tx=0x7fb81c009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:54.583 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.571+0000 7fb831753640 1 -- 172.21.15.191:0/2811178569 shutdown_connections 2024-09-19T09:27:54.583 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.571+0000 7fb831753640 1 --2- 172.21.15.191:0/2811178569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb82c1021e0 0x7fb82c1025b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:54.583 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.571+0000 7fb831753640 1 -- 172.21.15.191:0/2811178569 >> 172.21.15.191:0/2811178569 conn(0x7fb82c0f7d90 msgr2=0x7fb82c0fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:54.583 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.571+0000 7fb831753640 1 -- 172.21.15.191:0/2811178569 shutdown_connections 2024-09-19T09:27:54.583 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.571+0000 7fb831753640 1 -- 172.21.15.191:0/2811178569 wait complete. 2024-09-19T09:27:54.583 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.572+0000 7fb831753640 1 Processor -- start 2024-09-19T09:27:54.583 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.572+0000 7fb831753640 1 -- start start 2024-09-19T09:27:54.584 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.572+0000 7fb831753640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb82c1021e0 0x7fb82c1127c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:54.584 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.572+0000 7fb831753640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c112d00 con 0x7fb82c1021e0 2024-09-19T09:27:54.584 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.573+0000 7fb82affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb82c1021e0 0x7fb82c1127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:54.584 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.573+0000 7fb82affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb82c1021e0 0x7fb82c1127c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.191:48162/0 (socket says 172.21.15.191:48162) 2024-09-19T09:27:54.584 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.573+0000 7fb82affd640 1 -- 172.21.15.191:0/1859305951 learned_addr learned my addr 172.21.15.191:0/1859305951 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:27:54.584 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.573+0000 7fb82affd640 1 -- 172.21.15.191:0/1859305951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c005040 con 0x7fb82c1021e0 2024-09-19T09:27:54.584 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.573+0000 7fb82affd640 1 --2- 172.21.15.191:0/1859305951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb82c1021e0 0x7fb82c1127c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb81c02a6d0 tx=0x7fb81c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:54.584 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.573+0000 7fb8137fe640 1 -- 172.21.15.191:0/1859305951 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb81c02cf10 con 0x7fb82c1021e0 2024-09-19T09:27:54.584 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.573+0000 7fb8137fe640 1 -- 172.21.15.191:0/1859305951 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb81c033ad0 con 0x7fb82c1021e0 2024-09-19T09:27:54.584 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.573+0000 7fb831753640 1 -- 172.21.15.191:0/1859305951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82c112f00 con 0x7fb82c1021e0 2024-09-19T09:27:54.584 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.573+0000 7fb8137fe640 1 -- 172.21.15.191:0/1859305951 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb81c03ebb0 con 0x7fb82c1021e0 2024-09-19T09:27:54.585 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.573+0000 7fb831753640 1 -- 172.21.15.191:0/1859305951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c1133d0 con 0x7fb82c1021e0 2024-09-19T09:27:54.585 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.574+0000 7fb8137fe640 1 -- 172.21.15.191:0/1859305951 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7fb81c030020 con 0x7fb82c1021e0 2024-09-19T09:27:54.585 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.575+0000 7fb831753640 1 -- 172.21.15.191:0/1859305951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82c0fd950 con 0x7fb82c1021e0 2024-09-19T09:27:54.585 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.575+0000 7fb8137fe640 1 --2- 172.21.15.191:0/1859305951 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb814039670 0x7fb81403bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:54.585 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.575+0000 7fb8137fe640 1 -- 172.21.15.191:0/1859305951 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fb81c06c610 con 0x7fb82c1021e0 2024-09-19T09:27:54.585 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.575+0000 7fb82a7fc640 1 --2- 172.21.15.191:0/1859305951 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb814039670 0x7fb81403bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:54.585 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.576+0000 7fb82a7fc640 1 --2- 172.21.15.191:0/1859305951 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb814039670 0x7fb81403bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb820006fd0 tx=0x7fb820006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:54.585 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.579+0000 7fb8137fe640 1 -- 172.21.15.191:0/1859305951 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb81c03c330 con 0x7fb82c1021e0 2024-09-19T09:27:54.814 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.812+0000 7fb831753640 1 -- 172.21.15.191:0/1859305951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb82c1133d0 con 0x7fb82c1021e0 2024-09-19T09:27:54.814 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.813+0000 7fb8137fe640 1 -- 172.21.15.191:0/1859305951 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fb82c1133d0 con 0x7fb82c1021e0 2024-09-19T09:27:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:27:54.814 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:25:39.367095Z","created":"2024-09-19T09:25:39.367095Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:27:54.815 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-19T09:27:54.816 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.815+0000 7fb831753640 1 -- 172.21.15.191:0/1859305951 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb814039670 msgr2=0x7fb81403bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:54.816 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.815+0000 7fb831753640 1 --2- 172.21.15.191:0/1859305951 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb814039670 0x7fb81403bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb820006fd0 tx=0x7fb820006db0 comp rx=0 tx=0).stop 2024-09-19T09:27:54.816 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.815+0000 7fb831753640 1 -- 172.21.15.191:0/1859305951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb82c1021e0 msgr2=0x7fb82c1127c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:54.816 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.815+0000 7fb831753640 1 --2- 172.21.15.191:0/1859305951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb82c1021e0 0x7fb82c1127c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb81c02a6d0 tx=0x7fb81c009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:54.816 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.815+0000 7fb831753640 1 -- 172.21.15.191:0/1859305951 shutdown_connections 2024-09-19T09:27:54.816 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.815+0000 7fb831753640 1 --2- 172.21.15.191:0/1859305951 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb814039670 0x7fb81403bb20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:54.816 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.815+0000 7fb831753640 1 --2- 172.21.15.191:0/1859305951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb82c1021e0 0x7fb82c1127c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:54.816 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.815+0000 7fb831753640 1 -- 172.21.15.191:0/1859305951 >> 172.21.15.191:0/1859305951 conn(0x7fb82c0f7d90 msgr2=0x7fb82c0f9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:54.816 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.815+0000 7fb831753640 1 -- 172.21.15.191:0/1859305951 shutdown_connections 2024-09-19T09:27:54.817 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:54.815+0000 7fb831753640 1 -- 172.21.15.191:0/1859305951 wait complete. 2024-09-19T09:27:55.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:55 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:55.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:55 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:55.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:55 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:55.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:55 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:27:55.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:55 smithi112 ceph-mon[27605]: Deploying daemon node-exporter.smithi191 on smithi191 2024-09-19T09:27:55.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:55 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/1859305951' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:27:56.444 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T09:27:56.445 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:27:56.685 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:27:59.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.380+0000 7f36d61d5640 1 -- 172.21.15.191:0/3895355104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36d01021e0 msgr2=0x7f36d01025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:59.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.380+0000 7f36d61d5640 1 --2- 172.21.15.191:0/3895355104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36d01021e0 0x7f36d01025b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f36c0004850 tx=0x7f36c0009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:59.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.380+0000 7f36d61d5640 1 -- 172.21.15.191:0/3895355104 shutdown_connections 2024-09-19T09:27:59.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.380+0000 7f36d61d5640 1 --2- 172.21.15.191:0/3895355104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36d01021e0 0x7f36d01025b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:59.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.380+0000 7f36d61d5640 1 -- 172.21.15.191:0/3895355104 >> 172.21.15.191:0/3895355104 conn(0x7f36d00710b0 msgr2=0x7f36d00714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:59.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.380+0000 7f36d61d5640 1 -- 172.21.15.191:0/3895355104 shutdown_connections 2024-09-19T09:27:59.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.380+0000 7f36d61d5640 1 -- 172.21.15.191:0/3895355104 wait complete. 2024-09-19T09:27:59.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.380+0000 7f36d61d5640 1 Processor -- start 2024-09-19T09:27:59.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.380+0000 7f36d61d5640 1 -- start start 2024-09-19T09:27:59.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.380+0000 7f36d61d5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36d01021e0 0x7f36d00fb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:59.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.380+0000 7f36d61d5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00fb6a0 con 0x7f36d01021e0 2024-09-19T09:27:59.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.380+0000 7f36cf7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36d01021e0 0x7f36d00fb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:59.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.380+0000 7f36cf7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36d01021e0 0x7f36d00fb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.191:43316/0 (socket says 172.21.15.191:43316) 2024-09-19T09:27:59.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.380+0000 7f36cf7fe640 1 -- 172.21.15.191:0/2089925354 learned_addr learned my addr 172.21.15.191:0/2089925354 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:27:59.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.381+0000 7f36cf7fe640 1 -- 172.21.15.191:0/2089925354 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c0005040 con 0x7f36d01021e0 2024-09-19T09:27:59.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.381+0000 7f36cf7fe640 1 --2- 172.21.15.191:0/2089925354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36d01021e0 0x7f36d00fb160 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f36c0004820 tx=0x7f36c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:59.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.381+0000 7f36ccff9640 1 -- 172.21.15.191:0/2089925354 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36c0033630 con 0x7f36d01021e0 2024-09-19T09:27:59.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.381+0000 7f36d61d5640 1 -- 172.21.15.191:0/2089925354 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d00fb8a0 con 0x7f36d01021e0 2024-09-19T09:27:59.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.381+0000 7f36ccff9640 1 -- 172.21.15.191:0/2089925354 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f36c0033c30 con 0x7f36d01021e0 2024-09-19T09:27:59.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.381+0000 7f36d61d5640 1 -- 172.21.15.191:0/2089925354 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d00fbd10 con 0x7f36d01021e0 2024-09-19T09:27:59.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.381+0000 7f36ccff9640 1 -- 172.21.15.191:0/2089925354 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36c003dcd0 con 0x7f36d01021e0 2024-09-19T09:27:59.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.382+0000 7f36d61d5640 1 -- 172.21.15.191:0/2089925354 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d00f9510 con 0x7f36d01021e0 2024-09-19T09:27:59.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.382+0000 7f36ccff9640 1 -- 172.21.15.191:0/2089925354 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f36c0030020 con 0x7f36d01021e0 2024-09-19T09:27:59.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.382+0000 7f36ccff9640 1 --2- 172.21.15.191:0/2089925354 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f36bc039670 0x7f36bc03bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:59.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.382+0000 7f36ccff9640 1 -- 172.21.15.191:0/2089925354 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f36c006cbb0 con 0x7f36d01021e0 2024-09-19T09:27:59.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.382+0000 7f36c7fff640 1 --2- 172.21.15.191:0/2089925354 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f36bc039670 0x7f36bc03bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:59.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.383+0000 7f36c7fff640 1 --2- 172.21.15.191:0/2089925354 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f36bc039670 0x7f36bc03bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f36b8006fd0 tx=0x7f36b8006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:59.415 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.387+0000 7f36ccff9640 1 -- 172.21.15.191:0/2089925354 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f36c0033da0 con 0x7f36d01021e0 2024-09-19T09:27:59.612 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.611+0000 7f36d61d5640 1 -- 172.21.15.191:0/2089925354 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f36d00fd950 con 0x7f36d01021e0 2024-09-19T09:27:59.613 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.612+0000 7f36ccff9640 1 -- 172.21.15.191:0/2089925354 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f36c00457b0 con 0x7f36d01021e0 2024-09-19T09:27:59.613 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:27:59.613 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:25:39.367095Z","created":"2024-09-19T09:25:39.367095Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:27:59.614 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-19T09:27:59.615 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.614+0000 7f36d61d5640 1 -- 172.21.15.191:0/2089925354 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f36bc039670 msgr2=0x7f36bc03bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:59.615 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.614+0000 7f36d61d5640 1 --2- 172.21.15.191:0/2089925354 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f36bc039670 0x7f36bc03bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f36b8006fd0 tx=0x7f36b8006db0 comp rx=0 tx=0).stop 2024-09-19T09:27:59.615 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.614+0000 7f36d61d5640 1 -- 172.21.15.191:0/2089925354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36d01021e0 msgr2=0x7f36d00fb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:59.615 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.614+0000 7f36d61d5640 1 --2- 172.21.15.191:0/2089925354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36d01021e0 0x7f36d00fb160 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f36c0004820 tx=0x7f36c0009da0 comp rx=0 tx=0).stop 2024-09-19T09:27:59.615 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.614+0000 7f36d61d5640 1 -- 172.21.15.191:0/2089925354 shutdown_connections 2024-09-19T09:27:59.615 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.614+0000 7f36d61d5640 1 --2- 172.21.15.191:0/2089925354 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f36bc039670 0x7f36bc03bb20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:59.615 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.614+0000 7f36d61d5640 1 --2- 172.21.15.191:0/2089925354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36d01021e0 0x7f36d00fb160 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:59.615 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.614+0000 7f36d61d5640 1 -- 172.21.15.191:0/2089925354 >> 172.21.15.191:0/2089925354 conn(0x7f36d00710b0 msgr2=0x7f36d00f9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:59.616 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.614+0000 7f36d61d5640 1 -- 172.21.15.191:0/2089925354 shutdown_connections 2024-09-19T09:27:59.616 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:27:59.614+0000 7f36d61d5640 1 -- 172.21.15.191:0/2089925354 wait complete. 2024-09-19T09:28:00.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:00.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:28:00.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi191.xjpplx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:28:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi191.xjpplx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:28:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:28:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:59 smithi112 ceph-mon[27605]: Deploying daemon mgr.smithi191.xjpplx on smithi191 2024-09-19T09:28:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:27:59 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/2089925354' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:28:01.203 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T09:28:01.203 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:28:01.459 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:28:03.526 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.523+0000 7f158f0eb640 1 -- 172.21.15.191:0/1594273560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15881021e0 msgr2=0x7f15881025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:03.526 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.523+0000 7f158f0eb640 1 --2- 172.21.15.191:0/1594273560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15881021e0 0x7f15881025b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f157c004850 tx=0x7f157c009da0 comp rx=0 tx=0).stop 2024-09-19T09:28:03.527 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.523+0000 7f158f0eb640 1 -- 172.21.15.191:0/1594273560 shutdown_connections 2024-09-19T09:28:03.527 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.523+0000 7f158f0eb640 1 --2- 172.21.15.191:0/1594273560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15881021e0 0x7f15881025b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:03.527 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.523+0000 7f158f0eb640 1 -- 172.21.15.191:0/1594273560 >> 172.21.15.191:0/1594273560 conn(0x7f15880710b0 msgr2=0x7f15880714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:03.527 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.523+0000 7f158f0eb640 1 -- 172.21.15.191:0/1594273560 shutdown_connections 2024-09-19T09:28:03.527 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.523+0000 7f158f0eb640 1 -- 172.21.15.191:0/1594273560 wait complete. 2024-09-19T09:28:03.527 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.523+0000 7f158f0eb640 1 Processor -- start 2024-09-19T09:28:03.527 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.523+0000 7f158f0eb640 1 -- start start 2024-09-19T09:28:03.527 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.524+0000 7f158f0eb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15881021e0 0x7f1588112790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:03.527 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.524+0000 7f158f0eb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1588112cd0 con 0x7f15881021e0 2024-09-19T09:28:03.528 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.524+0000 7f158ce87640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15881021e0 0x7f1588112790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:03.528 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.524+0000 7f158ce87640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15881021e0 0x7f1588112790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.191:43338/0 (socket says 172.21.15.191:43338) 2024-09-19T09:28:03.528 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.524+0000 7f158ce87640 1 -- 172.21.15.191:0/3134492889 learned_addr learned my addr 172.21.15.191:0/3134492889 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:28:03.528 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.524+0000 7f158ce87640 1 -- 172.21.15.191:0/3134492889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c005040 con 0x7f15881021e0 2024-09-19T09:28:03.528 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.525+0000 7f158ce87640 1 --2- 172.21.15.191:0/3134492889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15881021e0 0x7f1588112790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f157c02a6d0 tx=0x7f157c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:03.528 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.525+0000 7f15857fa640 1 -- 172.21.15.191:0/3134492889 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f157c02cf10 con 0x7f15881021e0 2024-09-19T09:28:03.528 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.525+0000 7f158f0eb640 1 -- 172.21.15.191:0/3134492889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1588112ed0 con 0x7f15881021e0 2024-09-19T09:28:03.528 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.525+0000 7f15857fa640 1 -- 172.21.15.191:0/3134492889 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f157c033ad0 con 0x7f15881021e0 2024-09-19T09:28:03.528 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.525+0000 7f15857fa640 1 -- 172.21.15.191:0/3134492889 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f157c03ebb0 con 0x7f15881021e0 2024-09-19T09:28:03.529 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.525+0000 7f158f0eb640 1 -- 172.21.15.191:0/3134492889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15881133a0 con 0x7f15881021e0 2024-09-19T09:28:03.530 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.526+0000 7f158f0eb640 1 -- 172.21.15.191:0/3134492889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15880fd950 con 0x7f15881021e0 2024-09-19T09:28:03.530 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.526+0000 7f15857fa640 1 -- 172.21.15.191:0/3134492889 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f157c030020 con 0x7f15881021e0 2024-09-19T09:28:03.530 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.526+0000 7f15857fa640 1 --2- 172.21.15.191:0/3134492889 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f1578039670 0x7f157803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:03.530 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.526+0000 7f15857fa640 1 -- 172.21.15.191:0/3134492889 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f157c06c690 con 0x7f15881021e0 2024-09-19T09:28:03.531 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.527+0000 7f1587fff640 1 --2- 172.21.15.191:0/3134492889 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f1578039670 0x7f157803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:03.531 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.527+0000 7f1587fff640 1 --2- 172.21.15.191:0/3134492889 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f1578039670 0x7f157803bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1574006fd0 tx=0x7f1574006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:03.533 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.532+0000 7f15857fa640 1 -- 172.21.15.191:0/3134492889 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f157c03c930 con 0x7f15881021e0 2024-09-19T09:28:03.768 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.767+0000 7f158f0eb640 1 -- 172.21.15.191:0/3134492889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f15881133a0 con 0x7f15881021e0 2024-09-19T09:28:03.769 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.767+0000 7f15857fa640 1 -- 172.21.15.191:0/3134492889 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f15881133a0 con 0x7f15881021e0 2024-09-19T09:28:03.769 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:28:03.769 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:25:39.367095Z","created":"2024-09-19T09:25:39.367095Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:28:03.769 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-19T09:28:03.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.769+0000 7f158f0eb640 1 -- 172.21.15.191:0/3134492889 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f1578039670 msgr2=0x7f157803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:03.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.769+0000 7f158f0eb640 1 --2- 172.21.15.191:0/3134492889 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f1578039670 0x7f157803bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1574006fd0 tx=0x7f1574006db0 comp rx=0 tx=0).stop 2024-09-19T09:28:03.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.769+0000 7f158f0eb640 1 -- 172.21.15.191:0/3134492889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15881021e0 msgr2=0x7f1588112790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:03.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.769+0000 7f158f0eb640 1 --2- 172.21.15.191:0/3134492889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15881021e0 0x7f1588112790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f157c02a6d0 tx=0x7f157c009da0 comp rx=0 tx=0).stop 2024-09-19T09:28:03.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.770+0000 7f158f0eb640 1 -- 172.21.15.191:0/3134492889 shutdown_connections 2024-09-19T09:28:03.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.770+0000 7f158f0eb640 1 --2- 172.21.15.191:0/3134492889 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f1578039670 0x7f157803bb20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:03.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.770+0000 7f158f0eb640 1 --2- 172.21.15.191:0/3134492889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15881021e0 0x7f1588112790 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:03.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.770+0000 7f158f0eb640 1 -- 172.21.15.191:0/3134492889 >> 172.21.15.191:0/3134492889 conn(0x7f15880710b0 msgr2=0x7f15880f9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:03.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.770+0000 7f158f0eb640 1 -- 172.21.15.191:0/3134492889 shutdown_connections 2024-09-19T09:28:03.772 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:03.770+0000 7f158f0eb640 1 -- 172.21.15.191:0/3134492889 wait complete. 2024-09-19T09:28:03.860 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:03 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:03.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:03 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:03.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:03 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:03.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:03 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:03.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:03 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:28:03.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:03 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:03.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:03 smithi112 ceph-mon[27605]: Deploying daemon mon.smithi191 on smithi191 2024-09-19T09:28:05.056 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:04 smithi112 ceph-mon[27605]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:05.056 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:04 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:05.056 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:04 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/3134492889' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:28:06.749 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T09:28:06.749 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:28:07.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:06 smithi112 ceph-mon[27605]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:07.337 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi191/config 2024-09-19T09:28:12.442 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.440+0000 7f8e8c5d8640 1 -- 172.21.15.191:0/3692103404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6c0034f0 msgr2=0x7f8e6c005970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:12.442 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.440+0000 7f8e8c5d8640 1 --2- 172.21.15.191:0/3692103404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6c0034f0 0x7f8e6c005970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8e840fb9f0 tx=0x7f8e7400b040 comp rx=0 tx=0).stop 2024-09-19T09:28:12.442 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.440+0000 7f8e8c5d8640 1 -- 172.21.15.191:0/3692103404 shutdown_connections 2024-09-19T09:28:12.442 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.440+0000 7f8e8c5d8640 1 --2- 172.21.15.191:0/3692103404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6c0034f0 0x7f8e6c005970 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:12.443 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.440+0000 7f8e8c5d8640 1 -- 172.21.15.191:0/3692103404 >> 172.21.15.191:0/3692103404 conn(0x7f8e840707b0 msgr2=0x7f8e84070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:12.443 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.440+0000 7f8e8c5d8640 1 -- 172.21.15.191:0/3692103404 shutdown_connections 2024-09-19T09:28:12.443 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.441+0000 7f8e8c5d8640 1 -- 172.21.15.191:0/3692103404 wait complete. 2024-09-19T09:28:12.444 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.441+0000 7f8e8c5d8640 1 Processor -- start 2024-09-19T09:28:12.445 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e8c5d8640 1 -- start start 2024-09-19T09:28:12.445 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e8c5d8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6c0034f0 0x7f8e840fbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:12.445 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e8c5d8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e840fc070 0x7f8e840fc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:12.445 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e8c5d8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e84118d00 con 0x7f8e6c0034f0 2024-09-19T09:28:12.445 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e8c5d8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e84118e40 con 0x7f8e840fc070 2024-09-19T09:28:12.445 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e89b73640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e840fc070 0x7f8e840fc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:12.445 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e89b73640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e840fc070 0x7f8e840fc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:57050/0 (socket says 172.21.15.191:57050) 2024-09-19T09:28:12.445 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e89b73640 1 -- 172.21.15.191:0/1814925172 learned_addr learned my addr 172.21.15.191:0/1814925172 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:28:12.445 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e89b73640 1 -- 172.21.15.191:0/1814925172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e840fc070 msgr2=0x7f8e840fc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T09:28:12.445 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e89b73640 1 -- 172.21.15.191:0/1814925172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e840fc070 msgr2=0x7f8e840fc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:28:12.445 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e8a374640 1 --2- 172.21.15.191:0/1814925172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6c0034f0 0x7f8e840fbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:12.445 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e89b73640 1 --2- 172.21.15.191:0/1814925172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e840fc070 0x7f8e840fc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-19T09:28:12.445 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e89b73640 1 --2- 172.21.15.191:0/1814925172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e840fc070 0x7f8e840fc4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:28:12.446 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e8a374640 1 -- 172.21.15.191:0/1814925172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e840fc070 msgr2=0x7f8e840fc4c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:28:12.446 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e8a374640 1 --2- 172.21.15.191:0/1814925172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e840fc070 0x7f8e840fc4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:12.446 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.442+0000 7f8e8a374640 1 -- 172.21.15.191:0/1814925172 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e74005040 con 0x7f8e6c0034f0 2024-09-19T09:28:12.446 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.443+0000 7f8e8a374640 1 --2- 172.21.15.191:0/1814925172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6c0034f0 0x7f8e840fbb30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8e74037040 tx=0x7f8e7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:12.446 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.443+0000 7f8e82ffd640 1 -- 172.21.15.191:0/1814925172 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e74043070 con 0x7f8e6c0034f0 2024-09-19T09:28:12.446 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.443+0000 7f8e82ffd640 1 -- 172.21.15.191:0/1814925172 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8e7400f040 con 0x7f8e6c0034f0 2024-09-19T09:28:12.446 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.443+0000 7f8e8c5d8640 1 -- 172.21.15.191:0/1814925172 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e84119040 con 0x7f8e6c0034f0 2024-09-19T09:28:12.446 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.443+0000 7f8e82ffd640 1 -- 172.21.15.191:0/1814925172 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e74035640 con 0x7f8e6c0034f0 2024-09-19T09:28:12.446 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.443+0000 7f8e8c5d8640 1 -- 172.21.15.191:0/1814925172 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e84119530 con 0x7f8e6c0034f0 2024-09-19T09:28:12.447 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.444+0000 7f8e8c5d8640 1 -- 172.21.15.191:0/1814925172 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e840fdc70 con 0x7f8e6c0034f0 2024-09-19T09:28:12.447 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.445+0000 7f8e82ffd640 1 -- 172.21.15.191:0/1814925172 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f8e7403f430 con 0x7f8e6c0034f0 2024-09-19T09:28:12.447 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.445+0000 7f8e82ffd640 1 --2- 172.21.15.191:0/1814925172 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f8e7006ee10 0x7f8e700712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:12.447 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.445+0000 7f8e82ffd640 1 -- 172.21.15.191:0/1814925172 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f8e740adf60 con 0x7f8e6c0034f0 2024-09-19T09:28:12.447 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.446+0000 7f8e89b73640 1 --2- 172.21.15.191:0/1814925172 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f8e7006ee10 0x7f8e700712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:12.448 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.447+0000 7f8e89b73640 1 --2- 172.21.15.191:0/1814925172 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f8e7006ee10 0x7f8e700712c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8e78006fd0 tx=0x7f8e78008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:12.451 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.450+0000 7f8e82ffd640 1 -- 172.21.15.191:0/1814925172 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8e7407c180 con 0x7f8e6c0034f0 2024-09-19T09:28:12.687 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.686+0000 7f8e8c5d8640 1 -- 172.21.15.191:0/1814925172 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8e8404b720 con 0x7f8e6c0034f0 2024-09-19T09:28:12.688 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.687+0000 7f8e82ffd640 1 -- 172.21.15.191:0/1814925172 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7f8e74031020 con 0x7f8e6c0034f0 2024-09-19T09:28:12.688 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:28:12.688 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":2,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:28:07.274063Z","created":"2024-09-19T09:25:39.367095Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi191","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T09:28:12.689 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 2 2024-09-19T09:28:12.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:28:12.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: mon.smithi112 calling monitor election 2024-09-19T09:28:12.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:28:12.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:12.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:28:12.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:28:12.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: mon.smithi191 calling monitor election 2024-09-19T09:28:12.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:12.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:28:12.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:28:12.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:28:12.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: mon.smithi112 is new leader, mons smithi112,smithi191 in quorum (ranks 0,1) 2024-09-19T09:28:12.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: monmap e2: 2 mons at {smithi112=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0],smithi191=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-19T09:28:12.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: fsmap 2024-09-19T09:28:12.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: osdmap e5: 0 total, 0 up, 0 in 2024-09-19T09:28:12.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: mgrmap e17: smithi112.puhuua(active, since 28s) 2024-09-19T09:28:12.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: overall HEALTH_OK 2024-09-19T09:28:12.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: Standby manager daemon smithi191.xjpplx started 2024-09-19T09:28:12.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:12.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:12.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:12.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:12.691 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:12 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:12.691 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.689+0000 7f8e8c5d8640 1 -- 172.21.15.191:0/1814925172 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f8e7006ee10 msgr2=0x7f8e700712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:12.691 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.689+0000 7f8e8c5d8640 1 --2- 172.21.15.191:0/1814925172 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f8e7006ee10 0x7f8e700712c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8e78006fd0 tx=0x7f8e78008040 comp rx=0 tx=0).stop 2024-09-19T09:28:12.691 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.689+0000 7f8e8c5d8640 1 -- 172.21.15.191:0/1814925172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6c0034f0 msgr2=0x7f8e840fbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:12.691 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.689+0000 7f8e8c5d8640 1 --2- 172.21.15.191:0/1814925172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6c0034f0 0x7f8e840fbb30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8e74037040 tx=0x7f8e7400b040 comp rx=0 tx=0).stop 2024-09-19T09:28:12.691 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.689+0000 7f8e8c5d8640 1 -- 172.21.15.191:0/1814925172 shutdown_connections 2024-09-19T09:28:12.692 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.689+0000 7f8e8c5d8640 1 --2- 172.21.15.191:0/1814925172 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f8e7006ee10 0x7f8e700712c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:12.692 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.689+0000 7f8e8c5d8640 1 --2- 172.21.15.191:0/1814925172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e840fc070 0x7f8e840fc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:12.692 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.689+0000 7f8e8c5d8640 1 --2- 172.21.15.191:0/1814925172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6c0034f0 0x7f8e840fbb30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:12.692 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.689+0000 7f8e8c5d8640 1 -- 172.21.15.191:0/1814925172 >> 172.21.15.191:0/1814925172 conn(0x7f8e840707b0 msgr2=0x7f8e84101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:12.692 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.689+0000 7f8e8c5d8640 1 -- 172.21.15.191:0/1814925172 shutdown_connections 2024-09-19T09:28:12.692 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:28:12.689+0000 7f8e8c5d8640 1 -- 172.21.15.191:0/1814925172 wait complete. 2024-09-19T09:28:13.282 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T09:28:13.282 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T09:28:13.534 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:28:13.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:13 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:28:13.654 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:13 smithi112 ceph-mon[27605]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:13.654 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:13 smithi112 ceph-mon[27605]: mgrmap e18: smithi112.puhuua(active, since 28s), standbys: smithi191.xjpplx 2024-09-19T09:28:13.655 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:13 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr metadata", "who": "smithi191.xjpplx", "id": "smithi191.xjpplx"}]: dispatch 2024-09-19T09:28:13.655 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:13 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:28:13.655 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:13 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/1814925172' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:28:13.655 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:13 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:28:14.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:14 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:28:14.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:14 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:14.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:14 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:28:14.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:14 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:15.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.286+0000 7f1866ef9640 1 -- 172.21.15.112:0/348398462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18601021e0 msgr2=0x7f18601025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:15.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.286+0000 7f1866ef9640 1 --2- 172.21.15.112:0/348398462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18601021e0 0x7f18601025b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1854004850 tx=0x7f1854009da0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.286+0000 7f1866ef9640 1 -- 172.21.15.112:0/348398462 shutdown_connections 2024-09-19T09:28:15.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.286+0000 7f1866ef9640 1 --2- 172.21.15.112:0/348398462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18601021e0 0x7f18601025b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.286+0000 7f1866ef9640 1 -- 172.21.15.112:0/348398462 >> 172.21.15.112:0/348398462 conn(0x7f18600710b0 msgr2=0x7f18600714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:15.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.286+0000 7f1866ef9640 1 -- 172.21.15.112:0/348398462 shutdown_connections 2024-09-19T09:28:15.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.286+0000 7f1866ef9640 1 -- 172.21.15.112:0/348398462 wait complete. 2024-09-19T09:28:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.286+0000 7f1866ef9640 1 Processor -- start 2024-09-19T09:28:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.286+0000 7f1866ef9640 1 -- start start 2024-09-19T09:28:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f1866ef9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18601021e0 0x7f1860112890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f1866ef9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1860112dd0 0x7f186010c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f1866ef9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1860113390 con 0x7f1860112dd0 2024-09-19T09:28:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f1866ef9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18601134d0 con 0x7f18601021e0 2024-09-19T09:28:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f185ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1860112dd0 0x7f186010c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f185ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1860112dd0 0x7f186010c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50358/0 (socket says 172.21.15.112:50358) 2024-09-19T09:28:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f185ffff640 1 -- 172.21.15.112:0/711496005 learned_addr learned my addr 172.21.15.112:0/711496005 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:28:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f1864c95640 1 --2- 172.21.15.112:0/711496005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18601021e0 0x7f1860112890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f1864c95640 1 -- 172.21.15.112:0/711496005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18601021e0 msgr2=0x7f1860112890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T09:28:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f1864c95640 1 -- 172.21.15.112:0/711496005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18601021e0 msgr2=0x7f1860112890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:28:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f1864c95640 1 --2- 172.21.15.112:0/711496005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18601021e0 0x7f1860112890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-19T09:28:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f1864c95640 1 --2- 172.21.15.112:0/711496005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18601021e0 0x7f1860112890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:28:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f185ffff640 1 -- 172.21.15.112:0/711496005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18601021e0 msgr2=0x7f1860112890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:28:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f185ffff640 1 --2- 172.21.15.112:0/711496005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18601021e0 0x7f1860112890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f185ffff640 1 -- 172.21.15.112:0/711496005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854005040 con 0x7f1860112dd0 2024-09-19T09:28:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f185ffff640 1 --2- 172.21.15.112:0/711496005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1860112dd0 0x7f186010c830 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f184c00b790 tx=0x7f184c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.287+0000 7f185d7fa640 1 -- 172.21.15.112:0/711496005 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f184c00c700 con 0x7f1860112dd0 2024-09-19T09:28:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.288+0000 7f185d7fa640 1 -- 172.21.15.112:0/711496005 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f184c00cd00 con 0x7f1860112dd0 2024-09-19T09:28:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.288+0000 7f1866ef9640 1 -- 172.21.15.112:0/711496005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186010ce30 con 0x7f1860112dd0 2024-09-19T09:28:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.288+0000 7f185d7fa640 1 -- 172.21.15.112:0/711496005 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f184c0133a0 con 0x7f1860112dd0 2024-09-19T09:28:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.288+0000 7f1866ef9640 1 -- 172.21.15.112:0/711496005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186010d350 con 0x7f1860112dd0 2024-09-19T09:28:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.289+0000 7f1866ef9640 1 -- 172.21.15.112:0/711496005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186010d630 con 0x7f1860112dd0 2024-09-19T09:28:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.289+0000 7f185d7fa640 1 -- 172.21.15.112:0/711496005 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f184c0146f0 con 0x7f1860112dd0 2024-09-19T09:28:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.289+0000 7f185d7fa640 1 --2- 172.21.15.112:0/711496005 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f185006ee20 0x7f18500712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.290+0000 7f1864c95640 1 --2- 172.21.15.112:0/711496005 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f185006ee20 0x7f18500712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.290+0000 7f185d7fa640 1 -- 172.21.15.112:0/711496005 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f184c08c6b0 con 0x7f1860112dd0 2024-09-19T09:28:15.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.290+0000 7f1864c95640 1 --2- 172.21.15.112:0/711496005 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f185006ee20 0x7f18500712d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f185402ab60 tx=0x7f1854009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:15.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.294+0000 7f185d7fa640 1 -- 172.21.15.112:0/711496005 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f184c04d2a0 con 0x7f1860112dd0 2024-09-19T09:28:15.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.459+0000 7f1866ef9640 1 -- 172.21.15.112:0/711496005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f1860106410 con 0x7f1860112dd0 2024-09-19T09:28:15.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.459+0000 7f185d7fa640 1 -- 172.21.15.112:0/711496005 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7f184c019100 con 0x7f1860112dd0 2024-09-19T09:28:15.461 INFO:teuthology.orchestra.run.smithi112.stdout:# minimal ceph.conf for 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:15.461 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-19T09:28:15.461 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:15.461 INFO:teuthology.orchestra.run.smithi112.stdout: mon_host = [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] 2024-09-19T09:28:15.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.461+0000 7f1866ef9640 1 -- 172.21.15.112:0/711496005 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f185006ee20 msgr2=0x7f18500712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:15.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.461+0000 7f1866ef9640 1 --2- 172.21.15.112:0/711496005 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f185006ee20 0x7f18500712d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f185402ab60 tx=0x7f1854009da0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.461+0000 7f1866ef9640 1 -- 172.21.15.112:0/711496005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1860112dd0 msgr2=0x7f186010c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:15.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.461+0000 7f1866ef9640 1 --2- 172.21.15.112:0/711496005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1860112dd0 0x7f186010c830 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f184c00b790 tx=0x7f184c0091d0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.461+0000 7f1866ef9640 1 -- 172.21.15.112:0/711496005 shutdown_connections 2024-09-19T09:28:15.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.461+0000 7f1866ef9640 1 --2- 172.21.15.112:0/711496005 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f185006ee20 0x7f18500712d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.462+0000 7f1866ef9640 1 --2- 172.21.15.112:0/711496005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1860112dd0 0x7f186010c830 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.462+0000 7f1866ef9640 1 --2- 172.21.15.112:0/711496005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18601021e0 0x7f1860112890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.462+0000 7f1866ef9640 1 -- 172.21.15.112:0/711496005 >> 172.21.15.112:0/711496005 conn(0x7f18600710b0 msgr2=0x7f18600fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:15.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.462+0000 7f1866ef9640 1 -- 172.21.15.112:0/711496005 shutdown_connections 2024-09-19T09:28:15.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:15.462+0000 7f1866ef9640 1 -- 172.21.15.112:0/711496005 wait complete. 2024-09-19T09:28:15.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:15 smithi112 ceph-mon[27605]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:15.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:15.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:15.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:15.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:28:15.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:15.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:15.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:15.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:15.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:15.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:28:15.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:28:15.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:15.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:15 smithi191 ceph-mon[34834]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:15.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:15.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:15.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:15.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:28:15.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:15.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:15.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:15.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:15.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:15.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:28:15.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:28:15.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:16.101 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T09:28:16.101 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:28:16.101 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:28:16.128 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:28:16.128 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:28:16.194 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:28:16.194 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:28:16.223 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:28:16.223 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:28:16.289 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T09:28:16.290 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:28:16.290 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:28:16.305 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:28:16.305 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-09-19T09:28:16.362 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:28:16.362 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:28:16.363 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T09:28:16.363 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:28:16.363 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:28:16.363 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-19 09:27:34.236412980 +0000 2024-09-19T09:28:16.363 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-19 09:22:36.692463008 +0000 2024-09-19T09:28:16.363 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-19 09:22:36.692463008 +0000 2024-09-19T09:28:16.363 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-19 09:22:36.692463008 +0000 2024-09-19T09:28:16.363 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:28:16.426 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-19T09:28:16.427 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-19T09:28:16.427 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000207021 s, 2.5 MB/s 2024-09-19T09:28:16.428 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:28:16.484 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-09-19T09:28:16.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:16 smithi191 ceph-mon[34834]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-19T09:28:16.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:16 smithi191 ceph-mon[34834]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-19T09:28:16.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:16 smithi191 ceph-mon[34834]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:28:16.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:16 smithi191 ceph-mon[34834]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:28:16.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:16 smithi191 ceph-mon[34834]: Reconfiguring mon.smithi112 (unknown last config time)... 2024-09-19T09:28:16.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:16 smithi191 ceph-mon[34834]: Reconfiguring daemon mon.smithi112 on smithi112 2024-09-19T09:28:16.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:16 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/711496005' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:28:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:28:16.542 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T09:28:16.542 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:28:16.542 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:28:16.542 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-19 09:27:34.237412954 +0000 2024-09-19T09:28:16.542 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-19 09:22:37.024453006 +0000 2024-09-19T09:28:16.542 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-19 09:22:37.024453006 +0000 2024-09-19T09:28:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-19 09:22:37.024453006 +0000 2024-09-19T09:28:16.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:28:16.605 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-19T09:28:16.605 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-19T09:28:16.605 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000217716 s, 2.4 MB/s 2024-09-19T09:28:16.606 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:28:16.650 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:16 smithi112 ceph-mon[27605]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-19T09:28:16.650 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:16 smithi112 ceph-mon[27605]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-19T09:28:16.650 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:16 smithi112 ceph-mon[27605]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:28:16.650 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:16 smithi112 ceph-mon[27605]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:28:16.650 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:16 smithi112 ceph-mon[27605]: Reconfiguring mon.smithi112 (unknown last config time)... 2024-09-19T09:28:16.650 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:16 smithi112 ceph-mon[27605]: Reconfiguring daemon mon.smithi112 on smithi112 2024-09-19T09:28:16.650 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:16 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/711496005' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:16.663 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-09-19T09:28:16.719 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:28:16.719 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:28:16.719 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T09:28:16.719 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:28:16.719 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:28:16.719 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-19 09:27:34.237412954 +0000 2024-09-19T09:28:16.719 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-19 09:22:37.355443034 +0000 2024-09-19T09:28:16.719 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-19 09:22:37.355443034 +0000 2024-09-19T09:28:16.720 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-19 09:22:37.355443034 +0000 2024-09-19T09:28:16.720 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:28:16.783 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-19T09:28:16.783 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-19T09:28:16.783 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000213553 s, 2.4 MB/s 2024-09-19T09:28:16.784 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:28:16.840 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-09-19T09:28:16.896 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:28:16.896 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:28:16.896 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T09:28:16.896 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:28:16.896 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:28:16.896 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-19 09:27:34.238412927 +0000 2024-09-19T09:28:16.896 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-19 09:22:37.685433092 +0000 2024-09-19T09:28:16.897 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-19 09:22:37.685433092 +0000 2024-09-19T09:28:16.897 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-19 09:22:37.685433092 +0000 2024-09-19T09:28:16.897 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:28:16.960 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-19T09:28:16.960 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-19T09:28:16.960 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000211613 s, 2.4 MB/s 2024-09-19T09:28:16.961 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:28:17.018 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:28:17.018 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:28:17.037 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:28:17.037 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2024-09-19T09:28:17.096 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:28:17.097 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:28:17.097 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T09:28:17.097 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:28:17.097 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:28:17.097 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-19 09:28:06.644456340 +0000 2024-09-19T09:28:17.097 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-19 09:22:36.703561824 +0000 2024-09-19T09:28:17.097 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-19 09:22:36.703561824 +0000 2024-09-19T09:28:17.097 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-19 09:22:36.703561824 +0000 2024-09-19T09:28:17.097 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:28:17.165 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-19T09:28:17.165 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-19T09:28:17.165 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000221714 s, 2.3 MB/s 2024-09-19T09:28:17.166 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:28:17.226 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2024-09-19T09:28:17.285 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:28:17.285 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:28:17.285 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T09:28:17.285 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:28:17.285 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:28:17.285 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-19 09:28:06.645456323 +0000 2024-09-19T09:28:17.286 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-19 09:22:37.021556368 +0000 2024-09-19T09:28:17.286 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-19 09:22:37.021556368 +0000 2024-09-19T09:28:17.286 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-19 09:22:37.021556368 +0000 2024-09-19T09:28:17.286 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:28:17.351 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-19T09:28:17.351 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-19T09:28:17.351 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000225063 s, 2.3 MB/s 2024-09-19T09:28:17.353 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:28:17.412 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2024-09-19T09:28:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:28:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:28:17.470 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T09:28:17.470 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:28:17.470 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:28:17.470 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-19 09:28:06.645456323 +0000 2024-09-19T09:28:17.470 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-19 09:22:37.346550792 +0000 2024-09-19T09:28:17.471 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-19 09:22:37.346550792 +0000 2024-09-19T09:28:17.471 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-19 09:22:37.346550792 +0000 2024-09-19T09:28:17.471 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:28:17.533 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:17 smithi191 ceph-mon[34834]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:17.533 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:17 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:17.533 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:17 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:17.533 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:17 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.puhuua", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:28:17.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:17 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:28:17.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:17 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:17.535 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-19T09:28:17.535 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-19T09:28:17.535 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000234963 s, 2.2 MB/s 2024-09-19T09:28:17.538 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:28:17.595 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2024-09-19T09:28:17.651 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:28:17.651 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:28:17.652 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T09:28:17.652 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:28:17.652 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:28:17.652 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-19 09:28:06.645456323 +0000 2024-09-19T09:28:17.652 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-19 09:22:37.663545353 +0000 2024-09-19T09:28:17.652 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-19 09:22:37.663545353 +0000 2024-09-19T09:28:17.652 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-19 09:22:37.663545353 +0000 2024-09-19T09:28:17.652 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:28:17.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:17 smithi112 ceph-mon[27605]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:17.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:17 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:17.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:17 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:17.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:17 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.puhuua", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:28:17.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:17 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:28:17.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:17 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:17.716 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-19T09:28:17.717 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-19T09:28:17.717 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000225549 s, 2.3 MB/s 2024-09-19T09:28:17.718 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:28:17.775 INFO:tasks.cephadm:Deploying osd.0 on smithi112 with /dev/vg_nvme/lv_4... 2024-09-19T09:28:17.775 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:28:18.685 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:18 smithi112 ceph-mon[27605]: Reconfiguring mgr.smithi112.puhuua (unknown last config time)... 2024-09-19T09:28:18.685 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:18 smithi112 ceph-mon[27605]: Reconfiguring daemon mgr.smithi112.puhuua on smithi112 2024-09-19T09:28:18.726 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:28:18.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:18 smithi191 ceph-mon[34834]: Reconfiguring mgr.smithi112.puhuua (unknown last config time)... 2024-09-19T09:28:18.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:18 smithi191 ceph-mon[34834]: Reconfiguring daemon mgr.smithi112.puhuua on smithi112 2024-09-19T09:28:19.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:19 smithi112 ceph-mon[27605]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:19.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:19 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:19.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:19 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:19.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:19 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:28:19.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:19 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:19.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:19 smithi191 ceph-mon[34834]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:19.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:19 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:19.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:19 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:19.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:19 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:28:19.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:19 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:20.685 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:20 smithi191 ceph-mon[34834]: Reconfiguring crash.smithi112 (monmap changed)... 2024-09-19T09:28:20.685 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:20 smithi191 ceph-mon[34834]: Reconfiguring daemon crash.smithi112 on smithi112 2024-09-19T09:28:20.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:20 smithi112 ceph-mon[27605]: Reconfiguring crash.smithi112 (monmap changed)... 2024-09-19T09:28:20.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:20 smithi112 ceph-mon[27605]: Reconfiguring daemon crash.smithi112 on smithi112 2024-09-19T09:28:21.559 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:21 smithi112 ceph-mon[27605]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:21.560 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:21 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:21.560 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:21 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:21.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:21 smithi191 ceph-mon[34834]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:21.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:21 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:21.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:21 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:22.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:22 smithi112 ceph-mon[27605]: Reconfiguring alertmanager.smithi112 (dependencies changed)... 2024-09-19T09:28:22.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:22 smithi112 ceph-mon[27605]: Reconfiguring daemon alertmanager.smithi112 on smithi112 2024-09-19T09:28:22.469 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:28:22.489 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_4 2024-09-19T09:28:22.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:22 smithi191 ceph-mon[34834]: Reconfiguring alertmanager.smithi112 (dependencies changed)... 2024-09-19T09:28:22.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:22 smithi191 ceph-mon[34834]: Reconfiguring daemon alertmanager.smithi112 on smithi112 2024-09-19T09:28:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:28:23.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:23 smithi112 ceph-mon[27605]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:23.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:23 smithi191 ceph-mon[34834]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:25.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:25 smithi112 ceph-mon[27605]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:25.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:25 smithi191 ceph-mon[34834]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.708+0000 7feade51d640 1 -- 172.21.15.112:0/2067282888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead8065bc0 msgr2=0x7fead81015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.708+0000 7feade51d640 1 --2- 172.21.15.112:0/2067282888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead8065bc0 0x7fead81015c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7feac80048d0 tx=0x7feac8009da0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.708+0000 7feade51d640 1 -- 172.21.15.112:0/2067282888 shutdown_connections 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.708+0000 7feade51d640 1 --2- 172.21.15.112:0/2067282888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fead8101b00 0x7fead8103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.708+0000 7feade51d640 1 --2- 172.21.15.112:0/2067282888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead8065bc0 0x7fead81015c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.708+0000 7feade51d640 1 -- 172.21.15.112:0/2067282888 >> 172.21.15.112:0/2067282888 conn(0x7fead80f6c10 msgr2=0x7fead80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.708+0000 7feade51d640 1 -- 172.21.15.112:0/2067282888 shutdown_connections 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.708+0000 7feade51d640 1 -- 172.21.15.112:0/2067282888 wait complete. 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.708+0000 7feade51d640 1 Processor -- start 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.708+0000 7feade51d640 1 -- start start 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.708+0000 7feade51d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead8065bc0 0x7fead810f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.708+0000 7feade51d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fead8101b00 0x7fead810f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.708+0000 7feade51d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead810fee0 con 0x7fead8065bc0 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.708+0000 7feade51d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead8110660 con 0x7fead8101b00 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.709+0000 7fead7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead8065bc0 0x7fead810f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.709+0000 7fead7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead8065bc0 0x7fead810f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36586/0 (socket says 172.21.15.112:36586) 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.709+0000 7fead7fff640 1 -- 172.21.15.112:0/786583619 learned_addr learned my addr 172.21.15.112:0/786583619 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.709+0000 7feacffff640 1 --2- 172.21.15.112:0/786583619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fead8101b00 0x7fead810f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.709+0000 7fead7fff640 1 -- 172.21.15.112:0/786583619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fead8101b00 msgr2=0x7fead810f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.709+0000 7fead7fff640 1 --2- 172.21.15.112:0/786583619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fead8101b00 0x7fead810f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.709+0000 7fead7fff640 1 -- 172.21.15.112:0/786583619 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac8005040 con 0x7fead8065bc0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.709+0000 7fead7fff640 1 --2- 172.21.15.112:0/786583619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead8065bc0 0x7fead810f350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7feac80048a0 tx=0x7feac8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.709+0000 7fead57fa640 1 -- 172.21.15.112:0/786583619 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac8038070 con 0x7fead8065bc0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.709+0000 7fead57fa640 1 -- 172.21.15.112:0/786583619 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feac802abd0 con 0x7fead8065bc0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.709+0000 7feade51d640 1 -- 172.21.15.112:0/786583619 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead8110890 con 0x7fead8065bc0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.709+0000 7fead57fa640 1 -- 172.21.15.112:0/786583619 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac8033640 con 0x7fead8065bc0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.709+0000 7feade51d640 1 -- 172.21.15.112:0/786583619 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead8110e30 con 0x7fead8065bc0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.710+0000 7feade51d640 1 -- 172.21.15.112:0/786583619 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead80fa890 con 0x7fead8065bc0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.711+0000 7fead57fa640 1 -- 172.21.15.112:0/786583619 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7feac8030020 con 0x7fead8065bc0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.711+0000 7fead57fa640 1 --2- 172.21.15.112:0/786583619 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7feac406ecc0 0x7feac4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.711+0000 7fead57fa640 1 -- 172.21.15.112:0/786583619 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7feac80ad3d0 con 0x7fead8065bc0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.711+0000 7feacffff640 1 --2- 172.21.15.112:0/786583619 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7feac406ecc0 0x7feac4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.712+0000 7feacffff640 1 --2- 172.21.15.112:0/786583619 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7feac406ecc0 0x7feac4071170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fead810f100 tx=0x7feac0009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:26.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.715+0000 7fead57fa640 1 -- 172.21.15.112:0/786583619 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7feac807b5d0 con 0x7fead8065bc0 2024-09-19T09:28:26.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:26.886+0000 7feade51d640 1 -- 172.21.15.112:0/786583619 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fead81110c0 con 0x7feac406ecc0 2024-09-19T09:28:27.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:27 smithi112 ceph-mon[27605]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:27.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:27 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:28:27.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:27 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:28:27.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:27 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:27.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:27 smithi191 ceph-mon[34834]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:27.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:27 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:28:27.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:27 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:28:27.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:27 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:28.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:28 smithi112 ceph-mon[27605]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:28:28.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:28 smithi191 ceph-mon[34834]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:28:29.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:29 smithi112 ceph-mon[27605]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:29.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:29 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:28:29.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:29 smithi191 ceph-mon[34834]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:29.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:29 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:28:30.884 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:30 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:30.884 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:30 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:30.884 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:30 smithi112 ceph-mon[27605]: Reconfiguring grafana.smithi112 (dependencies changed)... 2024-09-19T09:28:30.884 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:30 smithi112 ceph-mon[27605]: Reconfiguring daemon grafana.smithi112 on smithi112 2024-09-19T09:28:30.884 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:30 smithi112 ceph-mon[27605]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:30.885 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:30 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3253352903' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ce98763-b438-4d5d-9907-e2652cd154ad"}]: dispatch 2024-09-19T09:28:30.885 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:30 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3253352903' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ce98763-b438-4d5d-9907-e2652cd154ad"}]': finished 2024-09-19T09:28:30.885 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:30 smithi112 ceph-mon[27605]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:28:30.885 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:30 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:28:31.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:30 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:31.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:30 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:31.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:30 smithi191 ceph-mon[34834]: Reconfiguring grafana.smithi112 (dependencies changed)... 2024-09-19T09:28:31.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:30 smithi191 ceph-mon[34834]: Reconfiguring daemon grafana.smithi112 on smithi112 2024-09-19T09:28:31.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:30 smithi191 ceph-mon[34834]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:31.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:30 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/3253352903' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ce98763-b438-4d5d-9907-e2652cd154ad"}]: dispatch 2024-09-19T09:28:31.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:30 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/3253352903' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ce98763-b438-4d5d-9907-e2652cd154ad"}]': finished 2024-09-19T09:28:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:30 smithi191 ceph-mon[34834]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:28:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:30 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:28:31.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:31 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/1627330612' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:28:31.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:31 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1627330612' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:28:32.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:32 smithi112 ceph-mon[27605]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:33.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:32 smithi191 ceph-mon[34834]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:35.064 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:34 smithi112 ceph-mon[27605]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:35.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:34 smithi191 ceph-mon[34834]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:37.003 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:36 smithi112 ceph-mon[27605]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:37.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:36 smithi191 ceph-mon[34834]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:39.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:38 smithi112 ceph-mon[27605]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:39.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:38 smithi191 ceph-mon[34834]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:41.175 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:40 smithi112 ceph-mon[27605]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:41.175 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:40 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:41.175 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:40 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:41.175 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:40 smithi112 ceph-mon[27605]: Reconfiguring prometheus.smithi112 (dependencies changed)... 2024-09-19T09:28:41.175 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:40 smithi112 ceph-mon[27605]: Reconfiguring daemon prometheus.smithi112 on smithi112 2024-09-19T09:28:41.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:40 smithi191 ceph-mon[34834]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:41.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:40 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:41.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:40 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:41.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:40 smithi191 ceph-mon[34834]: Reconfiguring prometheus.smithi112 (dependencies changed)... 2024-09-19T09:28:41.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:40 smithi191 ceph-mon[34834]: Reconfiguring daemon prometheus.smithi112 on smithi112 2024-09-19T09:28:42.132 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:41 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:28:42.132 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:41 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:42.132 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:41 smithi112 ceph-mon[27605]: Deploying daemon osd.0 on smithi112 2024-09-19T09:28:42.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:41 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:28:42.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:41 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:42.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:41 smithi191 ceph-mon[34834]: Deploying daemon osd.0 on smithi112 2024-09-19T09:28:42.986 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:42 smithi112 ceph-mon[27605]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:43.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:42 smithi191 ceph-mon[34834]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:44.068 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:43 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:28:44.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:43 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:28:45.070 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:44 smithi112 ceph-mon[27605]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:45.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:44 smithi191 ceph-mon[34834]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:46.545 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:46 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:46.546 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:46 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:46.546 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:46 smithi112 ceph-mon[27605]: Reconfiguring crash.smithi191 (monmap changed)... 2024-09-19T09:28:46.546 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:46 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi191", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:28:46.546 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:46 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:46.546 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:46 smithi112 ceph-mon[27605]: Reconfiguring daemon crash.smithi191 on smithi191 2024-09-19T09:28:46.703 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:46 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:46.704 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:46 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:46.704 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:46 smithi191 ceph-mon[34834]: Reconfiguring crash.smithi191 (monmap changed)... 2024-09-19T09:28:46.704 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:46 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi191", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:28:46.704 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:46 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:46.704 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:46 smithi191 ceph-mon[34834]: Reconfiguring daemon crash.smithi191 on smithi191 2024-09-19T09:28:47.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:47 smithi112 ceph-mon[27605]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:47.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:47.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:47.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi191.xjpplx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:28:47.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:28:47.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:47.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:47 smithi191 ceph-mon[34834]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:47.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:47.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:47.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi191.xjpplx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:28:47.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:28:47.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:48.648 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:48 smithi112 ceph-mon[27605]: Reconfiguring mgr.smithi191.xjpplx (monmap changed)... 2024-09-19T09:28:48.648 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:48 smithi112 ceph-mon[27605]: Reconfiguring daemon mgr.smithi191.xjpplx on smithi191 2024-09-19T09:28:48.648 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:48.648 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:48.648 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:28:48.648 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:28:48.649 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:48.671 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:48 smithi191 ceph-mon[34834]: Reconfiguring mgr.smithi191.xjpplx (monmap changed)... 2024-09-19T09:28:48.671 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:48 smithi191 ceph-mon[34834]: Reconfiguring daemon mgr.smithi191.xjpplx on smithi191 2024-09-19T09:28:48.671 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:48 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:48.671 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:48 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:48.671 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:48 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:28:48.671 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:48 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:28:48.671 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:48 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:49.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:49 smithi112 ceph-mon[27605]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:49.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:49 smithi112 ceph-mon[27605]: Reconfiguring mon.smithi191 (monmap changed)... 2024-09-19T09:28:49.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:49 smithi112 ceph-mon[27605]: Reconfiguring daemon mon.smithi191 on smithi191 2024-09-19T09:28:49.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:49 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:49.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:49 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:49.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:49 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T09:28:49.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:49 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi112.front.sepia.ceph.com:9093"}]: dispatch 2024-09-19T09:28:49.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:49 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:49.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:49 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:28:49.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:49 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi112.front.sepia.ceph.com:3000"}]: dispatch 2024-09-19T09:28:49.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:49 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:49.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:49 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:28:49.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:49 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi112.front.sepia.ceph.com:9095"}]: dispatch 2024-09-19T09:28:49.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:49 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:49.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:49 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:28:49.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:49 smithi191 ceph-mon[34834]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:49.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:49 smithi191 ceph-mon[34834]: Reconfiguring mon.smithi191 (monmap changed)... 2024-09-19T09:28:49.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:49 smithi191 ceph-mon[34834]: Reconfiguring daemon mon.smithi191 on smithi191 2024-09-19T09:28:49.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:49 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:49.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:49 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:49.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:49 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T09:28:49.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:49 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi112.front.sepia.ceph.com:9093"}]: dispatch 2024-09-19T09:28:49.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:49 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:49.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:49 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:28:49.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:49 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi112.front.sepia.ceph.com:3000"}]: dispatch 2024-09-19T09:28:49.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:49 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:49.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:49 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:28:49.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:49 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi112.front.sepia.ceph.com:9095"}]: dispatch 2024-09-19T09:28:49.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:49 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:49.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:49 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:28:50.613 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:50 smithi191 ceph-mon[34834]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T09:28:50.613 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:50 smithi191 ceph-mon[34834]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi112.front.sepia.ceph.com:9093"}]: dispatch 2024-09-19T09:28:50.613 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:50 smithi191 ceph-mon[34834]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:28:50.613 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:50 smithi191 ceph-mon[34834]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi112.front.sepia.ceph.com:3000"}]: dispatch 2024-09-19T09:28:50.613 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:50 smithi191 ceph-mon[34834]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:28:50.613 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:50 smithi191 ceph-mon[34834]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi112.front.sepia.ceph.com:9095"}]: dispatch 2024-09-19T09:28:50.613 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:50 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:50.614 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:50 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:50.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:50 smithi112 ceph-mon[27605]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T09:28:50.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:50 smithi112 ceph-mon[27605]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi112.front.sepia.ceph.com:9093"}]: dispatch 2024-09-19T09:28:50.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:50 smithi112 ceph-mon[27605]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:28:50.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:50 smithi112 ceph-mon[27605]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi112.front.sepia.ceph.com:3000"}]: dispatch 2024-09-19T09:28:50.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:50 smithi112 ceph-mon[27605]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:28:50.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:50 smithi112 ceph-mon[27605]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi112.front.sepia.ceph.com:9095"}]: dispatch 2024-09-19T09:28:50.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:50.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:51.584 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:51 smithi112 ceph-mon[27605]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:51.584 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:51 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:51.584 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:51 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:51.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:51 smithi191 ceph-mon[34834]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:51.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:51 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:51.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:51 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:53.644 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:53 smithi112 ceph-mon[27605]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:53.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:53 smithi191 ceph-mon[34834]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:53.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:53.957+0000 7fead57fa640 1 -- 172.21.15.112:0/786583619 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fead81110c0 con 0x7feac406ecc0 2024-09-19T09:28:53.959 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 0 on host 'smithi112' 2024-09-19T09:28:53.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:53.959+0000 7feade51d640 1 -- 172.21.15.112:0/786583619 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7feac406ecc0 msgr2=0x7feac4071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:53.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:53.959+0000 7feade51d640 1 --2- 172.21.15.112:0/786583619 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7feac406ecc0 0x7feac4071170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fead810f100 tx=0x7feac0009040 comp rx=0 tx=0).stop 2024-09-19T09:28:53.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:53.959+0000 7feade51d640 1 -- 172.21.15.112:0/786583619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead8065bc0 msgr2=0x7fead810f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:53.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:53.959+0000 7feade51d640 1 --2- 172.21.15.112:0/786583619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead8065bc0 0x7fead810f350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7feac80048a0 tx=0x7feac8009da0 comp rx=0 tx=0).stop 2024-09-19T09:28:53.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:53.959+0000 7feade51d640 1 -- 172.21.15.112:0/786583619 shutdown_connections 2024-09-19T09:28:53.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:53.959+0000 7feade51d640 1 --2- 172.21.15.112:0/786583619 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7feac406ecc0 0x7feac4071170 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:53.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:53.959+0000 7feade51d640 1 --2- 172.21.15.112:0/786583619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fead8101b00 0x7fead810f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:53.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:53.959+0000 7feade51d640 1 --2- 172.21.15.112:0/786583619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead8065bc0 0x7fead810f350 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:53.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:53.959+0000 7feade51d640 1 -- 172.21.15.112:0/786583619 >> 172.21.15.112:0/786583619 conn(0x7fead80f6c10 msgr2=0x7fead80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:53.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:53.959+0000 7feade51d640 1 -- 172.21.15.112:0/786583619 shutdown_connections 2024-09-19T09:28:53.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:28:53.959+0000 7feade51d640 1 -- 172.21.15.112:0/786583619 wait complete. 2024-09-19T09:28:54.581 DEBUG:teuthology.orchestra.run.smithi112:osd.0> sudo journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T09:28:54.583 INFO:tasks.cephadm:Deploying osd.1 on smithi112 with /dev/vg_nvme/lv_3... 2024-09-19T09:28:54.583 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:28:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:54 smithi112 ceph-mon[27605]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:54 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:54 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:54 smithi112 ceph-mon[27605]: from='osd.0 [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:28:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:54 smithi191 ceph-mon[34834]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:54 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:54 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:54 smithi191 ceph-mon[34834]: from='osd.0 [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:28:55.378 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:28:56.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:55 smithi112 ceph-mon[27605]: from='osd.0 [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:28:56.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:55 smithi112 ceph-mon[27605]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:28:56.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:55 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:28:56.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:55 smithi112 ceph-mon[27605]: from='osd.0 [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-19T09:28:56.274 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:28:55 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0[45343]: 2024-09-19T09:28:55.969+0000 7fbb36c89640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T09:28:56.274 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:28:55 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0[45343]: 2024-09-19T09:28:55.972+0000 7fbb31ac0640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:28:56.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:55 smithi191 ceph-mon[34834]: from='osd.0 [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:28:56.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:55 smithi191 ceph-mon[34834]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:28:56.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:55 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:28:56.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:55 smithi191 ceph-mon[34834]: from='osd.0 [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-19T09:28:57.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:56 smithi112 ceph-mon[27605]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:57.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:56 smithi112 ceph-mon[27605]: from='osd.0 [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-19T09:28:57.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:56 smithi112 ceph-mon[27605]: osdmap e8: 1 total, 0 up, 1 in 2024-09-19T09:28:57.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:56 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:28:57.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:56 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:28:57.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:56 smithi191 ceph-mon[34834]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:57.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:56 smithi191 ceph-mon[34834]: from='osd.0 [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-19T09:28:57.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:56 smithi191 ceph-mon[34834]: osdmap e8: 1 total, 0 up, 1 in 2024-09-19T09:28:57.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:56 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:28:57.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:56 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:28:58.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:57 smithi112 ceph-mon[27605]: purged_snaps scrub starts 2024-09-19T09:28:58.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:57 smithi112 ceph-mon[27605]: purged_snaps scrub ok 2024-09-19T09:28:58.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:57 smithi112 ceph-mon[27605]: osd.0 [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068] boot 2024-09-19T09:28:58.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:57 smithi112 ceph-mon[27605]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T09:28:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:28:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:58.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:57 smithi191 ceph-mon[34834]: purged_snaps scrub starts 2024-09-19T09:28:58.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:57 smithi191 ceph-mon[34834]: purged_snaps scrub ok 2024-09-19T09:28:58.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:57 smithi191 ceph-mon[34834]: osd.0 [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068] boot 2024-09-19T09:28:58.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:57 smithi191 ceph-mon[34834]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T09:28:58.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:28:58.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:58.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:28:59.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:58 smithi191 ceph-mon[34834]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:59.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:58 smithi191 ceph-mon[34834]: osdmap e10: 1 total, 1 up, 1 in 2024-09-19T09:28:59.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:28:58 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:28:59.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:58 smithi112 ceph-mon[27605]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:28:59.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:58 smithi112 ceph-mon[27605]: osdmap e10: 1 total, 1 up, 1 in 2024-09-19T09:28:59.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:28:58 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:28:59.833 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:28:59.856 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_3 2024-09-19T09:29:00.854 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:29:01.235 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:00 smithi112 ceph-mon[27605]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:01.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:00 smithi191 ceph-mon[34834]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:03.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.148+0000 7faf17ee9640 1 -- 172.21.15.112:0/720259230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf100fb430 msgr2=0x7faf100fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:03.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.148+0000 7faf17ee9640 1 --2- 172.21.15.112:0/720259230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf100fb430 0x7faf100fb840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0048d0 tx=0x7faf0c009da0 comp rx=0 tx=0).stop 2024-09-19T09:29:03.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.148+0000 7faf17ee9640 1 -- 172.21.15.112:0/720259230 shutdown_connections 2024-09-19T09:29:03.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.148+0000 7faf17ee9640 1 --2- 172.21.15.112:0/720259230 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf100fc700 0x7faf100fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:03.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.149+0000 7faf17ee9640 1 --2- 172.21.15.112:0/720259230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf100fb430 0x7faf100fb840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:03.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.149+0000 7faf17ee9640 1 -- 172.21.15.112:0/720259230 >> 172.21.15.112:0/720259230 conn(0x7faf100f6c10 msgr2=0x7faf100f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:03.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.149+0000 7faf17ee9640 1 -- 172.21.15.112:0/720259230 shutdown_connections 2024-09-19T09:29:03.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.149+0000 7faf17ee9640 1 -- 172.21.15.112:0/720259230 wait complete. 2024-09-19T09:29:03.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.149+0000 7faf17ee9640 1 Processor -- start 2024-09-19T09:29:03.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.149+0000 7faf17ee9640 1 -- start start 2024-09-19T09:29:03.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.149+0000 7faf17ee9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf100fb430 0x7faf1010fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:03.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.149+0000 7faf17ee9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf100fc700 0x7faf10112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:03.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.149+0000 7faf17ee9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf10065c60 con 0x7faf100fb430 2024-09-19T09:29:03.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.149+0000 7faf17ee9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf10065dd0 con 0x7faf100fc700 2024-09-19T09:29:03.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.149+0000 7faf15c85640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf100fb430 0x7faf1010fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:03.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.149+0000 7faf15c85640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf100fb430 0x7faf1010fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37258/0 (socket says 172.21.15.112:37258) 2024-09-19T09:29:03.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.149+0000 7faf15c85640 1 -- 172.21.15.112:0/555896091 learned_addr learned my addr 172.21.15.112:0/555896091 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:29:03.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.150+0000 7faf15c85640 1 -- 172.21.15.112:0/555896091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf100fc700 msgr2=0x7faf10112310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:03.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.150+0000 7faf15c85640 1 --2- 172.21.15.112:0/555896091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf100fc700 0x7faf10112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:03.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.150+0000 7faf15c85640 1 -- 172.21.15.112:0/555896091 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c005040 con 0x7faf100fb430 2024-09-19T09:29:03.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.150+0000 7faf15c85640 1 --2- 172.21.15.112:0/555896091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf100fb430 0x7faf1010fdc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faf0c003080 tx=0x7faf0c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:03.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.150+0000 7faf067fc640 1 -- 172.21.15.112:0/555896091 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf0c038070 con 0x7faf100fb430 2024-09-19T09:29:03.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.150+0000 7faf067fc640 1 -- 172.21.15.112:0/555896091 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faf0c02abd0 con 0x7faf100fb430 2024-09-19T09:29:03.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.150+0000 7faf17ee9640 1 -- 172.21.15.112:0/555896091 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf10112850 con 0x7faf100fb430 2024-09-19T09:29:03.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.150+0000 7faf067fc640 1 -- 172.21.15.112:0/555896091 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf0c03e670 con 0x7faf100fb430 2024-09-19T09:29:03.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.150+0000 7faf17ee9640 1 -- 172.21.15.112:0/555896091 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf10112dc0 con 0x7faf100fb430 2024-09-19T09:29:03.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.151+0000 7faf17ee9640 1 -- 172.21.15.112:0/555896091 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf100fa890 con 0x7faf100fb430 2024-09-19T09:29:03.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.151+0000 7faf067fc640 1 -- 172.21.15.112:0/555896091 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7faf0c030020 con 0x7faf100fb430 2024-09-19T09:29:03.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.152+0000 7faf067fc640 1 --2- 172.21.15.112:0/555896091 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7faefc06ecc0 0x7faefc071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:03.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.152+0000 7faf067fc640 1 -- 172.21.15.112:0/555896091 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7faf0c0ad6d0 con 0x7faf100fb430 2024-09-19T09:29:03.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.152+0000 7faf15484640 1 --2- 172.21.15.112:0/555896091 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7faefc06ecc0 0x7faefc071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:03.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.152+0000 7faf15484640 1 --2- 172.21.15.112:0/555896091 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7faefc06ecc0 0x7faefc071170 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faf00004a50 tx=0x7faf00007cb0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:03.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.156+0000 7faf067fc640 1 -- 172.21.15.112:0/555896091 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7faf0c07b670 con 0x7faf100fb430 2024-09-19T09:29:03.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:03.352+0000 7faf17ee9640 1 -- 172.21.15.112:0/555896091 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7faf10100b60 con 0x7faefc06ecc0 2024-09-19T09:29:03.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:03 smithi112 ceph-mon[27605]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:03.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:03 smithi112 ceph-mon[27605]: Detected new or changed devices on smithi112 2024-09-19T09:29:03.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:03 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:03.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:03 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:03.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:03 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:03.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:03 smithi112 ceph-mon[27605]: Adjusting osd_memory_target on smithi112 to 12864M 2024-09-19T09:29:03.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:03 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:03.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:03 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:03.355 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:03 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:03.355 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:03 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:03.355 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:03 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:03.494 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:03 smithi191 ceph-mon[34834]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:03.495 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:03 smithi191 ceph-mon[34834]: Detected new or changed devices on smithi112 2024-09-19T09:29:03.495 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:03 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:03.495 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:03 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:03.495 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:03 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:03.495 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:03 smithi191 ceph-mon[34834]: Adjusting osd_memory_target on smithi112 to 12864M 2024-09-19T09:29:03.495 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:03 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:03.495 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:03 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:03.495 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:03 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:03.496 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:03 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:03.496 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:03 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:04.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:04 smithi112 ceph-mon[27605]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:29:04.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:04 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:29:04.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:04 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:29:04.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:04 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:04.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:04 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:04.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:04 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:04.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:04 smithi191 ceph-mon[34834]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:29:04.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:04 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:29:04.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:04 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:29:04.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:04 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:04.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:04 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:04.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:04 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:05.433 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:05 smithi112 ceph-mon[27605]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:05.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:05 smithi191 ceph-mon[34834]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:07.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:07 smithi112 ceph-mon[27605]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:07.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:07 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/433598318' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21b187e2-98e3-4f5b-a784-a24b848c75f0"}]: dispatch 2024-09-19T09:29:07.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:07 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/433598318' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21b187e2-98e3-4f5b-a784-a24b848c75f0"}]': finished 2024-09-19T09:29:07.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:07 smithi112 ceph-mon[27605]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:29:07.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:07 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:29:07.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:07 smithi191 ceph-mon[34834]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:07.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:07 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/433598318' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21b187e2-98e3-4f5b-a784-a24b848c75f0"}]: dispatch 2024-09-19T09:29:07.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:07 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/433598318' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21b187e2-98e3-4f5b-a784-a24b848c75f0"}]': finished 2024-09-19T09:29:07.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:07 smithi191 ceph-mon[34834]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:29:07.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:07 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:29:08.486 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:08 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/573301187' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:29:08.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:08 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/573301187' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:29:09.499 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:09 smithi112 ceph-mon[27605]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:09.500 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:09 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:09.500 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:09 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:09.500 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:09 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:09.500 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:09 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:09.500 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:09 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:09.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:09 smithi191 ceph-mon[34834]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:09.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:09 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:09.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:09 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:09.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:09 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:09.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:09 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:09.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:09 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:11.398 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:11 smithi112 ceph-mon[27605]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:11.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:11 smithi191 ceph-mon[34834]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:13.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:13 smithi112 ceph-mon[27605]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:13.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:13 smithi191 ceph-mon[34834]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:14.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:14 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:29:14.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:14 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:29:14.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:14 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:14.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:14 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:29:14.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:14 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:29:14.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:14 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:15.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:15 smithi112 ceph-mon[27605]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:15.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:15 smithi112 ceph-mon[27605]: Deploying daemon osd.1 on smithi112 2024-09-19T09:29:15.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:15 smithi191 ceph-mon[34834]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:15.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:15 smithi191 ceph-mon[34834]: Deploying daemon osd.1 on smithi112 2024-09-19T09:29:17.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:17 smithi112 ceph-mon[27605]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:17.536 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:17 smithi191 ceph-mon[34834]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:19.498 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:19 smithi112 ceph-mon[27605]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:19.499 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:19 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:19.499 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:19 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:19.499 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:19 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:19.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:19 smithi191 ceph-mon[34834]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:19.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:19 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:19.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:19 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:19.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:19 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:21.362 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:21 smithi112 ceph-mon[27605]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:21.362 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:21 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:21.362 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:21 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:21.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:21 smithi191 ceph-mon[34834]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:21.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:21 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:21.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:21 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:22.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:22.411+0000 7faf067fc640 1 -- 172.21.15.112:0/555896091 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7faf10100b60 con 0x7faefc06ecc0 2024-09-19T09:29:22.413 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 1 on host 'smithi112' 2024-09-19T09:29:22.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:22.413+0000 7faf17ee9640 1 -- 172.21.15.112:0/555896091 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7faefc06ecc0 msgr2=0x7faefc071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:22.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:22.413+0000 7faf17ee9640 1 --2- 172.21.15.112:0/555896091 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7faefc06ecc0 0x7faefc071170 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faf00004a50 tx=0x7faf00007cb0 comp rx=0 tx=0).stop 2024-09-19T09:29:22.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:22.413+0000 7faf17ee9640 1 -- 172.21.15.112:0/555896091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf100fb430 msgr2=0x7faf1010fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:22.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:22.413+0000 7faf17ee9640 1 --2- 172.21.15.112:0/555896091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf100fb430 0x7faf1010fdc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faf0c003080 tx=0x7faf0c009da0 comp rx=0 tx=0).stop 2024-09-19T09:29:22.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:22.413+0000 7faf17ee9640 1 -- 172.21.15.112:0/555896091 shutdown_connections 2024-09-19T09:29:22.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:22.413+0000 7faf17ee9640 1 --2- 172.21.15.112:0/555896091 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7faefc06ecc0 0x7faefc071170 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:22.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:22.413+0000 7faf17ee9640 1 --2- 172.21.15.112:0/555896091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf100fc700 0x7faf10112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:22.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:22.413+0000 7faf17ee9640 1 --2- 172.21.15.112:0/555896091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf100fb430 0x7faf1010fdc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:22.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:22.413+0000 7faf17ee9640 1 -- 172.21.15.112:0/555896091 >> 172.21.15.112:0/555896091 conn(0x7faf100f6c10 msgr2=0x7faf100f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:22.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:22.413+0000 7faf17ee9640 1 -- 172.21.15.112:0/555896091 shutdown_connections 2024-09-19T09:29:22.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:22.413+0000 7faf17ee9640 1 -- 172.21.15.112:0/555896091 wait complete. 2024-09-19T09:29:23.128 DEBUG:teuthology.orchestra.run.smithi112:osd.1> sudo journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T09:29:23.130 INFO:tasks.cephadm:Deploying osd.2 on smithi112 with /dev/vg_nvme/lv_2... 2024-09-19T09:29:23.130 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:29:23.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:23 smithi112 ceph-mon[27605]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:23.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:23 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:23.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:23 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:23.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:23 smithi112 ceph-mon[27605]: from='osd.1 [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:29:23.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:23 smithi191 ceph-mon[34834]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:23.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:23 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:23.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:23 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:23.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:23 smithi191 ceph-mon[34834]: from='osd.1 [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:29:23.921 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:29:24.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:24 smithi112 ceph-mon[27605]: from='osd.1 [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:29:24.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:24 smithi112 ceph-mon[27605]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T09:29:24.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:24 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:29:24.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:24 smithi112 ceph-mon[27605]: from='osd.1 [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-19T09:29:24.689 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:29:24 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1[52992]: 2024-09-19T09:29:24.416+0000 7fe508404640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T09:29:24.689 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:29:24 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1[52992]: 2024-09-19T09:29:24.420+0000 7fe501a16640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:29:24.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:24 smithi191 ceph-mon[34834]: from='osd.1 [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:29:24.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:24 smithi191 ceph-mon[34834]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T09:29:24.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:24 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:29:24.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:24 smithi191 ceph-mon[34834]: from='osd.1 [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-19T09:29:25.609 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:25 smithi112 ceph-mon[27605]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:25.610 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:25 smithi112 ceph-mon[27605]: from='osd.1 [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-19T09:29:25.610 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:25 smithi112 ceph-mon[27605]: osdmap e13: 2 total, 1 up, 2 in 2024-09-19T09:29:25.610 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:25 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:29:25.610 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:25 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:29:25.610 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:25 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:29:25.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:25 smithi191 ceph-mon[34834]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:25.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:25 smithi191 ceph-mon[34834]: from='osd.1 [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-19T09:29:25.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:25 smithi191 ceph-mon[34834]: osdmap e13: 2 total, 1 up, 2 in 2024-09-19T09:29:25.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:25 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:29:25.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:25 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:29:25.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:25 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:29:26.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:26 smithi112 ceph-mon[27605]: purged_snaps scrub starts 2024-09-19T09:29:26.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:26 smithi112 ceph-mon[27605]: purged_snaps scrub ok 2024-09-19T09:29:26.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:26 smithi112 ceph-mon[27605]: osd.1 [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300] boot 2024-09-19T09:29:26.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:26 smithi112 ceph-mon[27605]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T09:29:26.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:26 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:29:26.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:26 smithi191 ceph-mon[34834]: purged_snaps scrub starts 2024-09-19T09:29:26.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:26 smithi191 ceph-mon[34834]: purged_snaps scrub ok 2024-09-19T09:29:26.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:26 smithi191 ceph-mon[34834]: osd.1 [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300] boot 2024-09-19T09:29:26.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:26 smithi191 ceph-mon[34834]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T09:29:26.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:26 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:29:27.090 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:29:27.110 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_2 2024-09-19T09:29:27.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:27 smithi112 ceph-mon[27605]: pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:27.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:27 smithi112 ceph-mon[27605]: osdmap e15: 2 total, 2 up, 2 in 2024-09-19T09:29:27.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:27 smithi191 ceph-mon[34834]: pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:29:27.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:27 smithi191 ceph-mon[34834]: osdmap e15: 2 total, 2 up, 2 in 2024-09-19T09:29:28.286 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:29:29.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:29 smithi112 ceph-mon[27605]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:29.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:29 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:29:29.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:29 smithi191 ceph-mon[34834]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:29.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:29 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:29:30.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.018+0000 7f9b9a2ff640 1 -- 172.21.15.112:0/2977707466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b940fb430 msgr2=0x7f9b940fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:30.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.018+0000 7f9b9a2ff640 1 --2- 172.21.15.112:0/2977707466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b940fb430 0x7f9b940fb840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9b840048d0 tx=0x7f9b84009da0 comp rx=0 tx=0).stop 2024-09-19T09:29:30.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.018+0000 7f9b9a2ff640 1 -- 172.21.15.112:0/2977707466 shutdown_connections 2024-09-19T09:29:30.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.018+0000 7f9b9a2ff640 1 --2- 172.21.15.112:0/2977707466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b940fc700 0x7f9b940fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:30.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.018+0000 7f9b9a2ff640 1 --2- 172.21.15.112:0/2977707466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b940fb430 0x7f9b940fb840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:30.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.018+0000 7f9b9a2ff640 1 -- 172.21.15.112:0/2977707466 >> 172.21.15.112:0/2977707466 conn(0x7f9b940f6c10 msgr2=0x7f9b940f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:30.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.018+0000 7f9b9a2ff640 1 -- 172.21.15.112:0/2977707466 shutdown_connections 2024-09-19T09:29:30.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.018+0000 7f9b9a2ff640 1 -- 172.21.15.112:0/2977707466 wait complete. 2024-09-19T09:29:30.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.018+0000 7f9b9a2ff640 1 Processor -- start 2024-09-19T09:29:30.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b9a2ff640 1 -- start start 2024-09-19T09:29:30.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b9a2ff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b940fb430 0x7f9b9410bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:30.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b9a2ff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b940fc700 0x7f9b9410c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:30.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b9a2ff640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9410d390 con 0x7f9b940fb430 2024-09-19T09:29:30.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b9a2ff640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9410d500 con 0x7f9b940fc700 2024-09-19T09:29:30.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b93fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b940fb430 0x7f9b9410bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:30.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b93fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b940fb430 0x7f9b9410bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36938/0 (socket says 172.21.15.112:36938) 2024-09-19T09:29:30.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b93fff640 1 -- 172.21.15.112:0/4257751371 learned_addr learned my addr 172.21.15.112:0/4257751371 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:29:30.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b937fe640 1 --2- 172.21.15.112:0/4257751371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b940fc700 0x7f9b9410c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:30.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b93fff640 1 -- 172.21.15.112:0/4257751371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b940fc700 msgr2=0x7f9b9410c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:30.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b93fff640 1 --2- 172.21.15.112:0/4257751371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b940fc700 0x7f9b9410c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:30.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b93fff640 1 -- 172.21.15.112:0/4257751371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b84005040 con 0x7f9b940fb430 2024-09-19T09:29:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b937fe640 1 --2- 172.21.15.112:0/4257751371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b940fc700 0x7f9b9410c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b93fff640 1 --2- 172.21.15.112:0/4257751371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b940fb430 0x7f9b9410bfe0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9b84003080 tx=0x7f9b84009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b90ff9640 1 -- 172.21.15.112:0/4257751371 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b84038070 con 0x7f9b940fb430 2024-09-19T09:29:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b9a2ff640 1 -- 172.21.15.112:0/4257751371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9410d780 con 0x7f9b940fb430 2024-09-19T09:29:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b90ff9640 1 -- 172.21.15.112:0/4257751371 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9b8402abd0 con 0x7f9b940fb430 2024-09-19T09:29:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.019+0000 7f9b90ff9640 1 -- 172.21.15.112:0/4257751371 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b8403e670 con 0x7f9b940fb430 2024-09-19T09:29:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.020+0000 7f9b9a2ff640 1 -- 172.21.15.112:0/4257751371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9410dca0 con 0x7f9b940fb430 2024-09-19T09:29:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.020+0000 7f9b9a2ff640 1 -- 172.21.15.112:0/4257751371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b941046c0 con 0x7f9b940fb430 2024-09-19T09:29:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.021+0000 7f9b90ff9640 1 -- 172.21.15.112:0/4257751371 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f9b84030020 con 0x7f9b940fb430 2024-09-19T09:29:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.021+0000 7f9b90ff9640 1 --2- 172.21.15.112:0/4257751371 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9b7c06ecc0 0x7f9b7c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.021+0000 7f9b90ff9640 1 -- 172.21.15.112:0/4257751371 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f9b840ad880 con 0x7f9b940fb430 2024-09-19T09:29:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.021+0000 7f9b937fe640 1 --2- 172.21.15.112:0/4257751371 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9b7c06ecc0 0x7f9b7c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.022+0000 7f9b937fe640 1 --2- 172.21.15.112:0/4257751371 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9b7c06ecc0 0x7f9b7c071170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9b88006fd0 tx=0x7f9b88008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:30.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.025+0000 7f9b90ff9640 1 -- 172.21.15.112:0/4257751371 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9b8407b670 con 0x7f9b940fb430 2024-09-19T09:29:30.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:30.197+0000 7f9b9a2ff640 1 -- 172.21.15.112:0/4257751371 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b9410dec0 con 0x7f9b7c06ecc0 2024-09-19T09:29:30.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:30 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:30.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:30 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:30.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:30 smithi112 ceph-mon[27605]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:30.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:30 smithi112 ceph-mon[27605]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:29:30.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:30 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:29:30.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:30 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:29:30.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:30 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:31.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:30 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:31.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:30 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:30 smithi191 ceph-mon[34834]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:30 smithi191 ceph-mon[34834]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:29:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:30 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:29:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:30 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:29:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:30 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:33.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:32 smithi112 ceph-mon[27605]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:33.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:32 smithi191 ceph-mon[34834]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:35.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:35 smithi112 ceph-mon[27605]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:35.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:35 smithi112 ceph-mon[27605]: Detected new or changed devices on smithi112 2024-09-19T09:29:35.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:35 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:35.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:35 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:35.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:35 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:35.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:35 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:35.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:35 smithi112 ceph-mon[27605]: Adjusting osd_memory_target on smithi112 to 6432M 2024-09-19T09:29:35.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:35 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:35.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:35 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:35.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:35 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:35.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:35 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:35.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:35 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:35.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:35 smithi191 ceph-mon[34834]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:35.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:35 smithi191 ceph-mon[34834]: Detected new or changed devices on smithi112 2024-09-19T09:29:35.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:35 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:35.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:35 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:35.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:35 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:35.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:35 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:35.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:35 smithi191 ceph-mon[34834]: Adjusting osd_memory_target on smithi112 to 6432M 2024-09-19T09:29:35.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:35 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:35.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:35 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:35.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:35 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:35.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:35 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:35.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:35 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:36.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:36 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/1898903638' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf806972-fe72-4319-bac0-e302402ebfa0"}]: dispatch 2024-09-19T09:29:36.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:36 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/1898903638' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf806972-fe72-4319-bac0-e302402ebfa0"}]': finished 2024-09-19T09:29:36.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:36 smithi191 ceph-mon[34834]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T09:29:36.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:36 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:29:36.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:36 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/974371227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:29:36.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:36 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1898903638' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf806972-fe72-4319-bac0-e302402ebfa0"}]: dispatch 2024-09-19T09:29:36.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:36 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1898903638' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf806972-fe72-4319-bac0-e302402ebfa0"}]': finished 2024-09-19T09:29:36.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:36 smithi112 ceph-mon[27605]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T09:29:36.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:36 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:29:36.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:36 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/974371227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:29:37.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:37 smithi112 ceph-mon[27605]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:37.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:37 smithi191 ceph-mon[34834]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:39.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:39 smithi112 ceph-mon[27605]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:39 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:39 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:39 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:39 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:39 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:39.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:39 smithi191 ceph-mon[34834]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:39.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:39 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:39.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:39 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:39.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:39 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:39.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:39 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:39.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:39 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:41.568 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:41 smithi112 ceph-mon[27605]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:41.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:41 smithi191 ceph-mon[34834]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:43.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:43 smithi112 ceph-mon[27605]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:43.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:43 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:29:43.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:43 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:43.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:43 smithi191 ceph-mon[34834]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:43.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:43 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:29:43.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:43 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:44.565 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:44 smithi112 ceph-mon[27605]: Deploying daemon osd.2 on smithi112 2024-09-19T09:29:44.566 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:44 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:29:44.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:44 smithi191 ceph-mon[34834]: Deploying daemon osd.2 on smithi112 2024-09-19T09:29:44.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:44 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:29:45.670 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:45 smithi112 ceph-mon[27605]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:45.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:45 smithi191 ceph-mon[34834]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:47.360 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:47 smithi112 ceph-mon[27605]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:47.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:47 smithi191 ceph-mon[34834]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:48.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:48.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:48.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:48 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:48 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:48 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:49.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:49 smithi112 ceph-mon[27605]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:49.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:49 smithi191 ceph-mon[34834]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:51.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:51.190+0000 7f9b90ff9640 1 -- 172.21.15.112:0/4257751371 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9b9410dec0 con 0x7f9b7c06ecc0 2024-09-19T09:29:51.192 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 2 on host 'smithi112' 2024-09-19T09:29:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:51.192+0000 7f9b9a2ff640 1 -- 172.21.15.112:0/4257751371 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9b7c06ecc0 msgr2=0x7f9b7c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:51.192+0000 7f9b9a2ff640 1 --2- 172.21.15.112:0/4257751371 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9b7c06ecc0 0x7f9b7c071170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9b88006fd0 tx=0x7f9b88008040 comp rx=0 tx=0).stop 2024-09-19T09:29:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:51.192+0000 7f9b9a2ff640 1 -- 172.21.15.112:0/4257751371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b940fb430 msgr2=0x7f9b9410bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:51.192+0000 7f9b9a2ff640 1 --2- 172.21.15.112:0/4257751371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b940fb430 0x7f9b9410bfe0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9b84003080 tx=0x7f9b84009da0 comp rx=0 tx=0).stop 2024-09-19T09:29:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:51.192+0000 7f9b9a2ff640 1 -- 172.21.15.112:0/4257751371 shutdown_connections 2024-09-19T09:29:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:51.192+0000 7f9b9a2ff640 1 --2- 172.21.15.112:0/4257751371 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9b7c06ecc0 0x7f9b7c071170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:51.192+0000 7f9b9a2ff640 1 --2- 172.21.15.112:0/4257751371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b940fc700 0x7f9b9410c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:51.192+0000 7f9b9a2ff640 1 --2- 172.21.15.112:0/4257751371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b940fb430 0x7f9b9410bfe0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:51.192+0000 7f9b9a2ff640 1 -- 172.21.15.112:0/4257751371 >> 172.21.15.112:0/4257751371 conn(0x7f9b940f6c10 msgr2=0x7f9b940f83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:51.192+0000 7f9b9a2ff640 1 -- 172.21.15.112:0/4257751371 shutdown_connections 2024-09-19T09:29:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:29:51.192+0000 7f9b9a2ff640 1 -- 172.21.15.112:0/4257751371 wait complete. 2024-09-19T09:29:51.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:51 smithi112 ceph-mon[27605]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:51.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:51 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:51.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:51 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:51.586 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:51 smithi191 ceph-mon[34834]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:51.586 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:51 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:51.586 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:51 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:51.942 DEBUG:teuthology.orchestra.run.smithi112:osd.2> sudo journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T09:29:51.945 INFO:tasks.cephadm:Deploying osd.3 on smithi191 with /dev/vg_nvme/lv_4... 2024-09-19T09:29:51.945 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:29:52.205 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi191/config 2024-09-19T09:29:52.474 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:52 smithi191 ceph-mon[34834]: from='osd.2 [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:29:52.591 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:52 smithi112 ceph-mon[27605]: from='osd.2 [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:29:53.476 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:53 smithi191 ceph-mon[34834]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:53.476 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:53 smithi191 ceph-mon[34834]: from='osd.2 [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:29:53.476 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:53 smithi191 ceph-mon[34834]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T09:29:53.476 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:53 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:29:53.476 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:53 smithi191 ceph-mon[34834]: from='osd.2 [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-19T09:29:53.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:53 smithi112 ceph-mon[27605]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:53.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:53 smithi112 ceph-mon[27605]: from='osd.2 [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:29:53.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:53 smithi112 ceph-mon[27605]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T09:29:53.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:53 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:29:53.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:53 smithi112 ceph-mon[27605]: from='osd.2 [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-19T09:29:53.689 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:29:53 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2[60559]: 2024-09-19T09:29:53.318+0000 7fcbbfd67640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T09:29:53.689 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:29:53 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2[60559]: 2024-09-19T09:29:53.323+0000 7fcbb7375640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:29:54.654 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:54 smithi191 ceph-mon[34834]: from='osd.2 [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-19T09:29:54.655 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:54 smithi191 ceph-mon[34834]: osdmap e18: 3 total, 2 up, 3 in 2024-09-19T09:29:54.655 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:54 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:29:54.655 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:54 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:29:54.660 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:29:54.679 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi191:vg_nvme/lv_4 2024-09-19T09:29:54.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:54 smithi112 ceph-mon[27605]: from='osd.2 [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-19T09:29:54.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:54 smithi112 ceph-mon[27605]: osdmap e18: 3 total, 2 up, 3 in 2024-09-19T09:29:54.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:54 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:29:54.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:54 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:29:54.918 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi191/config 2024-09-19T09:29:55.619 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:55 smithi112 ceph-mon[27605]: purged_snaps scrub starts 2024-09-19T09:29:55.670 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:55 smithi112 ceph-mon[27605]: purged_snaps scrub ok 2024-09-19T09:29:55.670 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:55 smithi112 ceph-mon[27605]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:55.670 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:55 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:29:55.670 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:55 smithi112 ceph-mon[27605]: osd.2 [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264] boot 2024-09-19T09:29:55.670 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:55 smithi112 ceph-mon[27605]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T09:29:55.670 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:55 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:29:55.670 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:55 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:55.670 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:55 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:55.728 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:55 smithi191 ceph-mon[34834]: purged_snaps scrub starts 2024-09-19T09:29:55.728 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:55 smithi191 ceph-mon[34834]: purged_snaps scrub ok 2024-09-19T09:29:55.728 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:55 smithi191 ceph-mon[34834]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T09:29:55.728 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:55 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:29:55.728 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:55 smithi191 ceph-mon[34834]: osd.2 [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264] boot 2024-09-19T09:29:55.728 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:55 smithi191 ceph-mon[34834]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T09:29:55.728 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:55 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:29:55.728 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:55 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:55.728 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:55 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:56.477 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.475+0000 7f42cd435640 1 -- 172.21.15.191:0/1836485943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42c80fb420 msgr2=0x7f42c80fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:56.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.475+0000 7f42cd435640 1 --2- 172.21.15.191:0/1836485943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42c80fb420 0x7f42c80fb830 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f42b80048d0 tx=0x7f42b8009da0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.475+0000 7f42cd435640 1 -- 172.21.15.191:0/1836485943 shutdown_connections 2024-09-19T09:29:56.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.475+0000 7f42cd435640 1 --2- 172.21.15.191:0/1836485943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c80fc6f0 0x7f42c80fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.475+0000 7f42cd435640 1 --2- 172.21.15.191:0/1836485943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42c80fb420 0x7f42c80fb830 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.475+0000 7f42cd435640 1 -- 172.21.15.191:0/1836485943 >> 172.21.15.191:0/1836485943 conn(0x7f42c80f6c00 msgr2=0x7f42c80f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:56.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.475+0000 7f42cd435640 1 -- 172.21.15.191:0/1836485943 shutdown_connections 2024-09-19T09:29:56.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.475+0000 7f42cd435640 1 -- 172.21.15.191:0/1836485943 wait complete. 2024-09-19T09:29:56.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.475+0000 7f42cd435640 1 Processor -- start 2024-09-19T09:29:56.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.475+0000 7f42cd435640 1 -- start start 2024-09-19T09:29:56.478 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42cd435640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c80fb420 0x7f42c810fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.479 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42cd435640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42c80fc6f0 0x7f42c8112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.479 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42cd435640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c80664f0 con 0x7f42c80fb420 2024-09-19T09:29:56.479 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42cd435640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c8066660 con 0x7f42c80fc6f0 2024-09-19T09:29:56.479 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42be7fc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42c80fc6f0 0x7f42c8112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.479 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42be7fc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42c80fc6f0 0x7f42c8112300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:39004/0 (socket says 172.21.15.191:39004) 2024-09-19T09:29:56.479 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42be7fc640 1 -- 172.21.15.191:0/1632417502 learned_addr learned my addr 172.21.15.191:0/1632417502 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:29:56.479 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42c6ffd640 1 --2- 172.21.15.191:0/1632417502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c80fb420 0x7f42c810fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.479 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42be7fc640 1 -- 172.21.15.191:0/1632417502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c80fb420 msgr2=0x7f42c810fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:56.480 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42be7fc640 1 --2- 172.21.15.191:0/1632417502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c80fb420 0x7f42c810fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.480 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42be7fc640 1 -- 172.21.15.191:0/1632417502 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b8005040 con 0x7f42c80fc6f0 2024-09-19T09:29:56.480 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42be7fc640 1 --2- 172.21.15.191:0/1632417502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42c80fc6f0 0x7f42c8112300 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f42b000eb70 tx=0x7f42b000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:56.480 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42bffff640 1 -- 172.21.15.191:0/1632417502 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42b0007c30 con 0x7f42c80fc6f0 2024-09-19T09:29:56.480 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42bffff640 1 -- 172.21.15.191:0/1632417502 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f42b000f040 con 0x7f42c80fc6f0 2024-09-19T09:29:56.480 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42cd435640 1 -- 172.21.15.191:0/1632417502 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c8112840 con 0x7f42c80fc6f0 2024-09-19T09:29:56.480 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42bffff640 1 -- 172.21.15.191:0/1632417502 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42b000ca60 con 0x7f42c80fc6f0 2024-09-19T09:29:56.480 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.476+0000 7f42cd435640 1 -- 172.21.15.191:0/1632417502 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c8112db0 con 0x7f42c80fc6f0 2024-09-19T09:29:56.481 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.478+0000 7f42cd435640 1 -- 172.21.15.191:0/1632417502 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c80fa880 con 0x7f42c80fc6f0 2024-09-19T09:29:56.481 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.478+0000 7f42bffff640 1 -- 172.21.15.191:0/1632417502 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f42b000cbc0 con 0x7f42c80fc6f0 2024-09-19T09:29:56.481 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.478+0000 7f42bffff640 1 --2- 172.21.15.191:0/1632417502 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f42b406ecc0 0x7f42b4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.482 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.478+0000 7f42bffff640 1 -- 172.21.15.191:0/1632417502 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2842+0+0 (secure 0 0 0) 0x7f42b008d130 con 0x7f42c80fc6f0 2024-09-19T09:29:56.482 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.479+0000 7f42c6ffd640 1 --2- 172.21.15.191:0/1632417502 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f42b406ecc0 0x7f42b4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.482 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.479+0000 7f42c6ffd640 1 --2- 172.21.15.191:0/1632417502 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f42b406ecc0 0x7f42b4071170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f42b8000c00 tx=0x7f42b8035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:56.484 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.483+0000 7f42bffff640 1 -- 172.21.15.191:0/1632417502 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f42b005aea0 con 0x7f42c80fc6f0 2024-09-19T09:29:56.653 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:29:56.652+0000 7f42cd435640 1 -- 172.21.15.191:0/1632417502 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f42c8100b00 con 0x7f42b406ecc0 2024-09-19T09:29:56.654 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:56 smithi191 ceph-mon[34834]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T09:29:56.654 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:56 smithi191 ceph-mon[34834]: pgmap v74: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:29:56.654 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:56 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-19T09:29:56.823 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:56 smithi112 ceph-mon[27605]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T09:29:56.823 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:56 smithi112 ceph-mon[27605]: pgmap v74: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:29:56.823 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:56 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-19T09:29:57.730 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-19T09:29:57.730 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: osdmap e21: 3 total, 3 up, 3 in 2024-09-19T09:29:57.730 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:29:57.731 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:29:57.731 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:29:57.731 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:29:57.731 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:57.731 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: Detected new or changed devices on smithi112 2024-09-19T09:29:57.731 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:57.732 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:57.732 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:57.732 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:57.732 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:57.732 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: Adjusting osd_memory_target on smithi112 to 4288M 2024-09-19T09:29:57.732 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:57.732 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:57.733 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:57.733 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:57.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-19T09:29:57.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: osdmap e21: 3 total, 3 up, 3 in 2024-09-19T09:29:57.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:29:57.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:29:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:29:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:29:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: Detected new or changed devices on smithi112 2024-09-19T09:29:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: Adjusting osd_memory_target on smithi112 to 4288M 2024-09-19T09:29:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:57.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:57.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:58.438 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:29:58 smithi112 sudo[65150]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:29:58.438 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:29:58 smithi112 sudo[65150]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:29:58.438 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:29:58 smithi112 sudo[65150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:29:58.438 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:29:58 smithi112 sudo[65150]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:29:58.690 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:58 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:29:58.690 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:58 smithi191 ceph-mon[34834]: osdmap e22: 3 total, 3 up, 3 in 2024-09-19T09:29:58.690 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:58 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:58.690 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:58 smithi191 ceph-mon[34834]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:29:58.814 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:58 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:29:58.814 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:58 smithi112 ceph-mon[27605]: osdmap e22: 3 total, 3 up, 3 in 2024-09-19T09:29:58.814 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:58 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:58.815 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:58 smithi112 ceph-mon[27605]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:29:58.815 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:29:58 smithi112 sudo[65155]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:29:58.815 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:29:58 smithi112 sudo[65155]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:29:58.815 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:29:58 smithi112 sudo[65155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:29:58.815 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:29:58 smithi112 sudo[65155]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:29:59.184 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:29:58 smithi112 sudo[65235]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:29:59.185 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:29:58 smithi112 sudo[65235]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:29:59.185 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:29:58 smithi112 sudo[65235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:29:59.185 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:29:58 smithi112 sudo[65235]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:29:59.438 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65263]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:29:59.438 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65263]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:29:59.438 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:29:59.438 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65260]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:29:59.439 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65260]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:29:59.439 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:29:59.439 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65260]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:29:59.701 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65263]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:29:59.701 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65312]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:29:59.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:59 smithi112 ceph-mon[27605]: osdmap e23: 3 total, 3 up, 3 in 2024-09-19T09:29:59.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:29:59.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:29:59.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:59 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/668593652' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5a4869d-0060-48a9-aa67-da01703fa6fe"}]: dispatch 2024-09-19T09:29:59.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:59 smithi112 ceph-mon[27605]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5a4869d-0060-48a9-aa67-da01703fa6fe"}]: dispatch 2024-09-19T09:29:59.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:59 smithi112 ceph-mon[27605]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5a4869d-0060-48a9-aa67-da01703fa6fe"}]': finished 2024-09-19T09:29:59.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:59 smithi112 ceph-mon[27605]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T09:29:59.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:29:59.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:59 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/2575433772' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:29:59.952 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65312]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:29:59.952 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:29:59.952 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65312]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:30:00.025 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:59 smithi191 ceph-mon[34834]: osdmap e23: 3 total, 3 up, 3 in 2024-09-19T09:30:00.026 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:59 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:00.026 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:59 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:30:00.026 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:59 smithi191 ceph-mon[34834]: from='client.? 172.21.15.191:0/668593652' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5a4869d-0060-48a9-aa67-da01703fa6fe"}]: dispatch 2024-09-19T09:30:00.026 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:59 smithi191 ceph-mon[34834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5a4869d-0060-48a9-aa67-da01703fa6fe"}]: dispatch 2024-09-19T09:30:00.026 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:59 smithi191 ceph-mon[34834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5a4869d-0060-48a9-aa67-da01703fa6fe"}]': finished 2024-09-19T09:30:00.027 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:59 smithi191 ceph-mon[34834]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T09:30:00.027 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:59 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:30:00.027 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:29:59 smithi191 ceph-mon[34834]: from='client.? 172.21.15.191:0/2575433772' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:30:00.215 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65343]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:30:00.215 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65343]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:30:00.216 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:30:00.216 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:29:59 smithi112 sudo[65343]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:30:00.596 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:00 smithi112 sudo[65368]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:30:00.597 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:00 smithi112 sudo[65368]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:30:00.597 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:00 smithi112 sudo[65368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:30:00.597 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:00 smithi112 sudo[65368]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:30:00.725 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 sudo[38461]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:30:00.726 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 sudo[38461]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:30:00.726 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 sudo[38461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:30:00.726 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 sudo[38461]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:30:00.735 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:00.733+0000 7f42bffff640 1 -- 172.21.15.191:0/1632417502 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f42b0057400 con 0x7f42c80fc6f0 2024-09-19T09:30:00.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:00 smithi112 ceph-mon[27605]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:30:00.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:00 smithi112 ceph-mon[27605]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:00.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:00 smithi112 ceph-mon[27605]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:30:00.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:00 smithi112 ceph-mon[27605]: overall HEALTH_OK 2024-09-19T09:30:00.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:00 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:30:00.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:00 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:30:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:00 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:30:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:00 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:30:01.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 sudo[38648]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:30:01.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 sudo[38648]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:30:01.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 sudo[38648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:30:01.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 sudo[38648]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:30:01.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 ceph-mon[34834]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:30:01.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 ceph-mon[34834]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:01.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 ceph-mon[34834]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:30:01.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 ceph-mon[34834]: overall HEALTH_OK 2024-09-19T09:30:01.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:30:01.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:30:01.041 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:30:01.041 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:00 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:30:02.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:01 smithi191 ceph-mon[34834]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:30:02.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:01 smithi191 ceph-mon[34834]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:30:02.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:01 smithi191 ceph-mon[34834]: mgrmap e19: smithi112.puhuua(active, since 2m), standbys: smithi191.xjpplx 2024-09-19T09:30:02.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:01 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:02.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:01 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:02.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:01 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:02.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:01 smithi112 ceph-mon[27605]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:30:02.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:01 smithi112 ceph-mon[27605]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:30:02.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:01 smithi112 ceph-mon[27605]: mgrmap e19: smithi112.puhuua(active, since 2m), standbys: smithi191.xjpplx 2024-09-19T09:30:02.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:01 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:01 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:01 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:03.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:02 smithi191 ceph-mon[34834]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:03.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:02 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:03.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:02 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:03.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:02 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:03.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:02 smithi112 ceph-mon[27605]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:03.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:02 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:03.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:02 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:03.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:02 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:05.019 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:04 smithi191 ceph-mon[34834]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:05.102 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:04 smithi112 ceph-mon[27605]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:07.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:06 smithi191 ceph-mon[34834]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:07.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:06 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:30:07.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:06 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:07.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:06 smithi191 ceph-mon[34834]: Deploying daemon osd.3 on smithi191 2024-09-19T09:30:07.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:06 smithi112 ceph-mon[27605]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:07.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:06 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:30:07.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:06 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:07.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:06 smithi112 ceph-mon[27605]: Deploying daemon osd.3 on smithi191 2024-09-19T09:30:08.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:08 smithi191 ceph-mon[34834]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:09.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:08 smithi112 ceph-mon[27605]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:11.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:10 smithi191 ceph-mon[34834]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:11.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:10 smithi112 ceph-mon[27605]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:12.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:11 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:12.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:11 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:12.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:11 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:12.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:11 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:12.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:11 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:12.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:11 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:13.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:12 smithi112 ceph-mon[27605]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:13.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:12 smithi191 ceph-mon[34834]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:14.169 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:13 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:30:14.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:13 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:30:14.824 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:14.823+0000 7f42bffff640 1 -- 172.21.15.191:0/1632417502 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f42c8100b00 con 0x7f42b406ecc0 2024-09-19T09:30:14.825 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 3 on host 'smithi191' 2024-09-19T09:30:14.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:14.825+0000 7f42cd435640 1 -- 172.21.15.191:0/1632417502 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f42b406ecc0 msgr2=0x7f42b4071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:14.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:14.825+0000 7f42cd435640 1 --2- 172.21.15.191:0/1632417502 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f42b406ecc0 0x7f42b4071170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f42b8000c00 tx=0x7f42b8035040 comp rx=0 tx=0).stop 2024-09-19T09:30:14.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:14.825+0000 7f42cd435640 1 -- 172.21.15.191:0/1632417502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42c80fc6f0 msgr2=0x7f42c8112300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:14.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:14.825+0000 7f42cd435640 1 --2- 172.21.15.191:0/1632417502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42c80fc6f0 0x7f42c8112300 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f42b000eb70 tx=0x7f42b000b040 comp rx=0 tx=0).stop 2024-09-19T09:30:14.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:14.825+0000 7f42cd435640 1 -- 172.21.15.191:0/1632417502 shutdown_connections 2024-09-19T09:30:14.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:14.825+0000 7f42cd435640 1 --2- 172.21.15.191:0/1632417502 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f42b406ecc0 0x7f42b4071170 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:14.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:14.825+0000 7f42cd435640 1 --2- 172.21.15.191:0/1632417502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42c80fc6f0 0x7f42c8112300 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:14.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:14.825+0000 7f42cd435640 1 --2- 172.21.15.191:0/1632417502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c80fb420 0x7f42c810fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:14.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:14.825+0000 7f42cd435640 1 -- 172.21.15.191:0/1632417502 >> 172.21.15.191:0/1632417502 conn(0x7f42c80f6c00 msgr2=0x7f42c80f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:14.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:14.826+0000 7f42cd435640 1 -- 172.21.15.191:0/1632417502 shutdown_connections 2024-09-19T09:30:14.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:14.826+0000 7f42cd435640 1 -- 172.21.15.191:0/1632417502 wait complete. 2024-09-19T09:30:15.143 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:14 smithi191 ceph-mon[34834]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:15.143 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:14 smithi191 ceph-mon[34834]: from='osd.3 [v2:172.21.15.191:6800/2835674394,v1:172.21.15.191:6801/2835674394]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:30:15.143 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:14 smithi191 ceph-mon[34834]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:30:15.143 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:14 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:15.143 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:14 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:15.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:14 smithi112 ceph-mon[27605]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:15.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:14 smithi112 ceph-mon[27605]: from='osd.3 [v2:172.21.15.191:6800/2835674394,v1:172.21.15.191:6801/2835674394]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:30:15.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:14 smithi112 ceph-mon[27605]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:30:15.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:14 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:15.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:14 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:15.451 DEBUG:teuthology.orchestra.run.smithi191:osd.3> sudo journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T09:30:15.454 INFO:tasks.cephadm:Deploying osd.4 on smithi191 with /dev/vg_nvme/lv_3... 2024-09-19T09:30:15.454 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:30:15.745 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi191/config 2024-09-19T09:30:16.130 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:15 smithi191 ceph-mon[34834]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:30:16.130 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:15 smithi191 ceph-mon[34834]: osdmap e25: 4 total, 3 up, 4 in 2024-09-19T09:30:16.130 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:15 smithi191 ceph-mon[34834]: from='osd.3 [v2:172.21.15.191:6800/2835674394,v1:172.21.15.191:6801/2835674394]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:30:16.131 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:30:16.131 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:15 smithi191 ceph-mon[34834]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:30:16.131 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:16.131 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:16.131 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:15 smithi191 ceph-mon[34834]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-19T09:30:16.131 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:15 smithi191 ceph-mon[34834]: osdmap e26: 4 total, 3 up, 4 in 2024-09-19T09:30:16.131 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:15 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:30:16.131 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:30:15 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3[40258]: 2024-09-19T09:30:15.921+0000 7f743fef3640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T09:30:16.131 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:30:15 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3[40258]: 2024-09-19T09:30:15.932+0000 7f743ad08640 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:30:16.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:15 smithi112 ceph-mon[27605]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:30:16.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:15 smithi112 ceph-mon[27605]: osdmap e25: 4 total, 3 up, 4 in 2024-09-19T09:30:16.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:15 smithi112 ceph-mon[27605]: from='osd.3 [v2:172.21.15.191:6800/2835674394,v1:172.21.15.191:6801/2835674394]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:30:16.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:30:16.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:15 smithi112 ceph-mon[27605]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:30:16.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:16.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:16.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:15 smithi112 ceph-mon[27605]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-19T09:30:16.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:15 smithi112 ceph-mon[27605]: osdmap e26: 4 total, 3 up, 4 in 2024-09-19T09:30:16.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:15 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:30:17.145 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:16 smithi191 ceph-mon[34834]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:17.145 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:16 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:30:17.145 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:16 smithi191 ceph-mon[34834]: osd.3 [v2:172.21.15.191:6800/2835674394,v1:172.21.15.191:6801/2835674394] boot 2024-09-19T09:30:17.145 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:16 smithi191 ceph-mon[34834]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T09:30:17.145 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:16 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:30:17.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:16 smithi112 ceph-mon[27605]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T09:30:17.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:16 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:30:17.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:16 smithi112 ceph-mon[27605]: osd.3 [v2:172.21.15.191:6800/2835674394,v1:172.21.15.191:6801/2835674394] boot 2024-09-19T09:30:17.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:16 smithi112 ceph-mon[27605]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T09:30:17.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:16 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:30:18.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:18 smithi112 ceph-mon[27605]: purged_snaps scrub starts 2024-09-19T09:30:18.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:18 smithi112 ceph-mon[27605]: purged_snaps scrub ok 2024-09-19T09:30:18.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:18 smithi112 ceph-mon[27605]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T09:30:18.517 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:18 smithi191 ceph-mon[34834]: purged_snaps scrub starts 2024-09-19T09:30:18.517 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:18 smithi191 ceph-mon[34834]: purged_snaps scrub ok 2024-09-19T09:30:18.517 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:18 smithi191 ceph-mon[34834]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T09:30:19.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:19 smithi191 ceph-mon[34834]: pgmap v93: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:19.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:19 smithi191 ceph-mon[34834]: osdmap e29: 4 total, 4 up, 4 in 2024-09-19T09:30:19.295 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:30:19.316 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi191:vg_nvme/lv_3 2024-09-19T09:30:19.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:19 smithi112 ceph-mon[27605]: pgmap v93: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:19.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:19 smithi112 ceph-mon[27605]: osdmap e29: 4 total, 4 up, 4 in 2024-09-19T09:30:19.850 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi191/config 2024-09-19T09:30:21.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:21 smithi191 ceph-mon[34834]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:21.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:21 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:21.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:21 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:21.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:21 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:30:21.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:21 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:21.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:21 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:21.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:21 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:21.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:21 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:21.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:21 smithi112 ceph-mon[27605]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:21.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:21 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:21.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:21 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:21.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:21 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:30:21.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:21 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:21.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:21 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:21.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:21 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:21.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:21 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:21.956 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.934+0000 7fc58536d640 1 -- 172.21.15.191:0/3317831301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5800fd7f0 msgr2=0x7fc5800fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:21.956 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.934+0000 7fc58536d640 1 --2- 172.21.15.191:0/3317831301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5800fd7f0 0x7fc5800fdc60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc5680048d0 tx=0x7fc568009da0 comp rx=0 tx=0).stop 2024-09-19T09:30:21.956 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.934+0000 7fc58536d640 1 -- 172.21.15.191:0/3317831301 shutdown_connections 2024-09-19T09:30:21.957 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.934+0000 7fc58536d640 1 --2- 172.21.15.191:0/3317831301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5800fd7f0 0x7fc5800fdc60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:21.957 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.934+0000 7fc58536d640 1 --2- 172.21.15.191:0/3317831301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5800fc520 0x7fc5800fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:21.957 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.934+0000 7fc58536d640 1 -- 172.21.15.191:0/3317831301 >> 172.21.15.191:0/3317831301 conn(0x7fc5800f7ce0 msgr2=0x7fc5800fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:21.957 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.934+0000 7fc58536d640 1 -- 172.21.15.191:0/3317831301 shutdown_connections 2024-09-19T09:30:21.957 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.934+0000 7fc58536d640 1 -- 172.21.15.191:0/3317831301 wait complete. 2024-09-19T09:30:21.957 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.935+0000 7fc58536d640 1 Processor -- start 2024-09-19T09:30:21.957 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.935+0000 7fc58536d640 1 -- start start 2024-09-19T09:30:21.957 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.935+0000 7fc58536d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5800fc520 0x7fc580071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:21.957 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.935+0000 7fc58536d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5800fd7f0 0x7fc58006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:21.957 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.935+0000 7fc58536d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58006fff0 con 0x7fc5800fc520 2024-09-19T09:30:21.957 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.935+0000 7fc58536d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc580070130 con 0x7fc5800fd7f0 2024-09-19T09:30:21.958 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.935+0000 7fc57e7fc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5800fd7f0 0x7fc58006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:21.958 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.935+0000 7fc57e7fc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5800fd7f0 0x7fc58006fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:51046/0 (socket says 172.21.15.191:51046) 2024-09-19T09:30:21.958 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.935+0000 7fc57e7fc640 1 -- 172.21.15.191:0/1293637187 learned_addr learned my addr 172.21.15.191:0/1293637187 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:30:21.958 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.936+0000 7fc57effd640 1 --2- 172.21.15.191:0/1293637187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5800fc520 0x7fc580071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:21.958 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.936+0000 7fc57e7fc640 1 -- 172.21.15.191:0/1293637187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5800fc520 msgr2=0x7fc580071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:21.958 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.936+0000 7fc57e7fc640 1 --2- 172.21.15.191:0/1293637187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5800fc520 0x7fc580071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:21.958 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.936+0000 7fc57e7fc640 1 -- 172.21.15.191:0/1293637187 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568005040 con 0x7fc5800fd7f0 2024-09-19T09:30:21.958 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.936+0000 7fc57effd640 1 --2- 172.21.15.191:0/1293637187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5800fc520 0x7fc580071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:21.958 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.936+0000 7fc57e7fc640 1 --2- 172.21.15.191:0/1293637187 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5800fd7f0 0x7fc58006fa60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc5680043d0 tx=0x7fc568009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:21.958 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.936+0000 7fc5777fe640 1 -- 172.21.15.191:0/1293637187 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc568038070 con 0x7fc5800fd7f0 2024-09-19T09:30:21.958 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.936+0000 7fc5777fe640 1 -- 172.21.15.191:0/1293637187 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc56802ae90 con 0x7fc5800fd7f0 2024-09-19T09:30:21.959 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.936+0000 7fc58536d640 1 -- 172.21.15.191:0/1293637187 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5800703b0 con 0x7fc5800fd7f0 2024-09-19T09:30:21.959 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.936+0000 7fc5777fe640 1 -- 172.21.15.191:0/1293637187 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc56803e670 con 0x7fc5800fd7f0 2024-09-19T09:30:21.959 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.936+0000 7fc58536d640 1 -- 172.21.15.191:0/1293637187 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5801150d0 con 0x7fc5800fd7f0 2024-09-19T09:30:21.959 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.937+0000 7fc58536d640 1 -- 172.21.15.191:0/1293637187 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5800fb980 con 0x7fc5800fd7f0 2024-09-19T09:30:21.959 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.937+0000 7fc5777fe640 1 -- 172.21.15.191:0/1293637187 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc568030020 con 0x7fc5800fd7f0 2024-09-19T09:30:21.959 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.938+0000 7fc5777fe640 1 --2- 172.21.15.191:0/1293637187 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc56c06ed60 0x7fc56c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:21.959 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.938+0000 7fc5777fe640 1 -- 172.21.15.191:0/1293637187 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3770+0+0 (secure 0 0 0) 0x7fc5680adcc0 con 0x7fc5800fd7f0 2024-09-19T09:30:21.959 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.938+0000 7fc57effd640 1 --2- 172.21.15.191:0/1293637187 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc56c06ed60 0x7fc56c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:21.959 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.938+0000 7fc57effd640 1 --2- 172.21.15.191:0/1293637187 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc56c06ed60 0x7fc56c071210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc580071320 tx=0x7fc57000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:21.959 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:21.942+0000 7fc5777fe640 1 -- 172.21.15.191:0/1293637187 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc56807b500 con 0x7fc5800fd7f0 2024-09-19T09:30:22.108 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:22.107+0000 7fc58536d640 1 -- 172.21.15.191:0/1293637187 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc580101c10 con 0x7fc56c06ed60 2024-09-19T09:30:22.387 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:22 smithi191 ceph-mon[34834]: Detected new or changed devices on smithi191 2024-09-19T09:30:22.387 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:22 smithi191 ceph-mon[34834]: Adjusting osd_memory_target on smithi191 to 15936M 2024-09-19T09:30:22.387 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:22 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:22.387 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:22 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:22.387 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:22 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:22.388 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:22 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:22.388 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:22 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:30:22.388 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:22 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:30:22.388 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:22 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:22.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:22 smithi112 ceph-mon[27605]: Detected new or changed devices on smithi191 2024-09-19T09:30:22.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:22 smithi112 ceph-mon[27605]: Adjusting osd_memory_target on smithi191 to 15936M 2024-09-19T09:30:22.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:22 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:22.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:22 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:22.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:22 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:22.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:22 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:22.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:22 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:30:22.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:22 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:30:22.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:22 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:23.363 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:23 smithi191 ceph-mon[34834]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-19T09:30:23.363 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:23 smithi191 ceph-mon[34834]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:23.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:23 smithi112 ceph-mon[27605]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-19T09:30:23.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:23 smithi112 ceph-mon[27605]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:25.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:25 smithi191 ceph-mon[34834]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-19T09:30:25.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:25 smithi191 ceph-mon[34834]: from='client.? 172.21.15.191:0/2736791468' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "942246d0-c3f9-4581-93c1-dc7b4345af73"}]: dispatch 2024-09-19T09:30:25.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:25 smithi191 ceph-mon[34834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "942246d0-c3f9-4581-93c1-dc7b4345af73"}]: dispatch 2024-09-19T09:30:25.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:25 smithi191 ceph-mon[34834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "942246d0-c3f9-4581-93c1-dc7b4345af73"}]': finished 2024-09-19T09:30:25.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:25 smithi191 ceph-mon[34834]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T09:30:25.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:25 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:30:25.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:25 smithi191 ceph-mon[34834]: from='client.? 172.21.15.191:0/2569736508' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:30:25.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:25 smithi112 ceph-mon[27605]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-19T09:30:25.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:25 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/2736791468' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "942246d0-c3f9-4581-93c1-dc7b4345af73"}]: dispatch 2024-09-19T09:30:25.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:25 smithi112 ceph-mon[27605]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "942246d0-c3f9-4581-93c1-dc7b4345af73"}]: dispatch 2024-09-19T09:30:25.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:25 smithi112 ceph-mon[27605]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "942246d0-c3f9-4581-93c1-dc7b4345af73"}]': finished 2024-09-19T09:30:25.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:25 smithi112 ceph-mon[27605]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T09:30:25.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:25 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:30:25.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:25 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/2569736508' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:30:27.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:27 smithi191 ceph-mon[34834]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:30:27.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:27 smithi112 ceph-mon[27605]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:30:29.498 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:29 smithi112 ceph-mon[27605]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-19T09:30:29.498 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:29 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:30:29.499 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:29 smithi191 ceph-mon[34834]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-19T09:30:29.499 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:29 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:30:31.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:31 smithi191 ceph-mon[34834]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:30:31.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:31 smithi112 ceph-mon[27605]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:30:32.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:32 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:30:32.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:32 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:32.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:32 smithi191 ceph-mon[34834]: Deploying daemon osd.4 on smithi191 2024-09-19T09:30:32.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:32 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:30:32.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:32 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:32.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:32 smithi112 ceph-mon[27605]: Deploying daemon osd.4 on smithi191 2024-09-19T09:30:33.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:33 smithi191 ceph-mon[34834]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:33.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:33 smithi112 ceph-mon[27605]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:35.390 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:35 smithi191 ceph-mon[34834]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:35.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:35 smithi112 ceph-mon[27605]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:36.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:36 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:36.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:36 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:36.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:36 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:36.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:36 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:36.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:36 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:36.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:36 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:37.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:37 smithi191 ceph-mon[34834]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:37.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:37 smithi112 ceph-mon[27605]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:39.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:39 smithi191 ceph-mon[34834]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:39.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:39 smithi112 ceph-mon[27605]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:39.876 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:39.874+0000 7fc5777fe640 1 -- 172.21.15.191:0/1293637187 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc580101c10 con 0x7fc56c06ed60 2024-09-19T09:30:39.876 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 4 on host 'smithi191' 2024-09-19T09:30:39.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:39.877+0000 7fc58536d640 1 -- 172.21.15.191:0/1293637187 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc56c06ed60 msgr2=0x7fc56c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:39.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:39.877+0000 7fc58536d640 1 --2- 172.21.15.191:0/1293637187 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc56c06ed60 0x7fc56c071210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc580071320 tx=0x7fc57000b040 comp rx=0 tx=0).stop 2024-09-19T09:30:39.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:39.877+0000 7fc58536d640 1 -- 172.21.15.191:0/1293637187 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5800fd7f0 msgr2=0x7fc58006fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:39.879 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:39.877+0000 7fc58536d640 1 --2- 172.21.15.191:0/1293637187 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5800fd7f0 0x7fc58006fa60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc5680043d0 tx=0x7fc568009da0 comp rx=0 tx=0).stop 2024-09-19T09:30:39.879 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:39.877+0000 7fc58536d640 1 -- 172.21.15.191:0/1293637187 shutdown_connections 2024-09-19T09:30:39.879 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:39.877+0000 7fc58536d640 1 --2- 172.21.15.191:0/1293637187 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc56c06ed60 0x7fc56c071210 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:39.879 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:39.877+0000 7fc58536d640 1 --2- 172.21.15.191:0/1293637187 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5800fd7f0 0x7fc58006fa60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:39.879 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:39.877+0000 7fc58536d640 1 --2- 172.21.15.191:0/1293637187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5800fc520 0x7fc580071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:39.879 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:39.877+0000 7fc58536d640 1 -- 172.21.15.191:0/1293637187 >> 172.21.15.191:0/1293637187 conn(0x7fc5800f7ce0 msgr2=0x7fc5800f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:39.879 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:39.877+0000 7fc58536d640 1 -- 172.21.15.191:0/1293637187 shutdown_connections 2024-09-19T09:30:39.879 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:39.877+0000 7fc58536d640 1 -- 172.21.15.191:0/1293637187 wait complete. 2024-09-19T09:30:40.720 DEBUG:teuthology.orchestra.run.smithi191:osd.4> sudo journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T09:30:40.723 INFO:tasks.cephadm:Deploying osd.5 on smithi191 with /dev/vg_nvme/lv_2... 2024-09-19T09:30:40.723 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:30:41.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:40 smithi191 ceph-mon[34834]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:41.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:40 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:41.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:40 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:41.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:40 smithi191 ceph-mon[34834]: from='osd.4 [v2:172.21.15.191:6808/101220282,v1:172.21.15.191:6809/101220282]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:30:41.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:40 smithi191 ceph-mon[34834]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:30:41.036 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi191/config 2024-09-19T09:30:41.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:40 smithi112 ceph-mon[27605]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:41.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:40 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:41.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:40 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:41.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:40 smithi112 ceph-mon[27605]: from='osd.4 [v2:172.21.15.191:6808/101220282,v1:172.21.15.191:6809/101220282]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:30:41.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:40 smithi112 ceph-mon[27605]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:30:42.111 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:41 smithi191 ceph-mon[34834]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:30:42.111 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:41 smithi191 ceph-mon[34834]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T09:30:42.111 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:41 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:30:42.112 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:41 smithi191 ceph-mon[34834]: from='osd.4 [v2:172.21.15.191:6808/101220282,v1:172.21.15.191:6809/101220282]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:30:42.112 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:41 smithi191 ceph-mon[34834]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:30:42.112 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:41 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:42.112 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:41 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:42.112 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:30:41 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[46881]: 2024-09-19T09:30:41.882+0000 7f38a036f640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T09:30:42.112 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:30:41 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[46881]: 2024-09-19T09:30:41.888+0000 7f38991a2640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:30:42.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:41 smithi112 ceph-mon[27605]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:30:42.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:41 smithi112 ceph-mon[27605]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T09:30:42.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:41 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:30:42.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:41 smithi112 ceph-mon[27605]: from='osd.4 [v2:172.21.15.191:6808/101220282,v1:172.21.15.191:6809/101220282]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:30:42.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:41 smithi112 ceph-mon[27605]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:30:42.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:41 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:42.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:41 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:43.023 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:42 smithi191 ceph-mon[34834]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:43.023 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:42 smithi191 ceph-mon[34834]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-19T09:30:43.023 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:42 smithi191 ceph-mon[34834]: osdmap e32: 5 total, 4 up, 5 in 2024-09-19T09:30:43.024 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:42 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:30:43.024 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:42 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:30:43.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:42 smithi112 ceph-mon[27605]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T09:30:43.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:42 smithi112 ceph-mon[27605]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-19T09:30:43.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:42 smithi112 ceph-mon[27605]: osdmap e32: 5 total, 4 up, 5 in 2024-09-19T09:30:43.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:42 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:30:43.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:42 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:30:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:43 smithi112 ceph-mon[27605]: purged_snaps scrub starts 2024-09-19T09:30:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:43 smithi112 ceph-mon[27605]: purged_snaps scrub ok 2024-09-19T09:30:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:43 smithi112 ceph-mon[27605]: osd.4 [v2:172.21.15.191:6808/101220282,v1:172.21.15.191:6809/101220282] boot 2024-09-19T09:30:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:43 smithi112 ceph-mon[27605]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T09:30:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:43 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:30:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:43 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:30:44.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:43 smithi191 ceph-mon[34834]: purged_snaps scrub starts 2024-09-19T09:30:44.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:43 smithi191 ceph-mon[34834]: purged_snaps scrub ok 2024-09-19T09:30:44.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:43 smithi191 ceph-mon[34834]: osd.4 [v2:172.21.15.191:6808/101220282,v1:172.21.15.191:6809/101220282] boot 2024-09-19T09:30:44.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:43 smithi191 ceph-mon[34834]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T09:30:44.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:43 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:30:44.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:43 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:30:44.396 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-19T09:30:44.421 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi191:vg_nvme/lv_2 2024-09-19T09:30:44.953 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi191/config 2024-09-19T09:30:45.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:44 smithi191 ceph-mon[34834]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:45.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:44 smithi191 ceph-mon[34834]: osdmap e34: 5 total, 5 up, 5 in 2024-09-19T09:30:45.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:44 smithi112 ceph-mon[27605]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:45.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:44 smithi112 ceph-mon[27605]: osdmap e34: 5 total, 5 up, 5 in 2024-09-19T09:30:47.024 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.001+0000 7f636bb42640 1 -- 172.21.15.191:0/1373549279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63640fb450 msgr2=0x7f63640fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:47.024 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.001+0000 7f636bb42640 1 --2- 172.21.15.191:0/1373549279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63640fb450 0x7f63640fb860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f635c0048d0 tx=0x7f635c009da0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.024 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.001+0000 7f636bb42640 1 -- 172.21.15.191:0/1373549279 shutdown_connections 2024-09-19T09:30:47.024 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.001+0000 7f636bb42640 1 --2- 172.21.15.191:0/1373549279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63640fc720 0x7f63640fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.024 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.001+0000 7f636bb42640 1 --2- 172.21.15.191:0/1373549279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63640fb450 0x7f63640fb860 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.024 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.001+0000 7f636bb42640 1 -- 172.21.15.191:0/1373549279 >> 172.21.15.191:0/1373549279 conn(0x7f63640f6c10 msgr2=0x7f63640f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:47.025 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.001+0000 7f636bb42640 1 -- 172.21.15.191:0/1373549279 shutdown_connections 2024-09-19T09:30:47.025 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.001+0000 7f636bb42640 1 -- 172.21.15.191:0/1373549279 wait complete. 2024-09-19T09:30:47.025 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.002+0000 7f636bb42640 1 Processor -- start 2024-09-19T09:30:47.025 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.002+0000 7f636bb42640 1 -- start start 2024-09-19T09:30:47.025 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.002+0000 7f636bb42640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63640fb450 0x7f636410d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.025 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.002+0000 7f636bb42640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63640fc720 0x7f636410d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.025 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.002+0000 7f636bb42640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636410e520 con 0x7f63640fc720 2024-09-19T09:30:47.025 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.002+0000 7f636bb42640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636410e690 con 0x7f63640fb450 2024-09-19T09:30:47.025 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.002+0000 7f63698de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63640fb450 0x7f636410d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.025 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.002+0000 7f63698de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63640fb450 0x7f636410d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:57388/0 (socket says 172.21.15.191:57388) 2024-09-19T09:30:47.026 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.002+0000 7f63698de640 1 -- 172.21.15.191:0/4213077838 learned_addr learned my addr 172.21.15.191:0/4213077838 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:30:47.026 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.002+0000 7f63698de640 1 -- 172.21.15.191:0/4213077838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63640fc720 msgr2=0x7f636410d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:47.026 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.002+0000 7f63698de640 1 --2- 172.21.15.191:0/4213077838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63640fc720 0x7f636410d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.026 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.002+0000 7f63698de640 1 -- 172.21.15.191:0/4213077838 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c005040 con 0x7f63640fb450 2024-09-19T09:30:47.026 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.003+0000 7f63698de640 1 --2- 172.21.15.191:0/4213077838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63640fb450 0x7f636410d170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f635c000c00 tx=0x7f635c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:47.026 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.003+0000 7f63627fc640 1 -- 172.21.15.191:0/4213077838 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f635c038070 con 0x7f63640fb450 2024-09-19T09:30:47.026 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.003+0000 7f636bb42640 1 -- 172.21.15.191:0/4213077838 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636410e910 con 0x7f63640fb450 2024-09-19T09:30:47.026 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.003+0000 7f63627fc640 1 -- 172.21.15.191:0/4213077838 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f635c02ae90 con 0x7f63640fb450 2024-09-19T09:30:47.026 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.003+0000 7f63627fc640 1 -- 172.21.15.191:0/4213077838 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f635c03d420 con 0x7f63640fb450 2024-09-19T09:30:47.026 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.003+0000 7f636bb42640 1 -- 172.21.15.191:0/4213077838 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636410edd0 con 0x7f63640fb450 2024-09-19T09:30:47.026 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.004+0000 7f636bb42640 1 -- 172.21.15.191:0/4213077838 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63640fa8b0 con 0x7f63640fb450 2024-09-19T09:30:47.026 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.004+0000 7f63627fc640 1 -- 172.21.15.191:0/4213077838 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f635c030020 con 0x7f63640fb450 2024-09-19T09:30:47.026 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.005+0000 7f63627fc640 1 --2- 172.21.15.191:0/4213077838 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f634c06ed60 0x7f634c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.027 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.005+0000 7f63627fc640 1 -- 172.21.15.191:0/4213077838 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f635c0ae4b0 con 0x7f63640fb450 2024-09-19T09:30:47.027 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.005+0000 7f63690dd640 1 --2- 172.21.15.191:0/4213077838 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f634c06ed60 0x7f634c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.027 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.005+0000 7f63690dd640 1 --2- 172.21.15.191:0/4213077838 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f634c06ed60 0x7f634c071210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f636410cf20 tx=0x7f6358006d20 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:47.027 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.009+0000 7f63627fc640 1 -- 172.21.15.191:0/4213077838 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f635c07ba60 con 0x7f63640fb450 2024-09-19T09:30:47.177 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:30:47.173+0000 7f636bb42640 1 -- 172.21.15.191:0/4213077838 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6364103f40 con 0x7f634c06ed60 2024-09-19T09:30:47.427 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:47 smithi191 ceph-mon[34834]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:47.427 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:47 smithi191 ceph-mon[34834]: Detected new or changed devices on smithi191 2024-09-19T09:30:47.427 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:47.427 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:47.427 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:30:47.427 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:30:47.427 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:47 smithi191 ceph-mon[34834]: Adjusting osd_memory_target on smithi191 to 7968M 2024-09-19T09:30:47.427 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:47.427 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:47.428 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:47.428 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:47.428 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:47.428 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:47.428 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:47.428 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:47 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:47.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:47 smithi112 ceph-mon[27605]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:47.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:47 smithi112 ceph-mon[27605]: Detected new or changed devices on smithi191 2024-09-19T09:30:47.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:47.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:47.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:30:47.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:30:47.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:47 smithi112 ceph-mon[27605]: Adjusting osd_memory_target on smithi191 to 7968M 2024-09-19T09:30:47.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:47.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:47.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:47.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:47.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:47.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:47.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:47.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:47 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:30:48.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:48 smithi112 ceph-mon[27605]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:48.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:30:48.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:30:48.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:48.514 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:48 smithi191 ceph-mon[34834]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:48.514 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:48 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:30:48.514 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:48 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:30:48.514 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:48 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:49.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:49 smithi112 ceph-mon[27605]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:49.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:49 smithi191 ceph-mon[34834]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:50.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:50 smithi191 ceph-mon[34834]: from='client.? 172.21.15.191:0/3007996640' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33796cd8-002f-4f26-b7a3-0d126f6bcb01"}]: dispatch 2024-09-19T09:30:50.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:50 smithi191 ceph-mon[34834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33796cd8-002f-4f26-b7a3-0d126f6bcb01"}]: dispatch 2024-09-19T09:30:50.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:50 smithi191 ceph-mon[34834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33796cd8-002f-4f26-b7a3-0d126f6bcb01"}]': finished 2024-09-19T09:30:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:50 smithi191 ceph-mon[34834]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T09:30:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:50 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:30:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:50 smithi191 ceph-mon[34834]: from='client.? 172.21.15.191:0/3324648697' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:30:50.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:50 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/3007996640' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33796cd8-002f-4f26-b7a3-0d126f6bcb01"}]: dispatch 2024-09-19T09:30:50.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:50 smithi112 ceph-mon[27605]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33796cd8-002f-4f26-b7a3-0d126f6bcb01"}]: dispatch 2024-09-19T09:30:50.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:50 smithi112 ceph-mon[27605]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33796cd8-002f-4f26-b7a3-0d126f6bcb01"}]': finished 2024-09-19T09:30:50.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:50 smithi112 ceph-mon[27605]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T09:30:50.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:30:50.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:50 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/3324648697' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:30:51.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:51 smithi191 ceph-mon[34834]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:51.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:51 smithi112 ceph-mon[27605]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:53.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:53 smithi191 ceph-mon[34834]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:53.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:53 smithi112 ceph-mon[27605]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:55.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:55 smithi191 ceph-mon[34834]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:55.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:55 smithi112 ceph-mon[27605]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:57.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:57 smithi191 ceph-mon[34834]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:57.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:30:57.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:57 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:57.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:57 smithi112 ceph-mon[27605]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:57.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:30:57.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:57 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:58.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:58 smithi191 ceph-mon[34834]: Deploying daemon osd.5 on smithi191 2024-09-19T09:30:58.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:58 smithi112 ceph-mon[27605]: Deploying daemon osd.5 on smithi191 2024-09-19T09:30:59.749 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:59 smithi191 ceph-mon[34834]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:59.749 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:30:59 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:30:59.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:59 smithi112 ceph-mon[27605]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:30:59.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:30:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:31:01.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:01 smithi191 ceph-mon[34834]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:31:01.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:01 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:01.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:01 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:01.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:01 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:01.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:01 smithi112 ceph-mon[27605]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:31:01.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:01 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:01.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:01 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:01.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:01 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:03.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:03 smithi191 ceph-mon[34834]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:31:03.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:03 smithi112 ceph-mon[27605]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:31:05.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:05 smithi191 ceph-mon[34834]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:31:05.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:05 smithi191 ceph-mon[34834]: from='osd.5 [v2:172.21.15.191:6816/2561099737,v1:172.21.15.191:6817/2561099737]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:31:05.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:05 smithi191 ceph-mon[34834]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:31:05.593 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:05.592+0000 7f63627fc640 1 -- 172.21.15.191:0/4213077838 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6364103f40 con 0x7f634c06ed60 2024-09-19T09:31:05.593 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 5 on host 'smithi191' 2024-09-19T09:31:05.596 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:05.594+0000 7f636bb42640 1 -- 172.21.15.191:0/4213077838 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f634c06ed60 msgr2=0x7f634c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:05.596 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:05.594+0000 7f636bb42640 1 --2- 172.21.15.191:0/4213077838 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f634c06ed60 0x7f634c071210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f636410cf20 tx=0x7f6358006d20 comp rx=0 tx=0).stop 2024-09-19T09:31:05.596 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:05.594+0000 7f636bb42640 1 -- 172.21.15.191:0/4213077838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63640fb450 msgr2=0x7f636410d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:05.596 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:05.594+0000 7f636bb42640 1 --2- 172.21.15.191:0/4213077838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63640fb450 0x7f636410d170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f635c000c00 tx=0x7f635c009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:05.596 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:05.594+0000 7f636bb42640 1 -- 172.21.15.191:0/4213077838 shutdown_connections 2024-09-19T09:31:05.596 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:05.594+0000 7f636bb42640 1 --2- 172.21.15.191:0/4213077838 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f634c06ed60 0x7f634c071210 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:05.596 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:05.594+0000 7f636bb42640 1 --2- 172.21.15.191:0/4213077838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63640fc720 0x7f636410d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:05.596 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:05.594+0000 7f636bb42640 1 --2- 172.21.15.191:0/4213077838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63640fb450 0x7f636410d170 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:05.596 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:05.594+0000 7f636bb42640 1 -- 172.21.15.191:0/4213077838 >> 172.21.15.191:0/4213077838 conn(0x7f63640f6c10 msgr2=0x7f63640660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:05.596 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:05.594+0000 7f636bb42640 1 -- 172.21.15.191:0/4213077838 shutdown_connections 2024-09-19T09:31:05.596 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:05.594+0000 7f636bb42640 1 -- 172.21.15.191:0/4213077838 wait complete. 2024-09-19T09:31:05.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:05 smithi112 ceph-mon[27605]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:31:05.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:05 smithi112 ceph-mon[27605]: from='osd.5 [v2:172.21.15.191:6816/2561099737,v1:172.21.15.191:6817/2561099737]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:31:05.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:05 smithi112 ceph-mon[27605]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:31:06.175 DEBUG:teuthology.orchestra.run.smithi191:osd.5> sudo journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T09:31:06.177 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-19T09:31:06.177 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:31:06.437 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:06.784 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:31:06 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[53570]: 2024-09-19T09:31:06.499+0000 7ff1d3013640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T09:31:06.784 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:31:06 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[53570]: 2024-09-19T09:31:06.506+0000 7ff1ce64b640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:31:06.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:06 smithi191 ceph-mon[34834]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:31:06.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:06 smithi191 ceph-mon[34834]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T09:31:06.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:06 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:31:06.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:06 smithi191 ceph-mon[34834]: from='osd.5 [v2:172.21.15.191:6816/2561099737,v1:172.21.15.191:6817/2561099737]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:31:06.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:06 smithi191 ceph-mon[34834]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:31:06.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:06 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:06.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:06 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:06.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:06 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:06.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:06 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:06.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:06 smithi112 ceph-mon[27605]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:31:06.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:06 smithi112 ceph-mon[27605]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T09:31:06.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:06 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:31:06.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:06 smithi112 ceph-mon[27605]: from='osd.5 [v2:172.21.15.191:6816/2561099737,v1:172.21.15.191:6817/2561099737]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:31:06.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:06 smithi112 ceph-mon[27605]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:31:06.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:06 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:06.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:06 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:06.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:06 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:06.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:06 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:07.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:07 smithi191 ceph-mon[34834]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:31:07.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:07 smithi191 ceph-mon[34834]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-19T09:31:07.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:07 smithi191 ceph-mon[34834]: osdmap e37: 6 total, 5 up, 6 in 2024-09-19T09:31:07.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:07 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:31:07.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:07 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:31:07.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:07 smithi112 ceph-mon[27605]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:31:07.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:07 smithi112 ceph-mon[27605]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-19T09:31:07.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:07 smithi112 ceph-mon[27605]: osdmap e37: 6 total, 5 up, 6 in 2024-09-19T09:31:07.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:07 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:31:07.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:07 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:31:08.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.128+0000 7f34a387c640 1 -- 172.21.15.112:0/1268033901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f349c0fdba0 msgr2=0x7f349c0fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:08.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.128+0000 7f34a387c640 1 --2- 172.21.15.112:0/1268033901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f349c0fdba0 0x7f349c0fdfb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f348c0048d0 tx=0x7f348c009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:08.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.128+0000 7f34a387c640 1 -- 172.21.15.112:0/1268033901 shutdown_connections 2024-09-19T09:31:08.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.128+0000 7f34a387c640 1 --2- 172.21.15.112:0/1268033901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f349c0fe4f0 0x7f349c0fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:08.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.128+0000 7f34a387c640 1 --2- 172.21.15.112:0/1268033901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f349c0fdba0 0x7f349c0fdfb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:08.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.128+0000 7f34a387c640 1 -- 172.21.15.112:0/1268033901 >> 172.21.15.112:0/1268033901 conn(0x7f349c0f63a0 msgr2=0x7f349c0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:08.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.128+0000 7f34a387c640 1 -- 172.21.15.112:0/1268033901 shutdown_connections 2024-09-19T09:31:08.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.128+0000 7f34a387c640 1 -- 172.21.15.112:0/1268033901 wait complete. 2024-09-19T09:31:08.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.128+0000 7f34a387c640 1 Processor -- start 2024-09-19T09:31:08.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f34a387c640 1 -- start start 2024-09-19T09:31:08.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f34a387c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f349c0fdba0 0x7f349c10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:08.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f34a387c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f349c0fe4f0 0x7f349c10d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:08.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f34a387c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c10dc70 con 0x7f349c0fdba0 2024-09-19T09:31:08.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f34a387c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c10e490 con 0x7f349c0fe4f0 2024-09-19T09:31:08.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f34a1618640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f349c0fdba0 0x7f349c10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:08.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f34a1618640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f349c0fdba0 0x7f349c10d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34706/0 (socket says 172.21.15.112:34706) 2024-09-19T09:31:08.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f34a1618640 1 -- 172.21.15.112:0/3882906476 learned_addr learned my addr 172.21.15.112:0/3882906476 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f34a0e17640 1 --2- 172.21.15.112:0/3882906476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f349c0fe4f0 0x7f349c10d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f34a1618640 1 -- 172.21.15.112:0/3882906476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f349c0fe4f0 msgr2=0x7f349c10d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f34a1618640 1 --2- 172.21.15.112:0/3882906476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f349c0fe4f0 0x7f349c10d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f34a1618640 1 -- 172.21.15.112:0/3882906476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c005040 con 0x7f349c0fdba0 2024-09-19T09:31:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f34a1618640 1 --2- 172.21.15.112:0/3882906476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f349c0fdba0 0x7f349c10d0e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f348c0043d0 tx=0x7f348c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f3491ffb640 1 -- 172.21.15.112:0/3882906476 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f348c038070 con 0x7f349c0fdba0 2024-09-19T09:31:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f3491ffb640 1 -- 172.21.15.112:0/3882906476 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f348c02ae90 con 0x7f349c0fdba0 2024-09-19T09:31:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.129+0000 7f34a387c640 1 -- 172.21.15.112:0/3882906476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349c10e6c0 con 0x7f349c0fdba0 2024-09-19T09:31:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.130+0000 7f3491ffb640 1 -- 172.21.15.112:0/3882906476 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f348c03e670 con 0x7f349c0fdba0 2024-09-19T09:31:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.130+0000 7f34a387c640 1 -- 172.21.15.112:0/3882906476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349c10ec60 con 0x7f349c0fdba0 2024-09-19T09:31:08.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.131+0000 7f34a387c640 1 -- 172.21.15.112:0/3882906476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349c0fa040 con 0x7f349c0fdba0 2024-09-19T09:31:08.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.131+0000 7f3491ffb640 1 -- 172.21.15.112:0/3882906476 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f348c030020 con 0x7f349c0fdba0 2024-09-19T09:31:08.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.132+0000 7f3491ffb640 1 --2- 172.21.15.112:0/3882906476 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f348806ed60 0x7f3488071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:08.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.132+0000 7f3491ffb640 1 -- 172.21.15.112:0/3882906476 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f348c0adf70 con 0x7f349c0fdba0 2024-09-19T09:31:08.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.132+0000 7f34a0e17640 1 --2- 172.21.15.112:0/3882906476 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f348806ed60 0x7f3488071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:08.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.132+0000 7f34a0e17640 1 --2- 172.21.15.112:0/3882906476 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f348806ed60 0x7f3488071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f349c10ce90 tx=0x7f349800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:08.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.136+0000 7f3491ffb640 1 -- 172.21.15.112:0/3882906476 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f348c07b500 con 0x7f349c0fdba0 2024-09-19T09:31:08.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.290+0000 7f34a387c640 1 -- 172.21.15.112:0/3882906476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f349c04b720 con 0x7f349c0fdba0 2024-09-19T09:31:08.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.291+0000 7f3491ffb640 1 -- 172.21.15.112:0/3882906476 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f348c07aea0 con 0x7f349c0fdba0 2024-09-19T09:31:08.293 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:31:08.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.293+0000 7f34a387c640 1 -- 172.21.15.112:0/3882906476 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f348806ed60 msgr2=0x7f3488071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:08.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.293+0000 7f34a387c640 1 --2- 172.21.15.112:0/3882906476 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f348806ed60 0x7f3488071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f349c10ce90 tx=0x7f349800b040 comp rx=0 tx=0).stop 2024-09-19T09:31:08.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.293+0000 7f34a387c640 1 -- 172.21.15.112:0/3882906476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f349c0fdba0 msgr2=0x7f349c10d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:08.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.293+0000 7f34a387c640 1 --2- 172.21.15.112:0/3882906476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f349c0fdba0 0x7f349c10d0e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f348c0043d0 tx=0x7f348c009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:08.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.293+0000 7f34a387c640 1 -- 172.21.15.112:0/3882906476 shutdown_connections 2024-09-19T09:31:08.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.293+0000 7f34a387c640 1 --2- 172.21.15.112:0/3882906476 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f348806ed60 0x7f3488071210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:08.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.293+0000 7f34a387c640 1 --2- 172.21.15.112:0/3882906476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f349c0fe4f0 0x7f349c10d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:08.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.293+0000 7f34a387c640 1 --2- 172.21.15.112:0/3882906476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f349c0fdba0 0x7f349c10d0e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:08.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.293+0000 7f34a387c640 1 -- 172.21.15.112:0/3882906476 >> 172.21.15.112:0/3882906476 conn(0x7f349c0f63a0 msgr2=0x7f349c0f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:08.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.293+0000 7f34a387c640 1 -- 172.21.15.112:0/3882906476 shutdown_connections 2024-09-19T09:31:08.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:08.293+0000 7f34a387c640 1 -- 172.21.15.112:0/3882906476 wait complete. 2024-09-19T09:31:08.569 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:08 smithi112 ceph-mon[27605]: purged_snaps scrub starts 2024-09-19T09:31:08.569 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:08 smithi112 ceph-mon[27605]: purged_snaps scrub ok 2024-09-19T09:31:08.569 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:08 smithi112 ceph-mon[27605]: osd.5 [v2:172.21.15.191:6816/2561099737,v1:172.21.15.191:6817/2561099737] boot 2024-09-19T09:31:08.569 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:08 smithi112 ceph-mon[27605]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T09:31:08.569 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:08 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:31:08.569 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:08 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3882906476' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:31:08.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:08 smithi191 ceph-mon[34834]: purged_snaps scrub starts 2024-09-19T09:31:08.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:08 smithi191 ceph-mon[34834]: purged_snaps scrub ok 2024-09-19T09:31:08.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:08 smithi191 ceph-mon[34834]: osd.5 [v2:172.21.15.191:6816/2561099737,v1:172.21.15.191:6817/2561099737] boot 2024-09-19T09:31:08.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:08 smithi191 ceph-mon[34834]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T09:31:08.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:08 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:31:08.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:08 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/3882906476' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:31:08.979 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1726738267,"num_in_osds":6,"osd_in_since":1726738249,"num_remapped_pgs":0} 2024-09-19T09:31:08.980 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:31:09.232 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:09.586 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:09 smithi191 ceph-mon[34834]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:31:09.586 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:09 smithi191 ceph-mon[34834]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T09:31:09.605 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:09 smithi112 ceph-mon[27605]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T09:31:09.605 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:09 smithi112 ceph-mon[27605]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T09:31:10.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: Detected new or changed devices on smithi191 2024-09-19T09:31:10.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:10.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:10.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:10.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:10.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:10.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: Adjusting osd_memory_target on smithi191 to 5312M 2024-09-19T09:31:10.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:10.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:10.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:10.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:10.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:10.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:10.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:10.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:10.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:10 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:10.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.872+0000 7f872e29d640 1 -- 172.21.15.112:0/510224172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8728102550 msgr2=0x7f8728102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:10.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.872+0000 7f872e29d640 1 --2- 172.21.15.112:0/510224172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8728102550 0x7f8728102920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f87180048d0 tx=0x7f8718009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:10.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.872+0000 7f872e29d640 1 -- 172.21.15.112:0/510224172 shutdown_connections 2024-09-19T09:31:10.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.872+0000 7f872e29d640 1 --2- 172.21.15.112:0/510224172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8728102ef0 0x7f87280fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:10.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.872+0000 7f872e29d640 1 --2- 172.21.15.112:0/510224172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8728102550 0x7f8728102920 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:10.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.872+0000 7f872e29d640 1 -- 172.21.15.112:0/510224172 >> 172.21.15.112:0/510224172 conn(0x7f87280f80f0 msgr2=0x7f87280fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:10.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.872+0000 7f872e29d640 1 -- 172.21.15.112:0/510224172 shutdown_connections 2024-09-19T09:31:10.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.872+0000 7f872e29d640 1 -- 172.21.15.112:0/510224172 wait complete. 2024-09-19T09:31:10.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.873+0000 7f872e29d640 1 Processor -- start 2024-09-19T09:31:10.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.873+0000 7f872e29d640 1 -- start start 2024-09-19T09:31:10.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.873+0000 7f872e29d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8728102550 0x7f8728113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:10.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.873+0000 7f872e29d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8728102ef0 0x7f8728113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:10.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.873+0000 7f872e29d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8728114100 con 0x7f8728102ef0 2024-09-19T09:31:10.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.873+0000 7f872e29d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872810d510 con 0x7f8728102550 2024-09-19T09:31:10.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.873+0000 7f87277fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8728102ef0 0x7f8728113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:10.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.873+0000 7f87277fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8728102ef0 0x7f8728113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38128/0 (socket says 172.21.15.112:38128) 2024-09-19T09:31:10.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.873+0000 7f87277fe640 1 -- 172.21.15.112:0/258017443 learned_addr learned my addr 172.21.15.112:0/258017443 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:10.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.873+0000 7f8727fff640 1 --2- 172.21.15.112:0/258017443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8728102550 0x7f8728113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:10.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.874+0000 7f87277fe640 1 -- 172.21.15.112:0/258017443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8728102550 msgr2=0x7f8728113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:10.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.874+0000 7f87277fe640 1 --2- 172.21.15.112:0/258017443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8728102550 0x7f8728113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:10.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.874+0000 7f87277fe640 1 -- 172.21.15.112:0/258017443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8718005040 con 0x7f8728102ef0 2024-09-19T09:31:10.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.874+0000 7f87277fe640 1 --2- 172.21.15.112:0/258017443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8728102ef0 0x7f8728113ab0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f871c009af0 tx=0x7f871c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:10.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.874+0000 7f8724ff9640 1 -- 172.21.15.112:0/258017443 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f871c007c30 con 0x7f8728102ef0 2024-09-19T09:31:10.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.874+0000 7f8724ff9640 1 -- 172.21.15.112:0/258017443 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f871c00f040 con 0x7f8728102ef0 2024-09-19T09:31:10.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.874+0000 7f872e29d640 1 -- 172.21.15.112:0/258017443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872810d7f0 con 0x7f8728102ef0 2024-09-19T09:31:10.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.874+0000 7f8724ff9640 1 -- 172.21.15.112:0/258017443 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f871c00da10 con 0x7f8728102ef0 2024-09-19T09:31:10.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.874+0000 7f872e29d640 1 -- 172.21.15.112:0/258017443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872810dd90 con 0x7f8728102ef0 2024-09-19T09:31:10.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.875+0000 7f872e29d640 1 -- 172.21.15.112:0/258017443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87280fdcd0 con 0x7f8728102ef0 2024-09-19T09:31:10.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.876+0000 7f8724ff9640 1 -- 172.21.15.112:0/258017443 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f871c009670 con 0x7f8728102ef0 2024-09-19T09:31:10.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.876+0000 7f8724ff9640 1 --2- 172.21.15.112:0/258017443 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f871006ed60 0x7f8710071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:10.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.876+0000 7f8724ff9640 1 -- 172.21.15.112:0/258017443 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f871c08db60 con 0x7f8728102ef0 2024-09-19T09:31:10.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.876+0000 7f8727fff640 1 --2- 172.21.15.112:0/258017443 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f871006ed60 0x7f8710071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:10.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.876+0000 7f8727fff640 1 --2- 172.21.15.112:0/258017443 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f871006ed60 0x7f8710071210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8718009ac0 tx=0x7f8718035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:10.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:10.880+0000 7f8724ff9640 1 -- 172.21.15.112:0/258017443 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f871c05b100 con 0x7f8728102ef0 2024-09-19T09:31:11.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: Detected new or changed devices on smithi191 2024-09-19T09:31:11.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:11.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:11.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:11.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:11.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:11.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: Adjusting osd_memory_target on smithi191 to 5312M 2024-09-19T09:31:11.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:11.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:11.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:11.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:11.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:11.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:11.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:11.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:11.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:10 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:31:11.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:11.041+0000 7f872e29d640 1 -- 172.21.15.112:0/258017443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87280fbd50 con 0x7f8728102ef0 2024-09-19T09:31:11.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:11.042+0000 7f8724ff9640 1 -- 172.21.15.112:0/258017443 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11134 (secure 0 0 0) 0x7f871c05aaa0 con 0x7f8728102ef0 2024-09-19T09:31:11.043 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:31:11.044 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":39,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:25:42.323502+0000","modified":"2024-09-19T09:31:08.502857+0000","last_up_change":"2024-09-19T09:31:07.497508+0000","last_in_change":"2024-09-19T09:30:49.460305+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:29:56.033927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"8ce98763-b438-4d5d-9907-e2652cd154ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1562881068},{"type":"v1","addr":"172.21.15.112:6803","nonce":1562881068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1562881068},{"type":"v1","addr":"172.21.15.112:6805","nonce":1562881068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1562881068},{"type":"v1","addr":"172.21.15.112:6809","nonce":1562881068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1562881068},{"type":"v1","addr":"172.21.15.112:6807","nonce":1562881068}]},"public_addr":"172.21.15.112:6803/1562881068","cluster_addr":"172.21.15.112:6805/1562881068","heartbeat_back_addr":"172.21.15.112:6809/1562881068","heartbeat_front_addr":"172.21.15.112:6807/1562881068","state":["exists","up"]},{"osd":1,"uuid":"21b187e2-98e3-4f5b-a784-a24b848c75f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3124914300},{"type":"v1","addr":"172.21.15.112:6811","nonce":3124914300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3124914300},{"type":"v1","addr":"172.21.15.112:6813","nonce":3124914300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3124914300},{"type":"v1","addr":"172.21.15.112:6817","nonce":3124914300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3124914300},{"type":"v1","addr":"172.21.15.112:6815","nonce":3124914300}]},"public_addr":"172.21.15.112:6811/3124914300","cluster_addr":"172.21.15.112:6813/3124914300","heartbeat_back_addr":"172.21.15.112:6817/3124914300","heartbeat_front_addr":"172.21.15.112:6815/3124914300","state":["exists","up"]},{"osd":2,"uuid":"bf806972-fe72-4319-bac0-e302402ebfa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":2593689264},{"type":"v1","addr":"172.21.15.112:6819","nonce":2593689264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":2593689264},{"type":"v1","addr":"172.21.15.112:6821","nonce":2593689264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2593689264},{"type":"v1","addr":"172.21.15.112:6825","nonce":2593689264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":2593689264},{"type":"v1","addr":"172.21.15.112:6823","nonce":2593689264}]},"public_addr":"172.21.15.112:6819/2593689264","cluster_addr":"172.21.15.112:6821/2593689264","heartbeat_back_addr":"172.21.15.112:6825/2593689264","heartbeat_front_addr":"172.21.15.112:6823/2593689264","state":["exists","up"]},{"osd":3,"uuid":"f5a4869d-0060-48a9-aa67-da01703fa6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2835674394},{"type":"v1","addr":"172.21.15.191:6801","nonce":2835674394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2835674394},{"type":"v1","addr":"172.21.15.191:6803","nonce":2835674394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2835674394},{"type":"v1","addr":"172.21.15.191:6807","nonce":2835674394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2835674394},{"type":"v1","addr":"172.21.15.191:6805","nonce":2835674394}]},"public_addr":"172.21.15.191:6801/2835674394","cluster_addr":"172.21.15.191:6803/2835674394","heartbeat_back_addr":"172.21.15.191:6807/2835674394","heartbeat_front_addr":"172.21.15.191:6805/2835674394","state":["exists","up"]},{"osd":4,"uuid":"942246d0-c3f9-4581-93c1-dc7b4345af73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":101220282},{"type":"v1","addr":"172.21.15.191:6809","nonce":101220282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":101220282},{"type":"v1","addr":"172.21.15.191:6811","nonce":101220282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":101220282},{"type":"v1","addr":"172.21.15.191:6815","nonce":101220282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":101220282},{"type":"v1","addr":"172.21.15.191:6813","nonce":101220282}]},"public_addr":"172.21.15.191:6809/101220282","cluster_addr":"172.21.15.191:6811/101220282","heartbeat_back_addr":"172.21.15.191:6815/101220282","heartbeat_front_addr":"172.21.15.191:6813/101220282","state":["exists","up"]},{"osd":5,"uuid":"33796cd8-002f-4f26-b7a3-0d126f6bcb01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":2561099737},{"type":"v1","addr":"172.21.15.191:6817","nonce":2561099737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":2561099737},{"type":"v1","addr":"172.21.15.191:6819","nonce":2561099737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":2561099737},{"type":"v1","addr":"172.21.15.191:6823","nonce":2561099737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":2561099737},{"type":"v1","addr":"172.21.15.191:6821","nonce":2561099737}]},"public_addr":"172.21.15.191:6817/2561099737","cluster_addr":"172.21.15.191:6819/2561099737","heartbeat_back_addr":"172.21.15.191:6823/2561099737","heartbeat_front_addr":"172.21.15.191:6821/2561099737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:28:55.105239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:29:24.029349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:29:52.656220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:15.723724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:41.148318+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:06.270050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:0/2752965886":"2024-09-20T09:27:43.717543+0000","172.21.15.112:0/2459323098":"2024-09-20T09:26:10.763366+0000","172.21.15.112:0/1621418219":"2024-09-20T09:27:43.717543+0000","172.21.15.112:0/2839937816":"2024-09-20T09:26:40.441468+0000","172.21.15.112:6801/2336666418":"2024-09-20T09:26:10.763366+0000","172.21.15.112:0/3318399440":"2024-09-20T09:26:10.763366+0000","172.21.15.112:0/616967539":"2024-09-20T09:26:40.441468+0000","172.21.15.112:0/1234573048":"2024-09-20T09:26:10.763366+0000","172.21.15.112:0/1633167540":"2024-09-20T09:26:40.441468+0000","172.21.15.112:6800/2336666418":"2024-09-20T09:26:10.763366+0000","172.21.15.112:6800/1627571174":"2024-09-20T09:26:40.441468+0000","172.21.15.112:6801/1627571174":"2024-09-20T09:26:40.441468+0000","172.21.15.112:6800/3210372910":"2024-09-20T09:27:43.717543+0000","172.21.15.112:6801/3210372910":"2024-09-20T09:27:43.717543+0000","172.21.15.112:0/852695113":"2024-09-20T09:27:43.717543+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:31:11.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:11.044+0000 7f872e29d640 1 -- 172.21.15.112:0/258017443 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f871006ed60 msgr2=0x7f8710071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:11.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:11.044+0000 7f872e29d640 1 --2- 172.21.15.112:0/258017443 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f871006ed60 0x7f8710071210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8718009ac0 tx=0x7f8718035040 comp rx=0 tx=0).stop 2024-09-19T09:31:11.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:11.044+0000 7f872e29d640 1 -- 172.21.15.112:0/258017443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8728102ef0 msgr2=0x7f8728113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:11.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:11.044+0000 7f872e29d640 1 --2- 172.21.15.112:0/258017443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8728102ef0 0x7f8728113ab0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f871c009af0 tx=0x7f871c004570 comp rx=0 tx=0).stop 2024-09-19T09:31:11.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:11.044+0000 7f872e29d640 1 -- 172.21.15.112:0/258017443 shutdown_connections 2024-09-19T09:31:11.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:11.044+0000 7f872e29d640 1 --2- 172.21.15.112:0/258017443 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f871006ed60 0x7f8710071210 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:11.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:11.044+0000 7f872e29d640 1 --2- 172.21.15.112:0/258017443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8728102ef0 0x7f8728113ab0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:11.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:11.044+0000 7f872e29d640 1 --2- 172.21.15.112:0/258017443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8728102550 0x7f8728113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:11.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:11.044+0000 7f872e29d640 1 -- 172.21.15.112:0/258017443 >> 172.21.15.112:0/258017443 conn(0x7f87280f80f0 msgr2=0x7f87280f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:11.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:11.044+0000 7f872e29d640 1 -- 172.21.15.112:0/258017443 shutdown_connections 2024-09-19T09:31:11.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:11.044+0000 7f872e29d640 1 -- 172.21.15.112:0/258017443 wait complete. 2024-09-19T09:31:11.699 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:29:56.033927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-19T09:31:11.699 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T09:31:11.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:11 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/258017443' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:31:11.945 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:12.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:11 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/258017443' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:31:12.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:12 smithi112 ceph-mon[27605]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:13.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:12 smithi191 ceph-mon[34834]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:13.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.560+0000 7fad95bf6640 1 -- 172.21.15.112:0/2148210054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad900fdf20 msgr2=0x7fad90106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:13.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.560+0000 7fad95bf6640 1 --2- 172.21.15.112:0/2148210054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad900fdf20 0x7fad90106560 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fad840048d0 tx=0x7fad84009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:13.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.561+0000 7fad95bf6640 1 -- 172.21.15.112:0/2148210054 shutdown_connections 2024-09-19T09:31:13.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.561+0000 7fad95bf6640 1 --2- 172.21.15.112:0/2148210054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad900fdf20 0x7fad90106560 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:13.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.561+0000 7fad95bf6640 1 --2- 172.21.15.112:0/2148210054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad900fd580 0x7fad900fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:13.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.561+0000 7fad95bf6640 1 -- 172.21.15.112:0/2148210054 >> 172.21.15.112:0/2148210054 conn(0x7fad900f7010 msgr2=0x7fad900f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:13.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.561+0000 7fad95bf6640 1 -- 172.21.15.112:0/2148210054 shutdown_connections 2024-09-19T09:31:13.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.561+0000 7fad95bf6640 1 -- 172.21.15.112:0/2148210054 wait complete. 2024-09-19T09:31:13.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.561+0000 7fad95bf6640 1 Processor -- start 2024-09-19T09:31:13.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.561+0000 7fad95bf6640 1 -- start start 2024-09-19T09:31:13.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.561+0000 7fad95bf6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad900fd580 0x7fad90113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:13.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.561+0000 7fad95bf6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad900fdf20 0x7fad901137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:13.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.561+0000 7fad95bf6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad90113e60 con 0x7fad900fdf20 2024-09-19T09:31:13.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.561+0000 7fad95bf6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9010d210 con 0x7fad900fd580 2024-09-19T09:31:13.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.562+0000 7fad8effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad900fdf20 0x7fad901137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:13.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.562+0000 7fad8effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad900fdf20 0x7fad901137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38144/0 (socket says 172.21.15.112:38144) 2024-09-19T09:31:13.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.562+0000 7fad8effd640 1 -- 172.21.15.112:0/3567399623 learned_addr learned my addr 172.21.15.112:0/3567399623 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.562+0000 7fad8f7fe640 1 --2- 172.21.15.112:0/3567399623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad900fd580 0x7fad90113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.562+0000 7fad8effd640 1 -- 172.21.15.112:0/3567399623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad900fd580 msgr2=0x7fad90113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.562+0000 7fad8effd640 1 --2- 172.21.15.112:0/3567399623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad900fd580 0x7fad90113290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.562+0000 7fad8effd640 1 -- 172.21.15.112:0/3567399623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84005040 con 0x7fad900fdf20 2024-09-19T09:31:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.562+0000 7fad8effd640 1 --2- 172.21.15.112:0/3567399623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad900fdf20 0x7fad901137d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fad84003080 tx=0x7fad84009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.562+0000 7fad77fff640 1 -- 172.21.15.112:0/3567399623 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad84038070 con 0x7fad900fdf20 2024-09-19T09:31:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.562+0000 7fad77fff640 1 -- 172.21.15.112:0/3567399623 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fad840097e0 con 0x7fad900fdf20 2024-09-19T09:31:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.562+0000 7fad95bf6640 1 -- 172.21.15.112:0/3567399623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9010d490 con 0x7fad900fdf20 2024-09-19T09:31:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.562+0000 7fad77fff640 1 -- 172.21.15.112:0/3567399623 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad8403d420 con 0x7fad900fdf20 2024-09-19T09:31:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.562+0000 7fad95bf6640 1 -- 172.21.15.112:0/3567399623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9010d950 con 0x7fad900fdf20 2024-09-19T09:31:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.563+0000 7fad95bf6640 1 -- 172.21.15.112:0/3567399623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad900663b0 con 0x7fad900fdf20 2024-09-19T09:31:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.564+0000 7fad77fff640 1 -- 172.21.15.112:0/3567399623 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fad84030020 con 0x7fad900fdf20 2024-09-19T09:31:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.564+0000 7fad77fff640 1 --2- 172.21.15.112:0/3567399623 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fad7806ed60 0x7fad78071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.564+0000 7fad8f7fe640 1 --2- 172.21.15.112:0/3567399623 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fad7806ed60 0x7fad78071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.564+0000 7fad77fff640 1 -- 172.21.15.112:0/3567399623 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fad840ae2d0 con 0x7fad900fdf20 2024-09-19T09:31:13.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.565+0000 7fad8f7fe640 1 --2- 172.21.15.112:0/3567399623 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fad7806ed60 0x7fad78071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fad80009b50 tx=0x7fad80009120 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:13.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.568+0000 7fad77fff640 1 -- 172.21.15.112:0/3567399623 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fad8407b730 con 0x7fad900fdf20 2024-09-19T09:31:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.727+0000 7fad95bf6640 1 -- 172.21.15.112:0/3567399623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad90109610 con 0x7fad900fdf20 2024-09-19T09:31:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.727+0000 7fad77fff640 1 -- 172.21.15.112:0/3567399623 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad8407b0d0 con 0x7fad900fdf20 2024-09-19T09:31:13.729 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-19T09:31:13.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.729+0000 7fad95bf6640 1 -- 172.21.15.112:0/3567399623 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fad7806ed60 msgr2=0x7fad78071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:13.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.729+0000 7fad95bf6640 1 --2- 172.21.15.112:0/3567399623 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fad7806ed60 0x7fad78071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fad80009b50 tx=0x7fad80009120 comp rx=0 tx=0).stop 2024-09-19T09:31:13.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.729+0000 7fad95bf6640 1 -- 172.21.15.112:0/3567399623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad900fdf20 msgr2=0x7fad901137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:13.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.729+0000 7fad95bf6640 1 --2- 172.21.15.112:0/3567399623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad900fdf20 0x7fad901137d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fad84003080 tx=0x7fad84009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:13.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.729+0000 7fad95bf6640 1 -- 172.21.15.112:0/3567399623 shutdown_connections 2024-09-19T09:31:13.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.729+0000 7fad95bf6640 1 --2- 172.21.15.112:0/3567399623 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fad7806ed60 0x7fad78071210 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:13.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.729+0000 7fad95bf6640 1 --2- 172.21.15.112:0/3567399623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad900fdf20 0x7fad901137d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:13.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.729+0000 7fad95bf6640 1 --2- 172.21.15.112:0/3567399623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad900fd580 0x7fad90113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:13.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.729+0000 7fad95bf6640 1 -- 172.21.15.112:0/3567399623 >> 172.21.15.112:0/3567399623 conn(0x7fad900f7010 msgr2=0x7fad900f85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:13.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.730+0000 7fad95bf6640 1 -- 172.21.15.112:0/3567399623 shutdown_connections 2024-09-19T09:31:13.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:13.730+0000 7fad95bf6640 1 -- 172.21.15.112:0/3567399623 wait complete. 2024-09-19T09:31:14.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:13 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/3567399623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:31:14.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:13 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:31:14.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:13 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3567399623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:31:14.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:13 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:31:14.451 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T09:31:14.451 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T09:31:14.698 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:15.066 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:14 smithi112 ceph-mon[27605]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:15.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:14 smithi191 ceph-mon[34834]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:16.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.367+0000 7f9c5ae1d640 1 -- 172.21.15.112:0/1352514393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c540fc550 msgr2=0x7f9c540fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:16.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.367+0000 7f9c5ae1d640 1 --2- 172.21.15.112:0/1352514393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c540fc550 0x7f9c540fc960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9c480048d0 tx=0x7f9c48009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:16.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.368+0000 7f9c5ae1d640 1 -- 172.21.15.112:0/1352514393 shutdown_connections 2024-09-19T09:31:16.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.368+0000 7f9c5ae1d640 1 --2- 172.21.15.112:0/1352514393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c540fd820 0x7f9c540fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:16.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.368+0000 7f9c5ae1d640 1 --2- 172.21.15.112:0/1352514393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c540fc550 0x7f9c540fc960 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:16.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.368+0000 7f9c5ae1d640 1 -- 172.21.15.112:0/1352514393 >> 172.21.15.112:0/1352514393 conn(0x7f9c540f7d10 msgr2=0x7f9c540fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:16.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.368+0000 7f9c5ae1d640 1 -- 172.21.15.112:0/1352514393 shutdown_connections 2024-09-19T09:31:16.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.368+0000 7f9c5ae1d640 1 -- 172.21.15.112:0/1352514393 wait complete. 2024-09-19T09:31:16.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.368+0000 7f9c5ae1d640 1 Processor -- start 2024-09-19T09:31:16.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.368+0000 7f9c5ae1d640 1 -- start start 2024-09-19T09:31:16.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.368+0000 7f9c5ae1d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c540fc550 0x7f9c5410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:16.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.368+0000 7f9c5ae1d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c540fd820 0x7f9c5410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:16.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.368+0000 7f9c5ae1d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5410dc10 con 0x7f9c540fd820 2024-09-19T09:31:16.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.368+0000 7f9c5ae1d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5410e430 con 0x7f9c540fc550 2024-09-19T09:31:16.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.369+0000 7f9c53fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c540fd820 0x7f9c5410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:16.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.369+0000 7f9c53fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c540fd820 0x7f9c5410d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38160/0 (socket says 172.21.15.112:38160) 2024-09-19T09:31:16.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.369+0000 7f9c53fff640 1 -- 172.21.15.112:0/4022914641 learned_addr learned my addr 172.21.15.112:0/4022914641 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:16.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.369+0000 7f9c58bb9640 1 --2- 172.21.15.112:0/4022914641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c540fc550 0x7f9c5410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:16.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.369+0000 7f9c53fff640 1 -- 172.21.15.112:0/4022914641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c540fc550 msgr2=0x7f9c5410d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:16.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.369+0000 7f9c53fff640 1 --2- 172.21.15.112:0/4022914641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c540fc550 0x7f9c5410d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:16.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.369+0000 7f9c53fff640 1 -- 172.21.15.112:0/4022914641 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c48005040 con 0x7f9c540fd820 2024-09-19T09:31:16.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.369+0000 7f9c53fff640 1 --2- 172.21.15.112:0/4022914641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c540fd820 0x7f9c5410d5c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000c790 tx=0x7f9c400043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:16.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.369+0000 7f9c517fa640 1 -- 172.21.15.112:0/4022914641 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c4000a820 con 0x7f9c540fd820 2024-09-19T09:31:16.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.369+0000 7f9c517fa640 1 -- 172.21.15.112:0/4022914641 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9c4000ae20 con 0x7f9c540fd820 2024-09-19T09:31:16.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.369+0000 7f9c5ae1d640 1 -- 172.21.15.112:0/4022914641 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5410e6c0 con 0x7f9c540fd820 2024-09-19T09:31:16.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.369+0000 7f9c517fa640 1 -- 172.21.15.112:0/4022914641 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c400113a0 con 0x7f9c540fd820 2024-09-19T09:31:16.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.369+0000 7f9c5ae1d640 1 -- 172.21.15.112:0/4022914641 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5410ec60 con 0x7f9c540fd820 2024-09-19T09:31:16.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.370+0000 7f9c5ae1d640 1 -- 172.21.15.112:0/4022914641 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c540fb9b0 con 0x7f9c540fd820 2024-09-19T09:31:16.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.371+0000 7f9c517fa640 1 -- 172.21.15.112:0/4022914641 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9c40012400 con 0x7f9c540fd820 2024-09-19T09:31:16.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.371+0000 7f9c517fa640 1 --2- 172.21.15.112:0/4022914641 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9c4406ed60 0x7f9c44071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:16.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.371+0000 7f9c517fa640 1 -- 172.21.15.112:0/4022914641 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9c4008dfc0 con 0x7f9c540fd820 2024-09-19T09:31:16.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.371+0000 7f9c58bb9640 1 --2- 172.21.15.112:0/4022914641 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9c4406ed60 0x7f9c44071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:16.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.372+0000 7f9c58bb9640 1 --2- 172.21.15.112:0/4022914641 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9c4406ed60 0x7f9c44071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c48007ac0 tx=0x7f9c48035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:16.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.375+0000 7f9c517fa640 1 -- 172.21.15.112:0/4022914641 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9c4005b4a0 con 0x7f9c540fd820 2024-09-19T09:31:16.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.591+0000 7f9c5ae1d640 1 -- 172.21.15.112:0/4022914641 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f9c5404b720 con 0x7f9c540fd820 2024-09-19T09:31:16.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.595+0000 7f9c517fa640 1 -- 172.21.15.112:0/4022914641 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f9c4005ae40 con 0x7f9c540fd820 2024-09-19T09:31:16.597 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-19T09:31:16.597 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBk7+tm6RNVIxAA7scQUSBkm+UgqQwwWBf7wQ== 2024-09-19T09:31:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.597+0000 7f9c5ae1d640 1 -- 172.21.15.112:0/4022914641 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9c4406ed60 msgr2=0x7f9c44071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.597+0000 7f9c5ae1d640 1 --2- 172.21.15.112:0/4022914641 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9c4406ed60 0x7f9c44071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c48007ac0 tx=0x7f9c48035040 comp rx=0 tx=0).stop 2024-09-19T09:31:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.597+0000 7f9c5ae1d640 1 -- 172.21.15.112:0/4022914641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c540fd820 msgr2=0x7f9c5410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.597+0000 7f9c5ae1d640 1 --2- 172.21.15.112:0/4022914641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c540fd820 0x7f9c5410d5c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000c790 tx=0x7f9c400043c0 comp rx=0 tx=0).stop 2024-09-19T09:31:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.597+0000 7f9c5ae1d640 1 -- 172.21.15.112:0/4022914641 shutdown_connections 2024-09-19T09:31:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.597+0000 7f9c5ae1d640 1 --2- 172.21.15.112:0/4022914641 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9c4406ed60 0x7f9c44071210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.597+0000 7f9c5ae1d640 1 --2- 172.21.15.112:0/4022914641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c540fd820 0x7f9c5410d5c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.597+0000 7f9c5ae1d640 1 --2- 172.21.15.112:0/4022914641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c540fc550 0x7f9c5410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.597+0000 7f9c5ae1d640 1 -- 172.21.15.112:0/4022914641 >> 172.21.15.112:0/4022914641 conn(0x7f9c540f7d10 msgr2=0x7f9c540f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.597+0000 7f9c5ae1d640 1 -- 172.21.15.112:0/4022914641 shutdown_connections 2024-09-19T09:31:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:16.597+0000 7f9c5ae1d640 1 -- 172.21.15.112:0/4022914641 wait complete. 2024-09-19T09:31:16.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:16 smithi112 ceph-mon[27605]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:16.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:16 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/4022914641' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:31:16.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:16 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/4022914641' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:31:17.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:16 smithi191 ceph-mon[34834]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:17.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:16 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/4022914641' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:31:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:16 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/4022914641' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:31:17.377 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:31:17.378 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T09:31:17.378 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T09:31:17.413 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T09:31:17.668 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi191/config 2024-09-19T09:31:18.974 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:18 smithi191 ceph-mon[34834]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:19.185 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.184+0000 7fd49b8dd640 1 -- 172.21.15.191:0/701859682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4940fb8f0 msgr2=0x7fd4940fbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:19.185 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.184+0000 7fd49b8dd640 1 --2- 172.21.15.191:0/701859682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4940fb8f0 0x7fd4940fbd00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd4900048d0 tx=0x7fd490009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:19.185 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.184+0000 7fd49b8dd640 1 -- 172.21.15.191:0/701859682 shutdown_connections 2024-09-19T09:31:19.185 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.184+0000 7fd49b8dd640 1 --2- 172.21.15.191:0/701859682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4940fc240 0x7fd4940fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:19.186 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.184+0000 7fd49b8dd640 1 --2- 172.21.15.191:0/701859682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4940fb8f0 0x7fd4940fbd00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:19.186 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.184+0000 7fd49b8dd640 1 -- 172.21.15.191:0/701859682 >> 172.21.15.191:0/701859682 conn(0x7fd4940f63a0 msgr2=0x7fd4940f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:19.186 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.184+0000 7fd49b8dd640 1 -- 172.21.15.191:0/701859682 shutdown_connections 2024-09-19T09:31:19.186 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.184+0000 7fd49b8dd640 1 -- 172.21.15.191:0/701859682 wait complete. 2024-09-19T09:31:19.187 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.184+0000 7fd49b8dd640 1 Processor -- start 2024-09-19T09:31:19.187 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.184+0000 7fd49b8dd640 1 -- start start 2024-09-19T09:31:19.187 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd49b8dd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4940fb8f0 0x7fd494113670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:19.187 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd49b8dd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4940fc240 0x7fd494113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:19.187 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd49b8dd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd494114200 con 0x7fd4940fc240 2024-09-19T09:31:19.188 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd49b8dd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4941149b0 con 0x7fd4940fb8f0 2024-09-19T09:31:19.188 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd499679640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4940fb8f0 0x7fd494113670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:19.188 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd499679640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4940fb8f0 0x7fd494113670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:41802/0 (socket says 172.21.15.191:41802) 2024-09-19T09:31:19.188 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd499679640 1 -- 172.21.15.191:0/805922607 learned_addr learned my addr 172.21.15.191:0/805922607 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-19T09:31:19.188 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd498e78640 1 --2- 172.21.15.191:0/805922607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4940fc240 0x7fd494113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:19.188 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd499679640 1 -- 172.21.15.191:0/805922607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4940fc240 msgr2=0x7fd494113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:19.188 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd499679640 1 --2- 172.21.15.191:0/805922607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4940fc240 0x7fd494113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:19.188 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd499679640 1 -- 172.21.15.191:0/805922607 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd490005040 con 0x7fd4940fb8f0 2024-09-19T09:31:19.188 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd499679640 1 --2- 172.21.15.191:0/805922607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4940fb8f0 0x7fd494113670 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd490003080 tx=0x7fd490009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:19.188 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd489ffb640 1 -- 172.21.15.191:0/805922607 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd490038070 con 0x7fd4940fb8f0 2024-09-19T09:31:19.188 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd49b8dd640 1 -- 172.21.15.191:0/805922607 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd494114be0 con 0x7fd4940fb8f0 2024-09-19T09:31:19.188 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd489ffb640 1 -- 172.21.15.191:0/805922607 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd49002abd0 con 0x7fd4940fb8f0 2024-09-19T09:31:19.189 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.185+0000 7fd489ffb640 1 -- 172.21.15.191:0/805922607 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd49003e670 con 0x7fd4940fb8f0 2024-09-19T09:31:19.189 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.186+0000 7fd49b8dd640 1 -- 172.21.15.191:0/805922607 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd494115180 con 0x7fd4940fb8f0 2024-09-19T09:31:19.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:18 smithi112 ceph-mon[27605]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:19.190 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.187+0000 7fd49b8dd640 1 -- 172.21.15.191:0/805922607 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4940fa060 con 0x7fd4940fb8f0 2024-09-19T09:31:19.190 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.187+0000 7fd489ffb640 1 -- 172.21.15.191:0/805922607 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd490030020 con 0x7fd4940fb8f0 2024-09-19T09:31:19.190 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.187+0000 7fd489ffb640 1 --2- 172.21.15.191:0/805922607 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd48006ed60 0x7fd480071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:19.190 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.188+0000 7fd489ffb640 1 -- 172.21.15.191:0/805922607 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd4900ae250 con 0x7fd4940fb8f0 2024-09-19T09:31:19.190 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.188+0000 7fd498e78640 1 --2- 172.21.15.191:0/805922607 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd48006ed60 0x7fd480071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:19.190 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.188+0000 7fd498e78640 1 --2- 172.21.15.191:0/805922607 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd48006ed60 0x7fd480071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd494113420 tx=0x7fd484009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:19.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.192+0000 7fd489ffb640 1 -- 172.21.15.191:0/805922607 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd49007b6b0 con 0x7fd4940fb8f0 2024-09-19T09:31:19.404 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.403+0000 7fd49b8dd640 1 -- 172.21.15.191:0/805922607 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fd49404b720 con 0x7fd4940fb8f0 2024-09-19T09:31:19.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.408+0000 7fd489ffb640 1 -- 172.21.15.191:0/805922607 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fd49007b050 con 0x7fd4940fb8f0 2024-09-19T09:31:19.410 INFO:teuthology.orchestra.run.smithi191.stdout:[client.1] 2024-09-19T09:31:19.410 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBn7+tmG1AnGBAA730fzUBUKCM909avVocu7A== 2024-09-19T09:31:19.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.410+0000 7fd49b8dd640 1 -- 172.21.15.191:0/805922607 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd48006ed60 msgr2=0x7fd480071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:19.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.410+0000 7fd49b8dd640 1 --2- 172.21.15.191:0/805922607 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd48006ed60 0x7fd480071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd494113420 tx=0x7fd484009040 comp rx=0 tx=0).stop 2024-09-19T09:31:19.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.410+0000 7fd49b8dd640 1 -- 172.21.15.191:0/805922607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4940fb8f0 msgr2=0x7fd494113670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:19.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.410+0000 7fd49b8dd640 1 --2- 172.21.15.191:0/805922607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4940fb8f0 0x7fd494113670 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd490003080 tx=0x7fd490009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:19.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.410+0000 7fd49b8dd640 1 -- 172.21.15.191:0/805922607 shutdown_connections 2024-09-19T09:31:19.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.410+0000 7fd49b8dd640 1 --2- 172.21.15.191:0/805922607 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd48006ed60 0x7fd480071210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:19.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.410+0000 7fd49b8dd640 1 --2- 172.21.15.191:0/805922607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4940fc240 0x7fd494113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:19.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.410+0000 7fd49b8dd640 1 --2- 172.21.15.191:0/805922607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4940fb8f0 0x7fd494113670 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:19.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.410+0000 7fd49b8dd640 1 -- 172.21.15.191:0/805922607 >> 172.21.15.191:0/805922607 conn(0x7fd4940f63a0 msgr2=0x7fd4940f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:19.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.410+0000 7fd49b8dd640 1 -- 172.21.15.191:0/805922607 shutdown_connections 2024-09-19T09:31:19.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:31:19.410+0000 7fd49b8dd640 1 -- 172.21.15.191:0/805922607 wait complete. 2024-09-19T09:31:20.002 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:31:20.002 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-19T09:31:20.003 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-19T09:31:20.039 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T09:31:20.039 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T09:31:20.039 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T09:31:20.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:19 smithi112 ceph-mon[27605]: from='client.? 172.21.15.191:0/805922607' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:31:20.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:19 smithi112 ceph-mon[27605]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:31:20.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:19 smithi112 ceph-mon[27605]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:31:20.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:19 smithi191 ceph-mon[34834]: from='client.? 172.21.15.191:0/805922607' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:31:20.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:19 smithi191 ceph-mon[34834]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:31:20.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:19 smithi191 ceph-mon[34834]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:31:20.295 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:21.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:21 smithi112 ceph-mon[27605]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:21.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:21 smithi191 ceph-mon[34834]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:22.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.038+0000 7fc0724d2640 1 -- 172.21.15.112:0/2927577109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc06c0fbd30 msgr2=0x7fc06c100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:22.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.038+0000 7fc0724d2640 1 --2- 172.21.15.112:0/2927577109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc06c0fbd30 0x7fc06c100350 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc0540048d0 tx=0x7fc054009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:22.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.038+0000 7fc0724d2640 1 -- 172.21.15.112:0/2927577109 shutdown_connections 2024-09-19T09:31:22.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.038+0000 7fc0724d2640 1 --2- 172.21.15.112:0/2927577109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc06c0fbd30 0x7fc06c100350 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:22.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.038+0000 7fc0724d2640 1 --2- 172.21.15.112:0/2927577109 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc06c0fb390 0x7fc06c0fb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:22.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.038+0000 7fc0724d2640 1 -- 172.21.15.112:0/2927577109 >> 172.21.15.112:0/2927577109 conn(0x7fc06c0f7030 msgr2=0x7fc06c0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:22.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.038+0000 7fc0724d2640 1 -- 172.21.15.112:0/2927577109 shutdown_connections 2024-09-19T09:31:22.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.038+0000 7fc0724d2640 1 -- 172.21.15.112:0/2927577109 wait complete. 2024-09-19T09:31:22.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.039+0000 7fc0724d2640 1 Processor -- start 2024-09-19T09:31:22.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.039+0000 7fc0724d2640 1 -- start start 2024-09-19T09:31:22.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.039+0000 7fc0724d2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc06c0fb390 0x7fc06c119810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:22.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.039+0000 7fc0724d2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc06c0fbd30 0x7fc06c119d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:22.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.039+0000 7fc0724d2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c11a3a0 con 0x7fc06c0fbd30 2024-09-19T09:31:22.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.039+0000 7fc0724d2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c113800 con 0x7fc06c0fb390 2024-09-19T09:31:22.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.039+0000 7fc063fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc06c0fbd30 0x7fc06c119d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:22.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.039+0000 7fc063fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc06c0fbd30 0x7fc06c119d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38046/0 (socket says 172.21.15.112:38046) 2024-09-19T09:31:22.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.039+0000 7fc063fff640 1 -- 172.21.15.112:0/1303659500 learned_addr learned my addr 172.21.15.112:0/1303659500 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:22.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.039+0000 7fc06bfff640 1 --2- 172.21.15.112:0/1303659500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc06c0fb390 0x7fc06c119810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:22.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.039+0000 7fc063fff640 1 -- 172.21.15.112:0/1303659500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc06c0fb390 msgr2=0x7fc06c119810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:22.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.039+0000 7fc063fff640 1 --2- 172.21.15.112:0/1303659500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc06c0fb390 0x7fc06c119810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:22.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.039+0000 7fc063fff640 1 -- 172.21.15.112:0/1303659500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc054005040 con 0x7fc06c0fbd30 2024-09-19T09:31:22.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.040+0000 7fc063fff640 1 --2- 172.21.15.112:0/1303659500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc06c0fbd30 0x7fc06c119d50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc054000c00 tx=0x7fc054009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:22.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.040+0000 7fc0697fa640 1 -- 172.21.15.112:0/1303659500 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc054038070 con 0x7fc06c0fbd30 2024-09-19T09:31:22.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.040+0000 7fc0697fa640 1 -- 172.21.15.112:0/1303659500 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc05402ade0 con 0x7fc06c0fbd30 2024-09-19T09:31:22.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.040+0000 7fc0697fa640 1 -- 172.21.15.112:0/1303659500 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc05402c7e0 con 0x7fc06c0fbd30 2024-09-19T09:31:22.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.040+0000 7fc0724d2640 1 -- 172.21.15.112:0/1303659500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06c113a80 con 0x7fc06c0fbd30 2024-09-19T09:31:22.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.040+0000 7fc0724d2640 1 -- 172.21.15.112:0/1303659500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06c113f40 con 0x7fc06c0fbd30 2024-09-19T09:31:22.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.041+0000 7fc0724d2640 1 -- 172.21.15.112:0/1303659500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06c066370 con 0x7fc06c0fbd30 2024-09-19T09:31:22.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.041+0000 7fc0697fa640 1 -- 172.21.15.112:0/1303659500 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc054030020 con 0x7fc06c0fbd30 2024-09-19T09:31:22.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.042+0000 7fc0697fa640 1 --2- 172.21.15.112:0/1303659500 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc05806ed60 0x7fc058071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:22.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.042+0000 7fc0697fa640 1 -- 172.21.15.112:0/1303659500 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc0540ad9b0 con 0x7fc06c0fbd30 2024-09-19T09:31:22.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.042+0000 7fc06bfff640 1 --2- 172.21.15.112:0/1303659500 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc05806ed60 0x7fc058071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:22.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.042+0000 7fc06bfff640 1 --2- 172.21.15.112:0/1303659500 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc05806ed60 0x7fc058071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009fd0 tx=0x7fc05c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:22.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.046+0000 7fc0697fa640 1 -- 172.21.15.112:0/1303659500 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc05407af40 con 0x7fc06c0fbd30 2024-09-19T09:31:22.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.242+0000 7fc0724d2640 1 -- 172.21.15.112:0/1303659500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc06c0fac70 con 0x7fc06c0fbd30 2024-09-19T09:31:22.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.245+0000 7fc0697fa640 1 -- 172.21.15.112:0/1303659500 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+176722 (secure 0 0 0) 0x7fc05407a8e0 con 0x7fc06c0fbd30 2024-09-19T09:31:22.250 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:31:22.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.248+0000 7fc0724d2640 1 -- 172.21.15.112:0/1303659500 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc05806ed60 msgr2=0x7fc058071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.248+0000 7fc0724d2640 1 --2- 172.21.15.112:0/1303659500 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc05806ed60 0x7fc058071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009fd0 tx=0x7fc05c00b040 comp rx=0 tx=0).stop 2024-09-19T09:31:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.248+0000 7fc0724d2640 1 -- 172.21.15.112:0/1303659500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc06c0fbd30 msgr2=0x7fc06c119d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.248+0000 7fc0724d2640 1 --2- 172.21.15.112:0/1303659500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc06c0fbd30 0x7fc06c119d50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc054000c00 tx=0x7fc054009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.248+0000 7fc0724d2640 1 -- 172.21.15.112:0/1303659500 shutdown_connections 2024-09-19T09:31:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.248+0000 7fc0724d2640 1 --2- 172.21.15.112:0/1303659500 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc05806ed60 0x7fc058071210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.248+0000 7fc0724d2640 1 --2- 172.21.15.112:0/1303659500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc06c0fbd30 0x7fc06c119d50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.248+0000 7fc0724d2640 1 --2- 172.21.15.112:0/1303659500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc06c0fb390 0x7fc06c119810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.248+0000 7fc0724d2640 1 -- 172.21.15.112:0/1303659500 >> 172.21.15.112:0/1303659500 conn(0x7fc06c0f7030 msgr2=0x7fc06c0f8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.248+0000 7fc0724d2640 1 -- 172.21.15.112:0/1303659500 shutdown_connections 2024-09-19T09:31:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:22.248+0000 7fc0724d2640 1 -- 172.21.15.112:0/1303659500 wait complete. 2024-09-19T09:31:22.550 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:22 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1303659500' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:31:22.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:22 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/1303659500' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:31:23.010 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":19,"flags":0,"active_gid":14206,"active_name":"smithi112.puhuua","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3495376281},{"type":"v1","addr":"172.21.15.112:6801","nonce":3495376281}]},"active_addr":"172.21.15.112:6801/3495376281","active_change":"2024-09-19T09:27:43.717650+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14224,"name":"smithi191.xjpplx","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.112:8443/","prometheus":"http://172.21.15.112:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":2880667232}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3962529596}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3517126379}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3555278869}]}]} 2024-09-19T09:31:23.017 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T09:31:23.017 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T09:31:23.017 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:31:23.261 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:23.645 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:23 smithi112 ceph-mon[27605]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:23.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:23 smithi191 ceph-mon[34834]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:24.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.961+0000 7f7c4667c640 1 -- 172.21.15.112:0/1451232495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c40102ed0 msgr2=0x7f7c400fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:24.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.961+0000 7f7c4667c640 1 --2- 172.21.15.112:0/1451232495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c40102ed0 0x7f7c400fc590 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7c340048d0 tx=0x7f7c34009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:24.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.961+0000 7f7c4667c640 1 -- 172.21.15.112:0/1451232495 shutdown_connections 2024-09-19T09:31:24.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.961+0000 7f7c4667c640 1 --2- 172.21.15.112:0/1451232495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c40102ed0 0x7f7c400fc590 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:24.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.961+0000 7f7c4667c640 1 --2- 172.21.15.112:0/1451232495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c40102530 0x7f7c40102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:24.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.961+0000 7f7c4667c640 1 -- 172.21.15.112:0/1451232495 >> 172.21.15.112:0/1451232495 conn(0x7f7c400f8110 msgr2=0x7f7c400fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:24.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.961+0000 7f7c4667c640 1 -- 172.21.15.112:0/1451232495 shutdown_connections 2024-09-19T09:31:24.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.961+0000 7f7c4667c640 1 -- 172.21.15.112:0/1451232495 wait complete. 2024-09-19T09:31:24.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.962+0000 7f7c4667c640 1 Processor -- start 2024-09-19T09:31:24.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.962+0000 7f7c4667c640 1 -- start start 2024-09-19T09:31:24.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.962+0000 7f7c4667c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c40102530 0x7f7c40113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:24.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.962+0000 7f7c4667c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c40102ed0 0x7f7c40113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:24.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.962+0000 7f7c4667c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c40113d50 con 0x7f7c40102ed0 2024-09-19T09:31:24.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.962+0000 7f7c4667c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4010d190 con 0x7f7c40102530 2024-09-19T09:31:24.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.962+0000 7f7c3f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c40102ed0 0x7f7c40113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:24.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.962+0000 7f7c3f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c40102ed0 0x7f7c40113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38070/0 (socket says 172.21.15.112:38070) 2024-09-19T09:31:24.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.962+0000 7f7c3f7fe640 1 -- 172.21.15.112:0/3166569918 learned_addr learned my addr 172.21.15.112:0/3166569918 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:24.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.962+0000 7f7c3ffff640 1 --2- 172.21.15.112:0/3166569918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c40102530 0x7f7c40113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:24.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.962+0000 7f7c3f7fe640 1 -- 172.21.15.112:0/3166569918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c40102530 msgr2=0x7f7c40113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:24.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.962+0000 7f7c3f7fe640 1 --2- 172.21.15.112:0/3166569918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c40102530 0x7f7c40113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:24.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.962+0000 7f7c3f7fe640 1 -- 172.21.15.112:0/3166569918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c34005040 con 0x7f7c40102ed0 2024-09-19T09:31:24.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.963+0000 7f7c3f7fe640 1 --2- 172.21.15.112:0/3166569918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c40102ed0 0x7f7c40113750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7c340043d0 tx=0x7f7c34009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:24.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.963+0000 7f7c3cff9640 1 -- 172.21.15.112:0/3166569918 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c34038070 con 0x7f7c40102ed0 2024-09-19T09:31:24.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.963+0000 7f7c3cff9640 1 -- 172.21.15.112:0/3166569918 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7c340096e0 con 0x7f7c40102ed0 2024-09-19T09:31:24.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.963+0000 7f7c4667c640 1 -- 172.21.15.112:0/3166569918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4010d410 con 0x7f7c40102ed0 2024-09-19T09:31:24.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.963+0000 7f7c3cff9640 1 -- 172.21.15.112:0/3166569918 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c3402c8a0 con 0x7f7c40102ed0 2024-09-19T09:31:24.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.963+0000 7f7c4667c640 1 -- 172.21.15.112:0/3166569918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4010d950 con 0x7f7c40102ed0 2024-09-19T09:31:24.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.964+0000 7f7c4667c640 1 -- 172.21.15.112:0/3166569918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c400fdcb0 con 0x7f7c40102ed0 2024-09-19T09:31:24.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.964+0000 7f7c3cff9640 1 -- 172.21.15.112:0/3166569918 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f7c34030020 con 0x7f7c40102ed0 2024-09-19T09:31:24.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.965+0000 7f7c3cff9640 1 --2- 172.21.15.112:0/3166569918 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f7c2806ed60 0x7f7c28071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:24.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.965+0000 7f7c3ffff640 1 --2- 172.21.15.112:0/3166569918 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f7c2806ed60 0x7f7c28071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:24.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.965+0000 7f7c3cff9640 1 -- 172.21.15.112:0/3166569918 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7c340adab0 con 0x7f7c40102ed0 2024-09-19T09:31:24.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.965+0000 7f7c3ffff640 1 --2- 172.21.15.112:0/3166569918 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f7c2806ed60 0x7f7c28071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c30004ed0 tx=0x7f7c3000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:24.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:24.969+0000 7f7c3cff9640 1 -- 172.21.15.112:0/3166569918 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7c3407b040 con 0x7f7c40102ed0 2024-09-19T09:31:25.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:25.124+0000 7f7c4667c640 1 -- 172.21.15.112:0/3166569918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c40109560 con 0x7f7c40102ed0 2024-09-19T09:31:25.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:25.124+0000 7f7c3cff9640 1 -- 172.21.15.112:0/3166569918 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11134 (secure 0 0 0) 0x7f7c3407a9e0 con 0x7f7c40102ed0 2024-09-19T09:31:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:31:25.126 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":39,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:25:42.323502+0000","modified":"2024-09-19T09:31:08.502857+0000","last_up_change":"2024-09-19T09:31:07.497508+0000","last_in_change":"2024-09-19T09:30:49.460305+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:29:56.033927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"8ce98763-b438-4d5d-9907-e2652cd154ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1562881068},{"type":"v1","addr":"172.21.15.112:6803","nonce":1562881068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1562881068},{"type":"v1","addr":"172.21.15.112:6805","nonce":1562881068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1562881068},{"type":"v1","addr":"172.21.15.112:6809","nonce":1562881068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1562881068},{"type":"v1","addr":"172.21.15.112:6807","nonce":1562881068}]},"public_addr":"172.21.15.112:6803/1562881068","cluster_addr":"172.21.15.112:6805/1562881068","heartbeat_back_addr":"172.21.15.112:6809/1562881068","heartbeat_front_addr":"172.21.15.112:6807/1562881068","state":["exists","up"]},{"osd":1,"uuid":"21b187e2-98e3-4f5b-a784-a24b848c75f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3124914300},{"type":"v1","addr":"172.21.15.112:6811","nonce":3124914300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3124914300},{"type":"v1","addr":"172.21.15.112:6813","nonce":3124914300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3124914300},{"type":"v1","addr":"172.21.15.112:6817","nonce":3124914300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3124914300},{"type":"v1","addr":"172.21.15.112:6815","nonce":3124914300}]},"public_addr":"172.21.15.112:6811/3124914300","cluster_addr":"172.21.15.112:6813/3124914300","heartbeat_back_addr":"172.21.15.112:6817/3124914300","heartbeat_front_addr":"172.21.15.112:6815/3124914300","state":["exists","up"]},{"osd":2,"uuid":"bf806972-fe72-4319-bac0-e302402ebfa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":2593689264},{"type":"v1","addr":"172.21.15.112:6819","nonce":2593689264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":2593689264},{"type":"v1","addr":"172.21.15.112:6821","nonce":2593689264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2593689264},{"type":"v1","addr":"172.21.15.112:6825","nonce":2593689264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":2593689264},{"type":"v1","addr":"172.21.15.112:6823","nonce":2593689264}]},"public_addr":"172.21.15.112:6819/2593689264","cluster_addr":"172.21.15.112:6821/2593689264","heartbeat_back_addr":"172.21.15.112:6825/2593689264","heartbeat_front_addr":"172.21.15.112:6823/2593689264","state":["exists","up"]},{"osd":3,"uuid":"f5a4869d-0060-48a9-aa67-da01703fa6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2835674394},{"type":"v1","addr":"172.21.15.191:6801","nonce":2835674394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2835674394},{"type":"v1","addr":"172.21.15.191:6803","nonce":2835674394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2835674394},{"type":"v1","addr":"172.21.15.191:6807","nonce":2835674394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2835674394},{"type":"v1","addr":"172.21.15.191:6805","nonce":2835674394}]},"public_addr":"172.21.15.191:6801/2835674394","cluster_addr":"172.21.15.191:6803/2835674394","heartbeat_back_addr":"172.21.15.191:6807/2835674394","heartbeat_front_addr":"172.21.15.191:6805/2835674394","state":["exists","up"]},{"osd":4,"uuid":"942246d0-c3f9-4581-93c1-dc7b4345af73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":101220282},{"type":"v1","addr":"172.21.15.191:6809","nonce":101220282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":101220282},{"type":"v1","addr":"172.21.15.191:6811","nonce":101220282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":101220282},{"type":"v1","addr":"172.21.15.191:6815","nonce":101220282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":101220282},{"type":"v1","addr":"172.21.15.191:6813","nonce":101220282}]},"public_addr":"172.21.15.191:6809/101220282","cluster_addr":"172.21.15.191:6811/101220282","heartbeat_back_addr":"172.21.15.191:6815/101220282","heartbeat_front_addr":"172.21.15.191:6813/101220282","state":["exists","up"]},{"osd":5,"uuid":"33796cd8-002f-4f26-b7a3-0d126f6bcb01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":2561099737},{"type":"v1","addr":"172.21.15.191:6817","nonce":2561099737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":2561099737},{"type":"v1","addr":"172.21.15.191:6819","nonce":2561099737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":2561099737},{"type":"v1","addr":"172.21.15.191:6823","nonce":2561099737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":2561099737},{"type":"v1","addr":"172.21.15.191:6821","nonce":2561099737}]},"public_addr":"172.21.15.191:6817/2561099737","cluster_addr":"172.21.15.191:6819/2561099737","heartbeat_back_addr":"172.21.15.191:6823/2561099737","heartbeat_front_addr":"172.21.15.191:6821/2561099737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:28:55.105239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:29:24.029349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:29:52.656220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:15.723724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:41.148318+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:06.270050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:0/2752965886":"2024-09-20T09:27:43.717543+0000","172.21.15.112:0/2459323098":"2024-09-20T09:26:10.763366+0000","172.21.15.112:0/1621418219":"2024-09-20T09:27:43.717543+0000","172.21.15.112:0/2839937816":"2024-09-20T09:26:40.441468+0000","172.21.15.112:6801/2336666418":"2024-09-20T09:26:10.763366+0000","172.21.15.112:0/3318399440":"2024-09-20T09:26:10.763366+0000","172.21.15.112:0/616967539":"2024-09-20T09:26:40.441468+0000","172.21.15.112:0/1234573048":"2024-09-20T09:26:10.763366+0000","172.21.15.112:0/1633167540":"2024-09-20T09:26:40.441468+0000","172.21.15.112:6800/2336666418":"2024-09-20T09:26:10.763366+0000","172.21.15.112:6800/1627571174":"2024-09-20T09:26:40.441468+0000","172.21.15.112:6801/1627571174":"2024-09-20T09:26:40.441468+0000","172.21.15.112:6800/3210372910":"2024-09-20T09:27:43.717543+0000","172.21.15.112:6801/3210372910":"2024-09-20T09:27:43.717543+0000","172.21.15.112:0/852695113":"2024-09-20T09:27:43.717543+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:31:25.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:25.126+0000 7f7c4667c640 1 -- 172.21.15.112:0/3166569918 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f7c2806ed60 msgr2=0x7f7c28071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:25.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:25.126+0000 7f7c4667c640 1 --2- 172.21.15.112:0/3166569918 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f7c2806ed60 0x7f7c28071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c30004ed0 tx=0x7f7c3000b040 comp rx=0 tx=0).stop 2024-09-19T09:31:25.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:25.126+0000 7f7c4667c640 1 -- 172.21.15.112:0/3166569918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c40102ed0 msgr2=0x7f7c40113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:25.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:25.126+0000 7f7c4667c640 1 --2- 172.21.15.112:0/3166569918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c40102ed0 0x7f7c40113750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7c340043d0 tx=0x7f7c34009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:25.127+0000 7f7c4667c640 1 -- 172.21.15.112:0/3166569918 shutdown_connections 2024-09-19T09:31:25.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:25.127+0000 7f7c4667c640 1 --2- 172.21.15.112:0/3166569918 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f7c2806ed60 0x7f7c28071210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:25.127+0000 7f7c4667c640 1 --2- 172.21.15.112:0/3166569918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c40102ed0 0x7f7c40113750 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:25.127+0000 7f7c4667c640 1 --2- 172.21.15.112:0/3166569918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c40102530 0x7f7c40113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:25.127+0000 7f7c4667c640 1 -- 172.21.15.112:0/3166569918 >> 172.21.15.112:0/3166569918 conn(0x7f7c400f8110 msgr2=0x7f7c400f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:25.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:25.127+0000 7f7c4667c640 1 -- 172.21.15.112:0/3166569918 shutdown_connections 2024-09-19T09:31:25.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:25.127+0000 7f7c4667c640 1 -- 172.21.15.112:0/3166569918 wait complete. 2024-09-19T09:31:25.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:25 smithi112 ceph-mon[27605]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:25.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:25 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3166569918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:31:25.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:25 smithi191 ceph-mon[34834]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:25.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:25 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/3166569918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:31:25.908 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T09:31:25.908 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:31:26.149 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:27.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:27 smithi112 ceph-mon[27605]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:27.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:27 smithi191 ceph-mon[34834]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:27.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.801+0000 7f5ecbf0d640 1 -- 172.21.15.112:0/256718329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec40703c0 msgr2=0x7f5ec4108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:27.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.801+0000 7f5ecbf0d640 1 --2- 172.21.15.112:0/256718329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec40703c0 0x7f5ec4108870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80048d0 tx=0x7f5eb8009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:27.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.801+0000 7f5ecbf0d640 1 -- 172.21.15.112:0/256718329 shutdown_connections 2024-09-19T09:31:27.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.801+0000 7f5ecbf0d640 1 --2- 172.21.15.112:0/256718329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec40703c0 0x7f5ec4108870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:27.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.801+0000 7f5ecbf0d640 1 --2- 172.21.15.112:0/256718329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ec406fab0 0x7f5ec406fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:27.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.801+0000 7f5ecbf0d640 1 -- 172.21.15.112:0/256718329 >> 172.21.15.112:0/256718329 conn(0x7f5ec40f80f0 msgr2=0x7f5ec40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:27.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.802+0000 7f5ecbf0d640 1 -- 172.21.15.112:0/256718329 shutdown_connections 2024-09-19T09:31:27.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.802+0000 7f5ecbf0d640 1 -- 172.21.15.112:0/256718329 wait complete. 2024-09-19T09:31:27.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.802+0000 7f5ecbf0d640 1 Processor -- start 2024-09-19T09:31:27.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.802+0000 7f5ecbf0d640 1 -- start start 2024-09-19T09:31:27.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.802+0000 7f5ecbf0d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec406fab0 0x7f5ec4115420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:27.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.802+0000 7f5ecbf0d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ec40703c0 0x7f5ec4115960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:27.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.802+0000 7f5ecbf0d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec4115f60 con 0x7f5ec406fab0 2024-09-19T09:31:27.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.802+0000 7f5ecbf0d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec41160d0 con 0x7f5ec40703c0 2024-09-19T09:31:27.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.802+0000 7f5ec9ca9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec406fab0 0x7f5ec4115420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:27.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.802+0000 7f5ec9ca9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec406fab0 0x7f5ec4115420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38092/0 (socket says 172.21.15.112:38092) 2024-09-19T09:31:27.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.802+0000 7f5ec9ca9640 1 -- 172.21.15.112:0/2402907582 learned_addr learned my addr 172.21.15.112:0/2402907582 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:27.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.803+0000 7f5ec94a8640 1 --2- 172.21.15.112:0/2402907582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ec40703c0 0x7f5ec4115960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:27.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.803+0000 7f5ec9ca9640 1 -- 172.21.15.112:0/2402907582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ec40703c0 msgr2=0x7f5ec4115960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:27.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.803+0000 7f5ec9ca9640 1 --2- 172.21.15.112:0/2402907582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ec40703c0 0x7f5ec4115960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:27.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.803+0000 7f5ec9ca9640 1 -- 172.21.15.112:0/2402907582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb8005040 con 0x7f5ec406fab0 2024-09-19T09:31:27.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.803+0000 7f5ec94a8640 1 --2- 172.21.15.112:0/2402907582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ec40703c0 0x7f5ec4115960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:27.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.803+0000 7f5ec9ca9640 1 --2- 172.21.15.112:0/2402907582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec406fab0 0x7f5ec4115420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400cb10 tx=0x7f5eb4007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:27.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.803+0000 7f5ec27fc640 1 -- 172.21.15.112:0/2402907582 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eb4004200 con 0x7f5ec406fab0 2024-09-19T09:31:27.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.803+0000 7f5ec27fc640 1 -- 172.21.15.112:0/2402907582 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5eb400acc0 con 0x7f5ec406fab0 2024-09-19T09:31:27.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.803+0000 7f5ecbf0d640 1 -- 172.21.15.112:0/2402907582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec410f550 con 0x7f5ec406fab0 2024-09-19T09:31:27.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.803+0000 7f5ec27fc640 1 -- 172.21.15.112:0/2402907582 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eb4003cd0 con 0x7f5ec406fab0 2024-09-19T09:31:27.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.803+0000 7f5ecbf0d640 1 -- 172.21.15.112:0/2402907582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec410fa70 con 0x7f5ec406fab0 2024-09-19T09:31:27.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.804+0000 7f5ecbf0d640 1 -- 172.21.15.112:0/2402907582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec40711f0 con 0x7f5ec406fab0 2024-09-19T09:31:27.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.804+0000 7f5ec27fc640 1 -- 172.21.15.112:0/2402907582 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f5eb400a820 con 0x7f5ec406fab0 2024-09-19T09:31:27.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.805+0000 7f5ec27fc640 1 --2- 172.21.15.112:0/2402907582 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f5eac06ed60 0x7f5eac071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:27.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.805+0000 7f5ec27fc640 1 -- 172.21.15.112:0/2402907582 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5eb408e4d0 con 0x7f5ec406fab0 2024-09-19T09:31:27.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.805+0000 7f5ec94a8640 1 --2- 172.21.15.112:0/2402907582 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f5eac06ed60 0x7f5eac071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:27.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.805+0000 7f5ec94a8640 1 --2- 172.21.15.112:0/2402907582 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f5eac06ed60 0x7f5eac071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800b020 tx=0x7f5eb8009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:27.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.809+0000 7f5ec27fc640 1 -- 172.21.15.112:0/2402907582 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5eb405b9b0 con 0x7f5ec406fab0 2024-09-19T09:31:27.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.965+0000 7f5ecbf0d640 1 -- 172.21.15.112:0/2402907582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ec40fbd30 con 0x7f5ec406fab0 2024-09-19T09:31:27.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.966+0000 7f5ec27fc640 1 -- 172.21.15.112:0/2402907582 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11134 (secure 0 0 0) 0x7f5eb405b350 con 0x7f5ec406fab0 2024-09-19T09:31:27.968 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:31:27.968 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":39,"fsid":"0bd98d30-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:25:42.323502+0000","modified":"2024-09-19T09:31:08.502857+0000","last_up_change":"2024-09-19T09:31:07.497508+0000","last_in_change":"2024-09-19T09:30:49.460305+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:29:56.033927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"8ce98763-b438-4d5d-9907-e2652cd154ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1562881068},{"type":"v1","addr":"172.21.15.112:6803","nonce":1562881068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1562881068},{"type":"v1","addr":"172.21.15.112:6805","nonce":1562881068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1562881068},{"type":"v1","addr":"172.21.15.112:6809","nonce":1562881068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1562881068},{"type":"v1","addr":"172.21.15.112:6807","nonce":1562881068}]},"public_addr":"172.21.15.112:6803/1562881068","cluster_addr":"172.21.15.112:6805/1562881068","heartbeat_back_addr":"172.21.15.112:6809/1562881068","heartbeat_front_addr":"172.21.15.112:6807/1562881068","state":["exists","up"]},{"osd":1,"uuid":"21b187e2-98e3-4f5b-a784-a24b848c75f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3124914300},{"type":"v1","addr":"172.21.15.112:6811","nonce":3124914300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3124914300},{"type":"v1","addr":"172.21.15.112:6813","nonce":3124914300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3124914300},{"type":"v1","addr":"172.21.15.112:6817","nonce":3124914300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3124914300},{"type":"v1","addr":"172.21.15.112:6815","nonce":3124914300}]},"public_addr":"172.21.15.112:6811/3124914300","cluster_addr":"172.21.15.112:6813/3124914300","heartbeat_back_addr":"172.21.15.112:6817/3124914300","heartbeat_front_addr":"172.21.15.112:6815/3124914300","state":["exists","up"]},{"osd":2,"uuid":"bf806972-fe72-4319-bac0-e302402ebfa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":2593689264},{"type":"v1","addr":"172.21.15.112:6819","nonce":2593689264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":2593689264},{"type":"v1","addr":"172.21.15.112:6821","nonce":2593689264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2593689264},{"type":"v1","addr":"172.21.15.112:6825","nonce":2593689264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":2593689264},{"type":"v1","addr":"172.21.15.112:6823","nonce":2593689264}]},"public_addr":"172.21.15.112:6819/2593689264","cluster_addr":"172.21.15.112:6821/2593689264","heartbeat_back_addr":"172.21.15.112:6825/2593689264","heartbeat_front_addr":"172.21.15.112:6823/2593689264","state":["exists","up"]},{"osd":3,"uuid":"f5a4869d-0060-48a9-aa67-da01703fa6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2835674394},{"type":"v1","addr":"172.21.15.191:6801","nonce":2835674394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2835674394},{"type":"v1","addr":"172.21.15.191:6803","nonce":2835674394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2835674394},{"type":"v1","addr":"172.21.15.191:6807","nonce":2835674394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2835674394},{"type":"v1","addr":"172.21.15.191:6805","nonce":2835674394}]},"public_addr":"172.21.15.191:6801/2835674394","cluster_addr":"172.21.15.191:6803/2835674394","heartbeat_back_addr":"172.21.15.191:6807/2835674394","heartbeat_front_addr":"172.21.15.191:6805/2835674394","state":["exists","up"]},{"osd":4,"uuid":"942246d0-c3f9-4581-93c1-dc7b4345af73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":101220282},{"type":"v1","addr":"172.21.15.191:6809","nonce":101220282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":101220282},{"type":"v1","addr":"172.21.15.191:6811","nonce":101220282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":101220282},{"type":"v1","addr":"172.21.15.191:6815","nonce":101220282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":101220282},{"type":"v1","addr":"172.21.15.191:6813","nonce":101220282}]},"public_addr":"172.21.15.191:6809/101220282","cluster_addr":"172.21.15.191:6811/101220282","heartbeat_back_addr":"172.21.15.191:6815/101220282","heartbeat_front_addr":"172.21.15.191:6813/101220282","state":["exists","up"]},{"osd":5,"uuid":"33796cd8-002f-4f26-b7a3-0d126f6bcb01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":2561099737},{"type":"v1","addr":"172.21.15.191:6817","nonce":2561099737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":2561099737},{"type":"v1","addr":"172.21.15.191:6819","nonce":2561099737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":2561099737},{"type":"v1","addr":"172.21.15.191:6823","nonce":2561099737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":2561099737},{"type":"v1","addr":"172.21.15.191:6821","nonce":2561099737}]},"public_addr":"172.21.15.191:6817/2561099737","cluster_addr":"172.21.15.191:6819/2561099737","heartbeat_back_addr":"172.21.15.191:6823/2561099737","heartbeat_front_addr":"172.21.15.191:6821/2561099737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:28:55.105239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:29:24.029349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:29:52.656220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:15.723724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:41.148318+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:06.270050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:0/2752965886":"2024-09-20T09:27:43.717543+0000","172.21.15.112:0/2459323098":"2024-09-20T09:26:10.763366+0000","172.21.15.112:0/1621418219":"2024-09-20T09:27:43.717543+0000","172.21.15.112:0/2839937816":"2024-09-20T09:26:40.441468+0000","172.21.15.112:6801/2336666418":"2024-09-20T09:26:10.763366+0000","172.21.15.112:0/3318399440":"2024-09-20T09:26:10.763366+0000","172.21.15.112:0/616967539":"2024-09-20T09:26:40.441468+0000","172.21.15.112:0/1234573048":"2024-09-20T09:26:10.763366+0000","172.21.15.112:0/1633167540":"2024-09-20T09:26:40.441468+0000","172.21.15.112:6800/2336666418":"2024-09-20T09:26:10.763366+0000","172.21.15.112:6800/1627571174":"2024-09-20T09:26:40.441468+0000","172.21.15.112:6801/1627571174":"2024-09-20T09:26:40.441468+0000","172.21.15.112:6800/3210372910":"2024-09-20T09:27:43.717543+0000","172.21.15.112:6801/3210372910":"2024-09-20T09:27:43.717543+0000","172.21.15.112:0/852695113":"2024-09-20T09:27:43.717543+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:31:27.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.968+0000 7f5ecbf0d640 1 -- 172.21.15.112:0/2402907582 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f5eac06ed60 msgr2=0x7f5eac071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:27.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.968+0000 7f5ecbf0d640 1 --2- 172.21.15.112:0/2402907582 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f5eac06ed60 0x7f5eac071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800b020 tx=0x7f5eb8009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:27.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.968+0000 7f5ecbf0d640 1 -- 172.21.15.112:0/2402907582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec406fab0 msgr2=0x7f5ec4115420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:27.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.968+0000 7f5ecbf0d640 1 --2- 172.21.15.112:0/2402907582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec406fab0 0x7f5ec4115420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400cb10 tx=0x7f5eb4007ee0 comp rx=0 tx=0).stop 2024-09-19T09:31:27.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.968+0000 7f5ecbf0d640 1 -- 172.21.15.112:0/2402907582 shutdown_connections 2024-09-19T09:31:27.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.968+0000 7f5ecbf0d640 1 --2- 172.21.15.112:0/2402907582 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f5eac06ed60 0x7f5eac071210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:27.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.968+0000 7f5ecbf0d640 1 --2- 172.21.15.112:0/2402907582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ec40703c0 0x7f5ec4115960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:27.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.968+0000 7f5ecbf0d640 1 --2- 172.21.15.112:0/2402907582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec406fab0 0x7f5ec4115420 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:27.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.968+0000 7f5ecbf0d640 1 -- 172.21.15.112:0/2402907582 >> 172.21.15.112:0/2402907582 conn(0x7f5ec40f80f0 msgr2=0x7f5ec40f9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:27.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.968+0000 7f5ecbf0d640 1 -- 172.21.15.112:0/2402907582 shutdown_connections 2024-09-19T09:31:27.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:27.969+0000 7f5ecbf0d640 1 -- 172.21.15.112:0/2402907582 wait complete. 2024-09-19T09:31:28.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:28 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2402907582' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:31:28.722 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T09:31:28.723 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T09:31:28.723 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T09:31:28.724 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T09:31:28.724 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T09:31:28.725 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T09:31:28.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:28 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2402907582' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:31:29.029 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:29.037 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:29.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:29 smithi112 ceph-mon[27605]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:29.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:29 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:31:29.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:29 smithi191 ceph-mon[34834]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:29.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:29 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:31:29.802 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:29.802 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:29.803 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:31.646 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:31 smithi112 ceph-mon[27605]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:31.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:31 smithi191 ceph-mon[34834]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:32.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.204+0000 7fe708518640 1 -- 172.21.15.112:0/1674410109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7000fb810 msgr2=0x7fe7000fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:32.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.204+0000 7fe708518640 1 --2- 172.21.15.112:0/1674410109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7000fb810 0x7fe7000fbbe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80048d0 tx=0x7fe6f8009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:32.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.204+0000 7fe708518640 1 -- 172.21.15.112:0/1674410109 shutdown_connections 2024-09-19T09:31:32.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.204+0000 7fe708518640 1 --2- 172.21.15.112:0/1674410109 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7000fcf80 0x7fe7000fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.204+0000 7fe708518640 1 --2- 172.21.15.112:0/1674410109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7000fb810 0x7fe7000fbbe0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.204+0000 7fe708518640 1 -- 172.21.15.112:0/1674410109 >> 172.21.15.112:0/1674410109 conn(0x7fe7000723b0 msgr2=0x7fe7000727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.204+0000 7fe708518640 1 -- 172.21.15.112:0/1674410109 shutdown_connections 2024-09-19T09:31:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.204+0000 7fe708518640 1 -- 172.21.15.112:0/1674410109 wait complete. 2024-09-19T09:31:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.204+0000 7fe708518640 1 Processor -- start 2024-09-19T09:31:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.204+0000 7fe708518640 1 -- start start 2024-09-19T09:31:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.204+0000 7fe708518640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7000fb810 0x7fe700112100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.204+0000 7fe708518640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7000fcf80 0x7fe700112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.204+0000 7fe708518640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe700112cd0 con 0x7fe7000fcf80 2024-09-19T09:31:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.204+0000 7fe708518640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70010c080 con 0x7fe7000fb810 2024-09-19T09:31:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.205+0000 7fe705ab3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7000fcf80 0x7fe700112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.205+0000 7fe705ab3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7000fcf80 0x7fe700112640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54810/0 (socket says 172.21.15.112:54810) 2024-09-19T09:31:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.205+0000 7fe705ab3640 1 -- 172.21.15.112:0/2307893206 learned_addr learned my addr 172.21.15.112:0/2307893206 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.205+0000 7fe7062b4640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7000fb810 0x7fe700112100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.205+0000 7fe705ab3640 1 -- 172.21.15.112:0/2307893206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7000fb810 msgr2=0x7fe700112100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.205+0000 7fe705ab3640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7000fb810 0x7fe700112100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.205+0000 7fe705ab3640 1 -- 172.21.15.112:0/2307893206 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f8005040 con 0x7fe7000fcf80 2024-09-19T09:31:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.205+0000 7fe705ab3640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7000fcf80 0x7fe700112640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400b790 tx=0x7fe6f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.205+0000 7fe6feffd640 1 -- 172.21.15.112:0/2307893206 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6f400c700 con 0x7fe7000fcf80 2024-09-19T09:31:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.205+0000 7fe6feffd640 1 -- 172.21.15.112:0/2307893206 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe6f400cd00 con 0x7fe7000fcf80 2024-09-19T09:31:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.205+0000 7fe708518640 1 -- 172.21.15.112:0/2307893206 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70010c360 con 0x7fe7000fcf80 2024-09-19T09:31:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.205+0000 7fe6feffd640 1 -- 172.21.15.112:0/2307893206 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6f4015e70 con 0x7fe7000fcf80 2024-09-19T09:31:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.205+0000 7fe708518640 1 -- 172.21.15.112:0/2307893206 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70010c880 con 0x7fe7000fcf80 2024-09-19T09:31:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.206+0000 7fe708518640 1 -- 172.21.15.112:0/2307893206 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe70010cdc0 con 0x7fe7000fcf80 2024-09-19T09:31:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.207+0000 7fe6feffd640 1 -- 172.21.15.112:0/2307893206 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fe6f4012070 con 0x7fe7000fcf80 2024-09-19T09:31:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.207+0000 7fe6feffd640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe6e806ed60 0x7fe6e8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.207+0000 7fe6feffd640 1 -- 172.21.15.112:0/2307893206 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe6f408df40 con 0x7fe7000fcf80 2024-09-19T09:31:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.207+0000 7fe7062b4640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe6e806ed60 0x7fe6e8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.207+0000 7fe6feffd640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264] conn(0x7fe6e8074ae0 0x7fe6e8076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.207+0000 7fe6feffd640 1 -- 172.21.15.112:0/2307893206 --> [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6e80775a0 con 0x7fe6e8074ae0 2024-09-19T09:31:32.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.207+0000 7fe6feffd640 1 -- 172.21.15.112:0/2307893206 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6f408e320 con 0x7fe7000fcf80 2024-09-19T09:31:32.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.208+0000 7fe706ab5640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264] conn(0x7fe6e8074ae0 0x7fe6e8076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:32.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.208+0000 7fe7062b4640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe6e806ed60 0x7fe6e8071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009ac0 tx=0x7fe6f8035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:32.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.208+0000 7fe706ab5640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264] conn(0x7fe6e8074ae0 0x7fe6e8076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:32.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.209+0000 7fe6feffd640 1 -- 172.21.15.112:0/2307893206 <== osd.2 v2:172.21.15.112:6818/2593689264 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe6e80775a0 con 0x7fe6e8074ae0 2024-09-19T09:31:32.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.221+0000 7fe708518640 1 -- 172.21.15.112:0/2307893206 --> [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe7000fae10 con 0x7fe6e8074ae0 2024-09-19T09:31:32.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.221+0000 7fe6feffd640 1 -- 172.21.15.112:0/2307893206 <== osd.2 v2:172.21.15.112:6818/2593689264 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe7000fae10 con 0x7fe6e8074ae0 2024-09-19T09:31:32.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.221+0000 7fe708518640 1 -- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264] conn(0x7fe6e8074ae0 msgr2=0x7fe6e8076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:32.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.221+0000 7fe708518640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264] conn(0x7fe6e8074ae0 0x7fe6e8076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:32.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.221+0000 7fe708518640 1 -- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe6e806ed60 msgr2=0x7fe6e8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:32.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.221+0000 7fe708518640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe6e806ed60 0x7fe6e8071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009ac0 tx=0x7fe6f8035040 comp rx=0 tx=0).stop 2024-09-19T09:31:32.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.221+0000 7fe708518640 1 -- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7000fcf80 msgr2=0x7fe700112640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:32.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.221+0000 7fe708518640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7000fcf80 0x7fe700112640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400b790 tx=0x7fe6f40091d0 comp rx=0 tx=0).stop 2024-09-19T09:31:32.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.221+0000 7fe708518640 1 -- 172.21.15.112:0/2307893206 shutdown_connections 2024-09-19T09:31:32.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.221+0000 7fe708518640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:6818/2593689264,v1:172.21.15.112:6819/2593689264] conn(0x7fe6e8074ae0 0x7fe6e8076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:32.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.221+0000 7fe708518640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe6e806ed60 0x7fe6e8071210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:32.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.222+0000 7fe708518640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7000fcf80 0x7fe700112640 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:32.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.222+0000 7fe708518640 1 --2- 172.21.15.112:0/2307893206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7000fb810 0x7fe700112100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:32.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.222+0000 7fe708518640 1 -- 172.21.15.112:0/2307893206 >> 172.21.15.112:0/2307893206 conn(0x7fe7000723b0 msgr2=0x7fe7000fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:32.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.222+0000 7fe708518640 1 -- 172.21.15.112:0/2307893206 shutdown_connections 2024-09-19T09:31:32.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:32.222+0000 7fe708518640 1 -- 172.21.15.112:0/2307893206 wait complete. 2024-09-19T09:31:33.227 INFO:teuthology.orchestra.run.smithi112.stdout:81604378646 2024-09-19T09:31:33.227 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T09:31:33.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:33 smithi112 ceph-mon[27605]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:33.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:33 smithi191 ceph-mon[34834]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:34.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.972+0000 7f7be6684640 1 -- 172.21.15.112:0/1040240723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be00fb470 msgr2=0x7f7be00fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:34.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.972+0000 7f7be6684640 1 --2- 172.21.15.112:0/1040240723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be00fb470 0x7f7be00fb8e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80048d0 tx=0x7f7bc8009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:34.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.972+0000 7f7be6684640 1 -- 172.21.15.112:0/1040240723 shutdown_connections 2024-09-19T09:31:34.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.972+0000 7f7be6684640 1 --2- 172.21.15.112:0/1040240723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be00fb470 0x7f7be00fb8e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:34.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.972+0000 7f7be6684640 1 --2- 172.21.15.112:0/1040240723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7be01014b0 0x7f7be0101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:34.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.972+0000 7f7be6684640 1 -- 172.21.15.112:0/1040240723 >> 172.21.15.112:0/1040240723 conn(0x7f7be00f7030 msgr2=0x7f7be00f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:34.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.972+0000 7f7be6684640 1 -- 172.21.15.112:0/1040240723 shutdown_connections 2024-09-19T09:31:34.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.972+0000 7f7be6684640 1 -- 172.21.15.112:0/1040240723 wait complete. 2024-09-19T09:31:34.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.972+0000 7f7be6684640 1 Processor -- start 2024-09-19T09:31:34.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.972+0000 7f7be6684640 1 -- start start 2024-09-19T09:31:34.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7be6684640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be00fb470 0x7f7be0112080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:34.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7be6684640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7be01014b0 0x7f7be01125c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:34.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7be6684640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0112c50 con 0x7f7be00fb470 2024-09-19T09:31:34.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7be6684640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be010c040 con 0x7f7be01014b0 2024-09-19T09:31:34.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7bdffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be00fb470 0x7f7be0112080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:34.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7bdffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be00fb470 0x7f7be0112080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54834/0 (socket says 172.21.15.112:54834) 2024-09-19T09:31:34.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7bdffff640 1 -- 172.21.15.112:0/2949723535 learned_addr learned my addr 172.21.15.112:0/2949723535 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:34.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7bdffff640 1 -- 172.21.15.112:0/2949723535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7be01014b0 msgr2=0x7f7be01125c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:34.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7bdffff640 1 --2- 172.21.15.112:0/2949723535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7be01014b0 0x7f7be01125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:34.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7bdffff640 1 -- 172.21.15.112:0/2949723535 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc8005040 con 0x7f7be00fb470 2024-09-19T09:31:34.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7bdffff640 1 --2- 172.21.15.112:0/2949723535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be00fb470 0x7f7be0112080 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000b790 tx=0x7f7bd00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:34.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7bdd7fa640 1 -- 172.21.15.112:0/2949723535 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bd000c700 con 0x7f7be00fb470 2024-09-19T09:31:34.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7bdd7fa640 1 -- 172.21.15.112:0/2949723535 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7bd000cd00 con 0x7f7be00fb470 2024-09-19T09:31:34.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7be6684640 1 -- 172.21.15.112:0/2949723535 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be010c320 con 0x7f7be00fb470 2024-09-19T09:31:34.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7bdd7fa640 1 -- 172.21.15.112:0/2949723535 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bd0015e70 con 0x7f7be00fb470 2024-09-19T09:31:34.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.973+0000 7f7be6684640 1 -- 172.21.15.112:0/2949723535 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be010c840 con 0x7f7be00fb470 2024-09-19T09:31:34.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.974+0000 7f7be6684640 1 -- 172.21.15.112:0/2949723535 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7be010cdc0 con 0x7f7be00fb470 2024-09-19T09:31:34.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.975+0000 7f7bdd7fa640 1 -- 172.21.15.112:0/2949723535 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f7bd0012070 con 0x7f7be00fb470 2024-09-19T09:31:34.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.975+0000 7f7bdd7fa640 1 --2- 172.21.15.112:0/2949723535 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f7bcc06ed60 0x7f7bcc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:34.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.976+0000 7f7bdd7fa640 1 -- 172.21.15.112:0/2949723535 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7bd008d970 con 0x7f7be00fb470 2024-09-19T09:31:34.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.976+0000 7f7bd7fff640 1 --2- 172.21.15.112:0/2949723535 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f7bcc06ed60 0x7f7bcc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:34.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.976+0000 7f7bdd7fa640 1 --2- 172.21.15.112:0/2949723535 >> [v2:172.21.15.191:6808/101220282,v1:172.21.15.191:6809/101220282] conn(0x7f7bcc074ae0 0x7f7bcc076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:34.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.976+0000 7f7bdd7fa640 1 -- 172.21.15.112:0/2949723535 --> [v2:172.21.15.191:6808/101220282,v1:172.21.15.191:6809/101220282] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7bcc0775a0 con 0x7f7bcc074ae0 2024-09-19T09:31:34.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.976+0000 7f7bdd7fa640 1 -- 172.21.15.112:0/2949723535 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bd0092220 con 0x7f7be00fb470 2024-09-19T09:31:34.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.976+0000 7f7be4c21640 1 --2- 172.21.15.112:0/2949723535 >> [v2:172.21.15.191:6808/101220282,v1:172.21.15.191:6809/101220282] conn(0x7f7bcc074ae0 0x7f7bcc076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:34.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.976+0000 7f7bd7fff640 1 --2- 172.21.15.112:0/2949723535 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f7bcc06ed60 0x7f7bcc071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80043d0 tx=0x7f7bc8009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:34.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.976+0000 7f7be4c21640 1 --2- 172.21.15.112:0/2949723535 >> [v2:172.21.15.191:6808/101220282,v1:172.21.15.191:6809/101220282] conn(0x7f7bcc074ae0 0x7f7bcc076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:34.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.977+0000 7f7bdd7fa640 1 -- 172.21.15.112:0/2949723535 <== osd.4 v2:172.21.15.191:6808/101220282 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7bcc0775a0 con 0x7f7bcc074ae0 2024-09-19T09:31:34.985 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:34.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.990+0000 7f7be6684640 1 -- 172.21.15.112:0/2949723535 --> [v2:172.21.15.191:6808/101220282,v1:172.21.15.191:6809/101220282] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7be00f7dd0 con 0x7f7bcc074ae0 2024-09-19T09:31:34.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.991+0000 7f7bdd7fa640 1 -- 172.21.15.112:0/2949723535 <== osd.4 v2:172.21.15.191:6808/101220282 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7be00f7dd0 con 0x7f7bcc074ae0 2024-09-19T09:31:34.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.991+0000 7f7be6684640 1 -- 172.21.15.112:0/2949723535 >> [v2:172.21.15.191:6808/101220282,v1:172.21.15.191:6809/101220282] conn(0x7f7bcc074ae0 msgr2=0x7f7bcc076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:34.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.991+0000 7f7be6684640 1 --2- 172.21.15.112:0/2949723535 >> [v2:172.21.15.191:6808/101220282,v1:172.21.15.191:6809/101220282] conn(0x7f7bcc074ae0 0x7f7bcc076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:34.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.991+0000 7f7be6684640 1 -- 172.21.15.112:0/2949723535 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f7bcc06ed60 msgr2=0x7f7bcc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:34.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.991+0000 7f7be6684640 1 --2- 172.21.15.112:0/2949723535 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f7bcc06ed60 0x7f7bcc071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80043d0 tx=0x7f7bc8009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:34.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.991+0000 7f7be6684640 1 -- 172.21.15.112:0/2949723535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be00fb470 msgr2=0x7f7be0112080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:34.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.991+0000 7f7be6684640 1 --2- 172.21.15.112:0/2949723535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be00fb470 0x7f7be0112080 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000b790 tx=0x7f7bd00091d0 comp rx=0 tx=0).stop 2024-09-19T09:31:34.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.992+0000 7f7be6684640 1 -- 172.21.15.112:0/2949723535 shutdown_connections 2024-09-19T09:31:34.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.992+0000 7f7be6684640 1 --2- 172.21.15.112:0/2949723535 >> [v2:172.21.15.191:6808/101220282,v1:172.21.15.191:6809/101220282] conn(0x7f7bcc074ae0 0x7f7bcc076ef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:34.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.992+0000 7f7be6684640 1 --2- 172.21.15.112:0/2949723535 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f7bcc06ed60 0x7f7bcc071210 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:34.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.992+0000 7f7be6684640 1 --2- 172.21.15.112:0/2949723535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7be01014b0 0x7f7be01125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:34.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.992+0000 7f7be6684640 1 --2- 172.21.15.112:0/2949723535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be00fb470 0x7f7be0112080 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:34.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.992+0000 7f7be6684640 1 -- 172.21.15.112:0/2949723535 >> 172.21.15.112:0/2949723535 conn(0x7f7be00f7030 msgr2=0x7f7be00f7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:34.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.992+0000 7f7be6684640 1 -- 172.21.15.112:0/2949723535 shutdown_connections 2024-09-19T09:31:34.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:34.992+0000 7f7be6684640 1 -- 172.21.15.112:0/2949723535 wait complete. 2024-09-19T09:31:35.639 INFO:teuthology.orchestra.run.smithi112.stdout:141733920781 2024-09-19T09:31:35.639 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T09:31:35.738 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:35 smithi112 ceph-mon[27605]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:35.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:35 smithi191 ceph-mon[34834]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:37.550 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:37 smithi112 ceph-mon[27605]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:37.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:37 smithi191 ceph-mon[34834]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:38.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.359+0000 7fcb08f37640 1 -- 172.21.15.112:0/2493144845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb04102530 msgr2=0x7fcb04102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:38.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.359+0000 7fcb08f37640 1 --2- 172.21.15.112:0/2493144845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb04102530 0x7fcb04102900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40048d0 tx=0x7fcaf4009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.360+0000 7fcb08f37640 1 -- 172.21.15.112:0/2493144845 shutdown_connections 2024-09-19T09:31:38.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.360+0000 7fcb08f37640 1 --2- 172.21.15.112:0/2493144845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb04102ed0 0x7fcb040fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.360+0000 7fcb08f37640 1 --2- 172.21.15.112:0/2493144845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb04102530 0x7fcb04102900 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.360+0000 7fcb08f37640 1 -- 172.21.15.112:0/2493144845 >> 172.21.15.112:0/2493144845 conn(0x7fcb040f80f0 msgr2=0x7fcb040fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:38.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.360+0000 7fcb08f37640 1 -- 172.21.15.112:0/2493144845 shutdown_connections 2024-09-19T09:31:38.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.360+0000 7fcb08f37640 1 -- 172.21.15.112:0/2493144845 wait complete. 2024-09-19T09:31:38.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.360+0000 7fcb08f37640 1 Processor -- start 2024-09-19T09:31:38.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.360+0000 7fcb08f37640 1 -- start start 2024-09-19T09:31:38.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.360+0000 7fcb08f37640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb04102530 0x7fcb04113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.360+0000 7fcb08f37640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb04102ed0 0x7fcb04113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.360+0000 7fcb08f37640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb04113e20 con 0x7fcb04102530 2024-09-19T09:31:38.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.360+0000 7fcb08f37640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0410d1d0 con 0x7fcb04102ed0 2024-09-19T09:31:38.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.361+0000 7fcb0259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb04102530 0x7fcb04113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.361+0000 7fcb0259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb04102530 0x7fcb04113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57246/0 (socket says 172.21.15.112:57246) 2024-09-19T09:31:38.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.361+0000 7fcb0259c640 1 -- 172.21.15.112:0/706646586 learned_addr learned my addr 172.21.15.112:0/706646586 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:38.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.361+0000 7fcb01d9b640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb04102ed0 0x7fcb04113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.361+0000 7fcb0259c640 1 -- 172.21.15.112:0/706646586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb04102ed0 msgr2=0x7fcb04113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:38.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.361+0000 7fcb0259c640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb04102ed0 0x7fcb04113790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.361+0000 7fcb0259c640 1 -- 172.21.15.112:0/706646586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf4005040 con 0x7fcb04102530 2024-09-19T09:31:38.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.361+0000 7fcb01d9b640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb04102ed0 0x7fcb04113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:38.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.361+0000 7fcb0259c640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb04102530 0x7fcb04113250 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4000c00 tx=0x7fcaf4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:38.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.361+0000 7fcaf2ffd640 1 -- 172.21.15.112:0/706646586 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaf4038070 con 0x7fcb04102530 2024-09-19T09:31:38.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.361+0000 7fcb08f37640 1 -- 172.21.15.112:0/706646586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0410d450 con 0x7fcb04102530 2024-09-19T09:31:38.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.361+0000 7fcaf2ffd640 1 -- 172.21.15.112:0/706646586 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcaf403daf0 con 0x7fcb04102530 2024-09-19T09:31:38.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.361+0000 7fcaf2ffd640 1 -- 172.21.15.112:0/706646586 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaf4033b20 con 0x7fcb04102530 2024-09-19T09:31:38.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.361+0000 7fcb08f37640 1 -- 172.21.15.112:0/706646586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0410d970 con 0x7fcb04102530 2024-09-19T09:31:38.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.362+0000 7fcb08f37640 1 -- 172.21.15.112:0/706646586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb0410df60 con 0x7fcb04102530 2024-09-19T09:31:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.363+0000 7fcaf2ffd640 1 -- 172.21.15.112:0/706646586 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fcaf4030020 con 0x7fcb04102530 2024-09-19T09:31:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.363+0000 7fcaf2ffd640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fcaec06ed60 0x7fcaec071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.363+0000 7fcaf2ffd640 1 -- 172.21.15.112:0/706646586 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcaf40ae260 con 0x7fcb04102530 2024-09-19T09:31:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.363+0000 7fcb01d9b640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fcaec06ed60 0x7fcaec071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.363+0000 7fcaf2ffd640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.191:6800/2835674394,v1:172.21.15.191:6801/2835674394] conn(0x7fcaec074ae0 0x7fcaec076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.363+0000 7fcaf2ffd640 1 -- 172.21.15.112:0/706646586 --> [v2:172.21.15.191:6800/2835674394,v1:172.21.15.191:6801/2835674394] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcaec0775a0 con 0x7fcaec074ae0 2024-09-19T09:31:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.363+0000 7fcaf2ffd640 1 -- 172.21.15.112:0/706646586 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcaf40ae640 con 0x7fcb04102530 2024-09-19T09:31:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.364+0000 7fcb02d9d640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.191:6800/2835674394,v1:172.21.15.191:6801/2835674394] conn(0x7fcaec074ae0 0x7fcaec076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.364+0000 7fcb01d9b640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fcaec06ed60 0x7fcaec071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8006fd0 tx=0x7fcaf8008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.364+0000 7fcb02d9d640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.191:6800/2835674394,v1:172.21.15.191:6801/2835674394] conn(0x7fcaec074ae0 0x7fcaec076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.365+0000 7fcaf2ffd640 1 -- 172.21.15.112:0/706646586 <== osd.3 v2:172.21.15.191:6800/2835674394 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcaec0775a0 con 0x7fcaec074ae0 2024-09-19T09:31:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.377+0000 7fcb08f37640 1 -- 172.21.15.112:0/706646586 --> [v2:172.21.15.191:6800/2835674394,v1:172.21.15.191:6801/2835674394] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb0410d5e0 con 0x7fcaec074ae0 2024-09-19T09:31:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.378+0000 7fcaf2ffd640 1 -- 172.21.15.112:0/706646586 <== osd.3 v2:172.21.15.191:6800/2835674394 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fcb0410d5e0 con 0x7fcaec074ae0 2024-09-19T09:31:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.378+0000 7fcb08f37640 1 -- 172.21.15.112:0/706646586 >> [v2:172.21.15.191:6800/2835674394,v1:172.21.15.191:6801/2835674394] conn(0x7fcaec074ae0 msgr2=0x7fcaec076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.378+0000 7fcb08f37640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.191:6800/2835674394,v1:172.21.15.191:6801/2835674394] conn(0x7fcaec074ae0 0x7fcaec076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.378+0000 7fcb08f37640 1 -- 172.21.15.112:0/706646586 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fcaec06ed60 msgr2=0x7fcaec071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:38.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.378+0000 7fcb08f37640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fcaec06ed60 0x7fcaec071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8006fd0 tx=0x7fcaf8008040 comp rx=0 tx=0).stop 2024-09-19T09:31:38.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.378+0000 7fcb08f37640 1 -- 172.21.15.112:0/706646586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb04102530 msgr2=0x7fcb04113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:38.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.378+0000 7fcb08f37640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb04102530 0x7fcb04113250 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4000c00 tx=0x7fcaf4009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.378+0000 7fcb08f37640 1 -- 172.21.15.112:0/706646586 shutdown_connections 2024-09-19T09:31:38.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.378+0000 7fcb08f37640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.191:6800/2835674394,v1:172.21.15.191:6801/2835674394] conn(0x7fcaec074ae0 0x7fcaec076ef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.378+0000 7fcb08f37640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fcaec06ed60 0x7fcaec071210 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.378+0000 7fcb08f37640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb04102ed0 0x7fcb04113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.378+0000 7fcb08f37640 1 --2- 172.21.15.112:0/706646586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb04102530 0x7fcb04113250 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.378+0000 7fcb08f37640 1 -- 172.21.15.112:0/706646586 >> 172.21.15.112:0/706646586 conn(0x7fcb040f80f0 msgr2=0x7fcb040f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:38.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.378+0000 7fcb08f37640 1 -- 172.21.15.112:0/706646586 shutdown_connections 2024-09-19T09:31:38.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:38.378+0000 7fcb08f37640 1 -- 172.21.15.112:0/706646586 wait complete. 2024-09-19T09:31:39.187 INFO:teuthology.orchestra.run.smithi112.stdout:115964117011 2024-09-19T09:31:39.187 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T09:31:39.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:39 smithi191 ceph-mon[34834]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:39.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:39 smithi112 ceph-mon[27605]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:40.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.464+0000 7f669a438640 1 -- 172.21.15.112:0/2873096710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66941014e0 msgr2=0x7f66941018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:40.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.464+0000 7f669a438640 1 --2- 172.21.15.112:0/2873096710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66941014e0 0x7f66941018b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f66840048d0 tx=0x7f6684009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.464+0000 7f669a438640 1 -- 172.21.15.112:0/2873096710 shutdown_connections 2024-09-19T09:31:40.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.464+0000 7f669a438640 1 --2- 172.21.15.112:0/2873096710 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66940fb4a0 0x7f66940fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.464+0000 7f669a438640 1 --2- 172.21.15.112:0/2873096710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66941014e0 0x7f66941018b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.464+0000 7f669a438640 1 -- 172.21.15.112:0/2873096710 >> 172.21.15.112:0/2873096710 conn(0x7f66940f7060 msgr2=0x7f66940f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.464+0000 7f669a438640 1 -- 172.21.15.112:0/2873096710 shutdown_connections 2024-09-19T09:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.464+0000 7f669a438640 1 -- 172.21.15.112:0/2873096710 wait complete. 2024-09-19T09:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.465+0000 7f669a438640 1 Processor -- start 2024-09-19T09:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.465+0000 7f669a438640 1 -- start start 2024-09-19T09:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.465+0000 7f669a438640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66940fb4a0 0x7f6694112110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.465+0000 7f669a438640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66941014e0 0x7f6694112650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.465+0000 7f669a438640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6694112ce0 con 0x7f66940fb4a0 2024-09-19T09:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.465+0000 7f669a438640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669410c090 con 0x7f66941014e0 2024-09-19T09:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.465+0000 7f6693fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66940fb4a0 0x7f6694112110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.465+0000 7f6693fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66940fb4a0 0x7f6694112110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57270/0 (socket says 172.21.15.112:57270) 2024-09-19T09:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.465+0000 7f6693fff640 1 -- 172.21.15.112:0/3749139885 learned_addr learned my addr 172.21.15.112:0/3749139885 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.466+0000 7f6693fff640 1 -- 172.21.15.112:0/3749139885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66941014e0 msgr2=0x7f6694112650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.466+0000 7f6693fff640 1 --2- 172.21.15.112:0/3749139885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66941014e0 0x7f6694112650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.466+0000 7f6693fff640 1 -- 172.21.15.112:0/3749139885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6684005040 con 0x7f66940fb4a0 2024-09-19T09:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.466+0000 7f6693fff640 1 --2- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66940fb4a0 0x7f6694112110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6684000c00 tx=0x7f6684009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.466+0000 7f6690ff9640 1 -- 172.21.15.112:0/3749139885 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f668403a070 con 0x7f66940fb4a0 2024-09-19T09:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.466+0000 7f669a438640 1 -- 172.21.15.112:0/3749139885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669410c310 con 0x7f66940fb4a0 2024-09-19T09:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.466+0000 7f6690ff9640 1 -- 172.21.15.112:0/3749139885 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6684009880 con 0x7f66940fb4a0 2024-09-19T09:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.466+0000 7f6690ff9640 1 -- 172.21.15.112:0/3749139885 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66840338f0 con 0x7f66940fb4a0 2024-09-19T09:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.466+0000 7f669a438640 1 -- 172.21.15.112:0/3749139885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669410c7d0 con 0x7f66940fb4a0 2024-09-19T09:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.467+0000 7f669a438640 1 -- 172.21.15.112:0/3749139885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f669410ccb0 con 0x7f66940fb4a0 2024-09-19T09:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.467+0000 7f6690ff9640 1 -- 172.21.15.112:0/3749139885 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f6684030020 con 0x7f66940fb4a0 2024-09-19T09:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.468+0000 7f6690ff9640 1 --2- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f667c06ed60 0x7f667c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.468+0000 7f6690ff9640 1 -- 172.21.15.112:0/3749139885 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f66840b06d0 con 0x7f66940fb4a0 2024-09-19T09:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.468+0000 7f66937fe640 1 --2- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f667c06ed60 0x7f667c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.468+0000 7f6690ff9640 1 --2- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068] conn(0x7f667c074ae0 0x7f667c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:40.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.468+0000 7f6690ff9640 1 -- 172.21.15.112:0/3749139885 --> [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f667c0775a0 con 0x7f667c074ae0 2024-09-19T09:31:40.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.468+0000 7f6690ff9640 1 -- 172.21.15.112:0/3749139885 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66840b2d20 con 0x7f66940fb4a0 2024-09-19T09:31:40.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.468+0000 7f66989d5640 1 --2- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068] conn(0x7f667c074ae0 0x7f667c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:40.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.468+0000 7f66937fe640 1 --2- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f667c06ed60 0x7f667c071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f669410d9d0 tx=0x7f6688006ca0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:40.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.468+0000 7f66989d5640 1 --2- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068] conn(0x7f667c074ae0 0x7f667c076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:40.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.469+0000 7f6690ff9640 1 -- 172.21.15.112:0/3749139885 <== osd.0 v2:172.21.15.112:6802/1562881068 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f667c0775a0 con 0x7f667c074ae0 2024-09-19T09:31:40.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.481+0000 7f669a438640 1 -- 172.21.15.112:0/3749139885 --> [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f66940fcbe0 con 0x7f667c074ae0 2024-09-19T09:31:40.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.482+0000 7f6690ff9640 1 -- 172.21.15.112:0/3749139885 <== osd.0 v2:172.21.15.112:6802/1562881068 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f66940fcbe0 con 0x7f667c074ae0 2024-09-19T09:31:40.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.482+0000 7f669a438640 1 -- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068] conn(0x7f667c074ae0 msgr2=0x7f667c076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:40.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.482+0000 7f669a438640 1 --2- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068] conn(0x7f667c074ae0 0x7f667c076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.482+0000 7f669a438640 1 -- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f667c06ed60 msgr2=0x7f667c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:40.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.482+0000 7f669a438640 1 --2- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f667c06ed60 0x7f667c071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f669410d9d0 tx=0x7f6688006ca0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.482+0000 7f669a438640 1 -- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66940fb4a0 msgr2=0x7f6694112110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:40.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.482+0000 7f669a438640 1 --2- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66940fb4a0 0x7f6694112110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6684000c00 tx=0x7f6684009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.482+0000 7f669a438640 1 -- 172.21.15.112:0/3749139885 shutdown_connections 2024-09-19T09:31:40.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.482+0000 7f669a438640 1 --2- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:6802/1562881068,v1:172.21.15.112:6803/1562881068] conn(0x7f667c074ae0 0x7f667c076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.482+0000 7f669a438640 1 --2- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f667c06ed60 0x7f667c071210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.482+0000 7f669a438640 1 --2- 172.21.15.112:0/3749139885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66941014e0 0x7f6694112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.482+0000 7f669a438640 1 --2- 172.21.15.112:0/3749139885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66940fb4a0 0x7f6694112110 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.482+0000 7f669a438640 1 -- 172.21.15.112:0/3749139885 >> 172.21.15.112:0/3749139885 conn(0x7f66940f7060 msgr2=0x7f66940f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:40.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.482+0000 7f669a438640 1 -- 172.21.15.112:0/3749139885 shutdown_connections 2024-09-19T09:31:40.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.482+0000 7f669a438640 1 -- 172.21.15.112:0/3749139885 wait complete. 2024-09-19T09:31:40.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.898+0000 7f4a043fc640 1 -- 172.21.15.112:0/39562927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49fc102ef0 msgr2=0x7f49fc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:40.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.898+0000 7f4a043fc640 1 --2- 172.21.15.112:0/39562927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49fc102ef0 0x7f49fc0fc5b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f49ec0048d0 tx=0x7f49ec009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.898+0000 7f4a043fc640 1 -- 172.21.15.112:0/39562927 shutdown_connections 2024-09-19T09:31:40.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.898+0000 7f4a043fc640 1 --2- 172.21.15.112:0/39562927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49fc102ef0 0x7f49fc0fc5b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.898+0000 7f4a043fc640 1 --2- 172.21.15.112:0/39562927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49fc102550 0x7f49fc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.898+0000 7f4a043fc640 1 -- 172.21.15.112:0/39562927 >> 172.21.15.112:0/39562927 conn(0x7f49fc0f80f0 msgr2=0x7f49fc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:40.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.898+0000 7f4a043fc640 1 -- 172.21.15.112:0/39562927 shutdown_connections 2024-09-19T09:31:40.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.898+0000 7f4a043fc640 1 -- 172.21.15.112:0/39562927 wait complete. 2024-09-19T09:31:40.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.898+0000 7f4a043fc640 1 Processor -- start 2024-09-19T09:31:40.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.898+0000 7f4a043fc640 1 -- start start 2024-09-19T09:31:40.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f4a043fc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49fc102550 0x7f49fc1135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:40.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f4a043fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49fc102ef0 0x7f49fc113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:40.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f4a043fc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc1141d0 con 0x7f49fc102ef0 2024-09-19T09:31:40.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f4a043fc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc10d550 con 0x7f49fc102550 2024-09-19T09:31:40.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f4a01997640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49fc102ef0 0x7f49fc113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:40.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f4a01997640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49fc102ef0 0x7f49fc113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57296/0 (socket says 172.21.15.112:57296) 2024-09-19T09:31:40.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f4a01997640 1 -- 172.21.15.112:0/3632689644 learned_addr learned my addr 172.21.15.112:0/3632689644 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:40.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f4a02198640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49fc102550 0x7f49fc1135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:40.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f4a01997640 1 -- 172.21.15.112:0/3632689644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49fc102550 msgr2=0x7f49fc1135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:40.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f4a01997640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49fc102550 0x7f49fc1135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f4a01997640 1 -- 172.21.15.112:0/3632689644 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec005040 con 0x7f49fc102ef0 2024-09-19T09:31:40.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f4a01997640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49fc102ef0 0x7f49fc113af0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f49ec003080 tx=0x7f49ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:40.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f49f2ffd640 1 -- 172.21.15.112:0/3632689644 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49ec038070 con 0x7f49fc102ef0 2024-09-19T09:31:40.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f49f2ffd640 1 -- 172.21.15.112:0/3632689644 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f49ec009760 con 0x7f49fc102ef0 2024-09-19T09:31:40.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f4a043fc640 1 -- 172.21.15.112:0/3632689644 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49fc10d780 con 0x7f49fc102ef0 2024-09-19T09:31:40.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f49f2ffd640 1 -- 172.21.15.112:0/3632689644 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49ec033420 con 0x7f49fc102ef0 2024-09-19T09:31:40.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.899+0000 7f4a043fc640 1 -- 172.21.15.112:0/3632689644 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49fc10dbe0 con 0x7f49fc102ef0 2024-09-19T09:31:40.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.900+0000 7f4a043fc640 1 -- 172.21.15.112:0/3632689644 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49fc0fdcd0 con 0x7f49fc102ef0 2024-09-19T09:31:40.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.901+0000 7f49f2ffd640 1 -- 172.21.15.112:0/3632689644 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f49ec030020 con 0x7f49fc102ef0 2024-09-19T09:31:40.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.901+0000 7f49f2ffd640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f49e806ed60 0x7f49e8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:40.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.901+0000 7f49f2ffd640 1 -- 172.21.15.112:0/3632689644 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f49ec0adb40 con 0x7f49fc102ef0 2024-09-19T09:31:40.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.901+0000 7f4a02198640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f49e806ed60 0x7f49e8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:40.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.901+0000 7f49f2ffd640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.191:6816/2561099737,v1:172.21.15.191:6817/2561099737] conn(0x7f49e8074ae0 0x7f49e8076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:40.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.901+0000 7f49f2ffd640 1 -- 172.21.15.112:0/3632689644 --> [v2:172.21.15.191:6816/2561099737,v1:172.21.15.191:6817/2561099737] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49e80775a0 con 0x7f49e8074ae0 2024-09-19T09:31:40.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.901+0000 7f49f2ffd640 1 -- 172.21.15.112:0/3632689644 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49ec0b2220 con 0x7f49fc102ef0 2024-09-19T09:31:40.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.902+0000 7f4a02198640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f49e806ed60 0x7f49e8071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009b50 tx=0x7f49f8009120 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:40.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.902+0000 7f4a02999640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.191:6816/2561099737,v1:172.21.15.191:6817/2561099737] conn(0x7f49e8074ae0 0x7f49e8076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:40.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.902+0000 7f4a02999640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.191:6816/2561099737,v1:172.21.15.191:6817/2561099737] conn(0x7f49e8074ae0 0x7f49e8076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:40.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.903+0000 7f49f2ffd640 1 -- 172.21.15.112:0/3632689644 <== osd.5 v2:172.21.15.191:6816/2561099737 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f49e80775a0 con 0x7f49e8074ae0 2024-09-19T09:31:40.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.918+0000 7f4a043fc640 1 -- 172.21.15.112:0/3632689644 --> [v2:172.21.15.191:6816/2561099737,v1:172.21.15.191:6817/2561099737] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f49fc10e120 con 0x7f49e8074ae0 2024-09-19T09:31:40.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.919+0000 7f49f2ffd640 1 -- 172.21.15.112:0/3632689644 <== osd.5 v2:172.21.15.191:6816/2561099737 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f49fc10e120 con 0x7f49e8074ae0 2024-09-19T09:31:40.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.919+0000 7f4a043fc640 1 -- 172.21.15.112:0/3632689644 >> [v2:172.21.15.191:6816/2561099737,v1:172.21.15.191:6817/2561099737] conn(0x7f49e8074ae0 msgr2=0x7f49e8076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:40.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.919+0000 7f4a043fc640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.191:6816/2561099737,v1:172.21.15.191:6817/2561099737] conn(0x7f49e8074ae0 0x7f49e8076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.919+0000 7f4a043fc640 1 -- 172.21.15.112:0/3632689644 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f49e806ed60 msgr2=0x7f49e8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:40.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.919+0000 7f4a043fc640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f49e806ed60 0x7f49e8071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009b50 tx=0x7f49f8009120 comp rx=0 tx=0).stop 2024-09-19T09:31:40.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.919+0000 7f4a043fc640 1 -- 172.21.15.112:0/3632689644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49fc102ef0 msgr2=0x7f49fc113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:40.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.919+0000 7f4a043fc640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49fc102ef0 0x7f49fc113af0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f49ec003080 tx=0x7f49ec009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.919+0000 7f4a043fc640 1 -- 172.21.15.112:0/3632689644 shutdown_connections 2024-09-19T09:31:40.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.919+0000 7f4a043fc640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.191:6816/2561099737,v1:172.21.15.191:6817/2561099737] conn(0x7f49e8074ae0 0x7f49e8076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.919+0000 7f4a043fc640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f49e806ed60 0x7f49e8071210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.919+0000 7f4a043fc640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49fc102ef0 0x7f49fc113af0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.919+0000 7f4a043fc640 1 --2- 172.21.15.112:0/3632689644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49fc102550 0x7f49fc1135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.919+0000 7f4a043fc640 1 -- 172.21.15.112:0/3632689644 >> 172.21.15.112:0/3632689644 conn(0x7f49fc0f80f0 msgr2=0x7f49fc0f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:40.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.920+0000 7f4a043fc640 1 -- 172.21.15.112:0/3632689644 shutdown_connections 2024-09-19T09:31:40.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:40.920+0000 7f4a043fc640 1 -- 172.21.15.112:0/3632689644 wait complete. 2024-09-19T09:31:41.121 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:41.628 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:41 smithi112 ceph-mon[27605]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:41.634 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:41.659 INFO:teuthology.orchestra.run.smithi112.stdout:38654705700 2024-09-19T09:31:41.659 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T09:31:41.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:41 smithi191 ceph-mon[34834]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.302+0000 7f549f9e9640 1 -- 172.21.15.112:0/1314501767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54980fcf80 msgr2=0x7f54980fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.302+0000 7f549f9e9640 1 --2- 172.21.15.112:0/1314501767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54980fcf80 0x7f54980fd3d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f54880048d0 tx=0x7f5488009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.302+0000 7f549f9e9640 1 -- 172.21.15.112:0/1314501767 shutdown_connections 2024-09-19T09:31:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.302+0000 7f549f9e9640 1 --2- 172.21.15.112:0/1314501767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54980fcf80 0x7f54980fd3d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.302+0000 7f549f9e9640 1 --2- 172.21.15.112:0/1314501767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54980fb810 0x7f54980fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.302+0000 7f549f9e9640 1 -- 172.21.15.112:0/1314501767 >> 172.21.15.112:0/1314501767 conn(0x7f54980723b0 msgr2=0x7f54980727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.302+0000 7f549f9e9640 1 -- 172.21.15.112:0/1314501767 shutdown_connections 2024-09-19T09:31:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.302+0000 7f549f9e9640 1 -- 172.21.15.112:0/1314501767 wait complete. 2024-09-19T09:31:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.302+0000 7f549f9e9640 1 Processor -- start 2024-09-19T09:31:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.302+0000 7f549f9e9640 1 -- start start 2024-09-19T09:31:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.302+0000 7f549f9e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54980fb810 0x7f54981120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.302+0000 7f549f9e9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54980fcf80 0x7f5498112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.302+0000 7f549f9e9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5498112c10 con 0x7f54980fb810 2024-09-19T09:31:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.302+0000 7f549f9e9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549810c050 con 0x7f54980fcf80 2024-09-19T09:31:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.303+0000 7f549d785640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54980fb810 0x7f54981120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.303+0000 7f549d785640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54980fb810 0x7f54981120d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57308/0 (socket says 172.21.15.112:57308) 2024-09-19T09:31:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.303+0000 7f549d785640 1 -- 172.21.15.112:0/815406503 learned_addr learned my addr 172.21.15.112:0/815406503 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.303+0000 7f549cf84640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54980fcf80 0x7f5498112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.303+0000 7f549d785640 1 -- 172.21.15.112:0/815406503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54980fcf80 msgr2=0x7f5498112610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.303+0000 7f549d785640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54980fcf80 0x7f5498112610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.303+0000 7f549d785640 1 -- 172.21.15.112:0/815406503 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5488005040 con 0x7f54980fb810 2024-09-19T09:31:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.303+0000 7f549d785640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54980fb810 0x7f54981120d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5494002a50 tx=0x7f5494004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.303+0000 7f548dffb640 1 -- 172.21.15.112:0/815406503 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5494007c30 con 0x7f54980fb810 2024-09-19T09:31:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.303+0000 7f548dffb640 1 -- 172.21.15.112:0/815406503 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f549400f040 con 0x7f54980fb810 2024-09-19T09:31:42.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.303+0000 7f549f9e9640 1 -- 172.21.15.112:0/815406503 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549810c330 con 0x7f54980fb810 2024-09-19T09:31:42.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.303+0000 7f548dffb640 1 -- 172.21.15.112:0/815406503 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f549400da10 con 0x7f54980fb810 2024-09-19T09:31:42.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.303+0000 7f549f9e9640 1 -- 172.21.15.112:0/815406503 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549810c8a0 con 0x7f54980fb810 2024-09-19T09:31:42.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.304+0000 7f549f9e9640 1 -- 172.21.15.112:0/815406503 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f549810cd50 con 0x7f54980fb810 2024-09-19T09:31:42.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.305+0000 7f548dffb640 1 -- 172.21.15.112:0/815406503 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f549400dc80 con 0x7f54980fb810 2024-09-19T09:31:42.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.305+0000 7f548dffb640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f548406ed60 0x7f5484071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.305+0000 7f548dffb640 1 -- 172.21.15.112:0/815406503 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f549408d600 con 0x7f54980fb810 2024-09-19T09:31:42.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.305+0000 7f549cf84640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f548406ed60 0x7f5484071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.305+0000 7f548dffb640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300] conn(0x7f5484074ae0 0x7f5484076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.305+0000 7f548dffb640 1 -- 172.21.15.112:0/815406503 --> [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54840775a0 con 0x7f5484074ae0 2024-09-19T09:31:42.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.305+0000 7f548dffb640 1 -- 172.21.15.112:0/815406503 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f549408fc50 con 0x7f54980fb810 2024-09-19T09:31:42.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.305+0000 7f549df86640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300] conn(0x7f5484074ae0 0x7f5484076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.306+0000 7f549cf84640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f548406ed60 0x7f5484071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5488009ac0 tx=0x7f5488035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:42.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.306+0000 7f549df86640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300] conn(0x7f5484074ae0 0x7f5484076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:42.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.306+0000 7f548dffb640 1 -- 172.21.15.112:0/815406503 <== osd.1 v2:172.21.15.112:6810/3124914300 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f54840775a0 con 0x7f5484074ae0 2024-09-19T09:31:42.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.319+0000 7f549f9e9640 1 -- 172.21.15.112:0/815406503 --> [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f549810cec0 con 0x7f5484074ae0 2024-09-19T09:31:42.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.319+0000 7f548dffb640 1 -- 172.21.15.112:0/815406503 <== osd.1 v2:172.21.15.112:6810/3124914300 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f549810cec0 con 0x7f5484074ae0 2024-09-19T09:31:42.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.320+0000 7f549f9e9640 1 -- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300] conn(0x7f5484074ae0 msgr2=0x7f5484076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:42.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.320+0000 7f549f9e9640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300] conn(0x7f5484074ae0 0x7f5484076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.320+0000 7f549f9e9640 1 -- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f548406ed60 msgr2=0x7f5484071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.320+0000 7f549f9e9640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f548406ed60 0x7f5484071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5488009ac0 tx=0x7f5488035040 comp rx=0 tx=0).stop 2024-09-19T09:31:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.320+0000 7f549f9e9640 1 -- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54980fb810 msgr2=0x7f54981120d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.320+0000 7f549f9e9640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54980fb810 0x7f54981120d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5494002a50 tx=0x7f5494004600 comp rx=0 tx=0).stop 2024-09-19T09:31:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.320+0000 7f549f9e9640 1 -- 172.21.15.112:0/815406503 shutdown_connections 2024-09-19T09:31:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.320+0000 7f549f9e9640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:6810/3124914300,v1:172.21.15.112:6811/3124914300] conn(0x7f5484074ae0 0x7f5484076ef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.320+0000 7f549f9e9640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f548406ed60 0x7f5484071210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.320+0000 7f549f9e9640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54980fcf80 0x7f5498112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.320+0000 7f549f9e9640 1 --2- 172.21.15.112:0/815406503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54980fb810 0x7f54981120d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.320+0000 7f549f9e9640 1 -- 172.21.15.112:0/815406503 >> 172.21.15.112:0/815406503 conn(0x7f54980723b0 msgr2=0x7f54980fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.320+0000 7f549f9e9640 1 -- 172.21.15.112:0/815406503 shutdown_connections 2024-09-19T09:31:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:42.320+0000 7f549f9e9640 1 -- 172.21.15.112:0/815406503 wait complete. 2024-09-19T09:31:43.433 INFO:teuthology.orchestra.run.smithi112.stdout:163208757257 2024-09-19T09:31:43.433 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T09:31:43.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:43 smithi112 ceph-mon[27605]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:43.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:43 smithi191 ceph-mon[34834]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:44.607 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:44.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:44 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:31:44.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:44 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:31:44.997 INFO:teuthology.orchestra.run.smithi112.stdout:60129542175 2024-09-19T09:31:44.998 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T09:31:45.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:45 smithi112 ceph-mon[27605]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:45.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:45 smithi191 ceph-mon[34834]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:46.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.200+0000 7f68c40e8640 1 -- 172.21.15.112:0/1790705642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68bc0fcf80 msgr2=0x7f68bc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:46.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.200+0000 7f68c40e8640 1 --2- 172.21.15.112:0/1790705642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68bc0fcf80 0x7f68bc0fd3d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f68ac0048d0 tx=0x7f68ac009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:46.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.200+0000 7f68c40e8640 1 -- 172.21.15.112:0/1790705642 shutdown_connections 2024-09-19T09:31:46.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.200+0000 7f68c40e8640 1 --2- 172.21.15.112:0/1790705642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68bc0fcf80 0x7f68bc0fd3d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:46.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.200+0000 7f68c40e8640 1 --2- 172.21.15.112:0/1790705642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68bc0fb810 0x7f68bc0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:46.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.200+0000 7f68c40e8640 1 -- 172.21.15.112:0/1790705642 >> 172.21.15.112:0/1790705642 conn(0x7f68bc0723b0 msgr2=0x7f68bc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:46.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.200+0000 7f68c40e8640 1 -- 172.21.15.112:0/1790705642 shutdown_connections 2024-09-19T09:31:46.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.200+0000 7f68c40e8640 1 -- 172.21.15.112:0/1790705642 wait complete. 2024-09-19T09:31:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.200+0000 7f68c40e8640 1 Processor -- start 2024-09-19T09:31:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68c40e8640 1 -- start start 2024-09-19T09:31:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68c40e8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68bc0fb810 0x7f68bc0f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68c40e8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68bc0fcf80 0x7f68bc0f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68c40e8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc0f8fc0 con 0x7f68bc0fb810 2024-09-19T09:31:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68c40e8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc0f9130 con 0x7f68bc0fcf80 2024-09-19T09:31:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68c1e84640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68bc0fb810 0x7f68bc0f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68c1e84640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68bc0fb810 0x7f68bc0f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57342/0 (socket says 172.21.15.112:57342) 2024-09-19T09:31:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68c1e84640 1 -- 172.21.15.112:0/2819770279 learned_addr learned my addr 172.21.15.112:0/2819770279 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68c1683640 1 --2- 172.21.15.112:0/2819770279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68bc0fcf80 0x7f68bc0f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68c1e84640 1 -- 172.21.15.112:0/2819770279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68bc0fcf80 msgr2=0x7f68bc0f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68c1e84640 1 --2- 172.21.15.112:0/2819770279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68bc0fcf80 0x7f68bc0f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68c1e84640 1 -- 172.21.15.112:0/2819770279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac005040 con 0x7f68bc0fb810 2024-09-19T09:31:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68c1683640 1 --2- 172.21.15.112:0/2819770279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68bc0fcf80 0x7f68bc0f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68c1e84640 1 --2- 172.21.15.112:0/2819770279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68bc0fb810 0x7f68bc0f8540 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f68b8002a50 tx=0x7f68b8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68b27fc640 1 -- 172.21.15.112:0/2819770279 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68b8007c30 con 0x7f68bc0fb810 2024-09-19T09:31:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68b27fc640 1 -- 172.21.15.112:0/2819770279 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f68b800f040 con 0x7f68bc0fb810 2024-09-19T09:31:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68c40e8640 1 -- 172.21.15.112:0/2819770279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68bc0f93c0 con 0x7f68bc0fb810 2024-09-19T09:31:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.201+0000 7f68b27fc640 1 -- 172.21.15.112:0/2819770279 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68b800da90 con 0x7f68bc0fb810 2024-09-19T09:31:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.202+0000 7f68c40e8640 1 -- 172.21.15.112:0/2819770279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68bc1198a0 con 0x7f68bc0fb810 2024-09-19T09:31:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.202+0000 7f68c40e8640 1 -- 172.21.15.112:0/2819770279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68bc0fcbc0 con 0x7f68bc0fb810 2024-09-19T09:31:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.203+0000 7f68b27fc640 1 -- 172.21.15.112:0/2819770279 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f68b800dc30 con 0x7f68bc0fb810 2024-09-19T09:31:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.203+0000 7f68b27fc640 1 --2- 172.21.15.112:0/2819770279 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f68a806ed60 0x7f68a8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.203+0000 7f68c1683640 1 --2- 172.21.15.112:0/2819770279 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f68a806ed60 0x7f68a8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.203+0000 7f68b27fc640 1 -- 172.21.15.112:0/2819770279 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f68b808d690 con 0x7f68bc0fb810 2024-09-19T09:31:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.204+0000 7f68c1683640 1 --2- 172.21.15.112:0/2819770279 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f68a806ed60 0x7f68a8071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0f9e80 tx=0x7f68ac035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.208+0000 7f68b27fc640 1 -- 172.21.15.112:0/2819770279 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f68b804d2a0 con 0x7f68bc0fb810 2024-09-19T09:31:46.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.091+0000 7ff15704d640 1 -- 172.21.15.112:0/2152980962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1501014c0 msgr2=0x7ff150101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:46.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.091+0000 7ff15704d640 1 --2- 172.21.15.112:0/2152980962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1501014c0 0x7ff150101890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff1440048d0 tx=0x7ff144009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:46.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.091+0000 7ff15704d640 1 -- 172.21.15.112:0/2152980962 shutdown_connections 2024-09-19T09:31:46.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.091+0000 7ff15704d640 1 --2- 172.21.15.112:0/2152980962 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1500fb480 0x7ff1500fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:46.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.091+0000 7ff15704d640 1 --2- 172.21.15.112:0/2152980962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1501014c0 0x7ff150101890 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:46.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.091+0000 7ff15704d640 1 -- 172.21.15.112:0/2152980962 >> 172.21.15.112:0/2152980962 conn(0x7ff1500f7000 msgr2=0x7ff1500f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:46.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.091+0000 7ff15704d640 1 -- 172.21.15.112:0/2152980962 shutdown_connections 2024-09-19T09:31:46.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.091+0000 7ff15704d640 1 -- 172.21.15.112:0/2152980962 wait complete. 2024-09-19T09:31:46.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.092+0000 7ff15704d640 1 Processor -- start 2024-09-19T09:31:46.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.092+0000 7ff15704d640 1 -- start start 2024-09-19T09:31:46.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.092+0000 7ff15704d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1500fb480 0x7ff1501153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:46.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.092+0000 7ff15704d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1501014c0 0x7ff150115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:46.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.092+0000 7ff15704d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff150115f10 con 0x7ff1500fb480 2024-09-19T09:31:46.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.092+0000 7ff15704d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15010f350 con 0x7ff1501014c0 2024-09-19T09:31:46.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.092+0000 7ff154de9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1500fb480 0x7ff1501153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:46.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.092+0000 7ff154de9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1500fb480 0x7ff1501153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57318/0 (socket says 172.21.15.112:57318) 2024-09-19T09:31:46.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.092+0000 7ff154de9640 1 -- 172.21.15.112:0/2014663206 learned_addr learned my addr 172.21.15.112:0/2014663206 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:46.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.093+0000 7ff154de9640 1 -- 172.21.15.112:0/2014663206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1501014c0 msgr2=0x7ff150115910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:46.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.093+0000 7ff154de9640 1 --2- 172.21.15.112:0/2014663206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1501014c0 0x7ff150115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:46.326 INFO:teuthology.orchestra.run.smithi112.stdout:141733920783 2024-09-19T09:31:46.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.093+0000 7ff154de9640 1 -- 172.21.15.112:0/2014663206 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff144005040 con 0x7ff1500fb480 2024-09-19T09:31:46.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.093+0000 7ff154de9640 1 --2- 172.21.15.112:0/2014663206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1500fb480 0x7ff1501153d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff144000c00 tx=0x7ff144009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:46.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.093+0000 7ff14d7fa640 1 -- 172.21.15.112:0/2014663206 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff144038070 con 0x7ff1500fb480 2024-09-19T09:31:46.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.093+0000 7ff15704d640 1 -- 172.21.15.112:0/2014663206 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff15010f5d0 con 0x7ff1500fb480 2024-09-19T09:31:46.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.093+0000 7ff14d7fa640 1 -- 172.21.15.112:0/2014663206 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff14402ade0 con 0x7ff1500fb480 2024-09-19T09:31:46.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.093+0000 7ff14d7fa640 1 -- 172.21.15.112:0/2014663206 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff14402c7e0 con 0x7ff1500fb480 2024-09-19T09:31:46.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.093+0000 7ff15704d640 1 -- 172.21.15.112:0/2014663206 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15010fb10 con 0x7ff1500fb480 2024-09-19T09:31:46.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.094+0000 7ff15704d640 1 -- 172.21.15.112:0/2014663206 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1500fcbc0 con 0x7ff1500fb480 2024-09-19T09:31:46.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.095+0000 7ff14d7fa640 1 -- 172.21.15.112:0/2014663206 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ff144030020 con 0x7ff1500fb480 2024-09-19T09:31:46.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.095+0000 7ff14d7fa640 1 --2- 172.21.15.112:0/2014663206 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7ff14006ed60 0x7ff140071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:46.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.095+0000 7ff14ffff640 1 --2- 172.21.15.112:0/2014663206 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7ff14006ed60 0x7ff140071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:46.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.095+0000 7ff14d7fa640 1 -- 172.21.15.112:0/2014663206 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff1440adad0 con 0x7ff1500fb480 2024-09-19T09:31:46.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.096+0000 7ff14ffff640 1 --2- 172.21.15.112:0/2014663206 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7ff14006ed60 0x7ff140071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff150110c90 tx=0x7ff13c007e00 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:46.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.100+0000 7ff14d7fa640 1 -- 172.21.15.112:0/2014663206 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff14407afe0 con 0x7ff1500fb480 2024-09-19T09:31:46.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.265+0000 7ff15704d640 1 -- 172.21.15.112:0/2014663206 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff150107350 con 0x7ff1500fb480 2024-09-19T09:31:46.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.265+0000 7ff14d7fa640 1 -- 172.21.15.112:0/2014663206 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff14407a980 con 0x7ff1500fb480 2024-09-19T09:31:46.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.267+0000 7ff15704d640 1 -- 172.21.15.112:0/2014663206 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7ff14006ed60 msgr2=0x7ff140071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:46.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.267+0000 7ff15704d640 1 --2- 172.21.15.112:0/2014663206 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7ff14006ed60 0x7ff140071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff150110c90 tx=0x7ff13c007e00 comp rx=0 tx=0).stop 2024-09-19T09:31:46.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.267+0000 7ff15704d640 1 -- 172.21.15.112:0/2014663206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1500fb480 msgr2=0x7ff1501153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:46.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.267+0000 7ff15704d640 1 --2- 172.21.15.112:0/2014663206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1500fb480 0x7ff1501153d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff144000c00 tx=0x7ff144009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:46.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.268+0000 7ff15704d640 1 -- 172.21.15.112:0/2014663206 shutdown_connections 2024-09-19T09:31:46.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.268+0000 7ff15704d640 1 --2- 172.21.15.112:0/2014663206 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7ff14006ed60 0x7ff140071210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:46.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.268+0000 7ff15704d640 1 --2- 172.21.15.112:0/2014663206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1501014c0 0x7ff150115910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:46.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.268+0000 7ff15704d640 1 --2- 172.21.15.112:0/2014663206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1500fb480 0x7ff1501153d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:46.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.268+0000 7ff15704d640 1 -- 172.21.15.112:0/2014663206 >> 172.21.15.112:0/2014663206 conn(0x7ff1500f7000 msgr2=0x7ff1500f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:46.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.268+0000 7ff15704d640 1 -- 172.21.15.112:0/2014663206 shutdown_connections 2024-09-19T09:31:46.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.268+0000 7ff15704d640 1 -- 172.21.15.112:0/2014663206 wait complete. 2024-09-19T09:31:46.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.369+0000 7f68c40e8640 1 -- 172.21.15.112:0/2819770279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f68bc0f9c30 con 0x7f68bc0fb810 2024-09-19T09:31:46.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.369+0000 7f68b27fc640 1 -- 172.21.15.112:0/2819770279 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f68b805ac30 con 0x7f68bc0fb810 2024-09-19T09:31:46.371 INFO:teuthology.orchestra.run.smithi112.stdout:81604378648 2024-09-19T09:31:46.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.371+0000 7f68c40e8640 1 -- 172.21.15.112:0/2819770279 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f68a806ed60 msgr2=0x7f68a8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:46.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.371+0000 7f68c40e8640 1 --2- 172.21.15.112:0/2819770279 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f68a806ed60 0x7f68a8071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0f9e80 tx=0x7f68ac035040 comp rx=0 tx=0).stop 2024-09-19T09:31:46.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.371+0000 7f68c40e8640 1 -- 172.21.15.112:0/2819770279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68bc0fb810 msgr2=0x7f68bc0f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:46.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.371+0000 7f68c40e8640 1 --2- 172.21.15.112:0/2819770279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68bc0fb810 0x7f68bc0f8540 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f68b8002a50 tx=0x7f68b8004600 comp rx=0 tx=0).stop 2024-09-19T09:31:46.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.371+0000 7f68c40e8640 1 -- 172.21.15.112:0/2819770279 shutdown_connections 2024-09-19T09:31:46.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.371+0000 7f68c40e8640 1 --2- 172.21.15.112:0/2819770279 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f68a806ed60 0x7f68a8071210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:46.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.371+0000 7f68c40e8640 1 --2- 172.21.15.112:0/2819770279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68bc0fcf80 0x7f68bc0f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:46.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.371+0000 7f68c40e8640 1 --2- 172.21.15.112:0/2819770279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68bc0fb810 0x7f68bc0f8540 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:46.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.372+0000 7f68c40e8640 1 -- 172.21.15.112:0/2819770279 >> 172.21.15.112:0/2819770279 conn(0x7f68bc0723b0 msgr2=0x7f68bc065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:46.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.372+0000 7f68c40e8640 1 -- 172.21.15.112:0/2819770279 shutdown_connections 2024-09-19T09:31:46.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:46.372+0000 7f68c40e8640 1 -- 172.21.15.112:0/2819770279 wait complete. 2024-09-19T09:31:46.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:46 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2014663206' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:31:46.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:46 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2819770279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:31:46.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:46 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2014663206' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:31:46.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:46 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2819770279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:31:46.817 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:46.817 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:47.254 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378646 got 81604378648 for osd.2 2024-09-19T09:31:47.254 DEBUG:teuthology.parallel:result is None 2024-09-19T09:31:47.271 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:47.525 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:47 smithi112 ceph-mon[27605]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:47.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:47 smithi191 ceph-mon[34834]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:49.649 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:49 smithi112 ceph-mon[27605]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:49.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:49 smithi191 ceph-mon[34834]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:50.325 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920781 got 141733920783 for osd.4 2024-09-19T09:31:50.325 DEBUG:teuthology.parallel:result is None 2024-09-19T09:31:51.751 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:51 smithi112 ceph-mon[27605]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:51.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:51 smithi191 ceph-mon[34834]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:52.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.252+0000 7f471e307640 1 -- 172.21.15.112:0/314748074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4718102ef0 msgr2=0x7f47180fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:52.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.252+0000 7f471e307640 1 --2- 172.21.15.112:0/314748074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4718102ef0 0x7f47180fc5b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f47000048d0 tx=0x7f4700009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.252+0000 7f471e307640 1 -- 172.21.15.112:0/314748074 shutdown_connections 2024-09-19T09:31:52.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.252+0000 7f471e307640 1 --2- 172.21.15.112:0/314748074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4718102ef0 0x7f47180fc5b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.252+0000 7f471e307640 1 --2- 172.21.15.112:0/314748074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4718102550 0x7f4718102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.252+0000 7f471e307640 1 -- 172.21.15.112:0/314748074 >> 172.21.15.112:0/314748074 conn(0x7f47180f80f0 msgr2=0x7f47180fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:52.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.252+0000 7f471e307640 1 -- 172.21.15.112:0/314748074 shutdown_connections 2024-09-19T09:31:52.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.252+0000 7f471e307640 1 -- 172.21.15.112:0/314748074 wait complete. 2024-09-19T09:31:52.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.252+0000 7f471e307640 1 Processor -- start 2024-09-19T09:31:52.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.252+0000 7f471e307640 1 -- start start 2024-09-19T09:31:52.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.252+0000 7f471e307640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4718102550 0x7f4718113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:52.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.252+0000 7f471e307640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4718102ef0 0x7f4718113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:52.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.252+0000 7f471e307640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47181140b0 con 0x7f4718102ef0 2024-09-19T09:31:52.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.252+0000 7f471e307640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471810d4c0 con 0x7f4718102550 2024-09-19T09:31:52.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.253+0000 7f470ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4718102ef0 0x7f4718113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:52.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.253+0000 7f470ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4718102ef0 0x7f4718113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41736/0 (socket says 172.21.15.112:41736) 2024-09-19T09:31:52.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.253+0000 7f470ffff640 1 -- 172.21.15.112:0/2286185888 learned_addr learned my addr 172.21.15.112:0/2286185888 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:52.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.253+0000 7f4717fff640 1 --2- 172.21.15.112:0/2286185888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4718102550 0x7f4718113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:52.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.253+0000 7f470ffff640 1 -- 172.21.15.112:0/2286185888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4718102550 msgr2=0x7f4718113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:52.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.253+0000 7f470ffff640 1 --2- 172.21.15.112:0/2286185888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4718102550 0x7f4718113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.253+0000 7f470ffff640 1 -- 172.21.15.112:0/2286185888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4700005040 con 0x7f4718102ef0 2024-09-19T09:31:52.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.253+0000 7f470ffff640 1 --2- 172.21.15.112:0/2286185888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4718102ef0 0x7f4718113a60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f47000043d0 tx=0x7f4700009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:52.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.253+0000 7f47157fa640 1 -- 172.21.15.112:0/2286185888 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4700038070 con 0x7f4718102ef0 2024-09-19T09:31:52.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.253+0000 7f471e307640 1 -- 172.21.15.112:0/2286185888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f471810d740 con 0x7f4718102ef0 2024-09-19T09:31:52.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.253+0000 7f47157fa640 1 -- 172.21.15.112:0/2286185888 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f47000096e0 con 0x7f4718102ef0 2024-09-19T09:31:52.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.253+0000 7f47157fa640 1 -- 172.21.15.112:0/2286185888 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f470002c8a0 con 0x7f4718102ef0 2024-09-19T09:31:52.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.253+0000 7f471e307640 1 -- 172.21.15.112:0/2286185888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471810dc80 con 0x7f4718102ef0 2024-09-19T09:31:52.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.254+0000 7f471e307640 1 -- 172.21.15.112:0/2286185888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47180fdcd0 con 0x7f4718102ef0 2024-09-19T09:31:52.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.255+0000 7f47157fa640 1 -- 172.21.15.112:0/2286185888 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4700030020 con 0x7f4718102ef0 2024-09-19T09:31:52.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.255+0000 7f47157fa640 1 --2- 172.21.15.112:0/2286185888 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f470406ed60 0x7f4704071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:52.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.255+0000 7f47157fa640 1 -- 172.21.15.112:0/2286185888 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f47000adbe0 con 0x7f4718102ef0 2024-09-19T09:31:52.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.255+0000 7f4717fff640 1 --2- 172.21.15.112:0/2286185888 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f470406ed60 0x7f4704071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:52.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.256+0000 7f4717fff640 1 --2- 172.21.15.112:0/2286185888 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f470406ed60 0x7f4704071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4708007fd0 tx=0x7f4708009e90 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:52.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.260+0000 7f47157fa640 1 -- 172.21.15.112:0/2286185888 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f470007b040 con 0x7f4718102ef0 2024-09-19T09:31:52.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.419+0000 7f471e307640 1 -- 172.21.15.112:0/2286185888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f47180fbd50 con 0x7f4718102ef0 2024-09-19T09:31:52.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.419+0000 7f47157fa640 1 -- 172.21.15.112:0/2286185888 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f470007a9e0 con 0x7f4718102ef0 2024-09-19T09:31:52.421 INFO:teuthology.orchestra.run.smithi112.stdout:115964117013 2024-09-19T09:31:52.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.421+0000 7f471e307640 1 -- 172.21.15.112:0/2286185888 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f470406ed60 msgr2=0x7f4704071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:52.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.421+0000 7f471e307640 1 --2- 172.21.15.112:0/2286185888 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f470406ed60 0x7f4704071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4708007fd0 tx=0x7f4708009e90 comp rx=0 tx=0).stop 2024-09-19T09:31:52.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.421+0000 7f471e307640 1 -- 172.21.15.112:0/2286185888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4718102ef0 msgr2=0x7f4718113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:52.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.421+0000 7f471e307640 1 --2- 172.21.15.112:0/2286185888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4718102ef0 0x7f4718113a60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f47000043d0 tx=0x7f4700009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.422+0000 7f471e307640 1 -- 172.21.15.112:0/2286185888 shutdown_connections 2024-09-19T09:31:52.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.422+0000 7f471e307640 1 --2- 172.21.15.112:0/2286185888 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f470406ed60 0x7f4704071210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.422+0000 7f471e307640 1 --2- 172.21.15.112:0/2286185888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4718102ef0 0x7f4718113a60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.422+0000 7f471e307640 1 --2- 172.21.15.112:0/2286185888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4718102550 0x7f4718113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.422+0000 7f471e307640 1 -- 172.21.15.112:0/2286185888 >> 172.21.15.112:0/2286185888 conn(0x7f47180f80f0 msgr2=0x7f47180f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:52.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.422+0000 7f471e307640 1 -- 172.21.15.112:0/2286185888 shutdown_connections 2024-09-19T09:31:52.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.422+0000 7f471e307640 1 -- 172.21.15.112:0/2286185888 wait complete. 2024-09-19T09:31:52.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:52 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2286185888' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:31:52.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:52 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2286185888' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:31:53.417 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117013 for osd.3 2024-09-19T09:31:53.417 DEBUG:teuthology.parallel:result is None 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.790+0000 7f9e8c049640 1 -- 172.21.15.112:0/1831371611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e840fcf80 msgr2=0x7f9e840fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.790+0000 7f9e8c049640 1 --2- 172.21.15.112:0/1831371611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e840fcf80 0x7f9e840fd3d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9e780048d0 tx=0x7f9e78009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.790+0000 7f9e8c049640 1 -- 172.21.15.112:0/1831371611 shutdown_connections 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.790+0000 7f9e8c049640 1 --2- 172.21.15.112:0/1831371611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e840fcf80 0x7f9e840fd3d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.790+0000 7f9e8c049640 1 --2- 172.21.15.112:0/1831371611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e840fb810 0x7f9e840fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.790+0000 7f9e8c049640 1 -- 172.21.15.112:0/1831371611 >> 172.21.15.112:0/1831371611 conn(0x7f9e840723b0 msgr2=0x7f9e840727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.791+0000 7f9e8c049640 1 -- 172.21.15.112:0/1831371611 shutdown_connections 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.791+0000 7f9e8c049640 1 -- 172.21.15.112:0/1831371611 wait complete. 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.791+0000 7f9e8c049640 1 Processor -- start 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.791+0000 7f9e8c049640 1 -- start start 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.791+0000 7f9e8c049640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e840fb810 0x7f9e84113150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.791+0000 7f9e8c049640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e840fcf80 0x7f9e84113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.791+0000 7f9e8c049640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84113c90 con 0x7f9e840fb810 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.791+0000 7f9e8c049640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8410d0d0 con 0x7f9e840fcf80 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi112.stdout:60129542177 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.791+0000 7f9e89de5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e840fb810 0x7f9e84113150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.791+0000 7f9e89de5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e840fb810 0x7f9e84113150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41758/0 (socket says 172.21.15.112:41758) 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.791+0000 7f9e89de5640 1 -- 172.21.15.112:0/1310002708 learned_addr learned my addr 172.21.15.112:0/1310002708 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.792+0000 7f9e89de5640 1 -- 172.21.15.112:0/1310002708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e840fcf80 msgr2=0x7f9e84113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.792+0000 7f9e89de5640 1 --2- 172.21.15.112:0/1310002708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e840fcf80 0x7f9e84113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.792+0000 7f9e89de5640 1 -- 172.21.15.112:0/1310002708 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e78005040 con 0x7f9e840fb810 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.792+0000 7f9e89de5640 1 --2- 172.21.15.112:0/1310002708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e840fb810 0x7f9e84113150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400ece0 tx=0x7f9e7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.792+0000 7f9e827fc640 1 -- 172.21.15.112:0/1310002708 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e7400ee40 con 0x7f9e840fb810 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.792+0000 7f9e827fc640 1 -- 172.21.15.112:0/1310002708 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9e7400f040 con 0x7f9e840fb810 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.792+0000 7f9e827fc640 1 -- 172.21.15.112:0/1310002708 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e740096b0 con 0x7f9e840fb810 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.792+0000 7f9e8c049640 1 -- 172.21.15.112:0/1310002708 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8410d3b0 con 0x7f9e840fb810 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.792+0000 7f9e8c049640 1 -- 172.21.15.112:0/1310002708 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8410d950 con 0x7f9e840fb810 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.793+0000 7f9e8c049640 1 -- 172.21.15.112:0/1310002708 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e840fcbc0 con 0x7f9e840fb810 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.793+0000 7f9e827fc640 1 -- 172.21.15.112:0/1310002708 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9e74007890 con 0x7f9e840fb810 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.794+0000 7f9e827fc640 1 --2- 172.21.15.112:0/1310002708 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9e6c06ed60 0x7f9e6c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.794+0000 7f9e827fc640 1 -- 172.21.15.112:0/1310002708 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9e7408e520 con 0x7f9e840fb810 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.794+0000 7f9e895e4640 1 --2- 172.21.15.112:0/1310002708 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9e6c06ed60 0x7f9e6c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.794+0000 7f9e895e4640 1 --2- 172.21.15.112:0/1310002708 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9e6c06ed60 0x7f9e6c071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9e7802a530 tx=0x7f9e78009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.798+0000 7f9e827fc640 1 -- 172.21.15.112:0/1310002708 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9e7405b520 con 0x7f9e840fb810 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.957+0000 7f9e8c049640 1 -- 172.21.15.112:0/1310002708 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9e8410e850 con 0x7f9e840fb810 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.957+0000 7f9e827fc640 1 -- 172.21.15.112:0/1310002708 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e8410e850 con 0x7f9e840fb810 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.959+0000 7f9e8c049640 1 -- 172.21.15.112:0/1310002708 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9e6c06ed60 msgr2=0x7f9e6c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.959+0000 7f9e8c049640 1 --2- 172.21.15.112:0/1310002708 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9e6c06ed60 0x7f9e6c071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9e7802a530 tx=0x7f9e78009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.959+0000 7f9e8c049640 1 -- 172.21.15.112:0/1310002708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e840fb810 msgr2=0x7f9e84113150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.959+0000 7f9e8c049640 1 --2- 172.21.15.112:0/1310002708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e840fb810 0x7f9e84113150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400ece0 tx=0x7f9e7400b040 comp rx=0 tx=0).stop 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.959+0000 7f9e8c049640 1 -- 172.21.15.112:0/1310002708 shutdown_connections 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.959+0000 7f9e8c049640 1 --2- 172.21.15.112:0/1310002708 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9e6c06ed60 0x7f9e6c071210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.959+0000 7f9e8c049640 1 --2- 172.21.15.112:0/1310002708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e840fcf80 0x7f9e84113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.959+0000 7f9e8c049640 1 --2- 172.21.15.112:0/1310002708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e840fb810 0x7f9e84113150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.959+0000 7f9e8c049640 1 -- 172.21.15.112:0/1310002708 >> 172.21.15.112:0/1310002708 conn(0x7f9e840723b0 msgr2=0x7f9e84101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:53.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.959+0000 7f9e8c049640 1 -- 172.21.15.112:0/1310002708 shutdown_connections 2024-09-19T09:31:53.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:52.959+0000 7f9e8c049640 1 -- 172.21.15.112:0/1310002708 wait complete. 2024-09-19T09:31:53.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:53 smithi112 ceph-mon[27605]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:53.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:53 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1310002708' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:31:53.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:53 smithi191 ceph-mon[34834]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:53.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:53 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/1310002708' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:31:54.838 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542175 got 60129542177 for osd.1 2024-09-19T09:31:54.839 DEBUG:teuthology.parallel:result is None 2024-09-19T09:31:55.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:54.999+0000 7f4871876640 1 -- 172.21.15.112:0/319603019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f486c0fdf60 msgr2=0x7f486c106630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:55.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:54.999+0000 7f4871876640 1 --2- 172.21.15.112:0/319603019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f486c0fdf60 0x7f486c106630 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f48600048d0 tx=0x7f4860009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.000+0000 7f4871876640 1 -- 172.21.15.112:0/319603019 shutdown_connections 2024-09-19T09:31:55.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.000+0000 7f4871876640 1 --2- 172.21.15.112:0/319603019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f486c0fdf60 0x7f486c106630 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.000+0000 7f4871876640 1 --2- 172.21.15.112:0/319603019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f486c0fd5c0 0x7f486c0fd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.000+0000 7f4871876640 1 -- 172.21.15.112:0/319603019 >> 172.21.15.112:0/319603019 conn(0x7f486c0f7060 msgr2=0x7f486c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:55.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.000+0000 7f4871876640 1 -- 172.21.15.112:0/319603019 shutdown_connections 2024-09-19T09:31:55.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.000+0000 7f4871876640 1 -- 172.21.15.112:0/319603019 wait complete. 2024-09-19T09:31:55.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.000+0000 7f4871876640 1 Processor -- start 2024-09-19T09:31:55.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.000+0000 7f4871876640 1 -- start start 2024-09-19T09:31:55.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.000+0000 7f4871876640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f486c0fd5c0 0x7f486c113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.000+0000 7f4871876640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f486c0fdf60 0x7f486c1137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.000+0000 7f4871876640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c113da0 con 0x7f486c0fd5c0 2024-09-19T09:31:55.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.000+0000 7f4871876640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c10d1e0 con 0x7f486c0fdf60 2024-09-19T09:31:55.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.001+0000 7f486affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f486c0fd5c0 0x7f486c113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.001+0000 7f486affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f486c0fd5c0 0x7f486c113260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41778/0 (socket says 172.21.15.112:41778) 2024-09-19T09:31:55.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.001+0000 7f486affd640 1 -- 172.21.15.112:0/1363200472 learned_addr learned my addr 172.21.15.112:0/1363200472 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:55.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.001+0000 7f486a7fc640 1 --2- 172.21.15.112:0/1363200472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f486c0fdf60 0x7f486c1137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.001+0000 7f486affd640 1 -- 172.21.15.112:0/1363200472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f486c0fdf60 msgr2=0x7f486c1137a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:55.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.001+0000 7f486affd640 1 --2- 172.21.15.112:0/1363200472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f486c0fdf60 0x7f486c1137a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.001+0000 7f486affd640 1 -- 172.21.15.112:0/1363200472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4860005040 con 0x7f486c0fd5c0 2024-09-19T09:31:55.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.001+0000 7f486a7fc640 1 --2- 172.21.15.112:0/1363200472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f486c0fdf60 0x7f486c1137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:55.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.001+0000 7f486affd640 1 --2- 172.21.15.112:0/1363200472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f486c0fd5c0 0x7f486c113260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f485c002a50 tx=0x7f485c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:55.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.001+0000 7f48537fe640 1 -- 172.21.15.112:0/1363200472 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f485c007c30 con 0x7f486c0fd5c0 2024-09-19T09:31:55.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.001+0000 7f48537fe640 1 -- 172.21.15.112:0/1363200472 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f485c00f040 con 0x7f486c0fd5c0 2024-09-19T09:31:55.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.001+0000 7f4871876640 1 -- 172.21.15.112:0/1363200472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486c10d4c0 con 0x7f486c0fd5c0 2024-09-19T09:31:55.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.001+0000 7f48537fe640 1 -- 172.21.15.112:0/1363200472 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f485c00da90 con 0x7f486c0fd5c0 2024-09-19T09:31:55.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.001+0000 7f4871876640 1 -- 172.21.15.112:0/1363200472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486c10d9e0 con 0x7f486c0fd5c0 2024-09-19T09:31:55.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.002+0000 7f4871876640 1 -- 172.21.15.112:0/1363200472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486c066290 con 0x7f486c0fd5c0 2024-09-19T09:31:55.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.003+0000 7f48537fe640 1 -- 172.21.15.112:0/1363200472 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f485c00dd00 con 0x7f486c0fd5c0 2024-09-19T09:31:55.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.003+0000 7f48537fe640 1 --2- 172.21.15.112:0/1363200472 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f485406ed60 0x7f4854071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.003+0000 7f48537fe640 1 -- 172.21.15.112:0/1363200472 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f485c08d700 con 0x7f486c0fd5c0 2024-09-19T09:31:55.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.003+0000 7f486a7fc640 1 --2- 172.21.15.112:0/1363200472 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f485406ed60 0x7f4854071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.004+0000 7f486a7fc640 1 --2- 172.21.15.112:0/1363200472 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f485406ed60 0x7f4854071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4860007ac0 tx=0x7f4860035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:55.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.007+0000 7f48537fe640 1 -- 172.21.15.112:0/1363200472 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f485c04d2a0 con 0x7f486c0fd5c0 2024-09-19T09:31:55.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.168+0000 7f4871876640 1 -- 172.21.15.112:0/1363200472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f486c04b750 con 0x7f486c0fd5c0 2024-09-19T09:31:55.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.168+0000 7f48537fe640 1 -- 172.21.15.112:0/1363200472 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f485c05ab60 con 0x7f486c0fd5c0 2024-09-19T09:31:55.170 INFO:teuthology.orchestra.run.smithi112.stdout:163208757260 2024-09-19T09:31:55.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.170+0000 7f4871876640 1 -- 172.21.15.112:0/1363200472 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f485406ed60 msgr2=0x7f4854071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:55.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.170+0000 7f4871876640 1 --2- 172.21.15.112:0/1363200472 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f485406ed60 0x7f4854071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4860007ac0 tx=0x7f4860035040 comp rx=0 tx=0).stop 2024-09-19T09:31:55.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.170+0000 7f4871876640 1 -- 172.21.15.112:0/1363200472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f486c0fd5c0 msgr2=0x7f486c113260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:55.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.170+0000 7f4871876640 1 --2- 172.21.15.112:0/1363200472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f486c0fd5c0 0x7f486c113260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f485c002a50 tx=0x7f485c004600 comp rx=0 tx=0).stop 2024-09-19T09:31:55.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.170+0000 7f4871876640 1 -- 172.21.15.112:0/1363200472 shutdown_connections 2024-09-19T09:31:55.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.170+0000 7f4871876640 1 --2- 172.21.15.112:0/1363200472 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f485406ed60 0x7f4854071210 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.170+0000 7f4871876640 1 --2- 172.21.15.112:0/1363200472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f486c0fdf60 0x7f486c1137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.170+0000 7f4871876640 1 --2- 172.21.15.112:0/1363200472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f486c0fd5c0 0x7f486c113260 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.170+0000 7f4871876640 1 -- 172.21.15.112:0/1363200472 >> 172.21.15.112:0/1363200472 conn(0x7f486c0f7060 msgr2=0x7f486c100fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:55.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.171+0000 7f4871876640 1 -- 172.21.15.112:0/1363200472 shutdown_connections 2024-09-19T09:31:55.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.171+0000 7f4871876640 1 -- 172.21.15.112:0/1363200472 wait complete. 2024-09-19T09:31:55.773 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:55 smithi112 ceph-mon[27605]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:55.773 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:55 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1363200472' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:31:55.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:55 smithi191 ceph-mon[34834]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:55.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:55 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/1363200472' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:31:56.055 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757257 got 163208757260 for osd.5 2024-09-19T09:31:56.055 DEBUG:teuthology.parallel:result is None 2024-09-19T09:31:56.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.603+0000 7f4bb6b5d640 1 -- 172.21.15.112:0/3067834149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb01025f0 msgr2=0x7f4bb01029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:56.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.603+0000 7f4bb6b5d640 1 --2- 172.21.15.112:0/3067834149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb01025f0 0x7f4bb01029c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40048d0 tx=0x7f4ba4009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:56.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.603+0000 7f4bb6b5d640 1 -- 172.21.15.112:0/3067834149 shutdown_connections 2024-09-19T09:31:56.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.603+0000 7f4bb6b5d640 1 --2- 172.21.15.112:0/3067834149 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bb00fac60 0x7f4bb00fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:56.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.603+0000 7f4bb6b5d640 1 --2- 172.21.15.112:0/3067834149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb01025f0 0x7f4bb01029c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:56.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.603+0000 7f4bb6b5d640 1 -- 172.21.15.112:0/3067834149 >> 172.21.15.112:0/3067834149 conn(0x7f4bb0070c80 msgr2=0x7f4bb0071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.603+0000 7f4bb6b5d640 1 -- 172.21.15.112:0/3067834149 shutdown_connections 2024-09-19T09:31:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.603+0000 7f4bb6b5d640 1 -- 172.21.15.112:0/3067834149 wait complete. 2024-09-19T09:31:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.603+0000 7f4bb6b5d640 1 Processor -- start 2024-09-19T09:31:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.603+0000 7f4bb6b5d640 1 -- start start 2024-09-19T09:31:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.604+0000 7f4bb6b5d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fac60 0x7f4bb01131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.604+0000 7f4bb6b5d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bb01025f0 0x7f4bb0113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.604+0000 7f4bb6b5d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb0113d10 con 0x7f4bb00fac60 2024-09-19T09:31:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.604+0000 7f4bb6b5d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb010d150 con 0x7f4bb01025f0 2024-09-19T09:31:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.604+0000 7f4baffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bb01025f0 0x7f4bb0113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.604+0000 7f4baffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bb01025f0 0x7f4bb0113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.112:55382/0 (socket says 172.21.15.112:55382) 2024-09-19T09:31:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.604+0000 7f4baffff640 1 -- 172.21.15.112:0/3309279849 learned_addr learned my addr 172.21.15.112:0/3309279849 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.604+0000 7f4bb48f9640 1 --2- 172.21.15.112:0/3309279849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fac60 0x7f4bb01131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.604+0000 7f4bb48f9640 1 -- 172.21.15.112:0/3309279849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bb01025f0 msgr2=0x7f4bb0113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:56.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.604+0000 7f4bb48f9640 1 --2- 172.21.15.112:0/3309279849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bb01025f0 0x7f4bb0113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:56.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.604+0000 7f4bb48f9640 1 -- 172.21.15.112:0/3309279849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba4005040 con 0x7f4bb00fac60 2024-09-19T09:31:56.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.604+0000 7f4bb48f9640 1 --2- 172.21.15.112:0/3309279849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fac60 0x7f4bb01131d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40043d0 tx=0x7f4ba4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:56.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.605+0000 7f4bad7fa640 1 -- 172.21.15.112:0/3309279849 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ba4038070 con 0x7f4bb00fac60 2024-09-19T09:31:56.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.605+0000 7f4bad7fa640 1 -- 172.21.15.112:0/3309279849 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4ba40096e0 con 0x7f4bb00fac60 2024-09-19T09:31:56.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.605+0000 7f4bb6b5d640 1 -- 172.21.15.112:0/3309279849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb010d3d0 con 0x7f4bb00fac60 2024-09-19T09:31:56.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.605+0000 7f4bad7fa640 1 -- 172.21.15.112:0/3309279849 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ba402c870 con 0x7f4bb00fac60 2024-09-19T09:31:56.152 INFO:teuthology.orchestra.run.smithi112.stdout:38654705703 2024-09-19T09:31:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.605+0000 7f4bb6b5d640 1 -- 172.21.15.112:0/3309279849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb010d910 con 0x7f4bb00fac60 2024-09-19T09:31:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.606+0000 7f4bb6b5d640 1 -- 172.21.15.112:0/3309279849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb0065810 con 0x7f4bb00fac60 2024-09-19T09:31:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.606+0000 7f4bad7fa640 1 -- 172.21.15.112:0/3309279849 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4ba4030020 con 0x7f4bb00fac60 2024-09-19T09:31:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.606+0000 7f4bad7fa640 1 --2- 172.21.15.112:0/3309279849 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f4ba006ed60 0x7f4ba0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.607+0000 7f4baffff640 1 --2- 172.21.15.112:0/3309279849 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f4ba006ed60 0x7f4ba0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.607+0000 7f4bad7fa640 1 -- 172.21.15.112:0/3309279849 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4ba40adaa0 con 0x7f4bb00fac60 2024-09-19T09:31:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.607+0000 7f4baffff640 1 --2- 172.21.15.112:0/3309279849 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f4ba006ed60 0x7f4ba0071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4bb010ea90 tx=0x7f4b9c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.611+0000 7f4bad7fa640 1 -- 172.21.15.112:0/3309279849 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4ba407afb0 con 0x7f4bb00fac60 2024-09-19T09:31:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.771+0000 7f4bb6b5d640 1 -- 172.21.15.112:0/3309279849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4bb004b720 con 0x7f4bb00fac60 2024-09-19T09:31:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.772+0000 7f4bad7fa640 1 -- 172.21.15.112:0/3309279849 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ba407a950 con 0x7f4bb00fac60 2024-09-19T09:31:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.774+0000 7f4bb6b5d640 1 -- 172.21.15.112:0/3309279849 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f4ba006ed60 msgr2=0x7f4ba0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.774+0000 7f4bb6b5d640 1 --2- 172.21.15.112:0/3309279849 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f4ba006ed60 0x7f4ba0071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4bb010ea90 tx=0x7f4b9c00b040 comp rx=0 tx=0).stop 2024-09-19T09:31:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.774+0000 7f4bb6b5d640 1 -- 172.21.15.112:0/3309279849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fac60 msgr2=0x7f4bb01131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:56.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.774+0000 7f4bb6b5d640 1 --2- 172.21.15.112:0/3309279849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fac60 0x7f4bb01131d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40043d0 tx=0x7f4ba4009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:56.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.774+0000 7f4bb6b5d640 1 -- 172.21.15.112:0/3309279849 shutdown_connections 2024-09-19T09:31:56.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.774+0000 7f4bb6b5d640 1 --2- 172.21.15.112:0/3309279849 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f4ba006ed60 0x7f4ba0071210 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:56.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.774+0000 7f4bb6b5d640 1 --2- 172.21.15.112:0/3309279849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bb01025f0 0x7f4bb0113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:56.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.774+0000 7f4bb6b5d640 1 --2- 172.21.15.112:0/3309279849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fac60 0x7f4bb01131d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:56.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.774+0000 7f4bb6b5d640 1 -- 172.21.15.112:0/3309279849 >> 172.21.15.112:0/3309279849 conn(0x7f4bb0070c80 msgr2=0x7f4bb00f9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:56.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.774+0000 7f4bb6b5d640 1 -- 172.21.15.112:0/3309279849 shutdown_connections 2024-09-19T09:31:56.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:55.774+0000 7f4bb6b5d640 1 -- 172.21.15.112:0/3309279849 wait complete. 2024-09-19T09:31:56.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:56 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3309279849' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:31:56.753 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705703 for osd.0 2024-09-19T09:31:56.754 DEBUG:teuthology.parallel:result is None 2024-09-19T09:31:56.754 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:31:56.754 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:31:56.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:56 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/3309279849' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:31:56.999 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:57.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:57 smithi112 ceph-mon[27605]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:57.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:57 smithi191 ceph-mon[34834]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:58.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.618+0000 7fc5ee4b8640 1 -- 172.21.15.112:0/3138506904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e80fb4d0 msgr2=0x7fc5e80fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:58.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.618+0000 7fc5ee4b8640 1 --2- 172.21.15.112:0/3138506904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e80fb4d0 0x7fc5e80fb940 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0048d0 tx=0x7fc5dc009da0 comp rx=0 tx=0).stop 2024-09-19T09:31:58.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.618+0000 7fc5ee4b8640 1 -- 172.21.15.112:0/3138506904 shutdown_connections 2024-09-19T09:31:58.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.618+0000 7fc5ee4b8640 1 --2- 172.21.15.112:0/3138506904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e80fb4d0 0x7fc5e80fb940 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:58.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.618+0000 7fc5ee4b8640 1 --2- 172.21.15.112:0/3138506904 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5e8101510 0x7fc5e81018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:58.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.618+0000 7fc5ee4b8640 1 -- 172.21.15.112:0/3138506904 >> 172.21.15.112:0/3138506904 conn(0x7fc5e80f7090 msgr2=0x7fc5e80f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:58.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.618+0000 7fc5ee4b8640 1 -- 172.21.15.112:0/3138506904 shutdown_connections 2024-09-19T09:31:58.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.618+0000 7fc5ee4b8640 1 -- 172.21.15.112:0/3138506904 wait complete. 2024-09-19T09:31:58.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.619+0000 7fc5ee4b8640 1 Processor -- start 2024-09-19T09:31:58.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.619+0000 7fc5ee4b8640 1 -- start start 2024-09-19T09:31:58.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.619+0000 7fc5ee4b8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e80fb4d0 0x7fc5e8113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:58.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.619+0000 7fc5ee4b8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5e8101510 0x7fc5e81136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:58.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.619+0000 7fc5ee4b8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e8113cb0 con 0x7fc5e80fb4d0 2024-09-19T09:31:58.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.619+0000 7fc5ee4b8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e8113e20 con 0x7fc5e8101510 2024-09-19T09:31:58.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.619+0000 7fc5e7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e80fb4d0 0x7fc5e8113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:58.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.619+0000 7fc5e7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e80fb4d0 0x7fc5e8113170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40240/0 (socket says 172.21.15.112:40240) 2024-09-19T09:31:58.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.619+0000 7fc5e7fff640 1 -- 172.21.15.112:0/525700742 learned_addr learned my addr 172.21.15.112:0/525700742 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:31:58.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.619+0000 7fc5e77fe640 1 --2- 172.21.15.112:0/525700742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5e8101510 0x7fc5e81136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:58.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.620+0000 7fc5e7fff640 1 -- 172.21.15.112:0/525700742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5e8101510 msgr2=0x7fc5e81136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:58.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.620+0000 7fc5e7fff640 1 --2- 172.21.15.112:0/525700742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5e8101510 0x7fc5e81136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:58.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.620+0000 7fc5e7fff640 1 -- 172.21.15.112:0/525700742 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc005040 con 0x7fc5e80fb4d0 2024-09-19T09:31:58.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.620+0000 7fc5e7fff640 1 --2- 172.21.15.112:0/525700742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e80fb4d0 0x7fc5e8113170 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8002a50 tx=0x7fc5d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:58.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.620+0000 7fc5e4ff9640 1 -- 172.21.15.112:0/525700742 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d8007c30 con 0x7fc5e80fb4d0 2024-09-19T09:31:58.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.620+0000 7fc5e4ff9640 1 -- 172.21.15.112:0/525700742 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc5d800f040 con 0x7fc5e80fb4d0 2024-09-19T09:31:58.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.620+0000 7fc5ee4b8640 1 -- 172.21.15.112:0/525700742 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e810d2a0 con 0x7fc5e80fb4d0 2024-09-19T09:31:58.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.620+0000 7fc5e4ff9640 1 -- 172.21.15.112:0/525700742 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d800da10 con 0x7fc5e80fb4d0 2024-09-19T09:31:58.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.620+0000 7fc5ee4b8640 1 -- 172.21.15.112:0/525700742 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e810d810 con 0x7fc5e80fb4d0 2024-09-19T09:31:58.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.621+0000 7fc5ee4b8640 1 -- 172.21.15.112:0/525700742 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e80fcc10 con 0x7fc5e80fb4d0 2024-09-19T09:31:58.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.621+0000 7fc5e4ff9640 1 -- 172.21.15.112:0/525700742 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc5d800dc80 con 0x7fc5e80fb4d0 2024-09-19T09:31:58.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.622+0000 7fc5e4ff9640 1 --2- 172.21.15.112:0/525700742 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc5d006ed60 0x7fc5d0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:58.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.622+0000 7fc5e4ff9640 1 -- 172.21.15.112:0/525700742 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc5d808d600 con 0x7fc5e80fb4d0 2024-09-19T09:31:58.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.622+0000 7fc5e77fe640 1 --2- 172.21.15.112:0/525700742 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc5d006ed60 0x7fc5d0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:58.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.622+0000 7fc5e77fe640 1 --2- 172.21.15.112:0/525700742 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc5d006ed60 0x7fc5d0071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009ac0 tx=0x7fc5dc035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:58.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.626+0000 7fc5e4ff9640 1 -- 172.21.15.112:0/525700742 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc5d804d2a0 con 0x7fc5e80fb4d0 2024-09-19T09:31:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.781+0000 7fc5ee4b8640 1 -- 172.21.15.112:0/525700742 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc5e810e820 con 0x7fc5d006ed60 2024-09-19T09:31:58.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.782+0000 7fc5e4ff9640 1 -- 172.21.15.112:0/525700742 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27965 (secure 0 0 0) 0x7fc5e810e820 con 0x7fc5d006ed60 2024-09-19T09:31:58.784 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:31:58.785 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-19T09:31:58.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.785+0000 7fc5ee4b8640 1 -- 172.21.15.112:0/525700742 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc5d006ed60 msgr2=0x7fc5d0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:58.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.785+0000 7fc5ee4b8640 1 --2- 172.21.15.112:0/525700742 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc5d006ed60 0x7fc5d0071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009ac0 tx=0x7fc5dc035040 comp rx=0 tx=0).stop 2024-09-19T09:31:58.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.785+0000 7fc5ee4b8640 1 -- 172.21.15.112:0/525700742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e80fb4d0 msgr2=0x7fc5e8113170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:58.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.785+0000 7fc5ee4b8640 1 --2- 172.21.15.112:0/525700742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e80fb4d0 0x7fc5e8113170 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8002a50 tx=0x7fc5d8004600 comp rx=0 tx=0).stop 2024-09-19T09:31:58.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.785+0000 7fc5ee4b8640 1 -- 172.21.15.112:0/525700742 shutdown_connections 2024-09-19T09:31:58.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.785+0000 7fc5ee4b8640 1 --2- 172.21.15.112:0/525700742 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fc5d006ed60 0x7fc5d0071210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:58.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.785+0000 7fc5ee4b8640 1 --2- 172.21.15.112:0/525700742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5e8101510 0x7fc5e81136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:58.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.785+0000 7fc5ee4b8640 1 --2- 172.21.15.112:0/525700742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e80fb4d0 0x7fc5e8113170 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:58.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.785+0000 7fc5ee4b8640 1 -- 172.21.15.112:0/525700742 >> 172.21.15.112:0/525700742 conn(0x7fc5e80f7090 msgr2=0x7fc5e80659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:58.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.785+0000 7fc5ee4b8640 1 -- 172.21.15.112:0/525700742 shutdown_connections 2024-09-19T09:31:58.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:31:58.785+0000 7fc5ee4b8640 1 -- 172.21.15.112:0/525700742 wait complete. 2024-09-19T09:31:59.520 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-19T09:31:57.765202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787976,"kb_used_data":3824,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682936,"statfs":{"total":575970213888,"available":574139326464,"internally_reserved":0,"allocated":3915776,"data_stored":2576039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001832"},"pg_stats":[{"pgid":"1.0","version":"24'72","reported_seq":129,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T09:31:06.495160+0000","last_change":"2024-09-19T09:30:42.882813+0000","last_active":"2024-09-19T09:31:06.495160+0000","last_peered":"2024-09-19T09:31:06.495160+0000","last_clean":"2024-09-19T09:31:06.495160+0000","last_became_active":"2024-09-19T09:30:42.882512+0000","last_became_peered":"2024-09-19T09:30:42.882512+0000","last_unstale":"2024-09-19T09:31:06.495160+0000","last_undegraded":"2024-09-19T09:31:06.495160+0000","last_fullsized":"2024-09-19T09:31:06.495160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:29:56.540331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:29:56.540331+0000","last_clean_scrub_stamp":"2024-09-19T09:29:56.540331+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:11.339734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]}]},{"osd":4,"up_from":33,"seq":141733920785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 09:31:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.503},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Sep 19 09:31:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Sep 19 09:31:45 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Sep 19 09:31:45 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.36399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298284,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446868,"statfs":{"total":95995035648,"available":95689592832,"internally_reserved":0,"allocated":946176,"data_stored":724303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 09:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Sep 19 09:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.44},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Sep 19 09:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Sep 19 09:31:44 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 09:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.442}]},{"osd":1,"last update":"Thu Sep 19 09:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Sep 19 09:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.627}]},{"osd":4,"last update":"Thu Sep 19 09:31:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446864,"statfs":{"total":95995035648,"available":95689588736,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 09:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.314,"15min":0.30599999999999999},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.32000000000000001,"15min":0.312},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.27500000000000002}]},{"osd":2,"last update":"Thu Sep 19 09:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.255},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Sep 19 09:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Sep 19 09:31:45 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298284,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446868,"statfs":{"total":95995035648,"available":95689592832,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 19 09:31:28 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.307,"15min":0.30599999999999999},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.44700000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.29699999999999999},"min":{"1min":0.24099999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Sep 19 09:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Sep 19 09:31:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.623}]},{"osd":4,"last update":"Thu Sep 19 09:31:43 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:31:59.521 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:31:59.770 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:31:59.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:59 smithi191 ceph-mon[34834]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:59.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:31:59 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:31:59.891 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:59 smithi112 ceph-mon[27605]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:31:59.891 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:31:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:32:00.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:00 smithi191 ceph-mon[34834]: from='client.14408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:32:00.902 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:00 smithi112 ceph-mon[27605]: from='client.14408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:32:01.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.423+0000 7f8573932640 1 -- 172.21.15.112:0/3903317493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f856c0fbd00 msgr2=0x7f856c100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.423+0000 7f8573932640 1 --2- 172.21.15.112:0/3903317493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f856c0fbd00 0x7f856c100320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f855c0048d0 tx=0x7f855c009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.423+0000 7f8573932640 1 -- 172.21.15.112:0/3903317493 shutdown_connections 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.423+0000 7f8573932640 1 --2- 172.21.15.112:0/3903317493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f856c0fbd00 0x7f856c100320 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.423+0000 7f8573932640 1 --2- 172.21.15.112:0/3903317493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f856c0fb360 0x7f856c0fb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.423+0000 7f8573932640 1 -- 172.21.15.112:0/3903317493 >> 172.21.15.112:0/3903317493 conn(0x7f856c0f7000 msgr2=0x7f856c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.423+0000 7f8573932640 1 -- 172.21.15.112:0/3903317493 shutdown_connections 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.423+0000 7f8573932640 1 -- 172.21.15.112:0/3903317493 wait complete. 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.424+0000 7f8573932640 1 Processor -- start 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.424+0000 7f8573932640 1 -- start start 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.424+0000 7f8573932640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f856c0fb360 0x7f856c119850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.424+0000 7f8573932640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f856c0fbd00 0x7f856c119d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.424+0000 7f8573932640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c11a3e0 con 0x7f856c0fb360 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.424+0000 7f8573932640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c1137f0 con 0x7f856c0fbd00 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.424+0000 7f85716ce640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f856c0fb360 0x7f856c119850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.424+0000 7f85716ce640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f856c0fb360 0x7f856c119850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40254/0 (socket says 172.21.15.112:40254) 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.424+0000 7f85716ce640 1 -- 172.21.15.112:0/1371247991 learned_addr learned my addr 172.21.15.112:0/1371247991 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.424+0000 7f8570ecd640 1 --2- 172.21.15.112:0/1371247991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f856c0fbd00 0x7f856c119d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.425+0000 7f85716ce640 1 -- 172.21.15.112:0/1371247991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f856c0fbd00 msgr2=0x7f856c119d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.425+0000 7f85716ce640 1 --2- 172.21.15.112:0/1371247991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f856c0fbd00 0x7f856c119d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.425+0000 7f85716ce640 1 -- 172.21.15.112:0/1371247991 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c005040 con 0x7f856c0fb360 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.425+0000 7f85716ce640 1 --2- 172.21.15.112:0/1371247991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f856c0fb360 0x7f856c119850 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8568002a50 tx=0x7f8568004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.425+0000 7f8561ffb640 1 -- 172.21.15.112:0/1371247991 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8568007c30 con 0x7f856c0fb360 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.425+0000 7f8573932640 1 -- 172.21.15.112:0/1371247991 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c113ad0 con 0x7f856c0fb360 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.425+0000 7f8561ffb640 1 -- 172.21.15.112:0/1371247991 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f856800f040 con 0x7f856c0fb360 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.425+0000 7f8561ffb640 1 -- 172.21.15.112:0/1371247991 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f856800da90 con 0x7f856c0fb360 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.425+0000 7f8573932640 1 -- 172.21.15.112:0/1371247991 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c113fc0 con 0x7f856c0fb360 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.426+0000 7f8573932640 1 -- 172.21.15.112:0/1371247991 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c066330 con 0x7f856c0fb360 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.426+0000 7f8561ffb640 1 -- 172.21.15.112:0/1371247991 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f856800dd00 con 0x7f856c0fb360 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.427+0000 7f8561ffb640 1 --2- 172.21.15.112:0/1371247991 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f855806ed60 0x7f8558071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.427+0000 7f8561ffb640 1 -- 172.21.15.112:0/1371247991 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f856808d700 con 0x7f856c0fb360 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.427+0000 7f8570ecd640 1 --2- 172.21.15.112:0/1371247991 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f855806ed60 0x7f8558071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.427+0000 7f8570ecd640 1 --2- 172.21.15.112:0/1371247991 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f855806ed60 0x7f8558071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f856c114c10 tx=0x7f855c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.431+0000 7f8561ffb640 1 -- 172.21.15.112:0/1371247991 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f856804d2a0 con 0x7f856c0fb360 2024-09-19T09:32:01.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.584+0000 7f8573932640 1 -- 172.21.15.112:0/1371247991 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f856c10fbb0 con 0x7f855806ed60 2024-09-19T09:32:01.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.585+0000 7f8561ffb640 1 -- 172.21.15.112:0/1371247991 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27936 (secure 0 0 0) 0x7f856c10fbb0 con 0x7f855806ed60 2024-09-19T09:32:01.587 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:32:01.587 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-19T09:32:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.587+0000 7f8573932640 1 -- 172.21.15.112:0/1371247991 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f855806ed60 msgr2=0x7f8558071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.587+0000 7f8573932640 1 --2- 172.21.15.112:0/1371247991 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f855806ed60 0x7f8558071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f856c114c10 tx=0x7f855c035040 comp rx=0 tx=0).stop 2024-09-19T09:32:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.587+0000 7f8573932640 1 -- 172.21.15.112:0/1371247991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f856c0fb360 msgr2=0x7f856c119850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.587+0000 7f8573932640 1 --2- 172.21.15.112:0/1371247991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f856c0fb360 0x7f856c119850 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8568002a50 tx=0x7f8568004600 comp rx=0 tx=0).stop 2024-09-19T09:32:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.587+0000 7f8573932640 1 -- 172.21.15.112:0/1371247991 shutdown_connections 2024-09-19T09:32:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.587+0000 7f8573932640 1 --2- 172.21.15.112:0/1371247991 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f855806ed60 0x7f8558071210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.587+0000 7f8573932640 1 --2- 172.21.15.112:0/1371247991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f856c0fbd00 0x7f856c119d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.587+0000 7f8573932640 1 --2- 172.21.15.112:0/1371247991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f856c0fb360 0x7f856c119850 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.587+0000 7f8573932640 1 -- 172.21.15.112:0/1371247991 >> 172.21.15.112:0/1371247991 conn(0x7f856c0f7000 msgr2=0x7f856c0f8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:01.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.587+0000 7f8573932640 1 -- 172.21.15.112:0/1371247991 shutdown_connections 2024-09-19T09:32:01.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:01.587+0000 7f8573932640 1 -- 172.21.15.112:0/1371247991 wait complete. 2024-09-19T09:32:01.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:01 smithi191 ceph-mon[34834]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:01.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:01 smithi112 ceph-mon[27605]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:02.214 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-19T09:31:59.765535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787976,"kb_used_data":3824,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682936,"statfs":{"total":575970213888,"available":574139326464,"internally_reserved":0,"allocated":3915776,"data_stored":2576039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001924"},"pg_stats":[{"pgid":"1.0","version":"24'72","reported_seq":129,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T09:31:06.495160+0000","last_change":"2024-09-19T09:30:42.882813+0000","last_active":"2024-09-19T09:31:06.495160+0000","last_peered":"2024-09-19T09:31:06.495160+0000","last_clean":"2024-09-19T09:31:06.495160+0000","last_became_active":"2024-09-19T09:30:42.882512+0000","last_became_peered":"2024-09-19T09:30:42.882512+0000","last_unstale":"2024-09-19T09:31:06.495160+0000","last_undegraded":"2024-09-19T09:31:06.495160+0000","last_fullsized":"2024-09-19T09:31:06.495160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:29:56.540331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:29:56.540331+0000","last_clean_scrub_stamp":"2024-09-19T09:29:56.540331+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:11.339734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]}]},{"osd":4,"up_from":33,"seq":141733920786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 09:31:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Sep 19 09:31:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.315}]},{"osd":2,"last update":"Thu Sep 19 09:31:45 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.375},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.44}]},{"osd":3,"last update":"Thu Sep 19 09:31:45 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.28100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298284,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446868,"statfs":{"total":95995035648,"available":95689592832,"internally_reserved":0,"allocated":946176,"data_stored":724303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 09:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Sep 19 09:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.44},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Sep 19 09:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Sep 19 09:31:44 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 09:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.442}]},{"osd":1,"last update":"Thu Sep 19 09:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Sep 19 09:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.627}]},{"osd":4,"last update":"Thu Sep 19 09:31:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446864,"statfs":{"total":95995035648,"available":95689588736,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 09:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.314,"15min":0.30599999999999999},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.32000000000000001,"15min":0.312},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.27500000000000002}]},{"osd":2,"last update":"Thu Sep 19 09:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.255},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Sep 19 09:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Sep 19 09:31:45 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298284,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446868,"statfs":{"total":95995035648,"available":95689592832,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 19 09:31:28 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.307,"15min":0.30599999999999999},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.44700000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.29699999999999999},"min":{"1min":0.24099999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Sep 19 09:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.249},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Sep 19 09:31:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Sep 19 09:31:43 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:32:02.215 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:32:02.215 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T09:32:02.215 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T09:32:02.215 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T09:32:02.461 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:03.654 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:03 smithi112 ceph-mon[27605]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:32:03.654 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:03 smithi112 ceph-mon[27605]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:03.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:03 smithi191 ceph-mon[34834]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:32:03.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:03 smithi191 ceph-mon[34834]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:04.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.139+0000 7fd349599640 1 -- 172.21.15.112:0/2603717517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd344102580 msgr2=0x7fd344102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:04.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.139+0000 7fd349599640 1 --2- 172.21.15.112:0/2603717517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd344102580 0x7fd344102950 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd3340048d0 tx=0x7fd334009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.139+0000 7fd349599640 1 -- 172.21.15.112:0/2603717517 shutdown_connections 2024-09-19T09:32:04.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.139+0000 7fd349599640 1 --2- 172.21.15.112:0/2603717517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd344102f20 0x7fd3440fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.139+0000 7fd349599640 1 --2- 172.21.15.112:0/2603717517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd344102580 0x7fd344102950 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.139+0000 7fd349599640 1 -- 172.21.15.112:0/2603717517 >> 172.21.15.112:0/2603717517 conn(0x7fd3440f81a0 msgr2=0x7fd3440fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:04.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.139+0000 7fd349599640 1 -- 172.21.15.112:0/2603717517 shutdown_connections 2024-09-19T09:32:04.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.139+0000 7fd349599640 1 -- 172.21.15.112:0/2603717517 wait complete. 2024-09-19T09:32:04.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.140+0000 7fd349599640 1 Processor -- start 2024-09-19T09:32:04.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.140+0000 7fd349599640 1 -- start start 2024-09-19T09:32:04.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd349599640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd344102580 0x7fd344113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd349599640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd344102f20 0x7fd344113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd349599640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd344113e10 con 0x7fd344102f20 2024-09-19T09:32:04.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd349599640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34410d200 con 0x7fd344102580 2024-09-19T09:32:04.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd33a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd344102f20 0x7fd344113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd33a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd344102f20 0x7fd344113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40282/0 (socket says 172.21.15.112:40282) 2024-09-19T09:32:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd33a7fc640 1 -- 172.21.15.112:0/3311965662 learned_addr learned my addr 172.21.15.112:0/3311965662 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd342ffd640 1 --2- 172.21.15.112:0/3311965662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd344102580 0x7fd344113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd33a7fc640 1 -- 172.21.15.112:0/3311965662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd344102580 msgr2=0x7fd344113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd33a7fc640 1 --2- 172.21.15.112:0/3311965662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd344102580 0x7fd344113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd33a7fc640 1 -- 172.21.15.112:0/3311965662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd334005040 con 0x7fd344102f20 2024-09-19T09:32:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd33a7fc640 1 --2- 172.21.15.112:0/3311965662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd344102f20 0x7fd344113780 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00b540 tx=0x7fd32c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd33bfff640 1 -- 172.21.15.112:0/3311965662 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd32c00f6f0 con 0x7fd344102f20 2024-09-19T09:32:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd349599640 1 -- 172.21.15.112:0/3311965662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34410d4e0 con 0x7fd344102f20 2024-09-19T09:32:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd33bfff640 1 -- 172.21.15.112:0/3311965662 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd32c00fcf0 con 0x7fd344102f20 2024-09-19T09:32:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd33bfff640 1 -- 172.21.15.112:0/3311965662 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd32c0103a0 con 0x7fd344102f20 2024-09-19T09:32:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.141+0000 7fd349599640 1 -- 172.21.15.112:0/3311965662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34410da00 con 0x7fd344102f20 2024-09-19T09:32:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.143+0000 7fd349599640 1 -- 172.21.15.112:0/3311965662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3440fdd00 con 0x7fd344102f20 2024-09-19T09:32:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.143+0000 7fd33bfff640 1 -- 172.21.15.112:0/3311965662 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd32c00f850 con 0x7fd344102f20 2024-09-19T09:32:04.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.143+0000 7fd33bfff640 1 --2- 172.21.15.112:0/3311965662 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd33006ed60 0x7fd330071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.143+0000 7fd342ffd640 1 --2- 172.21.15.112:0/3311965662 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd33006ed60 0x7fd330071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.143+0000 7fd33bfff640 1 -- 172.21.15.112:0/3311965662 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd32c08ddc0 con 0x7fd344102f20 2024-09-19T09:32:04.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.144+0000 7fd342ffd640 1 --2- 172.21.15.112:0/3311965662 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd33006ed60 0x7fd330071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd334000c00 tx=0x7fd334035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:04.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.148+0000 7fd33bfff640 1 -- 172.21.15.112:0/3311965662 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd32c05b2a0 con 0x7fd344102f20 2024-09-19T09:32:04.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.337+0000 7fd349599640 1 -- 172.21.15.112:0/3311965662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd3440fbda0 con 0x7fd344102f20 2024-09-19T09:32:04.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.338+0000 7fd33bfff640 1 -- 172.21.15.112:0/3311965662 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd32c05ac40 con 0x7fd344102f20 2024-09-19T09:32:04.339 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:32:04.339 INFO:teuthology.orchestra.run.smithi112.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T09:32:04.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.339+0000 7fd349599640 1 -- 172.21.15.112:0/3311965662 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd33006ed60 msgr2=0x7fd330071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:04.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.339+0000 7fd349599640 1 --2- 172.21.15.112:0/3311965662 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd33006ed60 0x7fd330071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd334000c00 tx=0x7fd334035040 comp rx=0 tx=0).stop 2024-09-19T09:32:04.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.339+0000 7fd349599640 1 -- 172.21.15.112:0/3311965662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd344102f20 msgr2=0x7fd344113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:04.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.339+0000 7fd349599640 1 --2- 172.21.15.112:0/3311965662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd344102f20 0x7fd344113780 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00b540 tx=0x7fd32c0091a0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.339+0000 7fd349599640 1 -- 172.21.15.112:0/3311965662 shutdown_connections 2024-09-19T09:32:04.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.339+0000 7fd349599640 1 --2- 172.21.15.112:0/3311965662 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd33006ed60 0x7fd330071210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.340+0000 7fd349599640 1 --2- 172.21.15.112:0/3311965662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd344102f20 0x7fd344113780 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.340+0000 7fd349599640 1 --2- 172.21.15.112:0/3311965662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd344102580 0x7fd344113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.340+0000 7fd349599640 1 -- 172.21.15.112:0/3311965662 >> 172.21.15.112:0/3311965662 conn(0x7fd3440f81a0 msgr2=0x7fd3440f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:04.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.340+0000 7fd349599640 1 -- 172.21.15.112:0/3311965662 shutdown_connections 2024-09-19T09:32:04.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:04.340+0000 7fd349599640 1 -- 172.21.15.112:0/3311965662 wait complete. 2024-09-19T09:32:04.636 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:04 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3311965662' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:32:04.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:04 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/3311965662' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:32:05.038 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T09:32:05.038 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T09:32:05.038 INFO:teuthology.run_tasks:Running task print... 2024-09-19T09:32:05.048 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-09-19T09:32:05.048 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:32:05.063 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-19T09:32:05.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-19T09:32:05.308 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:05.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:05 smithi112 ceph-mon[27605]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:05.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:05 smithi191 ceph-mon[34834]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:06.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.939+0000 7f36271d8640 1 -- 172.21.15.112:0/3658538063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36200fc700 msgr2=0x7f36200fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:06.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.939+0000 7f36271d8640 1 --2- 172.21.15.112:0/3658538063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36200fc700 0x7f36200fcb70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f360c0048d0 tx=0x7f360c009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:06.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.939+0000 7f36271d8640 1 -- 172.21.15.112:0/3658538063 shutdown_connections 2024-09-19T09:32:06.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.939+0000 7f36271d8640 1 --2- 172.21.15.112:0/3658538063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36200fc700 0x7f36200fcb70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:06.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.939+0000 7f36271d8640 1 --2- 172.21.15.112:0/3658538063 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36200fb430 0x7f36200fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:06.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.939+0000 7f36271d8640 1 -- 172.21.15.112:0/3658538063 >> 172.21.15.112:0/3658538063 conn(0x7f36200f6c10 msgr2=0x7f36200f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:06.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.939+0000 7f36271d8640 1 -- 172.21.15.112:0/3658538063 shutdown_connections 2024-09-19T09:32:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.939+0000 7f36271d8640 1 -- 172.21.15.112:0/3658538063 wait complete. 2024-09-19T09:32:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.940+0000 7f36271d8640 1 Processor -- start 2024-09-19T09:32:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.940+0000 7f36271d8640 1 -- start start 2024-09-19T09:32:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.940+0000 7f36271d8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36200fb430 0x7f362010fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.940+0000 7f36271d8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36200fc700 0x7f36201122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.940+0000 7f36271d8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3620065c60 con 0x7f36200fb430 2024-09-19T09:32:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.940+0000 7f36271d8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3620065dd0 con 0x7f36200fc700 2024-09-19T09:32:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.940+0000 7f3624f74640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36200fb430 0x7f362010fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.940+0000 7f3624f74640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36200fb430 0x7f362010fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40300/0 (socket says 172.21.15.112:40300) 2024-09-19T09:32:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.940+0000 7f3624f74640 1 -- 172.21.15.112:0/1693599891 learned_addr learned my addr 172.21.15.112:0/1693599891 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.940+0000 7f361ffff640 1 --2- 172.21.15.112:0/1693599891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36200fc700 0x7f36201122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.940+0000 7f3624f74640 1 -- 172.21.15.112:0/1693599891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36200fc700 msgr2=0x7f36201122f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.940+0000 7f3624f74640 1 --2- 172.21.15.112:0/1693599891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36200fc700 0x7f36201122f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.940+0000 7f3624f74640 1 -- 172.21.15.112:0/1693599891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c005040 con 0x7f36200fb430 2024-09-19T09:32:06.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.941+0000 7f361ffff640 1 --2- 172.21.15.112:0/1693599891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36200fc700 0x7f36201122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:06.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.941+0000 7f3624f74640 1 --2- 172.21.15.112:0/1693599891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36200fb430 0x7f362010fda0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f361400c790 tx=0x7f36140043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:06.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.941+0000 7f361d7fa640 1 -- 172.21.15.112:0/1693599891 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361400a820 con 0x7f36200fb430 2024-09-19T09:32:06.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.941+0000 7f36271d8640 1 -- 172.21.15.112:0/1693599891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3620112890 con 0x7f36200fb430 2024-09-19T09:32:06.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.941+0000 7f361d7fa640 1 -- 172.21.15.112:0/1693599891 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f361400ae20 con 0x7f36200fb430 2024-09-19T09:32:06.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.941+0000 7f361d7fa640 1 -- 172.21.15.112:0/1693599891 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36140113a0 con 0x7f36200fb430 2024-09-19T09:32:06.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.941+0000 7f36271d8640 1 -- 172.21.15.112:0/1693599891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3620112e00 con 0x7f36200fb430 2024-09-19T09:32:06.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.942+0000 7f36271d8640 1 -- 172.21.15.112:0/1693599891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36200fa890 con 0x7f36200fb430 2024-09-19T09:32:06.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.944+0000 7f361d7fa640 1 -- 172.21.15.112:0/1693599891 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3614012400 con 0x7f36200fb430 2024-09-19T09:32:06.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.944+0000 7f361d7fa640 1 --2- 172.21.15.112:0/1693599891 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f361006ed60 0x7f3610071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:06.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.944+0000 7f361d7fa640 1 -- 172.21.15.112:0/1693599891 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f361408ea00 con 0x7f36200fb430 2024-09-19T09:32:06.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.944+0000 7f361ffff640 1 --2- 172.21.15.112:0/1693599891 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f361006ed60 0x7f3610071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:06.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.945+0000 7f361ffff640 1 --2- 172.21.15.112:0/1693599891 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f361006ed60 0x7f3610071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f360c004540 tx=0x7f360c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:06.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:06.947+0000 7f361d7fa640 1 -- 172.21.15.112:0/1693599891 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f361405bf80 con 0x7f36200fb430 2024-09-19T09:32:07.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:07.107+0000 7f36271d8640 1 -- 172.21.15.112:0/1693599891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f362004b720 con 0x7f36200fb430 2024-09-19T09:32:07.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:07.112+0000 7f361d7fa640 1 -- 172.21.15.112:0/1693599891 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f361405b920 con 0x7f36200fb430 2024-09-19T09:32:07.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:07.114+0000 7f36271d8640 1 -- 172.21.15.112:0/1693599891 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f361006ed60 msgr2=0x7f3610071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:07.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:07.114+0000 7f36271d8640 1 --2- 172.21.15.112:0/1693599891 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f361006ed60 0x7f3610071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f360c004540 tx=0x7f360c035040 comp rx=0 tx=0).stop 2024-09-19T09:32:07.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:07.114+0000 7f36271d8640 1 -- 172.21.15.112:0/1693599891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36200fb430 msgr2=0x7f362010fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:07.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:07.114+0000 7f36271d8640 1 --2- 172.21.15.112:0/1693599891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36200fb430 0x7f362010fda0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f361400c790 tx=0x7f36140043c0 comp rx=0 tx=0).stop 2024-09-19T09:32:07.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:07.114+0000 7f36271d8640 1 -- 172.21.15.112:0/1693599891 shutdown_connections 2024-09-19T09:32:07.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:07.114+0000 7f36271d8640 1 --2- 172.21.15.112:0/1693599891 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f361006ed60 0x7f3610071210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:07.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:07.114+0000 7f36271d8640 1 --2- 172.21.15.112:0/1693599891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36200fc700 0x7f36201122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:07.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:07.114+0000 7f36271d8640 1 --2- 172.21.15.112:0/1693599891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36200fb430 0x7f362010fda0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:07.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:07.114+0000 7f36271d8640 1 -- 172.21.15.112:0/1693599891 >> 172.21.15.112:0/1693599891 conn(0x7f36200f6c10 msgr2=0x7f36200f8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:07.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:07.114+0000 7f36271d8640 1 -- 172.21.15.112:0/1693599891 shutdown_connections 2024-09-19T09:32:07.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:07.114+0000 7f36271d8640 1 -- 172.21.15.112:0/1693599891 wait complete. 2024-09-19T09:32:07.738 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:07 smithi112 ceph-mon[27605]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:07.738 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:07 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1693599891' entity='client.admin' 2024-09-19T09:32:07.738 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:07 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:07.738 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:07 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:07.738 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:07 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:07.738 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:07 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:07.761 INFO:teuthology.run_tasks:Running task print... 2024-09-19T09:32:07.770 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-19T09:32:07.770 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:32:07.787 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-19T09:32:07.788 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T09:32:07.789 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:07 smithi191 ceph-mon[34834]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:07.790 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:07 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/1693599891' entity='client.admin' 2024-09-19T09:32:07.790 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:07 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:07.790 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:07 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:07.790 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:07 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:07.790 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:07 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:08.041 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:09.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.710+0000 7fb9b96c1640 1 -- 172.21.15.112:0/235391622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9b40fb450 msgr2=0x7fb9b40fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:09.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.710+0000 7fb9b96c1640 1 --2- 172.21.15.112:0/235391622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9b40fb450 0x7fb9b40fb860 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009c50 tx=0x7fb9a4004d10 comp rx=0 tx=0).stop 2024-09-19T09:32:09.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.710+0000 7fb9b96c1640 1 -- 172.21.15.112:0/235391622 shutdown_connections 2024-09-19T09:32:09.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.710+0000 7fb9b96c1640 1 --2- 172.21.15.112:0/235391622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9b40fc720 0x7fb9b40fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:09.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.710+0000 7fb9b96c1640 1 --2- 172.21.15.112:0/235391622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9b40fb450 0x7fb9b40fb860 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:09.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.710+0000 7fb9b96c1640 1 -- 172.21.15.112:0/235391622 >> 172.21.15.112:0/235391622 conn(0x7fb9b40f6c10 msgr2=0x7fb9b40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:09.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.710+0000 7fb9b96c1640 1 -- 172.21.15.112:0/235391622 shutdown_connections 2024-09-19T09:32:09.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.710+0000 7fb9b96c1640 1 -- 172.21.15.112:0/235391622 wait complete. 2024-09-19T09:32:09.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.710+0000 7fb9b96c1640 1 Processor -- start 2024-09-19T09:32:09.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.710+0000 7fb9b96c1640 1 -- start start 2024-09-19T09:32:09.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9b96c1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9b40fb450 0x7fb9b410bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:09.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9b96c1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9b40fc720 0x7fb9b410c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:09.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9b96c1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b410cb10 con 0x7fb9b40fc720 2024-09-19T09:32:09.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9b96c1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b410d330 con 0x7fb9b40fb450 2024-09-19T09:32:09.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9b27fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9b40fc720 0x7fb9b410c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:09.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9b27fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9b40fc720 0x7fb9b410c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53412/0 (socket says 172.21.15.112:53412) 2024-09-19T09:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9b27fc640 1 -- 172.21.15.112:0/1348010175 learned_addr learned my addr 172.21.15.112:0/1348010175 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9b2ffd640 1 --2- 172.21.15.112:0/1348010175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9b40fb450 0x7fb9b410bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9b27fc640 1 -- 172.21.15.112:0/1348010175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9b40fb450 msgr2=0x7fb9b410bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9b27fc640 1 --2- 172.21.15.112:0/1348010175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9b40fb450 0x7fb9b410bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9b27fc640 1 -- 172.21.15.112:0/1348010175 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a40098b0 con 0x7fb9b40fc720 2024-09-19T09:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9b27fc640 1 --2- 172.21.15.112:0/1348010175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9b40fc720 0x7fb9b410c4c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb99c002a50 tx=0x7fb99c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9ab7fe640 1 -- 172.21.15.112:0/1348010175 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb99c007c30 con 0x7fb9b40fc720 2024-09-19T09:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9ab7fe640 1 -- 172.21.15.112:0/1348010175 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb99c00f040 con 0x7fb9b40fc720 2024-09-19T09:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9b96c1640 1 -- 172.21.15.112:0/1348010175 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b410d5c0 con 0x7fb9b40fc720 2024-09-19T09:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9ab7fe640 1 -- 172.21.15.112:0/1348010175 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb99c00db50 con 0x7fb9b40fc720 2024-09-19T09:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.711+0000 7fb9b96c1640 1 -- 172.21.15.112:0/1348010175 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b410db60 con 0x7fb9b40fc720 2024-09-19T09:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.712+0000 7fb9b96c1640 1 -- 172.21.15.112:0/1348010175 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b40fa8b0 con 0x7fb9b40fc720 2024-09-19T09:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.713+0000 7fb9ab7fe640 1 -- 172.21.15.112:0/1348010175 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fb99c00dcb0 con 0x7fb9b40fc720 2024-09-19T09:32:09.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.713+0000 7fb9ab7fe640 1 --2- 172.21.15.112:0/1348010175 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb9a006ed60 0x7fb9a0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:09.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.713+0000 7fb9ab7fe640 1 -- 172.21.15.112:0/1348010175 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb99c08ddb0 con 0x7fb9b40fc720 2024-09-19T09:32:09.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.713+0000 7fb9b2ffd640 1 --2- 172.21.15.112:0/1348010175 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb9a006ed60 0x7fb9a0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:09.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.714+0000 7fb9b2ffd640 1 --2- 172.21.15.112:0/1348010175 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb9a006ed60 0x7fb9a0071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4000f80 tx=0x7fb9a4004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:09.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.717+0000 7fb9ab7fe640 1 -- 172.21.15.112:0/1348010175 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb99c05b210 con 0x7fb9b40fc720 2024-09-19T09:32:09.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:09 smithi191 ceph-mon[34834]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:09.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.887+0000 7fb9b96c1640 1 -- 172.21.15.112:0/1348010175 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9b410de90 con 0x7fb9a006ed60 2024-09-19T09:32:09.889 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:09 smithi112 ceph-mon[27605]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:09.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.888+0000 7fb9ab7fe640 1 -- 172.21.15.112:0/1348010175 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fb9b410de90 con 0x7fb9a006ed60 2024-09-19T09:32:09.889 INFO:teuthology.orchestra.run.smithi112.stdout:Backend: cephadm 2024-09-19T09:32:09.889 INFO:teuthology.orchestra.run.smithi112.stdout:Available: Yes 2024-09-19T09:32:09.889 INFO:teuthology.orchestra.run.smithi112.stdout:Paused: No 2024-09-19T09:32:09.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.890+0000 7fb9b96c1640 1 -- 172.21.15.112:0/1348010175 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb9a006ed60 msgr2=0x7fb9a0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:09.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.890+0000 7fb9b96c1640 1 --2- 172.21.15.112:0/1348010175 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb9a006ed60 0x7fb9a0071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4000f80 tx=0x7fb9a4004d10 comp rx=0 tx=0).stop 2024-09-19T09:32:09.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.890+0000 7fb9b96c1640 1 -- 172.21.15.112:0/1348010175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9b40fc720 msgr2=0x7fb9b410c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:09.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.890+0000 7fb9b96c1640 1 --2- 172.21.15.112:0/1348010175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9b40fc720 0x7fb9b410c4c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb99c002a50 tx=0x7fb99c004600 comp rx=0 tx=0).stop 2024-09-19T09:32:09.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.890+0000 7fb9b96c1640 1 -- 172.21.15.112:0/1348010175 shutdown_connections 2024-09-19T09:32:09.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.890+0000 7fb9b96c1640 1 --2- 172.21.15.112:0/1348010175 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb9a006ed60 0x7fb9a0071210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:09.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.890+0000 7fb9b96c1640 1 --2- 172.21.15.112:0/1348010175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9b40fc720 0x7fb9b410c4c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:09.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.890+0000 7fb9b96c1640 1 --2- 172.21.15.112:0/1348010175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9b40fb450 0x7fb9b410bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:09.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.890+0000 7fb9b96c1640 1 -- 172.21.15.112:0/1348010175 >> 172.21.15.112:0/1348010175 conn(0x7fb9b40f6c10 msgr2=0x7fb9b40f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:09.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.890+0000 7fb9b96c1640 1 -- 172.21.15.112:0/1348010175 shutdown_connections 2024-09-19T09:32:09.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:09.890+0000 7fb9b96c1640 1 -- 172.21.15.112:0/1348010175 wait complete. 2024-09-19T09:32:10.578 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T09:32:10.822 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:11.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:11 smithi191 ceph-mon[34834]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:11.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:11 smithi191 ceph-mon[34834]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:11.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:11 smithi112 ceph-mon[27605]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:11.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:11 smithi112 ceph-mon[27605]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:12.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.517+0000 7f21533c2640 1 -- 172.21.15.112:0/625997684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f214c0fd820 msgr2=0x7f214c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.517+0000 7f21533c2640 1 --2- 172.21.15.112:0/625997684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f214c0fd820 0x7f214c0fdc90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f213c0048d0 tx=0x7f213c009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.517+0000 7f21533c2640 1 -- 172.21.15.112:0/625997684 shutdown_connections 2024-09-19T09:32:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.517+0000 7f21533c2640 1 --2- 172.21.15.112:0/625997684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f214c0fd820 0x7f214c0fdc90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.517+0000 7f21533c2640 1 --2- 172.21.15.112:0/625997684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f214c0fc550 0x7f214c0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.517+0000 7f21533c2640 1 -- 172.21.15.112:0/625997684 >> 172.21.15.112:0/625997684 conn(0x7f214c0f7d30 msgr2=0x7f214c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.517+0000 7f21533c2640 1 -- 172.21.15.112:0/625997684 shutdown_connections 2024-09-19T09:32:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.517+0000 7f21533c2640 1 -- 172.21.15.112:0/625997684 wait complete. 2024-09-19T09:32:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.517+0000 7f21533c2640 1 Processor -- start 2024-09-19T09:32:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.518+0000 7f21533c2640 1 -- start start 2024-09-19T09:32:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.518+0000 7f21533c2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f214c0fc550 0x7f214c10d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.518+0000 7f21533c2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f214c0fd820 0x7f214c10d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.518+0000 7f21533c2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c10dc20 con 0x7f214c0fd820 2024-09-19T09:32:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.518+0000 7f21533c2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c10e440 con 0x7f214c0fc550 2024-09-19T09:32:12.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.518+0000 7f215095d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f214c0fd820 0x7f214c10d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:12.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.518+0000 7f215095d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f214c0fd820 0x7f214c10d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53432/0 (socket says 172.21.15.112:53432) 2024-09-19T09:32:12.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.518+0000 7f215095d640 1 -- 172.21.15.112:0/335246638 learned_addr learned my addr 172.21.15.112:0/335246638 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:12.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.518+0000 7f215115e640 1 --2- 172.21.15.112:0/335246638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f214c0fc550 0x7f214c10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:12.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.518+0000 7f215095d640 1 -- 172.21.15.112:0/335246638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f214c0fc550 msgr2=0x7f214c10d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:12.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.518+0000 7f215095d640 1 --2- 172.21.15.112:0/335246638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f214c0fc550 0x7f214c10d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:12.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.518+0000 7f215095d640 1 -- 172.21.15.112:0/335246638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c005040 con 0x7f214c0fd820 2024-09-19T09:32:12.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.518+0000 7f215095d640 1 --2- 172.21.15.112:0/335246638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f214c0fd820 0x7f214c10d5d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f213c0043d0 tx=0x7f213c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:12.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.519+0000 7f2141ffb640 1 -- 172.21.15.112:0/335246638 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f213c038070 con 0x7f214c0fd820 2024-09-19T09:32:12.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.519+0000 7f2141ffb640 1 -- 172.21.15.112:0/335246638 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f213c02ae90 con 0x7f214c0fd820 2024-09-19T09:32:12.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.519+0000 7f2141ffb640 1 -- 172.21.15.112:0/335246638 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f213c03e670 con 0x7f214c0fd820 2024-09-19T09:32:12.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.519+0000 7f21533c2640 1 -- 172.21.15.112:0/335246638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c10e670 con 0x7f214c0fd820 2024-09-19T09:32:12.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.519+0000 7f21533c2640 1 -- 172.21.15.112:0/335246638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c10ec10 con 0x7f214c0fd820 2024-09-19T09:32:12.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.520+0000 7f21533c2640 1 -- 172.21.15.112:0/335246638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214c0fb9b0 con 0x7f214c0fd820 2024-09-19T09:32:12.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.521+0000 7f2141ffb640 1 -- 172.21.15.112:0/335246638 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f213c030020 con 0x7f214c0fd820 2024-09-19T09:32:12.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.521+0000 7f2141ffb640 1 --2- 172.21.15.112:0/335246638 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f213806ed60 0x7f2138071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:12.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.521+0000 7f2141ffb640 1 -- 172.21.15.112:0/335246638 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f213c0adf70 con 0x7f214c0fd820 2024-09-19T09:32:12.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.521+0000 7f215115e640 1 --2- 172.21.15.112:0/335246638 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f213806ed60 0x7f2138071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:12.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.521+0000 7f215115e640 1 --2- 172.21.15.112:0/335246638 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f213806ed60 0x7f2138071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2148004eb0 tx=0x7f214800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:12.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.525+0000 7f2141ffb640 1 -- 172.21.15.112:0/335246638 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f213c07b500 con 0x7f214c0fd820 2024-09-19T09:32:12.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.687+0000 7f21533c2640 1 -- 172.21.15.112:0/335246638 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f214c10ef90 con 0x7f213806ed60 2024-09-19T09:32:12.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.694+0000 7f2141ffb640 1 -- 172.21.15.112:0/335246638 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2790 (secure 0 0 0) 0x7f214c10ef90 con 0x7f213806ed60 2024-09-19T09:32:12.696 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:32:12.696 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (3m) 2m ago 4m 26.7M - 0.25.0 c8568f914cd2 bc75f08f7e02 2024-09-19T09:32:12.696 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (5m) 2m ago 5m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1513f1075df5 2024-09-19T09:32:12.696 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (4m) 66s ago 4m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6c313b300b35 2024-09-19T09:32:12.696 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (3m) 2m ago 4m 79.5M - 9.4.7 954c08fa6188 aeb5727c19ca 2024-09-19T09:32:12.696 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:9283,8765,8443 running (6m) 2m ago 6m 439M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a963c39d50ce 2024-09-19T09:32:12.696 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283 running (4m) 66s ago 4m 401M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cc9633745ef8 2024-09-19T09:32:12.696 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (6m) 2m ago 6m 42.7M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 34676d67b669 2024-09-19T09:32:12.696 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (4m) 66s ago 4m 38.6M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 35690ef0929b 2024-09-19T09:32:12.696 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (5m) 2m ago 5m 15.8M - 1.5.0 0da6a335fe13 a5e6a378cf2f 2024-09-19T09:32:12.696 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (4m) 66s ago 4m 16.4M - 1.5.0 0da6a335fe13 6b6c7c67cf29 2024-09-19T09:32:12.696 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (3m) 2m ago 3m 37.2M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 621693067dce 2024-09-19T09:32:12.697 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (2m) 2m ago 2m 35.4M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1742e5964367 2024-09-19T09:32:12.697 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (2m) 2m ago 2m 39.4M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 4dcca18af229 2024-09-19T09:32:12.697 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (2m) 66s ago 2m 38.0M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:32:12.697 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (96s) 66s ago 96s 37.4M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:32:12.697 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (71s) 66s ago 71s 12.5M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:32:12.697 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (3m) 2m ago 4m 38.2M - 2.43.0 a07b618ecd1d 9499df984e6a 2024-09-19T09:32:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.696+0000 7f21533c2640 1 -- 172.21.15.112:0/335246638 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f213806ed60 msgr2=0x7f2138071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.696+0000 7f21533c2640 1 --2- 172.21.15.112:0/335246638 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f213806ed60 0x7f2138071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2148004eb0 tx=0x7f214800b040 comp rx=0 tx=0).stop 2024-09-19T09:32:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.696+0000 7f21533c2640 1 -- 172.21.15.112:0/335246638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f214c0fd820 msgr2=0x7f214c10d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.696+0000 7f21533c2640 1 --2- 172.21.15.112:0/335246638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f214c0fd820 0x7f214c10d5d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f213c0043d0 tx=0x7f213c009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.696+0000 7f21533c2640 1 -- 172.21.15.112:0/335246638 shutdown_connections 2024-09-19T09:32:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.696+0000 7f21533c2640 1 --2- 172.21.15.112:0/335246638 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f213806ed60 0x7f2138071210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.696+0000 7f21533c2640 1 --2- 172.21.15.112:0/335246638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f214c0fd820 0x7f214c10d5d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.696+0000 7f21533c2640 1 --2- 172.21.15.112:0/335246638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f214c0fc550 0x7f214c10d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.696+0000 7f21533c2640 1 -- 172.21.15.112:0/335246638 >> 172.21.15.112:0/335246638 conn(0x7f214c0f7d30 msgr2=0x7f214c0f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.696+0000 7f21533c2640 1 -- 172.21.15.112:0/335246638 shutdown_connections 2024-09-19T09:32:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:12.696+0000 7f21533c2640 1 -- 172.21.15.112:0/335246638 wait complete. 2024-09-19T09:32:13.452 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T09:32:13.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:13 smithi112 ceph-mon[27605]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:13.696 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:13.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:13 smithi191 ceph-mon[34834]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:14.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:14 smithi191 ceph-mon[34834]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:14.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:14 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:32:14.899 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:14 smithi112 ceph-mon[27605]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:14.899 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:14 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:32:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.246+0000 7fd0c5d3a640 1 -- 172.21.15.112:0/454588161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0c00fb450 msgr2=0x7fd0c00fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.246+0000 7fd0c5d3a640 1 --2- 172.21.15.112:0/454588161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0c00fb450 0x7fd0c00fb860 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd0b00048d0 tx=0x7fd0b0009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.246+0000 7fd0c5d3a640 1 -- 172.21.15.112:0/454588161 shutdown_connections 2024-09-19T09:32:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.246+0000 7fd0c5d3a640 1 --2- 172.21.15.112:0/454588161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c00fc720 0x7fd0c00fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.246+0000 7fd0c5d3a640 1 --2- 172.21.15.112:0/454588161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0c00fb450 0x7fd0c00fb860 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.247+0000 7fd0c5d3a640 1 -- 172.21.15.112:0/454588161 >> 172.21.15.112:0/454588161 conn(0x7fd0c00f6c10 msgr2=0x7fd0c00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.247+0000 7fd0c5d3a640 1 -- 172.21.15.112:0/454588161 shutdown_connections 2024-09-19T09:32:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.247+0000 7fd0c5d3a640 1 -- 172.21.15.112:0/454588161 wait complete. 2024-09-19T09:32:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.247+0000 7fd0c5d3a640 1 Processor -- start 2024-09-19T09:32:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.247+0000 7fd0c5d3a640 1 -- start start 2024-09-19T09:32:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.247+0000 7fd0c5d3a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c00fb450 0x7fd0c010c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.247+0000 7fd0c5d3a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0c00fc720 0x7fd0c010c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:15.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.247+0000 7fd0c5d3a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c010d430 con 0x7fd0c00fc720 2024-09-19T09:32:15.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.247+0000 7fd0c5d3a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c010d5a0 con 0x7fd0c00fb450 2024-09-19T09:32:15.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.248+0000 7fd0b6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0c00fc720 0x7fd0c010c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:15.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.248+0000 7fd0b6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0c00fc720 0x7fd0c010c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53450/0 (socket says 172.21.15.112:53450) 2024-09-19T09:32:15.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.248+0000 7fd0b6ffd640 1 -- 172.21.15.112:0/601248456 learned_addr learned my addr 172.21.15.112:0/601248456 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:15.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.248+0000 7fd0bf7fe640 1 --2- 172.21.15.112:0/601248456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c00fb450 0x7fd0c010c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:15.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.248+0000 7fd0b6ffd640 1 -- 172.21.15.112:0/601248456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c00fb450 msgr2=0x7fd0c010c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:15.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.248+0000 7fd0b6ffd640 1 --2- 172.21.15.112:0/601248456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c00fb450 0x7fd0c010c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:15.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.248+0000 7fd0b6ffd640 1 -- 172.21.15.112:0/601248456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b0005040 con 0x7fd0c00fc720 2024-09-19T09:32:15.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.248+0000 7fd0b6ffd640 1 --2- 172.21.15.112:0/601248456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0c00fc720 0x7fd0c010c5c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800b790 tx=0x7fd0a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:15.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.248+0000 7fd0bcff9640 1 -- 172.21.15.112:0/601248456 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0a800c700 con 0x7fd0c00fc720 2024-09-19T09:32:15.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.248+0000 7fd0bcff9640 1 -- 172.21.15.112:0/601248456 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd0a800cd00 con 0x7fd0c00fc720 2024-09-19T09:32:15.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.248+0000 7fd0c5d3a640 1 -- 172.21.15.112:0/601248456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c010d880 con 0x7fd0c00fc720 2024-09-19T09:32:15.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.248+0000 7fd0bcff9640 1 -- 172.21.15.112:0/601248456 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0a8015e80 con 0x7fd0c00fc720 2024-09-19T09:32:15.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.248+0000 7fd0c5d3a640 1 -- 172.21.15.112:0/601248456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c010dda0 con 0x7fd0c00fc720 2024-09-19T09:32:15.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.249+0000 7fd0c5d3a640 1 -- 172.21.15.112:0/601248456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c00fa8b0 con 0x7fd0c00fc720 2024-09-19T09:32:15.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.250+0000 7fd0bcff9640 1 -- 172.21.15.112:0/601248456 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd0a8012070 con 0x7fd0c00fc720 2024-09-19T09:32:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.250+0000 7fd0bcff9640 1 --2- 172.21.15.112:0/601248456 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd0ac06ed60 0x7fd0ac071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.250+0000 7fd0bf7fe640 1 --2- 172.21.15.112:0/601248456 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd0ac06ed60 0x7fd0ac071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.250+0000 7fd0bcff9640 1 -- 172.21.15.112:0/601248456 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd0a808d5f0 con 0x7fd0c00fc720 2024-09-19T09:32:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.251+0000 7fd0bf7fe640 1 --2- 172.21.15.112:0/601248456 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd0ac06ed60 0x7fd0ac071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0000c00 tx=0x7fd0b0035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:15.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.254+0000 7fd0bcff9640 1 -- 172.21.15.112:0/601248456 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd0a805aad0 con 0x7fd0c00fc720 2024-09-19T09:32:15.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.417+0000 7fd0c5d3a640 1 -- 172.21.15.112:0/601248456 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0c010e020 con 0x7fd0ac06ed60 2024-09-19T09:32:15.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.421+0000 7fd0bcff9640 1 -- 172.21.15.112:0/601248456 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7fd0c010e020 con 0x7fd0ac06ed60 2024-09-19T09:32:15.423 INFO:teuthology.orchestra.run.smithi112.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T09:32:15.423 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-19T09:32:15.423 INFO:teuthology.orchestra.run.smithi112.stdout:crash 2/2 2m ago 5m * 2024-09-19T09:32:15.423 INFO:teuthology.orchestra.run.smithi112.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-19T09:32:15.423 INFO:teuthology.orchestra.run.smithi112.stdout:mgr 2/2 2m ago 5m count:2 2024-09-19T09:32:15.423 INFO:teuthology.orchestra.run.smithi112.stdout:mon 2/2 2m ago 4m smithi112:172.21.15.112=smithi112;smithi191:172.21.15.191=smithi191;count:2 2024-09-19T09:32:15.423 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-19T09:32:15.423 INFO:teuthology.orchestra.run.smithi112.stdout:osd 6 2m ago - 2024-09-19T09:32:15.423 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-19T09:32:15.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.423+0000 7fd0c5d3a640 1 -- 172.21.15.112:0/601248456 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd0ac06ed60 msgr2=0x7fd0ac071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:15.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.423+0000 7fd0c5d3a640 1 --2- 172.21.15.112:0/601248456 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd0ac06ed60 0x7fd0ac071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0000c00 tx=0x7fd0b0035040 comp rx=0 tx=0).stop 2024-09-19T09:32:15.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.423+0000 7fd0c5d3a640 1 -- 172.21.15.112:0/601248456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0c00fc720 msgr2=0x7fd0c010c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:15.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.424+0000 7fd0c5d3a640 1 --2- 172.21.15.112:0/601248456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0c00fc720 0x7fd0c010c5c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800b790 tx=0x7fd0a80091d0 comp rx=0 tx=0).stop 2024-09-19T09:32:15.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.424+0000 7fd0c5d3a640 1 -- 172.21.15.112:0/601248456 shutdown_connections 2024-09-19T09:32:15.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.424+0000 7fd0c5d3a640 1 --2- 172.21.15.112:0/601248456 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fd0ac06ed60 0x7fd0ac071210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:15.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.424+0000 7fd0c5d3a640 1 --2- 172.21.15.112:0/601248456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0c00fc720 0x7fd0c010c5c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:15.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.424+0000 7fd0c5d3a640 1 --2- 172.21.15.112:0/601248456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c00fb450 0x7fd0c010c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:15.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.424+0000 7fd0c5d3a640 1 -- 172.21.15.112:0/601248456 >> 172.21.15.112:0/601248456 conn(0x7fd0c00f6c10 msgr2=0x7fd0c00f8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:15.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.424+0000 7fd0c5d3a640 1 -- 172.21.15.112:0/601248456 shutdown_connections 2024-09-19T09:32:15.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:15.424+0000 7fd0c5d3a640 1 -- 172.21.15.112:0/601248456 wait complete. 2024-09-19T09:32:15.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:15 smithi112 ceph-mon[27605]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:15.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:15 smithi112 ceph-mon[27605]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:15.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:15 smithi191 ceph-mon[34834]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:15.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:15 smithi191 ceph-mon[34834]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:16.026 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T09:32:16.269 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:16.653 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:16 smithi112 ceph-mon[27605]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:16.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:16 smithi191 ceph-mon[34834]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:17.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.852+0000 7f702b9f7640 1 -- 172.21.15.112:0/215933612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70240fb430 msgr2=0x7f70240fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.852+0000 7f702b9f7640 1 --2- 172.21.15.112:0/215933612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70240fb430 0x7f70240fb840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f70180048d0 tx=0x7f7018009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.853+0000 7f702b9f7640 1 -- 172.21.15.112:0/215933612 shutdown_connections 2024-09-19T09:32:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.853+0000 7f702b9f7640 1 --2- 172.21.15.112:0/215933612 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70240fc700 0x7f70240fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.853+0000 7f702b9f7640 1 --2- 172.21.15.112:0/215933612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70240fb430 0x7f70240fb840 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.853+0000 7f702b9f7640 1 -- 172.21.15.112:0/215933612 >> 172.21.15.112:0/215933612 conn(0x7f70240f6c10 msgr2=0x7f70240f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.853+0000 7f702b9f7640 1 -- 172.21.15.112:0/215933612 shutdown_connections 2024-09-19T09:32:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.853+0000 7f702b9f7640 1 -- 172.21.15.112:0/215933612 wait complete. 2024-09-19T09:32:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.853+0000 7f702b9f7640 1 Processor -- start 2024-09-19T09:32:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.853+0000 7f702b9f7640 1 -- start start 2024-09-19T09:32:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.853+0000 7f702b9f7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70240fb430 0x7f702410d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.853+0000 7f702b9f7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70240fc700 0x7f702410d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.853+0000 7f702b9f7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702410e490 con 0x7f70240fc700 2024-09-19T09:32:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.853+0000 7f702b9f7640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702410e600 con 0x7f70240fb430 2024-09-19T09:32:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.853+0000 7f7028f92640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70240fc700 0x7f702410d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.853+0000 7f7028f92640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70240fc700 0x7f702410d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53464/0 (socket says 172.21.15.112:53464) 2024-09-19T09:32:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.853+0000 7f7028f92640 1 -- 172.21.15.112:0/4057719291 learned_addr learned my addr 172.21.15.112:0/4057719291 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.854+0000 7f7029793640 1 --2- 172.21.15.112:0/4057719291 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70240fb430 0x7f702410d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.854+0000 7f7028f92640 1 -- 172.21.15.112:0/4057719291 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70240fb430 msgr2=0x7f702410d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.854+0000 7f7028f92640 1 --2- 172.21.15.112:0/4057719291 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70240fb430 0x7f702410d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.854+0000 7f7028f92640 1 -- 172.21.15.112:0/4057719291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7018005040 con 0x7f70240fc700 2024-09-19T09:32:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.854+0000 7f7028f92640 1 --2- 172.21.15.112:0/4057719291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70240fc700 0x7f702410d620 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f702000b790 tx=0x7f70200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.854+0000 7f7015ffb640 1 -- 172.21.15.112:0/4057719291 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f702000c700 con 0x7f70240fc700 2024-09-19T09:32:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.854+0000 7f7015ffb640 1 -- 172.21.15.112:0/4057719291 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f702000cd00 con 0x7f70240fc700 2024-09-19T09:32:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.854+0000 7f702b9f7640 1 -- 172.21.15.112:0/4057719291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702410e8e0 con 0x7f70240fc700 2024-09-19T09:32:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.854+0000 7f7015ffb640 1 -- 172.21.15.112:0/4057719291 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7020015e80 con 0x7f70240fc700 2024-09-19T09:32:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.854+0000 7f702b9f7640 1 -- 172.21.15.112:0/4057719291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702410ee00 con 0x7f70240fc700 2024-09-19T09:32:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.855+0000 7f702b9f7640 1 -- 172.21.15.112:0/4057719291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70240fa890 con 0x7f70240fc700 2024-09-19T09:32:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.856+0000 7f7015ffb640 1 -- 172.21.15.112:0/4057719291 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f7020012070 con 0x7f70240fc700 2024-09-19T09:32:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.856+0000 7f7015ffb640 1 --2- 172.21.15.112:0/4057719291 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f701006ed60 0x7f7010071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.856+0000 7f7015ffb640 1 -- 172.21.15.112:0/4057719291 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f702008d5f0 con 0x7f70240fc700 2024-09-19T09:32:17.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.856+0000 7f7029793640 1 --2- 172.21.15.112:0/4057719291 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f701006ed60 0x7f7010071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.857+0000 7f7029793640 1 --2- 172.21.15.112:0/4057719291 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f701006ed60 0x7f7010071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7018000c00 tx=0x7f7018035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:17.860+0000 7f7015ffb640 1 -- 172.21.15.112:0/4057719291 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f702005aad0 con 0x7f70240fc700 2024-09-19T09:32:18.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:18.022+0000 7f702b9f7640 1 -- 172.21.15.112:0/4057719291 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7024103eb0 con 0x7f701006ed60 2024-09-19T09:32:18.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:18.023+0000 7f7015ffb640 1 -- 172.21.15.112:0/4057719291 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f7024103eb0 con 0x7f701006ed60 2024-09-19T09:32:18.025 INFO:teuthology.orchestra.run.smithi112.stdout:HOST ADDR LABELS STATUS 2024-09-19T09:32:18.025 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112 172.21.15.112 2024-09-19T09:32:18.025 INFO:teuthology.orchestra.run.smithi112.stdout:smithi191 172.21.15.191 2024-09-19T09:32:18.025 INFO:teuthology.orchestra.run.smithi112.stdout:2 hosts in cluster 2024-09-19T09:32:18.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:18.025+0000 7f702b9f7640 1 -- 172.21.15.112:0/4057719291 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f701006ed60 msgr2=0x7f7010071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:18.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:18.025+0000 7f702b9f7640 1 --2- 172.21.15.112:0/4057719291 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f701006ed60 0x7f7010071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7018000c00 tx=0x7f7018035040 comp rx=0 tx=0).stop 2024-09-19T09:32:18.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:18.025+0000 7f702b9f7640 1 -- 172.21.15.112:0/4057719291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70240fc700 msgr2=0x7f702410d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:18.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:18.025+0000 7f702b9f7640 1 --2- 172.21.15.112:0/4057719291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70240fc700 0x7f702410d620 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f702000b790 tx=0x7f70200091d0 comp rx=0 tx=0).stop 2024-09-19T09:32:18.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:18.025+0000 7f702b9f7640 1 -- 172.21.15.112:0/4057719291 shutdown_connections 2024-09-19T09:32:18.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:18.025+0000 7f702b9f7640 1 --2- 172.21.15.112:0/4057719291 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f701006ed60 0x7f7010071210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:18.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:18.025+0000 7f702b9f7640 1 --2- 172.21.15.112:0/4057719291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70240fc700 0x7f702410d620 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:18.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:18.025+0000 7f702b9f7640 1 --2- 172.21.15.112:0/4057719291 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70240fb430 0x7f702410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:18.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:18.025+0000 7f702b9f7640 1 -- 172.21.15.112:0/4057719291 >> 172.21.15.112:0/4057719291 conn(0x7f70240f6c10 msgr2=0x7f70240656e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:18.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:18.026+0000 7f702b9f7640 1 -- 172.21.15.112:0/4057719291 shutdown_connections 2024-09-19T09:32:18.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:18.026+0000 7f702b9f7640 1 -- 172.21.15.112:0/4057719291 wait complete. 2024-09-19T09:32:18.723 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T09:32:18.966 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:19.087 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:18 smithi112 ceph-mon[27605]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:19.088 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:18 smithi112 ceph-mon[27605]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:19.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:18 smithi191 ceph-mon[34834]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:19.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:18 smithi191 ceph-mon[34834]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:20.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.626+0000 7fe9e99fe640 1 -- 172.21.15.112:0/1664794310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9e40fb460 msgr2=0x7fe9e40fb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:20.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.626+0000 7fe9e99fe640 1 --2- 172.21.15.112:0/1664794310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9e40fb460 0x7fe9e40fb870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40048d0 tx=0x7fe9d4009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:20.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.627+0000 7fe9e99fe640 1 -- 172.21.15.112:0/1664794310 shutdown_connections 2024-09-19T09:32:20.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.627+0000 7fe9e99fe640 1 --2- 172.21.15.112:0/1664794310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9e40fc730 0x7fe9e40fcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:20.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.627+0000 7fe9e99fe640 1 --2- 172.21.15.112:0/1664794310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9e40fb460 0x7fe9e40fb870 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:20.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.627+0000 7fe9e99fe640 1 -- 172.21.15.112:0/1664794310 >> 172.21.15.112:0/1664794310 conn(0x7fe9e40f6c40 msgr2=0x7fe9e40f9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:20.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.627+0000 7fe9e99fe640 1 -- 172.21.15.112:0/1664794310 shutdown_connections 2024-09-19T09:32:20.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.627+0000 7fe9e99fe640 1 -- 172.21.15.112:0/1664794310 wait complete. 2024-09-19T09:32:20.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.627+0000 7fe9e99fe640 1 Processor -- start 2024-09-19T09:32:20.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.627+0000 7fe9e99fe640 1 -- start start 2024-09-19T09:32:20.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9e99fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9e40fb460 0x7fe9e410fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:20.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9e99fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9e40fc730 0x7fe9e4112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:20.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9e99fe640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e40666a0 con 0x7fe9e40fb460 2024-09-19T09:32:20.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9e99fe640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e4066810 con 0x7fe9e40fc730 2024-09-19T09:32:20.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9e2ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9e40fb460 0x7fe9e410fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:20.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9e2ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9e40fb460 0x7fe9e410fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33942/0 (socket says 172.21.15.112:33942) 2024-09-19T09:32:20.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9e2ffd640 1 -- 172.21.15.112:0/1041094465 learned_addr learned my addr 172.21.15.112:0/1041094465 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:20.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9e27fc640 1 --2- 172.21.15.112:0/1041094465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9e40fc730 0x7fe9e4112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:20.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9e2ffd640 1 -- 172.21.15.112:0/1041094465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9e40fc730 msgr2=0x7fe9e4112310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:20.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9e2ffd640 1 --2- 172.21.15.112:0/1041094465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9e40fc730 0x7fe9e4112310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:20.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9e2ffd640 1 -- 172.21.15.112:0/1041094465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d4005040 con 0x7fe9e40fb460 2024-09-19T09:32:20.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9e2ffd640 1 --2- 172.21.15.112:0/1041094465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9e40fb460 0x7fe9e410fdc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40043d0 tx=0x7fe9d4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:20.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9db7fe640 1 -- 172.21.15.112:0/1041094465 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d4038070 con 0x7fe9e40fb460 2024-09-19T09:32:20.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9db7fe640 1 -- 172.21.15.112:0/1041094465 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe9d402ae90 con 0x7fe9e40fb460 2024-09-19T09:32:20.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9db7fe640 1 -- 172.21.15.112:0/1041094465 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d403e670 con 0x7fe9e40fb460 2024-09-19T09:32:20.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.628+0000 7fe9e99fe640 1 -- 172.21.15.112:0/1041094465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e4112850 con 0x7fe9e40fb460 2024-09-19T09:32:20.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.629+0000 7fe9e99fe640 1 -- 172.21.15.112:0/1041094465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e4112d90 con 0x7fe9e40fb460 2024-09-19T09:32:20.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.630+0000 7fe9e99fe640 1 -- 172.21.15.112:0/1041094465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e40fa8c0 con 0x7fe9e40fb460 2024-09-19T09:32:20.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.630+0000 7fe9db7fe640 1 -- 172.21.15.112:0/1041094465 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fe9d4030020 con 0x7fe9e40fb460 2024-09-19T09:32:20.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.630+0000 7fe9db7fe640 1 --2- 172.21.15.112:0/1041094465 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe9d006ed60 0x7fe9d0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:20.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.631+0000 7fe9db7fe640 1 -- 172.21.15.112:0/1041094465 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe9d40aded0 con 0x7fe9e40fb460 2024-09-19T09:32:20.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.631+0000 7fe9e27fc640 1 --2- 172.21.15.112:0/1041094465 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe9d006ed60 0x7fe9d0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:20.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.631+0000 7fe9e27fc640 1 --2- 172.21.15.112:0/1041094465 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe9d006ed60 0x7fe9d0071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc004eb0 tx=0x7fe9cc00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:20.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.635+0000 7fe9db7fe640 1 -- 172.21.15.112:0/1041094465 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe9d407b460 con 0x7fe9e40fb460 2024-09-19T09:32:20.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.800+0000 7fe9e99fe640 1 -- 172.21.15.112:0/1041094465 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9e4100b10 con 0x7fe9d006ed60 2024-09-19T09:32:20.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.802+0000 7fe9db7fe640 1 -- 172.21.15.112:0/1041094465 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7fe9e4100b10 con 0x7fe9d006ed60 2024-09-19T09:32:20.803 INFO:teuthology.orchestra.run.smithi112.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T09:32:20.803 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NV400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T09:32:20.803 INFO:teuthology.orchestra.run.smithi112.stdout:smithi191 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303008M400BGN 372G No 71s ago Has a FileSystem, LVM detected 2024-09-19T09:32:20.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.803+0000 7fe9e99fe640 1 -- 172.21.15.112:0/1041094465 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe9d006ed60 msgr2=0x7fe9d0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:20.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.803+0000 7fe9e99fe640 1 --2- 172.21.15.112:0/1041094465 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe9d006ed60 0x7fe9d0071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc004eb0 tx=0x7fe9cc00b040 comp rx=0 tx=0).stop 2024-09-19T09:32:20.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.803+0000 7fe9e99fe640 1 -- 172.21.15.112:0/1041094465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9e40fb460 msgr2=0x7fe9e410fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:20.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.803+0000 7fe9e99fe640 1 --2- 172.21.15.112:0/1041094465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9e40fb460 0x7fe9e410fdc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40043d0 tx=0x7fe9d4009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:20.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.804+0000 7fe9e99fe640 1 -- 172.21.15.112:0/1041094465 shutdown_connections 2024-09-19T09:32:20.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.804+0000 7fe9e99fe640 1 --2- 172.21.15.112:0/1041094465 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe9d006ed60 0x7fe9d0071210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:20.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.804+0000 7fe9e99fe640 1 --2- 172.21.15.112:0/1041094465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9e40fc730 0x7fe9e4112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:20.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.804+0000 7fe9e99fe640 1 --2- 172.21.15.112:0/1041094465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9e40fb460 0x7fe9e410fdc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:20.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.804+0000 7fe9e99fe640 1 -- 172.21.15.112:0/1041094465 >> 172.21.15.112:0/1041094465 conn(0x7fe9e40f6c40 msgr2=0x7fe9e40f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:20.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.804+0000 7fe9e99fe640 1 -- 172.21.15.112:0/1041094465 shutdown_connections 2024-09-19T09:32:20.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:20.804+0000 7fe9e99fe640 1 -- 172.21.15.112:0/1041094465 wait complete. 2024-09-19T09:32:20.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:20 smithi112 ceph-mon[27605]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:21.087 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:20 smithi191 ceph-mon[34834]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:21.455 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:32:21.464 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-19T09:32:21.464 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-19T09:32:21.710 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:22.166 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:21 smithi112 ceph-mon[27605]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:22.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:21 smithi191 ceph-mon[34834]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:22.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:22 smithi112 ceph-mon[27605]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:23.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:22 smithi191 ceph-mon[34834]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:23.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.510+0000 7fba48d57640 1 -- 172.21.15.112:0/2211387451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba440fb430 msgr2=0x7fba440fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:23.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.510+0000 7fba48d57640 1 --2- 172.21.15.112:0/2211387451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba440fb430 0x7fba440fb840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fba340048d0 tx=0x7fba34009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:23.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.510+0000 7fba48d57640 1 -- 172.21.15.112:0/2211387451 shutdown_connections 2024-09-19T09:32:23.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.510+0000 7fba48d57640 1 --2- 172.21.15.112:0/2211387451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba440fc700 0x7fba440fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:23.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.510+0000 7fba48d57640 1 --2- 172.21.15.112:0/2211387451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba440fb430 0x7fba440fb840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:23.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.510+0000 7fba48d57640 1 -- 172.21.15.112:0/2211387451 >> 172.21.15.112:0/2211387451 conn(0x7fba440f6c10 msgr2=0x7fba440f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:23.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.510+0000 7fba48d57640 1 -- 172.21.15.112:0/2211387451 shutdown_connections 2024-09-19T09:32:23.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.510+0000 7fba48d57640 1 -- 172.21.15.112:0/2211387451 wait complete. 2024-09-19T09:32:23.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.511+0000 7fba48d57640 1 Processor -- start 2024-09-19T09:32:23.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.511+0000 7fba48d57640 1 -- start start 2024-09-19T09:32:23.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.511+0000 7fba48d57640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba440fb430 0x7fba4410fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:23.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.511+0000 7fba48d57640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba440fc700 0x7fba441122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:23.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.511+0000 7fba48d57640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba44065cc0 con 0x7fba440fc700 2024-09-19T09:32:23.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.511+0000 7fba48d57640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba44065e30 con 0x7fba440fb430 2024-09-19T09:32:23.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.511+0000 7fba41d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba440fc700 0x7fba441122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:23.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.511+0000 7fba41d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba440fc700 0x7fba441122b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33958/0 (socket says 172.21.15.112:33958) 2024-09-19T09:32:23.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.511+0000 7fba41d9b640 1 -- 172.21.15.112:0/1932085913 learned_addr learned my addr 172.21.15.112:0/1932085913 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:23.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.511+0000 7fba4259c640 1 --2- 172.21.15.112:0/1932085913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba440fb430 0x7fba4410fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:23.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.511+0000 7fba41d9b640 1 -- 172.21.15.112:0/1932085913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba440fb430 msgr2=0x7fba4410fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:23.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.511+0000 7fba41d9b640 1 --2- 172.21.15.112:0/1932085913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba440fb430 0x7fba4410fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:23.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.511+0000 7fba41d9b640 1 -- 172.21.15.112:0/1932085913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba34005040 con 0x7fba440fc700 2024-09-19T09:32:23.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.511+0000 7fba41d9b640 1 --2- 172.21.15.112:0/1932085913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba440fc700 0x7fba441122b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fba38002a50 tx=0x7fba38004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:23.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.511+0000 7fba32ffd640 1 -- 172.21.15.112:0/1932085913 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba38007c30 con 0x7fba440fc700 2024-09-19T09:32:23.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.512+0000 7fba32ffd640 1 -- 172.21.15.112:0/1932085913 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fba3800f040 con 0x7fba440fc700 2024-09-19T09:32:23.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.512+0000 7fba32ffd640 1 -- 172.21.15.112:0/1932085913 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba3800da90 con 0x7fba440fc700 2024-09-19T09:32:23.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.512+0000 7fba48d57640 1 -- 172.21.15.112:0/1932085913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba441128b0 con 0x7fba440fc700 2024-09-19T09:32:23.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.512+0000 7fba48d57640 1 -- 172.21.15.112:0/1932085913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba44112e20 con 0x7fba440fc700 2024-09-19T09:32:23.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.512+0000 7fba48d57640 1 -- 172.21.15.112:0/1932085913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba440fa890 con 0x7fba440fc700 2024-09-19T09:32:23.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.513+0000 7fba32ffd640 1 -- 172.21.15.112:0/1932085913 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fba3800dd00 con 0x7fba440fc700 2024-09-19T09:32:23.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.513+0000 7fba32ffd640 1 --2- 172.21.15.112:0/1932085913 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fba2c06ed60 0x7fba2c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:23.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.514+0000 7fba32ffd640 1 -- 172.21.15.112:0/1932085913 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fba3808d760 con 0x7fba440fc700 2024-09-19T09:32:23.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.514+0000 7fba4259c640 1 --2- 172.21.15.112:0/1932085913 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fba2c06ed60 0x7fba2c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:23.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.514+0000 7fba4259c640 1 --2- 172.21.15.112:0/1932085913 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fba2c06ed60 0x7fba2c071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fba34007ac0 tx=0x7fba34009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:23.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.518+0000 7fba32ffd640 1 -- 172.21.15.112:0/1932085913 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fba3805abc0 con 0x7fba440fc700 2024-09-19T09:32:23.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:23.692+0000 7fba48d57640 1 -- 172.21.15.112:0/1932085913 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fba44100b60 con 0x7fba2c06ed60 2024-09-19T09:32:23.987 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:23 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-19T09:32:24.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:23 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-19T09:32:25.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:25.012+0000 7fba32ffd640 1 -- 172.21.15.112:0/1932085913 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fba44100b60 con 0x7fba2c06ed60 2024-09-19T09:32:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:25.014+0000 7fba48d57640 1 -- 172.21.15.112:0/1932085913 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fba2c06ed60 msgr2=0x7fba2c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:25.014+0000 7fba48d57640 1 --2- 172.21.15.112:0/1932085913 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fba2c06ed60 0x7fba2c071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fba34007ac0 tx=0x7fba34009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:25.014+0000 7fba48d57640 1 -- 172.21.15.112:0/1932085913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba440fc700 msgr2=0x7fba441122b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:25.014+0000 7fba48d57640 1 --2- 172.21.15.112:0/1932085913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba440fc700 0x7fba441122b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fba38002a50 tx=0x7fba38004600 comp rx=0 tx=0).stop 2024-09-19T09:32:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:25.014+0000 7fba48d57640 1 -- 172.21.15.112:0/1932085913 shutdown_connections 2024-09-19T09:32:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:25.014+0000 7fba48d57640 1 --2- 172.21.15.112:0/1932085913 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fba2c06ed60 0x7fba2c071210 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:25.014+0000 7fba48d57640 1 --2- 172.21.15.112:0/1932085913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba440fc700 0x7fba441122b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:25.014+0000 7fba48d57640 1 --2- 172.21.15.112:0/1932085913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba440fb430 0x7fba4410fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:25.014+0000 7fba48d57640 1 -- 172.21.15.112:0/1932085913 >> 172.21.15.112:0/1932085913 conn(0x7fba440f6c10 msgr2=0x7fba440f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:25.014+0000 7fba48d57640 1 -- 172.21.15.112:0/1932085913 shutdown_connections 2024-09-19T09:32:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:25.014+0000 7fba48d57640 1 -- 172.21.15.112:0/1932085913 wait complete. 2024-09-19T09:32:25.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:24 smithi191 ceph-mon[34834]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:25.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:24 smithi191 ceph-mon[34834]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:25.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:24 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-19T09:32:25.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:24 smithi191 ceph-mon[34834]: osdmap e40: 6 total, 6 up, 6 in 2024-09-19T09:32:25.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:24 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-19T09:32:25.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:24 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-19T09:32:25.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:24 smithi191 ceph-mon[34834]: osdmap e41: 6 total, 6 up, 6 in 2024-09-19T09:32:25.327 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:24 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112[27601]: 2024-09-19T09:32:24.988+0000 7f52a3999640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:32:25.327 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:24 smithi112 ceph-mon[27605]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:25.327 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:24 smithi112 ceph-mon[27605]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:25.327 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:24 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-19T09:32:25.327 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:24 smithi112 ceph-mon[27605]: osdmap e40: 6 total, 6 up, 6 in 2024-09-19T09:32:25.328 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:24 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-19T09:32:25.328 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:24 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-19T09:32:25.328 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:24 smithi112 ceph-mon[27605]: osdmap e41: 6 total, 6 up, 6 in 2024-09-19T09:32:25.668 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T09:32:25.929 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:26.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:25 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-19T09:32:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:25 smithi191 ceph-mon[34834]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:32:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:25 smithi191 ceph-mon[34834]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:32:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:25 smithi191 ceph-mon[34834]: osdmap e42: 6 total, 6 up, 6 in 2024-09-19T09:32:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:25 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-19T09:32:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:25 smithi191 ceph-mon[34834]: fsmap cephfs:0 2024-09-19T09:32:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:25 smithi191 ceph-mon[34834]: Saving service mds.cephfs spec with placement count:4 2024-09-19T09:32:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:25 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:25 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:25 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:25 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:25 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:25 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.ymjyok", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:32:26.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:25 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.ymjyok", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:32:26.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:25 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:26.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:25 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-19T09:32:26.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:25 smithi112 ceph-mon[27605]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:32:26.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:25 smithi112 ceph-mon[27605]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:32:26.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:25 smithi112 ceph-mon[27605]: osdmap e42: 6 total, 6 up, 6 in 2024-09-19T09:32:26.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:25 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-19T09:32:26.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:25 smithi112 ceph-mon[27605]: fsmap cephfs:0 2024-09-19T09:32:26.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:25 smithi112 ceph-mon[27605]: Saving service mds.cephfs spec with placement count:4 2024-09-19T09:32:26.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:25 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:26.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:25 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:26.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:25 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:26.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:25 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:26.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:25 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:26.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:25 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.ymjyok", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:32:26.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:25 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.ymjyok", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:32:26.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:25 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:27.058 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:27 smithi112 ceph-mon[27605]: pgmap v171: 65 pgs: 4 creating+peering, 55 unknown, 6 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:27.059 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:27 smithi112 ceph-mon[27605]: Deploying daemon mds.cephfs.smithi112.ymjyok on smithi112 2024-09-19T09:32:27.059 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:27 smithi112 ceph-mon[27605]: osdmap e43: 6 total, 6 up, 6 in 2024-09-19T09:32:27.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:27 smithi191 ceph-mon[34834]: pgmap v171: 65 pgs: 4 creating+peering, 55 unknown, 6 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:27.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:27 smithi191 ceph-mon[34834]: Deploying daemon mds.cephfs.smithi112.ymjyok on smithi112 2024-09-19T09:32:27.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:27 smithi191 ceph-mon[34834]: osdmap e43: 6 total, 6 up, 6 in 2024-09-19T09:32:28.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:28 smithi112 ceph-mon[27605]: osdmap e44: 6 total, 6 up, 6 in 2024-09-19T09:32:28.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:28 smithi191 ceph-mon[34834]: osdmap e44: 6 total, 6 up, 6 in 2024-09-19T09:32:28.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.580+0000 7fa879732640 1 -- 172.21.15.112:0/1201596116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8740fc560 msgr2=0x7fa8740fc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.580+0000 7fa879732640 1 --2- 172.21.15.112:0/1201596116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8740fc560 0x7fa8740fc970 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa8640048d0 tx=0x7fa864009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.580+0000 7fa879732640 1 -- 172.21.15.112:0/1201596116 shutdown_connections 2024-09-19T09:32:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.580+0000 7fa879732640 1 --2- 172.21.15.112:0/1201596116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8740fd830 0x7fa8740fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.580+0000 7fa879732640 1 --2- 172.21.15.112:0/1201596116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8740fc560 0x7fa8740fc970 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.580+0000 7fa879732640 1 -- 172.21.15.112:0/1201596116 >> 172.21.15.112:0/1201596116 conn(0x7fa8740f7d20 msgr2=0x7fa8740fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.580+0000 7fa879732640 1 -- 172.21.15.112:0/1201596116 shutdown_connections 2024-09-19T09:32:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.581+0000 7fa879732640 1 -- 172.21.15.112:0/1201596116 wait complete. 2024-09-19T09:32:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.581+0000 7fa879732640 1 Processor -- start 2024-09-19T09:32:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.581+0000 7fa879732640 1 -- start start 2024-09-19T09:32:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.581+0000 7fa879732640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8740fc560 0x7fa87410d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.581+0000 7fa879732640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8740fd830 0x7fa87410d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.581+0000 7fa879732640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87410dbd0 con 0x7fa8740fc560 2024-09-19T09:32:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.581+0000 7fa879732640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87410e3f0 con 0x7fa8740fd830 2024-09-19T09:32:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.581+0000 7fa872ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8740fc560 0x7fa87410d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.581+0000 7fa872ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8740fc560 0x7fa87410d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37446/0 (socket says 172.21.15.112:37446) 2024-09-19T09:32:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.581+0000 7fa872ffd640 1 -- 172.21.15.112:0/883919925 learned_addr learned my addr 172.21.15.112:0/883919925 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.582+0000 7fa8727fc640 1 --2- 172.21.15.112:0/883919925 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8740fd830 0x7fa87410d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.582+0000 7fa872ffd640 1 -- 172.21.15.112:0/883919925 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8740fd830 msgr2=0x7fa87410d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.582+0000 7fa872ffd640 1 --2- 172.21.15.112:0/883919925 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8740fd830 0x7fa87410d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.582+0000 7fa872ffd640 1 -- 172.21.15.112:0/883919925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa864005040 con 0x7fa8740fc560 2024-09-19T09:32:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.582+0000 7fa872ffd640 1 --2- 172.21.15.112:0/883919925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8740fc560 0x7fa87410d040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa864003080 tx=0x7fa864009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.582+0000 7fa85b7fe640 1 -- 172.21.15.112:0/883919925 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa864038070 con 0x7fa8740fc560 2024-09-19T09:32:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.582+0000 7fa85b7fe640 1 -- 172.21.15.112:0/883919925 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa86402abd0 con 0x7fa8740fc560 2024-09-19T09:32:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.582+0000 7fa879732640 1 -- 172.21.15.112:0/883919925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87410e620 con 0x7fa8740fc560 2024-09-19T09:32:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.582+0000 7fa85b7fe640 1 -- 172.21.15.112:0/883919925 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa86403e670 con 0x7fa8740fc560 2024-09-19T09:32:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.582+0000 7fa879732640 1 -- 172.21.15.112:0/883919925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87410ebc0 con 0x7fa8740fc560 2024-09-19T09:32:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.583+0000 7fa879732640 1 -- 172.21.15.112:0/883919925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8740fb9c0 con 0x7fa8740fc560 2024-09-19T09:32:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.584+0000 7fa85b7fe640 1 -- 172.21.15.112:0/883919925 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fa864030020 con 0x7fa8740fc560 2024-09-19T09:32:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.584+0000 7fa85b7fe640 1 --2- 172.21.15.112:0/883919925 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa85c06ed60 0x7fa85c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.584+0000 7fa85b7fe640 1 -- 172.21.15.112:0/883919925 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa8640ae590 con 0x7fa8740fc560 2024-09-19T09:32:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.584+0000 7fa8727fc640 1 --2- 172.21.15.112:0/883919925 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa85c06ed60 0x7fa85c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.585+0000 7fa8727fc640 1 --2- 172.21.15.112:0/883919925 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa85c06ed60 0x7fa85c071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa868007fd0 tx=0x7fa868009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.589+0000 7fa85b7fe640 1 -- 172.21.15.112:0/883919925 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa86407b6b0 con 0x7fa8740fc560 2024-09-19T09:32:28.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.795+0000 7fa879732640 1 -- 172.21.15.112:0/883919925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa87410ef60 con 0x7fa8740fc560 2024-09-19T09:32:28.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.795+0000 7fa85b7fe640 1 -- 172.21.15.112:0/883919925 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7fa86407b050 con 0x7fa8740fc560 2024-09-19T09:32:28.797 INFO:teuthology.orchestra.run.smithi112.stdout:e2 2024-09-19T09:32:28.798 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:32:28.798 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:32:28.798 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-19T09:32:28.798 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:32:28.798 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:32:28.798 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-19T09:32:28.798 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 2 2024-09-19T09:32:28.798 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T09:32:28.798 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:32:28.798 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-19T09:32:24.989412+0000 2024-09-19T09:32:28.798 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-19T09:32:28.798 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-19T09:32:28.798 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-19T09:32:28.799 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-19T09:32:28.799 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-19T09:32:28.799 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-19T09:32:28.799 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-19T09:32:28.799 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 0 2024-09-19T09:32:28.799 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:32:28.799 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-19T09:32:28.799 INFO:teuthology.orchestra.run.smithi112.stdout:in 2024-09-19T09:32:28.799 INFO:teuthology.orchestra.run.smithi112.stdout:up {} 2024-09-19T09:32:28.799 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-19T09:32:28.799 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-19T09:32:28.799 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-19T09:32:28.799 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-19T09:32:28.799 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-19T09:32:28.800 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data disabled 2024-09-19T09:32:28.800 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-19T09:32:28.800 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 0 2024-09-19T09:32:28.800 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:32:28.800 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:32:28.800 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 2 2024-09-19T09:32:28.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.798+0000 7fa879732640 1 -- 172.21.15.112:0/883919925 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa85c06ed60 msgr2=0x7fa85c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:28.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.798+0000 7fa879732640 1 --2- 172.21.15.112:0/883919925 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa85c06ed60 0x7fa85c071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa868007fd0 tx=0x7fa868009040 comp rx=0 tx=0).stop 2024-09-19T09:32:28.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.798+0000 7fa879732640 1 -- 172.21.15.112:0/883919925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8740fc560 msgr2=0x7fa87410d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:28.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.798+0000 7fa879732640 1 --2- 172.21.15.112:0/883919925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8740fc560 0x7fa87410d040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa864003080 tx=0x7fa864009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:28.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.799+0000 7fa879732640 1 -- 172.21.15.112:0/883919925 shutdown_connections 2024-09-19T09:32:28.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.799+0000 7fa879732640 1 --2- 172.21.15.112:0/883919925 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa85c06ed60 0x7fa85c071210 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:28.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.799+0000 7fa879732640 1 --2- 172.21.15.112:0/883919925 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8740fd830 0x7fa87410d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:28.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.799+0000 7fa879732640 1 --2- 172.21.15.112:0/883919925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8740fc560 0x7fa87410d040 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:28.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.799+0000 7fa879732640 1 -- 172.21.15.112:0/883919925 >> 172.21.15.112:0/883919925 conn(0x7fa8740f7d20 msgr2=0x7fa8740f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:28.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.799+0000 7fa879732640 1 -- 172.21.15.112:0/883919925 shutdown_connections 2024-09-19T09:32:28.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:28.799+0000 7fa879732640 1 -- 172.21.15.112:0/883919925 wait complete. 2024-09-19T09:32:29.112 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:29 smithi112 ceph-mon[27605]: pgmap v174: 65 pgs: 4 creating+peering, 28 unknown, 33 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:29.112 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:29 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:29.112 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:29 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:32:29.112 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:29 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/883919925' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:32:29.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:29 smithi191 ceph-mon[34834]: pgmap v174: 65 pgs: 4 creating+peering, 28 unknown, 33 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:29.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:29 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:29.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:29 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:32:29.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:29 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/883919925' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:32:29.413 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:32:29.423 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-19T09:32:29.423 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-19T09:32:30.209 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: pgmap v175: 65 pgs: 4 creating+peering, 61 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: mds.? [v2:172.21.15.112:6826/3112259740,v1:172.21.15.112:6827/3112259740] up:boot 2024-09-19T09:32:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: daemon mds.cephfs.smithi112.ymjyok assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-19T09:32:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:32:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:32:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: Cluster is now healthy 2024-09-19T09:32:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: fsmap cephfs:0 1 up:standby 2024-09-19T09:32:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:32:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:creating} 2024-09-19T09:32:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: daemon mds.cephfs.smithi112.ymjyok is now active in filesystem cephfs as rank 0 2024-09-19T09:32:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:31.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:31.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:31.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.jjldod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:32:31.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.jjldod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:32:31.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:31.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:31 smithi191 ceph-mon[34834]: Deploying daemon mds.cephfs.smithi191.jjldod on smithi191 2024-09-19T09:32:31.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: pgmap v175: 65 pgs: 4 creating+peering, 61 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:32:31.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: mds.? [v2:172.21.15.112:6826/3112259740,v1:172.21.15.112:6827/3112259740] up:boot 2024-09-19T09:32:31.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: daemon mds.cephfs.smithi112.ymjyok assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-19T09:32:31.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:32:31.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:32:31.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: Cluster is now healthy 2024-09-19T09:32:31.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: fsmap cephfs:0 1 up:standby 2024-09-19T09:32:31.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:32:31.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:creating} 2024-09-19T09:32:31.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: daemon mds.cephfs.smithi112.ymjyok is now active in filesystem cephfs as rank 0 2024-09-19T09:32:31.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:31.375 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:31.375 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:31.375 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.jjldod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:32:31.375 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.jjldod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:32:31.375 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:31.375 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:31 smithi112 ceph-mon[27605]: Deploying daemon mds.cephfs.smithi191.jjldod on smithi191 2024-09-19T09:32:31.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.925+0000 7f1f744be640 1 -- 172.21.15.112:0/2489016990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f6c0fdc40 msgr2=0x7f1f6c0fe050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:31.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.925+0000 7f1f744be640 1 --2- 172.21.15.112:0/2489016990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f6c0fdc40 0x7f1f6c0fe050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1f680048d0 tx=0x7f1f68009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:31.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f744be640 1 -- 172.21.15.112:0/2489016990 shutdown_connections 2024-09-19T09:32:31.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f744be640 1 --2- 172.21.15.112:0/2489016990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f6c0fe590 0x7f1f6c0fa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:31.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f744be640 1 --2- 172.21.15.112:0/2489016990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f6c0fdc40 0x7f1f6c0fe050 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:31.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f744be640 1 -- 172.21.15.112:0/2489016990 >> 172.21.15.112:0/2489016990 conn(0x7f1f6c0f63a0 msgr2=0x7f1f6c0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:31.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f744be640 1 -- 172.21.15.112:0/2489016990 shutdown_connections 2024-09-19T09:32:31.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f744be640 1 -- 172.21.15.112:0/2489016990 wait complete. 2024-09-19T09:32:31.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f744be640 1 Processor -- start 2024-09-19T09:32:31.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f744be640 1 -- start start 2024-09-19T09:32:31.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f744be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f6c0fdc40 0x7f1f6c0fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:31.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f744be640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f6c0fe590 0x7f1f6c0fb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:31.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f744be640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c0fbeb0 con 0x7f1f6c0fdc40 2024-09-19T09:32:31.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f744be640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c0fbff0 con 0x7f1f6c0fe590 2024-09-19T09:32:31.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f7225a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f6c0fdc40 0x7f1f6c0fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:31.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f7225a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f6c0fdc40 0x7f1f6c0fd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37498/0 (socket says 172.21.15.112:37498) 2024-09-19T09:32:31.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f71a59640 1 --2- 172.21.15.112:0/3282202575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f6c0fe590 0x7f1f6c0fb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:31.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.926+0000 7f1f7225a640 1 -- 172.21.15.112:0/3282202575 learned_addr learned my addr 172.21.15.112:0/3282202575 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:31.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.927+0000 7f1f7225a640 1 -- 172.21.15.112:0/3282202575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f6c0fe590 msgr2=0x7f1f6c0fb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:31.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.927+0000 7f1f7225a640 1 --2- 172.21.15.112:0/3282202575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f6c0fe590 0x7f1f6c0fb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:31.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.927+0000 7f1f7225a640 1 -- 172.21.15.112:0/3282202575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f68005040 con 0x7f1f6c0fdc40 2024-09-19T09:32:31.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.927+0000 7f1f71a59640 1 --2- 172.21.15.112:0/3282202575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f6c0fe590 0x7f1f6c0fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:32:31.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.927+0000 7f1f7225a640 1 --2- 172.21.15.112:0/3282202575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f6c0fdc40 0x7f1f6c0fd430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1f680048a0 tx=0x7f1f68009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:31.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.927+0000 7f1f62ffd640 1 -- 172.21.15.112:0/3282202575 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f68038070 con 0x7f1f6c0fdc40 2024-09-19T09:32:31.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.927+0000 7f1f744be640 1 -- 172.21.15.112:0/3282202575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6c0fc270 con 0x7f1f6c0fdc40 2024-09-19T09:32:31.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.927+0000 7f1f62ffd640 1 -- 172.21.15.112:0/3282202575 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1f68004290 con 0x7f1f6c0fdc40 2024-09-19T09:32:31.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.927+0000 7f1f62ffd640 1 -- 172.21.15.112:0/3282202575 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f68033660 con 0x7f1f6c0fdc40 2024-09-19T09:32:31.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.927+0000 7f1f744be640 1 -- 172.21.15.112:0/3282202575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6c1150d0 con 0x7f1f6c0fdc40 2024-09-19T09:32:31.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.928+0000 7f1f744be640 1 -- 172.21.15.112:0/3282202575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6c04b720 con 0x7f1f6c0fdc40 2024-09-19T09:32:31.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.929+0000 7f1f62ffd640 1 -- 172.21.15.112:0/3282202575 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f1f68030020 con 0x7f1f6c0fdc40 2024-09-19T09:32:31.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.929+0000 7f1f62ffd640 1 --2- 172.21.15.112:0/3282202575 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f1f5806ed60 0x7f1f58071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:31.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.929+0000 7f1f62ffd640 1 -- 172.21.15.112:0/3282202575 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1f680ae210 con 0x7f1f6c0fdc40 2024-09-19T09:32:31.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.929+0000 7f1f71a59640 1 --2- 172.21.15.112:0/3282202575 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f1f5806ed60 0x7f1f58071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:31.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.930+0000 7f1f71a59640 1 --2- 172.21.15.112:0/3282202575 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f1f5806ed60 0x7f1f58071210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c004fd0 tx=0x7f1f5c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:31.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:31.933+0000 7f1f62ffd640 1 -- 172.21.15.112:0/3282202575 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1f6807b460 con 0x7f1f6c0fdc40 2024-09-19T09:32:32.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:32.126+0000 7f1f744be640 1 -- 172.21.15.112:0/3282202575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f1f6c0fc400 con 0x7f1f6c0fdc40 2024-09-19T09:32:32.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:32 smithi191 ceph-mon[34834]: mds.? [v2:172.21.15.112:6826/3112259740,v1:172.21.15.112:6827/3112259740] up:active 2024-09-19T09:32:32.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:32 smithi191 ceph-mon[34834]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 2024-09-19T09:32:32.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:32 smithi112 ceph-mon[27605]: mds.? [v2:172.21.15.112:6826/3112259740,v1:172.21.15.112:6827/3112259740] up:active 2024-09-19T09:32:32.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:32 smithi112 ceph-mon[27605]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 2024-09-19T09:32:33.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:33.037+0000 7f1f62ffd640 1 -- 172.21.15.112:0/3282202575 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f1f6c0fc400 con 0x7f1f6c0fdc40 2024-09-19T09:32:33.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:33.039+0000 7f1f744be640 1 -- 172.21.15.112:0/3282202575 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f1f5806ed60 msgr2=0x7f1f58071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:33.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:33.039+0000 7f1f744be640 1 --2- 172.21.15.112:0/3282202575 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f1f5806ed60 0x7f1f58071210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c004fd0 tx=0x7f1f5c00b040 comp rx=0 tx=0).stop 2024-09-19T09:32:33.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:33.039+0000 7f1f744be640 1 -- 172.21.15.112:0/3282202575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f6c0fdc40 msgr2=0x7f1f6c0fd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:33.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:33.039+0000 7f1f744be640 1 --2- 172.21.15.112:0/3282202575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f6c0fdc40 0x7f1f6c0fd430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1f680048a0 tx=0x7f1f68009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:33.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:33.039+0000 7f1f744be640 1 -- 172.21.15.112:0/3282202575 shutdown_connections 2024-09-19T09:32:33.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:33.039+0000 7f1f744be640 1 --2- 172.21.15.112:0/3282202575 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f1f5806ed60 0x7f1f58071210 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:33.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:33.039+0000 7f1f744be640 1 --2- 172.21.15.112:0/3282202575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f6c0fe590 0x7f1f6c0fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:33.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:33.039+0000 7f1f744be640 1 --2- 172.21.15.112:0/3282202575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f6c0fdc40 0x7f1f6c0fd430 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:33.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:33.039+0000 7f1f744be640 1 -- 172.21.15.112:0/3282202575 >> 172.21.15.112:0/3282202575 conn(0x7f1f6c0f63a0 msgr2=0x7f1f6c0f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:33.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:33.039+0000 7f1f744be640 1 -- 172.21.15.112:0/3282202575 shutdown_connections 2024-09-19T09:32:33.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:33.039+0000 7f1f744be640 1 -- 172.21.15.112:0/3282202575 wait complete. 2024-09-19T09:32:33.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:33 smithi112 ceph-mon[27605]: pgmap v176: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 302 B/s wr, 2 op/s 2024-09-19T09:32:33.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:33 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3282202575' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-19T09:32:33.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:33 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:33.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:33 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:33.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:33 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:33.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:33 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.hcoxjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:32:33.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:33 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.hcoxjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:32:33.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:33 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:33.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:33 smithi191 ceph-mon[34834]: pgmap v176: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 302 B/s wr, 2 op/s 2024-09-19T09:32:33.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:33 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/3282202575' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-19T09:32:33.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:33 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:33.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:33 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:33.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:33 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:33.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:33 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.hcoxjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:32:33.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:33 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.hcoxjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:32:33.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:33 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:34.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:34 smithi112 ceph-mon[27605]: Deploying daemon mds.cephfs.smithi112.hcoxjz on smithi112 2024-09-19T09:32:34.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:34 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3282202575' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-19T09:32:34.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:34 smithi112 ceph-mon[27605]: mds.? [v2:172.21.15.191:6824/88218660,v1:172.21.15.191:6825/88218660] up:boot 2024-09-19T09:32:34.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:34 smithi112 ceph-mon[27605]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 1 up:standby 2024-09-19T09:32:34.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:34 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.jjldod"}]: dispatch 2024-09-19T09:32:34.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:34 smithi112 ceph-mon[27605]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 1 up:standby 2024-09-19T09:32:34.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:34 smithi191 ceph-mon[34834]: Deploying daemon mds.cephfs.smithi112.hcoxjz on smithi112 2024-09-19T09:32:34.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:34 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/3282202575' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-19T09:32:34.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:34 smithi191 ceph-mon[34834]: mds.? [v2:172.21.15.191:6824/88218660,v1:172.21.15.191:6825/88218660] up:boot 2024-09-19T09:32:34.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:34 smithi191 ceph-mon[34834]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 1 up:standby 2024-09-19T09:32:34.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:34 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.jjldod"}]: dispatch 2024-09-19T09:32:34.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:34 smithi191 ceph-mon[34834]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 1 up:standby 2024-09-19T09:32:35.113 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:35 smithi112 ceph-mon[27605]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T09:32:35.114 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:32:35.123 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-19T09:32:35.123 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-19T09:32:35.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:35 smithi191 ceph-mon[34834]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T09:32:35.675 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:36.782 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:36 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:36.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:36 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:36.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:36 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:36.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:36 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.qweljt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:32:36.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:36 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.qweljt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:32:36.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:36 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:36.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:36 smithi112 ceph-mon[27605]: Deploying daemon mds.cephfs.smithi191.qweljt on smithi191 2024-09-19T09:32:36.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:36 smithi112 ceph-mon[27605]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-19T09:32:36.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:36 smithi112 ceph-mon[27605]: mds.? [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] up:boot 2024-09-19T09:32:36.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:36 smithi112 ceph-mon[27605]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 2 up:standby 2024-09-19T09:32:36.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:36 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.hcoxjz"}]: dispatch 2024-09-19T09:32:37.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:36 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:37.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:36 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:37.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:36 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:37.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:36 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.qweljt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:32:37.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:36 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.qweljt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:32:37.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:36 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:37.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:36 smithi191 ceph-mon[34834]: Deploying daemon mds.cephfs.smithi191.qweljt on smithi191 2024-09-19T09:32:37.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:36 smithi191 ceph-mon[34834]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-19T09:32:37.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:36 smithi191 ceph-mon[34834]: mds.? [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] up:boot 2024-09-19T09:32:37.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:36 smithi191 ceph-mon[34834]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 2 up:standby 2024-09-19T09:32:37.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:36 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.hcoxjz"}]: dispatch 2024-09-19T09:32:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.249+0000 7f2f221b1640 1 -- 172.21.15.112:0/1400403444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f1c0ff6d0 msgr2=0x7f2f1c101ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.249+0000 7f2f221b1640 1 --2- 172.21.15.112:0/1400403444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f1c0ff6d0 0x7f2f1c101ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2f100048d0 tx=0x7f2f10009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.249+0000 7f2f221b1640 1 -- 172.21.15.112:0/1400403444 shutdown_connections 2024-09-19T09:32:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.249+0000 7f2f221b1640 1 --2- 172.21.15.112:0/1400403444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f1c0ff6d0 0x7f2f1c101ab0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.249+0000 7f2f221b1640 1 --2- 172.21.15.112:0/1400403444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f1c066470 0x7f2f1c0ff190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.249+0000 7f2f221b1640 1 -- 172.21.15.112:0/1400403444 >> 172.21.15.112:0/1400403444 conn(0x7f2f1c0f6c00 msgr2=0x7f2f1c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.249+0000 7f2f221b1640 1 -- 172.21.15.112:0/1400403444 shutdown_connections 2024-09-19T09:32:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.249+0000 7f2f221b1640 1 -- 172.21.15.112:0/1400403444 wait complete. 2024-09-19T09:32:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.250+0000 7f2f221b1640 1 Processor -- start 2024-09-19T09:32:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.250+0000 7f2f221b1640 1 -- start start 2024-09-19T09:32:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.250+0000 7f2f221b1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f1c066470 0x7f2f1c10d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.250+0000 7f2f221b1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f1c0ff6d0 0x7f2f1c10d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.250+0000 7f2f221b1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c10e4a0 con 0x7f2f1c0ff6d0 2024-09-19T09:32:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.250+0000 7f2f221b1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c10e610 con 0x7f2f1c066470 2024-09-19T09:32:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.250+0000 7f2f1affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f1c0ff6d0 0x7f2f1c10d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.250+0000 7f2f1affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f1c0ff6d0 0x7f2f1c10d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37548/0 (socket says 172.21.15.112:37548) 2024-09-19T09:32:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.250+0000 7f2f1affd640 1 -- 172.21.15.112:0/2089549355 learned_addr learned my addr 172.21.15.112:0/2089549355 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.251+0000 7f2f1affd640 1 -- 172.21.15.112:0/2089549355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f1c066470 msgr2=0x7f2f1c10d0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:32:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.251+0000 7f2f1affd640 1 --2- 172.21.15.112:0/2089549355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f1c066470 0x7f2f1c10d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.251+0000 7f2f1affd640 1 -- 172.21.15.112:0/2089549355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f10005040 con 0x7f2f1c0ff6d0 2024-09-19T09:32:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.251+0000 7f2f1affd640 1 --2- 172.21.15.112:0/2089549355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f1c0ff6d0 0x7f2f1c10d630 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2f100048a0 tx=0x7f2f10009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.251+0000 7f2f03fff640 1 -- 172.21.15.112:0/2089549355 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f10038070 con 0x7f2f1c0ff6d0 2024-09-19T09:32:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.251+0000 7f2f221b1640 1 -- 172.21.15.112:0/2089549355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1c10e890 con 0x7f2f1c0ff6d0 2024-09-19T09:32:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.251+0000 7f2f03fff640 1 -- 172.21.15.112:0/2089549355 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2f10032d30 con 0x7f2f1c0ff6d0 2024-09-19T09:32:37.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.251+0000 7f2f03fff640 1 -- 172.21.15.112:0/2089549355 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f1003dc80 con 0x7f2f1c0ff6d0 2024-09-19T09:32:37.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.251+0000 7f2f221b1640 1 -- 172.21.15.112:0/2089549355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c10ed50 con 0x7f2f1c0ff6d0 2024-09-19T09:32:37.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.252+0000 7f2f221b1640 1 -- 172.21.15.112:0/2089549355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c0fa880 con 0x7f2f1c0ff6d0 2024-09-19T09:32:37.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.253+0000 7f2f03fff640 1 -- 172.21.15.112:0/2089549355 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f2f10030020 con 0x7f2f1c0ff6d0 2024-09-19T09:32:37.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.253+0000 7f2f03fff640 1 --2- 172.21.15.112:0/2089549355 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f2f0406ed60 0x7f2f04071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.253+0000 7f2f03fff640 1 -- 172.21.15.112:0/2089549355 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2f100aed20 con 0x7f2f1c0ff6d0 2024-09-19T09:32:37.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.254+0000 7f2f1b7fe640 1 --2- 172.21.15.112:0/2089549355 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f2f0406ed60 0x7f2f04071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.254+0000 7f2f1b7fe640 1 --2- 172.21.15.112:0/2089549355 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f2f0406ed60 0x7f2f04071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0661d0 tx=0x7f2f0c006ca0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:37.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.258+0000 7f2f03fff640 1 -- 172.21.15.112:0/2089549355 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2f1007be40 con 0x7f2f1c0ff6d0 2024-09-19T09:32:37.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.447+0000 7f2f221b1640 1 -- 172.21.15.112:0/2089549355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f2f1c105150 con 0x7f2f1c0ff6d0 2024-09-19T09:32:37.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.707+0000 7f2f03fff640 1 -- 172.21.15.112:0/2089549355 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v9) v1 ==== 121+0+0 (secure 0 0 0) 0x7f2f1007b7e0 con 0x7f2f1c0ff6d0 2024-09-19T09:32:37.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.709+0000 7f2f221b1640 1 -- 172.21.15.112:0/2089549355 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f2f0406ed60 msgr2=0x7f2f04071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:37.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.709+0000 7f2f221b1640 1 --2- 172.21.15.112:0/2089549355 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f2f0406ed60 0x7f2f04071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0661d0 tx=0x7f2f0c006ca0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.709+0000 7f2f221b1640 1 -- 172.21.15.112:0/2089549355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f1c0ff6d0 msgr2=0x7f2f1c10d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:37.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.709+0000 7f2f221b1640 1 --2- 172.21.15.112:0/2089549355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f1c0ff6d0 0x7f2f1c10d630 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2f100048a0 tx=0x7f2f10009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.709+0000 7f2f221b1640 1 -- 172.21.15.112:0/2089549355 shutdown_connections 2024-09-19T09:32:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.709+0000 7f2f221b1640 1 --2- 172.21.15.112:0/2089549355 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f2f0406ed60 0x7f2f04071210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.709+0000 7f2f221b1640 1 --2- 172.21.15.112:0/2089549355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f1c0ff6d0 0x7f2f1c10d630 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.709+0000 7f2f221b1640 1 --2- 172.21.15.112:0/2089549355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f1c066470 0x7f2f1c10d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.709+0000 7f2f221b1640 1 -- 172.21.15.112:0/2089549355 >> 172.21.15.112:0/2089549355 conn(0x7f2f1c0f6c00 msgr2=0x7f2f1c0f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.709+0000 7f2f221b1640 1 -- 172.21.15.112:0/2089549355 shutdown_connections 2024-09-19T09:32:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:37.709+0000 7f2f221b1640 1 -- 172.21.15.112:0/2089549355 wait complete. 2024-09-19T09:32:37.966 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:37 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2089549355' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:32:38.098 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:37 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2089549355' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:32:38.466 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:32:38.475 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-19T09:32:38.475 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-19T09:32:39.031 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:38 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2089549355' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:32:39.031 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:38 smithi191 ceph-mon[34834]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 2 up:standby 2024-09-19T09:32:39.031 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:38 smithi191 ceph-mon[34834]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 1 up:standby-replay 1 up:standby 2024-09-19T09:32:39.031 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:38 smithi191 ceph-mon[34834]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-09-19T09:32:39.031 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:38 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:39.031 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:38 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:39.031 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:38 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:39.031 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:38 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:39.031 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:38 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:39.032 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:38 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:39.098 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:38 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2089549355' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:32:39.098 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:38 smithi112 ceph-mon[27605]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 2 up:standby 2024-09-19T09:32:39.098 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:38 smithi112 ceph-mon[27605]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 1 up:standby-replay 1 up:standby 2024-09-19T09:32:39.098 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:38 smithi112 ceph-mon[27605]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-09-19T09:32:39.098 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:38 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:39.098 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:38 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:39.099 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:38 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:39.099 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:38 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:39.099 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:38 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:39.099 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:38 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:39.750 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:39 smithi112 ceph-mon[27605]: mds.? [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] up:boot 2024-09-19T09:32:39.750 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:39 smithi112 ceph-mon[27605]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 1 up:standby-replay 2 up:standby 2024-09-19T09:32:39.750 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:39 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.qweljt"}]: dispatch 2024-09-19T09:32:39.750 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:39 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:39.833 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:39 smithi191 ceph-mon[34834]: mds.? [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] up:boot 2024-09-19T09:32:39.833 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:39 smithi191 ceph-mon[34834]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 1 up:standby-replay 2 up:standby 2024-09-19T09:32:39.833 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:39 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.qweljt"}]: dispatch 2024-09-19T09:32:39.833 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:39 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:41.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:40 smithi112 ceph-mon[27605]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T09:32:41.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:40 smithi112 ceph-mon[27605]: mds.? [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] up:standby 2024-09-19T09:32:41.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:40 smithi112 ceph-mon[27605]: Dropping low affinity standby-replay daemon mds.cephfs.smithi191.jjldod in favor of higher affinity standby. 2024-09-19T09:32:41.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:40 smithi112 ceph-mon[27605]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 1 up:standby-replay 2 up:standby 2024-09-19T09:32:41.070 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:40 smithi112 ceph-mon[27605]: Dropping low affinity active daemon mds.cephfs.smithi112.ymjyok in favor of higher affinity standby. 2024-09-19T09:32:41.070 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:40 smithi112 ceph-mon[27605]: Replacing daemon mds.cephfs.smithi112.ymjyok as rank 0 with standby daemon mds.cephfs.smithi112.hcoxjz 2024-09-19T09:32:41.070 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:40 smithi112 ceph-mon[27605]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:32:41.070 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:40 smithi112 ceph-mon[27605]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 1 up:standby-replay 1 up:standby 2024-09-19T09:32:41.070 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:40 smithi112 ceph-mon[27605]: osdmap e45: 6 total, 6 up, 6 in 2024-09-19T09:32:41.070 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:40 smithi112 ceph-mon[27605]: fsmap cephfs:1/1 {0=cephfs.smithi112.hcoxjz=up:replay} 1 up:standby 2024-09-19T09:32:41.070 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:40 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:41.070 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:40 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:41.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.067+0000 7f9cf9262640 1 -- 172.21.15.112:0/371570398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cf40fb440 msgr2=0x7f9cf40fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.067+0000 7f9cf9262640 1 --2- 172.21.15.112:0/371570398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cf40fb440 0x7f9cf40fb850 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40048d0 tx=0x7f9ce4009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.067+0000 7f9cf9262640 1 -- 172.21.15.112:0/371570398 shutdown_connections 2024-09-19T09:32:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.067+0000 7f9cf9262640 1 --2- 172.21.15.112:0/371570398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf40fc710 0x7f9cf40fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.067+0000 7f9cf9262640 1 --2- 172.21.15.112:0/371570398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cf40fb440 0x7f9cf40fb850 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.067+0000 7f9cf9262640 1 -- 172.21.15.112:0/371570398 >> 172.21.15.112:0/371570398 conn(0x7f9cf40f6c20 msgr2=0x7f9cf40f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.067+0000 7f9cf9262640 1 -- 172.21.15.112:0/371570398 shutdown_connections 2024-09-19T09:32:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.067+0000 7f9cf9262640 1 -- 172.21.15.112:0/371570398 wait complete. 2024-09-19T09:32:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.068+0000 7f9cf9262640 1 Processor -- start 2024-09-19T09:32:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.068+0000 7f9cf9262640 1 -- start start 2024-09-19T09:32:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.068+0000 7f9cf9262640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cf40fb440 0x7f9cf410bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.068+0000 7f9cf9262640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf40fc710 0x7f9cf410c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.068+0000 7f9cf9262640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf410cb50 con 0x7f9cf40fb440 2024-09-19T09:32:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.068+0000 7f9cf9262640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf410d370 con 0x7f9cf40fc710 2024-09-19T09:32:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.068+0000 7f9cf2ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cf40fb440 0x7f9cf410bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.068+0000 7f9cf2ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cf40fb440 0x7f9cf410bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35388/0 (socket says 172.21.15.112:35388) 2024-09-19T09:32:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.068+0000 7f9cf2ffd640 1 -- 172.21.15.112:0/1022325795 learned_addr learned my addr 172.21.15.112:0/1022325795 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.068+0000 7f9cea7fc640 1 --2- 172.21.15.112:0/1022325795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf40fc710 0x7f9cf410c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.069+0000 7f9cf2ffd640 1 -- 172.21.15.112:0/1022325795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf40fc710 msgr2=0x7f9cf410c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.069+0000 7f9cf2ffd640 1 --2- 172.21.15.112:0/1022325795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf40fc710 0x7f9cf410c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.069+0000 7f9cf2ffd640 1 -- 172.21.15.112:0/1022325795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce4005040 con 0x7f9cf40fb440 2024-09-19T09:32:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.069+0000 7f9cf2ffd640 1 --2- 172.21.15.112:0/1022325795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cf40fb440 0x7f9cf410bfc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40043d0 tx=0x7f9ce4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.069+0000 7f9cebfff640 1 -- 172.21.15.112:0/1022325795 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ce4038070 con 0x7f9cf40fb440 2024-09-19T09:32:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.069+0000 7f9cf9262640 1 -- 172.21.15.112:0/1022325795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf410d5a0 con 0x7f9cf40fb440 2024-09-19T09:32:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.069+0000 7f9cebfff640 1 -- 172.21.15.112:0/1022325795 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9ce402ae90 con 0x7f9cf40fb440 2024-09-19T09:32:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.069+0000 7f9cebfff640 1 -- 172.21.15.112:0/1022325795 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ce403e670 con 0x7f9cf40fb440 2024-09-19T09:32:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.069+0000 7f9cf9262640 1 -- 172.21.15.112:0/1022325795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf410db40 con 0x7f9cf40fb440 2024-09-19T09:32:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.070+0000 7f9cf9262640 1 -- 172.21.15.112:0/1022325795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf40fa8a0 con 0x7f9cf40fb440 2024-09-19T09:32:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.071+0000 7f9cebfff640 1 -- 172.21.15.112:0/1022325795 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9ce4030020 con 0x7f9cf40fb440 2024-09-19T09:32:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.071+0000 7f9cebfff640 1 --2- 172.21.15.112:0/1022325795 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9ce006ed60 0x7f9ce0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.071+0000 7f9cebfff640 1 -- 172.21.15.112:0/1022325795 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9ce40ae360 con 0x7f9cf40fb440 2024-09-19T09:32:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.071+0000 7f9cea7fc640 1 --2- 172.21.15.112:0/1022325795 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9ce006ed60 0x7f9ce0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.072+0000 7f9cea7fc640 1 --2- 172.21.15.112:0/1022325795 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9ce006ed60 0x7f9ce0071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9cf410bd70 tx=0x7f9cdc00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.076+0000 7f9cebfff640 1 -- 172.21.15.112:0/1022325795 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9ce407b4e0 con 0x7f9cf40fb440 2024-09-19T09:32:41.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.273+0000 7f9cf9262640 1 -- 172.21.15.112:0/1022325795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f9cf404b720 con 0x7f9cf40fb440 2024-09-19T09:32:41.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:40 smithi191 ceph-mon[34834]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T09:32:41.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:40 smithi191 ceph-mon[34834]: mds.? [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] up:standby 2024-09-19T09:32:41.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:40 smithi191 ceph-mon[34834]: Dropping low affinity standby-replay daemon mds.cephfs.smithi191.jjldod in favor of higher affinity standby. 2024-09-19T09:32:41.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:40 smithi191 ceph-mon[34834]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 1 up:standby-replay 2 up:standby 2024-09-19T09:32:41.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:40 smithi191 ceph-mon[34834]: Dropping low affinity active daemon mds.cephfs.smithi112.ymjyok in favor of higher affinity standby. 2024-09-19T09:32:41.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:40 smithi191 ceph-mon[34834]: Replacing daemon mds.cephfs.smithi112.ymjyok as rank 0 with standby daemon mds.cephfs.smithi112.hcoxjz 2024-09-19T09:32:41.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:40 smithi191 ceph-mon[34834]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:32:41.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:40 smithi191 ceph-mon[34834]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 1 up:standby-replay 1 up:standby 2024-09-19T09:32:41.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:40 smithi191 ceph-mon[34834]: osdmap e45: 6 total, 6 up, 6 in 2024-09-19T09:32:41.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:40 smithi191 ceph-mon[34834]: fsmap cephfs:1/1 {0=cephfs.smithi112.hcoxjz=up:replay} 1 up:standby 2024-09-19T09:32:41.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:40 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:41.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:40 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:41.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.824+0000 7f9cebfff640 1 -- 172.21.15.112:0/1022325795 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v16) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9ce407ae80 con 0x7f9cf40fb440 2024-09-19T09:32:41.826 INFO:teuthology.orchestra.run.smithi112.stderr:inline data disabled 2024-09-19T09:32:41.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.826+0000 7f9cf9262640 1 -- 172.21.15.112:0/1022325795 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9ce006ed60 msgr2=0x7f9ce0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:41.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.826+0000 7f9cf9262640 1 --2- 172.21.15.112:0/1022325795 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9ce006ed60 0x7f9ce0071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9cf410bd70 tx=0x7f9cdc00b040 comp rx=0 tx=0).stop 2024-09-19T09:32:41.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.826+0000 7f9cf9262640 1 -- 172.21.15.112:0/1022325795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cf40fb440 msgr2=0x7f9cf410bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:41.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.826+0000 7f9cf9262640 1 --2- 172.21.15.112:0/1022325795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cf40fb440 0x7f9cf410bfc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40043d0 tx=0x7f9ce4009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.826+0000 7f9cf9262640 1 -- 172.21.15.112:0/1022325795 shutdown_connections 2024-09-19T09:32:41.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.826+0000 7f9cf9262640 1 --2- 172.21.15.112:0/1022325795 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9ce006ed60 0x7f9ce0071210 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.826+0000 7f9cf9262640 1 --2- 172.21.15.112:0/1022325795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf40fc710 0x7f9cf410c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.826+0000 7f9cf9262640 1 --2- 172.21.15.112:0/1022325795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cf40fb440 0x7f9cf410bfc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.826+0000 7f9cf9262640 1 -- 172.21.15.112:0/1022325795 >> 172.21.15.112:0/1022325795 conn(0x7f9cf40f6c20 msgr2=0x7f9cf40f8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:41.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.826+0000 7f9cf9262640 1 -- 172.21.15.112:0/1022325795 shutdown_connections 2024-09-19T09:32:41.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:41.826+0000 7f9cf9262640 1 -- 172.21.15.112:0/1022325795 wait complete. 2024-09-19T09:32:42.141 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:41 smithi112 ceph-mon[27605]: mds.? [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] up:reconnect 2024-09-19T09:32:42.141 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:41 smithi112 ceph-mon[27605]: mds.? [v2:172.21.15.191:6824/2759077122,v1:172.21.15.191:6825/2759077122] up:boot 2024-09-19T09:32:42.142 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:41 smithi112 ceph-mon[27605]: mds.? [v2:172.21.15.112:6826/3468750429,v1:172.21.15.112:6827/3468750429] up:boot 2024-09-19T09:32:42.142 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:41 smithi112 ceph-mon[27605]: fsmap cephfs:1/1 {0=cephfs.smithi112.hcoxjz=up:reconnect} 3 up:standby 2024-09-19T09:32:42.142 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:41 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:32:42.142 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:41 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.jjldod"}]: dispatch 2024-09-19T09:32:42.142 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:41 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1022325795' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-19T09:32:42.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:41 smithi191 ceph-mon[34834]: mds.? [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] up:reconnect 2024-09-19T09:32:42.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:41 smithi191 ceph-mon[34834]: mds.? [v2:172.21.15.191:6824/2759077122,v1:172.21.15.191:6825/2759077122] up:boot 2024-09-19T09:32:42.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:41 smithi191 ceph-mon[34834]: mds.? [v2:172.21.15.112:6826/3468750429,v1:172.21.15.112:6827/3468750429] up:boot 2024-09-19T09:32:42.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:41 smithi191 ceph-mon[34834]: fsmap cephfs:1/1 {0=cephfs.smithi112.hcoxjz=up:reconnect} 3 up:standby 2024-09-19T09:32:42.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:41 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:32:42.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:41 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.jjldod"}]: dispatch 2024-09-19T09:32:42.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:41 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/1022325795' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-19T09:32:43.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:42 smithi112 ceph-mon[27605]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T09:32:43.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:42 smithi112 ceph-mon[27605]: mds.? [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] up:rejoin 2024-09-19T09:32:43.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:42 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1022325795' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-19T09:32:43.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:42 smithi112 ceph-mon[27605]: fsmap cephfs:1/1 {0=cephfs.smithi112.hcoxjz=up:rejoin} 3 up:standby 2024-09-19T09:32:43.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:42 smithi112 ceph-mon[27605]: daemon mds.cephfs.smithi112.hcoxjz is now active in filesystem cephfs as rank 0 2024-09-19T09:32:43.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:42 smithi112 ceph-mon[27605]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:32:43.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:42 smithi112 ceph-mon[27605]: Cluster is now healthy 2024-09-19T09:32:43.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:42 smithi112 ceph-mon[27605]: mds.? [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] up:active 2024-09-19T09:32:43.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:42 smithi112 ceph-mon[27605]: mds.? [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] up:standby 2024-09-19T09:32:43.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:42 smithi112 ceph-mon[27605]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 1 up:standby-replay 2 up:standby 2024-09-19T09:32:43.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:42 smithi191 ceph-mon[34834]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T09:32:43.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:42 smithi191 ceph-mon[34834]: mds.? [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] up:rejoin 2024-09-19T09:32:43.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:42 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/1022325795' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-19T09:32:43.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:42 smithi191 ceph-mon[34834]: fsmap cephfs:1/1 {0=cephfs.smithi112.hcoxjz=up:rejoin} 3 up:standby 2024-09-19T09:32:43.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:42 smithi191 ceph-mon[34834]: daemon mds.cephfs.smithi112.hcoxjz is now active in filesystem cephfs as rank 0 2024-09-19T09:32:43.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:42 smithi191 ceph-mon[34834]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:32:43.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:42 smithi191 ceph-mon[34834]: Cluster is now healthy 2024-09-19T09:32:43.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:42 smithi191 ceph-mon[34834]: mds.? [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] up:active 2024-09-19T09:32:43.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:42 smithi191 ceph-mon[34834]: mds.? [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] up:standby 2024-09-19T09:32:43.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:42 smithi191 ceph-mon[34834]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 1 up:standby-replay 2 up:standby 2024-09-19T09:32:43.767 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:32:43.778 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-19T09:32:43.778 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T09:32:44.539 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:44.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:44 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:44.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:44 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:32:44.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:44 smithi112 ceph-mon[27605]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-19T09:32:45.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:44 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:45.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:44 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:32:45.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:44 smithi191 ceph-mon[34834]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-19T09:32:46.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.268+0000 7ffb88af0640 1 -- 172.21.15.112:0/1681352496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb840fdb70 msgr2=0x7ffb840fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:46.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.268+0000 7ffb88af0640 1 --2- 172.21.15.112:0/1681352496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb840fdb70 0x7ffb840fdf80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffb740048d0 tx=0x7ffb74009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.268+0000 7ffb88af0640 1 -- 172.21.15.112:0/1681352496 shutdown_connections 2024-09-19T09:32:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.268+0000 7ffb88af0640 1 --2- 172.21.15.112:0/1681352496 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb840fe4c0 0x7ffb840fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.268+0000 7ffb88af0640 1 --2- 172.21.15.112:0/1681352496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb840fdb70 0x7ffb840fdf80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.268+0000 7ffb88af0640 1 -- 172.21.15.112:0/1681352496 >> 172.21.15.112:0/1681352496 conn(0x7ffb840f6390 msgr2=0x7ffb840f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.268+0000 7ffb88af0640 1 -- 172.21.15.112:0/1681352496 shutdown_connections 2024-09-19T09:32:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.268+0000 7ffb88af0640 1 -- 172.21.15.112:0/1681352496 wait complete. 2024-09-19T09:32:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.269+0000 7ffb88af0640 1 Processor -- start 2024-09-19T09:32:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.269+0000 7ffb88af0640 1 -- start start 2024-09-19T09:32:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.269+0000 7ffb88af0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb840fdb70 0x7ffb840fd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.269+0000 7ffb88af0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb840fe4c0 0x7ffb840fb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.269+0000 7ffb88af0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840fbde0 con 0x7ffb840fe4c0 2024-09-19T09:32:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.269+0000 7ffb88af0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840fbf20 con 0x7ffb840fdb70 2024-09-19T09:32:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.269+0000 7ffb81d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb840fe4c0 0x7ffb840fb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.269+0000 7ffb81d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb840fe4c0 0x7ffb840fb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35410/0 (socket says 172.21.15.112:35410) 2024-09-19T09:32:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.269+0000 7ffb81d9b640 1 -- 172.21.15.112:0/4192516593 learned_addr learned my addr 172.21.15.112:0/4192516593 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.269+0000 7ffb8259c640 1 --2- 172.21.15.112:0/4192516593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb840fdb70 0x7ffb840fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.269+0000 7ffb81d9b640 1 -- 172.21.15.112:0/4192516593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb840fdb70 msgr2=0x7ffb840fd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.269+0000 7ffb81d9b640 1 --2- 172.21.15.112:0/4192516593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb840fdb70 0x7ffb840fd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.270+0000 7ffb81d9b640 1 -- 172.21.15.112:0/4192516593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb74005040 con 0x7ffb840fe4c0 2024-09-19T09:32:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.270+0000 7ffb81d9b640 1 --2- 172.21.15.112:0/4192516593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb840fe4c0 0x7ffb840fb850 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb78002f40 tx=0x7ffb7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.270+0000 7ffb72ffd640 1 -- 172.21.15.112:0/4192516593 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb78007c30 con 0x7ffb840fe4c0 2024-09-19T09:32:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.270+0000 7ffb88af0640 1 -- 172.21.15.112:0/4192516593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb840fc1a0 con 0x7ffb840fe4c0 2024-09-19T09:32:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.270+0000 7ffb72ffd640 1 -- 172.21.15.112:0/4192516593 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffb7800f040 con 0x7ffb840fe4c0 2024-09-19T09:32:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.270+0000 7ffb72ffd640 1 -- 172.21.15.112:0/4192516593 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7800cb60 con 0x7ffb840fe4c0 2024-09-19T09:32:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.270+0000 7ffb88af0640 1 -- 172.21.15.112:0/4192516593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb841150e0 con 0x7ffb840fe4c0 2024-09-19T09:32:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.271+0000 7ffb88af0640 1 -- 172.21.15.112:0/4192516593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb840fa010 con 0x7ffb840fe4c0 2024-09-19T09:32:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.272+0000 7ffb72ffd640 1 -- 172.21.15.112:0/4192516593 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ffb7800ccc0 con 0x7ffb840fe4c0 2024-09-19T09:32:46.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.272+0000 7ffb72ffd640 1 --2- 172.21.15.112:0/4192516593 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7ffb6c06ed60 0x7ffb6c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.272+0000 7ffb8259c640 1 --2- 172.21.15.112:0/4192516593 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7ffb6c06ed60 0x7ffb6c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.272+0000 7ffb72ffd640 1 -- 172.21.15.112:0/4192516593 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ffb7808dd70 con 0x7ffb840fe4c0 2024-09-19T09:32:46.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.273+0000 7ffb8259c640 1 --2- 172.21.15.112:0/4192516593 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7ffb6c06ed60 0x7ffb6c071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb74000c00 tx=0x7ffb74035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:46.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.277+0000 7ffb72ffd640 1 -- 172.21.15.112:0/4192516593 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffb7805aef0 con 0x7ffb840fe4c0 2024-09-19T09:32:46.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.484+0000 7ffb88af0640 1 -- 172.21.15.112:0/4192516593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb8404b720 con 0x7ffb840fe4c0 2024-09-19T09:32:46.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.485+0000 7ffb72ffd640 1 -- 172.21.15.112:0/4192516593 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1841 (secure 0 0 0) 0x7ffb78019750 con 0x7ffb840fe4c0 2024-09-19T09:32:46.487 INFO:teuthology.orchestra.run.smithi112.stdout:e17 2024-09-19T09:32:46.487 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:32:46.487 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:32:46.487 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-19T09:32:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:32:46.487 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:32:46.487 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-19T09:32:46.487 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 17 2024-09-19T09:32:46.487 INFO:teuthology.orchestra.run.smithi112.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:32:46.488 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:32:46.488 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-19T09:32:42.200999+0000 2024-09-19T09:32:46.488 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-19T09:32:46.488 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-19T09:32:46.488 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-19T09:32:46.488 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-19T09:32:46.488 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-19T09:32:46.488 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-19T09:32:46.488 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-19T09:32:46.488 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 45 2024-09-19T09:32:46.488 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:32:46.489 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-19T09:32:46.489 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-19T09:32:46.489 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14460} 2024-09-19T09:32:46.489 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-19T09:32:46.489 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-19T09:32:46.489 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-19T09:32:46.489 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-19T09:32:46.489 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-19T09:32:46.489 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data disabled 2024-09-19T09:32:46.489 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-19T09:32:46.489 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-19T09:32:46.489 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.hcoxjz{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:32:46.489 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ymjyok{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/3468750429,v1:172.21.15.112:6827/3468750429] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:32:46.489 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:32:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:32:46.490 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-19T09:32:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:32:46.490 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.qweljt{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:32:46.490 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.jjldod{-1:24281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6824/2759077122,v1:172.21.15.191:6825/2759077122] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:32:46.490 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2024-09-19T09:32:46.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.487+0000 7ffb88af0640 1 -- 172.21.15.112:0/4192516593 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7ffb6c06ed60 msgr2=0x7ffb6c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:46.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.487+0000 7ffb88af0640 1 --2- 172.21.15.112:0/4192516593 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7ffb6c06ed60 0x7ffb6c071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb74000c00 tx=0x7ffb74035040 comp rx=0 tx=0).stop 2024-09-19T09:32:46.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.487+0000 7ffb88af0640 1 -- 172.21.15.112:0/4192516593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb840fe4c0 msgr2=0x7ffb840fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:46.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.487+0000 7ffb88af0640 1 --2- 172.21.15.112:0/4192516593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb840fe4c0 0x7ffb840fb850 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb78002f40 tx=0x7ffb7800b040 comp rx=0 tx=0).stop 2024-09-19T09:32:46.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.487+0000 7ffb88af0640 1 -- 172.21.15.112:0/4192516593 shutdown_connections 2024-09-19T09:32:46.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.487+0000 7ffb88af0640 1 --2- 172.21.15.112:0/4192516593 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7ffb6c06ed60 0x7ffb6c071210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.487+0000 7ffb88af0640 1 --2- 172.21.15.112:0/4192516593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb840fe4c0 0x7ffb840fb850 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.487+0000 7ffb88af0640 1 --2- 172.21.15.112:0/4192516593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb840fdb70 0x7ffb840fd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.487+0000 7ffb88af0640 1 -- 172.21.15.112:0/4192516593 >> 172.21.15.112:0/4192516593 conn(0x7ffb840f6390 msgr2=0x7ffb840f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:46.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.487+0000 7ffb88af0640 1 -- 172.21.15.112:0/4192516593 shutdown_connections 2024-09-19T09:32:46.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:46.487+0000 7ffb88af0640 1 -- 172.21.15.112:0/4192516593 wait complete. 2024-09-19T09:32:46.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:46 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:46.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:46 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:46.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:46 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:46.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:46 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:46.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:46 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:46.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:46 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:46.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:46 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:46.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:46 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:46.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:46 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:46.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:46 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:46.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:46 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:46.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:46 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:47.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:47 smithi191 ceph-mon[34834]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T09:32:47.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:47 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/4192516593' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:32:47.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:47 smithi112 ceph-mon[27605]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T09:32:47.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:47 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/4192516593' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:32:47.739 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-19T09:32:48.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:48.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:48 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:48.595 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:48.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:48 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:48.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:48 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:49.658 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:49 smithi112 ceph-mon[27605]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-19T09:32:49.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:49 smithi191 ceph-mon[34834]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-19T09:32:50.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.838+0000 7f88caadd640 1 -- 172.21.15.112:0/2665210895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c40fc710 msgr2=0x7f88c40fcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:50.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.838+0000 7f88caadd640 1 --2- 172.21.15.112:0/2665210895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c40fc710 0x7f88c40fcb80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f88b40048d0 tx=0x7f88b4009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:50.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.838+0000 7f88caadd640 1 -- 172.21.15.112:0/2665210895 shutdown_connections 2024-09-19T09:32:50.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.838+0000 7f88caadd640 1 --2- 172.21.15.112:0/2665210895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c40fc710 0x7f88c40fcb80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:50.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.838+0000 7f88caadd640 1 --2- 172.21.15.112:0/2665210895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88c40fb440 0x7f88c40fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:50.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.838+0000 7f88caadd640 1 -- 172.21.15.112:0/2665210895 >> 172.21.15.112:0/2665210895 conn(0x7f88c40f6c00 msgr2=0x7f88c40f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:50.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.839+0000 7f88caadd640 1 -- 172.21.15.112:0/2665210895 shutdown_connections 2024-09-19T09:32:50.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.839+0000 7f88caadd640 1 -- 172.21.15.112:0/2665210895 wait complete. 2024-09-19T09:32:50.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.839+0000 7f88caadd640 1 Processor -- start 2024-09-19T09:32:50.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.839+0000 7f88caadd640 1 -- start start 2024-09-19T09:32:50.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.839+0000 7f88caadd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88c40fb440 0x7f88c410d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:50.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.839+0000 7f88caadd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c40fc710 0x7f88c410d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:50.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.839+0000 7f88caadd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c410dc90 con 0x7f88c40fc710 2024-09-19T09:32:50.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.839+0000 7f88caadd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c410e460 con 0x7f88c40fb440 2024-09-19T09:32:50.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.840+0000 7f88bbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c40fc710 0x7f88c410d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:50.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.840+0000 7f88bbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c40fc710 0x7f88c410d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53140/0 (socket says 172.21.15.112:53140) 2024-09-19T09:32:50.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.840+0000 7f88bbfff640 1 -- 172.21.15.112:0/3747252917 learned_addr learned my addr 172.21.15.112:0/3747252917 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:50.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.840+0000 7f88c8879640 1 --2- 172.21.15.112:0/3747252917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88c40fb440 0x7f88c410d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:50.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.840+0000 7f88bbfff640 1 -- 172.21.15.112:0/3747252917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88c40fb440 msgr2=0x7f88c410d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:50.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.840+0000 7f88bbfff640 1 --2- 172.21.15.112:0/3747252917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88c40fb440 0x7f88c410d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:50.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.840+0000 7f88bbfff640 1 -- 172.21.15.112:0/3747252917 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4005040 con 0x7f88c40fc710 2024-09-19T09:32:50.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.840+0000 7f88bbfff640 1 --2- 172.21.15.112:0/3747252917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c40fc710 0x7f88c410d640 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f88b40043d0 tx=0x7f88b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:50.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.840+0000 7f88b97fa640 1 -- 172.21.15.112:0/3747252917 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88b4038070 con 0x7f88c40fc710 2024-09-19T09:32:50.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.840+0000 7f88caadd640 1 -- 172.21.15.112:0/3747252917 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c410e690 con 0x7f88c40fc710 2024-09-19T09:32:50.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.840+0000 7f88b97fa640 1 -- 172.21.15.112:0/3747252917 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f88b402ae90 con 0x7f88c40fc710 2024-09-19T09:32:50.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.840+0000 7f88b97fa640 1 -- 172.21.15.112:0/3747252917 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88b403e670 con 0x7f88c40fc710 2024-09-19T09:32:50.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.840+0000 7f88caadd640 1 -- 172.21.15.112:0/3747252917 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c410ebb0 con 0x7f88c40fc710 2024-09-19T09:32:50.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.842+0000 7f88caadd640 1 -- 172.21.15.112:0/3747252917 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c40fa8a0 con 0x7f88c40fc710 2024-09-19T09:32:50.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.842+0000 7f88b97fa640 1 -- 172.21.15.112:0/3747252917 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f88b4030020 con 0x7f88c40fc710 2024-09-19T09:32:50.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.842+0000 7f88b97fa640 1 --2- 172.21.15.112:0/3747252917 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f88ac06ed60 0x7f88ac071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:50.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.843+0000 7f88b97fa640 1 -- 172.21.15.112:0/3747252917 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f88b40ae3d0 con 0x7f88c40fc710 2024-09-19T09:32:50.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.843+0000 7f88c8879640 1 --2- 172.21.15.112:0/3747252917 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f88ac06ed60 0x7f88ac071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:50.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.843+0000 7f88c8879640 1 --2- 172.21.15.112:0/3747252917 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f88ac06ed60 0x7f88ac071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009fd0 tx=0x7f88c000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:50.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:50.847+0000 7f88b97fa640 1 -- 172.21.15.112:0/3747252917 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f88b407b550 con 0x7f88c40fc710 2024-09-19T09:32:51.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:51.042+0000 7f88caadd640 1 -- 172.21.15.112:0/3747252917 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88c404b720 con 0x7f88c40fc710 2024-09-19T09:32:51.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:51.042+0000 7f88b97fa640 1 -- 172.21.15.112:0/3747252917 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4705 (secure 0 0 0) 0x7f88b407aef0 con 0x7f88c40fc710 2024-09-19T09:32:51.045 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:51.044+0000 7f88caadd640 1 -- 172.21.15.112:0/3747252917 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f88ac06ed60 msgr2=0x7f88ac071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:51.044+0000 7f88caadd640 1 --2- 172.21.15.112:0/3747252917 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f88ac06ed60 0x7f88ac071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009fd0 tx=0x7f88c000b040 comp rx=0 tx=0).stop 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:51.044+0000 7f88caadd640 1 -- 172.21.15.112:0/3747252917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c40fc710 msgr2=0x7f88c410d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:51.044+0000 7f88caadd640 1 --2- 172.21.15.112:0/3747252917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c40fc710 0x7f88c410d640 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f88b40043d0 tx=0x7f88b4009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:51.044+0000 7f88caadd640 1 -- 172.21.15.112:0/3747252917 shutdown_connections 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:51.044+0000 7f88caadd640 1 --2- 172.21.15.112:0/3747252917 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f88ac06ed60 0x7f88ac071210 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:51.044+0000 7f88caadd640 1 --2- 172.21.15.112:0/3747252917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c40fc710 0x7f88c410d640 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:51.044+0000 7f88caadd640 1 --2- 172.21.15.112:0/3747252917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88c40fb440 0x7f88c410d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:51.044+0000 7f88caadd640 1 -- 172.21.15.112:0/3747252917 >> 172.21.15.112:0/3747252917 conn(0x7f88c40f6c00 msgr2=0x7f88c40661c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:51.045+0000 7f88caadd640 1 -- 172.21.15.112:0/3747252917 shutdown_connections 2024-09-19T09:32:51.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:51.045+0000 7f88caadd640 1 -- 172.21.15.112:0/3747252917 wait complete. 2024-09-19T09:32:51.055 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:32:51.605 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:51 smithi112 ceph-mon[27605]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-19T09:32:51.605 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:51 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3747252917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:32:51.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:51 smithi191 ceph-mon[34834]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-19T09:32:51.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:51 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/3747252917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:32:51.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-19T09:32:52.643 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:53.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:53 smithi112 ceph-mon[27605]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T09:32:53.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:53 smithi191 ceph-mon[34834]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T09:32:54.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.286+0000 7f0369dae640 1 -- 172.21.15.112:0/3030645962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03640fd820 msgr2=0x7f03640fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:54.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.286+0000 7f0369dae640 1 --2- 172.21.15.112:0/3030645962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03640fd820 0x7f03640fdc90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f03580048d0 tx=0x7f0358009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.286+0000 7f0369dae640 1 -- 172.21.15.112:0/3030645962 shutdown_connections 2024-09-19T09:32:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.286+0000 7f0369dae640 1 --2- 172.21.15.112:0/3030645962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03640fd820 0x7f03640fdc90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.286+0000 7f0369dae640 1 --2- 172.21.15.112:0/3030645962 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03640fc550 0x7f03640fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.286+0000 7f0369dae640 1 -- 172.21.15.112:0/3030645962 >> 172.21.15.112:0/3030645962 conn(0x7f03640f7d30 msgr2=0x7f03640fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.286+0000 7f0369dae640 1 -- 172.21.15.112:0/3030645962 shutdown_connections 2024-09-19T09:32:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.286+0000 7f0369dae640 1 -- 172.21.15.112:0/3030645962 wait complete. 2024-09-19T09:32:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.287+0000 7f0369dae640 1 Processor -- start 2024-09-19T09:32:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.287+0000 7f0369dae640 1 -- start start 2024-09-19T09:32:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.287+0000 7f0369dae640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03640fc550 0x7f036410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.287+0000 7f0369dae640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03640fd820 0x7f036410d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.287+0000 7f0369dae640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036410dc40 con 0x7f03640fc550 2024-09-19T09:32:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.287+0000 7f0369dae640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036410e460 con 0x7f03640fd820 2024-09-19T09:32:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.287+0000 7f03637fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03640fc550 0x7f036410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.287+0000 7f03637fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03640fc550 0x7f036410d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53172/0 (socket says 172.21.15.112:53172) 2024-09-19T09:32:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.287+0000 7f03637fe640 1 -- 172.21.15.112:0/2667188859 learned_addr learned my addr 172.21.15.112:0/2667188859 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.288+0000 7f03637fe640 1 -- 172.21.15.112:0/2667188859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03640fd820 msgr2=0x7f036410d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.288+0000 7f03637fe640 1 --2- 172.21.15.112:0/2667188859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03640fd820 0x7f036410d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.288+0000 7f03637fe640 1 -- 172.21.15.112:0/2667188859 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0358005040 con 0x7f03640fc550 2024-09-19T09:32:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.288+0000 7f03637fe640 1 --2- 172.21.15.112:0/2667188859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03640fc550 0x7f036410d0b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0354002a50 tx=0x7f0354004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:54.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.288+0000 7f034bfff640 1 -- 172.21.15.112:0/2667188859 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0354007c30 con 0x7f03640fc550 2024-09-19T09:32:54.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.288+0000 7f0369dae640 1 -- 172.21.15.112:0/2667188859 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036410e6f0 con 0x7f03640fc550 2024-09-19T09:32:54.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.288+0000 7f034bfff640 1 -- 172.21.15.112:0/2667188859 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f035400f040 con 0x7f03640fc550 2024-09-19T09:32:54.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.288+0000 7f034bfff640 1 -- 172.21.15.112:0/2667188859 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f035400da90 con 0x7f03640fc550 2024-09-19T09:32:54.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.288+0000 7f0369dae640 1 -- 172.21.15.112:0/2667188859 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036410ec90 con 0x7f03640fc550 2024-09-19T09:32:54.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.289+0000 7f0369dae640 1 -- 172.21.15.112:0/2667188859 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03640fb9b0 con 0x7f03640fc550 2024-09-19T09:32:54.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.289+0000 7f034bfff640 1 -- 172.21.15.112:0/2667188859 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f035400dd00 con 0x7f03640fc550 2024-09-19T09:32:54.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.290+0000 7f034bfff640 1 --2- 172.21.15.112:0/2667188859 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f034c06ed60 0x7f034c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:54.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.290+0000 7f0362ffd640 1 --2- 172.21.15.112:0/2667188859 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f034c06ed60 0x7f034c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:54.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.290+0000 7f034bfff640 1 -- 172.21.15.112:0/2667188859 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f035408dac0 con 0x7f03640fc550 2024-09-19T09:32:54.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.290+0000 7f0362ffd640 1 --2- 172.21.15.112:0/2667188859 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f034c06ed60 0x7f034c071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f035802a530 tx=0x7f0358009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:54.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.294+0000 7f034bfff640 1 -- 172.21.15.112:0/2667188859 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f035404d2a0 con 0x7f03640fc550 2024-09-19T09:32:54.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.512+0000 7f0369dae640 1 -- 172.21.15.112:0/2667188859 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f0364104f80 con 0x7f03640fc550 2024-09-19T09:32:54.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.512+0000 7f034bfff640 1 -- 172.21.15.112:0/2667188859 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v17) v1 ==== 78+0+100 (secure 0 0 0) 0x7f035405ac50 con 0x7f03640fc550 2024-09-19T09:32:54.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.514+0000 7f0369dae640 1 -- 172.21.15.112:0/2667188859 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f034c06ed60 msgr2=0x7f034c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:54.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.514+0000 7f0369dae640 1 --2- 172.21.15.112:0/2667188859 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f034c06ed60 0x7f034c071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f035802a530 tx=0x7f0358009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:54.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.514+0000 7f0369dae640 1 -- 172.21.15.112:0/2667188859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03640fc550 msgr2=0x7f036410d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:54.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.514+0000 7f0369dae640 1 --2- 172.21.15.112:0/2667188859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03640fc550 0x7f036410d0b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0354002a50 tx=0x7f0354004600 comp rx=0 tx=0).stop 2024-09-19T09:32:54.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.514+0000 7f0369dae640 1 -- 172.21.15.112:0/2667188859 shutdown_connections 2024-09-19T09:32:54.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.514+0000 7f0369dae640 1 --2- 172.21.15.112:0/2667188859 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f034c06ed60 0x7f034c071210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:54.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.514+0000 7f0369dae640 1 --2- 172.21.15.112:0/2667188859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03640fd820 0x7f036410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:54.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.514+0000 7f0369dae640 1 --2- 172.21.15.112:0/2667188859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03640fc550 0x7f036410d0b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:54.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.514+0000 7f0369dae640 1 -- 172.21.15.112:0/2667188859 >> 172.21.15.112:0/2667188859 conn(0x7f03640f7d30 msgr2=0x7f03640f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:54.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.515+0000 7f0369dae640 1 -- 172.21.15.112:0/2667188859 shutdown_connections 2024-09-19T09:32:54.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:54.515+0000 7f0369dae640 1 -- 172.21.15.112:0/2667188859 wait complete. 2024-09-19T09:32:54.525 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:32:55.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:54 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:55.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:54 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:55.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:54 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:55.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:54 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:55.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:54 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:55.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:54 smithi191 ceph-mon[34834]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T09:32:55.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:54 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2667188859' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-19T09:32:55.080 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:54 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:55.080 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:54 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:55.080 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:54 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:55.080 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:54 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:55.080 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:54 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:32:55.080 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:54 smithi112 ceph-mon[27605]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T09:32:55.081 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:54 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2667188859' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-19T09:32:55.106 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-19T09:32:55.118 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:32:55.364 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:57.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.008+0000 7f4b56aa8640 1 -- 172.21.15.112:0/2017091746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500fcf80 msgr2=0x7f4b500fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.008+0000 7f4b56aa8640 1 --2- 172.21.15.112:0/2017091746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500fcf80 0x7f4b500fd3d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0048d0 tx=0x7f4b3c009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.008+0000 7f4b56aa8640 1 -- 172.21.15.112:0/2017091746 shutdown_connections 2024-09-19T09:32:57.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.008+0000 7f4b56aa8640 1 --2- 172.21.15.112:0/2017091746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500fcf80 0x7f4b500fd3d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.008+0000 7f4b56aa8640 1 --2- 172.21.15.112:0/2017091746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b500fb810 0x7f4b500fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.008+0000 7f4b56aa8640 1 -- 172.21.15.112:0/2017091746 >> 172.21.15.112:0/2017091746 conn(0x7f4b500723b0 msgr2=0x7f4b500727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:57.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.008+0000 7f4b56aa8640 1 -- 172.21.15.112:0/2017091746 shutdown_connections 2024-09-19T09:32:57.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.008+0000 7f4b56aa8640 1 -- 172.21.15.112:0/2017091746 wait complete. 2024-09-19T09:32:57.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.009+0000 7f4b56aa8640 1 Processor -- start 2024-09-19T09:32:57.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.009+0000 7f4b56aa8640 1 -- start start 2024-09-19T09:32:57.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.009+0000 7f4b56aa8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500fb810 0x7f4b500f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.009+0000 7f4b56aa8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b500fcf80 0x7f4b500f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.009+0000 7f4b56aa8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b500f8fc0 con 0x7f4b500fb810 2024-09-19T09:32:57.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.009+0000 7f4b56aa8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b500f9130 con 0x7f4b500fcf80 2024-09-19T09:32:57.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.009+0000 7f4b54844640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500fb810 0x7f4b500f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.009+0000 7f4b54844640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500fb810 0x7f4b500f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53186/0 (socket says 172.21.15.112:53186) 2024-09-19T09:32:57.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.009+0000 7f4b54844640 1 -- 172.21.15.112:0/2313309981 learned_addr learned my addr 172.21.15.112:0/2313309981 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:32:57.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.009+0000 7f4b4ffff640 1 --2- 172.21.15.112:0/2313309981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b500fcf80 0x7f4b500f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.009+0000 7f4b54844640 1 -- 172.21.15.112:0/2313309981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b500fcf80 msgr2=0x7f4b500f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.009+0000 7f4b54844640 1 --2- 172.21.15.112:0/2313309981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b500fcf80 0x7f4b500f8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.009+0000 7f4b54844640 1 -- 172.21.15.112:0/2313309981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c005040 con 0x7f4b500fb810 2024-09-19T09:32:57.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.009+0000 7f4b54844640 1 --2- 172.21.15.112:0/2313309981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500fb810 0x7f4b500f8540 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4b44002a80 tx=0x7f4b44004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:57.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.010+0000 7f4b4d7fa640 1 -- 172.21.15.112:0/2313309981 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b44007c30 con 0x7f4b500fb810 2024-09-19T09:32:57.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.010+0000 7f4b4d7fa640 1 -- 172.21.15.112:0/2313309981 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4b4400f040 con 0x7f4b500fb810 2024-09-19T09:32:57.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.010+0000 7f4b56aa8640 1 -- 172.21.15.112:0/2313309981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b500f93c0 con 0x7f4b500fb810 2024-09-19T09:32:57.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.010+0000 7f4b4d7fa640 1 -- 172.21.15.112:0/2313309981 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b44009530 con 0x7f4b500fb810 2024-09-19T09:32:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.010+0000 7f4b56aa8640 1 -- 172.21.15.112:0/2313309981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b501198c0 con 0x7f4b500fb810 2024-09-19T09:32:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.011+0000 7f4b56aa8640 1 -- 172.21.15.112:0/2313309981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b500fcbc0 con 0x7f4b500fb810 2024-09-19T09:32:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.011+0000 7f4b4d7fa640 1 -- 172.21.15.112:0/2313309981 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4b440096b0 con 0x7f4b500fb810 2024-09-19T09:32:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.012+0000 7f4b4d7fa640 1 --2- 172.21.15.112:0/2313309981 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f4b4006ed60 0x7f4b40071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.012+0000 7f4b4ffff640 1 --2- 172.21.15.112:0/2313309981 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f4b4006ed60 0x7f4b40071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.012+0000 7f4b4d7fa640 1 -- 172.21.15.112:0/2313309981 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4b4408daa0 con 0x7f4b500fb810 2024-09-19T09:32:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.012+0000 7f4b4ffff640 1 --2- 172.21.15.112:0/2313309981 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f4b4006ed60 0x7f4b40071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0043d0 tx=0x7f4b3c009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.016+0000 7f4b4d7fa640 1 -- 172.21.15.112:0/2313309981 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4b4404d2a0 con 0x7f4b500fb810 2024-09-19T09:32:57.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:56 smithi112 ceph-mon[27605]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-19T09:32:57.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.204+0000 7f4b56aa8640 1 -- 172.21.15.112:0/2313309981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b50072ec0 con 0x7f4b500fb810 2024-09-19T09:32:57.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.205+0000 7f4b4d7fa640 1 -- 172.21.15.112:0/2313309981 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4705 (secure 0 0 0) 0x7f4b4405abf0 con 0x7f4b500fb810 2024-09-19T09:32:57.206 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:32:57.206 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi191.qweljt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.191:6827/1382170395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1382170395},{"type":"v1","addr":"172.21.15.191:6827","nonce":1382170395}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24281,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/2759077122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2759077122},{"type":"v1","addr":"172.21.15.191:6825","nonce":2759077122}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:32:42.200999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi112.hcoxjz","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6829/165136062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":165136062},{"type":"v1","addr":"172.21.15.112:6829","nonce":165136062}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14474":{"gid":14474,"name":"cephfs.smithi112.ymjyok","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6827/3468750429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3468750429},{"type":"v1","addr":"172.21.15.112:6827","nonce":3468750429}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-09-19T09:32:57.207 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2024-09-19T09:32:57.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.207+0000 7f4b56aa8640 1 -- 172.21.15.112:0/2313309981 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f4b4006ed60 msgr2=0x7f4b40071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.207+0000 7f4b56aa8640 1 --2- 172.21.15.112:0/2313309981 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f4b4006ed60 0x7f4b40071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0043d0 tx=0x7f4b3c009da0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.207+0000 7f4b56aa8640 1 -- 172.21.15.112:0/2313309981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500fb810 msgr2=0x7f4b500f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.207+0000 7f4b56aa8640 1 --2- 172.21.15.112:0/2313309981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500fb810 0x7f4b500f8540 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4b44002a80 tx=0x7f4b44004600 comp rx=0 tx=0).stop 2024-09-19T09:32:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.207+0000 7f4b56aa8640 1 -- 172.21.15.112:0/2313309981 shutdown_connections 2024-09-19T09:32:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.207+0000 7f4b56aa8640 1 --2- 172.21.15.112:0/2313309981 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f4b4006ed60 0x7f4b40071210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.207+0000 7f4b56aa8640 1 --2- 172.21.15.112:0/2313309981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b500fcf80 0x7f4b500f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.207+0000 7f4b56aa8640 1 --2- 172.21.15.112:0/2313309981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b500fb810 0x7f4b500f8540 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.207+0000 7f4b56aa8640 1 -- 172.21.15.112:0/2313309981 >> 172.21.15.112:0/2313309981 conn(0x7f4b500723b0 msgr2=0x7f4b500fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.207+0000 7f4b56aa8640 1 -- 172.21.15.112:0/2313309981 shutdown_connections 2024-09-19T09:32:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:32:57.207+0000 7f4b56aa8640 1 -- 172.21.15.112:0/2313309981 wait complete. 2024-09-19T09:32:57.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:56 smithi191 ceph-mon[34834]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-19T09:32:57.897 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 17, 'max_mds': 1, 'flags': 50} 2024-09-19T09:32:57.897 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T09:32:57.926 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T09:32:57.926 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-19T09:32:57.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:32:57.926 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-19T09:32:57.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:32:57.946 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-09-19T09:32:58.019 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2024-09-19T09:32:58.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:32:58.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:32:58.021 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2024-09-19T09:32:58.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:32:58.040 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2024-09-19T09:32:58.106 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:57 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2313309981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:32:58.113 INFO:teuthology.orchestra.run.smithi191.stderr:Cannot find device "ceph-brx" 2024-09-19T09:32:58.114 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:32:58.115 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-19T09:32:58.115 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:32:58.115 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:32:58.115 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T09:32:58.140 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:57 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2313309981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:32:58.364 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:32:59.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:58 smithi112 ceph-mon[27605]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-19T09:32:59.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:32:58 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:32:59.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:58 smithi191 ceph-mon[34834]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-19T09:32:59.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:32:58 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:33:00.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.087+0000 7fe14eb25640 1 -- 172.21.15.112:0/173520490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1481014c0 msgr2=0x7fe148101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.087+0000 7fe14eb25640 1 --2- 172.21.15.112:0/173520490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1481014c0 0x7fe148101890 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0048d0 tx=0x7fe13c009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.087+0000 7fe14eb25640 1 -- 172.21.15.112:0/173520490 shutdown_connections 2024-09-19T09:33:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.087+0000 7fe14eb25640 1 --2- 172.21.15.112:0/173520490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1480fb480 0x7fe1480fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.087+0000 7fe14eb25640 1 --2- 172.21.15.112:0/173520490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1481014c0 0x7fe148101890 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.087+0000 7fe14eb25640 1 -- 172.21.15.112:0/173520490 >> 172.21.15.112:0/173520490 conn(0x7fe1480f7000 msgr2=0x7fe1480f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.087+0000 7fe14eb25640 1 -- 172.21.15.112:0/173520490 shutdown_connections 2024-09-19T09:33:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.087+0000 7fe14eb25640 1 -- 172.21.15.112:0/173520490 wait complete. 2024-09-19T09:33:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.087+0000 7fe14eb25640 1 Processor -- start 2024-09-19T09:33:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.087+0000 7fe14eb25640 1 -- start start 2024-09-19T09:33:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.088+0000 7fe14eb25640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1480fb480 0x7fe14810e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.088+0000 7fe14eb25640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1481014c0 0x7fe14810e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.088+0000 7fe14eb25640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14810ee00 con 0x7fe1480fb480 2024-09-19T09:33:00.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.088+0000 7fe14eb25640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14810ef70 con 0x7fe1481014c0 2024-09-19T09:33:00.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.088+0000 7fe14c8c1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1480fb480 0x7fe14810e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.088+0000 7fe14c8c1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1480fb480 0x7fe14810e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44850/0 (socket says 172.21.15.112:44850) 2024-09-19T09:33:00.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.088+0000 7fe14c8c1640 1 -- 172.21.15.112:0/2620484343 learned_addr learned my addr 172.21.15.112:0/2620484343 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:33:00.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.088+0000 7fe14c8c1640 1 -- 172.21.15.112:0/2620484343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1481014c0 msgr2=0x7fe14810e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:00.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.088+0000 7fe14c8c1640 1 --2- 172.21.15.112:0/2620484343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1481014c0 0x7fe14810e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.088+0000 7fe14c8c1640 1 -- 172.21.15.112:0/2620484343 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c005040 con 0x7fe1480fb480 2024-09-19T09:33:00.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.088+0000 7fe14c8c1640 1 --2- 172.21.15.112:0/2620484343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1480fb480 0x7fe14810e1e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe13c003080 tx=0x7fe13c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:00.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.088+0000 7fe1457fa640 1 -- 172.21.15.112:0/2620484343 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe13c038070 con 0x7fe1480fb480 2024-09-19T09:33:00.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.089+0000 7fe14eb25640 1 -- 172.21.15.112:0/2620484343 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe148117250 con 0x7fe1480fb480 2024-09-19T09:33:00.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.089+0000 7fe1457fa640 1 -- 172.21.15.112:0/2620484343 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe13c0097e0 con 0x7fe1480fb480 2024-09-19T09:33:00.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.089+0000 7fe1457fa640 1 -- 172.21.15.112:0/2620484343 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe13c03d420 con 0x7fe1480fb480 2024-09-19T09:33:00.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.089+0000 7fe14eb25640 1 -- 172.21.15.112:0/2620484343 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1481176c0 con 0x7fe1480fb480 2024-09-19T09:33:00.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.089+0000 7fe14eb25640 1 -- 172.21.15.112:0/2620484343 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1480fcbc0 con 0x7fe1480fb480 2024-09-19T09:33:00.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.090+0000 7fe1457fa640 1 -- 172.21.15.112:0/2620484343 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fe13c030020 con 0x7fe1480fb480 2024-09-19T09:33:00.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.090+0000 7fe1457fa640 1 --2- 172.21.15.112:0/2620484343 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe13806ed60 0x7fe138071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.091+0000 7fe1457fa640 1 -- 172.21.15.112:0/2620484343 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe13c0ae800 con 0x7fe1480fb480 2024-09-19T09:33:00.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.091+0000 7fe147fff640 1 --2- 172.21.15.112:0/2620484343 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe13806ed60 0x7fe138071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.091+0000 7fe147fff640 1 --2- 172.21.15.112:0/2620484343 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe13806ed60 0x7fe138071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe148066450 tx=0x7fe134006d20 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:00.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.095+0000 7fe1457fa640 1 -- 172.21.15.112:0/2620484343 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe13c07b8d0 con 0x7fe1480fb480 2024-09-19T09:33:00.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.284+0000 7fe14eb25640 1 -- 172.21.15.112:0/2620484343 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe1480fac80 con 0x7fe1480fb480 2024-09-19T09:33:00.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.284+0000 7fe1457fa640 1 -- 172.21.15.112:0/2620484343 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+83 (secure 0 0 0) 0x7fe13c07b270 con 0x7fe1480fb480 2024-09-19T09:33:00.286 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-19T09:33:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.286+0000 7fe14eb25640 1 -- 172.21.15.112:0/2620484343 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe13806ed60 msgr2=0x7fe138071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.286+0000 7fe14eb25640 1 --2- 172.21.15.112:0/2620484343 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe13806ed60 0x7fe138071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe148066450 tx=0x7fe134006d20 comp rx=0 tx=0).stop 2024-09-19T09:33:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.286+0000 7fe14eb25640 1 -- 172.21.15.112:0/2620484343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1480fb480 msgr2=0x7fe14810e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.286+0000 7fe14eb25640 1 --2- 172.21.15.112:0/2620484343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1480fb480 0x7fe14810e1e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe13c003080 tx=0x7fe13c009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.286+0000 7fe14eb25640 1 -- 172.21.15.112:0/2620484343 shutdown_connections 2024-09-19T09:33:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.286+0000 7fe14eb25640 1 --2- 172.21.15.112:0/2620484343 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fe13806ed60 0x7fe138071210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.286+0000 7fe14eb25640 1 --2- 172.21.15.112:0/2620484343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1481014c0 0x7fe14810e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.286+0000 7fe14eb25640 1 --2- 172.21.15.112:0/2620484343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1480fb480 0x7fe14810e1e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.286+0000 7fe14eb25640 1 -- 172.21.15.112:0/2620484343 >> 172.21.15.112:0/2620484343 conn(0x7fe1480f7000 msgr2=0x7fe1480f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.286+0000 7fe14eb25640 1 -- 172.21.15.112:0/2620484343 shutdown_connections 2024-09-19T09:33:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:00.286+0000 7fe14eb25640 1 -- 172.21.15.112:0/2620484343 wait complete. 2024-09-19T09:33:00.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:00 smithi112 ceph-mon[27605]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:00.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:00 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2620484343' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:33:00.950 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:33:00.950 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:33:00.950 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-19T09:33:00.950 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:33:00.950 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:33:00.950 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:33:00.950 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:33:00.950 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:33:00.951 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:33:00.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:33:00.951 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-19T09:33:01.007 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:33:01.007 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:33:01.007 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:33:01.007 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:33:01.007 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-19T09:33:01.008 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:33:01.008 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:33:01.008 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-19T09:33:01.008 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-19T09:33:01.008 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:33:01.008 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-19T09:33:01.008 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-19T09:33:01.008 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:33:01.008 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:33:01.008 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:33:01.008 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:33:01.008 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:33:01.008 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42330sec preferred_lft 42330sec 2024-09-19T09:33:01.009 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-19T09:33:01.009 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:33:01.009 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T09:33:01.009 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:33:01.009 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-19T09:33:01.009 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2024-09-19T09:33:01.009 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2024-09-19T09:33:01.010 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2024-09-19T09:33:01.010 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T09:33:01.010 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-19T09:33:01.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:33:01.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:01.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:33:01.215 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:33:01.241 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-19T09:33:01.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:33:01.242 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-19T09:33:01.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:00 smithi191 ceph-mon[34834]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:01.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:00 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2620484343' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:33:01.316 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-19T09:33:01.316 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:33:01.316 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:33:01.317 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:33:01.317 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:33:01.317 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:33:01.317 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-19T09:33:01.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:33:01.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:33:01.318 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:33:01.318 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-19T09:33:01.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:33:01.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:01.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:33:01.598 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-19T09:33:01.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:33:01.614 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2024-09-19T09:33:01.670 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:33:01.670 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-19T09:33:01.670 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:33:01.670 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T09:33:01.670 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-19T09:33:01.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:33:01.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:01.788 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T09:33:01.788 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:33:01.788 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-19T09:33:01.788 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T09:33:01.788 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T09:33:01.788 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T09:33:01.788 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T09:33:01.788 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T09:33:01.788 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-19T09:33:01.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:33:01.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:01.916 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:33:01.916 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-19T09:33:01.916 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-19T09:33:01.916 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T09:33:01.916 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-19T09:33:01.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:33:01.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:01.993 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:33:01.993 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:33:02.008 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:33:02.008 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:33:02.008 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:33:02.063 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:33:02.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:33:02.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:33:02.173 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:33:02.173 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:33:02.173 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2024-09-19T09:33:02.304 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:33:02.304 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:33:02.304 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2024-09-19T09:33:02.305 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.191:3300" 2024-09-19T09:33:02.305 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:33:02.309 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:33:02.310 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:33:02.310 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2024-09-19T09:33:02.310 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.191:3300" 2024-09-19T09:33:02.310 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:33:02.310 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:6789,172.21.15.191:6789" 2024-09-19T09:33:02.310 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.112:6789,172.21.15.191:6789:/ 2024-09-19T09:33:02.310 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=0bd98d30-7669-11ef-bceb-c7b262605968" will pass to kernel 2024-09-19T09:33:02.311 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:33:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:33:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:33:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:33:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:33:02.312 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:33:02.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:33:02.313 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:33:02.337 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:33:02.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:33:02.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:02.439 INFO:teuthology.orchestra.run.smithi112.stdout:client14500 2024-09-19T09:33:02.440 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:33:02.440 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:33:02.456 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:33:02.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:33:02.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:02.557 INFO:teuthology.orchestra.run.smithi112.stdout:client14500 2024-09-19T09:33:02.557 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:33:02.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:33:02.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:02.620 INFO:teuthology.orchestra.run.smithi112.stdout:client14500 2024-09-19T09:33:02.620 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0bd98d30-7669-11ef-bceb-c7b262605968.client14500/status') 2024-09-19T09:33:02.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:33:02.682 INFO:teuthology.orchestra.run.smithi112.stdout:instance: client.14500 (3)192.168.0.1:0/3618400098 2024-09-19T09:33:02.682 INFO:teuthology.orchestra.run.smithi112.stdout:blocklisted: false 2024-09-19T09:33:02.682 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2024-09-19T09:33:02.682 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2024-09-19T09:33:02.682 INFO:teuthology.orchestra.run.smithi112.stderr:70 bytes copied, 2.134e-05 s, 3.3 MB/s 2024-09-19T09:33:02.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:02.689 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-19T09:33:02.690 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:33:02.690 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:33:02.690 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T09:33:02.935 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:33:02.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:02 smithi112 ceph-mon[27605]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:03.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:02 smithi191 ceph-mon[34834]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:04.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.737+0000 7f59ec72f640 1 -- 172.21.15.112:0/3100090646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e41025f0 msgr2=0x7f59e41029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:04.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.737+0000 7f59ec72f640 1 --2- 172.21.15.112:0/3100090646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e41025f0 0x7f59e41029c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f59e00048d0 tx=0x7f59e0009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.737+0000 7f59ec72f640 1 -- 172.21.15.112:0/3100090646 shutdown_connections 2024-09-19T09:33:04.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.737+0000 7f59ec72f640 1 --2- 172.21.15.112:0/3100090646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59e40fac60 0x7f59e40fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.737+0000 7f59ec72f640 1 --2- 172.21.15.112:0/3100090646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e41025f0 0x7f59e41029c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.737+0000 7f59ec72f640 1 -- 172.21.15.112:0/3100090646 >> 172.21.15.112:0/3100090646 conn(0x7f59e4070c80 msgr2=0x7f59e4071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:04.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.737+0000 7f59ec72f640 1 -- 172.21.15.112:0/3100090646 shutdown_connections 2024-09-19T09:33:04.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.737+0000 7f59ec72f640 1 -- 172.21.15.112:0/3100090646 wait complete. 2024-09-19T09:33:04.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.738+0000 7f59ec72f640 1 Processor -- start 2024-09-19T09:33:04.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.738+0000 7f59ec72f640 1 -- start start 2024-09-19T09:33:04.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.738+0000 7f59ec72f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e40fac60 0x7f59e41131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.738+0000 7f59ec72f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59e41025f0 0x7f59e4113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.738+0000 7f59ec72f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e4113d30 con 0x7f59e40fac60 2024-09-19T09:33:04.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.738+0000 7f59ec72f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e410d170 con 0x7f59e41025f0 2024-09-19T09:33:04.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.738+0000 7f59ea4cb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e40fac60 0x7f59e41131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.738+0000 7f59ea4cb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e40fac60 0x7f59e41131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44876/0 (socket says 172.21.15.112:44876) 2024-09-19T09:33:04.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.738+0000 7f59ea4cb640 1 -- 172.21.15.112:0/2443455713 learned_addr learned my addr 172.21.15.112:0/2443455713 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:33:04.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.738+0000 7f59ea4cb640 1 -- 172.21.15.112:0/2443455713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59e41025f0 msgr2=0x7f59e4113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:04.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.738+0000 7f59ea4cb640 1 --2- 172.21.15.112:0/2443455713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59e41025f0 0x7f59e4113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.738+0000 7f59ea4cb640 1 -- 172.21.15.112:0/2443455713 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e0005040 con 0x7f59e40fac60 2024-09-19T09:33:04.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.739+0000 7f59ea4cb640 1 --2- 172.21.15.112:0/2443455713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e40fac60 0x7f59e41131f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f59e0000c00 tx=0x7f59e0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:04.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.739+0000 7f59d6ffd640 1 -- 172.21.15.112:0/2443455713 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59e0038070 con 0x7f59e40fac60 2024-09-19T09:33:04.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.739+0000 7f59d6ffd640 1 -- 172.21.15.112:0/2443455713 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f59e002ade0 con 0x7f59e40fac60 2024-09-19T09:33:04.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.739+0000 7f59ec72f640 1 -- 172.21.15.112:0/2443455713 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e410d3f0 con 0x7f59e40fac60 2024-09-19T09:33:04.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.739+0000 7f59d6ffd640 1 -- 172.21.15.112:0/2443455713 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59e002c7e0 con 0x7f59e40fac60 2024-09-19T09:33:04.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.739+0000 7f59ec72f640 1 -- 172.21.15.112:0/2443455713 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e410d930 con 0x7f59e40fac60 2024-09-19T09:33:04.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.740+0000 7f59ec72f640 1 -- 172.21.15.112:0/2443455713 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e4065810 con 0x7f59e40fac60 2024-09-19T09:33:04.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.740+0000 7f59d6ffd640 1 -- 172.21.15.112:0/2443455713 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f59e0030020 con 0x7f59e40fac60 2024-09-19T09:33:04.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.741+0000 7f59d6ffd640 1 --2- 172.21.15.112:0/2443455713 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f59d006ed60 0x7f59d0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.741+0000 7f59e9cca640 1 --2- 172.21.15.112:0/2443455713 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f59d006ed60 0x7f59d0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.741+0000 7f59d6ffd640 1 -- 172.21.15.112:0/2443455713 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f59e00ade60 con 0x7f59e40fac60 2024-09-19T09:33:04.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.741+0000 7f59e9cca640 1 --2- 172.21.15.112:0/2443455713 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f59d006ed60 0x7f59d0071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f59e410eab0 tx=0x7f59d8009c50 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:04.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.745+0000 7f59d6ffd640 1 -- 172.21.15.112:0/2443455713 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f59e007afe0 con 0x7f59e40fac60 2024-09-19T09:33:04.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:04 smithi112 ceph-mon[27605]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:33:04.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.940+0000 7f59ec72f640 1 -- 172.21.15.112:0/2443455713 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f59e4109600 con 0x7f59e40fac60 2024-09-19T09:33:04.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.941+0000 7f59d6ffd640 1 -- 172.21.15.112:0/2443455713 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+83 (secure 0 0 0) 0x7f59e007a980 con 0x7f59e40fac60 2024-09-19T09:33:04.942 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-19T09:33:04.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.943+0000 7f59ec72f640 1 -- 172.21.15.112:0/2443455713 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f59d006ed60 msgr2=0x7f59d0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:04.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.943+0000 7f59ec72f640 1 --2- 172.21.15.112:0/2443455713 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f59d006ed60 0x7f59d0071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f59e410eab0 tx=0x7f59d8009c50 comp rx=0 tx=0).stop 2024-09-19T09:33:04.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.943+0000 7f59ec72f640 1 -- 172.21.15.112:0/2443455713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e40fac60 msgr2=0x7f59e41131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:04.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.943+0000 7f59ec72f640 1 --2- 172.21.15.112:0/2443455713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e40fac60 0x7f59e41131f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f59e0000c00 tx=0x7f59e0009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.943+0000 7f59ec72f640 1 -- 172.21.15.112:0/2443455713 shutdown_connections 2024-09-19T09:33:04.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.943+0000 7f59ec72f640 1 --2- 172.21.15.112:0/2443455713 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f59d006ed60 0x7f59d0071210 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.943+0000 7f59ec72f640 1 --2- 172.21.15.112:0/2443455713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59e41025f0 0x7f59e4113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.943+0000 7f59ec72f640 1 --2- 172.21.15.112:0/2443455713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e40fac60 0x7f59e41131f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.943+0000 7f59ec72f640 1 -- 172.21.15.112:0/2443455713 >> 172.21.15.112:0/2443455713 conn(0x7f59e4070c80 msgr2=0x7f59e40f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:04.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.943+0000 7f59ec72f640 1 -- 172.21.15.112:0/2443455713 shutdown_connections 2024-09-19T09:33:04.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:04.943+0000 7f59ec72f640 1 -- 172.21.15.112:0/2443455713 wait complete. 2024-09-19T09:33:05.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:04 smithi191 ceph-mon[34834]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:33:05.610 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:33:05.610 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:33:05.610 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi191.front.sepia.ceph.com 2024-09-19T09:33:05.610 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T09:33:05.610 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:33:05.610 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:33:05.610 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:33:05.610 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:33:05.610 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:33:05.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:33:05.611 DEBUG:teuthology.orchestra.run.smithi191:> ip addr 2024-09-19T09:33:05.630 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:33:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:33:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:33:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:33:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2024-09-19T09:33:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:33:05.631 INFO:teuthology.orchestra.run.smithi191.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:33:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f6 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:33:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f0 2024-09-19T09:33:05.631 INFO:teuthology.orchestra.run.smithi191.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:33:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f7 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:33:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f1 2024-09-19T09:33:05.631 INFO:teuthology.orchestra.run.smithi191.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:33:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:10 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:33:05.631 INFO:teuthology.orchestra.run.smithi191.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:33:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:11 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:33:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: inet 172.21.15.191/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:33:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft 42324sec preferred_lft 42324sec 2024-09-19T09:33:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::ec4:7aff:fe88:7211/64 scope link noprefixroute 2024-09-19T09:33:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:33:05.632 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T09:33:05.632 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:33:05.632 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-09-19T09:33:05.632 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add name ceph-brx type bridge 2024-09-19T09:33:05.632 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip addr flush dev ceph-brx 2024-09-19T09:33:05.632 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set ceph-brx up 2024-09-19T09:33:05.632 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T09:33:05.632 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-09-19T09:33:05.725 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:33:05.834 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:05.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:33:05.840 DEBUG:teuthology.orchestra.run.smithi191:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:33:05.865 INFO:teuthology.orchestra.run.smithi191.stdout:1 2024-09-19T09:33:05.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:33:05.867 DEBUG:teuthology.orchestra.run.smithi191:> route 2024-09-19T09:33:05.937 INFO:teuthology.orchestra.run.smithi191.stdout:Kernel IP routing table 2024-09-19T09:33:05.937 INFO:teuthology.orchestra.run.smithi191.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:33:05.937 INFO:teuthology.orchestra.run.smithi191.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:33:05.937 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:33:05.938 INFO:teuthology.orchestra.run.smithi191.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:33:05.938 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:33:05.938 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-09-19T09:33:05.938 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:33:05.938 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:33:05.938 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:33:05.938 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-09-19T09:33:06.027 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:33:06.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:05 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2443455713' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:33:06.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:05 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2443455713' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:33:06.214 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:06.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:33:06.220 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2024-09-19T09:33:06.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:33:06.236 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list-id 2024-09-19T09:33:06.291 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:33:06.291 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-09-19T09:33:06.292 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:33:06.292 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-19T09:33:06.292 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-09-19T09:33:06.379 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:33:06.402 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:06.408 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-19T09:33:06.408 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:33:06.408 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-09-19T09:33:06.408 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-19T09:33:06.408 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T09:33:06.408 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-19T09:33:06.409 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-19T09:33:06.409 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-19T09:33:06.409 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-09-19T09:33:06.456 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:33:06.529 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:06.536 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:33:06.536 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-09-19T09:33:06.536 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set brx.0 up 2024-09-19T09:33:06.536 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T09:33:06.536 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-09-19T09:33:06.583 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:33:06.606 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:06.612 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:33:06.612 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T09:33:06.627 INFO:teuthology.orchestra.run.smithi191.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:33:06.627 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:33:06.627 DEBUG:teuthology.orchestra.run.smithi191:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:33:06.681 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:33:06.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:33:06.682 DEBUG:teuthology.orchestra.run.smithi191:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:33:06.779 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:33:06.779 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:33:06.779 INFO:teuthology.orchestra.run.smithi191.stdout:invalid new device string format 2024-09-19T09:33:06.904 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:33:06.904 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:33:06.904 INFO:teuthology.orchestra.run.smithi191.stdout:invalid new device string format 2024-09-19T09:33:06.904 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.191:3300" 2024-09-19T09:33:06.904 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:33:06.908 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:33:06.908 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:33:06.908 INFO:teuthology.orchestra.run.smithi191.stdout:invalid new device string format 2024-09-19T09:33:06.908 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.191:3300" 2024-09-19T09:33:06.908 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:33:06.908 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.112:6789,172.21.15.191:6789" 2024-09-19T09:33:06.908 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.112:6789,172.21.15.191:6789:/ 2024-09-19T09:33:06.908 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=0bd98d30-7669-11ef-bceb-c7b262605968" will pass to kernel 2024-09-19T09:33:06.909 INFO:teuthology.orchestra.run.smithi191.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-19T09:33:06.909 INFO:teuthology.orchestra.run.smithi191.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:33:06.909 INFO:teuthology.orchestra.run.smithi191.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:33:06.909 INFO:teuthology.orchestra.run.smithi191.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:33:06.909 INFO:teuthology.orchestra.run.smithi191.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:33:06.910 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:33:06.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:33:06.911 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:33:06.935 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:33:06.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:06 smithi112 ceph-mon[27605]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:07.023 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:33:07.025 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:07.031 INFO:teuthology.orchestra.run.smithi191.stdout:client14506 2024-09-19T09:33:07.031 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:33:07.031 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:33:07.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:06 smithi191 ceph-mon[34834]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:07.048 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:33:07.135 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:33:07.137 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:07.143 INFO:teuthology.orchestra.run.smithi191.stdout:client14506 2024-09-19T09:33:07.143 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:33:07.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:33:07.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:07.199 INFO:teuthology.orchestra.run.smithi191.stdout:client14506 2024-09-19T09:33:07.199 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0bd98d30-7669-11ef-bceb-c7b262605968.client14506/status') 2024-09-19T09:33:07.247 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:33:07.257 INFO:teuthology.orchestra.run.smithi191.stdout:instance: client.14506 (3)172.21.15.191:0/3203645647 2024-09-19T09:33:07.257 INFO:teuthology.orchestra.run.smithi191.stdout:blocklisted: false 2024-09-19T09:33:07.257 INFO:teuthology.orchestra.run.smithi191.stderr:0+1 records in 2024-09-19T09:33:07.257 INFO:teuthology.orchestra.run.smithi191.stderr:0+1 records out 2024-09-19T09:33:07.257 INFO:teuthology.orchestra.run.smithi191.stderr:72 bytes copied, 2.6375e-05 s, 2.7 MB/s 2024-09-19T09:33:07.258 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-19T09:33:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:33:07.264 INFO:teuthology.run_tasks:Running task print... 2024-09-19T09:33:07.273 INFO:teuthology.task.print:**** done client 2024-09-19T09:33:07.273 INFO:teuthology.run_tasks:Running task parallel... 2024-09-19T09:33:07.284 INFO:teuthology.task.parallel:starting parallel... 2024-09-19T09:33:07.284 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-19T09:33:07.285 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-19T09:33:07.285 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-19T09:33:07.285 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-19T09:33:07.285 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-19T09:33:07.286 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-19T09:33:07.290 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:33:07.290 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T09:33:07.290 INFO:tasks.workunit:timeout=3h 2024-09-19T09:33:07.291 INFO:tasks.workunit:cleanup=True 2024-09-19T09:33:07.291 DEBUG:teuthology.orchestra.run.smithi112:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T09:33:07.307 INFO:teuthology.orchestra.run.smithi112.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T09:33:07.308 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T09:33:07.308 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 99h/153d Inode: 1 Links: 2 2024-09-19T09:33:07.308 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:33:07.308 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T09:33:07.308 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-19T09:33:07.308 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-19 09:32:30.026797533 +0000 2024-09-19T09:33:07.308 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-19 09:33:02.334697115 +0000 2024-09-19T09:33:07.308 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-19 09:32:30.026797533 +0000 2024-09-19T09:33:07.308 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T09:33:07.309 DEBUG:teuthology.orchestra.run.smithi112:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T09:33:07.376 DEBUG:teuthology.orchestra.run.smithi191:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-19T09:33:07.393 INFO:teuthology.orchestra.run.smithi191.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-19T09:33:07.393 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-19T09:33:07.393 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 75h/117d Inode: 1 Links: 3 2024-09-19T09:33:07.394 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:33:07.394 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T09:33:07.394 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-19T09:33:07.394 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-19 09:33:07.370562481 +0000 2024-09-19T09:33:07.394 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-19 09:33:07.370562481 +0000 2024-09-19T09:33:07.394 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-19 09:32:30.026797533 +0000 2024-09-19T09:33:07.394 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-19T09:33:07.394 DEBUG:teuthology.orchestra.run.smithi191:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-19T09:33:07.463 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:33:07.463 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:33:07.480 INFO:tasks.workunit.client.0.smithi112.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T09:33:07.518 INFO:tasks.workunit.client.1.smithi191.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-19T09:33:07.558 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:33:08.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:08 smithi112 ceph-mon[27605]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-19T09:33:09.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:08 smithi191 ceph-mon[34834]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-19T09:33:09.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7503e18640 1 -- 172.21.15.112:0/3429538519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74fc0ff680 msgr2=0x7f74fc101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:09.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7503e18640 1 --2- 172.21.15.112:0/3429538519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74fc0ff680 0x7f74fc101a60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0048d0 tx=0x7f74ec009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:09.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7503e18640 1 -- 172.21.15.112:0/3429538519 shutdown_connections 2024-09-19T09:33:09.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7503e18640 1 --2- 172.21.15.112:0/3429538519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74fc0ff680 0x7f74fc101a60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:09.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7503e18640 1 --2- 172.21.15.112:0/3429538519 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74fc065c40 0x7f74fc0ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:09.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7503e18640 1 -- 172.21.15.112:0/3429538519 >> 172.21.15.112:0/3429538519 conn(0x7f74fc0f6c10 msgr2=0x7f74fc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:09.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7503e18640 1 -- 172.21.15.112:0/3429538519 shutdown_connections 2024-09-19T09:33:09.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7503e18640 1 -- 172.21.15.112:0/3429538519 wait complete. 2024-09-19T09:33:09.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7503e18640 1 Processor -- start 2024-09-19T09:33:09.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7503e18640 1 -- start start 2024-09-19T09:33:09.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7503e18640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74fc065c40 0x7f74fc10d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:09.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7503e18640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74fc0ff680 0x7f74fc10d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:09.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7503e18640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc10dc00 con 0x7f74fc065c40 2024-09-19T09:33:09.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7503e18640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc10e420 con 0x7f74fc0ff680 2024-09-19T09:33:09.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7501bb4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74fc065c40 0x7f74fc10d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:09.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7501bb4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74fc065c40 0x7f74fc10d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59548/0 (socket says 172.21.15.112:59548) 2024-09-19T09:33:09.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.297+0000 7f7501bb4640 1 -- 172.21.15.112:0/2781404180 learned_addr learned my addr 172.21.15.112:0/2781404180 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:33:09.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.298+0000 7f75013b3640 1 --2- 172.21.15.112:0/2781404180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74fc0ff680 0x7f74fc10d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:09.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.298+0000 7f7501bb4640 1 -- 172.21.15.112:0/2781404180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74fc0ff680 msgr2=0x7f74fc10d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:09.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.298+0000 7f7501bb4640 1 --2- 172.21.15.112:0/2781404180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74fc0ff680 0x7f74fc10d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:09.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.298+0000 7f7501bb4640 1 -- 172.21.15.112:0/2781404180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec005040 con 0x7f74fc065c40 2024-09-19T09:33:09.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.298+0000 7f75013b3640 1 --2- 172.21.15.112:0/2781404180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74fc0ff680 0x7f74fc10d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:09.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.298+0000 7f7501bb4640 1 --2- 172.21.15.112:0/2781404180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74fc065c40 0x7f74fc10d070 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f74f800eb70 tx=0x7f74f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:09.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.298+0000 7f74f27fc640 1 -- 172.21.15.112:0/2781404180 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74f8007c30 con 0x7f74fc065c40 2024-09-19T09:33:09.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.298+0000 7f74f27fc640 1 -- 172.21.15.112:0/2781404180 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f74f800f040 con 0x7f74fc065c40 2024-09-19T09:33:09.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.298+0000 7f74f27fc640 1 -- 172.21.15.112:0/2781404180 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74f800cb20 con 0x7f74fc065c40 2024-09-19T09:33:09.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.298+0000 7f7503e18640 1 -- 172.21.15.112:0/2781404180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74fc10e6b0 con 0x7f74fc065c40 2024-09-19T09:33:09.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.298+0000 7f7503e18640 1 -- 172.21.15.112:0/2781404180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74fc10ec50 con 0x7f74fc065c40 2024-09-19T09:33:09.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.299+0000 7f7503e18640 1 -- 172.21.15.112:0/2781404180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74fc0fa890 con 0x7f74fc065c40 2024-09-19T09:33:09.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.300+0000 7f74f27fc640 1 -- 172.21.15.112:0/2781404180 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f74f8009110 con 0x7f74fc065c40 2024-09-19T09:33:09.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.300+0000 7f74f27fc640 1 --2- 172.21.15.112:0/2781404180 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f74e806ed60 0x7f74e8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:09.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.300+0000 7f74f27fc640 1 -- 172.21.15.112:0/2781404180 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f74f808e550 con 0x7f74fc065c40 2024-09-19T09:33:09.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.300+0000 7f75013b3640 1 --2- 172.21.15.112:0/2781404180 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f74e806ed60 0x7f74e8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:09.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.301+0000 7f75013b3640 1 --2- 172.21.15.112:0/2781404180 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f74e806ed60 0x7f74e8071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f74ec007ac0 tx=0x7f74ec035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:09.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.304+0000 7f74f27fc640 1 -- 172.21.15.112:0/2781404180 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f74f805b6d0 con 0x7f74fc065c40 2024-09-19T09:33:09.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.458+0000 7f7503e18640 1 -- 172.21.15.112:0/2781404180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f74fc04b720 con 0x7f74fc065c40 2024-09-19T09:33:09.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.459+0000 7f74f27fc640 1 -- 172.21.15.112:0/2781404180 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f74f8014440 con 0x7f74fc065c40 2024-09-19T09:33:09.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.461+0000 7f7503e18640 1 -- 172.21.15.112:0/2781404180 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f74e806ed60 msgr2=0x7f74e8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:09.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.461+0000 7f7503e18640 1 --2- 172.21.15.112:0/2781404180 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f74e806ed60 0x7f74e8071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f74ec007ac0 tx=0x7f74ec035040 comp rx=0 tx=0).stop 2024-09-19T09:33:09.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.461+0000 7f7503e18640 1 -- 172.21.15.112:0/2781404180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74fc065c40 msgr2=0x7f74fc10d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:09.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.461+0000 7f7503e18640 1 --2- 172.21.15.112:0/2781404180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74fc065c40 0x7f74fc10d070 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f74f800eb70 tx=0x7f74f800b040 comp rx=0 tx=0).stop 2024-09-19T09:33:09.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.461+0000 7f7503e18640 1 -- 172.21.15.112:0/2781404180 shutdown_connections 2024-09-19T09:33:09.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.461+0000 7f7503e18640 1 --2- 172.21.15.112:0/2781404180 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f74e806ed60 0x7f74e8071210 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:09.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.461+0000 7f7503e18640 1 --2- 172.21.15.112:0/2781404180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74fc0ff680 0x7f74fc10d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:09.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.461+0000 7f7503e18640 1 --2- 172.21.15.112:0/2781404180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74fc065c40 0x7f74fc10d070 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:09.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.461+0000 7f7503e18640 1 -- 172.21.15.112:0/2781404180 >> 172.21.15.112:0/2781404180 conn(0x7f74fc0f6c10 msgr2=0x7f74fc0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:09.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.461+0000 7f7503e18640 1 -- 172.21.15.112:0/2781404180 shutdown_connections 2024-09-19T09:33:09.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:09.461+0000 7f7503e18640 1 -- 172.21.15.112:0/2781404180 wait complete. 2024-09-19T09:33:10.158 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-19T09:33:10.442 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:33:11.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:10 smithi112 ceph-mon[27605]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-09-19T09:33:11.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:10 smithi191 ceph-mon[34834]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-09-19T09:33:12.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.083+0000 7f281deae640 1 -- 172.21.15.112:0/1550952367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28180fc730 msgr2=0x7f28180fcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.083+0000 7f281deae640 1 --2- 172.21.15.112:0/1550952367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28180fc730 0x7f28180fcba0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f28000048d0 tx=0x7f2800009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.083+0000 7f281deae640 1 -- 172.21.15.112:0/1550952367 shutdown_connections 2024-09-19T09:33:12.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.083+0000 7f281deae640 1 --2- 172.21.15.112:0/1550952367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28180fc730 0x7f28180fcba0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.083+0000 7f281deae640 1 --2- 172.21.15.112:0/1550952367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28180fb460 0x7f28180fb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.083+0000 7f281deae640 1 -- 172.21.15.112:0/1550952367 >> 172.21.15.112:0/1550952367 conn(0x7f28180f6c40 msgr2=0x7f28180f9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:12.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.083+0000 7f281deae640 1 -- 172.21.15.112:0/1550952367 shutdown_connections 2024-09-19T09:33:12.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.083+0000 7f281deae640 1 -- 172.21.15.112:0/1550952367 wait complete. 2024-09-19T09:33:12.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.083+0000 7f281deae640 1 Processor -- start 2024-09-19T09:33:12.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.084+0000 7f281deae640 1 -- start start 2024-09-19T09:33:12.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.084+0000 7f281deae640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28180fb460 0x7f281810d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.084+0000 7f281deae640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28180fc730 0x7f281810d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.084+0000 7f281deae640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281810dcd0 con 0x7f28180fb460 2024-09-19T09:33:12.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.084+0000 7f281deae640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281810e4f0 con 0x7f28180fc730 2024-09-19T09:33:12.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.084+0000 7f28177fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28180fb460 0x7f281810d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.084+0000 7f28177fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28180fb460 0x7f281810d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59580/0 (socket says 172.21.15.112:59580) 2024-09-19T09:33:12.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.084+0000 7f28177fe640 1 -- 172.21.15.112:0/998523583 learned_addr learned my addr 172.21.15.112:0/998523583 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:33:12.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.084+0000 7f2816ffd640 1 --2- 172.21.15.112:0/998523583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28180fc730 0x7f281810d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.084+0000 7f28177fe640 1 -- 172.21.15.112:0/998523583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28180fc730 msgr2=0x7f281810d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.084+0000 7f28177fe640 1 --2- 172.21.15.112:0/998523583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28180fc730 0x7f281810d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.084+0000 7f28177fe640 1 -- 172.21.15.112:0/998523583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2800005040 con 0x7f28180fb460 2024-09-19T09:33:12.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.084+0000 7f2816ffd640 1 --2- 172.21.15.112:0/998523583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28180fc730 0x7f281810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:12.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.084+0000 7f28177fe640 1 --2- 172.21.15.112:0/998523583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28180fb460 0x7f281810d140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f280800c790 tx=0x7f28080043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:12.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.084+0000 7f280ffff640 1 -- 172.21.15.112:0/998523583 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f280800a820 con 0x7f28180fb460 2024-09-19T09:33:12.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.085+0000 7f280ffff640 1 -- 172.21.15.112:0/998523583 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f280800ae20 con 0x7f28180fb460 2024-09-19T09:33:12.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.085+0000 7f281deae640 1 -- 172.21.15.112:0/998523583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281810e780 con 0x7f28180fb460 2024-09-19T09:33:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.085+0000 7f280ffff640 1 -- 172.21.15.112:0/998523583 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28080113a0 con 0x7f28180fb460 2024-09-19T09:33:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.085+0000 7f281deae640 1 -- 172.21.15.112:0/998523583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281810ed20 con 0x7f28180fb460 2024-09-19T09:33:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.086+0000 7f281deae640 1 -- 172.21.15.112:0/998523583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28180fa8c0 con 0x7f28180fb460 2024-09-19T09:33:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.086+0000 7f280ffff640 1 -- 172.21.15.112:0/998523583 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f2808012400 con 0x7f28180fb460 2024-09-19T09:33:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.086+0000 7f280ffff640 1 --2- 172.21.15.112:0/998523583 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f280406ed60 0x7f2804071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.087+0000 7f280ffff640 1 -- 172.21.15.112:0/998523583 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f280808e350 con 0x7f28180fb460 2024-09-19T09:33:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.087+0000 7f2816ffd640 1 --2- 172.21.15.112:0/998523583 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f280406ed60 0x7f2804071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.087+0000 7f2816ffd640 1 --2- 172.21.15.112:0/998523583 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f280406ed60 0x7f2804071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2800004540 tx=0x7f2800009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.091+0000 7f280ffff640 1 -- 172.21.15.112:0/998523583 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f280805b4a0 con 0x7f28180fb460 2024-09-19T09:33:12.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.248+0000 7f281deae640 1 -- 172.21.15.112:0/998523583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f281804b720 con 0x7f28180fb460 2024-09-19T09:33:12.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.248+0000 7f280ffff640 1 -- 172.21.15.112:0/998523583 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f280805ae40 con 0x7f28180fb460 2024-09-19T09:33:12.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.250+0000 7f281deae640 1 -- 172.21.15.112:0/998523583 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f280406ed60 msgr2=0x7f2804071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.250+0000 7f281deae640 1 --2- 172.21.15.112:0/998523583 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f280406ed60 0x7f2804071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2800004540 tx=0x7f2800009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.250+0000 7f281deae640 1 -- 172.21.15.112:0/998523583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28180fb460 msgr2=0x7f281810d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.250+0000 7f281deae640 1 --2- 172.21.15.112:0/998523583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28180fb460 0x7f281810d140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f280800c790 tx=0x7f28080043c0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.250+0000 7f281deae640 1 -- 172.21.15.112:0/998523583 shutdown_connections 2024-09-19T09:33:12.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.250+0000 7f281deae640 1 --2- 172.21.15.112:0/998523583 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f280406ed60 0x7f2804071210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.250+0000 7f281deae640 1 --2- 172.21.15.112:0/998523583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28180fc730 0x7f281810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.250+0000 7f281deae640 1 --2- 172.21.15.112:0/998523583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28180fb460 0x7f281810d140 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.250+0000 7f281deae640 1 -- 172.21.15.112:0/998523583 >> 172.21.15.112:0/998523583 conn(0x7f28180f6c40 msgr2=0x7f28180661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:12.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.251+0000 7f281deae640 1 -- 172.21.15.112:0/998523583 shutdown_connections 2024-09-19T09:33:12.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:12.251+0000 7f281deae640 1 -- 172.21.15.112:0/998523583 wait complete. 2024-09-19T09:33:12.961 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-19T09:33:13.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:12 smithi112 ceph-mon[27605]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 426 B/s wr, 2 op/s 2024-09-19T09:33:13.208 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:33:13.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:12 smithi191 ceph-mon[34834]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 426 B/s wr, 2 op/s 2024-09-19T09:33:14.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:13 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:33:14.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:13 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:33:14.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.882+0000 7f48cdf40640 1 -- 172.21.15.112:0/4262564890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c80fb420 msgr2=0x7f48c80fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:14.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.882+0000 7f48cdf40640 1 --2- 172.21.15.112:0/4262564890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c80fb420 0x7f48c80fb830 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f48b80048d0 tx=0x7f48b8009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.882+0000 7f48cdf40640 1 -- 172.21.15.112:0/4262564890 shutdown_connections 2024-09-19T09:33:14.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.882+0000 7f48cdf40640 1 --2- 172.21.15.112:0/4262564890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48c80fc6f0 0x7f48c80fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.882+0000 7f48cdf40640 1 --2- 172.21.15.112:0/4262564890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c80fb420 0x7f48c80fb830 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.883+0000 7f48cdf40640 1 -- 172.21.15.112:0/4262564890 >> 172.21.15.112:0/4262564890 conn(0x7f48c80f6c00 msgr2=0x7f48c80f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:14.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.883+0000 7f48cdf40640 1 -- 172.21.15.112:0/4262564890 shutdown_connections 2024-09-19T09:33:14.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.883+0000 7f48cdf40640 1 -- 172.21.15.112:0/4262564890 wait complete. 2024-09-19T09:33:14.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.883+0000 7f48cdf40640 1 Processor -- start 2024-09-19T09:33:14.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.883+0000 7f48cdf40640 1 -- start start 2024-09-19T09:33:14.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.883+0000 7f48cdf40640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48c80fb420 0x7f48c810f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.883+0000 7f48cdf40640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c80fc6f0 0x7f48c810f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.883+0000 7f48cdf40640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c810fdd0 con 0x7f48c80fc6f0 2024-09-19T09:33:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.883+0000 7f48cdf40640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c81105f0 con 0x7f48c80fb420 2024-09-19T09:33:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.883+0000 7f48bffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c80fc6f0 0x7f48c810f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.883+0000 7f48bffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c80fc6f0 0x7f48c810f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59590/0 (socket says 172.21.15.112:59590) 2024-09-19T09:33:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.883+0000 7f48bffff640 1 -- 172.21.15.112:0/453400769 learned_addr learned my addr 172.21.15.112:0/453400769 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:33:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.884+0000 7f48c77fe640 1 --2- 172.21.15.112:0/453400769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48c80fb420 0x7f48c810f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.884+0000 7f48bffff640 1 -- 172.21.15.112:0/453400769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48c80fb420 msgr2=0x7f48c810f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.884+0000 7f48bffff640 1 --2- 172.21.15.112:0/453400769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48c80fb420 0x7f48c810f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.884+0000 7f48bffff640 1 -- 172.21.15.112:0/453400769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b8005040 con 0x7f48c80fc6f0 2024-09-19T09:33:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.884+0000 7f48bffff640 1 --2- 172.21.15.112:0/453400769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c80fc6f0 0x7f48c810f780 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f48b000c830 tx=0x7f48b0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.884+0000 7f48c4ff9640 1 -- 172.21.15.112:0/453400769 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48b000a850 con 0x7f48c80fc6f0 2024-09-19T09:33:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.884+0000 7f48c4ff9640 1 -- 172.21.15.112:0/453400769 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f48b000ae50 con 0x7f48c80fc6f0 2024-09-19T09:33:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.884+0000 7f48cdf40640 1 -- 172.21.15.112:0/453400769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c8110880 con 0x7f48c80fc6f0 2024-09-19T09:33:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.884+0000 7f48c4ff9640 1 -- 172.21.15.112:0/453400769 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48b00113a0 con 0x7f48c80fc6f0 2024-09-19T09:33:14.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.884+0000 7f48cdf40640 1 -- 172.21.15.112:0/453400769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c8110e20 con 0x7f48c80fc6f0 2024-09-19T09:33:14.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.885+0000 7f48cdf40640 1 -- 172.21.15.112:0/453400769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c80fa880 con 0x7f48c80fc6f0 2024-09-19T09:33:14.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.886+0000 7f48c4ff9640 1 -- 172.21.15.112:0/453400769 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f48b0012400 con 0x7f48c80fc6f0 2024-09-19T09:33:14.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.886+0000 7f48c4ff9640 1 --2- 172.21.15.112:0/453400769 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f48b406ed60 0x7f48b4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.886+0000 7f48c4ff9640 1 -- 172.21.15.112:0/453400769 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f48b008e2e0 con 0x7f48c80fc6f0 2024-09-19T09:33:14.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.886+0000 7f48c77fe640 1 --2- 172.21.15.112:0/453400769 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f48b406ed60 0x7f48b4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.886+0000 7f48c77fe640 1 --2- 172.21.15.112:0/453400769 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f48b406ed60 0x7f48b4071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48b8000c00 tx=0x7f48b8009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:14.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:14.890+0000 7f48c4ff9640 1 -- 172.21.15.112:0/453400769 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f48b005b590 con 0x7f48c80fc6f0 2024-09-19T09:33:14.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:14 smithi112 ceph-mon[27605]: pgmap v198: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-19T09:33:15.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:15.048+0000 7f48cdf40640 1 -- 172.21.15.112:0/453400769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f48c8103f90 con 0x7f48c80fc6f0 2024-09-19T09:33:15.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:15.049+0000 7f48c4ff9640 1 -- 172.21.15.112:0/453400769 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f48b005af30 con 0x7f48c80fc6f0 2024-09-19T09:33:15.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:15.050+0000 7f48cdf40640 1 -- 172.21.15.112:0/453400769 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f48b406ed60 msgr2=0x7f48b4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:15.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:15.050+0000 7f48cdf40640 1 --2- 172.21.15.112:0/453400769 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f48b406ed60 0x7f48b4071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48b8000c00 tx=0x7f48b8009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:15.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:15.050+0000 7f48cdf40640 1 -- 172.21.15.112:0/453400769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c80fc6f0 msgr2=0x7f48c810f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:15.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:15.050+0000 7f48cdf40640 1 --2- 172.21.15.112:0/453400769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c80fc6f0 0x7f48c810f780 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f48b000c830 tx=0x7f48b0004430 comp rx=0 tx=0).stop 2024-09-19T09:33:15.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:15.051+0000 7f48cdf40640 1 -- 172.21.15.112:0/453400769 shutdown_connections 2024-09-19T09:33:15.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:15.051+0000 7f48cdf40640 1 --2- 172.21.15.112:0/453400769 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f48b406ed60 0x7f48b4071210 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:15.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:15.051+0000 7f48cdf40640 1 --2- 172.21.15.112:0/453400769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c80fc6f0 0x7f48c810f780 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:15.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:15.051+0000 7f48cdf40640 1 --2- 172.21.15.112:0/453400769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48c80fb420 0x7f48c810f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:15.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:15.051+0000 7f48cdf40640 1 -- 172.21.15.112:0/453400769 >> 172.21.15.112:0/453400769 conn(0x7f48c80f6c00 msgr2=0x7f48c8065ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:15.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:15.051+0000 7f48cdf40640 1 -- 172.21.15.112:0/453400769 shutdown_connections 2024-09-19T09:33:15.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:15.051+0000 7f48cdf40640 1 -- 172.21.15.112:0/453400769 wait complete. 2024-09-19T09:33:15.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:14 smithi191 ceph-mon[34834]: pgmap v198: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-19T09:33:15.788 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-19T09:33:16.040 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:33:17.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:16 smithi112 ceph-mon[27605]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T09:33:17.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:16 smithi191 ceph-mon[34834]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T09:33:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.756+0000 7f054ed65640 1 -- 172.21.15.112:0/597451642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480fb430 msgr2=0x7f05480fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.756+0000 7f054ed65640 1 --2- 172.21.15.112:0/597451642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480fb430 0x7f05480fb840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f053c0048d0 tx=0x7f053c009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.756+0000 7f054ed65640 1 -- 172.21.15.112:0/597451642 shutdown_connections 2024-09-19T09:33:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.756+0000 7f054ed65640 1 --2- 172.21.15.112:0/597451642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05480fc700 0x7f05480fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.756+0000 7f054ed65640 1 --2- 172.21.15.112:0/597451642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480fb430 0x7f05480fb840 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.756+0000 7f054ed65640 1 -- 172.21.15.112:0/597451642 >> 172.21.15.112:0/597451642 conn(0x7f05480f6c10 msgr2=0x7f05480f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.756+0000 7f054ed65640 1 -- 172.21.15.112:0/597451642 shutdown_connections 2024-09-19T09:33:17.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.756+0000 7f054ed65640 1 -- 172.21.15.112:0/597451642 wait complete. 2024-09-19T09:33:17.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.756+0000 7f054ed65640 1 Processor -- start 2024-09-19T09:33:17.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.756+0000 7f054ed65640 1 -- start start 2024-09-19T09:33:17.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.757+0000 7f054ed65640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05480fb430 0x7f054810d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.757+0000 7f054ed65640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480fc700 0x7f054810d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.757+0000 7f054ed65640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054810e470 con 0x7f05480fc700 2024-09-19T09:33:17.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.757+0000 7f054ed65640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054810e5e0 con 0x7f05480fb430 2024-09-19T09:33:17.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.757+0000 7f0547fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480fc700 0x7f054810d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.757+0000 7f0547fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480fc700 0x7f054810d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59608/0 (socket says 172.21.15.112:59608) 2024-09-19T09:33:17.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.757+0000 7f0547fff640 1 -- 172.21.15.112:0/3541015308 learned_addr learned my addr 172.21.15.112:0/3541015308 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:33:17.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.757+0000 7f054cb01640 1 --2- 172.21.15.112:0/3541015308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05480fb430 0x7f054810d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.757+0000 7f0547fff640 1 -- 172.21.15.112:0/3541015308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05480fb430 msgr2=0x7f054810d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:17.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.757+0000 7f0547fff640 1 --2- 172.21.15.112:0/3541015308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05480fb430 0x7f054810d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.757+0000 7f0547fff640 1 -- 172.21.15.112:0/3541015308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c005040 con 0x7f05480fc700 2024-09-19T09:33:17.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.757+0000 7f0547fff640 1 --2- 172.21.15.112:0/3541015308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480fc700 0x7f054810d600 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f053400b790 tx=0x7f05340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:17.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.758+0000 7f05457fa640 1 -- 172.21.15.112:0/3541015308 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f053400c700 con 0x7f05480fc700 2024-09-19T09:33:17.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.758+0000 7f05457fa640 1 -- 172.21.15.112:0/3541015308 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f053400cd00 con 0x7f05480fc700 2024-09-19T09:33:17.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.758+0000 7f05457fa640 1 -- 172.21.15.112:0/3541015308 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0534015e80 con 0x7f05480fc700 2024-09-19T09:33:17.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.758+0000 7f054ed65640 1 -- 172.21.15.112:0/3541015308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054810e8c0 con 0x7f05480fc700 2024-09-19T09:33:17.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.758+0000 7f054ed65640 1 -- 172.21.15.112:0/3541015308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054810ede0 con 0x7f05480fc700 2024-09-19T09:33:17.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.759+0000 7f054ed65640 1 -- 172.21.15.112:0/3541015308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05480fa890 con 0x7f05480fc700 2024-09-19T09:33:17.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.759+0000 7f05457fa640 1 -- 172.21.15.112:0/3541015308 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f0534012070 con 0x7f05480fc700 2024-09-19T09:33:17.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.760+0000 7f05457fa640 1 --2- 172.21.15.112:0/3541015308 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f053806ed60 0x7f0538071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.760+0000 7f054cb01640 1 --2- 172.21.15.112:0/3541015308 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f053806ed60 0x7f0538071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.760+0000 7f05457fa640 1 -- 172.21.15.112:0/3541015308 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f053408d980 con 0x7f05480fc700 2024-09-19T09:33:17.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.760+0000 7f054cb01640 1 --2- 172.21.15.112:0/3541015308 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f053806ed60 0x7f0538071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f053c000c00 tx=0x7f053c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:17.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.764+0000 7f05457fa640 1 -- 172.21.15.112:0/3541015308 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f053405aad0 con 0x7f05480fc700 2024-09-19T09:33:17.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:17.934+0000 7f054ed65640 1 -- 172.21.15.112:0/3541015308 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f0548103eb0 con 0x7f053806ed60 2024-09-19T09:33:19.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:18 smithi112 ceph-mon[27605]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-19T09:33:19.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:18 smithi112 ceph-mon[27605]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:19.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:18 smithi191 ceph-mon[34834]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-19T09:33:19.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:18 smithi191 ceph-mon[34834]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:21.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:20 smithi112 ceph-mon[27605]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T09:33:21.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:20 smithi191 ceph-mon[34834]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T09:33:23.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:22 smithi112 ceph-mon[27605]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T09:33:23.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:22 smithi191 ceph-mon[34834]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T09:33:25.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:24 smithi112 ceph-mon[27605]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T09:33:25.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:24 smithi191 ceph-mon[34834]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T09:33:27.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:26 smithi112 ceph-mon[27605]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:27.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:26 smithi191 ceph-mon[34834]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:29.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:28 smithi112 ceph-mon[27605]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:33:29.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:28 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:33:29.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:28 smithi191 ceph-mon[34834]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:33:29.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:28 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:33:31.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:30 smithi112 ceph-mon[27605]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:31.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:30 smithi191 ceph-mon[34834]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:33.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:32 smithi112 ceph-mon[27605]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:33.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:32 smithi191 ceph-mon[34834]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:35.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:34 smithi112 ceph-mon[27605]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:33:35.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:34 smithi191 ceph-mon[34834]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:33:37.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:36 smithi112 ceph-mon[27605]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:37.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:36 smithi191 ceph-mon[34834]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:39.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:38 smithi112 ceph-mon[27605]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:33:39.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:38 smithi191 ceph-mon[34834]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:33:41.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:40 smithi112 ceph-mon[27605]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:41.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:40 smithi191 ceph-mon[34834]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:33:43.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:42 smithi112 ceph-mon[27605]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T09:33:43.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:42 smithi191 ceph-mon[34834]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T09:33:44.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:43 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:33:44.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:43 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:33:45.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:44 smithi112 ceph-mon[27605]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T09:33:45.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:44 smithi191 ceph-mon[34834]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T09:33:47.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:46 smithi112 ceph-mon[27605]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T09:33:47.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:46 smithi191 ceph-mon[34834]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T09:33:49.500 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:49 smithi112 ceph-mon[27605]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-19T09:33:49.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:49 smithi191 ceph-mon[34834]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-19T09:33:49.854 INFO:teuthology.orchestra.run.smithi112.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:33:49.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:49.852+0000 7f05457fa640 1 -- 172.21.15.112:0/3541015308 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f0548103eb0 con 0x7f053806ed60 2024-09-19T09:33:49.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:49.855+0000 7f054ed65640 1 -- 172.21.15.112:0/3541015308 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f053806ed60 msgr2=0x7f0538071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:49.855+0000 7f054ed65640 1 --2- 172.21.15.112:0/3541015308 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f053806ed60 0x7f0538071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f053c000c00 tx=0x7f053c035040 comp rx=0 tx=0).stop 2024-09-19T09:33:49.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:49.855+0000 7f054ed65640 1 -- 172.21.15.112:0/3541015308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480fc700 msgr2=0x7f054810d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:49.855+0000 7f054ed65640 1 --2- 172.21.15.112:0/3541015308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480fc700 0x7f054810d600 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f053400b790 tx=0x7f05340091d0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:49.855+0000 7f054ed65640 1 -- 172.21.15.112:0/3541015308 shutdown_connections 2024-09-19T09:33:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:49.855+0000 7f054ed65640 1 --2- 172.21.15.112:0/3541015308 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f053806ed60 0x7f0538071210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:49.855+0000 7f054ed65640 1 --2- 172.21.15.112:0/3541015308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480fc700 0x7f054810d600 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:49.855+0000 7f054ed65640 1 --2- 172.21.15.112:0/3541015308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05480fb430 0x7f054810d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:49.855+0000 7f054ed65640 1 -- 172.21.15.112:0/3541015308 >> 172.21.15.112:0/3541015308 conn(0x7f05480f6c10 msgr2=0x7f0548065610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:49.855+0000 7f054ed65640 1 -- 172.21.15.112:0/3541015308 shutdown_connections 2024-09-19T09:33:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:49.856+0000 7f054ed65640 1 -- 172.21.15.112:0/3541015308 wait complete. 2024-09-19T09:33:50.518 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-19T09:33:50.858 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:33:51.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:50 smithi112 ceph-mon[27605]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T09:33:51.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:50 smithi112 ceph-mon[27605]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:33:51.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:33:51.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:51.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:51.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:51.170 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:50 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:33:51.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:50 smithi191 ceph-mon[34834]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T09:33:51.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:50 smithi191 ceph-mon[34834]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:33:51.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:50 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:33:51.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:50 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:51.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:50 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:51.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:50 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:51.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:50 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:33:52.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:51 smithi112 ceph-mon[27605]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:33:52.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:51 smithi191 ceph-mon[34834]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:33:52.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:52 smithi112 ceph-mon[27605]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T09:33:53.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.184+0000 7f86bd3cb640 1 -- 172.21.15.112:0/2773705986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b80fb430 msgr2=0x7f86b80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:53.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.184+0000 7f86bd3cb640 1 --2- 172.21.15.112:0/2773705986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b80fb430 0x7f86b80fb840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f86a80048d0 tx=0x7f86a8009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.184+0000 7f86bd3cb640 1 -- 172.21.15.112:0/2773705986 shutdown_connections 2024-09-19T09:33:53.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.184+0000 7f86bd3cb640 1 --2- 172.21.15.112:0/2773705986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86b80fc700 0x7f86b80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.184+0000 7f86bd3cb640 1 --2- 172.21.15.112:0/2773705986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b80fb430 0x7f86b80fb840 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.184+0000 7f86bd3cb640 1 -- 172.21.15.112:0/2773705986 >> 172.21.15.112:0/2773705986 conn(0x7f86b80f6c10 msgr2=0x7f86b80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:53.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.184+0000 7f86bd3cb640 1 -- 172.21.15.112:0/2773705986 shutdown_connections 2024-09-19T09:33:53.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.184+0000 7f86bd3cb640 1 -- 172.21.15.112:0/2773705986 wait complete. 2024-09-19T09:33:53.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.185+0000 7f86bd3cb640 1 Processor -- start 2024-09-19T09:33:53.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.185+0000 7f86bd3cb640 1 -- start start 2024-09-19T09:33:53.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.185+0000 7f86bd3cb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b80fb430 0x7f86b8103ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.185+0000 7f86bd3cb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86b80fc700 0x7f86b81023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.185+0000 7f86bd3cb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8102960 con 0x7f86b80fb430 2024-09-19T09:33:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.185+0000 7f86bd3cb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8102aa0 con 0x7f86b80fc700 2024-09-19T09:33:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.185+0000 7f86b6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b80fb430 0x7f86b8103ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.185+0000 7f86b6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b80fb430 0x7f86b8103ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59032/0 (socket says 172.21.15.112:59032) 2024-09-19T09:33:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.185+0000 7f86b6ffd640 1 -- 172.21.15.112:0/2536134694 learned_addr learned my addr 172.21.15.112:0/2536134694 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:33:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.185+0000 7f86b67fc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86b80fc700 0x7f86b81023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.186+0000 7f86b6ffd640 1 -- 172.21.15.112:0/2536134694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86b80fc700 msgr2=0x7f86b81023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.186+0000 7f86b6ffd640 1 --2- 172.21.15.112:0/2536134694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86b80fc700 0x7f86b81023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.186+0000 7f86b6ffd640 1 -- 172.21.15.112:0/2536134694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a8005040 con 0x7f86b80fb430 2024-09-19T09:33:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.186+0000 7f86b6ffd640 1 --2- 172.21.15.112:0/2536134694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b80fb430 0x7f86b8103ee0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f86a80048a0 tx=0x7f86a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.186+0000 7f869f7fe640 1 -- 172.21.15.112:0/2536134694 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86a8038070 con 0x7f86b80fb430 2024-09-19T09:33:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.186+0000 7f869f7fe640 1 -- 172.21.15.112:0/2536134694 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f86a8004290 con 0x7f86b80fb430 2024-09-19T09:33:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.186+0000 7f869f7fe640 1 -- 172.21.15.112:0/2536134694 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86a8033660 con 0x7f86b80fb430 2024-09-19T09:33:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.187+0000 7f86bd3cb640 1 -- 172.21.15.112:0/2536134694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b8102d20 con 0x7f86b80fb430 2024-09-19T09:33:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.187+0000 7f86bd3cb640 1 -- 172.21.15.112:0/2536134694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b81150b0 con 0x7f86b80fb430 2024-09-19T09:33:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.188+0000 7f86bd3cb640 1 -- 172.21.15.112:0/2536134694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b80fa890 con 0x7f86b80fb430 2024-09-19T09:33:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.188+0000 7f869f7fe640 1 -- 172.21.15.112:0/2536134694 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f86a8030020 con 0x7f86b80fb430 2024-09-19T09:33:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.189+0000 7f869f7fe640 1 --2- 172.21.15.112:0/2536134694 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f86a006ed60 0x7f86a0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.189+0000 7f869f7fe640 1 -- 172.21.15.112:0/2536134694 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f86a80ae300 con 0x7f86b80fb430 2024-09-19T09:33:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.192+0000 7f86b67fc640 1 --2- 172.21.15.112:0/2536134694 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f86a006ed60 0x7f86a0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.193+0000 7f86b67fc640 1 --2- 172.21.15.112:0/2536134694 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f86a006ed60 0x7f86a0071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009af0 tx=0x7f86ac00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:53.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.195+0000 7f869f7fe640 1 -- 172.21.15.112:0/2536134694 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f86a807b480 con 0x7f86b80fb430 2024-09-19T09:33:53.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:52 smithi191 ceph-mon[34834]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T09:33:53.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.453+0000 7f86bd3cb640 1 -- 172.21.15.112:0/2536134694 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f86b8100b60 con 0x7f86a006ed60 2024-09-19T09:33:53.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.456+0000 7f869f7fe640 1 -- 172.21.15.112:0/2536134694 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f86b8100b60 con 0x7f86a006ed60 2024-09-19T09:33:53.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.458+0000 7f86bd3cb640 1 -- 172.21.15.112:0/2536134694 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f86a006ed60 msgr2=0x7f86a0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:53.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.459+0000 7f86bd3cb640 1 --2- 172.21.15.112:0/2536134694 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f86a006ed60 0x7f86a0071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009af0 tx=0x7f86ac00b040 comp rx=0 tx=0).stop 2024-09-19T09:33:53.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.459+0000 7f86bd3cb640 1 -- 172.21.15.112:0/2536134694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b80fb430 msgr2=0x7f86b8103ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:53.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.459+0000 7f86bd3cb640 1 --2- 172.21.15.112:0/2536134694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b80fb430 0x7f86b8103ee0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f86a80048a0 tx=0x7f86a8009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.459+0000 7f86bd3cb640 1 -- 172.21.15.112:0/2536134694 shutdown_connections 2024-09-19T09:33:53.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.459+0000 7f86bd3cb640 1 --2- 172.21.15.112:0/2536134694 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f86a006ed60 0x7f86a0071210 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.459+0000 7f86bd3cb640 1 --2- 172.21.15.112:0/2536134694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86b80fc700 0x7f86b81023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.459+0000 7f86bd3cb640 1 --2- 172.21.15.112:0/2536134694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b80fb430 0x7f86b8103ee0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.459+0000 7f86bd3cb640 1 -- 172.21.15.112:0/2536134694 >> 172.21.15.112:0/2536134694 conn(0x7f86b80f6c10 msgr2=0x7f86b80f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:53.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.459+0000 7f86bd3cb640 1 -- 172.21.15.112:0/2536134694 shutdown_connections 2024-09-19T09:33:53.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.459+0000 7f86bd3cb640 1 -- 172.21.15.112:0/2536134694 wait complete. 2024-09-19T09:33:53.474 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:33:53.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.589+0000 7f3eecc75640 1 -- 172.21.15.112:0/2323805888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ee80fb430 msgr2=0x7f3ee80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:53.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.589+0000 7f3eecc75640 1 --2- 172.21.15.112:0/2323805888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ee80fb430 0x7f3ee80fb840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80048d0 tx=0x7f3ed8009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.589+0000 7f3eecc75640 1 -- 172.21.15.112:0/2323805888 shutdown_connections 2024-09-19T09:33:53.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.589+0000 7f3eecc75640 1 --2- 172.21.15.112:0/2323805888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ee80fc700 0x7f3ee80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.589+0000 7f3eecc75640 1 --2- 172.21.15.112:0/2323805888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ee80fb430 0x7f3ee80fb840 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.589+0000 7f3eecc75640 1 -- 172.21.15.112:0/2323805888 >> 172.21.15.112:0/2323805888 conn(0x7f3ee80f6c10 msgr2=0x7f3ee80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:53.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.589+0000 7f3eecc75640 1 -- 172.21.15.112:0/2323805888 shutdown_connections 2024-09-19T09:33:53.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.589+0000 7f3eecc75640 1 -- 172.21.15.112:0/2323805888 wait complete. 2024-09-19T09:33:53.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.591+0000 7f3eecc75640 1 Processor -- start 2024-09-19T09:33:53.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.591+0000 7f3eecc75640 1 -- start start 2024-09-19T09:33:53.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.591+0000 7f3eecc75640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ee80fb430 0x7f3ee8105580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:53.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.591+0000 7f3eecc75640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ee80fc700 0x7f3ee8105ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:53.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.591+0000 7f3eecc75640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee81060c0 con 0x7f3ee80fc700 2024-09-19T09:33:53.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.591+0000 7f3eecc75640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee8106980 con 0x7f3ee80fb430 2024-09-19T09:33:53.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.592+0000 7f3ee659c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ee80fb430 0x7f3ee8105580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:53.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.592+0000 7f3ee659c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ee80fb430 0x7f3ee8105580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.112:44816/0 (socket says 172.21.15.112:44816) 2024-09-19T09:33:53.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.592+0000 7f3ee659c640 1 -- 172.21.15.112:0/1079157910 learned_addr learned my addr 172.21.15.112:0/1079157910 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:33:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.592+0000 7f3edffff640 1 --2- 172.21.15.112:0/1079157910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ee80fc700 0x7f3ee8105ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.592+0000 7f3ee659c640 1 -- 172.21.15.112:0/1079157910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ee80fc700 msgr2=0x7f3ee8105ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.592+0000 7f3ee659c640 1 --2- 172.21.15.112:0/1079157910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ee80fc700 0x7f3ee8105ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.592+0000 7f3ee659c640 1 -- 172.21.15.112:0/1079157910 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed8005040 con 0x7f3ee80fb430 2024-09-19T09:33:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.592+0000 7f3edffff640 1 --2- 172.21.15.112:0/1079157910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ee80fc700 0x7f3ee8105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:53.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.592+0000 7f3ee659c640 1 --2- 172.21.15.112:0/1079157910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ee80fb430 0x7f3ee8105580 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80043d0 tx=0x7f3ed8009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:53.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.593+0000 7f3edeffd640 1 -- 172.21.15.112:0/1079157910 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ed8038070 con 0x7f3ee80fb430 2024-09-19T09:33:53.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.593+0000 7f3edeffd640 1 -- 172.21.15.112:0/1079157910 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ed8009800 con 0x7f3ee80fb430 2024-09-19T09:33:53.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.593+0000 7f3edeffd640 1 -- 172.21.15.112:0/1079157910 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ed803e670 con 0x7f3ee80fb430 2024-09-19T09:33:53.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.594+0000 7f3eecc75640 1 -- 172.21.15.112:0/1079157910 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee8106b80 con 0x7f3ee80fb430 2024-09-19T09:33:53.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.594+0000 7f3eecc75640 1 -- 172.21.15.112:0/1079157910 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee81070d0 con 0x7f3ee80fb430 2024-09-19T09:33:53.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.595+0000 7f3eecc75640 1 -- 172.21.15.112:0/1079157910 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee80fa890 con 0x7f3ee80fb430 2024-09-19T09:33:53.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.596+0000 7f3edeffd640 1 -- 172.21.15.112:0/1079157910 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3ed8030020 con 0x7f3ee80fb430 2024-09-19T09:33:53.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.597+0000 7f3edeffd640 1 --2- 172.21.15.112:0/1079157910 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f3ed406ed50 0x7f3ed4071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.598+0000 7f3edffff640 1 --2- 172.21.15.112:0/1079157910 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f3ed406ed50 0x7f3ed4071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.598+0000 7f3edeffd640 1 -- 172.21.15.112:0/1079157910 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3ed80adc50 con 0x7f3ee80fb430 2024-09-19T09:33:53.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.598+0000 7f3edffff640 1 --2- 172.21.15.112:0/1079157910 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f3ed406ed50 0x7f3ed4071200 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0004d60 tx=0x7f3ed000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.605+0000 7f3edeffd640 1 -- 172.21.15.112:0/1079157910 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3ed807ac80 con 0x7f3ee80fb430 2024-09-19T09:33:53.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.958+0000 7f3eecc75640 1 -- 172.21.15.112:0/1079157910 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ee8103fa0 con 0x7f3ed406ed50 2024-09-19T09:33:53.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.959+0000 7f3edeffd640 1 -- 172.21.15.112:0/1079157910 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f3ee8103fa0 con 0x7f3ed406ed50 2024-09-19T09:33:53.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.962+0000 7f3eecc75640 1 -- 172.21.15.112:0/1079157910 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f3ed406ed50 msgr2=0x7f3ed4071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:53.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.962+0000 7f3eecc75640 1 --2- 172.21.15.112:0/1079157910 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f3ed406ed50 0x7f3ed4071200 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0004d60 tx=0x7f3ed000b040 comp rx=0 tx=0).stop 2024-09-19T09:33:53.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.963+0000 7f3eecc75640 1 -- 172.21.15.112:0/1079157910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ee80fb430 msgr2=0x7f3ee8105580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:53.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.963+0000 7f3eecc75640 1 --2- 172.21.15.112:0/1079157910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ee80fb430 0x7f3ee8105580 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80043d0 tx=0x7f3ed8009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.963+0000 7f3eecc75640 1 -- 172.21.15.112:0/1079157910 shutdown_connections 2024-09-19T09:33:53.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.963+0000 7f3eecc75640 1 --2- 172.21.15.112:0/1079157910 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f3ed406ed50 0x7f3ed4071200 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.963+0000 7f3eecc75640 1 --2- 172.21.15.112:0/1079157910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ee80fc700 0x7f3ee8105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.963+0000 7f3eecc75640 1 --2- 172.21.15.112:0/1079157910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ee80fb430 0x7f3ee8105580 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:53.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.963+0000 7f3eecc75640 1 -- 172.21.15.112:0/1079157910 >> 172.21.15.112:0/1079157910 conn(0x7f3ee80f6c10 msgr2=0x7f3ee8065670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:53.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.964+0000 7f3eecc75640 1 -- 172.21.15.112:0/1079157910 shutdown_connections 2024-09-19T09:33:53.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:53.964+0000 7f3eecc75640 1 -- 172.21.15.112:0/1079157910 wait complete. 2024-09-19T09:33:54.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.083+0000 7f9a76624640 1 -- 172.21.15.112:0/4127301082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7006e540 msgr2=0x7f9a7010a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:54.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.083+0000 7f9a76624640 1 --2- 172.21.15.112:0/4127301082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7006e540 0x7f9a7010a940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9a580048d0 tx=0x7f9a58009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.083+0000 7f9a76624640 1 -- 172.21.15.112:0/4127301082 shutdown_connections 2024-09-19T09:33:54.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.083+0000 7f9a76624640 1 --2- 172.21.15.112:0/4127301082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7006e540 0x7f9a7010a940 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.083+0000 7f9a76624640 1 --2- 172.21.15.112:0/4127301082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a7006dbf0 0x7f9a7006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.083+0000 7f9a76624640 1 -- 172.21.15.112:0/4127301082 >> 172.21.15.112:0/4127301082 conn(0x7f9a70069560 msgr2=0x7f9a7006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:54.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.083+0000 7f9a76624640 1 -- 172.21.15.112:0/4127301082 shutdown_connections 2024-09-19T09:33:54.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.083+0000 7f9a76624640 1 -- 172.21.15.112:0/4127301082 wait complete. 2024-09-19T09:33:54.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.084+0000 7f9a76624640 1 Processor -- start 2024-09-19T09:33:54.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.084+0000 7f9a76624640 1 -- start start 2024-09-19T09:33:54.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.084+0000 7f9a76624640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a7006dbf0 0x7f9a70106340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:54.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.084+0000 7f9a76624640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7006e540 0x7f9a70104830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:54.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.084+0000 7f9a76624640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a70119510 con 0x7f9a7006e540 2024-09-19T09:33:54.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.084+0000 7f9a76624640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a70119650 con 0x7f9a7006dbf0 2024-09-19T09:33:54.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.085+0000 7f9a67fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7006e540 0x7f9a70104830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:54.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.085+0000 7f9a67fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7006e540 0x7f9a70104830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59070/0 (socket says 172.21.15.112:59070) 2024-09-19T09:33:54.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.085+0000 7f9a67fff640 1 -- 172.21.15.112:0/3360720198 learned_addr learned my addr 172.21.15.112:0/3360720198 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:33:54.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.085+0000 7f9a6ffff640 1 --2- 172.21.15.112:0/3360720198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a7006dbf0 0x7f9a70106340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:54.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.085+0000 7f9a67fff640 1 -- 172.21.15.112:0/3360720198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a7006dbf0 msgr2=0x7f9a70106340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:54.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.085+0000 7f9a67fff640 1 --2- 172.21.15.112:0/3360720198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a7006dbf0 0x7f9a70106340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.085+0000 7f9a67fff640 1 -- 172.21.15.112:0/3360720198 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a58005040 con 0x7f9a7006e540 2024-09-19T09:33:54.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.086+0000 7f9a67fff640 1 --2- 172.21.15.112:0/3360720198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7006e540 0x7f9a70104830 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9a580048a0 tx=0x7f9a58009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:54.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.086+0000 7f9a6d7fa640 1 -- 172.21.15.112:0/3360720198 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a58038070 con 0x7f9a7006e540 2024-09-19T09:33:54.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.086+0000 7f9a6d7fa640 1 -- 172.21.15.112:0/3360720198 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9a58009800 con 0x7f9a7006e540 2024-09-19T09:33:54.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.086+0000 7f9a76624640 1 -- 172.21.15.112:0/3360720198 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a70104dd0 con 0x7f9a7006e540 2024-09-19T09:33:54.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.086+0000 7f9a6d7fa640 1 -- 172.21.15.112:0/3360720198 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a5803e670 con 0x7f9a7006e540 2024-09-19T09:33:54.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.086+0000 7f9a76624640 1 -- 172.21.15.112:0/3360720198 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a70105370 con 0x7f9a7006e540 2024-09-19T09:33:54.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.088+0000 7f9a76624640 1 -- 172.21.15.112:0/3360720198 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7006d1b0 con 0x7f9a7006e540 2024-09-19T09:33:54.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.090+0000 7f9a6d7fa640 1 -- 172.21.15.112:0/3360720198 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9a58030020 con 0x7f9a7006e540 2024-09-19T09:33:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.091+0000 7f9a6d7fa640 1 --2- 172.21.15.112:0/3360720198 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9a5006ee20 0x7f9a500712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.091+0000 7f9a6d7fa640 1 -- 172.21.15.112:0/3360720198 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9a580ae380 con 0x7f9a7006e540 2024-09-19T09:33:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.091+0000 7f9a6ffff640 1 --2- 172.21.15.112:0/3360720198 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9a5006ee20 0x7f9a500712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.092+0000 7f9a6ffff640 1 --2- 172.21.15.112:0/3360720198 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9a5006ee20 0x7f9a500712d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9a701060f0 tx=0x7f9a6000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:54.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.097+0000 7f9a6d7fa640 1 -- 172.21.15.112:0/3360720198 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9a5807b560 con 0x7f9a7006e540 2024-09-19T09:33:54.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:53 smithi112 ceph-mon[27605]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:54.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:53 smithi191 ceph-mon[34834]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.386+0000 7f9a76624640 1 -- 172.21.15.112:0/3360720198 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a7010a1c0 con 0x7f9a5006ee20 2024-09-19T09:33:54.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.401+0000 7f9a6d7fa640 1 -- 172.21.15.112:0/3360720198 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9a7010a1c0 con 0x7f9a5006ee20 2024-09-19T09:33:54.403 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:33:54.403 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (5m) 60s ago 6m 25.5M - 0.25.0 c8568f914cd2 bc75f08f7e02 2024-09-19T09:33:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (6m) 60s ago 6m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1513f1075df5 2024-09-19T09:33:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (6m) 67s ago 6m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6c313b300b35 2024-09-19T09:33:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (5m) 60s ago 6m 87.4M - 9.4.7 954c08fa6188 aeb5727c19ca 2024-09-19T09:33:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (79s) 60s ago 78s 17.5M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:33:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (84s) 60s ago 84s 11.6M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:33:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (82s) 67s ago 81s 10.9M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:33:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (76s) 67s ago 76s 14.3M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:33:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:9283,8765,8443 running (8m) 60s ago 8m 448M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a963c39d50ce 2024-09-19T09:33:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283 running (5m) 67s ago 5m 401M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cc9633745ef8 2024-09-19T09:33:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (8m) 60s ago 8m 47.0M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 34676d67b669 2024-09-19T09:33:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (5m) 67s ago 5m 36.5M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 35690ef0929b 2024-09-19T09:33:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (6m) 60s ago 6m 15.6M - 1.5.0 0da6a335fe13 a5e6a378cf2f 2024-09-19T09:33:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (5m) 67s ago 5m 16.5M - 1.5.0 0da6a335fe13 6b6c7c67cf29 2024-09-19T09:33:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (5m) 60s ago 5m 45.1M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 621693067dce 2024-09-19T09:33:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (4m) 60s ago 4m 44.3M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1742e5964367 2024-09-19T09:33:54.405 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (4m) 60s ago 4m 46.3M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 4dcca18af229 2024-09-19T09:33:54.405 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (3m) 67s ago 3m 43.0M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:33:54.405 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (3m) 67s ago 3m 42.8M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:33:54.405 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (2m) 67s ago 2m 41.3M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:33:54.405 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (5m) 60s ago 6m 54.0M - 2.43.0 a07b618ecd1d 9499df984e6a 2024-09-19T09:33:54.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.404+0000 7f9a76624640 1 -- 172.21.15.112:0/3360720198 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9a5006ee20 msgr2=0x7f9a500712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:54.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.405+0000 7f9a76624640 1 --2- 172.21.15.112:0/3360720198 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9a5006ee20 0x7f9a500712d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9a701060f0 tx=0x7f9a6000b040 comp rx=0 tx=0).stop 2024-09-19T09:33:54.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.405+0000 7f9a76624640 1 -- 172.21.15.112:0/3360720198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7006e540 msgr2=0x7f9a70104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:54.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.405+0000 7f9a76624640 1 --2- 172.21.15.112:0/3360720198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7006e540 0x7f9a70104830 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9a580048a0 tx=0x7f9a58009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.405+0000 7f9a76624640 1 -- 172.21.15.112:0/3360720198 shutdown_connections 2024-09-19T09:33:54.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.405+0000 7f9a76624640 1 --2- 172.21.15.112:0/3360720198 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f9a5006ee20 0x7f9a500712d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.405+0000 7f9a76624640 1 --2- 172.21.15.112:0/3360720198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7006e540 0x7f9a70104830 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.405+0000 7f9a76624640 1 --2- 172.21.15.112:0/3360720198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a7006dbf0 0x7f9a70106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.405+0000 7f9a76624640 1 -- 172.21.15.112:0/3360720198 >> 172.21.15.112:0/3360720198 conn(0x7f9a70069560 msgr2=0x7f9a70108aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:54.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.405+0000 7f9a76624640 1 -- 172.21.15.112:0/3360720198 shutdown_connections 2024-09-19T09:33:54.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.405+0000 7f9a76624640 1 -- 172.21.15.112:0/3360720198 wait complete. 2024-09-19T09:33:54.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.524+0000 7f1957bf3640 1 -- 172.21.15.112:0/4142687153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19500fb430 msgr2=0x7f19500fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:54.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.524+0000 7f1957bf3640 1 --2- 172.21.15.112:0/4142687153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19500fb430 0x7f19500fb840 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f194c0048d0 tx=0x7f194c009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.524+0000 7f1957bf3640 1 -- 172.21.15.112:0/4142687153 shutdown_connections 2024-09-19T09:33:54.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.524+0000 7f1957bf3640 1 --2- 172.21.15.112:0/4142687153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19500fc700 0x7f19500fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.524+0000 7f1957bf3640 1 --2- 172.21.15.112:0/4142687153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19500fb430 0x7f19500fb840 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.524+0000 7f1957bf3640 1 -- 172.21.15.112:0/4142687153 >> 172.21.15.112:0/4142687153 conn(0x7f19500f6c10 msgr2=0x7f19500f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:54.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.525+0000 7f1957bf3640 1 -- 172.21.15.112:0/4142687153 shutdown_connections 2024-09-19T09:33:54.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.525+0000 7f1957bf3640 1 -- 172.21.15.112:0/4142687153 wait complete. 2024-09-19T09:33:54.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.526+0000 7f1957bf3640 1 Processor -- start 2024-09-19T09:33:54.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.526+0000 7f1957bf3640 1 -- start start 2024-09-19T09:33:54.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.526+0000 7f1957bf3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19500fb430 0x7f195010f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:54.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.526+0000 7f1957bf3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19500fc700 0x7f195010f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:54.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.526+0000 7f1957bf3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195010fe60 con 0x7f19500fb430 2024-09-19T09:33:54.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.526+0000 7f1957bf3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1950110630 con 0x7f19500fc700 2024-09-19T09:33:54.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.526+0000 7f195598f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19500fb430 0x7f195010f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.526+0000 7f195598f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19500fb430 0x7f195010f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59080/0 (socket says 172.21.15.112:59080) 2024-09-19T09:33:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.526+0000 7f195598f640 1 -- 172.21.15.112:0/1517310275 learned_addr learned my addr 172.21.15.112:0/1517310275 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:33:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.526+0000 7f195598f640 1 -- 172.21.15.112:0/1517310275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19500fc700 msgr2=0x7f195010f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.526+0000 7f195598f640 1 --2- 172.21.15.112:0/1517310275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19500fc700 0x7f195010f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.526+0000 7f195598f640 1 -- 172.21.15.112:0/1517310275 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c005040 con 0x7f19500fb430 2024-09-19T09:33:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.527+0000 7f195598f640 1 --2- 172.21.15.112:0/1517310275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19500fb430 0x7f195010f2d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f194c0043d0 tx=0x7f194c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.527+0000 7f19467fc640 1 -- 172.21.15.112:0/1517310275 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f194c038070 con 0x7f19500fb430 2024-09-19T09:33:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.527+0000 7f1957bf3640 1 -- 172.21.15.112:0/1517310275 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1950110860 con 0x7f19500fb430 2024-09-19T09:33:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.527+0000 7f1957bf3640 1 -- 172.21.15.112:0/1517310275 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1950110cc0 con 0x7f19500fb430 2024-09-19T09:33:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.527+0000 7f19467fc640 1 -- 172.21.15.112:0/1517310275 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f194c040e80 con 0x7f19500fb430 2024-09-19T09:33:54.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.527+0000 7f19467fc640 1 -- 172.21.15.112:0/1517310275 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f194c038070 con 0x7f19500fb430 2024-09-19T09:33:54.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.529+0000 7f1957bf3640 1 -- 172.21.15.112:0/1517310275 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19500fa890 con 0x7f19500fb430 2024-09-19T09:33:54.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.530+0000 7f19467fc640 1 -- 172.21.15.112:0/1517310275 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f194c030020 con 0x7f19500fb430 2024-09-19T09:33:54.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.530+0000 7f19467fc640 1 --2- 172.21.15.112:0/1517310275 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f193c06edb0 0x7f193c071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:54.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.530+0000 7f19467fc640 1 -- 172.21.15.112:0/1517310275 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f194c0b66c0 con 0x7f19500fb430 2024-09-19T09:33:54.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.531+0000 7f195518e640 1 --2- 172.21.15.112:0/1517310275 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f193c06edb0 0x7f193c071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:54.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.532+0000 7f195518e640 1 --2- 172.21.15.112:0/1517310275 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f193c06edb0 0x7f193c071260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f195010f080 tx=0x7f1940009c50 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:54.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.535+0000 7f19467fc640 1 -- 172.21.15.112:0/1517310275 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f194c083790 con 0x7f19500fb430 2024-09-19T09:33:54.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.766+0000 7f1957bf3640 1 -- 172.21.15.112:0/1517310275 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f195004b720 con 0x7f19500fb430 2024-09-19T09:33:54.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.766+0000 7f19467fc640 1 -- 172.21.15.112:0/1517310275 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f194c009fb0 con 0x7f19500fb430 2024-09-19T09:33:54.768 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:33:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:33:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T09:33:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:33:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:33:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T09:33:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:33:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:33:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T09:33:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:33:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:33:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:33:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:33:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:33:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 14 2024-09-19T09:33:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:33:54.769 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:33:54.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.769+0000 7f1957bf3640 1 -- 172.21.15.112:0/1517310275 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f193c06edb0 msgr2=0x7f193c071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:54.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.769+0000 7f1957bf3640 1 --2- 172.21.15.112:0/1517310275 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f193c06edb0 0x7f193c071260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f195010f080 tx=0x7f1940009c50 comp rx=0 tx=0).stop 2024-09-19T09:33:54.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.769+0000 7f1957bf3640 1 -- 172.21.15.112:0/1517310275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19500fb430 msgr2=0x7f195010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:54.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.769+0000 7f1957bf3640 1 --2- 172.21.15.112:0/1517310275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19500fb430 0x7f195010f2d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f194c0043d0 tx=0x7f194c009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.769+0000 7f1957bf3640 1 -- 172.21.15.112:0/1517310275 shutdown_connections 2024-09-19T09:33:54.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.769+0000 7f1957bf3640 1 --2- 172.21.15.112:0/1517310275 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f193c06edb0 0x7f193c071260 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.769+0000 7f1957bf3640 1 --2- 172.21.15.112:0/1517310275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19500fc700 0x7f195010f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.769+0000 7f1957bf3640 1 --2- 172.21.15.112:0/1517310275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19500fb430 0x7f195010f2d0 secure :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f194c0043d0 tx=0x7f194c009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.769+0000 7f1957bf3640 1 -- 172.21.15.112:0/1517310275 >> 172.21.15.112:0/1517310275 conn(0x7f19500f6c10 msgr2=0x7f19500f8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:54.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.769+0000 7f1957bf3640 1 -- 172.21.15.112:0/1517310275 shutdown_connections 2024-09-19T09:33:54.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.769+0000 7f1957bf3640 1 -- 172.21.15.112:0/1517310275 wait complete. 2024-09-19T09:33:54.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.854+0000 7fb829994640 1 -- 172.21.15.112:0/4077356557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8240fe4c0 msgr2=0x7fb8240fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:54.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.854+0000 7fb829994640 1 --2- 172.21.15.112:0/4077356557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8240fe4c0 0x7fb8240fa620 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb8180048d0 tx=0x7fb818009da0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.854+0000 7fb829994640 1 -- 172.21.15.112:0/4077356557 shutdown_connections 2024-09-19T09:33:54.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.854+0000 7fb829994640 1 --2- 172.21.15.112:0/4077356557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8240fe4c0 0x7fb8240fa620 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.854+0000 7fb829994640 1 --2- 172.21.15.112:0/4077356557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8240fdb70 0x7fb8240fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.854+0000 7fb829994640 1 -- 172.21.15.112:0/4077356557 >> 172.21.15.112:0/4077356557 conn(0x7fb8240f6390 msgr2=0x7fb8240f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:54.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.854+0000 7fb829994640 1 -- 172.21.15.112:0/4077356557 shutdown_connections 2024-09-19T09:33:54.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.854+0000 7fb829994640 1 -- 172.21.15.112:0/4077356557 wait complete. 2024-09-19T09:33:54.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.856+0000 7fb829994640 1 Processor -- start 2024-09-19T09:33:54.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.856+0000 7fb829994640 1 -- start start 2024-09-19T09:33:54.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.856+0000 7fb829994640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8240fdb70 0x7fb82410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:54.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.856+0000 7fb829994640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8240fe4c0 0x7fb82410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:54.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.856+0000 7fb829994640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82410dc30 con 0x7fb8240fdb70 2024-09-19T09:33:54.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.856+0000 7fb829994640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82410e450 con 0x7fb8240fe4c0 2024-09-19T09:33:54.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.856+0000 7fb822ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8240fdb70 0x7fb82410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:54.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.857+0000 7fb8227fc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8240fe4c0 0x7fb82410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:54.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.857+0000 7fb822ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8240fdb70 0x7fb82410d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59098/0 (socket says 172.21.15.112:59098) 2024-09-19T09:33:54.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.857+0000 7fb822ffd640 1 -- 172.21.15.112:0/3627530229 learned_addr learned my addr 172.21.15.112:0/3627530229 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:33:54.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.857+0000 7fb822ffd640 1 -- 172.21.15.112:0/3627530229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8240fe4c0 msgr2=0x7fb82410d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:54.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.857+0000 7fb822ffd640 1 --2- 172.21.15.112:0/3627530229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8240fe4c0 0x7fb82410d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:54.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.857+0000 7fb822ffd640 1 -- 172.21.15.112:0/3627530229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb818005040 con 0x7fb8240fdb70 2024-09-19T09:33:54.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.857+0000 7fb822ffd640 1 --2- 172.21.15.112:0/3627530229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8240fdb70 0x7fb82410d0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb81400eb70 tx=0x7fb81400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:54.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.857+0000 7fb80b7fe640 1 -- 172.21.15.112:0/3627530229 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb814007c30 con 0x7fb8240fdb70 2024-09-19T09:33:54.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.858+0000 7fb829994640 1 -- 172.21.15.112:0/3627530229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82410e680 con 0x7fb8240fdb70 2024-09-19T09:33:54.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.858+0000 7fb829994640 1 -- 172.21.15.112:0/3627530229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82410ea90 con 0x7fb8240fdb70 2024-09-19T09:33:54.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.858+0000 7fb80b7fe640 1 -- 172.21.15.112:0/3627530229 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb81400f040 con 0x7fb8240fdb70 2024-09-19T09:33:54.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.858+0000 7fb80b7fe640 1 -- 172.21.15.112:0/3627530229 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb81400c960 con 0x7fb8240fdb70 2024-09-19T09:33:54.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.859+0000 7fb829994640 1 -- 172.21.15.112:0/3627530229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb810005240 con 0x7fb8240fdb70 2024-09-19T09:33:54.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.860+0000 7fb80b7fe640 1 -- 172.21.15.112:0/3627530229 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fb814009600 con 0x7fb8240fdb70 2024-09-19T09:33:54.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.861+0000 7fb80b7fe640 1 --2- 172.21.15.112:0/3627530229 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb80c077630 0x7fb80c079ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:54.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.861+0000 7fb80b7fe640 1 -- 172.21.15.112:0/3627530229 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb81408dce0 con 0x7fb8240fdb70 2024-09-19T09:33:54.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.861+0000 7fb8227fc640 1 --2- 172.21.15.112:0/3627530229 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb80c077630 0x7fb80c079ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:54.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.862+0000 7fb8227fc640 1 --2- 172.21.15.112:0/3627530229 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb80c077630 0x7fb80c079ae0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb82410ce50 tx=0x7fb818035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:54.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:54.865+0000 7fb80b7fe640 1 -- 172.21.15.112:0/3627530229 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb81404e2a0 con 0x7fb8240fdb70 2024-09-19T09:33:55.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:55.046+0000 7fb829994640 1 -- 172.21.15.112:0/3627530229 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb810000bf0 con 0x7fb80c077630 2024-09-19T09:33:55.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:55.047+0000 7fb80b7fe640 1 -- 172.21.15.112:0/3627530229 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fb810000bf0 con 0x7fb80c077630 2024-09-19T09:33:55.049 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:33:55.049 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:33:55.049 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:33:55.049 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-19T09:33:55.049 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [], 2024-09-19T09:33:55.049 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "0/2 daemons upgraded", 2024-09-19T09:33:55.049 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e image on host smithi191", 2024-09-19T09:33:55.049 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:33:55.049 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:33:55.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:55.050+0000 7fb829994640 1 -- 172.21.15.112:0/3627530229 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb80c077630 msgr2=0x7fb80c079ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:55.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:55.050+0000 7fb829994640 1 --2- 172.21.15.112:0/3627530229 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb80c077630 0x7fb80c079ae0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb82410ce50 tx=0x7fb818035040 comp rx=0 tx=0).stop 2024-09-19T09:33:55.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:55.050+0000 7fb829994640 1 -- 172.21.15.112:0/3627530229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8240fdb70 msgr2=0x7fb82410d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:55.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:55.050+0000 7fb829994640 1 --2- 172.21.15.112:0/3627530229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8240fdb70 0x7fb82410d0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb81400eb70 tx=0x7fb81400b040 comp rx=0 tx=0).stop 2024-09-19T09:33:55.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:55.050+0000 7fb829994640 1 -- 172.21.15.112:0/3627530229 shutdown_connections 2024-09-19T09:33:55.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:55.050+0000 7fb829994640 1 --2- 172.21.15.112:0/3627530229 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb80c077630 0x7fb80c079ae0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:55.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:55.050+0000 7fb829994640 1 --2- 172.21.15.112:0/3627530229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8240fe4c0 0x7fb82410d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:55.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:55.050+0000 7fb829994640 1 --2- 172.21.15.112:0/3627530229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8240fdb70 0x7fb82410d0a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:55.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:55.050+0000 7fb829994640 1 -- 172.21.15.112:0/3627530229 >> 172.21.15.112:0/3627530229 conn(0x7fb8240f6390 msgr2=0x7fb8240f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:55.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:55.050+0000 7fb829994640 1 -- 172.21.15.112:0/3627530229 shutdown_connections 2024-09-19T09:33:55.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:33:55.050+0000 7fb829994640 1 -- 172.21.15.112:0/3627530229 wait complete. 2024-09-19T09:33:55.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:55 smithi112 ceph-mon[27605]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-19T09:33:55.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:55 smithi112 ceph-mon[27605]: from='client.24315 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:55.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:55 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:33:55.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:55 smithi112 ceph-mon[27605]: Upgrade: Target is version 19.1.1-361-g2f599a46 (unknown) 2024-09-19T09:33:55.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:55 smithi112 ceph-mon[27605]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e'] 2024-09-19T09:33:55.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:55 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:55.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:55 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:33:55.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:55 smithi112 ceph-mon[27605]: Upgrade: Need to upgrade myself (mgr.smithi112.puhuua) 2024-09-19T09:33:55.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:55 smithi112 ceph-mon[27605]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:55.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:55 smithi112 ceph-mon[27605]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e on smithi191 2024-09-19T09:33:55.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:55 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1517310275' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:33:55.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:55 smithi191 ceph-mon[34834]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-19T09:33:55.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:55 smithi191 ceph-mon[34834]: from='client.24315 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:55.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:55 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:33:55.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:55 smithi191 ceph-mon[34834]: Upgrade: Target is version 19.1.1-361-g2f599a46 (unknown) 2024-09-19T09:33:55.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:55 smithi191 ceph-mon[34834]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e'] 2024-09-19T09:33:55.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:55 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:55.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:55 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:33:55.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:55 smithi191 ceph-mon[34834]: Upgrade: Need to upgrade myself (mgr.smithi112.puhuua) 2024-09-19T09:33:55.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:55 smithi191 ceph-mon[34834]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:55.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:55 smithi191 ceph-mon[34834]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e on smithi191 2024-09-19T09:33:55.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:55 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/1517310275' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:33:56.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:56 smithi112 ceph-mon[27605]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:56.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:56 smithi191 ceph-mon[34834]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:57.426 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:57 smithi191 ceph-mon[34834]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T09:33:57.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:57 smithi112 ceph-mon[27605]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T09:33:59.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:59 smithi112 ceph-mon[27605]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T09:33:59.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:33:59 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:33:59.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:59 smithi191 ceph-mon[34834]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T09:33:59.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:33:59 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:34:01.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:01 smithi112 ceph-mon[27605]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T09:34:01.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:01 smithi191 ceph-mon[34834]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T09:34:03.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:03 smithi112 ceph-mon[27605]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T09:34:03.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:03 smithi191 ceph-mon[34834]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T09:34:05.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:05 smithi112 ceph-mon[27605]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:34:05.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:05 smithi191 ceph-mon[34834]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:34:07.426 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:07 smithi191 ceph-mon[34834]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:34:07.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:07 smithi112 ceph-mon[27605]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:34:08.113 INFO:tasks.workunit.client.1.smithi191.stderr:Updating files: 90% (11651/12896) Updating files: 91% (11736/12896) Updating files: 92% (11865/12896) Updating files: 93% (11994/12896) Updating files: 94% (12123/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T09:34:08.559 INFO:tasks.workunit.client.1.smithi191.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T09:34:08.559 INFO:tasks.workunit.client.1.smithi191.stderr: 2024-09-19T09:34:08.559 INFO:tasks.workunit.client.1.smithi191.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T09:34:08.559 INFO:tasks.workunit.client.1.smithi191.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T09:34:08.559 INFO:tasks.workunit.client.1.smithi191.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T09:34:08.559 INFO:tasks.workunit.client.1.smithi191.stderr: 2024-09-19T09:34:08.559 INFO:tasks.workunit.client.1.smithi191.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T09:34:08.559 INFO:tasks.workunit.client.1.smithi191.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T09:34:08.559 INFO:tasks.workunit.client.1.smithi191.stderr: 2024-09-19T09:34:08.560 INFO:tasks.workunit.client.1.smithi191.stderr: git switch -c 2024-09-19T09:34:08.560 INFO:tasks.workunit.client.1.smithi191.stderr: 2024-09-19T09:34:08.560 INFO:tasks.workunit.client.1.smithi191.stderr:Or undo this operation with: 2024-09-19T09:34:08.560 INFO:tasks.workunit.client.1.smithi191.stderr: 2024-09-19T09:34:08.560 INFO:tasks.workunit.client.1.smithi191.stderr: git switch - 2024-09-19T09:34:08.560 INFO:tasks.workunit.client.1.smithi191.stderr: 2024-09-19T09:34:08.560 INFO:tasks.workunit.client.1.smithi191.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T09:34:08.560 INFO:tasks.workunit.client.1.smithi191.stderr: 2024-09-19T09:34:08.560 INFO:tasks.workunit.client.1.smithi191.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T09:34:08.564 DEBUG:teuthology.orchestra.run.smithi191:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-19T09:34:08.631 INFO:tasks.workunit.client.1.smithi191.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T09:34:08.633 INFO:tasks.workunit.client.1.smithi191.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-19T09:34:08.634 INFO:tasks.workunit.client.1.smithi191.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T09:34:09.072 INFO:tasks.workunit.client.0.smithi112.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T09:34:09.072 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-19T09:34:09.073 INFO:tasks.workunit.client.0.smithi112.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T09:34:09.073 INFO:tasks.workunit.client.0.smithi112.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T09:34:09.073 INFO:tasks.workunit.client.0.smithi112.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T09:34:09.073 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-19T09:34:09.074 INFO:tasks.workunit.client.0.smithi112.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T09:34:09.074 INFO:tasks.workunit.client.0.smithi112.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T09:34:09.074 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-19T09:34:09.074 INFO:tasks.workunit.client.0.smithi112.stderr: git switch -c 2024-09-19T09:34:09.074 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-19T09:34:09.074 INFO:tasks.workunit.client.0.smithi112.stderr:Or undo this operation with: 2024-09-19T09:34:09.075 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-19T09:34:09.075 INFO:tasks.workunit.client.0.smithi112.stderr: git switch - 2024-09-19T09:34:09.075 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-19T09:34:09.075 INFO:tasks.workunit.client.0.smithi112.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T09:34:09.075 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-19T09:34:09.076 INFO:tasks.workunit.client.0.smithi112.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T09:34:09.078 DEBUG:teuthology.orchestra.run.smithi112:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T09:34:09.191 INFO:tasks.workunit.client.0.smithi112.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T09:34:09.194 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:34:09.194 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T09:34:09.380 INFO:tasks.workunit.client.1.smithi191.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T09:34:09.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:09 smithi112 ceph-mon[27605]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:34:09.447 INFO:tasks.workunit.client.1.smithi191.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T09:34:09.491 INFO:tasks.workunit.client.1.smithi191.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-19T09:34:09.493 INFO:tasks.workunit.client.1.smithi191.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-19T09:34:09.493 INFO:tasks.workunit.client.1.smithi191.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T09:34:09.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:09 smithi191 ceph-mon[34834]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:34:09.535 INFO:tasks.workunit.client.1.smithi191.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-19T09:34:09.538 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:34:09.539 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-19T09:34:09.596 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-19T09:34:09.597 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-19T09:34:09.597 DEBUG:teuthology.orchestra.run.smithi191:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-19T09:34:09.657 INFO:tasks.workunit.client.1.smithi191.stderr:+ mkdir -p fsstress 2024-09-19T09:34:09.659 INFO:tasks.workunit.client.1.smithi191.stderr:+ pushd fsstress 2024-09-19T09:34:09.660 INFO:tasks.workunit.client.1.smithi191.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-19T09:34:09.660 INFO:tasks.workunit.client.1.smithi191.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-19T09:34:10.010 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T09:34:10.097 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T09:34:10.138 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:34:10.140 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:34:10.140 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T09:34:10.179 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:34:10.182 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:34:10.182 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T09:34:10.212 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-19T09:34:10.213 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-19T09:34:10.213 DEBUG:teuthology.orchestra.run.smithi112:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-19T09:34:10.272 INFO:tasks.workunit.client.0.smithi112.stderr:+ mkdir -p fsstress 2024-09-19T09:34:10.274 INFO:tasks.workunit.client.0.smithi112.stderr:+ pushd fsstress 2024-09-19T09:34:10.274 INFO:tasks.workunit.client.0.smithi112.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T09:34:10.274 INFO:tasks.workunit.client.0.smithi112.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-19T09:34:11.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:11 smithi112 ceph-mon[27605]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:34:11.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:11 smithi191 ceph-mon[34834]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:34:13.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:13 smithi112 ceph-mon[27605]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T09:34:13.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:13 smithi191 ceph-mon[34834]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T09:34:14.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:14 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:34:14.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:14 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:34:15.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:15 smithi112 ceph-mon[27605]: pgmap v228: 65 pgs: 65 active+clean; 606 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-19T09:34:15.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:15 smithi191 ceph-mon[34834]: pgmap v228: 65 pgs: 65 active+clean; 606 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-19T09:34:16.127 INFO:tasks.workunit.client.1.smithi191.stderr:+ tar xzf ltp-full.tgz 2024-09-19T09:34:17.425 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:17 smithi191 ceph-mon[34834]: pgmap v229: 65 pgs: 65 active+clean; 606 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-19T09:34:17.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:17 smithi112 ceph-mon[27605]: pgmap v229: 65 pgs: 65 active+clean; 606 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-19T09:34:19.143 INFO:tasks.workunit.client.0.smithi112.stderr:+ tar xzf ltp-full.tgz 2024-09-19T09:34:19.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:19 smithi112 ceph-mon[27605]: pgmap v230: 65 pgs: 65 active+clean; 5.2 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.0 KiB/s rd, 395 KiB/s wr, 4 op/s 2024-09-19T09:34:19.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:19 smithi191 ceph-mon[34834]: pgmap v230: 65 pgs: 65 active+clean; 5.2 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.0 KiB/s rd, 395 KiB/s wr, 4 op/s 2024-09-19T09:34:21.411 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:21 smithi191 ceph-mon[34834]: pgmap v231: 65 pgs: 65 active+clean; 15 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.6 KiB/s rd, 1.2 MiB/s wr, 4 op/s 2024-09-19T09:34:21.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:21 smithi112 ceph-mon[27605]: pgmap v231: 65 pgs: 65 active+clean; 15 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.6 KiB/s rd, 1.2 MiB/s wr, 4 op/s 2024-09-19T09:34:23.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:23 smithi191 ceph-mon[34834]: pgmap v232: 65 pgs: 65 active+clean; 19 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 347 KiB/s rd, 1.6 MiB/s wr, 4 op/s 2024-09-19T09:34:23.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:23 smithi191 ceph-mon[34834]: Upgrade: Updating mgr.smithi191.xjpplx 2024-09-19T09:34:23.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:23 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:23.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:23 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi191.xjpplx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:34:23.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:23 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:34:23.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:23 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:23.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:23 smithi191 ceph-mon[34834]: Deploying daemon mgr.smithi191.xjpplx on smithi191 2024-09-19T09:34:23.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:23 smithi112 ceph-mon[27605]: pgmap v232: 65 pgs: 65 active+clean; 19 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 347 KiB/s rd, 1.6 MiB/s wr, 4 op/s 2024-09-19T09:34:23.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:23 smithi112 ceph-mon[27605]: Upgrade: Updating mgr.smithi191.xjpplx 2024-09-19T09:34:23.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:23 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:23.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:23 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi191.xjpplx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:34:23.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:23 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:34:23.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:23 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:23.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:23 smithi112 ceph-mon[27605]: Deploying daemon mgr.smithi191.xjpplx on smithi191 2024-09-19T09:34:25.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.137+0000 7f5eb76f4640 1 -- 172.21.15.112:0/1532892520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5eb0065c40 msgr2=0x7f5eb00ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:25.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.137+0000 7f5eb76f4640 1 --2- 172.21.15.112:0/1532892520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5eb0065c40 0x7f5eb00ff140 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0048d0 tx=0x7f5eac009da0 comp rx=0 tx=0).stop 2024-09-19T09:34:25.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.137+0000 7f5eb76f4640 1 -- 172.21.15.112:0/1532892520 shutdown_connections 2024-09-19T09:34:25.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.137+0000 7f5eb76f4640 1 --2- 172.21.15.112:0/1532892520 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5eb00ff680 0x7f5eb0101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:25.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.137+0000 7f5eb76f4640 1 --2- 172.21.15.112:0/1532892520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5eb0065c40 0x7f5eb00ff140 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:25.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.137+0000 7f5eb76f4640 1 -- 172.21.15.112:0/1532892520 >> 172.21.15.112:0/1532892520 conn(0x7f5eb00f6c10 msgr2=0x7f5eb00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:25.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.137+0000 7f5eb76f4640 1 -- 172.21.15.112:0/1532892520 shutdown_connections 2024-09-19T09:34:25.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.137+0000 7f5eb76f4640 1 -- 172.21.15.112:0/1532892520 wait complete. 2024-09-19T09:34:25.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.138+0000 7f5eb76f4640 1 Processor -- start 2024-09-19T09:34:25.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.138+0000 7f5eb76f4640 1 -- start start 2024-09-19T09:34:25.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.138+0000 7f5eb76f4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5eb0065c40 0x7f5eb00fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:25.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.138+0000 7f5eb76f4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5eb00ff680 0x7f5eb00fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:25.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.138+0000 7f5eb76f4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00fb580 con 0x7f5eb00ff680 2024-09-19T09:34:25.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.138+0000 7f5eb76f4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00fb6c0 con 0x7f5eb0065c40 2024-09-19T09:34:25.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.138+0000 7f5eb4c8f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5eb00ff680 0x7f5eb00fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:25.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.138+0000 7f5eb4c8f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5eb00ff680 0x7f5eb00fb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34966/0 (socket says 172.21.15.112:34966) 2024-09-19T09:34:25.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.138+0000 7f5eb4c8f640 1 -- 172.21.15.112:0/1951854746 learned_addr learned my addr 172.21.15.112:0/1951854746 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:34:25.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.138+0000 7f5eb5490640 1 --2- 172.21.15.112:0/1951854746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5eb0065c40 0x7f5eb00fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:25.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.139+0000 7f5eb4c8f640 1 -- 172.21.15.112:0/1951854746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5eb0065c40 msgr2=0x7f5eb00fcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:25.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.139+0000 7f5eb4c8f640 1 --2- 172.21.15.112:0/1951854746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5eb0065c40 0x7f5eb00fcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:25.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.139+0000 7f5eb4c8f640 1 -- 172.21.15.112:0/1951854746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac005040 con 0x7f5eb00ff680 2024-09-19T09:34:25.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.139+0000 7f5eb4c8f640 1 --2- 172.21.15.112:0/1951854746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5eb00ff680 0x7f5eb00fb040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0002a80 tx=0x7f5ea0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:25.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.139+0000 7f5ea5ffb640 1 -- 172.21.15.112:0/1951854746 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ea0007c30 con 0x7f5eb00ff680 2024-09-19T09:34:25.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.139+0000 7f5eb76f4640 1 -- 172.21.15.112:0/1951854746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb00fb9a0 con 0x7f5eb00ff680 2024-09-19T09:34:25.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.139+0000 7f5ea5ffb640 1 -- 172.21.15.112:0/1951854746 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5ea000f040 con 0x7f5eb00ff680 2024-09-19T09:34:25.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.139+0000 7f5ea5ffb640 1 -- 172.21.15.112:0/1951854746 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ea00095b0 con 0x7f5eb00ff680 2024-09-19T09:34:25.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.139+0000 7f5eb76f4640 1 -- 172.21.15.112:0/1951854746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb00fbec0 con 0x7f5eb00ff680 2024-09-19T09:34:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.140+0000 7f5eb76f4640 1 -- 172.21.15.112:0/1951854746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb00fa890 con 0x7f5eb00ff680 2024-09-19T09:34:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.141+0000 7f5ea5ffb640 1 -- 172.21.15.112:0/1951854746 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f5ea0009710 con 0x7f5eb00ff680 2024-09-19T09:34:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.141+0000 7f5ea5ffb640 1 --2- 172.21.15.112:0/1951854746 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f5e9c06ed60 0x7f5e9c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.141+0000 7f5ea5ffb640 1 -- 172.21.15.112:0/1951854746 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5ea008db80 con 0x7f5eb00ff680 2024-09-19T09:34:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.141+0000 7f5eb5490640 1 --2- 172.21.15.112:0/1951854746 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f5e9c06ed60 0x7f5e9c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.142+0000 7f5eb5490640 1 --2- 172.21.15.112:0/1951854746 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f5e9c06ed60 0x7f5e9c071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00fc8b0 tx=0x7f5eac035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:25.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.146+0000 7f5ea5ffb640 1 -- 172.21.15.112:0/1951854746 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5ea004d2a0 con 0x7f5eb00ff680 2024-09-19T09:34:25.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:25 smithi191 ceph-mon[34834]: pgmap v233: 65 pgs: 65 active+clean; 31 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-09-19T09:34:25.405 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:25 smithi112 ceph-mon[27605]: pgmap v233: 65 pgs: 65 active+clean; 31 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-09-19T09:34:25.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.403+0000 7f5eb76f4640 1 -- 172.21.15.112:0/1951854746 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5eb00f8700 con 0x7f5e9c06ed60 2024-09-19T09:34:25.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.407+0000 7f5ea5ffb640 1 -- 172.21.15.112:0/1951854746 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f5eb00f8700 con 0x7f5e9c06ed60 2024-09-19T09:34:25.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.411+0000 7f5eb76f4640 1 -- 172.21.15.112:0/1951854746 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f5e9c06ed60 msgr2=0x7f5e9c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:25.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.411+0000 7f5eb76f4640 1 --2- 172.21.15.112:0/1951854746 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f5e9c06ed60 0x7f5e9c071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00fc8b0 tx=0x7f5eac035040 comp rx=0 tx=0).stop 2024-09-19T09:34:25.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.411+0000 7f5eb76f4640 1 -- 172.21.15.112:0/1951854746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5eb00ff680 msgr2=0x7f5eb00fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:25.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.411+0000 7f5eb76f4640 1 --2- 172.21.15.112:0/1951854746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5eb00ff680 0x7f5eb00fb040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0002a80 tx=0x7f5ea0004600 comp rx=0 tx=0).stop 2024-09-19T09:34:25.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.411+0000 7f5eb76f4640 1 -- 172.21.15.112:0/1951854746 shutdown_connections 2024-09-19T09:34:25.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.411+0000 7f5eb76f4640 1 --2- 172.21.15.112:0/1951854746 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f5e9c06ed60 0x7f5e9c071210 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:25.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.411+0000 7f5eb76f4640 1 --2- 172.21.15.112:0/1951854746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5eb00ff680 0x7f5eb00fb040 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:25.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.411+0000 7f5eb76f4640 1 --2- 172.21.15.112:0/1951854746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5eb0065c40 0x7f5eb00fcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:25.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.411+0000 7f5eb76f4640 1 -- 172.21.15.112:0/1951854746 >> 172.21.15.112:0/1951854746 conn(0x7f5eb00f6c10 msgr2=0x7f5eb00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:25.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.412+0000 7f5eb76f4640 1 -- 172.21.15.112:0/1951854746 shutdown_connections 2024-09-19T09:34:25.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.412+0000 7f5eb76f4640 1 -- 172.21.15.112:0/1951854746 wait complete. 2024-09-19T09:34:25.430 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:34:25.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.559+0000 7fa772f0f640 1 -- 172.21.15.112:0/3715035371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76c06dbf0 msgr2=0x7fa76c06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:25.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.559+0000 7fa772f0f640 1 --2- 172.21.15.112:0/3715035371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76c06dbf0 0x7fa76c06e000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa764009c50 tx=0x7fa764004d10 comp rx=0 tx=0).stop 2024-09-19T09:34:25.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.561+0000 7fa772f0f640 1 -- 172.21.15.112:0/3715035371 shutdown_connections 2024-09-19T09:34:25.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.561+0000 7fa772f0f640 1 --2- 172.21.15.112:0/3715035371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa76c06e540 0x7fa76c108730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:25.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.561+0000 7fa772f0f640 1 --2- 172.21.15.112:0/3715035371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76c06dbf0 0x7fa76c06e000 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:25.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.561+0000 7fa772f0f640 1 -- 172.21.15.112:0/3715035371 >> 172.21.15.112:0/3715035371 conn(0x7fa76c069560 msgr2=0x7fa76c06b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:25.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.562+0000 7fa772f0f640 1 -- 172.21.15.112:0/3715035371 shutdown_connections 2024-09-19T09:34:25.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.562+0000 7fa772f0f640 1 -- 172.21.15.112:0/3715035371 wait complete. 2024-09-19T09:34:25.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.563+0000 7fa772f0f640 1 Processor -- start 2024-09-19T09:34:25.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.563+0000 7fa772f0f640 1 -- start start 2024-09-19T09:34:25.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.563+0000 7fa772f0f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa76c06dbf0 0x7fa76c11bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:25.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.563+0000 7fa772f0f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76c06e540 0x7fa76c11c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:25.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.563+0000 7fa772f0f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c11cac0 con 0x7fa76c06e540 2024-09-19T09:34:25.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.563+0000 7fa772f0f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c11d1b0 con 0x7fa76c06dbf0 2024-09-19T09:34:25.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.564+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76c06e540 0x7fa76c11c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:25.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.564+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76c06e540 0x7fa76c11c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34978/0 (socket says 172.21.15.112:34978) 2024-09-19T09:34:25.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.564+0000 7fa76bfff640 1 -- 172.21.15.112:0/913877185 learned_addr learned my addr 172.21.15.112:0/913877185 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:34:25.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.564+0000 7fa76bfff640 1 -- 172.21.15.112:0/913877185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa76c06dbf0 msgr2=0x7fa76c11bf30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:34:25.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.564+0000 7fa76bfff640 1 --2- 172.21.15.112:0/913877185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa76c06dbf0 0x7fa76c11bf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:25.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.564+0000 7fa76bfff640 1 -- 172.21.15.112:0/913877185 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7640098b0 con 0x7fa76c06e540 2024-09-19T09:34:25.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.565+0000 7fa76bfff640 1 --2- 172.21.15.112:0/913877185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76c06e540 0x7fa76c11c470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa76000eb70 tx=0x7fa76000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:25.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.565+0000 7fa7697fa640 1 -- 172.21.15.112:0/913877185 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa760007c30 con 0x7fa76c06e540 2024-09-19T09:34:25.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.566+0000 7fa7697fa640 1 -- 172.21.15.112:0/913877185 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa76000f040 con 0x7fa76c06e540 2024-09-19T09:34:25.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.566+0000 7fa7697fa640 1 -- 172.21.15.112:0/913877185 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa760009530 con 0x7fa76c06e540 2024-09-19T09:34:25.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.566+0000 7fa772f0f640 1 -- 172.21.15.112:0/913877185 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c11d3e0 con 0x7fa76c06e540 2024-09-19T09:34:25.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.566+0000 7fa772f0f640 1 -- 172.21.15.112:0/913877185 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c11d980 con 0x7fa76c06e540 2024-09-19T09:34:25.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.571+0000 7fa7697fa640 1 -- 172.21.15.112:0/913877185 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fa760009710 con 0x7fa76c06e540 2024-09-19T09:34:25.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.571+0000 7fa7697fa640 1 --2- 172.21.15.112:0/913877185 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa75406ee60 0x7fa754071310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:25.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.572+0000 7fa7697fa640 1 -- 172.21.15.112:0/913877185 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa76008dcd0 con 0x7fa76c06e540 2024-09-19T09:34:25.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.571+0000 7fa772f0f640 1 -- 172.21.15.112:0/913877185 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76c06d1b0 con 0x7fa76c06e540 2024-09-19T09:34:25.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.579+0000 7fa770cab640 1 --2- 172.21.15.112:0/913877185 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa75406ee60 0x7fa754071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:25.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.580+0000 7fa7697fa640 1 -- 172.21.15.112:0/913877185 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa76004e2a0 con 0x7fa76c06e540 2024-09-19T09:34:25.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.582+0000 7fa770cab640 1 --2- 172.21.15.112:0/913877185 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa75406ee60 0x7fa754071310 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa764000f80 tx=0x7fa764004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:25.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.944+0000 7fa772f0f640 1 -- 172.21.15.112:0/913877185 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa76c11dd70 con 0x7fa75406ee60 2024-09-19T09:34:25.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.949+0000 7fa7697fa640 1 -- 172.21.15.112:0/913877185 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fa76c11dd70 con 0x7fa75406ee60 2024-09-19T09:34:25.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.953+0000 7fa772f0f640 1 -- 172.21.15.112:0/913877185 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa75406ee60 msgr2=0x7fa754071310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:25.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.953+0000 7fa772f0f640 1 --2- 172.21.15.112:0/913877185 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa75406ee60 0x7fa754071310 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa764000f80 tx=0x7fa764004d10 comp rx=0 tx=0).stop 2024-09-19T09:34:25.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.953+0000 7fa772f0f640 1 -- 172.21.15.112:0/913877185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76c06e540 msgr2=0x7fa76c11c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:25.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.953+0000 7fa772f0f640 1 --2- 172.21.15.112:0/913877185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76c06e540 0x7fa76c11c470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa76000eb70 tx=0x7fa76000b040 comp rx=0 tx=0).stop 2024-09-19T09:34:25.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.953+0000 7fa772f0f640 1 -- 172.21.15.112:0/913877185 shutdown_connections 2024-09-19T09:34:25.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.954+0000 7fa772f0f640 1 --2- 172.21.15.112:0/913877185 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fa75406ee60 0x7fa754071310 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:25.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.954+0000 7fa772f0f640 1 --2- 172.21.15.112:0/913877185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76c06e540 0x7fa76c11c470 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:25.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.954+0000 7fa772f0f640 1 --2- 172.21.15.112:0/913877185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa76c06dbf0 0x7fa76c11bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:25.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.954+0000 7fa772f0f640 1 -- 172.21.15.112:0/913877185 >> 172.21.15.112:0/913877185 conn(0x7fa76c069560 msgr2=0x7fa76c1068c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:25.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.954+0000 7fa772f0f640 1 -- 172.21.15.112:0/913877185 shutdown_connections 2024-09-19T09:34:25.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:25.954+0000 7fa772f0f640 1 -- 172.21.15.112:0/913877185 wait complete. 2024-09-19T09:34:26.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.104+0000 7fb275cfe640 1 -- 172.21.15.112:0/395397827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb27006e540 msgr2=0x7fb270108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:26.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.104+0000 7fb275cfe640 1 --2- 172.21.15.112:0/395397827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb27006e540 0x7fb270108730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb264004810 tx=0x7fb264009da0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.105+0000 7fb275cfe640 1 -- 172.21.15.112:0/395397827 shutdown_connections 2024-09-19T09:34:26.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.105+0000 7fb275cfe640 1 --2- 172.21.15.112:0/395397827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb27006e540 0x7fb270108730 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb264004810 tx=0x7fb264009da0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.105+0000 7fb275cfe640 1 --2- 172.21.15.112:0/395397827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb27006dbf0 0x7fb27006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.105+0000 7fb275cfe640 1 -- 172.21.15.112:0/395397827 >> 172.21.15.112:0/395397827 conn(0x7fb270069560 msgr2=0x7fb27006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:26.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.107+0000 7fb275cfe640 1 -- 172.21.15.112:0/395397827 shutdown_connections 2024-09-19T09:34:26.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.108+0000 7fb275cfe640 1 -- 172.21.15.112:0/395397827 wait complete. 2024-09-19T09:34:26.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.109+0000 7fb275cfe640 1 Processor -- start 2024-09-19T09:34:26.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.109+0000 7fb275cfe640 1 -- start start 2024-09-19T09:34:26.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.109+0000 7fb275cfe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb27006dbf0 0x7fb27011bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.109+0000 7fb275cfe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb27011c500 0x7fb27011d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.109+0000 7fb275cfe640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27011c9c0 con 0x7fb27006dbf0 2024-09-19T09:34:26.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.109+0000 7fb275cfe640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27011cb00 con 0x7fb27011c500 2024-09-19T09:34:26.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.110+0000 7fb26effd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb27011c500 0x7fb27011d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.110+0000 7fb26effd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb27011c500 0x7fb27011d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.112:50402/0 (socket says 172.21.15.112:50402) 2024-09-19T09:34:26.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.110+0000 7fb26effd640 1 -- 172.21.15.112:0/2381828247 learned_addr learned my addr 172.21.15.112:0/2381828247 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:34:26.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.111+0000 7fb26effd640 1 -- 172.21.15.112:0/2381828247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb27006dbf0 msgr2=0x7fb27011bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:26.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.111+0000 7fb26effd640 1 --2- 172.21.15.112:0/2381828247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb27006dbf0 0x7fb27011bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.111+0000 7fb26effd640 1 -- 172.21.15.112:0/2381828247 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb264005040 con 0x7fb27011c500 2024-09-19T09:34:26.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.111+0000 7fb26effd640 1 --2- 172.21.15.112:0/2381828247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb27011c500 0x7fb27011d370 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb264004730 tx=0x7fb264009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:26.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.114+0000 7fb257fff640 1 -- 172.21.15.112:0/2381828247 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb264038070 con 0x7fb27011c500 2024-09-19T09:34:26.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.114+0000 7fb257fff640 1 -- 172.21.15.112:0/2381828247 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb264009730 con 0x7fb27011c500 2024-09-19T09:34:26.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.114+0000 7fb257fff640 1 -- 172.21.15.112:0/2381828247 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb26403c6e0 con 0x7fb27011c500 2024-09-19T09:34:26.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.115+0000 7fb275cfe640 1 -- 172.21.15.112:0/2381828247 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27011d910 con 0x7fb27011c500 2024-09-19T09:34:26.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.115+0000 7fb275cfe640 1 -- 172.21.15.112:0/2381828247 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27011de20 con 0x7fb27011c500 2024-09-19T09:34:26.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.119+0000 7fb275cfe640 1 -- 172.21.15.112:0/2381828247 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25c005240 con 0x7fb27011c500 2024-09-19T09:34:26.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.121+0000 7fb257fff640 1 -- 172.21.15.112:0/2381828247 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fb264030020 con 0x7fb27011c500 2024-09-19T09:34:26.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.121+0000 7fb257fff640 1 --2- 172.21.15.112:0/2381828247 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb25806ef30 0x7fb2580713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.121+0000 7fb257fff640 1 -- 172.21.15.112:0/2381828247 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb2640ade90 con 0x7fb27011c500 2024-09-19T09:34:26.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.122+0000 7fb26f7fe640 1 --2- 172.21.15.112:0/2381828247 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb25806ef30 0x7fb2580713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.123+0000 7fb26f7fe640 1 --2- 172.21.15.112:0/2381828247 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb25806ef30 0x7fb2580713e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb2600043d0 tx=0x7fb260002420 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:26.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.129+0000 7fb257fff640 1 -- 172.21.15.112:0/2381828247 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb26407b070 con 0x7fb27011c500 2024-09-19T09:34:26.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:26 smithi112 ceph-mon[27605]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:26.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.488+0000 7fb275cfe640 1 -- 172.21.15.112:0/2381828247 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb25c000bf0 con 0x7fb25806ef30 2024-09-19T09:34:26.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.506+0000 7fb257fff640 1 -- 172.21.15.112:0/2381828247 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fb25c000bf0 con 0x7fb25806ef30 2024-09-19T09:34:26.507 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:34:26.507 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (5m) 92s ago 7m 25.5M - 0.25.0 c8568f914cd2 bc75f08f7e02 2024-09-19T09:34:26.508 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (7m) 92s ago 7m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1513f1075df5 2024-09-19T09:34:26.508 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (6m) 99s ago 6m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6c313b300b35 2024-09-19T09:34:26.508 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (5m) 92s ago 7m 87.4M - 9.4.7 954c08fa6188 aeb5727c19ca 2024-09-19T09:34:26.508 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (111s) 92s ago 110s 17.5M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:34:26.508 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (116s) 92s ago 116s 11.6M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:34:26.508 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (114s) 99s ago 113s 10.9M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:34:26.508 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (108s) 99s ago 108s 14.3M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:34:26.508 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:9283,8765,8443 running (8m) 92s ago 8m 448M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a963c39d50ce 2024-09-19T09:34:26.508 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283 running (6m) 99s ago 6m 401M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cc9633745ef8 2024-09-19T09:34:26.508 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (8m) 92s ago 8m 47.0M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 34676d67b669 2024-09-19T09:34:26.508 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (6m) 99s ago 6m 36.5M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 35690ef0929b 2024-09-19T09:34:26.508 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (7m) 92s ago 7m 15.6M - 1.5.0 0da6a335fe13 a5e6a378cf2f 2024-09-19T09:34:26.508 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (6m) 99s ago 6m 16.5M - 1.5.0 0da6a335fe13 6b6c7c67cf29 2024-09-19T09:34:26.508 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (5m) 92s ago 5m 45.1M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 621693067dce 2024-09-19T09:34:26.509 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (5m) 92s ago 5m 44.3M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1742e5964367 2024-09-19T09:34:26.509 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (4m) 92s ago 4m 46.3M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 4dcca18af229 2024-09-19T09:34:26.509 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (4m) 99s ago 4m 43.0M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:34:26.509 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (3m) 99s ago 3m 42.8M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:34:26.509 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (3m) 99s ago 3m 41.3M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:34:26.509 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (5m) 92s ago 6m 54.0M - 2.43.0 a07b618ecd1d 9499df984e6a 2024-09-19T09:34:26.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.511+0000 7fb275cfe640 1 -- 172.21.15.112:0/2381828247 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb25806ef30 msgr2=0x7fb2580713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:26.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.511+0000 7fb275cfe640 1 --2- 172.21.15.112:0/2381828247 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb25806ef30 0x7fb2580713e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb2600043d0 tx=0x7fb260002420 comp rx=0 tx=0).stop 2024-09-19T09:34:26.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.511+0000 7fb275cfe640 1 -- 172.21.15.112:0/2381828247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb27011c500 msgr2=0x7fb27011d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:26.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.511+0000 7fb275cfe640 1 --2- 172.21.15.112:0/2381828247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb27011c500 0x7fb27011d370 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb264004730 tx=0x7fb264009da0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.514+0000 7fb275cfe640 1 -- 172.21.15.112:0/2381828247 shutdown_connections 2024-09-19T09:34:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.514+0000 7fb275cfe640 1 --2- 172.21.15.112:0/2381828247 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7fb25806ef30 0x7fb2580713e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.514+0000 7fb275cfe640 1 --2- 172.21.15.112:0/2381828247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb27011c500 0x7fb27011d370 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.514+0000 7fb275cfe640 1 --2- 172.21.15.112:0/2381828247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb27006dbf0 0x7fb27011bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.514+0000 7fb275cfe640 1 -- 172.21.15.112:0/2381828247 >> 172.21.15.112:0/2381828247 conn(0x7fb270069560 msgr2=0x7fb270106930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.515+0000 7fb275cfe640 1 -- 172.21.15.112:0/2381828247 shutdown_connections 2024-09-19T09:34:26.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.517+0000 7fb275cfe640 1 -- 172.21.15.112:0/2381828247 wait complete. 2024-09-19T09:34:26.525 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:26 smithi191 ceph-mon[34834]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:26.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.654+0000 7f50ccaf8640 1 -- 172.21.15.112:0/2919707508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50c80fd470 msgr2=0x7f50c80ff8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:26.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.654+0000 7f50ccaf8640 1 --2- 172.21.15.112:0/2919707508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50c80fd470 0x7f50c80ff8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0048d0 tx=0x7f50bc009da0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.655+0000 7f50ccaf8640 1 -- 172.21.15.112:0/2919707508 shutdown_connections 2024-09-19T09:34:26.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.655+0000 7f50ccaf8640 1 --2- 172.21.15.112:0/2919707508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50c80fd470 0x7f50c80ff8f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.655+0000 7f50ccaf8640 1 --2- 172.21.15.112:0/2919707508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c8065c40 0x7f50c80fcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.655+0000 7f50ccaf8640 1 -- 172.21.15.112:0/2919707508 >> 172.21.15.112:0/2919707508 conn(0x7f50c80f6c10 msgr2=0x7f50c80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:26.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.661+0000 7f50ccaf8640 1 -- 172.21.15.112:0/2919707508 shutdown_connections 2024-09-19T09:34:26.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.664+0000 7f50ccaf8640 1 -- 172.21.15.112:0/2919707508 wait complete. 2024-09-19T09:34:26.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.664+0000 7f50ccaf8640 1 Processor -- start 2024-09-19T09:34:26.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.668+0000 7f50ccaf8640 1 -- start start 2024-09-19T09:34:26.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.668+0000 7f50ccaf8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c8065c40 0x7f50c8108a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.668+0000 7f50ccaf8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50c80fd470 0x7f50c8108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.668+0000 7f50ccaf8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c8109610 con 0x7f50c8065c40 2024-09-19T09:34:26.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.668+0000 7f50ccaf8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c811d110 con 0x7f50c80fd470 2024-09-19T09:34:26.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.669+0000 7f50c659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c8065c40 0x7f50c8108a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.669+0000 7f50c659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c8065c40 0x7f50c8108a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35000/0 (socket says 172.21.15.112:35000) 2024-09-19T09:34:26.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.669+0000 7f50c659c640 1 -- 172.21.15.112:0/2214656577 learned_addr learned my addr 172.21.15.112:0/2214656577 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:34:26.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.670+0000 7f50c659c640 1 -- 172.21.15.112:0/2214656577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50c80fd470 msgr2=0x7f50c8108f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:34:26.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.670+0000 7f50c659c640 1 --2- 172.21.15.112:0/2214656577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50c80fd470 0x7f50c8108f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.670+0000 7f50c659c640 1 -- 172.21.15.112:0/2214656577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc005040 con 0x7f50c8065c40 2024-09-19T09:34:26.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.671+0000 7f50c659c640 1 --2- 172.21.15.112:0/2214656577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c8065c40 0x7f50c8108a40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f50b800b560 tx=0x7f50b80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.672+0000 7f50b6ffd640 1 -- 172.21.15.112:0/2214656577 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50b800f770 con 0x7f50c8065c40 2024-09-19T09:34:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.672+0000 7f50b6ffd640 1 -- 172.21.15.112:0/2214656577 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f50b800fd70 con 0x7f50c8065c40 2024-09-19T09:34:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.672+0000 7f50b6ffd640 1 -- 172.21.15.112:0/2214656577 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50b800d310 con 0x7f50c8065c40 2024-09-19T09:34:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.673+0000 7f50ccaf8640 1 -- 172.21.15.112:0/2214656577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c811d3a0 con 0x7f50c8065c40 2024-09-19T09:34:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.674+0000 7f50ccaf8640 1 -- 172.21.15.112:0/2214656577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c811d8c0 con 0x7f50c8065c40 2024-09-19T09:34:26.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.676+0000 7f50ccaf8640 1 -- 172.21.15.112:0/2214656577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c80fa890 con 0x7f50c8065c40 2024-09-19T09:34:26.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.677+0000 7f50b6ffd640 1 -- 172.21.15.112:0/2214656577 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f50b800f8d0 con 0x7f50c8065c40 2024-09-19T09:34:26.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.678+0000 7f50b6ffd640 1 --2- 172.21.15.112:0/2214656577 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f50b006eee0 0x7f50b0071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.678+0000 7f50b6ffd640 1 -- 172.21.15.112:0/2214656577 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f50b808e030 con 0x7f50c8065c40 2024-09-19T09:34:26.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.681+0000 7f50c5d9b640 1 --2- 172.21.15.112:0/2214656577 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f50b006eee0 0x7f50b0071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.687+0000 7f50c5d9b640 1 --2- 172.21.15.112:0/2214656577 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f50b006eee0 0x7f50b0071390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50bc02a550 tx=0x7f50bc009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:26.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:26.689+0000 7f50b6ffd640 1 -- 172.21.15.112:0/2214656577 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f50b805b160 con 0x7f50c8065c40 2024-09-19T09:34:27.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.032+0000 7f50ccaf8640 1 -- 172.21.15.112:0/2214656577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f50c804b720 con 0x7f50c8065c40 2024-09-19T09:34:27.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.032+0000 7f50b6ffd640 1 -- 172.21.15.112:0/2214656577 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f50b805ab00 con 0x7f50c8065c40 2024-09-19T09:34:27.034 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:34:27.034 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:34:27.034 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T09:34:27.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:34:27.034 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:34:27.034 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T09:34:27.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:34:27.034 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:34:27.035 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T09:34:27.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:34:27.035 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:34:27.035 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:34:27.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:34:27.035 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:34:27.035 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 14 2024-09-19T09:34:27.035 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:34:27.035 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:34:27.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.035+0000 7f50ccaf8640 1 -- 172.21.15.112:0/2214656577 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f50b006eee0 msgr2=0x7f50b0071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:27.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.035+0000 7f50ccaf8640 1 --2- 172.21.15.112:0/2214656577 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f50b006eee0 0x7f50b0071390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50bc02a550 tx=0x7f50bc009da0 comp rx=0 tx=0).stop 2024-09-19T09:34:27.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.035+0000 7f50ccaf8640 1 -- 172.21.15.112:0/2214656577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c8065c40 msgr2=0x7f50c8108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:27.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.035+0000 7f50ccaf8640 1 --2- 172.21.15.112:0/2214656577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c8065c40 0x7f50c8108a40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f50b800b560 tx=0x7f50b80090f0 comp rx=0 tx=0).stop 2024-09-19T09:34:27.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.035+0000 7f50ccaf8640 1 -- 172.21.15.112:0/2214656577 shutdown_connections 2024-09-19T09:34:27.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.035+0000 7f50ccaf8640 1 --2- 172.21.15.112:0/2214656577 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7f50b006eee0 0x7f50b0071390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:27.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.035+0000 7f50ccaf8640 1 --2- 172.21.15.112:0/2214656577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50c80fd470 0x7f50c8108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:27.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.035+0000 7f50ccaf8640 1 --2- 172.21.15.112:0/2214656577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c8065c40 0x7f50c8108a40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:27.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.035+0000 7f50ccaf8640 1 -- 172.21.15.112:0/2214656577 >> 172.21.15.112:0/2214656577 conn(0x7f50c80f6c10 msgr2=0x7f50c80f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:27.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.035+0000 7f50ccaf8640 1 -- 172.21.15.112:0/2214656577 shutdown_connections 2024-09-19T09:34:27.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.035+0000 7f50ccaf8640 1 -- 172.21.15.112:0/2214656577 wait complete. 2024-09-19T09:34:27.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.125+0000 7eff554b5640 1 -- 172.21.15.112:0/1999998553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff50101ae0 msgr2=0x7eff50103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:27.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.125+0000 7eff554b5640 1 --2- 172.21.15.112:0/1999998553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff50101ae0 0x7eff50103ec0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7eff440048d0 tx=0x7eff44009da0 comp rx=0 tx=0).stop 2024-09-19T09:34:27.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.126+0000 7eff554b5640 1 -- 172.21.15.112:0/1999998553 shutdown_connections 2024-09-19T09:34:27.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.126+0000 7eff554b5640 1 --2- 172.21.15.112:0/1999998553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff50101ae0 0x7eff50103ec0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:27.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.126+0000 7eff554b5640 1 --2- 172.21.15.112:0/1999998553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff50065be0 0x7eff501015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:27.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.126+0000 7eff554b5640 1 -- 172.21.15.112:0/1999998553 >> 172.21.15.112:0/1999998553 conn(0x7eff500f6c10 msgr2=0x7eff500f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:27.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.126+0000 7eff554b5640 1 -- 172.21.15.112:0/1999998553 shutdown_connections 2024-09-19T09:34:27.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.126+0000 7eff554b5640 1 -- 172.21.15.112:0/1999998553 wait complete. 2024-09-19T09:34:27.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.126+0000 7eff554b5640 1 Processor -- start 2024-09-19T09:34:27.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.126+0000 7eff554b5640 1 -- start start 2024-09-19T09:34:27.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.127+0000 7eff554b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff50065be0 0x7eff5010f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:27.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.127+0000 7eff554b5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff50101ae0 0x7eff5010f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:27.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.127+0000 7eff554b5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5010fdd0 con 0x7eff50065be0 2024-09-19T09:34:27.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.127+0000 7eff554b5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff501105f0 con 0x7eff50101ae0 2024-09-19T09:34:27.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.127+0000 7eff4effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff50065be0 0x7eff5010f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:27.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.127+0000 7eff4effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff50065be0 0x7eff5010f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35010/0 (socket says 172.21.15.112:35010) 2024-09-19T09:34:27.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.127+0000 7eff4effd640 1 -- 172.21.15.112:0/3736466900 learned_addr learned my addr 172.21.15.112:0/3736466900 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:34:27.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.127+0000 7eff4e7fc640 1 --2- 172.21.15.112:0/3736466900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff50101ae0 0x7eff5010f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:27.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.127+0000 7eff4effd640 1 -- 172.21.15.112:0/3736466900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff50101ae0 msgr2=0x7eff5010f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:27.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.127+0000 7eff4effd640 1 --2- 172.21.15.112:0/3736466900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff50101ae0 0x7eff5010f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:27.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.127+0000 7eff4effd640 1 -- 172.21.15.112:0/3736466900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff44005040 con 0x7eff50065be0 2024-09-19T09:34:27.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.127+0000 7eff4effd640 1 --2- 172.21.15.112:0/3736466900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff50065be0 0x7eff5010f240 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7eff4000eb70 tx=0x7eff4000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:27.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.127+0000 7eff377fe640 1 -- 172.21.15.112:0/3736466900 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff40007c30 con 0x7eff50065be0 2024-09-19T09:34:27.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.127+0000 7eff554b5640 1 -- 172.21.15.112:0/3736466900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff50110880 con 0x7eff50065be0 2024-09-19T09:34:27.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.127+0000 7eff377fe640 1 -- 172.21.15.112:0/3736466900 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7eff4000f040 con 0x7eff50065be0 2024-09-19T09:34:27.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.128+0000 7eff377fe640 1 -- 172.21.15.112:0/3736466900 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff4000cb80 con 0x7eff50065be0 2024-09-19T09:34:27.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.128+0000 7eff554b5640 1 -- 172.21.15.112:0/3736466900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff50110df0 con 0x7eff50065be0 2024-09-19T09:34:27.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.129+0000 7eff554b5640 1 -- 172.21.15.112:0/3736466900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff500fa890 con 0x7eff50065be0 2024-09-19T09:34:27.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.130+0000 7eff377fe640 1 -- 172.21.15.112:0/3736466900 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7eff4000cd00 con 0x7eff50065be0 2024-09-19T09:34:27.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.130+0000 7eff377fe640 1 --2- 172.21.15.112:0/3736466900 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7eff3806ed60 0x7eff38071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:27.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.130+0000 7eff377fe640 1 -- 172.21.15.112:0/3736466900 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7eff4008e2a0 con 0x7eff50065be0 2024-09-19T09:34:27.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.130+0000 7eff4e7fc640 1 --2- 172.21.15.112:0/3736466900 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7eff3806ed60 0x7eff38071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:27.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.131+0000 7eff4e7fc640 1 --2- 172.21.15.112:0/3736466900 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7eff3806ed60 0x7eff38071210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7eff44009ac0 tx=0x7eff44035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:27.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.135+0000 7eff377fe640 1 -- 172.21.15.112:0/3736466900 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7eff4005b4b0 con 0x7eff50065be0 2024-09-19T09:34:27.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:27 smithi191 ceph-mon[34834]: pgmap v234: 65 pgs: 65 active+clean; 35 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-09-19T09:34:27.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:27 smithi191 ceph-mon[34834]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:27.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:27 smithi191 ceph-mon[34834]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:27.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:27 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2214656577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:34:27.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.365+0000 7eff554b5640 1 -- 172.21.15.112:0/3736466900 --> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7eff50111230 con 0x7eff3806ed60 2024-09-19T09:34:27.367 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:27 smithi112 ceph-mon[27605]: pgmap v234: 65 pgs: 65 active+clean; 35 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-09-19T09:34:27.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:27 smithi112 ceph-mon[27605]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:27.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:27 smithi112 ceph-mon[27605]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:27.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:27 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2214656577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:34:27.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.366+0000 7eff377fe640 1 -- 172.21.15.112:0/3736466900 <== mgr.14206 v2:172.21.15.112:6800/3495376281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7eff50111230 con 0x7eff3806ed60 2024-09-19T09:34:27.369 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:34:27.369 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:34:27.369 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:34:27.369 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-19T09:34:27.369 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [], 2024-09-19T09:34:27.369 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "0/2 daemons upgraded", 2024-09-19T09:34:27.369 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading mgr daemons", 2024-09-19T09:34:27.369 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:34:27.369 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:34:27.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.368+0000 7eff554b5640 1 -- 172.21.15.112:0/3736466900 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7eff3806ed60 msgr2=0x7eff38071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:27.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.368+0000 7eff554b5640 1 --2- 172.21.15.112:0/3736466900 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7eff3806ed60 0x7eff38071210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7eff44009ac0 tx=0x7eff44035040 comp rx=0 tx=0).stop 2024-09-19T09:34:27.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.368+0000 7eff554b5640 1 -- 172.21.15.112:0/3736466900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff50065be0 msgr2=0x7eff5010f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:27.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.368+0000 7eff554b5640 1 --2- 172.21.15.112:0/3736466900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff50065be0 0x7eff5010f240 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7eff4000eb70 tx=0x7eff4000b040 comp rx=0 tx=0).stop 2024-09-19T09:34:27.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.368+0000 7eff554b5640 1 -- 172.21.15.112:0/3736466900 shutdown_connections 2024-09-19T09:34:27.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.368+0000 7eff554b5640 1 --2- 172.21.15.112:0/3736466900 >> [v2:172.21.15.112:6800/3495376281,v1:172.21.15.112:6801/3495376281] conn(0x7eff3806ed60 0x7eff38071210 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:27.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.368+0000 7eff554b5640 1 --2- 172.21.15.112:0/3736466900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff50101ae0 0x7eff5010f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:27.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.368+0000 7eff554b5640 1 --2- 172.21.15.112:0/3736466900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff50065be0 0x7eff5010f240 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:27.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.368+0000 7eff554b5640 1 -- 172.21.15.112:0/3736466900 >> 172.21.15.112:0/3736466900 conn(0x7eff500f6c10 msgr2=0x7eff500f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:27.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.369+0000 7eff554b5640 1 -- 172.21.15.112:0/3736466900 shutdown_connections 2024-09-19T09:34:27.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:27.369+0000 7eff554b5640 1 -- 172.21.15.112:0/3736466900 wait complete. 2024-09-19T09:34:28.193 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:28 smithi191 ceph-mon[34834]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:28.194 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:28 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:28.194 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:28 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:28.194 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:28 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:28.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:28 smithi112 ceph-mon[27605]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:28.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:28 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:28.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:28 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:28.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:28 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:29.098 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:29 smithi191 ceph-mon[34834]: pgmap v235: 65 pgs: 65 active+clean; 60 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.1 MiB/s wr, 176 op/s 2024-09-19T09:34:29.098 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:29 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:34:29.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:29 smithi112 ceph-mon[27605]: pgmap v235: 65 pgs: 65 active+clean; 60 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.1 MiB/s wr, 176 op/s 2024-09-19T09:34:29.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:29 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:34:31.152 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:31 smithi191 ceph-mon[34834]: pgmap v236: 65 pgs: 65 active+clean; 78 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 6.4 MiB/s wr, 491 op/s 2024-09-19T09:34:31.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:31 smithi112 ceph-mon[27605]: pgmap v236: 65 pgs: 65 active+clean; 78 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 6.4 MiB/s wr, 491 op/s 2024-09-19T09:34:32.879 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:32 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:32.880 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:32 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:32.880 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:32 smithi191 ceph-mon[34834]: pgmap v237: 65 pgs: 65 active+clean; 85 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 604 op/s 2024-09-19T09:34:32.880 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:32 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:32.880 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:32 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:32.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:32 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:32.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:32 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:32.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:32 smithi112 ceph-mon[27605]: pgmap v237: 65 pgs: 65 active+clean; 85 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 604 op/s 2024-09-19T09:34:32.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:32 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:32.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:32 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:33.659 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:33 smithi191 ceph-mon[34834]: Standby manager daemon smithi191.xjpplx restarted 2024-09-19T09:34:33.659 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:33 smithi191 ceph-mon[34834]: Standby manager daemon smithi191.xjpplx started 2024-09-19T09:34:33.659 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:33 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/crt"}]: dispatch 2024-09-19T09:34:33.659 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:33 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:34:33.659 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:33 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/key"}]: dispatch 2024-09-19T09:34:33.659 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:33 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:34:33.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:33 smithi112 ceph-mon[27605]: Standby manager daemon smithi191.xjpplx restarted 2024-09-19T09:34:33.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:33 smithi112 ceph-mon[27605]: Standby manager daemon smithi191.xjpplx started 2024-09-19T09:34:33.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:33 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/crt"}]: dispatch 2024-09-19T09:34:33.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:33 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:34:33.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:33 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/key"}]: dispatch 2024-09-19T09:34:33.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:33 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:34:34.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:34 smithi112 ceph-mon[27605]: mgrmap e20: smithi112.puhuua(active, since 6m), standbys: smithi191.xjpplx 2024-09-19T09:34:34.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:34 smithi112 ceph-mon[27605]: pgmap v238: 65 pgs: 65 active+clean; 100 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 7.1 MiB/s wr, 622 op/s 2024-09-19T09:34:35.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:34 smithi191 ceph-mon[34834]: mgrmap e20: smithi112.puhuua(active, since 6m), standbys: smithi191.xjpplx 2024-09-19T09:34:35.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:34 smithi191 ceph-mon[34834]: pgmap v238: 65 pgs: 65 active+clean; 100 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 7.1 MiB/s wr, 622 op/s 2024-09-19T09:34:37.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:36 smithi112 ceph-mon[27605]: pgmap v239: 65 pgs: 65 active+clean; 100 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 620 op/s 2024-09-19T09:34:37.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:36 smithi191 ceph-mon[34834]: pgmap v239: 65 pgs: 65 active+clean; 100 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 620 op/s 2024-09-19T09:34:39.133 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:38 smithi191 ceph-mon[34834]: pgmap v240: 65 pgs: 65 active+clean; 107 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 629 op/s 2024-09-19T09:34:39.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:38 smithi112 ceph-mon[27605]: pgmap v240: 65 pgs: 65 active+clean; 107 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 629 op/s 2024-09-19T09:34:41.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:40 smithi112 ceph-mon[27605]: pgmap v241: 65 pgs: 65 active+clean; 120 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 511 op/s 2024-09-19T09:34:41.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:40 smithi191 ceph-mon[34834]: pgmap v241: 65 pgs: 65 active+clean; 120 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 511 op/s 2024-09-19T09:34:42.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:42.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:42.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:42.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:42.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:42.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:42.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr fail", "who": "smithi112.puhuua"}]: dispatch 2024-09-19T09:34:42.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: Activating manager daemon smithi191.xjpplx 2024-09-19T09:34:42.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: osdmap e46: 6 total, 6 up, 6 in 2024-09-19T09:34:42.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "mgr fail", "who": "smithi112.puhuua"}]': finished 2024-09-19T09:34:42.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: mgrmap e21: smithi191.xjpplx(active, starting, since 0.00754376s) 2024-09-19T09:34:42.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:34:42.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:34:42.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.hcoxjz"}]: dispatch 2024-09-19T09:34:42.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:34:42.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.qweljt"}]: dispatch 2024-09-19T09:34:42.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.jjldod"}]: dispatch 2024-09-19T09:34:42.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mgr metadata", "who": "smithi191.xjpplx", "id": "smithi191.xjpplx"}]: dispatch 2024-09-19T09:34:42.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:34:42.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:34:42.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:34:42.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:34:42.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:34:42.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:34:42.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:34:42.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:34:42.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:34:42.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: Manager daemon smithi191.xjpplx is now available 2024-09-19T09:34:42.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:42.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:42.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:42.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:42.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:34:42.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi191.xjpplx/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:34:42.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi191.xjpplx/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:34:42.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi191.xjpplx/trash_purge_schedule"}]: dispatch 2024-09-19T09:34:42.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:42 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi191.xjpplx/trash_purge_schedule"}]: dispatch 2024-09-19T09:34:43.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:43.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:43.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:43.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:43.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' 2024-09-19T09:34:43.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:43.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr fail", "who": "smithi112.puhuua"}]: dispatch 2024-09-19T09:34:43.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: Activating manager daemon smithi191.xjpplx 2024-09-19T09:34:43.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: osdmap e46: 6 total, 6 up, 6 in 2024-09-19T09:34:43.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.14206 172.21.15.112:0/2419159238' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "mgr fail", "who": "smithi112.puhuua"}]': finished 2024-09-19T09:34:43.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: mgrmap e21: smithi191.xjpplx(active, starting, since 0.00754376s) 2024-09-19T09:34:43.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:34:43.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:34:43.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.hcoxjz"}]: dispatch 2024-09-19T09:34:43.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:34:43.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.qweljt"}]: dispatch 2024-09-19T09:34:43.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.jjldod"}]: dispatch 2024-09-19T09:34:43.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mgr metadata", "who": "smithi191.xjpplx", "id": "smithi191.xjpplx"}]: dispatch 2024-09-19T09:34:43.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:34:43.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:34:43.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:34:43.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:34:43.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:34:43.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:34:43.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:34:43.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:34:43.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:34:43.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: Manager daemon smithi191.xjpplx is now available 2024-09-19T09:34:43.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:43.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:43.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:43.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:43.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:34:43.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi191.xjpplx/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:34:43.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi191.xjpplx/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:34:43.038 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi191.xjpplx/trash_purge_schedule"}]: dispatch 2024-09-19T09:34:43.038 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:42 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi191.xjpplx/trash_purge_schedule"}]: dispatch 2024-09-19T09:34:44.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:43 smithi191 ceph-mon[34834]: Checking for cert/key for grafana.smithi112 2024-09-19T09:34:44.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:43 smithi191 ceph-mon[34834]: Migrating grafana.smithi112 cert to cert store 2024-09-19T09:34:44.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:43 smithi191 ceph-mon[34834]: Migrating grafana.smithi112 key to cert store 2024-09-19T09:34:44.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:43 smithi191 ceph-mon[34834]: mgrmap e22: smithi191.xjpplx(active, since 1.01014s) 2024-09-19T09:34:44.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:43 smithi191 ceph-mon[34834]: pgmap v3: 65 pgs: 65 active+clean; 163 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:34:44.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:43 smithi191 ceph-mon[34834]: Deploying cephadm binary to smithi191 2024-09-19T09:34:44.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:43 smithi191 ceph-mon[34834]: Deploying cephadm binary to smithi112 2024-09-19T09:34:44.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:43 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:44.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:43 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:44.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:43 smithi112 ceph-mon[27605]: Checking for cert/key for grafana.smithi112 2024-09-19T09:34:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:43 smithi112 ceph-mon[27605]: Migrating grafana.smithi112 cert to cert store 2024-09-19T09:34:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:43 smithi112 ceph-mon[27605]: Migrating grafana.smithi112 key to cert store 2024-09-19T09:34:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:43 smithi112 ceph-mon[27605]: mgrmap e22: smithi191.xjpplx(active, since 1.01014s) 2024-09-19T09:34:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:43 smithi112 ceph-mon[27605]: pgmap v3: 65 pgs: 65 active+clean; 163 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:34:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:43 smithi112 ceph-mon[27605]: Deploying cephadm binary to smithi191 2024-09-19T09:34:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:43 smithi112 ceph-mon[27605]: Deploying cephadm binary to smithi112 2024-09-19T09:34:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:43 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:43 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:45.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:44 smithi191 ceph-mon[34834]: [19/Sep/2024:09:34:43] ENGINE Bus STARTING 2024-09-19T09:34:45.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:44 smithi191 ceph-mon[34834]: pgmap v4: 65 pgs: 65 active+clean; 163 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:34:45.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:44 smithi191 ceph-mon[34834]: [19/Sep/2024:09:34:43] ENGINE Serving on http://172.21.15.191:8765 2024-09-19T09:34:45.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:44 smithi191 ceph-mon[34834]: mgrmap e23: smithi191.xjpplx(active, since 2s) 2024-09-19T09:34:45.088 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:44 smithi112 ceph-mon[27605]: [19/Sep/2024:09:34:43] ENGINE Bus STARTING 2024-09-19T09:34:45.088 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:44 smithi112 ceph-mon[27605]: pgmap v4: 65 pgs: 65 active+clean; 163 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:34:45.088 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:44 smithi112 ceph-mon[27605]: [19/Sep/2024:09:34:43] ENGINE Serving on http://172.21.15.191:8765 2024-09-19T09:34:45.088 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:44 smithi112 ceph-mon[27605]: mgrmap e23: smithi191.xjpplx(active, since 2s) 2024-09-19T09:34:45.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:45 smithi112 ceph-mon[27605]: [19/Sep/2024:09:34:43] ENGINE Serving on https://172.21.15.191:7150 2024-09-19T09:34:45.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:45 smithi112 ceph-mon[27605]: [19/Sep/2024:09:34:43] ENGINE Bus STARTED 2024-09-19T09:34:45.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:45 smithi112 ceph-mon[27605]: [19/Sep/2024:09:34:43] ENGINE Error in HTTPServer.serve 2024-09-19T09:34:45.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Traceback (most recent call last): 2024-09-19T09:34:45.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:34:45.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:34:45.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:34:45.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._run(expiration_interval) 2024-09-19T09:34:45.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:34:45.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:34:45.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:34:45.889 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:34:45.889 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:34:45.889 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s = self.context.wrap_socket( 2024-09-19T09:34:45.889 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:34:45.889 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: return self.sslsocket_class._create( 2024-09-19T09:34:45.889 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:34:45.889 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self.do_handshake() 2024-09-19T09:34:45.889 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:34:45.889 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._sslobj.do_handshake() 2024-09-19T09:34:45.889 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:34:46.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:45 smithi191 ceph-mon[34834]: [19/Sep/2024:09:34:43] ENGINE Serving on https://172.21.15.191:7150 2024-09-19T09:34:46.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:45 smithi191 ceph-mon[34834]: [19/Sep/2024:09:34:43] ENGINE Bus STARTED 2024-09-19T09:34:46.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:45 smithi191 ceph-mon[34834]: [19/Sep/2024:09:34:43] ENGINE Error in HTTPServer.serve 2024-09-19T09:34:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Traceback (most recent call last): 2024-09-19T09:34:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:34:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:34:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:34:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: self._run(expiration_interval) 2024-09-19T09:34:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:34:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:34:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:34:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:34:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:34:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: s = self.context.wrap_socket( 2024-09-19T09:34:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:34:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: return self.sslsocket_class._create( 2024-09-19T09:34:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:34:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: self.do_handshake() 2024-09-19T09:34:46.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:34:46.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: self._sslobj.do_handshake() 2024-09-19T09:34:46.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:34:46.832 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:46 smithi112 ceph-mon[27605]: pgmap v5: 65 pgs: 65 active+clean; 163 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:34:46.833 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:46 smithi112 ceph-mon[27605]: mgrmap e24: smithi191.xjpplx(active, since 4s) 2024-09-19T09:34:47.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:46 smithi191 ceph-mon[34834]: pgmap v5: 65 pgs: 65 active+clean; 163 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:34:47.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:46 smithi191 ceph-mon[34834]: mgrmap e24: smithi191.xjpplx(active, since 4s) 2024-09-19T09:34:47.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:47 smithi112 ceph-mon[27605]: Standby manager daemon smithi112.puhuua started 2024-09-19T09:34:47.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:47 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.112:0/2443730992' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.puhuua/crt"}]: dispatch 2024-09-19T09:34:47.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:47 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.112:0/2443730992' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:34:47.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:47 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.112:0/2443730992' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.puhuua/key"}]: dispatch 2024-09-19T09:34:47.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:47 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.112:0/2443730992' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:34:48.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:47 smithi191 ceph-mon[34834]: Standby manager daemon smithi112.puhuua started 2024-09-19T09:34:48.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:47 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.112:0/2443730992' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.puhuua/crt"}]: dispatch 2024-09-19T09:34:48.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:47 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.112:0/2443730992' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:34:48.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:47 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.112:0/2443730992' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.puhuua/key"}]: dispatch 2024-09-19T09:34:48.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:47 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.112:0/2443730992' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:34:49.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:48 smithi191 ceph-mon[34834]: pgmap v6: 65 pgs: 65 active+clean; 163 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-19T09:34:49.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:48 smithi191 ceph-mon[34834]: mgrmap e25: smithi191.xjpplx(active, since 6s), standbys: smithi112.puhuua 2024-09-19T09:34:49.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:48 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mgr metadata", "who": "smithi112.puhuua", "id": "smithi112.puhuua"}]: dispatch 2024-09-19T09:34:49.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:48 smithi112 ceph-mon[27605]: pgmap v6: 65 pgs: 65 active+clean; 163 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-19T09:34:49.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:48 smithi112 ceph-mon[27605]: mgrmap e25: smithi191.xjpplx(active, since 6s), standbys: smithi112.puhuua 2024-09-19T09:34:49.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:48 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mgr metadata", "who": "smithi112.puhuua", "id": "smithi112.puhuua"}]: dispatch 2024-09-19T09:34:49.213 INFO:tasks.workunit.client.1.smithi191.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-19T09:34:49.229 INFO:tasks.workunit.client.1.smithi191.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-19T09:34:49.229 INFO:tasks.workunit.client.1.smithi191.stderr:+ make 2024-09-19T09:34:50.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:50 smithi112 ceph-mon[27605]: pgmap v7: 65 pgs: 65 active+clean; 178 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 37 op/s 2024-09-19T09:34:50.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:50 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:50.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:50 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:51.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:50 smithi191 ceph-mon[34834]: pgmap v7: 65 pgs: 65 active+clean; 178 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 37 op/s 2024-09-19T09:34:51.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:50 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:51.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:50 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:51.443 INFO:tasks.workunit.client.1.smithi191.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-19T09:34:52.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:51 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:52.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:51 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:52.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:51 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:52.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:51 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:52.204 INFO:tasks.workunit.client.0.smithi112.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-19T09:34:52.205 INFO:tasks.workunit.client.0.smithi112.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T09:34:52.205 INFO:tasks.workunit.client.0.smithi112.stderr:+ make 2024-09-19T09:34:52.335 INFO:tasks.workunit.client.0.smithi112.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-19T09:34:52.581 INFO:tasks.workunit.client.1.smithi191.stderr:++ readlink -f fsstress 2024-09-19T09:34:52.582 INFO:tasks.workunit.client.1.smithi191.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-19T09:34:52.582 INFO:tasks.workunit.client.1.smithi191.stderr:+ popd 2024-09-19T09:34:52.582 INFO:tasks.workunit.client.1.smithi191.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-19T09:34:52.582 INFO:tasks.workunit.client.1.smithi191.stderr:+ popd 2024-09-19T09:34:52.583 INFO:tasks.workunit.client.1.smithi191.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-19T09:34:52.583 INFO:tasks.workunit.client.1.smithi191.stderr:++ mktemp -d -p . 2024-09-19T09:34:52.584 INFO:tasks.workunit.client.1.smithi191.stderr:+ T=./tmp.vDzb4eMtOX 2024-09-19T09:34:52.584 INFO:tasks.workunit.client.1.smithi191.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.vDzb4eMtOX -l 1 -n 1000 -p 10 -v 2024-09-19T09:34:52.585 INFO:tasks.workunit.client.1.smithi191.stdout:seed = 1726160494 2024-09-19T09:34:52.588 INFO:tasks.workunit.client.1.smithi191.stdout:1/0: stat - no entries 2024-09-19T09:34:52.588 INFO:tasks.workunit.client.1.smithi191.stdout:0/0: mkdir d0 0 2024-09-19T09:34:52.589 INFO:tasks.workunit.client.1.smithi191.stdout:0/1: dread - no filename 2024-09-19T09:34:52.589 INFO:tasks.workunit.client.1.smithi191.stdout:0/2: write - no filename 2024-09-19T09:34:52.589 INFO:tasks.workunit.client.1.smithi191.stdout:0/3: chown d0 115419404 1 2024-09-19T09:34:52.589 INFO:tasks.workunit.client.1.smithi191.stdout:0/4: dwrite - no filename 2024-09-19T09:34:52.589 INFO:tasks.workunit.client.1.smithi191.stdout:0/5: rename d0 to d0/d1 22 2024-09-19T09:34:52.589 INFO:tasks.workunit.client.1.smithi191.stdout:0/6: stat d0 0 2024-09-19T09:34:52.589 INFO:tasks.workunit.client.1.smithi191.stdout:0/7: unlink - no file 2024-09-19T09:34:52.589 INFO:tasks.workunit.client.1.smithi191.stdout:0/8: fdatasync - no filename 2024-09-19T09:34:52.589 INFO:tasks.workunit.client.1.smithi191.stdout:0/9: readlink - no filename 2024-09-19T09:34:52.590 INFO:tasks.workunit.client.1.smithi191.stdout:2/0: dwrite - no filename 2024-09-19T09:34:52.590 INFO:tasks.workunit.client.1.smithi191.stdout:1/1: creat f0 x:0 0 0 2024-09-19T09:34:52.590 INFO:tasks.workunit.client.1.smithi191.stdout:0/10: creat d0/f2 x:0 0 0 2024-09-19T09:34:52.590 INFO:tasks.workunit.client.1.smithi191.stdout:0/11: write d0/f2 [495400,99671] 0 2024-09-19T09:34:52.590 INFO:tasks.workunit.client.1.smithi191.stdout:0/12: creat d0/f3 x:0 0 0 2024-09-19T09:34:52.591 INFO:tasks.workunit.client.1.smithi191.stdout:0/13: read d0/f2 [137,8630] 0 2024-09-19T09:34:52.591 INFO:tasks.workunit.client.1.smithi191.stdout:2/1: creat f0 x:0 0 0 2024-09-19T09:34:52.591 INFO:tasks.workunit.client.1.smithi191.stdout:2/2: readlink - no filename 2024-09-19T09:34:52.592 INFO:tasks.workunit.client.1.smithi191.stdout:1/2: mknod c1 0 2024-09-19T09:34:52.592 INFO:tasks.workunit.client.1.smithi191.stdout:1/3: creat f2 x:0 0 0 2024-09-19T09:34:52.593 INFO:tasks.workunit.client.1.smithi191.stdout:4/0: write - no filename 2024-09-19T09:34:52.593 INFO:tasks.workunit.client.1.smithi191.stdout:4/1: read - no filename 2024-09-19T09:34:52.593 INFO:tasks.workunit.client.1.smithi191.stdout:4/2: dread - no filename 2024-09-19T09:34:52.593 INFO:tasks.workunit.client.1.smithi191.stdout:4/3: write - no filename 2024-09-19T09:34:52.593 INFO:tasks.workunit.client.1.smithi191.stdout:4/4: getdents . 0 2024-09-19T09:34:52.593 INFO:tasks.workunit.client.1.smithi191.stdout:4/5: write - no filename 2024-09-19T09:34:52.594 INFO:tasks.workunit.client.1.smithi191.stdout:4/6: read - no filename 2024-09-19T09:34:52.594 INFO:tasks.workunit.client.1.smithi191.stdout:4/7: write - no filename 2024-09-19T09:34:52.594 INFO:tasks.workunit.client.1.smithi191.stdout:3/0: mknod c0 0 2024-09-19T09:34:52.594 INFO:tasks.workunit.client.1.smithi191.stdout:3/1: truncate - no filename 2024-09-19T09:34:52.594 INFO:tasks.workunit.client.1.smithi191.stdout:3/2: write - no filename 2024-09-19T09:34:52.594 INFO:tasks.workunit.client.1.smithi191.stdout:3/3: truncate - no filename 2024-09-19T09:34:52.594 INFO:tasks.workunit.client.1.smithi191.stdout:3/4: truncate - no filename 2024-09-19T09:34:52.596 INFO:tasks.workunit.client.1.smithi191.stdout:2/3: symlink l1 0 2024-09-19T09:34:52.596 INFO:tasks.workunit.client.1.smithi191.stdout:2/4: creat f2 x:0 0 0 2024-09-19T09:34:52.596 INFO:tasks.workunit.client.1.smithi191.stdout:2/5: dread - f0 zero size 2024-09-19T09:34:52.596 INFO:tasks.workunit.client.1.smithi191.stdout:1/4: mkdir d3 0 2024-09-19T09:34:52.596 INFO:tasks.workunit.client.1.smithi191.stdout:1/5: write f2 [143008,69323] 0 2024-09-19T09:34:52.596 INFO:tasks.workunit.client.1.smithi191.stdout:1/6: chown f2 822 1 2024-09-19T09:34:52.596 INFO:tasks.workunit.client.1.smithi191.stdout:5/0: write - no filename 2024-09-19T09:34:52.596 INFO:tasks.workunit.client.1.smithi191.stdout:5/1: dwrite - no filename 2024-09-19T09:34:52.596 INFO:tasks.workunit.client.1.smithi191.stdout:0/14: dread d0/f2 [0,4194304] 0 2024-09-19T09:34:52.596 INFO:tasks.workunit.client.1.smithi191.stdout:4/8: creat f0 x:0 0 0 2024-09-19T09:34:52.596 INFO:tasks.workunit.client.1.smithi191.stdout:0/15: creat d0/f4 x:0 0 0 2024-09-19T09:34:52.597 INFO:tasks.workunit.client.1.smithi191.stdout:4/9: dread - f0 zero size 2024-09-19T09:34:52.597 INFO:tasks.workunit.client.1.smithi191.stdout:4/10: creat f1 x:0 0 0 2024-09-19T09:34:52.597 INFO:tasks.workunit.client.1.smithi191.stdout:3/5: rename c0 to c1 0 2024-09-19T09:34:52.597 INFO:tasks.workunit.client.1.smithi191.stdout:2/6: mknod c3 0 2024-09-19T09:34:52.598 INFO:tasks.workunit.client.1.smithi191.stdout:2/7: write f2 [429743,106145] 0 2024-09-19T09:34:52.598 INFO:tasks.workunit.client.1.smithi191.stdout:2/8: readlink l1 0 2024-09-19T09:34:52.598 INFO:tasks.workunit.client.1.smithi191.stdout:1/7: creat d3/f4 x:0 0 0 2024-09-19T09:34:52.599 INFO:tasks.workunit.client.1.smithi191.stdout:5/2: mkdir d0 0 2024-09-19T09:34:52.600 INFO:tasks.workunit.client.1.smithi191.stdout:0/16: mkdir d0/d5 0 2024-09-19T09:34:52.600 INFO:tasks.workunit.client.1.smithi191.stdout:0/17: truncate d0/f2 739746 0 2024-09-19T09:34:52.602 INFO:tasks.workunit.client.1.smithi191.stdout:5/3: mkdir d0/d1 0 2024-09-19T09:34:52.602 INFO:tasks.workunit.client.1.smithi191.stdout:5/4: fdatasync - no filename 2024-09-19T09:34:52.615 INFO:tasks.workunit.client.1.smithi191.stdout:4/11: dwrite f0 [0,4194304] 0 2024-09-19T09:34:52.615 INFO:tasks.workunit.client.1.smithi191.stdout:4/12: creat f2 x:0 0 0 2024-09-19T09:34:52.615 INFO:tasks.workunit.client.1.smithi191.stdout:4/13: chown f0 88503 1 2024-09-19T09:34:52.615 INFO:tasks.workunit.client.1.smithi191.stdout:5/5: dread - no filename 2024-09-19T09:34:52.615 INFO:tasks.workunit.client.1.smithi191.stdout:7/0: link - no file 2024-09-19T09:34:52.615 INFO:tasks.workunit.client.1.smithi191.stdout:8/0: dwrite - no filename 2024-09-19T09:34:52.615 INFO:tasks.workunit.client.1.smithi191.stdout:8/1: dwrite - no filename 2024-09-19T09:34:52.620 INFO:tasks.workunit.client.1.smithi191.stdout:4/14: mknod c3 0 2024-09-19T09:34:52.620 INFO:tasks.workunit.client.1.smithi191.stdout:4/15: write f2 [585864,62444] 0 2024-09-19T09:34:52.620 INFO:tasks.workunit.client.1.smithi191.stdout:4/16: creat f4 x:0 0 0 2024-09-19T09:34:52.620 INFO:tasks.workunit.client.1.smithi191.stdout:4/17: read f2 [548404,115424] 0 2024-09-19T09:34:52.620 INFO:tasks.workunit.client.1.smithi191.stdout:4/18: chown c3 0 1 2024-09-19T09:34:52.621 INFO:tasks.workunit.client.1.smithi191.stdout:5/6: creat d0/d1/f2 x:0 0 0 2024-09-19T09:34:52.622 INFO:tasks.workunit.client.1.smithi191.stdout:5/7: write d0/d1/f2 [364919,128082] 0 2024-09-19T09:34:52.623 INFO:tasks.workunit.client.1.smithi191.stdout:9/0: creat f0 x:0 0 0 2024-09-19T09:34:52.623 INFO:tasks.workunit.client.1.smithi191.stdout:9/1: creat f1 x:0 0 0 2024-09-19T09:34:52.623 INFO:tasks.workunit.client.1.smithi191.stdout:9/2: write f0 [984910,130430] 0 2024-09-19T09:34:52.623 INFO:tasks.workunit.client.1.smithi191.stdout:9/3: write f0 [2107962,106144] 0 2024-09-19T09:34:52.623 INFO:tasks.workunit.client.1.smithi191.stdout:9/4: chown f1 1814 1 2024-09-19T09:34:52.623 INFO:tasks.workunit.client.1.smithi191.stdout:9/5: creat f2 x:0 0 0 2024-09-19T09:34:52.624 INFO:tasks.workunit.client.1.smithi191.stdout:6/0: symlink l0 0 2024-09-19T09:34:52.624 INFO:tasks.workunit.client.1.smithi191.stdout:6/1: dwrite - no filename 2024-09-19T09:34:52.624 INFO:tasks.workunit.client.1.smithi191.stdout:6/2: read - no filename 2024-09-19T09:34:52.624 INFO:tasks.workunit.client.1.smithi191.stdout:6/3: truncate - no filename 2024-09-19T09:34:52.624 INFO:tasks.workunit.client.1.smithi191.stdout:6/4: chown l0 3557 1 2024-09-19T09:34:52.625 INFO:tasks.workunit.client.1.smithi191.stdout:6/5: dread - no filename 2024-09-19T09:34:52.625 INFO:tasks.workunit.client.1.smithi191.stdout:6/6: dwrite - no filename 2024-09-19T09:34:52.625 INFO:tasks.workunit.client.1.smithi191.stdout:7/1: symlink l0 0 2024-09-19T09:34:52.627 INFO:tasks.workunit.client.1.smithi191.stdout:8/2: creat f0 x:0 0 0 2024-09-19T09:34:52.630 INFO:tasks.workunit.client.1.smithi191.stdout:5/8: rename d0/d1/f2 to d0/d1/f3 0 2024-09-19T09:34:52.633 INFO:tasks.workunit.client.1.smithi191.stdout:2/9: dwrite f2 [0,4194304] 0 2024-09-19T09:34:52.635 INFO:tasks.workunit.client.1.smithi191.stdout:0/18: dwrite d0/f4 [0,4194304] 0 2024-09-19T09:34:52.635 INFO:tasks.workunit.client.1.smithi191.stdout:0/19: write d0/f2 [1590177,24104] 0 2024-09-19T09:34:52.636 INFO:tasks.workunit.client.1.smithi191.stdout:3/6: rename c1 to c2 0 2024-09-19T09:34:52.636 INFO:tasks.workunit.client.1.smithi191.stdout:3/7: write - no filename 2024-09-19T09:34:52.636 INFO:tasks.workunit.client.1.smithi191.stdout:7/2: mknod c1 0 2024-09-19T09:34:52.637 INFO:tasks.workunit.client.1.smithi191.stdout:8/3: mkdir d1 0 2024-09-19T09:34:52.638 INFO:tasks.workunit.client.1.smithi191.stdout:8/4: chown f0 3 1 2024-09-19T09:34:52.641 INFO:tasks.workunit.client.1.smithi191.stdout:0/20: dread d0/f2 [0,4194304] 0 2024-09-19T09:34:52.641 INFO:tasks.workunit.client.1.smithi191.stdout:0/21: chown d0/f2 16 1 2024-09-19T09:34:52.641 INFO:tasks.workunit.client.1.smithi191.stdout:0/22: chown d0 316658276 1 2024-09-19T09:34:52.641 INFO:tasks.workunit.client.1.smithi191.stdout:0/23: truncate d0/f2 1798878 0 2024-09-19T09:34:52.641 INFO:tasks.workunit.client.1.smithi191.stdout:0/24: chown d0/d5 3 1 2024-09-19T09:34:52.647 INFO:tasks.workunit.client.1.smithi191.stdout:3/8: symlink l3 0 2024-09-19T09:34:52.647 INFO:tasks.workunit.client.1.smithi191.stdout:3/9: write - no filename 2024-09-19T09:34:52.648 INFO:tasks.workunit.client.1.smithi191.stdout:7/3: mkdir d2 0 2024-09-19T09:34:52.649 INFO:tasks.workunit.client.1.smithi191.stdout:7/4: chown c1 403 1 2024-09-19T09:34:52.651 INFO:tasks.workunit.client.1.smithi191.stdout:8/5: unlink f0 0 2024-09-19T09:34:52.651 INFO:tasks.workunit.client.1.smithi191.stdout:8/6: dread - no filename 2024-09-19T09:34:52.651 INFO:tasks.workunit.client.1.smithi191.stdout:8/7: stat d1 0 2024-09-19T09:34:52.652 INFO:tasks.workunit.client.1.smithi191.stdout:7/5: symlink d2/l3 0 2024-09-19T09:34:52.652 INFO:tasks.workunit.client.1.smithi191.stdout:7/6: chown d2 4 1 2024-09-19T09:34:52.653 INFO:tasks.workunit.client.1.smithi191.stdout:4/19: truncate f0 3043569 0 2024-09-19T09:34:52.654 INFO:tasks.workunit.client.1.smithi191.stdout:8/8: creat d1/f2 x:0 0 0 2024-09-19T09:34:52.654 INFO:tasks.workunit.client.1.smithi191.stdout:8/9: dread - d1/f2 zero size 2024-09-19T09:34:52.654 INFO:tasks.workunit.client.1.smithi191.stdout:8/10: dread - d1/f2 zero size 2024-09-19T09:34:52.655 INFO:tasks.workunit.client.1.smithi191.stdout:7/7: rename c1 to d2/c4 0 2024-09-19T09:34:52.656 INFO:tasks.workunit.client.1.smithi191.stdout:4/20: mkdir d5 0 2024-09-19T09:34:52.657 INFO:tasks.workunit.client.1.smithi191.stdout:7/8: mknod d2/c5 0 2024-09-19T09:34:52.657 INFO:tasks.workunit.client.1.smithi191.stdout:7/9: chown d2/c4 4 1 2024-09-19T09:34:52.658 INFO:tasks.workunit.client.1.smithi191.stdout:4/21: creat d5/f6 x:0 0 0 2024-09-19T09:34:52.658 INFO:tasks.workunit.client.1.smithi191.stdout:5/9: dwrite d0/d1/f3 [0,4194304] 0 2024-09-19T09:34:52.662 INFO:tasks.workunit.client.1.smithi191.stdout:9/6: getdents . 0 2024-09-19T09:34:52.662 INFO:tasks.workunit.client.1.smithi191.stdout:9/7: write f2 [303920,120136] 0 2024-09-19T09:34:52.662 INFO:tasks.workunit.client.1.smithi191.stdout:9/8: stat f0 0 2024-09-19T09:34:52.663 INFO:tasks.workunit.client.1.smithi191.stdout:3/10: rename c2 to c4 0 2024-09-19T09:34:52.663 INFO:tasks.workunit.client.1.smithi191.stdout:3/11: dread - no filename 2024-09-19T09:34:52.665 INFO:tasks.workunit.client.1.smithi191.stdout:3/12: symlink l5 0 2024-09-19T09:34:52.665 INFO:tasks.workunit.client.1.smithi191.stdout:3/13: dwrite - no filename 2024-09-19T09:34:52.665 INFO:tasks.workunit.client.1.smithi191.stdout:3/14: chown c4 343 1 2024-09-19T09:34:52.665 INFO:tasks.workunit.client.1.smithi191.stdout:3/15: dread - no filename 2024-09-19T09:34:52.665 INFO:tasks.workunit.client.1.smithi191.stdout:3/16: write - no filename 2024-09-19T09:34:52.665 INFO:tasks.workunit.client.1.smithi191.stdout:3/17: chown l3 13043 1 2024-09-19T09:34:52.665 INFO:tasks.workunit.client.1.smithi191.stdout:3/18: stat l3 0 2024-09-19T09:34:52.665 INFO:tasks.workunit.client.1.smithi191.stdout:3/19: dwrite - no filename 2024-09-19T09:34:52.666 INFO:tasks.workunit.client.1.smithi191.stdout:3/20: link l5 l6 0 2024-09-19T09:34:52.667 INFO:tasks.workunit.client.1.smithi191.stdout:3/21: creat f7 x:0 0 0 2024-09-19T09:34:52.676 INFO:tasks.workunit.client.1.smithi191.stdout:5/10: dread d0/d1/f3 [0,4194304] 0 2024-09-19T09:34:52.684 INFO:tasks.workunit.client.1.smithi191.stdout:3/22: dwrite f7 [0,4194304] 0 2024-09-19T09:34:52.715 INFO:tasks.workunit.client.1.smithi191.stdout:2/10: dwrite f0 [0,4194304] 0 2024-09-19T09:34:52.715 INFO:tasks.workunit.client.1.smithi191.stdout:2/11: chown l1 299729299 1 2024-09-19T09:34:52.718 INFO:tasks.workunit.client.1.smithi191.stdout:2/12: mknod c4 0 2024-09-19T09:34:52.718 INFO:tasks.workunit.client.1.smithi191.stdout:2/13: fsync f0 0 2024-09-19T09:34:52.720 INFO:tasks.workunit.client.1.smithi191.stdout:5/11: truncate d0/d1/f3 2697629 0 2024-09-19T09:34:52.721 INFO:tasks.workunit.client.1.smithi191.stdout:0/25: dwrite d0/f4 [0,4194304] 0 2024-09-19T09:34:52.721 INFO:tasks.workunit.client.1.smithi191.stdout:0/26: read d0/f2 [659381,84827] 0 2024-09-19T09:34:52.722 INFO:tasks.workunit.client.1.smithi191.stdout:0/27: write d0/f4 [5115644,19518] 0 2024-09-19T09:34:52.722 INFO:tasks.workunit.client.1.smithi191.stdout:3/23: getdents . 0 2024-09-19T09:34:52.722 INFO:tasks.workunit.client.1.smithi191.stdout:3/24: rmdir - no directory 2024-09-19T09:34:52.724 INFO:tasks.workunit.client.1.smithi191.stdout:3/25: mknod c8 0 2024-09-19T09:34:52.726 INFO:tasks.workunit.client.1.smithi191.stdout:3/26: creat f9 x:0 0 0 2024-09-19T09:34:52.726 INFO:tasks.workunit.client.1.smithi191.stdout:3/27: truncate f7 4240211 0 2024-09-19T09:34:52.726 INFO:tasks.workunit.client.1.smithi191.stdout:3/28: rmdir - no directory 2024-09-19T09:34:52.728 INFO:tasks.workunit.client.1.smithi191.stdout:3/29: mknod ca 0 2024-09-19T09:34:52.729 INFO:tasks.workunit.client.1.smithi191.stdout:2/14: dread f0 [0,4194304] 0 2024-09-19T09:34:52.729 INFO:tasks.workunit.client.1.smithi191.stdout:2/15: chown f0 29835 1 2024-09-19T09:34:52.731 INFO:tasks.workunit.client.1.smithi191.stdout:3/30: link l5 lb 0 2024-09-19T09:34:52.731 INFO:tasks.workunit.client.1.smithi191.stdout:0/28: write d0/f4 [1331004,50675] 0 2024-09-19T09:34:52.732 INFO:tasks.workunit.client.1.smithi191.stdout:0/29: rename d0/f2 to d0/d5/f6 0 2024-09-19T09:34:52.732 INFO:tasks.workunit.client.1.smithi191.stdout:8/11: dwrite d1/f2 [0,4194304] 0 2024-09-19T09:34:52.732 INFO:tasks.workunit.client.1.smithi191.stdout:3/31: symlink lc 0 2024-09-19T09:34:52.734 INFO:tasks.workunit.client.1.smithi191.stdout:0/30: mknod d0/d5/c7 0 2024-09-19T09:34:52.734 INFO:tasks.workunit.client.1.smithi191.stdout:0/31: creat d0/f8 x:0 0 0 2024-09-19T09:34:52.736 INFO:tasks.workunit.client.1.smithi191.stdout:8/12: mkdir d1/d3 0 2024-09-19T09:34:52.737 INFO:tasks.workunit.client.1.smithi191.stdout:8/13: rmdir d1/d3 0 2024-09-19T09:34:52.738 INFO:tasks.workunit.client.1.smithi191.stdout:4/22: dwrite f0 [0,4194304] 0 2024-09-19T09:34:52.742 INFO:tasks.workunit.client.1.smithi191.stdout:4/23: mkdir d5/d7 0 2024-09-19T09:34:52.742 INFO:tasks.workunit.client.1.smithi191.stdout:2/16: getdents . 0 2024-09-19T09:34:52.742 INFO:tasks.workunit.client.1.smithi191.stdout:4/24: creat d5/f8 x:0 0 0 2024-09-19T09:34:52.744 INFO:tasks.workunit.client.1.smithi191.stdout:3/32: write f7 [3303458,4092] 0 2024-09-19T09:34:52.746 INFO:tasks.workunit.client.1.smithi191.stdout:4/25: mkdir d5/d9 0 2024-09-19T09:34:52.746 INFO:tasks.workunit.client.1.smithi191.stdout:4/26: creat d5/fa x:0 0 0 2024-09-19T09:34:52.746 INFO:tasks.workunit.client.1.smithi191.stdout:4/27: truncate f1 456710 0 2024-09-19T09:34:52.747 INFO:tasks.workunit.client.1.smithi191.stdout:3/33: creat fd x:0 0 0 2024-09-19T09:34:52.750 INFO:tasks.workunit.client.1.smithi191.stdout:4/28: link c3 d5/d7/cb 0 2024-09-19T09:34:52.751 INFO:tasks.workunit.client.1.smithi191.stdout:4/29: dread - d5/fa zero size 2024-09-19T09:34:52.754 INFO:tasks.workunit.client.1.smithi191.stdout:4/30: creat d5/d9/fc x:0 0 0 2024-09-19T09:34:52.756 INFO:tasks.workunit.client.1.smithi191.stdout:4/31: mknod d5/d7/cd 0 2024-09-19T09:34:52.756 INFO:tasks.workunit.client.1.smithi191.stdout:4/32: dread - d5/d9/fc zero size 2024-09-19T09:34:52.757 INFO:tasks.workunit.client.1.smithi191.stdout:0/32: fsync d0/f8 0 2024-09-19T09:34:52.759 INFO:tasks.workunit.client.1.smithi191.stdout:0/33: rename d0/d5 to d0/d9 0 2024-09-19T09:34:52.759 INFO:tasks.workunit.client.1.smithi191.stdout:2/17: read f2 [3298568,15541] 0 2024-09-19T09:34:52.759 INFO:tasks.workunit.client.1.smithi191.stdout:0/34: chown d0/f4 55 1 2024-09-19T09:34:52.759 INFO:tasks.workunit.client.1.smithi191.stdout:0/35: readlink - no filename 2024-09-19T09:34:52.759 INFO:tasks.workunit.client.1.smithi191.stdout:2/18: write f2 [2004380,11860] 0 2024-09-19T09:34:52.759 INFO:tasks.workunit.client.1.smithi191.stdout:2/19: chown f2 289 1 2024-09-19T09:34:52.759 INFO:tasks.workunit.client.1.smithi191.stdout:2/20: getdents . 0 2024-09-19T09:34:52.761 INFO:tasks.workunit.client.1.smithi191.stdout:8/14: dwrite d1/f2 [0,4194304] 0 2024-09-19T09:34:52.761 INFO:tasks.workunit.client.1.smithi191.stdout:8/15: rename d1 to d1/d4 22 2024-09-19T09:34:52.761 INFO:tasks.workunit.client.1.smithi191.stdout:8/16: creat d1/f5 x:0 0 0 2024-09-19T09:34:52.761 INFO:tasks.workunit.client.1.smithi191.stdout:8/17: readlink - no filename 2024-09-19T09:34:52.763 INFO:tasks.workunit.client.1.smithi191.stdout:8/18: unlink d1/f2 0 2024-09-19T09:34:52.763 INFO:tasks.workunit.client.1.smithi191.stdout:8/19: rename d1 to d1/d6 22 2024-09-19T09:34:52.771 INFO:tasks.workunit.client.1.smithi191.stdout:2/21: dread f2 [0,4194304] 0 2024-09-19T09:34:52.771 INFO:tasks.workunit.client.1.smithi191.stdout:2/22: rmdir - no directory 2024-09-19T09:34:52.790 INFO:tasks.workunit.client.1.smithi191.stdout:3/34: dwrite f7 [4194304,4194304] 0 2024-09-19T09:34:52.790 INFO:tasks.workunit.client.1.smithi191.stdout:3/35: chown f7 507 1 2024-09-19T09:34:52.791 INFO:tasks.workunit.client.1.smithi191.stdout:3/36: readlink lb 0 2024-09-19T09:34:52.791 INFO:tasks.workunit.client.1.smithi191.stdout:3/37: dread - f9 zero size 2024-09-19T09:34:52.792 INFO:tasks.workunit.client.1.smithi191.stdout:5/12: dwrite d0/d1/f3 [0,4194304] 0 2024-09-19T09:34:52.793 INFO:tasks.workunit.client.1.smithi191.stdout:5/13: chown d0/d1 4 1 2024-09-19T09:34:52.793 INFO:tasks.workunit.client.1.smithi191.stdout:4/33: dwrite d5/f8 [0,4194304] 0 2024-09-19T09:34:52.793 INFO:tasks.workunit.client.1.smithi191.stdout:4/34: creat d5/fe x:0 0 0 2024-09-19T09:34:52.794 INFO:tasks.workunit.client.1.smithi191.stdout:2/23: dwrite f0 [0,4194304] 0 2024-09-19T09:34:52.800 INFO:tasks.workunit.client.1.smithi191.stdout:5/14: dread d0/d1/f3 [0,4194304] 0 2024-09-19T09:34:52.809 INFO:tasks.workunit.client.1.smithi191.stdout:4/35: symlink d5/d7/lf 0 2024-09-19T09:34:52.810 INFO:tasks.workunit.client.1.smithi191.stdout:5/15: mkdir d0/d4 0 2024-09-19T09:34:52.810 INFO:tasks.workunit.client.1.smithi191.stdout:5/16: chown d0/d1 48 1 2024-09-19T09:34:52.811 INFO:tasks.workunit.client.1.smithi191.stdout:4/36: unlink d5/d7/cd 0 2024-09-19T09:34:52.811 INFO:tasks.workunit.client.1.smithi191.stdout:4/37: chown d5/fa 174153 1 2024-09-19T09:34:52.813 INFO:tasks.workunit.client.1.smithi191.stdout:4/38: symlink d5/d9/l10 0 2024-09-19T09:34:52.814 INFO:tasks.workunit.client.1.smithi191.stdout:4/39: truncate f2 540180 0 2024-09-19T09:34:52.814 INFO:tasks.workunit.client.1.smithi191.stdout:4/40: chown f2 26446 1 2024-09-19T09:34:52.816 INFO:tasks.workunit.client.1.smithi191.stdout:4/41: rename d5/d9/fc to d5/d7/f11 0 2024-09-19T09:34:52.817 INFO:tasks.workunit.client.1.smithi191.stdout:4/42: mkdir d5/d12 0 2024-09-19T09:34:52.818 INFO:tasks.workunit.client.1.smithi191.stdout:8/20: getdents d1 0 2024-09-19T09:34:52.820 INFO:tasks.workunit.client.1.smithi191.stdout:8/21: mkdir d1/d7 0 2024-09-19T09:34:52.822 INFO:tasks.workunit.client.1.smithi191.stdout:8/22: unlink d1/f5 0 2024-09-19T09:34:52.822 INFO:tasks.workunit.client.1.smithi191.stdout:8/23: link - no file 2024-09-19T09:34:52.825 INFO:tasks.workunit.client.1.smithi191.stdout:2/24: truncate f0 1930301 0 2024-09-19T09:34:52.828 INFO:tasks.workunit.client.1.smithi191.stdout:5/17: dwrite d0/d1/f3 [0,4194304] 0 2024-09-19T09:34:52.828 INFO:tasks.workunit.client.1.smithi191.stdout:5/18: chown d0/d4 2567 1 2024-09-19T09:34:52.829 INFO:tasks.workunit.client.1.smithi191.stdout:4/43: getdents d5/d9 0 2024-09-19T09:34:52.829 INFO:tasks.workunit.client.1.smithi191.stdout:4/44: fsync f1 0 2024-09-19T09:34:52.830 INFO:tasks.workunit.client.1.smithi191.stdout:5/19: mknod d0/c5 0 2024-09-19T09:34:52.830 INFO:tasks.workunit.client.1.smithi191.stdout:2/25: dread f2 [0,4194304] 0 2024-09-19T09:34:52.830 INFO:tasks.workunit.client.1.smithi191.stdout:5/20: fdatasync d0/d1/f3 0 2024-09-19T09:34:52.831 INFO:tasks.workunit.client.1.smithi191.stdout:4/45: creat d5/d9/f13 x:0 0 0 2024-09-19T09:34:52.833 INFO:tasks.workunit.client.1.smithi191.stdout:8/24: rmdir d1 39 2024-09-19T09:34:52.833 INFO:tasks.workunit.client.1.smithi191.stdout:8/25: dread - no filename 2024-09-19T09:34:52.833 INFO:tasks.workunit.client.1.smithi191.stdout:2/26: truncate f2 1369496 0 2024-09-19T09:34:52.834 INFO:tasks.workunit.client.1.smithi191.stdout:5/21: symlink d0/d4/l6 0 2024-09-19T09:34:52.836 INFO:tasks.workunit.client.1.smithi191.stdout:8/26: mkdir d1/d7/d8 0 2024-09-19T09:34:52.836 INFO:tasks.workunit.client.1.smithi191.stdout:5/22: symlink d0/d1/l7 0 2024-09-19T09:34:52.838 INFO:tasks.workunit.client.1.smithi191.stdout:4/46: rmdir d5 39 2024-09-19T09:34:52.839 INFO:tasks.workunit.client.1.smithi191.stdout:8/27: symlink d1/d7/d8/l9 0 2024-09-19T09:34:52.839 INFO:tasks.workunit.client.1.smithi191.stdout:8/28: stat d1/d7 0 2024-09-19T09:34:52.840 INFO:tasks.workunit.client.1.smithi191.stdout:5/23: mknod d0/c8 0 2024-09-19T09:34:52.842 INFO:tasks.workunit.client.1.smithi191.stdout:4/47: unlink c3 0 2024-09-19T09:34:52.843 INFO:tasks.workunit.client.1.smithi191.stdout:8/29: symlink d1/d7/d8/la 0 2024-09-19T09:34:52.844 INFO:tasks.workunit.client.1.smithi191.stdout:8/30: readlink d1/d7/d8/la 0 2024-09-19T09:34:52.844 INFO:tasks.workunit.client.1.smithi191.stdout:8/31: dread - no filename 2024-09-19T09:34:52.844 INFO:tasks.workunit.client.1.smithi191.stdout:8/32: write - no filename 2024-09-19T09:34:52.845 INFO:tasks.workunit.client.1.smithi191.stdout:4/48: mknod d5/c14 0 2024-09-19T09:34:52.845 INFO:tasks.workunit.client.1.smithi191.stdout:4/49: dread - f4 zero size 2024-09-19T09:34:52.846 INFO:tasks.workunit.client.1.smithi191.stdout:4/50: write f4 [474302,83715] 0 2024-09-19T09:34:52.846 INFO:tasks.workunit.client.1.smithi191.stdout:4/51: read f4 [38660,44391] 0 2024-09-19T09:34:52.847 INFO:tasks.workunit.client.1.smithi191.stdout:8/33: mknod d1/cb 0 2024-09-19T09:34:52.847 INFO:tasks.workunit.client.1.smithi191.stdout:8/34: dwrite - no filename 2024-09-19T09:34:52.847 INFO:tasks.workunit.client.1.smithi191.stdout:8/35: fsync - no filename 2024-09-19T09:34:52.848 INFO:tasks.workunit.client.1.smithi191.stdout:8/36: dwrite - no filename 2024-09-19T09:34:52.848 INFO:tasks.workunit.client.1.smithi191.stdout:8/37: creat d1/d7/d8/fc x:0 0 0 2024-09-19T09:34:52.848 INFO:tasks.workunit.client.1.smithi191.stdout:8/38: chown d1/d7/d8/fc 1358 1 2024-09-19T09:34:52.849 INFO:tasks.workunit.client.1.smithi191.stdout:8/39: mknod d1/d7/cd 0 2024-09-19T09:34:52.850 INFO:tasks.workunit.client.1.smithi191.stdout:8/40: creat d1/d7/fe x:0 0 0 2024-09-19T09:34:52.850 INFO:tasks.workunit.client.1.smithi191.stdout:8/41: dread - d1/d7/fe zero size 2024-09-19T09:34:52.851 INFO:tasks.workunit.client.1.smithi191.stdout:8/42: symlink d1/d7/d8/lf 0 2024-09-19T09:34:52.851 INFO:tasks.workunit.client.1.smithi191.stdout:8/43: write d1/d7/fe [254090,17714] 0 2024-09-19T09:34:52.853 INFO:tasks.workunit.client.1.smithi191.stdout:8/44: creat d1/f10 x:0 0 0 2024-09-19T09:34:52.853 INFO:tasks.workunit.client.1.smithi191.stdout:8/45: rename d1 to d1/d7/d8/d11 22 2024-09-19T09:34:52.856 INFO:tasks.workunit.client.1.smithi191.stdout:5/24: truncate d0/d1/f3 2261276 0 2024-09-19T09:34:52.867 INFO:tasks.workunit.client.1.smithi191.stdout:4/52: dwrite d5/d7/f11 [0,4194304] 0 2024-09-19T09:34:52.867 INFO:tasks.workunit.client.1.smithi191.stdout:2/27: dwrite f2 [0,4194304] 0 2024-09-19T09:34:52.869 INFO:tasks.workunit.client.1.smithi191.stdout:2/28: mknod c5 0 2024-09-19T09:34:52.870 INFO:tasks.workunit.client.1.smithi191.stdout:8/46: rmdir d1/d7 39 2024-09-19T09:34:52.870 INFO:tasks.workunit.client.1.smithi191.stdout:8/47: dread - d1/d7/d8/fc zero size 2024-09-19T09:34:52.871 INFO:tasks.workunit.client.1.smithi191.stdout:4/53: mkdir d5/d9/d15 0 2024-09-19T09:34:52.871 INFO:tasks.workunit.client.1.smithi191.stdout:4/54: chown f4 21 1 2024-09-19T09:34:52.872 INFO:tasks.workunit.client.1.smithi191.stdout:8/48: getdents d1/d7/d8 0 2024-09-19T09:34:52.872 INFO:tasks.workunit.client.1.smithi191.stdout:8/49: chown d1 6556 1 2024-09-19T09:34:52.875 INFO:tasks.workunit.client.1.smithi191.stdout:4/55: rmdir d5/d12 0 2024-09-19T09:34:52.880 INFO:tasks.workunit.client.1.smithi191.stdout:5/25: rename d0/d1 to d0/d4/d9 0 2024-09-19T09:34:52.883 INFO:tasks.workunit.client.1.smithi191.stdout:4/56: rename d5/d7/f11 to d5/d9/f16 0 2024-09-19T09:34:52.883 INFO:tasks.workunit.client.1.smithi191.stdout:4/57: write f4 [72386,10697] 0 2024-09-19T09:34:52.883 INFO:tasks.workunit.client.1.smithi191.stdout:4/58: rename d5 to d5/d9/d17 22 2024-09-19T09:34:52.884 INFO:tasks.workunit.client.1.smithi191.stdout:4/59: write f2 [1255570,70762] 0 2024-09-19T09:34:52.885 INFO:tasks.workunit.client.1.smithi191.stdout:4/60: creat d5/f18 x:0 0 0 2024-09-19T09:34:52.889 INFO:tasks.workunit.client.1.smithi191.stdout:8/50: dwrite d1/d7/d8/fc [0,4194304] 0 2024-09-19T09:34:52.889 INFO:tasks.workunit.client.1.smithi191.stdout:8/51: truncate d1/f10 57075 0 2024-09-19T09:34:52.891 INFO:tasks.workunit.client.1.smithi191.stdout:5/26: write d0/d4/d9/f3 [1605962,87381] 0 2024-09-19T09:34:52.893 INFO:tasks.workunit.client.1.smithi191.stdout:2/29: dwrite f2 [0,4194304] 0 2024-09-19T09:34:52.896 INFO:tasks.workunit.client.1.smithi191.stdout:4/61: rename d5/d7 to d5/d9/d15/d19 0 2024-09-19T09:34:52.897 INFO:tasks.workunit.client.1.smithi191.stdout:8/52: rename d1 to d1/d12 22 2024-09-19T09:34:52.897 INFO:tasks.workunit.client.1.smithi191.stdout:8/53: fdatasync d1/d7/d8/fc 0 2024-09-19T09:34:52.900 INFO:tasks.workunit.client.1.smithi191.stdout:8/54: rename d1/d7/d8/lf to d1/d7/l13 0 2024-09-19T09:34:52.902 INFO:tasks.workunit.client.1.smithi191.stdout:8/55: creat d1/f14 x:0 0 0 2024-09-19T09:34:52.902 INFO:tasks.workunit.client.1.smithi191.stdout:8/56: fdatasync d1/f14 0 2024-09-19T09:34:52.903 INFO:tasks.workunit.client.1.smithi191.stdout:4/62: rename d5/d9/l10 to d5/d9/l1a 0 2024-09-19T09:34:52.904 INFO:tasks.workunit.client.1.smithi191.stdout:4/63: fdatasync d5/f18 0 2024-09-19T09:34:52.909 INFO:tasks.workunit.client.1.smithi191.stdout:8/57: unlink d1/d7/l13 0 2024-09-19T09:34:52.919 INFO:tasks.workunit.client.1.smithi191.stdout:5/27: dwrite d0/d4/d9/f3 [0,4194304] 0 2024-09-19T09:34:52.919 INFO:tasks.workunit.client.1.smithi191.stdout:2/30: dwrite f0 [0,4194304] 0 2024-09-19T09:34:52.919 INFO:tasks.workunit.client.1.smithi191.stdout:8/58: dread d1/d7/d8/fc [0,4194304] 0 2024-09-19T09:34:52.921 INFO:tasks.workunit.client.1.smithi191.stdout:8/59: unlink d1/d7/d8/l9 0 2024-09-19T09:34:52.921 INFO:tasks.workunit.client.1.smithi191.stdout:4/64: dwrite d5/f8 [0,4194304] 0 2024-09-19T09:34:52.922 INFO:tasks.workunit.client.1.smithi191.stdout:8/60: creat d1/f15 x:0 0 0 2024-09-19T09:34:52.922 INFO:tasks.workunit.client.1.smithi191.stdout:8/61: readlink d1/d7/d8/la 0 2024-09-19T09:34:52.922 INFO:tasks.workunit.client.1.smithi191.stdout:4/65: read f1 [455985,97850] 0 2024-09-19T09:34:52.923 INFO:tasks.workunit.client.1.smithi191.stdout:4/66: mkdir d5/d1b 0 2024-09-19T09:34:52.923 INFO:tasks.workunit.client.1.smithi191.stdout:8/62: mkdir d1/d16 0 2024-09-19T09:34:52.928 INFO:tasks.workunit.client.1.smithi191.stdout:8/63: getdents d1/d7 0 2024-09-19T09:34:52.930 INFO:tasks.workunit.client.1.smithi191.stdout:4/67: dread d5/f8 [0,4194304] 0 2024-09-19T09:34:52.933 INFO:tasks.workunit.client.1.smithi191.stdout:4/68: getdents d5/d9/d15/d19 0 2024-09-19T09:34:52.941 INFO:tasks.workunit.client.1.smithi191.stdout:4/69: write f0 [71679,44407] 0 2024-09-19T09:34:52.952 INFO:tasks.workunit.client.1.smithi191.stdout:5/28: dwrite d0/d4/d9/f3 [0,4194304] 0 2024-09-19T09:34:52.953 INFO:tasks.workunit.client.1.smithi191.stdout:5/29: unlink d0/c8 0 2024-09-19T09:34:52.954 INFO:tasks.workunit.client.1.smithi191.stdout:5/30: rename d0/c5 to d0/ca 0 2024-09-19T09:34:52.954 INFO:tasks.workunit.client.1.smithi191.stdout:5/31: fsync d0/d4/d9/f3 0 2024-09-19T09:34:52.955 INFO:tasks.workunit.client.1.smithi191.stdout:5/32: creat d0/d4/d9/fb x:0 0 0 2024-09-19T09:34:52.956 INFO:tasks.workunit.client.1.smithi191.stdout:5/33: rename d0/d4/d9 to d0/d4/d9/dc 22 2024-09-19T09:34:52.963 INFO:tasks.workunit.client.1.smithi191.stdout:5/34: read d0/d4/d9/f3 [3699329,43345] 0 2024-09-19T09:34:52.965 INFO:tasks.workunit.client.1.smithi191.stdout:2/31: dwrite f2 [0,4194304] 0 2024-09-19T09:34:52.965 INFO:tasks.workunit.client.1.smithi191.stdout:8/64: dwrite d1/f10 [0,4194304] 0 2024-09-19T09:34:52.965 INFO:tasks.workunit.client.1.smithi191.stdout:8/65: dread - d1/f15 zero size 2024-09-19T09:34:52.967 INFO:tasks.workunit.client.1.smithi191.stdout:4/70: dread f4 [0,4194304] 0 2024-09-19T09:34:52.968 INFO:tasks.workunit.client.1.smithi191.stdout:4/71: dread f1 [0,4194304] 0 2024-09-19T09:34:52.968 INFO:tasks.workunit.client.1.smithi191.stdout:5/35: dread d0/d4/d9/f3 [0,4194304] 0 2024-09-19T09:34:52.969 INFO:tasks.workunit.client.1.smithi191.stdout:4/72: mkdir d5/d1b/d1c 0 2024-09-19T09:34:52.969 INFO:tasks.workunit.client.1.smithi191.stdout:4/73: chown d5/d9/l1a 16034 1 2024-09-19T09:34:52.970 INFO:tasks.workunit.client.1.smithi191.stdout:5/36: truncate d0/d4/d9/f3 3195492 0 2024-09-19T09:34:52.970 INFO:tasks.workunit.client.1.smithi191.stdout:5/37: creat d0/d4/d9/fd x:0 0 0 2024-09-19T09:34:52.971 INFO:tasks.workunit.client.1.smithi191.stdout:4/74: creat d5/d1b/d1c/f1d x:0 0 0 2024-09-19T09:34:52.972 INFO:tasks.workunit.client.1.smithi191.stdout:4/75: creat d5/d9/f1e x:0 0 0 2024-09-19T09:34:52.973 INFO:tasks.workunit.client.1.smithi191.stdout:4/76: symlink d5/d9/d15/l1f 0 2024-09-19T09:34:52.973 INFO:tasks.workunit.client.1.smithi191.stdout:4/77: read f0 [3832513,57196] 0 2024-09-19T09:34:52.973 INFO:tasks.workunit.client.1.smithi191.stdout:4/78: dread - d5/fe zero size 2024-09-19T09:34:52.973 INFO:tasks.workunit.client.1.smithi191.stdout:4/79: dread - d5/f6 zero size 2024-09-19T09:34:52.974 INFO:tasks.workunit.client.1.smithi191.stdout:4/80: creat d5/d9/d15/d19/f20 x:0 0 0 2024-09-19T09:34:52.974 INFO:tasks.workunit.client.1.smithi191.stdout:4/81: write f2 [203366,88449] 0 2024-09-19T09:34:52.976 INFO:tasks.workunit.client.1.smithi191.stdout:2/32: dread f0 [0,4194304] 0 2024-09-19T09:34:52.977 INFO:tasks.workunit.client.1.smithi191.stdout:2/33: rename f2 to f6 0 2024-09-19T09:34:52.977 INFO:tasks.workunit.client.1.smithi191.stdout:2/34: chown c4 26448860 1 2024-09-19T09:34:52.977 INFO:tasks.workunit.client.1.smithi191.stdout:2/35: readlink l1 0 2024-09-19T09:34:52.977 INFO:tasks.workunit.client.1.smithi191.stdout:2/36: write f6 [5137890,35015] 0 2024-09-19T09:34:52.998 INFO:tasks.workunit.client.1.smithi191.stdout:8/66: dwrite d1/d7/fe [0,4194304] 0 2024-09-19T09:34:52.998 INFO:tasks.workunit.client.1.smithi191.stdout:5/38: dwrite d0/d4/d9/fd [0,4194304] 0 2024-09-19T09:34:52.998 INFO:tasks.workunit.client.1.smithi191.stdout:5/39: write d0/d4/d9/fb [453202,104354] 0 2024-09-19T09:34:53.000 INFO:tasks.workunit.client.1.smithi191.stdout:8/67: mkdir d1/d7/d8/d17 0 2024-09-19T09:34:53.004 INFO:tasks.workunit.client.1.smithi191.stdout:5/40: mkdir d0/d4/d9/de 0 2024-09-19T09:34:53.006 INFO:tasks.workunit.client.1.smithi191.stdout:5/41: creat d0/d4/d9/de/ff x:0 0 0 2024-09-19T09:34:53.006 INFO:tasks.workunit.client.1.smithi191.stdout:2/37: dread f6 [0,4194304] 0 2024-09-19T09:34:53.007 INFO:tasks.workunit.client.1.smithi191.stdout:5/42: symlink d0/d4/d9/de/l10 0 2024-09-19T09:34:53.008 INFO:tasks.workunit.client.1.smithi191.stdout:2/38: symlink l7 0 2024-09-19T09:34:53.009 INFO:tasks.workunit.client.1.smithi191.stdout:5/43: getdents d0 0 2024-09-19T09:34:53.010 INFO:tasks.workunit.client.1.smithi191.stdout:2/39: write f6 [4645804,12762] 0 2024-09-19T09:34:53.010 INFO:tasks.workunit.client.1.smithi191.stdout:2/40: truncate f6 5600126 0 2024-09-19T09:34:53.010 INFO:tasks.workunit.client.1.smithi191.stdout:2/41: chown c4 1609 1 2024-09-19T09:34:53.021 INFO:tasks.workunit.client.1.smithi191.stdout:4/82: dwrite f0 [0,4194304] 0 2024-09-19T09:34:53.021 INFO:tasks.workunit.client.1.smithi191.stdout:8/68: dwrite d1/f10 [4194304,4194304] 0 2024-09-19T09:34:53.025 INFO:tasks.workunit.client.1.smithi191.stdout:4/83: mkdir d5/d9/d21 0 2024-09-19T09:34:53.025 INFO:tasks.workunit.client.1.smithi191.stdout:4/84: fsync f0 0 2024-09-19T09:34:53.026 INFO:tasks.workunit.client.1.smithi191.stdout:2/42: dread f6 [0,4194304] 0 2024-09-19T09:34:53.026 INFO:tasks.workunit.client.1.smithi191.stdout:4/85: mknod d5/d9/c22 0 2024-09-19T09:34:53.027 INFO:tasks.workunit.client.1.smithi191.stdout:4/86: rename d5/d9/c22 to d5/d9/d15/c23 0 2024-09-19T09:34:53.028 INFO:tasks.workunit.client.1.smithi191.stdout:2/43: dread f6 [4194304,4194304] 0 2024-09-19T09:34:53.028 INFO:tasks.workunit.client.1.smithi191.stdout:2/44: stat l7 0 2024-09-19T09:34:53.029 INFO:tasks.workunit.client.1.smithi191.stdout:2/45: mkdir d8 0 2024-09-19T09:34:53.029 INFO:tasks.workunit.client.1.smithi191.stdout:4/87: getdents d5/d9/d15/d19 0 2024-09-19T09:34:53.030 INFO:tasks.workunit.client.1.smithi191.stdout:2/46: creat d8/f9 x:0 0 0 2024-09-19T09:34:53.031 INFO:tasks.workunit.client.1.smithi191.stdout:4/88: mkdir d5/d1b/d1c/d24 0 2024-09-19T09:34:53.031 INFO:tasks.workunit.client.1.smithi191.stdout:4/89: write f1 [841135,41010] 0 2024-09-19T09:34:53.032 INFO:tasks.workunit.client.1.smithi191.stdout:2/47: symlink d8/la 0 2024-09-19T09:34:53.033 INFO:tasks.workunit.client.1.smithi191.stdout:4/90: symlink d5/d1b/l25 0 2024-09-19T09:34:53.033 INFO:tasks.workunit.client.1.smithi191.stdout:4/91: fdatasync f2 0 2024-09-19T09:34:53.035 INFO:tasks.workunit.client.1.smithi191.stdout:4/92: getdents d5/d1b/d1c 0 2024-09-19T09:34:53.036 INFO:tasks.workunit.client.1.smithi191.stdout:2/48: rmdir d8 39 2024-09-19T09:34:53.036 INFO:tasks.workunit.client.1.smithi191.stdout:2/49: dread - d8/f9 zero size 2024-09-19T09:34:53.036 INFO:tasks.workunit.client.1.smithi191.stdout:2/50: stat d8/la 0 2024-09-19T09:34:53.037 INFO:tasks.workunit.client.1.smithi191.stdout:4/93: dread f4 [0,4194304] 0 2024-09-19T09:34:53.037 INFO:tasks.workunit.client.1.smithi191.stdout:4/94: chown f2 36 1 2024-09-19T09:34:53.037 INFO:tasks.workunit.client.1.smithi191.stdout:4/95: write d5/fe [529880,21942] 0 2024-09-19T09:34:53.037 INFO:tasks.workunit.client.1.smithi191.stdout:2/51: unlink l1 0 2024-09-19T09:34:53.038 INFO:tasks.workunit.client.1.smithi191.stdout:4/96: mknod d5/d1b/c26 0 2024-09-19T09:34:53.038 INFO:tasks.workunit.client.1.smithi191.stdout:4/97: write d5/f18 [1011621,98410] 0 2024-09-19T09:34:53.039 INFO:tasks.workunit.client.1.smithi191.stdout:4/98: mkdir d5/d9/d21/d27 0 2024-09-19T09:34:53.062 INFO:tasks.workunit.client.1.smithi191.stdout:2/52: dwrite d8/f9 [0,4194304] 0 2024-09-19T09:34:53.062 INFO:tasks.workunit.client.1.smithi191.stdout:4/99: dwrite f2 [0,4194304] 0 2024-09-19T09:34:53.062 INFO:tasks.workunit.client.1.smithi191.stdout:4/100: truncate f4 1419675 0 2024-09-19T09:34:53.062 INFO:tasks.workunit.client.1.smithi191.stdout:4/101: dread - d5/fa zero size 2024-09-19T09:34:53.063 INFO:tasks.workunit.client.1.smithi191.stdout:2/53: mkdir d8/db 0 2024-09-19T09:34:53.064 INFO:tasks.workunit.client.1.smithi191.stdout:2/54: mknod d8/cc 0 2024-09-19T09:34:53.068 INFO:tasks.workunit.client.1.smithi191.stdout:4/102: write f0 [3307912,83367] 0 2024-09-19T09:34:53.069 INFO:tasks.workunit.client.1.smithi191.stdout:4/103: write d5/f6 [163,52603] 0 2024-09-19T09:34:53.069 INFO:tasks.workunit.client.1.smithi191.stdout:4/104: mkdir d5/d1b/d1c/d28 0 2024-09-19T09:34:53.089 INFO:tasks.workunit.client.1.smithi191.stdout:4/105: dwrite d5/d9/d15/d19/f20 [0,4194304] 0 2024-09-19T09:34:53.090 INFO:tasks.workunit.client.1.smithi191.stdout:2/55: dwrite d8/f9 [0,4194304] 0 2024-09-19T09:34:53.091 INFO:tasks.workunit.client.1.smithi191.stdout:4/106: creat d5/d1b/d1c/f29 x:0 0 0 2024-09-19T09:34:53.091 INFO:tasks.workunit.client.1.smithi191.stdout:4/107: stat d5/d9/d21/d27 0 2024-09-19T09:34:53.091 INFO:tasks.workunit.client.1.smithi191.stdout:2/56: rmdir d8 39 2024-09-19T09:34:53.092 INFO:tasks.workunit.client.1.smithi191.stdout:4/108: link d5/c14 d5/d1b/c2a 0 2024-09-19T09:34:53.093 INFO:tasks.workunit.client.1.smithi191.stdout:2/57: unlink c3 0 2024-09-19T09:34:53.094 INFO:tasks.workunit.client.1.smithi191.stdout:2/58: fdatasync f0 0 2024-09-19T09:34:53.094 INFO:tasks.workunit.client.1.smithi191.stdout:2/59: chown d8/cc 2938 1 2024-09-19T09:34:53.094 INFO:tasks.workunit.client.1.smithi191.stdout:4/109: mknod d5/d9/d21/d27/c2b 0 2024-09-19T09:34:53.094 INFO:tasks.workunit.client.1.smithi191.stdout:4/110: fsync d5/d9/d15/d19/f20 0 2024-09-19T09:34:53.094 INFO:tasks.workunit.client.1.smithi191.stdout:4/111: chown d5/f8 12101 1 2024-09-19T09:34:53.095 INFO:tasks.workunit.client.1.smithi191.stdout:4/112: creat d5/d9/d21/f2c x:0 0 0 2024-09-19T09:34:53.096 INFO:tasks.workunit.client.1.smithi191.stdout:4/113: creat d5/d9/f2d x:0 0 0 2024-09-19T09:34:53.096 INFO:tasks.workunit.client.1.smithi191.stdout:4/114: truncate d5/d1b/d1c/f1d 999830 0 2024-09-19T09:34:53.097 INFO:tasks.workunit.client.1.smithi191.stdout:4/115: rename d5/d9/d21/d27/c2b to d5/d9/d15/d19/c2e 0 2024-09-19T09:34:53.102 INFO:tasks.workunit.client.1.smithi191.stdout:2/60: write d8/f9 [4104076,88621] 0 2024-09-19T09:34:53.104 INFO:tasks.workunit.client.1.smithi191.stdout:4/116: rename d5/d9/d15 to d5/d1b/d1c/d2f 0 2024-09-19T09:34:53.106 INFO:tasks.workunit.client.1.smithi191.stdout:2/61: rename c5 to d8/cd 0 2024-09-19T09:34:53.107 INFO:tasks.workunit.client.1.smithi191.stdout:4/117: unlink d5/d1b/d1c/d2f/l1f 0 2024-09-19T09:34:53.107 INFO:tasks.workunit.client.1.smithi191.stdout:2/62: mkdir d8/de 0 2024-09-19T09:34:53.108 INFO:tasks.workunit.client.1.smithi191.stdout:2/63: symlink d8/lf 0 2024-09-19T09:34:53.109 INFO:tasks.workunit.client.1.smithi191.stdout:4/118: symlink d5/d9/l30 0 2024-09-19T09:34:53.109 INFO:tasks.workunit.client.1.smithi191.stdout:4/119: write d5/d9/f2d [663878,20558] 0 2024-09-19T09:34:53.110 INFO:tasks.workunit.client.1.smithi191.stdout:2/64: rename l7 to d8/de/l10 0 2024-09-19T09:34:53.110 INFO:tasks.workunit.client.1.smithi191.stdout:2/65: chown d8 5015 1 2024-09-19T09:34:53.111 INFO:tasks.workunit.client.1.smithi191.stdout:2/66: mkdir d8/d11 0 2024-09-19T09:34:53.111 INFO:tasks.workunit.client.1.smithi191.stdout:2/67: truncate f0 5180891 0 2024-09-19T09:34:53.111 INFO:tasks.workunit.client.1.smithi191.stdout:2/68: rename d8 to d8/db/d12 22 2024-09-19T09:34:53.113 INFO:tasks.workunit.client.1.smithi191.stdout:2/69: dread f0 [0,4194304] 0 2024-09-19T09:34:53.117 INFO:tasks.workunit.client.1.smithi191.stdout:4/120: dread f0 [0,4194304] 0 2024-09-19T09:34:53.117 INFO:tasks.workunit.client.1.smithi191.stdout:4/121: fsync d5/d9/f13 0 2024-09-19T09:34:53.119 INFO:tasks.workunit.client.1.smithi191.stdout:4/122: mknod d5/d1b/d1c/d24/c31 0 2024-09-19T09:34:53.133 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:52 smithi191 ceph-mon[34834]: pgmap v8: 65 pgs: 65 active+clean; 178 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2024-09-19T09:34:53.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:52 smithi112 ceph-mon[27605]: pgmap v8: 65 pgs: 65 active+clean; 178 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2024-09-19T09:34:53.989 INFO:tasks.workunit.client.1.smithi191.stdout:8/69: sync 2024-09-19T09:34:53.989 INFO:tasks.workunit.client.1.smithi191.stdout:6/7: sync 2024-09-19T09:34:53.989 INFO:tasks.workunit.client.1.smithi191.stdout:0/36: sync 2024-09-19T09:34:53.989 INFO:tasks.workunit.client.1.smithi191.stdout:9/9: sync 2024-09-19T09:34:53.989 INFO:tasks.workunit.client.1.smithi191.stdout:3/38: sync 2024-09-19T09:34:53.989 INFO:tasks.workunit.client.1.smithi191.stdout:2/70: sync 2024-09-19T09:34:53.989 INFO:tasks.workunit.client.1.smithi191.stdout:9/10: fdatasync f0 0 2024-09-19T09:34:53.989 INFO:tasks.workunit.client.1.smithi191.stdout:3/39: fsync f7 0 2024-09-19T09:34:53.990 INFO:tasks.workunit.client.1.smithi191.stdout:0/37: truncate d0/d9/f6 1835121 0 2024-09-19T09:34:53.990 INFO:tasks.workunit.client.1.smithi191.stdout:2/71: readlink d8/la 0 2024-09-19T09:34:53.990 INFO:tasks.workunit.client.1.smithi191.stdout:1/8: sync 2024-09-19T09:34:53.990 INFO:tasks.workunit.client.1.smithi191.stdout:7/10: sync 2024-09-19T09:34:53.990 INFO:tasks.workunit.client.1.smithi191.stdout:7/11: fdatasync - no filename 2024-09-19T09:34:53.990 INFO:tasks.workunit.client.1.smithi191.stdout:4/123: sync 2024-09-19T09:34:53.990 INFO:tasks.workunit.client.1.smithi191.stdout:5/44: sync 2024-09-19T09:34:53.990 INFO:tasks.workunit.client.1.smithi191.stdout:5/45: fdatasync d0/d4/d9/f3 0 2024-09-19T09:34:53.991 INFO:tasks.workunit.client.1.smithi191.stdout:8/70: link d1/d7/d8/la d1/d7/l18 0 2024-09-19T09:34:53.991 INFO:tasks.workunit.client.1.smithi191.stdout:6/8: mknod c1 0 2024-09-19T09:34:53.991 INFO:tasks.workunit.client.1.smithi191.stdout:8/71: getdents d1/d16 0 2024-09-19T09:34:53.991 INFO:tasks.workunit.client.1.smithi191.stdout:3/40: creat fe x:0 0 0 2024-09-19T09:34:53.991 INFO:tasks.workunit.client.1.smithi191.stdout:0/38: mknod d0/ca 0 2024-09-19T09:34:53.992 INFO:tasks.workunit.client.1.smithi191.stdout:1/9: link d3/f4 d3/f5 0 2024-09-19T09:34:53.992 INFO:tasks.workunit.client.1.smithi191.stdout:1/10: creat d3/f6 x:0 0 0 2024-09-19T09:34:53.992 INFO:tasks.workunit.client.1.smithi191.stdout:1/11: readlink - no filename 2024-09-19T09:34:53.992 INFO:tasks.workunit.client.1.smithi191.stdout:1/12: truncate f0 472828 0 2024-09-19T09:34:53.993 INFO:tasks.workunit.client.1.smithi191.stdout:2/72: write f0 [3077400,36371] 0 2024-09-19T09:34:53.993 INFO:tasks.workunit.client.1.smithi191.stdout:7/12: symlink d2/l6 0 2024-09-19T09:34:53.993 INFO:tasks.workunit.client.1.smithi191.stdout:7/13: chown l0 41 1 2024-09-19T09:34:53.994 INFO:tasks.workunit.client.1.smithi191.stdout:5/46: creat d0/f11 x:0 0 0 2024-09-19T09:34:53.994 INFO:tasks.workunit.client.1.smithi191.stdout:5/47: write d0/d4/d9/f3 [540783,113291] 0 2024-09-19T09:34:53.994 INFO:tasks.workunit.client.1.smithi191.stdout:5/48: chown d0/f11 154716 1 2024-09-19T09:34:53.994 INFO:tasks.workunit.client.1.smithi191.stdout:6/9: mkdir d2 0 2024-09-19T09:34:53.995 INFO:tasks.workunit.client.1.smithi191.stdout:6/10: dread - no filename 2024-09-19T09:34:53.995 INFO:tasks.workunit.client.1.smithi191.stdout:6/11: write - no filename 2024-09-19T09:34:53.995 INFO:tasks.workunit.client.1.smithi191.stdout:6/12: dread - no filename 2024-09-19T09:34:53.995 INFO:tasks.workunit.client.1.smithi191.stdout:6/13: write - no filename 2024-09-19T09:34:53.995 INFO:tasks.workunit.client.1.smithi191.stdout:8/72: creat d1/d16/f19 x:0 0 0 2024-09-19T09:34:53.996 INFO:tasks.workunit.client.1.smithi191.stdout:3/41: creat ff x:0 0 0 2024-09-19T09:34:53.996 INFO:tasks.workunit.client.1.smithi191.stdout:0/39: mkdir d0/db 0 2024-09-19T09:34:53.997 INFO:tasks.workunit.client.1.smithi191.stdout:1/13: symlink d3/l7 0 2024-09-19T09:34:53.998 INFO:tasks.workunit.client.1.smithi191.stdout:1/14: read - d3/f4 zero size 2024-09-19T09:34:53.998 INFO:tasks.workunit.client.1.smithi191.stdout:1/15: creat d3/f8 x:0 0 0 2024-09-19T09:34:53.998 INFO:tasks.workunit.client.1.smithi191.stdout:1/16: read - d3/f4 zero size 2024-09-19T09:34:53.998 INFO:tasks.workunit.client.1.smithi191.stdout:2/73: mkdir d8/db/d13 0 2024-09-19T09:34:53.999 INFO:tasks.workunit.client.1.smithi191.stdout:7/14: rmdir d2 39 2024-09-19T09:34:53.999 INFO:tasks.workunit.client.1.smithi191.stdout:8/73: write d1/d7/d8/fc [1893372,47877] 0 2024-09-19T09:34:54.003 INFO:tasks.workunit.client.1.smithi191.stdout:5/49: symlink d0/d4/l12 0 2024-09-19T09:34:54.003 INFO:tasks.workunit.client.1.smithi191.stdout:5/50: creat d0/f13 x:0 0 0 2024-09-19T09:34:54.005 INFO:tasks.workunit.client.1.smithi191.stdout:9/11: dwrite f2 [0,4194304] 0 2024-09-19T09:34:54.006 INFO:tasks.workunit.client.1.smithi191.stdout:0/40: symlink d0/lc 0 2024-09-19T09:34:54.006 INFO:tasks.workunit.client.1.smithi191.stdout:0/41: fsync d0/f3 0 2024-09-19T09:34:54.008 INFO:tasks.workunit.client.1.smithi191.stdout:7/15: rmdir d2 39 2024-09-19T09:34:54.009 INFO:tasks.workunit.client.1.smithi191.stdout:8/74: mkdir d1/d7/d1a 0 2024-09-19T09:34:54.010 INFO:tasks.workunit.client.1.smithi191.stdout:4/124: rename d5/d9 to d5/d1b/d1c/d24/d32 0 2024-09-19T09:34:54.013 INFO:tasks.workunit.client.1.smithi191.stdout:9/12: mkdir d3 0 2024-09-19T09:34:54.013 INFO:tasks.workunit.client.1.smithi191.stdout:1/17: unlink d3/f8 0 2024-09-19T09:34:54.014 INFO:tasks.workunit.client.1.smithi191.stdout:1/18: fdatasync d3/f4 0 2024-09-19T09:34:54.014 INFO:tasks.workunit.client.1.smithi191.stdout:1/19: chown f2 1191719 1 2024-09-19T09:34:54.014 INFO:tasks.workunit.client.1.smithi191.stdout:1/20: fdatasync d3/f6 0 2024-09-19T09:34:54.014 INFO:tasks.workunit.client.1.smithi191.stdout:1/21: write d3/f4 [12163,42278] 0 2024-09-19T09:34:54.014 INFO:tasks.workunit.client.1.smithi191.stdout:7/16: creat d2/f7 x:0 0 0 2024-09-19T09:34:54.015 INFO:tasks.workunit.client.1.smithi191.stdout:8/75: symlink d1/d7/d8/d17/l1b 0 2024-09-19T09:34:54.015 INFO:tasks.workunit.client.1.smithi191.stdout:1/22: dread f2 [0,4194304] 0 2024-09-19T09:34:54.016 INFO:tasks.workunit.client.1.smithi191.stdout:1/23: stat d3/l7 0 2024-09-19T09:34:54.016 INFO:tasks.workunit.client.1.smithi191.stdout:1/24: readlink d3/l7 0 2024-09-19T09:34:54.017 INFO:tasks.workunit.client.1.smithi191.stdout:6/14: rename c1 to d2/c3 0 2024-09-19T09:34:54.019 INFO:tasks.workunit.client.1.smithi191.stdout:4/125: mknod d5/d1b/d1c/d24/c33 0 2024-09-19T09:34:54.019 INFO:tasks.workunit.client.1.smithi191.stdout:4/126: write f1 [40300,98269] 0 2024-09-19T09:34:54.020 INFO:tasks.workunit.client.1.smithi191.stdout:3/42: rename c4 to c10 0 2024-09-19T09:34:54.021 INFO:tasks.workunit.client.1.smithi191.stdout:9/13: symlink d3/l4 0 2024-09-19T09:34:54.022 INFO:tasks.workunit.client.1.smithi191.stdout:8/76: creat d1/d7/d8/d17/f1c x:0 0 0 2024-09-19T09:34:54.025 INFO:tasks.workunit.client.1.smithi191.stdout:6/15: symlink d2/l4 0 2024-09-19T09:34:54.025 INFO:tasks.workunit.client.1.smithi191.stdout:6/16: dwrite - no filename 2024-09-19T09:34:54.026 INFO:tasks.workunit.client.1.smithi191.stdout:6/17: rmdir d2 39 2024-09-19T09:34:54.026 INFO:tasks.workunit.client.1.smithi191.stdout:6/18: dwrite - no filename 2024-09-19T09:34:54.027 INFO:tasks.workunit.client.1.smithi191.stdout:6/19: symlink d2/l5 0 2024-09-19T09:34:54.028 INFO:tasks.workunit.client.1.smithi191.stdout:6/20: truncate - no filename 2024-09-19T09:34:54.029 INFO:tasks.workunit.client.1.smithi191.stdout:6/21: creat d2/f6 x:0 0 0 2024-09-19T09:34:54.032 INFO:tasks.workunit.client.1.smithi191.stdout:6/22: unlink d2/l5 0 2024-09-19T09:34:54.035 INFO:tasks.workunit.client.1.smithi191.stdout:6/23: mknod d2/c7 0 2024-09-19T09:34:54.036 INFO:tasks.workunit.client.1.smithi191.stdout:6/24: truncate d2/f6 1014020 0 2024-09-19T09:34:54.036 INFO:tasks.workunit.client.1.smithi191.stdout:9/14: dread f0 [0,4194304] 0 2024-09-19T09:34:54.037 INFO:tasks.workunit.client.1.smithi191.stdout:6/25: mknod d2/c8 0 2024-09-19T09:34:54.037 INFO:tasks.workunit.client.1.smithi191.stdout:9/15: mknod d3/c5 0 2024-09-19T09:34:54.037 INFO:tasks.workunit.client.1.smithi191.stdout:9/16: write f0 [2643111,70578] 0 2024-09-19T09:34:54.037 INFO:tasks.workunit.client.1.smithi191.stdout:9/17: chown d3/l4 2296 1 2024-09-19T09:34:54.037 INFO:tasks.workunit.client.1.smithi191.stdout:9/18: dread - f1 zero size 2024-09-19T09:34:54.038 INFO:tasks.workunit.client.1.smithi191.stdout:6/26: symlink d2/l9 0 2024-09-19T09:34:54.038 INFO:tasks.workunit.client.1.smithi191.stdout:6/27: fdatasync d2/f6 0 2024-09-19T09:34:54.038 INFO:tasks.workunit.client.1.smithi191.stdout:9/19: rmdir d3 39 2024-09-19T09:34:54.038 INFO:tasks.workunit.client.1.smithi191.stdout:6/28: dread d2/f6 [0,4194304] 0 2024-09-19T09:34:54.043 INFO:tasks.workunit.client.1.smithi191.stdout:0/42: dwrite d0/f4 [4194304,4194304] 0 2024-09-19T09:34:54.044 INFO:tasks.workunit.client.1.smithi191.stdout:0/43: creat d0/fd x:0 0 0 2024-09-19T09:34:54.046 INFO:tasks.workunit.client.1.smithi191.stdout:0/44: rmdir d0/db 0 2024-09-19T09:34:54.047 INFO:tasks.workunit.client.1.smithi191.stdout:0/45: mkdir d0/d9/de 0 2024-09-19T09:34:54.047 INFO:tasks.workunit.client.1.smithi191.stdout:0/46: dread - d0/f3 zero size 2024-09-19T09:34:54.059 INFO:tasks.workunit.client.1.smithi191.stdout:0/47: read d0/f4 [5123756,67226] 0 2024-09-19T09:34:54.059 INFO:tasks.workunit.client.1.smithi191.stdout:0/48: truncate d0/f3 71317 0 2024-09-19T09:34:54.060 INFO:tasks.workunit.client.1.smithi191.stdout:0/49: creat d0/d9/de/ff x:0 0 0 2024-09-19T09:34:54.060 INFO:tasks.workunit.client.1.smithi191.stdout:0/50: creat d0/d9/de/f10 x:0 0 0 2024-09-19T09:34:54.064 INFO:tasks.workunit.client.1.smithi191.stdout:7/17: dwrite d2/f7 [0,4194304] 0 2024-09-19T09:34:54.064 INFO:tasks.workunit.client.1.smithi191.stdout:2/74: dwrite f6 [4194304,4194304] 0 2024-09-19T09:34:54.064 INFO:tasks.workunit.client.1.smithi191.stdout:2/75: getdents d8/db/d13 0 2024-09-19T09:34:54.064 INFO:tasks.workunit.client.1.smithi191.stdout:2/76: read d8/f9 [1284869,43663] 0 2024-09-19T09:34:54.065 INFO:tasks.workunit.client.1.smithi191.stdout:3/43: dwrite ff [0,4194304] 0 2024-09-19T09:34:54.066 INFO:tasks.workunit.client.1.smithi191.stdout:1/25: dwrite d3/f4 [0,4194304] 0 2024-09-19T09:34:54.067 INFO:tasks.workunit.client.1.smithi191.stdout:5/51: dwrite d0/d4/d9/de/ff [0,4194304] 0 2024-09-19T09:34:54.067 INFO:tasks.workunit.client.1.smithi191.stdout:7/18: unlink d2/l3 0 2024-09-19T09:34:54.067 INFO:tasks.workunit.client.1.smithi191.stdout:6/29: dwrite d2/f6 [0,4194304] 0 2024-09-19T09:34:54.067 INFO:tasks.workunit.client.1.smithi191.stdout:6/30: creat d2/fa x:0 0 0 2024-09-19T09:34:54.067 INFO:tasks.workunit.client.1.smithi191.stdout:4/127: dwrite d5/fa [0,4194304] 0 2024-09-19T09:34:54.067 INFO:tasks.workunit.client.1.smithi191.stdout:9/20: fdatasync f0 0 2024-09-19T09:34:54.069 INFO:tasks.workunit.client.1.smithi191.stdout:5/52: read d0/d4/d9/fb [57414,106110] 0 2024-09-19T09:34:54.069 INFO:tasks.workunit.client.1.smithi191.stdout:2/77: creat d8/db/f14 x:0 0 0 2024-09-19T09:34:54.069 INFO:tasks.workunit.client.1.smithi191.stdout:2/78: write d8/db/f14 [264114,24244] 0 2024-09-19T09:34:54.069 INFO:tasks.workunit.client.1.smithi191.stdout:2/79: chown d8/f9 34 1 2024-09-19T09:34:54.069 INFO:tasks.workunit.client.1.smithi191.stdout:3/44: creat f11 x:0 0 0 2024-09-19T09:34:54.073 INFO:tasks.workunit.client.1.smithi191.stdout:9/21: rename f1 to d3/f6 0 2024-09-19T09:34:54.073 INFO:tasks.workunit.client.1.smithi191.stdout:9/22: dread - d3/f6 zero size 2024-09-19T09:34:54.074 INFO:tasks.workunit.client.1.smithi191.stdout:2/80: creat d8/db/d13/f15 x:0 0 0 2024-09-19T09:34:54.074 INFO:tasks.workunit.client.1.smithi191.stdout:2/81: dread - d8/db/d13/f15 zero size 2024-09-19T09:34:54.076 INFO:tasks.workunit.client.1.smithi191.stdout:9/23: creat d3/f7 x:0 0 0 2024-09-19T09:34:54.076 INFO:tasks.workunit.client.1.smithi191.stdout:3/45: mkdir d12 0 2024-09-19T09:34:54.077 INFO:tasks.workunit.client.1.smithi191.stdout:9/24: mkdir d3/d8 0 2024-09-19T09:34:54.078 INFO:tasks.workunit.client.1.smithi191.stdout:3/46: mkdir d12/d13 0 2024-09-19T09:34:54.080 INFO:tasks.workunit.client.1.smithi191.stdout:9/25: unlink d3/f7 0 2024-09-19T09:34:54.082 INFO:tasks.workunit.client.1.smithi191.stdout:9/26: symlink d3/d8/l9 0 2024-09-19T09:34:54.086 INFO:tasks.workunit.client.1.smithi191.stdout:6/31: dread d2/f6 [0,4194304] 0 2024-09-19T09:34:54.091 INFO:tasks.workunit.client.1.smithi191.stdout:3/47: dread f7 [0,4194304] 0 2024-09-19T09:34:54.093 INFO:tasks.workunit.client.1.smithi191.stdout:3/48: creat d12/d13/f14 x:0 0 0 2024-09-19T09:34:54.094 INFO:tasks.workunit.client.1.smithi191.stdout:3/49: rename f7 to d12/f15 0 2024-09-19T09:34:54.095 INFO:tasks.workunit.client.1.smithi191.stdout:3/50: readlink l3 0 2024-09-19T09:34:54.095 INFO:tasks.workunit.client.1.smithi191.stdout:5/53: write d0/d4/d9/fd [4061575,91154] 0 2024-09-19T09:34:54.101 INFO:tasks.workunit.client.1.smithi191.stdout:3/51: mknod d12/c16 0 2024-09-19T09:34:54.101 INFO:tasks.workunit.client.1.smithi191.stdout:3/52: truncate fd 74297 0 2024-09-19T09:34:54.101 INFO:tasks.workunit.client.1.smithi191.stdout:7/19: fsync d2/f7 0 2024-09-19T09:34:54.101 INFO:tasks.workunit.client.1.smithi191.stdout:5/54: dread d0/d4/d9/fb [0,4194304] 0 2024-09-19T09:34:54.101 INFO:tasks.workunit.client.1.smithi191.stdout:5/55: stat d0/d4/d9/de 0 2024-09-19T09:34:54.102 INFO:tasks.workunit.client.1.smithi191.stdout:4/128: dwrite f0 [0,4194304] 0 2024-09-19T09:34:54.102 INFO:tasks.workunit.client.1.smithi191.stdout:3/53: rename fd to d12/d13/f17 0 2024-09-19T09:34:54.102 INFO:tasks.workunit.client.1.smithi191.stdout:5/56: rename d0/d4 to d0/d4/d14 22 2024-09-19T09:34:54.102 INFO:tasks.workunit.client.1.smithi191.stdout:3/54: fsync ff 0 2024-09-19T09:34:54.102 INFO:tasks.workunit.client.1.smithi191.stdout:5/57: write d0/d4/d9/fd [4623058,113035] 0 2024-09-19T09:34:54.103 INFO:tasks.workunit.client.1.smithi191.stdout:3/55: creat d12/f18 x:0 0 0 2024-09-19T09:34:54.103 INFO:tasks.workunit.client.1.smithi191.stdout:3/56: creat d12/d13/f19 x:0 0 0 2024-09-19T09:34:54.103 INFO:tasks.workunit.client.1.smithi191.stdout:3/57: chown d12/d13/f14 116911 1 2024-09-19T09:34:54.103 INFO:tasks.workunit.client.1.smithi191.stdout:5/58: rename d0/d4/d9/de/l10 to d0/d4/d9/de/l15 0 2024-09-19T09:34:54.105 INFO:tasks.workunit.client.1.smithi191.stdout:4/129: write d5/f8 [3871403,126609] 0 2024-09-19T09:34:54.106 INFO:tasks.workunit.client.1.smithi191.stdout:5/59: symlink d0/d4/l16 0 2024-09-19T09:34:54.106 INFO:tasks.workunit.client.1.smithi191.stdout:5/60: fdatasync d0/f13 0 2024-09-19T09:34:54.106 INFO:tasks.workunit.client.1.smithi191.stdout:5/61: write d0/f11 [136287,71212] 0 2024-09-19T09:34:54.107 INFO:tasks.workunit.client.1.smithi191.stdout:5/62: dread d0/d4/d9/fb [0,4194304] 0 2024-09-19T09:34:54.108 INFO:tasks.workunit.client.1.smithi191.stdout:4/130: rename d5/d1b/d1c/f1d to d5/d1b/d1c/d2f/d19/f34 0 2024-09-19T09:34:54.108 INFO:tasks.workunit.client.1.smithi191.stdout:4/131: stat d5/d1b/d1c/d2f 0 2024-09-19T09:34:54.108 INFO:tasks.workunit.client.1.smithi191.stdout:4/132: creat d5/f35 x:0 0 0 2024-09-19T09:34:54.109 INFO:tasks.workunit.client.1.smithi191.stdout:5/63: symlink d0/l17 0 2024-09-19T09:34:54.109 INFO:tasks.workunit.client.1.smithi191.stdout:5/64: dread - d0/f13 zero size 2024-09-19T09:34:54.109 INFO:tasks.workunit.client.1.smithi191.stdout:5/65: chown d0/f13 79718 1 2024-09-19T09:34:54.110 INFO:tasks.workunit.client.1.smithi191.stdout:0/51: dwrite d0/d9/f6 [0,4194304] 0 2024-09-19T09:34:54.110 INFO:tasks.workunit.client.1.smithi191.stdout:0/52: stat d0/d9/de/ff 0 2024-09-19T09:34:54.110 INFO:tasks.workunit.client.1.smithi191.stdout:8/77: dwrite d1/d7/d8/fc [0,4194304] 0 2024-09-19T09:34:54.114 INFO:tasks.workunit.client.1.smithi191.stdout:7/20: dread d2/f7 [0,4194304] 0 2024-09-19T09:34:54.114 INFO:tasks.workunit.client.1.smithi191.stdout:7/21: fsync d2/f7 0 2024-09-19T09:34:54.114 INFO:tasks.workunit.client.1.smithi191.stdout:0/53: rename d0/d9/de/ff to d0/d9/f11 0 2024-09-19T09:34:54.115 INFO:tasks.workunit.client.1.smithi191.stdout:9/27: dwrite f2 [0,4194304] 0 2024-09-19T09:34:54.118 INFO:tasks.workunit.client.1.smithi191.stdout:7/22: dread d2/f7 [0,4194304] 0 2024-09-19T09:34:54.118 INFO:tasks.workunit.client.1.smithi191.stdout:7/23: creat d2/f8 x:0 0 0 2024-09-19T09:34:54.119 INFO:tasks.workunit.client.1.smithi191.stdout:7/24: creat d2/f9 x:0 0 0 2024-09-19T09:34:54.119 INFO:tasks.workunit.client.1.smithi191.stdout:6/32: dwrite d2/fa [0,4194304] 0 2024-09-19T09:34:54.119 INFO:tasks.workunit.client.1.smithi191.stdout:2/82: dwrite d8/f9 [0,4194304] 0 2024-09-19T09:34:54.119 INFO:tasks.workunit.client.1.smithi191.stdout:0/54: symlink d0/d9/de/l12 0 2024-09-19T09:34:54.119 INFO:tasks.workunit.client.1.smithi191.stdout:0/55: write d0/f8 [825918,14443] 0 2024-09-19T09:34:54.119 INFO:tasks.workunit.client.1.smithi191.stdout:8/78: mknod d1/c1d 0 2024-09-19T09:34:54.119 INFO:tasks.workunit.client.1.smithi191.stdout:8/79: stat d1/d7/d8/fc 0 2024-09-19T09:34:54.123 INFO:tasks.workunit.client.1.smithi191.stdout:7/25: symlink d2/la 0 2024-09-19T09:34:54.123 INFO:tasks.workunit.client.1.smithi191.stdout:7/26: truncate d2/f7 4225760 0 2024-09-19T09:34:54.136 INFO:tasks.workunit.client.1.smithi191.stdout:6/33: link d2/l4 d2/lb 0 2024-09-19T09:34:54.136 INFO:tasks.workunit.client.1.smithi191.stdout:9/28: write f2 [655496,93153] 0 2024-09-19T09:34:54.136 INFO:tasks.workunit.client.1.smithi191.stdout:2/83: unlink d8/cc 0 2024-09-19T09:34:54.136 INFO:tasks.workunit.client.1.smithi191.stdout:2/84: link d8/db/f14 d8/db/d13/f16 0 2024-09-19T09:34:54.137 INFO:tasks.workunit.client.1.smithi191.stdout:5/66: dwrite d0/d4/d9/fb [0,4194304] 0 2024-09-19T09:34:54.137 INFO:tasks.workunit.client.1.smithi191.stdout:0/56: write d0/d9/f6 [2627954,114] 0 2024-09-19T09:34:54.137 INFO:tasks.workunit.client.1.smithi191.stdout:9/29: dread f0 [0,4194304] 0 2024-09-19T09:34:54.137 INFO:tasks.workunit.client.1.smithi191.stdout:1/26: truncate d3/f5 3551700 0 2024-09-19T09:34:54.137 INFO:tasks.workunit.client.1.smithi191.stdout:1/27: fsync d3/f6 0 2024-09-19T09:34:54.139 INFO:tasks.workunit.client.1.smithi191.stdout:0/57: mkdir d0/d9/d13 0 2024-09-19T09:34:54.141 INFO:tasks.workunit.client.1.smithi191.stdout:9/30: unlink f0 0 2024-09-19T09:34:54.142 INFO:tasks.workunit.client.1.smithi191.stdout:6/34: read d2/fa [6869,24090] 0 2024-09-19T09:34:54.147 INFO:tasks.workunit.client.1.smithi191.stdout:1/28: mkdir d3/d9 0 2024-09-19T09:34:54.147 INFO:tasks.workunit.client.1.smithi191.stdout:1/29: chown d3/f5 4350659 1 2024-09-19T09:34:54.152 INFO:tasks.workunit.client.1.smithi191.stdout:3/58: getdents d12/d13 0 2024-09-19T09:34:54.152 INFO:tasks.workunit.client.1.smithi191.stdout:3/59: dread - d12/d13/f14 zero size 2024-09-19T09:34:54.154 INFO:tasks.workunit.client.1.smithi191.stdout:0/58: mknod d0/d9/d13/c14 0 2024-09-19T09:34:54.154 INFO:tasks.workunit.client.1.smithi191.stdout:0/59: fdatasync d0/d9/de/f10 0 2024-09-19T09:34:54.154 INFO:tasks.workunit.client.1.smithi191.stdout:0/60: chown d0/d9/d13/c14 1975174 1 2024-09-19T09:34:54.155 INFO:tasks.workunit.client.1.smithi191.stdout:4/133: link d5/d1b/d1c/d2f/d19/f34 d5/d1b/d1c/d24/d32/f36 0 2024-09-19T09:34:54.158 INFO:tasks.workunit.client.1.smithi191.stdout:7/27: dwrite d2/f8 [0,4194304] 0 2024-09-19T09:34:54.162 INFO:tasks.workunit.client.1.smithi191.stdout:7/28: dread d2/f7 [0,4194304] 0 2024-09-19T09:34:54.162 INFO:tasks.workunit.client.1.smithi191.stdout:7/29: readlink d2/la 0 2024-09-19T09:34:54.164 INFO:tasks.workunit.client.1.smithi191.stdout:8/80: getdents d1 0 2024-09-19T09:34:54.170 INFO:tasks.workunit.client.1.smithi191.stdout:3/60: mkdir d12/d13/d1a 0 2024-09-19T09:34:54.170 INFO:tasks.workunit.client.1.smithi191.stdout:3/61: stat fe 0 2024-09-19T09:34:54.172 INFO:tasks.workunit.client.1.smithi191.stdout:6/35: dwrite d2/f6 [0,4194304] 0 2024-09-19T09:34:54.172 INFO:tasks.workunit.client.1.smithi191.stdout:5/67: dwrite d0/d4/d9/fb [0,4194304] 0 2024-09-19T09:34:54.172 INFO:tasks.workunit.client.1.smithi191.stdout:1/30: dwrite f0 [0,4194304] 0 2024-09-19T09:34:54.172 INFO:tasks.workunit.client.1.smithi191.stdout:5/68: creat d0/d4/d9/de/f18 x:0 0 0 2024-09-19T09:34:54.172 INFO:tasks.workunit.client.1.smithi191.stdout:1/31: dread - d3/f6 zero size 2024-09-19T09:34:54.172 INFO:tasks.workunit.client.1.smithi191.stdout:5/69: chown d0/d4/d9/de/ff 121 1 2024-09-19T09:34:54.173 INFO:tasks.workunit.client.1.smithi191.stdout:4/134: mkdir d5/d1b/d1c/d2f/d37 0 2024-09-19T09:34:54.173 INFO:tasks.workunit.client.1.smithi191.stdout:4/135: fsync d5/fa 0 2024-09-19T09:34:54.175 INFO:tasks.workunit.client.1.smithi191.stdout:9/31: rmdir d3 39 2024-09-19T09:34:54.175 INFO:tasks.workunit.client.1.smithi191.stdout:9/32: dread - d3/f6 zero size 2024-09-19T09:34:54.176 INFO:tasks.workunit.client.1.smithi191.stdout:6/36: dread d2/fa [0,4194304] 0 2024-09-19T09:34:54.177 INFO:tasks.workunit.client.1.smithi191.stdout:7/30: symlink d2/lb 0 2024-09-19T09:34:54.178 INFO:tasks.workunit.client.1.smithi191.stdout:8/81: unlink d1/cb 0 2024-09-19T09:34:54.179 INFO:tasks.workunit.client.1.smithi191.stdout:3/62: readlink l6 0 2024-09-19T09:34:54.180 INFO:tasks.workunit.client.1.smithi191.stdout:7/31: write d2/f7 [2362995,13474] 0 2024-09-19T09:34:54.181 INFO:tasks.workunit.client.1.smithi191.stdout:9/33: dread f2 [0,4194304] 0 2024-09-19T09:34:54.181 INFO:tasks.workunit.client.1.smithi191.stdout:0/61: unlink d0/d9/f6 0 2024-09-19T09:34:54.181 INFO:tasks.workunit.client.1.smithi191.stdout:0/62: write d0/f8 [1108283,95225] 0 2024-09-19T09:34:54.181 INFO:tasks.workunit.client.1.smithi191.stdout:0/63: fsync d0/fd 0 2024-09-19T09:34:54.181 INFO:tasks.workunit.client.1.smithi191.stdout:0/64: truncate d0/d9/f11 461593 0 2024-09-19T09:34:54.181 INFO:tasks.workunit.client.1.smithi191.stdout:0/65: readlink d0/lc 0 2024-09-19T09:34:54.184 INFO:tasks.workunit.client.1.smithi191.stdout:9/34: dread f2 [0,4194304] 0 2024-09-19T09:34:54.186 INFO:tasks.workunit.client.1.smithi191.stdout:1/32: mkdir d3/d9/da 0 2024-09-19T09:34:54.186 INFO:tasks.workunit.client.1.smithi191.stdout:1/33: chown d3/f6 61 1 2024-09-19T09:34:54.188 INFO:tasks.workunit.client.1.smithi191.stdout:4/136: mkdir d5/d38 0 2024-09-19T09:34:54.189 INFO:tasks.workunit.client.1.smithi191.stdout:6/37: symlink d2/lc 0 2024-09-19T09:34:54.189 INFO:tasks.workunit.client.1.smithi191.stdout:6/38: stat d2/l9 0 2024-09-19T09:34:54.190 INFO:tasks.workunit.client.1.smithi191.stdout:4/137: dread d5/f6 [0,4194304] 0 2024-09-19T09:34:54.193 INFO:tasks.workunit.client.1.smithi191.stdout:3/63: mkdir d12/d13/d1a/d1b 0 2024-09-19T09:34:54.194 INFO:tasks.workunit.client.1.smithi191.stdout:7/32: link d2/f8 d2/fc 0 2024-09-19T09:34:54.194 INFO:tasks.workunit.client.1.smithi191.stdout:7/33: creat d2/fd x:0 0 0 2024-09-19T09:34:54.194 INFO:tasks.workunit.client.1.smithi191.stdout:7/34: dread - d2/f9 zero size 2024-09-19T09:34:54.194 INFO:tasks.workunit.client.1.smithi191.stdout:7/35: stat d2/fc 0 2024-09-19T09:34:54.195 INFO:tasks.workunit.client.1.smithi191.stdout:9/35: symlink d3/d8/la 0 2024-09-19T09:34:54.195 INFO:tasks.workunit.client.1.smithi191.stdout:5/70: truncate d0/d4/d9/fd 3754907 0 2024-09-19T09:34:54.197 INFO:tasks.workunit.client.1.smithi191.stdout:6/39: link d2/c8 d2/cd 0 2024-09-19T09:34:54.200 INFO:tasks.workunit.client.1.smithi191.stdout:3/64: link lc d12/d13/d1a/d1b/l1c 0 2024-09-19T09:34:54.201 INFO:tasks.workunit.client.1.smithi191.stdout:0/66: dwrite d0/fd [0,4194304] 0 2024-09-19T09:34:54.202 INFO:tasks.workunit.client.1.smithi191.stdout:0/67: chown d0/f3 0 1 2024-09-19T09:34:54.202 INFO:tasks.workunit.client.1.smithi191.stdout:9/36: mkdir d3/db 0 2024-09-19T09:34:54.203 INFO:tasks.workunit.client.1.smithi191.stdout:5/71: link d0/d4/l12 d0/l19 0 2024-09-19T09:34:54.205 INFO:tasks.workunit.client.1.smithi191.stdout:6/40: mkdir d2/de 0 2024-09-19T09:34:54.205 INFO:tasks.workunit.client.1.smithi191.stdout:5/72: write d0/f11 [34244,122474] 0 2024-09-19T09:34:54.209 INFO:tasks.workunit.client.1.smithi191.stdout:4/138: dread d5/fa [0,4194304] 0 2024-09-19T09:34:54.209 INFO:tasks.workunit.client.1.smithi191.stdout:9/37: unlink d3/d8/l9 0 2024-09-19T09:34:54.210 INFO:tasks.workunit.client.1.smithi191.stdout:5/73: rename d0/d4/d9/l7 to d0/d4/d9/l1a 0 2024-09-19T09:34:54.211 INFO:tasks.workunit.client.1.smithi191.stdout:3/65: mknod d12/d13/c1d 0 2024-09-19T09:34:54.211 INFO:tasks.workunit.client.1.smithi191.stdout:3/66: creat d12/f1e x:0 0 0 2024-09-19T09:34:54.213 INFO:tasks.workunit.client.1.smithi191.stdout:4/139: rmdir d5/d1b/d1c/d24 39 2024-09-19T09:34:54.213 INFO:tasks.workunit.client.1.smithi191.stdout:4/140: truncate d5/f6 832295 0 2024-09-19T09:34:54.213 INFO:tasks.workunit.client.1.smithi191.stdout:4/141: truncate f4 2083841 0 2024-09-19T09:34:54.214 INFO:tasks.workunit.client.1.smithi191.stdout:5/74: stat d0/d4/l12 0 2024-09-19T09:34:54.215 INFO:tasks.workunit.client.1.smithi191.stdout:0/68: dread d0/fd [0,4194304] 0 2024-09-19T09:34:54.215 INFO:tasks.workunit.client.1.smithi191.stdout:6/41: write d2/f6 [908494,92314] 0 2024-09-19T09:34:54.215 INFO:tasks.workunit.client.1.smithi191.stdout:6/42: readlink d2/l9 0 2024-09-19T09:34:54.217 INFO:tasks.workunit.client.1.smithi191.stdout:3/67: link c10 d12/d13/d1a/d1b/c1f 0 2024-09-19T09:34:54.218 INFO:tasks.workunit.client.1.smithi191.stdout:4/142: creat d5/d1b/d1c/d2f/f39 x:0 0 0 2024-09-19T09:34:54.219 INFO:tasks.workunit.client.1.smithi191.stdout:5/75: creat d0/d4/f1b x:0 0 0 2024-09-19T09:34:54.220 INFO:tasks.workunit.client.1.smithi191.stdout:0/69: mknod d0/d9/de/c15 0 2024-09-19T09:34:54.222 INFO:tasks.workunit.client.1.smithi191.stdout:6/43: truncate d2/fa 1388762 0 2024-09-19T09:34:54.222 INFO:tasks.workunit.client.1.smithi191.stdout:8/82: dwrite d1/d16/f19 [0,4194304] 0 2024-09-19T09:34:54.224 INFO:tasks.workunit.client.1.smithi191.stdout:3/68: link c10 d12/c20 0 2024-09-19T09:34:54.226 INFO:tasks.workunit.client.1.smithi191.stdout:0/70: creat d0/d9/d13/f16 x:0 0 0 2024-09-19T09:34:54.226 INFO:tasks.workunit.client.1.smithi191.stdout:0/71: truncate d0/d9/de/f10 956264 0 2024-09-19T09:34:54.226 INFO:tasks.workunit.client.1.smithi191.stdout:0/72: chown d0/d9/de/f10 16156 1 2024-09-19T09:34:54.226 INFO:tasks.workunit.client.1.smithi191.stdout:0/73: readlink d0/lc 0 2024-09-19T09:34:54.228 INFO:tasks.workunit.client.1.smithi191.stdout:6/44: mknod d2/cf 0 2024-09-19T09:34:54.234 INFO:tasks.workunit.client.1.smithi191.stdout:8/83: chown d1/d7/fe 19 1 2024-09-19T09:34:54.237 INFO:tasks.workunit.client.1.smithi191.stdout:0/74: mknod d0/d9/c17 0 2024-09-19T09:34:54.243 INFO:tasks.workunit.client.1.smithi191.stdout:0/75: dread d0/fd [0,4194304] 0 2024-09-19T09:34:54.244 INFO:tasks.workunit.client.1.smithi191.stdout:0/76: truncate d0/f4 9094124 0 2024-09-19T09:34:54.244 INFO:tasks.workunit.client.1.smithi191.stdout:0/77: chown d0/f4 35478 1 2024-09-19T09:34:54.244 INFO:tasks.workunit.client.1.smithi191.stdout:0/78: creat d0/d9/d13/f18 x:0 0 0 2024-09-19T09:34:54.244 INFO:tasks.workunit.client.1.smithi191.stdout:0/79: write d0/f3 [919526,68894] 0 2024-09-19T09:34:54.245 INFO:tasks.workunit.client.1.smithi191.stdout:8/84: dread d1/d7/fe [0,4194304] 0 2024-09-19T09:34:54.245 INFO:tasks.workunit.client.1.smithi191.stdout:7/36: dwrite d2/f7 [0,4194304] 0 2024-09-19T09:34:54.245 INFO:tasks.workunit.client.1.smithi191.stdout:8/85: creat d1/d7/d8/d17/f1e x:0 0 0 2024-09-19T09:34:54.249 INFO:tasks.workunit.client.1.smithi191.stdout:8/86: rename d1/d7/d8/d17/f1c to d1/d7/d1a/f1f 0 2024-09-19T09:34:54.251 INFO:tasks.workunit.client.1.smithi191.stdout:8/87: write d1/f15 [177070,101862] 0 2024-09-19T09:34:54.252 INFO:tasks.workunit.client.1.smithi191.stdout:8/88: symlink d1/d7/d1a/l20 0 2024-09-19T09:34:54.261 INFO:tasks.workunit.client.1.smithi191.stdout:7/37: write d2/fc [573394,56661] 0 2024-09-19T09:34:54.261 INFO:tasks.workunit.client.1.smithi191.stdout:1/34: dwrite f0 [4194304,4194304] 0 2024-09-19T09:34:54.264 INFO:tasks.workunit.client.1.smithi191.stdout:1/35: mkdir d3/d9/da/db 0 2024-09-19T09:34:54.264 INFO:tasks.workunit.client.1.smithi191.stdout:1/36: readlink d3/l7 0 2024-09-19T09:34:54.266 INFO:tasks.workunit.client.1.smithi191.stdout:5/76: dwrite d0/d4/d9/de/f18 [0,4194304] 0 2024-09-19T09:34:54.266 INFO:tasks.workunit.client.1.smithi191.stdout:3/69: dwrite d12/d13/f19 [0,4194304] 0 2024-09-19T09:34:54.267 INFO:tasks.workunit.client.1.smithi191.stdout:8/89: dread d1/d16/f19 [0,4194304] 0 2024-09-19T09:34:54.267 INFO:tasks.workunit.client.1.smithi191.stdout:9/38: dwrite d3/f6 [0,4194304] 0 2024-09-19T09:34:54.268 INFO:tasks.workunit.client.1.smithi191.stdout:1/37: mkdir d3/d9/da/dc 0 2024-09-19T09:34:54.270 INFO:tasks.workunit.client.1.smithi191.stdout:4/143: dwrite f2 [0,4194304] 0 2024-09-19T09:34:54.270 INFO:tasks.workunit.client.1.smithi191.stdout:4/144: truncate d5/f18 1597437 0 2024-09-19T09:34:54.276 INFO:tasks.workunit.client.1.smithi191.stdout:0/80: rmdir d0/d9 39 2024-09-19T09:34:54.278 INFO:tasks.workunit.client.1.smithi191.stdout:9/39: creat d3/d8/fc x:0 0 0 2024-09-19T09:34:54.279 INFO:tasks.workunit.client.1.smithi191.stdout:8/90: creat d1/d7/d1a/f21 x:0 0 0 2024-09-19T09:34:54.279 INFO:tasks.workunit.client.1.smithi191.stdout:4/145: dread f2 [0,4194304] 0 2024-09-19T09:34:54.279 INFO:tasks.workunit.client.1.smithi191.stdout:4/146: write d5/d1b/d1c/d24/d32/f13 [837280,60496] 0 2024-09-19T09:34:54.282 INFO:tasks.workunit.client.0.smithi112.stderr:++ readlink -f fsstress 2024-09-19T09:34:54.283 INFO:tasks.workunit.client.0.smithi112.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-19T09:34:54.283 INFO:tasks.workunit.client.0.smithi112.stderr:+ popd 2024-09-19T09:34:54.283 INFO:tasks.workunit.client.0.smithi112.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T09:34:54.283 INFO:tasks.workunit.client.0.smithi112.stderr:+ popd 2024-09-19T09:34:54.284 INFO:tasks.workunit.client.0.smithi112.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-19T09:34:54.284 INFO:tasks.workunit.client.0.smithi112.stderr:++ mktemp -d -p . 2024-09-19T09:34:54.285 INFO:tasks.workunit.client.0.smithi112.stderr:+ T=./tmp.ZMKU71bKrT 2024-09-19T09:34:54.286 INFO:tasks.workunit.client.0.smithi112.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.ZMKU71bKrT -l 1 -n 1000 -p 10 -v 2024-09-19T09:34:54.287 INFO:tasks.workunit.client.1.smithi191.stdout:1/38: truncate d3/f5 2915591 0 2024-09-19T09:34:54.287 INFO:tasks.workunit.client.1.smithi191.stdout:1/39: fdatasync d3/f5 0 2024-09-19T09:34:54.288 INFO:tasks.workunit.client.1.smithi191.stdout:7/38: dwrite d2/f7 [0,4194304] 0 2024-09-19T09:34:54.288 INFO:tasks.workunit.client.1.smithi191.stdout:7/39: fdatasync d2/fd 0 2024-09-19T09:34:54.288 INFO:tasks.workunit.client.0.smithi112.stdout:seed = 1726977480 2024-09-19T09:34:54.289 INFO:tasks.workunit.client.1.smithi191.stdout:3/70: dwrite d12/f18 [0,4194304] 0 2024-09-19T09:34:54.289 INFO:tasks.workunit.client.1.smithi191.stdout:3/71: dread - fe zero size 2024-09-19T09:34:54.290 INFO:tasks.workunit.client.1.smithi191.stdout:0/81: link d0/d9/f11 d0/d9/de/f19 0 2024-09-19T09:34:54.292 INFO:tasks.workunit.client.1.smithi191.stdout:9/40: link d3/d8/fc d3/db/fd 0 2024-09-19T09:34:54.292 INFO:tasks.workunit.client.1.smithi191.stdout:9/41: write d3/d8/fc [146005,108678] 0 2024-09-19T09:34:54.295 INFO:tasks.workunit.client.1.smithi191.stdout:4/147: creat d5/d1b/d1c/d2f/d19/f3a x:0 0 0 2024-09-19T09:34:54.297 INFO:tasks.workunit.client.1.smithi191.stdout:9/42: dread d3/db/fd [0,4194304] 0 2024-09-19T09:34:54.297 INFO:tasks.workunit.client.1.smithi191.stdout:1/40: creat d3/d9/da/db/fd x:0 0 0 2024-09-19T09:34:54.297 INFO:tasks.workunit.client.1.smithi191.stdout:1/41: chown d3/d9/da/db 85224668 1 2024-09-19T09:34:54.298 INFO:tasks.workunit.client.0.smithi112.stdout:1/0: unlink - no file 2024-09-19T09:34:54.298 INFO:tasks.workunit.client.0.smithi112.stdout:1/1: dwrite - no filename 2024-09-19T09:34:54.298 INFO:tasks.workunit.client.0.smithi112.stdout:1/2: fdatasync - no filename 2024-09-19T09:34:54.298 INFO:tasks.workunit.client.0.smithi112.stdout:1/3: unlink - no file 2024-09-19T09:34:54.298 INFO:tasks.workunit.client.0.smithi112.stdout:1/4: dread - no filename 2024-09-19T09:34:54.298 INFO:tasks.workunit.client.0.smithi112.stdout:1/5: truncate - no filename 2024-09-19T09:34:54.298 INFO:tasks.workunit.client.0.smithi112.stdout:1/6: readlink - no filename 2024-09-19T09:34:54.299 INFO:tasks.workunit.client.0.smithi112.stdout:1/7: chown . 39568 1 2024-09-19T09:34:54.299 INFO:tasks.workunit.client.0.smithi112.stdout:0/0: mknod c0 0 2024-09-19T09:34:54.299 INFO:tasks.workunit.client.1.smithi191.stdout:7/40: mkdir d2/de 0 2024-09-19T09:34:54.299 INFO:tasks.workunit.client.1.smithi191.stdout:7/41: chown d2/la 156620 1 2024-09-19T09:34:54.300 INFO:tasks.workunit.client.1.smithi191.stdout:3/72: dread d12/d13/f19 [0,4194304] 0 2024-09-19T09:34:54.301 INFO:tasks.workunit.client.1.smithi191.stdout:3/73: readlink lb 0 2024-09-19T09:34:54.301 INFO:tasks.workunit.client.0.smithi112.stdout:1/8: creat f0 x:0 0 0 2024-09-19T09:34:54.301 INFO:tasks.workunit.client.0.smithi112.stdout:1/9: creat f1 x:0 0 0 2024-09-19T09:34:54.302 INFO:tasks.workunit.client.0.smithi112.stdout:0/1: symlink l1 0 2024-09-19T09:34:54.306 INFO:tasks.workunit.client.0.smithi112.stdout:3/0: fdatasync - no filename 2024-09-19T09:34:54.307 INFO:tasks.workunit.client.0.smithi112.stdout:3/1: rmdir - no directory 2024-09-19T09:34:54.307 INFO:tasks.workunit.client.0.smithi112.stdout:3/2: write - no filename 2024-09-19T09:34:54.307 INFO:tasks.workunit.client.0.smithi112.stdout:3/3: dwrite - no filename 2024-09-19T09:34:54.307 INFO:tasks.workunit.client.0.smithi112.stdout:3/4: chown . 410 1 2024-09-19T09:34:54.307 INFO:tasks.workunit.client.0.smithi112.stdout:3/5: write - no filename 2024-09-19T09:34:54.307 INFO:tasks.workunit.client.0.smithi112.stdout:3/6: write - no filename 2024-09-19T09:34:54.308 INFO:tasks.workunit.client.1.smithi191.stdout:2/85: sync 2024-09-19T09:34:54.308 INFO:tasks.workunit.client.1.smithi191.stdout:2/86: truncate d8/db/d13/f15 27495 0 2024-09-19T09:34:54.308 INFO:tasks.workunit.client.1.smithi191.stdout:2/87: chown d8/f9 402 1 2024-09-19T09:34:54.308 INFO:tasks.workunit.client.1.smithi191.stdout:8/91: rmdir d1/d7/d1a 39 2024-09-19T09:34:54.309 INFO:tasks.workunit.client.0.smithi112.stdout:2/0: mkdir d0 0 2024-09-19T09:34:54.309 INFO:tasks.workunit.client.0.smithi112.stdout:2/1: readlink - no filename 2024-09-19T09:34:54.310 INFO:tasks.workunit.client.1.smithi191.stdout:9/43: creat d3/fe x:0 0 0 2024-09-19T09:34:54.312 INFO:tasks.workunit.client.1.smithi191.stdout:0/82: dwrite d0/d9/d13/f18 [0,4194304] 0 2024-09-19T09:34:54.313 INFO:tasks.workunit.client.1.smithi191.stdout:7/42: rmdir d2/de 0 2024-09-19T09:34:54.316 INFO:tasks.workunit.client.0.smithi112.stdout:0/2: mkdir d2 0 2024-09-19T09:34:54.316 INFO:tasks.workunit.client.0.smithi112.stdout:0/3: truncate - no filename 2024-09-19T09:34:54.317 INFO:tasks.workunit.client.1.smithi191.stdout:1/42: write d3/f4 [1436673,45584] 0 2024-09-19T09:34:54.317 INFO:tasks.workunit.client.1.smithi191.stdout:3/74: mknod d12/d13/d1a/c21 0 2024-09-19T09:34:54.318 INFO:tasks.workunit.client.0.smithi112.stdout:3/7: symlink l0 0 2024-09-19T09:34:54.319 INFO:tasks.workunit.client.0.smithi112.stdout:3/8: dwrite - no filename 2024-09-19T09:34:54.321 INFO:tasks.workunit.client.1.smithi191.stdout:4/148: dwrite d5/d1b/d1c/f29 [0,4194304] 0 2024-09-19T09:34:54.322 INFO:tasks.workunit.client.0.smithi112.stdout:1/10: dwrite f1 [0,4194304] 0 2024-09-19T09:34:54.323 INFO:tasks.workunit.client.0.smithi112.stdout:2/2: mkdir d0/d1 0 2024-09-19T09:34:54.328 INFO:tasks.workunit.client.0.smithi112.stdout:0/4: unlink l1 0 2024-09-19T09:34:54.328 INFO:tasks.workunit.client.0.smithi112.stdout:0/5: dread - no filename 2024-09-19T09:34:54.329 INFO:tasks.workunit.client.1.smithi191.stdout:0/83: creat d0/d9/f1a x:0 0 0 2024-09-19T09:34:54.329 INFO:tasks.workunit.client.1.smithi191.stdout:0/84: write d0/f4 [2547988,18184] 0 2024-09-19T09:34:54.330 INFO:tasks.workunit.client.0.smithi112.stdout:3/9: mknod c1 0 2024-09-19T09:34:54.330 INFO:tasks.workunit.client.0.smithi112.stdout:3/10: dread - no filename 2024-09-19T09:34:54.331 INFO:tasks.workunit.client.0.smithi112.stdout:3/11: read - no filename 2024-09-19T09:34:54.331 INFO:tasks.workunit.client.0.smithi112.stdout:3/12: write - no filename 2024-09-19T09:34:54.333 INFO:tasks.workunit.client.1.smithi191.stdout:2/88: dwrite f6 [0,4194304] 0 2024-09-19T09:34:54.333 INFO:tasks.workunit.client.1.smithi191.stdout:1/43: creat d3/d9/fe x:0 0 0 2024-09-19T09:34:54.334 INFO:tasks.workunit.client.0.smithi112.stdout:4/0: creat f0 x:0 0 0 2024-09-19T09:34:54.335 INFO:tasks.workunit.client.1.smithi191.stdout:8/92: write d1/f10 [679791,51897] 0 2024-09-19T09:34:54.335 INFO:tasks.workunit.client.1.smithi191.stdout:8/93: truncate d1/d7/d1a/f21 140971 0 2024-09-19T09:34:54.336 INFO:tasks.workunit.client.1.smithi191.stdout:3/75: truncate d12/f15 7098943 0 2024-09-19T09:34:54.343 INFO:tasks.workunit.client.0.smithi112.stdout:0/6: creat d2/f3 x:0 0 0 2024-09-19T09:34:54.343 INFO:tasks.workunit.client.0.smithi112.stdout:0/7: chown d2 232 1 2024-09-19T09:34:54.343 INFO:tasks.workunit.client.0.smithi112.stdout:0/8: chown c0 7329 1 2024-09-19T09:34:54.344 INFO:tasks.workunit.client.1.smithi191.stdout:0/85: creat d0/d9/d13/f1b x:0 0 0 2024-09-19T09:34:54.344 INFO:tasks.workunit.client.0.smithi112.stdout:3/13: mknod c2 0 2024-09-19T09:34:54.345 INFO:tasks.workunit.client.1.smithi191.stdout:2/89: mkdir d8/d11/d17 0 2024-09-19T09:34:54.346 INFO:tasks.workunit.client.1.smithi191.stdout:2/90: write d8/db/f14 [656266,44976] 0 2024-09-19T09:34:54.346 INFO:tasks.workunit.client.1.smithi191.stdout:9/44: dwrite d3/fe [0,4194304] 0 2024-09-19T09:34:54.346 INFO:tasks.workunit.client.1.smithi191.stdout:9/45: creat d3/ff x:0 0 0 2024-09-19T09:34:54.346 INFO:tasks.workunit.client.0.smithi112.stdout:6/0: write - no filename 2024-09-19T09:34:54.347 INFO:tasks.workunit.client.0.smithi112.stdout:6/1: rename - no filename 2024-09-19T09:34:54.347 INFO:tasks.workunit.client.0.smithi112.stdout:6/2: link - no file 2024-09-19T09:34:54.347 INFO:tasks.workunit.client.0.smithi112.stdout:6/3: getdents . 0 2024-09-19T09:34:54.347 INFO:tasks.workunit.client.0.smithi112.stdout:6/4: dwrite - no filename 2024-09-19T09:34:54.347 INFO:tasks.workunit.client.0.smithi112.stdout:6/5: read - no filename 2024-09-19T09:34:54.347 INFO:tasks.workunit.client.0.smithi112.stdout:2/3: getdents d0 0 2024-09-19T09:34:54.347 INFO:tasks.workunit.client.0.smithi112.stdout:2/4: rename d0/d1 to d0/d1/d2 22 2024-09-19T09:34:54.347 INFO:tasks.workunit.client.0.smithi112.stdout:2/5: fdatasync - no filename 2024-09-19T09:34:54.347 INFO:tasks.workunit.client.0.smithi112.stdout:2/6: dwrite - no filename 2024-09-19T09:34:54.347 INFO:tasks.workunit.client.0.smithi112.stdout:2/7: dwrite - no filename 2024-09-19T09:34:54.348 INFO:tasks.workunit.client.0.smithi112.stdout:5/0: mknod c0 0 2024-09-19T09:34:54.349 INFO:tasks.workunit.client.1.smithi191.stdout:3/76: mknod d12/d13/d1a/d1b/c22 0 2024-09-19T09:34:54.349 INFO:tasks.workunit.client.1.smithi191.stdout:3/77: fsync f11 0 2024-09-19T09:34:54.349 INFO:tasks.workunit.client.0.smithi112.stdout:1/11: dwrite f1 [0,4194304] 0 2024-09-19T09:34:54.349 INFO:tasks.workunit.client.0.smithi112.stdout:1/12: fsync f1 0 2024-09-19T09:34:54.351 INFO:tasks.workunit.client.0.smithi112.stdout:3/14: unlink l0 0 2024-09-19T09:34:54.351 INFO:tasks.workunit.client.0.smithi112.stdout:3/15: fdatasync - no filename 2024-09-19T09:34:54.356 INFO:tasks.workunit.client.0.smithi112.stdout:7/0: truncate - no filename 2024-09-19T09:34:54.358 INFO:tasks.workunit.client.0.smithi112.stdout:6/6: mknod c0 0 2024-09-19T09:34:54.358 INFO:tasks.workunit.client.0.smithi112.stdout:6/7: dwrite - no filename 2024-09-19T09:34:54.358 INFO:tasks.workunit.client.0.smithi112.stdout:6/8: fsync - no filename 2024-09-19T09:34:54.358 INFO:tasks.workunit.client.0.smithi112.stdout:6/9: chown c0 61910483 1 2024-09-19T09:34:54.360 INFO:tasks.workunit.client.0.smithi112.stdout:2/8: symlink d0/d1/l3 0 2024-09-19T09:34:54.360 INFO:tasks.workunit.client.0.smithi112.stdout:2/9: write - no filename 2024-09-19T09:34:54.362 INFO:tasks.workunit.client.0.smithi112.stdout:5/1: symlink l1 0 2024-09-19T09:34:54.364 INFO:tasks.workunit.client.1.smithi191.stdout:8/94: mkdir d1/d22 0 2024-09-19T09:34:54.366 INFO:tasks.workunit.client.1.smithi191.stdout:2/91: dread d8/db/d13/f16 [0,4194304] 0 2024-09-19T09:34:54.367 INFO:tasks.workunit.client.1.smithi191.stdout:9/46: write d3/fe [166099,83450] 0 2024-09-19T09:34:54.367 INFO:tasks.workunit.client.1.smithi191.stdout:7/43: dwrite d2/f9 [0,4194304] 0 2024-09-19T09:34:54.367 INFO:tasks.workunit.client.1.smithi191.stdout:7/44: creat d2/ff x:0 0 0 2024-09-19T09:34:54.367 INFO:tasks.workunit.client.1.smithi191.stdout:7/45: readlink d2/l6 0 2024-09-19T09:34:54.375 INFO:tasks.workunit.client.0.smithi112.stdout:0/9: getdents d2 0 2024-09-19T09:34:54.375 INFO:tasks.workunit.client.0.smithi112.stdout:0/10: dread - d2/f3 zero size 2024-09-19T09:34:54.375 INFO:tasks.workunit.client.0.smithi112.stdout:0/11: chown c0 1 1 2024-09-19T09:34:54.375 INFO:tasks.workunit.client.0.smithi112.stdout:0/12: chown d2/f3 198935657 1 2024-09-19T09:34:54.376 INFO:tasks.workunit.client.1.smithi191.stdout:0/86: rmdir d0/d9 39 2024-09-19T09:34:54.376 INFO:tasks.workunit.client.0.smithi112.stdout:4/1: dwrite f0 [0,4194304] 0 2024-09-19T09:34:54.377 INFO:tasks.workunit.client.0.smithi112.stdout:1/13: rename f0 to f2 0 2024-09-19T09:34:54.380 INFO:tasks.workunit.client.1.smithi191.stdout:4/149: truncate d5/d1b/d1c/d24/d32/f13 406623 0 2024-09-19T09:34:54.385 INFO:tasks.workunit.client.1.smithi191.stdout:2/92: mknod d8/d11/d17/c18 0 2024-09-19T09:34:54.386 INFO:tasks.workunit.client.0.smithi112.stdout:8/0: dread - no filename 2024-09-19T09:34:54.387 INFO:tasks.workunit.client.0.smithi112.stdout:8/1: dread - no filename 2024-09-19T09:34:54.387 INFO:tasks.workunit.client.0.smithi112.stdout:7/1: symlink l0 0 2024-09-19T09:34:54.395 INFO:tasks.workunit.client.0.smithi112.stdout:2/10: symlink d0/d1/l4 0 2024-09-19T09:34:54.395 INFO:tasks.workunit.client.0.smithi112.stdout:6/10: symlink l1 0 2024-09-19T09:34:54.395 INFO:tasks.workunit.client.0.smithi112.stdout:5/2: rename c0 to c2 0 2024-09-19T09:34:54.398 INFO:tasks.workunit.client.0.smithi112.stdout:8/2: creat f0 x:0 0 0 2024-09-19T09:34:54.398 INFO:tasks.workunit.client.0.smithi112.stdout:8/3: write f0 [660256,44779] 0 2024-09-19T09:34:54.401 INFO:tasks.workunit.client.0.smithi112.stdout:7/2: rename l0 to l1 0 2024-09-19T09:34:54.401 INFO:tasks.workunit.client.0.smithi112.stdout:7/3: dread - no filename 2024-09-19T09:34:54.406 INFO:tasks.workunit.client.1.smithi191.stdout:7/46: truncate d2/f8 1138773 0 2024-09-19T09:34:54.407 INFO:tasks.workunit.client.1.smithi191.stdout:8/95: write d1/f10 [6689816,67271] 0 2024-09-19T09:34:54.407 INFO:tasks.workunit.client.1.smithi191.stdout:8/96: fsync d1/d7/d1a/f21 0 2024-09-19T09:34:54.409 INFO:tasks.workunit.client.0.smithi112.stdout:6/11: mknod c2 0 2024-09-19T09:34:54.409 INFO:tasks.workunit.client.0.smithi112.stdout:2/11: creat d0/f5 x:0 0 0 2024-09-19T09:34:54.410 INFO:tasks.workunit.client.1.smithi191.stdout:0/87: mkdir d0/d9/d1c 0 2024-09-19T09:34:54.411 INFO:tasks.workunit.client.1.smithi191.stdout:4/150: unlink f2 0 2024-09-19T09:34:54.417 INFO:tasks.workunit.client.0.smithi112.stdout:6/12: link c2 c3 0 2024-09-19T09:34:54.417 INFO:tasks.workunit.client.0.smithi112.stdout:6/13: chown c3 42960 1 2024-09-19T09:34:54.417 INFO:tasks.workunit.client.0.smithi112.stdout:9/0: creat f0 x:0 0 0 2024-09-19T09:34:54.417 INFO:tasks.workunit.client.1.smithi191.stdout:8/97: mkdir d1/d16/d23 0 2024-09-19T09:34:54.418 INFO:tasks.workunit.client.1.smithi191.stdout:0/88: mkdir d0/d9/d1c/d1d 0 2024-09-19T09:34:54.418 INFO:tasks.workunit.client.1.smithi191.stdout:4/151: mknod d5/d1b/c3b 0 2024-09-19T09:34:54.421 INFO:tasks.workunit.client.0.smithi112.stdout:6/14: unlink c2 0 2024-09-19T09:34:54.421 INFO:tasks.workunit.client.0.smithi112.stdout:6/15: write - no filename 2024-09-19T09:34:54.421 INFO:tasks.workunit.client.0.smithi112.stdout:6/16: chown c3 3660403 1 2024-09-19T09:34:54.421 INFO:tasks.workunit.client.0.smithi112.stdout:9/1: symlink l1 0 2024-09-19T09:34:54.423 INFO:tasks.workunit.client.0.smithi112.stdout:6/17: symlink l4 0 2024-09-19T09:34:54.424 INFO:tasks.workunit.client.0.smithi112.stdout:6/18: creat f5 x:0 0 0 2024-09-19T09:34:54.425 INFO:tasks.workunit.client.0.smithi112.stdout:6/19: truncate f5 841549 0 2024-09-19T09:34:54.425 INFO:tasks.workunit.client.0.smithi112.stdout:6/20: creat f6 x:0 0 0 2024-09-19T09:34:54.428 INFO:tasks.workunit.client.0.smithi112.stdout:6/21: symlink l7 0 2024-09-19T09:34:54.428 INFO:tasks.workunit.client.0.smithi112.stdout:6/22: chown c0 1987717 1 2024-09-19T09:34:54.428 INFO:tasks.workunit.client.0.smithi112.stdout:6/23: write f6 [462758,116158] 0 2024-09-19T09:34:54.431 INFO:tasks.workunit.client.0.smithi112.stdout:6/24: mkdir d8 0 2024-09-19T09:34:54.460 INFO:tasks.workunit.client.1.smithi191.stdout:3/78: dwrite d12/f1e [0,4194304] 0 2024-09-19T09:34:54.473 INFO:tasks.workunit.client.1.smithi191.stdout:3/79: mknod d12/d13/c23 0 2024-09-19T09:34:54.473 INFO:tasks.workunit.client.1.smithi191.stdout:3/80: write d12/f15 [1895789,35417] 0 2024-09-19T09:34:54.473 INFO:tasks.workunit.client.1.smithi191.stdout:3/81: rename d12/d13/d1a/d1b to d12/d13/d1a/d1b/d24 22 2024-09-19T09:34:54.475 INFO:tasks.workunit.client.1.smithi191.stdout:3/82: stat d12/d13/d1a/d1b/c1f 0 2024-09-19T09:34:54.476 INFO:tasks.workunit.client.1.smithi191.stdout:3/83: creat d12/f25 x:0 0 0 2024-09-19T09:34:54.483 INFO:tasks.workunit.client.1.smithi191.stdout:3/84: mknod d12/d13/c26 0 2024-09-19T09:34:54.511 INFO:tasks.workunit.client.1.smithi191.stdout:3/85: write d12/d13/f19 [3546735,50011] 0 2024-09-19T09:34:54.511 INFO:tasks.workunit.client.1.smithi191.stdout:3/86: stat l5 0 2024-09-19T09:34:54.511 INFO:tasks.workunit.client.1.smithi191.stdout:3/87: write d12/d13/f19 [2449468,125042] 0 2024-09-19T09:34:54.516 INFO:tasks.workunit.client.1.smithi191.stdout:0/89: write d0/d9/de/f10 [413415,48381] 0 2024-09-19T09:34:54.519 INFO:tasks.workunit.client.1.smithi191.stdout:0/90: symlink d0/d9/d13/l1e 0 2024-09-19T09:34:54.634 INFO:tasks.workunit.client.1.smithi191.stdout:8/98: dwrite d1/d7/d8/fc [0,4194304] 0 2024-09-19T09:34:54.634 INFO:tasks.workunit.client.1.smithi191.stdout:8/99: write d1/d7/fe [4900154,26390] 0 2024-09-19T09:34:54.648 INFO:tasks.workunit.client.0.smithi112.stdout:1/14: dread f1 [0,4194304] 0 2024-09-19T09:34:54.665 INFO:tasks.workunit.client.1.smithi191.stdout:9/47: fsync d3/fe 0 2024-09-19T09:34:54.665 INFO:tasks.workunit.client.1.smithi191.stdout:9/48: dread - d3/ff zero size 2024-09-19T09:34:54.683 INFO:tasks.workunit.client.1.smithi191.stdout:9/49: getdents d3 0 2024-09-19T09:34:54.686 INFO:tasks.workunit.client.1.smithi191.stdout:9/50: creat d3/db/f10 x:0 0 0 2024-09-19T09:34:54.686 INFO:tasks.workunit.client.1.smithi191.stdout:9/51: write f2 [635927,70423] 0 2024-09-19T09:34:54.707 INFO:tasks.workunit.client.1.smithi191.stdout:0/91: write d0/f8 [689448,5954] 0 2024-09-19T09:34:54.710 INFO:tasks.workunit.client.1.smithi191.stdout:0/92: rename d0/d9/d1c/d1d to d0/d9/d1c/d1f 0 2024-09-19T09:34:54.713 INFO:tasks.workunit.client.1.smithi191.stdout:0/93: mkdir d0/d9/d1c/d20 0 2024-09-19T09:34:54.729 INFO:tasks.workunit.client.1.smithi191.stdout:4/152: dwrite d5/f18 [0,4194304] 0 2024-09-19T09:34:54.729 INFO:tasks.workunit.client.1.smithi191.stdout:4/153: fsync f4 0 2024-09-19T09:34:54.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:54 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:54 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:54 smithi191 ceph-mon[34834]: pgmap v9: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s rd, 7.9 MiB/s wr, 264 op/s 2024-09-19T09:34:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:54 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:54 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:54 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:54 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:54 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:54 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:54 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:54 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:54 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:54.787 INFO:tasks.workunit.client.0.smithi112.stdout:4/2: dread f0 [0,4194304] 0 2024-09-19T09:34:54.793 INFO:tasks.workunit.client.0.smithi112.stdout:5/3: rename c2 to c3 0 2024-09-19T09:34:54.797 INFO:tasks.workunit.client.0.smithi112.stdout:7/4: getdents . 0 2024-09-19T09:34:54.797 INFO:tasks.workunit.client.0.smithi112.stdout:7/5: dwrite - no filename 2024-09-19T09:34:54.799 INFO:tasks.workunit.client.1.smithi191.stdout:7/47: truncate d2/fc 1887862 0 2024-09-19T09:34:54.821 INFO:tasks.workunit.client.0.smithi112.stdout:2/12: fsync d0/f5 0 2024-09-19T09:34:54.821 INFO:tasks.workunit.client.0.smithi112.stdout:2/13: fdatasync d0/f5 0 2024-09-19T09:34:54.898 INFO:tasks.workunit.client.0.smithi112.stdout:9/2: getdents . 0 2024-09-19T09:34:54.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:54 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:54.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:54 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:54.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:54 smithi112 ceph-mon[27605]: pgmap v9: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s rd, 7.9 MiB/s wr, 264 op/s 2024-09-19T09:34:54.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:54 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:54.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:54 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:54.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:54 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:54 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:54 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:54 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:54 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:54 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:54 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:54.964 INFO:tasks.workunit.client.1.smithi191.stdout:2/93: dread f6 [4194304,4194304] 0 2024-09-19T09:34:54.968 INFO:tasks.workunit.client.1.smithi191.stdout:0/94: dwrite d0/f3 [0,4194304] 0 2024-09-19T09:34:54.968 INFO:tasks.workunit.client.1.smithi191.stdout:0/95: write d0/d9/f1a [509294,18368] 0 2024-09-19T09:34:54.968 INFO:tasks.workunit.client.1.smithi191.stdout:0/96: stat d0/fd 0 2024-09-19T09:34:55.001 INFO:tasks.workunit.client.1.smithi191.stdout:3/88: write d12/f1e [186007,107962] 0 2024-09-19T09:34:55.042 INFO:tasks.workunit.client.1.smithi191.stdout:8/100: write d1/d7/fe [816593,116849] 0 2024-09-19T09:34:55.055 INFO:tasks.workunit.client.1.smithi191.stdout:8/101: creat d1/d7/f24 x:0 0 0 2024-09-19T09:34:55.060 INFO:tasks.workunit.client.1.smithi191.stdout:8/102: creat d1/d7/d1a/f25 x:0 0 0 2024-09-19T09:34:55.061 INFO:tasks.workunit.client.1.smithi191.stdout:2/94: dread d8/db/f14 [0,4194304] 0 2024-09-19T09:34:55.067 INFO:tasks.workunit.client.1.smithi191.stdout:2/95: creat d8/f19 x:0 0 0 2024-09-19T09:34:55.073 INFO:tasks.workunit.client.1.smithi191.stdout:8/103: write d1/d16/f19 [2703159,34918] 0 2024-09-19T09:34:55.073 INFO:tasks.workunit.client.1.smithi191.stdout:8/104: fdatasync d1/d7/d1a/f25 0 2024-09-19T09:34:55.085 INFO:tasks.workunit.client.1.smithi191.stdout:8/105: rename d1/c1d to d1/d22/c26 0 2024-09-19T09:34:55.085 INFO:tasks.workunit.client.1.smithi191.stdout:8/106: truncate d1/d7/f24 905827 0 2024-09-19T09:34:55.094 INFO:tasks.workunit.client.0.smithi112.stdout:4/3: dread f0 [0,4194304] 0 2024-09-19T09:34:55.094 INFO:tasks.workunit.client.1.smithi191.stdout:8/107: mknod d1/d16/c27 0 2024-09-19T09:34:55.095 INFO:tasks.workunit.client.1.smithi191.stdout:8/108: truncate d1/d16/f19 5093480 0 2024-09-19T09:34:55.109 INFO:tasks.workunit.client.0.smithi112.stdout:4/4: dread f0 [0,4194304] 0 2024-09-19T09:34:55.109 INFO:tasks.workunit.client.0.smithi112.stdout:4/5: chown f0 9688271 1 2024-09-19T09:34:55.109 INFO:tasks.workunit.client.1.smithi191.stdout:8/109: dread d1/d7/d8/fc [0,4194304] 0 2024-09-19T09:34:55.109 INFO:tasks.workunit.client.1.smithi191.stdout:8/110: getdents d1/d16/d23 0 2024-09-19T09:34:55.124 INFO:tasks.workunit.client.1.smithi191.stdout:2/96: dwrite d8/db/d13/f16 [0,4194304] 0 2024-09-19T09:34:55.129 INFO:tasks.workunit.client.1.smithi191.stdout:0/97: dread d0/d9/f1a [0,4194304] 0 2024-09-19T09:34:55.129 INFO:tasks.workunit.client.1.smithi191.stdout:0/98: readlink d0/d9/d13/l1e 0 2024-09-19T09:34:55.130 INFO:tasks.workunit.client.1.smithi191.stdout:8/111: dread d1/d7/f24 [0,4194304] 0 2024-09-19T09:34:55.130 INFO:tasks.workunit.client.1.smithi191.stdout:8/112: readlink d1/d7/d8/d17/l1b 0 2024-09-19T09:34:55.132 INFO:tasks.workunit.client.1.smithi191.stdout:8/113: dread d1/d7/f24 [0,4194304] 0 2024-09-19T09:34:55.145 INFO:tasks.workunit.client.1.smithi191.stdout:0/99: mknod d0/c21 0 2024-09-19T09:34:55.146 INFO:tasks.workunit.client.1.smithi191.stdout:0/100: write d0/d9/f11 [456456,46222] 0 2024-09-19T09:34:55.146 INFO:tasks.workunit.client.1.smithi191.stdout:0/101: dread - d0/d9/d13/f16 zero size 2024-09-19T09:34:55.158 INFO:tasks.workunit.client.0.smithi112.stdout:0/13: dwrite d2/f3 [0,4194304] 0 2024-09-19T09:34:55.161 INFO:tasks.workunit.client.1.smithi191.stdout:0/102: dread d0/d9/d13/f18 [0,4194304] 0 2024-09-19T09:34:55.167 INFO:tasks.workunit.client.1.smithi191.stdout:0/103: write d0/fd [119452,56192] 0 2024-09-19T09:34:55.172 INFO:tasks.workunit.client.1.smithi191.stdout:0/104: creat d0/d9/f22 x:0 0 0 2024-09-19T09:34:55.178 INFO:tasks.workunit.client.1.smithi191.stdout:0/105: unlink d0/f3 0 2024-09-19T09:34:55.178 INFO:tasks.workunit.client.1.smithi191.stdout:0/106: chown d0/d9/d1c 1 1 2024-09-19T09:34:55.182 INFO:tasks.workunit.client.1.smithi191.stdout:2/97: dwrite d8/db/d13/f16 [0,4194304] 0 2024-09-19T09:34:55.185 INFO:tasks.workunit.client.1.smithi191.stdout:0/107: creat d0/d9/d1c/d1f/f23 x:0 0 0 2024-09-19T09:34:55.187 INFO:tasks.workunit.client.1.smithi191.stdout:2/98: rename d8/de/l10 to d8/de/l1a 0 2024-09-19T09:34:55.187 INFO:tasks.workunit.client.1.smithi191.stdout:2/99: fsync f0 0 2024-09-19T09:34:55.188 INFO:tasks.workunit.client.1.smithi191.stdout:0/108: mkdir d0/d9/d1c/d1f/d24 0 2024-09-19T09:34:55.188 INFO:tasks.workunit.client.1.smithi191.stdout:0/109: dread - d0/d9/d1c/d1f/f23 zero size 2024-09-19T09:34:55.189 INFO:tasks.workunit.client.1.smithi191.stdout:0/110: read d0/d9/f1a [234314,23492] 0 2024-09-19T09:34:55.190 INFO:tasks.workunit.client.1.smithi191.stdout:0/111: read d0/fd [2983725,100550] 0 2024-09-19T09:34:55.192 INFO:tasks.workunit.client.1.smithi191.stdout:0/112: dread d0/d9/f1a [0,4194304] 0 2024-09-19T09:34:55.196 INFO:tasks.workunit.client.1.smithi191.stdout:8/114: dwrite d1/d7/d8/fc [4194304,4194304] 0 2024-09-19T09:34:55.199 INFO:tasks.workunit.client.1.smithi191.stdout:8/115: write d1/f14 [748393,28611] 0 2024-09-19T09:34:55.199 INFO:tasks.workunit.client.1.smithi191.stdout:8/116: chown d1/d22 7599264 1 2024-09-19T09:34:55.220 INFO:tasks.workunit.client.0.smithi112.stdout:8/4: dwrite f0 [0,4194304] 0 2024-09-19T09:34:55.225 INFO:tasks.workunit.client.1.smithi191.stdout:2/100: dwrite d8/db/f14 [0,4194304] 0 2024-09-19T09:34:55.228 INFO:tasks.workunit.client.1.smithi191.stdout:0/113: dwrite d0/d9/f22 [0,4194304] 0 2024-09-19T09:34:55.228 INFO:tasks.workunit.client.1.smithi191.stdout:0/114: stat d0/d9/d13/f16 0 2024-09-19T09:34:55.238 INFO:tasks.workunit.client.1.smithi191.stdout:3/89: dread d12/d13/f17 [0,4194304] 0 2024-09-19T09:34:55.238 INFO:tasks.workunit.client.1.smithi191.stdout:3/90: chown ff 83 1 2024-09-19T09:34:55.239 INFO:tasks.workunit.client.1.smithi191.stdout:0/115: write d0/d9/d13/f18 [1382956,122449] 0 2024-09-19T09:34:55.239 INFO:tasks.workunit.client.1.smithi191.stdout:0/116: creat d0/d9/f25 x:0 0 0 2024-09-19T09:34:55.245 INFO:tasks.workunit.client.1.smithi191.stdout:0/117: mknod d0/d9/d13/c26 0 2024-09-19T09:34:55.246 INFO:tasks.workunit.client.0.smithi112.stdout:6/25: write f5 [158971,110910] 0 2024-09-19T09:34:55.249 INFO:tasks.workunit.client.1.smithi191.stdout:0/118: symlink d0/d9/d1c/d1f/d24/l27 0 2024-09-19T09:34:55.249 INFO:tasks.workunit.client.1.smithi191.stdout:0/119: chown d0/d9/d13/f1b 245953 1 2024-09-19T09:34:55.249 INFO:tasks.workunit.client.1.smithi191.stdout:0/120: chown d0/d9/d13/f18 530245977 1 2024-09-19T09:34:55.249 INFO:tasks.workunit.client.1.smithi191.stdout:0/121: chown d0/d9/d1c/d20 26791 1 2024-09-19T09:34:55.262 INFO:tasks.workunit.client.1.smithi191.stdout:8/117: dread d1/d7/fe [0,4194304] 0 2024-09-19T09:34:55.270 INFO:tasks.workunit.client.1.smithi191.stdout:2/101: dwrite f0 [0,4194304] 0 2024-09-19T09:34:55.270 INFO:tasks.workunit.client.1.smithi191.stdout:2/102: creat d8/db/f1b x:0 0 0 2024-09-19T09:34:55.271 INFO:tasks.workunit.client.0.smithi112.stdout:8/5: dwrite f0 [0,4194304] 0 2024-09-19T09:34:55.276 INFO:tasks.workunit.client.1.smithi191.stdout:9/52: dread d3/fe [0,4194304] 0 2024-09-19T09:34:55.276 INFO:tasks.workunit.client.1.smithi191.stdout:9/53: creat d3/db/f11 x:0 0 0 2024-09-19T09:34:55.277 INFO:tasks.workunit.client.1.smithi191.stdout:9/54: dread d3/db/fd [0,4194304] 0 2024-09-19T09:34:55.280 INFO:tasks.workunit.client.1.smithi191.stdout:2/103: mknod d8/d11/c1c 0 2024-09-19T09:34:55.280 INFO:tasks.workunit.client.1.smithi191.stdout:0/122: dwrite d0/d9/d13/f16 [0,4194304] 0 2024-09-19T09:34:55.283 INFO:tasks.workunit.client.1.smithi191.stdout:9/55: symlink d3/l12 0 2024-09-19T09:34:55.285 INFO:tasks.workunit.client.0.smithi112.stdout:4/6: dwrite f0 [4194304,4194304] 0 2024-09-19T09:34:55.286 INFO:tasks.workunit.client.1.smithi191.stdout:2/104: link f6 d8/f1d 0 2024-09-19T09:34:55.293 INFO:tasks.workunit.client.0.smithi112.stdout:8/6: write f0 [3832593,122674] 0 2024-09-19T09:34:55.293 INFO:tasks.workunit.client.0.smithi112.stdout:8/7: stat f0 0 2024-09-19T09:34:55.298 INFO:tasks.workunit.client.1.smithi191.stdout:0/123: dwrite d0/d9/de/f10 [0,4194304] 0 2024-09-19T09:34:55.309 INFO:tasks.workunit.client.1.smithi191.stdout:0/124: symlink d0/d9/l28 0 2024-09-19T09:34:55.310 INFO:tasks.workunit.client.1.smithi191.stdout:0/125: write d0/d9/f11 [1365417,112306] 0 2024-09-19T09:34:55.310 INFO:tasks.workunit.client.1.smithi191.stdout:0/126: chown d0/d9/d1c/d1f/d24 49455587 1 2024-09-19T09:34:55.310 INFO:tasks.workunit.client.1.smithi191.stdout:0/127: stat d0 0 2024-09-19T09:34:55.317 INFO:tasks.workunit.client.1.smithi191.stdout:3/91: getdents d12/d13 0 2024-09-19T09:34:55.318 INFO:tasks.workunit.client.1.smithi191.stdout:0/128: write d0/d9/d13/f16 [2098038,54918] 0 2024-09-19T09:34:55.348 INFO:tasks.workunit.client.1.smithi191.stdout:2/105: write f6 [4171052,23920] 0 2024-09-19T09:34:55.369 INFO:tasks.workunit.client.1.smithi191.stdout:2/106: dwrite d8/f9 [0,4194304] 0 2024-09-19T09:34:55.588 INFO:tasks.workunit.client.1.smithi191.stdout:6/45: sync 2024-09-19T09:34:55.589 INFO:tasks.workunit.client.1.smithi191.stdout:5/77: sync 2024-09-19T09:34:55.589 INFO:tasks.workunit.client.1.smithi191.stdout:1/44: sync 2024-09-19T09:34:55.589 INFO:tasks.workunit.client.1.smithi191.stdout:6/46: chown l0 62 1 2024-09-19T09:34:55.589 INFO:tasks.workunit.client.1.smithi191.stdout:1/45: fdatasync f0 0 2024-09-19T09:34:55.610 INFO:tasks.workunit.client.1.smithi191.stdout:6/47: creat d2/de/f10 x:0 0 0 2024-09-19T09:34:55.611 INFO:tasks.workunit.client.1.smithi191.stdout:1/46: dwrite d3/f6 [0,4194304] 0 2024-09-19T09:34:55.611 INFO:tasks.workunit.client.1.smithi191.stdout:1/47: write d3/d9/fe [287659,42044] 0 2024-09-19T09:34:55.612 INFO:tasks.workunit.client.1.smithi191.stdout:7/48: unlink d2/f8 0 2024-09-19T09:34:55.612 INFO:tasks.workunit.client.1.smithi191.stdout:5/78: dwrite d0/d4/d9/de/f18 [4194304,4194304] 0 2024-09-19T09:34:55.612 INFO:tasks.workunit.client.1.smithi191.stdout:7/49: truncate d2/fd 322584 0 2024-09-19T09:34:55.613 INFO:tasks.workunit.client.1.smithi191.stdout:6/48: symlink d2/l11 0 2024-09-19T09:34:55.613 INFO:tasks.workunit.client.1.smithi191.stdout:6/49: dread - d2/de/f10 zero size 2024-09-19T09:34:55.613 INFO:tasks.workunit.client.1.smithi191.stdout:6/50: read d2/fa [891001,64252] 0 2024-09-19T09:34:55.618 INFO:tasks.workunit.client.1.smithi191.stdout:5/79: rename d0/d4/l12 to d0/l1c 0 2024-09-19T09:34:55.619 INFO:tasks.workunit.client.1.smithi191.stdout:7/50: rename d2/l6 to d2/l10 0 2024-09-19T09:34:55.621 INFO:tasks.workunit.client.1.smithi191.stdout:6/51: symlink d2/de/l12 0 2024-09-19T09:34:55.621 INFO:tasks.workunit.client.1.smithi191.stdout:6/52: write d2/fa [455497,12590] 0 2024-09-19T09:34:55.621 INFO:tasks.workunit.client.1.smithi191.stdout:6/53: chown l0 90631 1 2024-09-19T09:34:55.622 INFO:tasks.workunit.client.1.smithi191.stdout:5/80: truncate d0/f11 107202 0 2024-09-19T09:34:55.622 INFO:tasks.workunit.client.1.smithi191.stdout:5/81: fsync d0/d4/d9/fd 0 2024-09-19T09:34:55.623 INFO:tasks.workunit.client.1.smithi191.stdout:7/51: write d2/fc [458585,92959] 0 2024-09-19T09:34:55.623 INFO:tasks.workunit.client.1.smithi191.stdout:7/52: creat d2/f11 x:0 0 0 2024-09-19T09:34:55.626 INFO:tasks.workunit.client.1.smithi191.stdout:6/54: mknod d2/de/c13 0 2024-09-19T09:34:55.627 INFO:tasks.workunit.client.1.smithi191.stdout:6/55: dread - d2/de/f10 zero size 2024-09-19T09:34:55.628 INFO:tasks.workunit.client.1.smithi191.stdout:1/48: dwrite d3/f4 [0,4194304] 0 2024-09-19T09:34:55.630 INFO:tasks.workunit.client.1.smithi191.stdout:7/53: symlink d2/l12 0 2024-09-19T09:34:55.632 INFO:tasks.workunit.client.1.smithi191.stdout:5/82: dread d0/d4/d9/de/f18 [0,4194304] 0 2024-09-19T09:34:55.634 INFO:tasks.workunit.client.1.smithi191.stdout:1/49: unlink d3/f5 0 2024-09-19T09:34:55.636 INFO:tasks.workunit.client.1.smithi191.stdout:7/54: unlink d2/l12 0 2024-09-19T09:34:55.639 INFO:tasks.workunit.client.1.smithi191.stdout:5/83: unlink d0/f13 0 2024-09-19T09:34:55.640 INFO:tasks.workunit.client.1.smithi191.stdout:6/56: dwrite d2/f6 [4194304,4194304] 0 2024-09-19T09:34:55.640 INFO:tasks.workunit.client.1.smithi191.stdout:7/55: mknod d2/c13 0 2024-09-19T09:34:55.645 INFO:tasks.workunit.client.1.smithi191.stdout:7/56: symlink d2/l14 0 2024-09-19T09:34:55.645 INFO:tasks.workunit.client.1.smithi191.stdout:7/57: write d2/fc [680590,60844] 0 2024-09-19T09:34:55.645 INFO:tasks.workunit.client.1.smithi191.stdout:7/58: readlink d2/lb 0 2024-09-19T09:34:55.648 INFO:tasks.workunit.client.1.smithi191.stdout:7/59: symlink d2/l15 0 2024-09-19T09:34:55.649 INFO:tasks.workunit.client.1.smithi191.stdout:5/84: dread d0/d4/d9/de/ff [0,4194304] 0 2024-09-19T09:34:55.649 INFO:tasks.workunit.client.1.smithi191.stdout:1/50: dwrite d3/f6 [0,4194304] 0 2024-09-19T09:34:55.651 INFO:tasks.workunit.client.1.smithi191.stdout:7/60: rename d2/c13 to d2/c16 0 2024-09-19T09:34:55.652 INFO:tasks.workunit.client.1.smithi191.stdout:5/85: unlink d0/d4/d9/fb 0 2024-09-19T09:34:55.655 INFO:tasks.workunit.client.1.smithi191.stdout:1/51: link f0 d3/d9/da/db/ff 0 2024-09-19T09:34:55.657 INFO:tasks.workunit.client.1.smithi191.stdout:7/61: dread d2/f7 [0,4194304] 0 2024-09-19T09:34:55.657 INFO:tasks.workunit.client.1.smithi191.stdout:7/62: creat d2/f17 x:0 0 0 2024-09-19T09:34:55.657 INFO:tasks.workunit.client.1.smithi191.stdout:5/86: unlink d0/d4/d9/l1a 0 2024-09-19T09:34:55.659 INFO:tasks.workunit.client.1.smithi191.stdout:1/52: mknod d3/d9/da/c10 0 2024-09-19T09:34:55.663 INFO:tasks.workunit.client.1.smithi191.stdout:5/87: mkdir d0/d4/d9/d1d 0 2024-09-19T09:34:55.664 INFO:tasks.workunit.client.1.smithi191.stdout:1/53: mknod d3/c11 0 2024-09-19T09:34:55.669 INFO:tasks.workunit.client.1.smithi191.stdout:5/88: dread d0/d4/d9/f3 [0,4194304] 0 2024-09-19T09:34:55.669 INFO:tasks.workunit.client.1.smithi191.stdout:5/89: creat d0/d4/d9/f1e x:0 0 0 2024-09-19T09:34:55.673 INFO:tasks.workunit.client.1.smithi191.stdout:5/90: mkdir d0/d1f 0 2024-09-19T09:34:55.674 INFO:tasks.workunit.client.1.smithi191.stdout:5/91: rename d0/d4/f1b to d0/f20 0 2024-09-19T09:34:55.674 INFO:tasks.workunit.client.1.smithi191.stdout:7/63: dwrite d2/f9 [0,4194304] 0 2024-09-19T09:34:55.674 INFO:tasks.workunit.client.1.smithi191.stdout:7/64: write d2/ff [835008,130395] 0 2024-09-19T09:34:55.675 INFO:tasks.workunit.client.1.smithi191.stdout:5/92: symlink d0/d4/d9/d1d/l21 0 2024-09-19T09:34:55.680 INFO:tasks.workunit.client.1.smithi191.stdout:5/93: dread d0/d4/d9/de/ff [0,4194304] 0 2024-09-19T09:34:55.685 INFO:tasks.workunit.client.1.smithi191.stdout:5/94: write d0/d4/d9/de/ff [3048725,35986] 0 2024-09-19T09:34:55.687 INFO:tasks.workunit.client.1.smithi191.stdout:5/95: mkdir d0/d4/d9/d1d/d22 0 2024-09-19T09:34:55.689 INFO:tasks.workunit.client.1.smithi191.stdout:5/96: rename d0/l19 to d0/l23 0 2024-09-19T09:34:55.691 INFO:tasks.workunit.client.1.smithi191.stdout:5/97: unlink d0/d4/l16 0 2024-09-19T09:34:55.691 INFO:tasks.workunit.client.1.smithi191.stdout:5/98: creat d0/d4/f24 x:0 0 0 2024-09-19T09:34:55.692 INFO:tasks.workunit.client.1.smithi191.stdout:5/99: chown d0/f11 313981706 1 2024-09-19T09:34:55.694 INFO:tasks.workunit.client.1.smithi191.stdout:5/100: symlink d0/l25 0 2024-09-19T09:34:55.694 INFO:tasks.workunit.client.1.smithi191.stdout:5/101: chown d0/d4/d9 69 1 2024-09-19T09:34:55.696 INFO:tasks.workunit.client.1.smithi191.stdout:5/102: creat d0/d4/d9/d1d/d22/f26 x:0 0 0 2024-09-19T09:34:55.696 INFO:tasks.workunit.client.1.smithi191.stdout:5/103: fsync d0/d4/d9/de/f18 0 2024-09-19T09:34:55.696 INFO:tasks.workunit.client.1.smithi191.stdout:5/104: write d0/d4/d9/f3 [580378,23755] 0 2024-09-19T09:34:55.696 INFO:tasks.workunit.client.1.smithi191.stdout:5/105: creat d0/d4/f27 x:0 0 0 2024-09-19T09:34:55.701 INFO:tasks.workunit.client.1.smithi191.stdout:5/106: mkdir d0/d4/d9/d1d/d28 0 2024-09-19T09:34:55.701 INFO:tasks.workunit.client.1.smithi191.stdout:5/107: readlink d0/d4/d9/de/l15 0 2024-09-19T09:34:55.701 INFO:tasks.workunit.client.1.smithi191.stdout:5/108: chown d0/l1c 31686209 1 2024-09-19T09:34:55.701 INFO:tasks.workunit.client.1.smithi191.stdout:5/109: chown d0/d4/f27 48019105 1 2024-09-19T09:34:55.701 INFO:tasks.workunit.client.1.smithi191.stdout:5/110: write d0/d4/d9/fd [4265740,47650] 0 2024-09-19T09:34:55.701 INFO:tasks.workunit.client.1.smithi191.stdout:5/111: write d0/d4/d9/f3 [2535874,94730] 0 2024-09-19T09:34:55.701 INFO:tasks.workunit.client.1.smithi191.stdout:5/112: chown d0/d4/d9/de 117 1 2024-09-19T09:34:55.720 INFO:tasks.workunit.client.1.smithi191.stdout:5/113: dwrite d0/d4/d9/f3 [0,4194304] 0 2024-09-19T09:34:55.720 INFO:tasks.workunit.client.1.smithi191.stdout:5/114: truncate d0/d4/d9/f1e 329134 0 2024-09-19T09:34:55.720 INFO:tasks.workunit.client.1.smithi191.stdout:5/115: chown d0/l17 558063 1 2024-09-19T09:34:55.723 INFO:tasks.workunit.client.1.smithi191.stdout:5/116: write d0/d4/d9/de/f18 [549510,45281] 0 2024-09-19T09:34:55.725 INFO:tasks.workunit.client.1.smithi191.stdout:5/117: mkdir d0/d4/d9/d1d/d29 0 2024-09-19T09:34:55.737 INFO:tasks.workunit.client.1.smithi191.stdout:5/118: dwrite d0/d4/d9/f1e [0,4194304] 0 2024-09-19T09:34:55.741 INFO:tasks.workunit.client.1.smithi191.stdout:5/119: mknod d0/d1f/c2a 0 2024-09-19T09:34:55.742 INFO:tasks.workunit.client.1.smithi191.stdout:5/120: chown d0/d4/d9/de/f18 418634 1 2024-09-19T09:34:55.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:55 smithi191 ceph-mon[34834]: Adjusting osd_memory_target on smithi112 to 1557M 2024-09-19T09:34:55.838 INFO:tasks.workunit.client.1.smithi191.stdout:8/118: rmdir d1 39 2024-09-19T09:34:55.840 INFO:tasks.workunit.client.1.smithi191.stdout:8/119: mkdir d1/d7/d8/d28 0 2024-09-19T09:34:55.840 INFO:tasks.workunit.client.1.smithi191.stdout:8/120: write d1/d7/d1a/f25 [162413,8944] 0 2024-09-19T09:34:55.852 INFO:tasks.workunit.client.1.smithi191.stdout:8/121: dwrite d1/f14 [0,4194304] 0 2024-09-19T09:34:55.856 INFO:tasks.workunit.client.1.smithi191.stdout:8/122: creat d1/d7/d8/f29 x:0 0 0 2024-09-19T09:34:55.857 INFO:tasks.workunit.client.1.smithi191.stdout:8/123: truncate d1/f14 4674007 0 2024-09-19T09:34:55.857 INFO:tasks.workunit.client.1.smithi191.stdout:8/124: dread - d1/d7/d8/f29 zero size 2024-09-19T09:34:55.861 INFO:tasks.workunit.client.1.smithi191.stdout:8/125: creat d1/d16/f2a x:0 0 0 2024-09-19T09:34:55.868 INFO:tasks.workunit.client.1.smithi191.stdout:8/126: rmdir d1 39 2024-09-19T09:34:55.870 INFO:tasks.workunit.client.1.smithi191.stdout:8/127: unlink d1/d16/c27 0 2024-09-19T09:34:55.872 INFO:tasks.workunit.client.1.smithi191.stdout:8/128: truncate d1/d7/d1a/f21 41980 0 2024-09-19T09:34:55.875 INFO:tasks.workunit.client.1.smithi191.stdout:8/129: mknod d1/d7/d8/c2b 0 2024-09-19T09:34:55.876 INFO:tasks.workunit.client.1.smithi191.stdout:8/130: rmdir d1/d7 39 2024-09-19T09:34:55.876 INFO:tasks.workunit.client.1.smithi191.stdout:8/131: fdatasync d1/d7/d8/f29 0 2024-09-19T09:34:55.876 INFO:tasks.workunit.client.1.smithi191.stdout:8/132: fdatasync d1/f14 0 2024-09-19T09:34:55.889 INFO:tasks.workunit.client.1.smithi191.stdout:0/129: fsync d0/d9/f22 0 2024-09-19T09:34:55.890 INFO:tasks.workunit.client.1.smithi191.stdout:0/130: dread d0/d9/f1a [0,4194304] 0 2024-09-19T09:34:55.890 INFO:tasks.workunit.client.1.smithi191.stdout:0/131: fdatasync d0/d9/f1a 0 2024-09-19T09:34:55.892 INFO:tasks.workunit.client.1.smithi191.stdout:0/132: dread d0/d9/de/f19 [0,4194304] 0 2024-09-19T09:34:55.892 INFO:tasks.workunit.client.1.smithi191.stdout:0/133: chown d0/d9/d13/c14 463691 1 2024-09-19T09:34:55.892 INFO:tasks.workunit.client.1.smithi191.stdout:0/134: chown d0/d9/de/f10 332 1 2024-09-19T09:34:55.894 INFO:tasks.workunit.client.1.smithi191.stdout:0/135: mkdir d0/d9/d1c/d1f/d24/d29 0 2024-09-19T09:34:55.896 INFO:tasks.workunit.client.1.smithi191.stdout:0/136: unlink d0/d9/c7 0 2024-09-19T09:34:55.898 INFO:tasks.workunit.client.1.smithi191.stdout:0/137: mknod d0/d9/d1c/d1f/d24/c2a 0 2024-09-19T09:34:55.900 INFO:tasks.workunit.client.1.smithi191.stdout:0/138: truncate d0/d9/f1a 498235 0 2024-09-19T09:34:55.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:55 smithi112 ceph-mon[27605]: Adjusting osd_memory_target on smithi112 to 1557M 2024-09-19T09:34:55.975 INFO:tasks.workunit.client.1.smithi191.stdout:9/56: rmdir d3/db 39 2024-09-19T09:34:55.975 INFO:tasks.workunit.client.1.smithi191.stdout:9/57: creat d3/d8/f13 x:0 0 0 2024-09-19T09:34:55.980 INFO:tasks.workunit.client.1.smithi191.stdout:9/58: symlink d3/db/l14 0 2024-09-19T09:34:55.980 INFO:tasks.workunit.client.1.smithi191.stdout:9/59: write d3/db/fd [650550,68471] 0 2024-09-19T09:34:55.980 INFO:tasks.workunit.client.1.smithi191.stdout:9/60: truncate d3/db/fd 1315010 0 2024-09-19T09:34:55.980 INFO:tasks.workunit.client.1.smithi191.stdout:9/61: dread - d3/db/f10 zero size 2024-09-19T09:34:55.980 INFO:tasks.workunit.client.1.smithi191.stdout:9/62: chown d3/db/f10 213406826 1 2024-09-19T09:34:55.983 INFO:tasks.workunit.client.1.smithi191.stdout:9/63: unlink d3/f6 0 2024-09-19T09:34:55.984 INFO:tasks.workunit.client.1.smithi191.stdout:9/64: read - d3/ff zero size 2024-09-19T09:34:56.034 INFO:tasks.workunit.client.1.smithi191.stdout:2/107: truncate d8/f1d 3330737 0 2024-09-19T09:34:56.042 INFO:tasks.workunit.client.1.smithi191.stdout:2/108: write d8/f9 [3757428,71276] 0 2024-09-19T09:34:56.042 INFO:tasks.workunit.client.1.smithi191.stdout:2/109: stat d8/de 0 2024-09-19T09:34:56.043 INFO:tasks.workunit.client.1.smithi191.stdout:2/110: chown d8/db/d13/f15 6405736 1 2024-09-19T09:34:56.043 INFO:tasks.workunit.client.1.smithi191.stdout:2/111: chown d8/db/d13 0 1 2024-09-19T09:34:56.043 INFO:tasks.workunit.client.1.smithi191.stdout:2/112: chown d8/db/f14 1 1 2024-09-19T09:34:56.044 INFO:tasks.workunit.client.1.smithi191.stdout:2/113: symlink d8/db/l1e 0 2024-09-19T09:34:56.045 INFO:tasks.workunit.client.1.smithi191.stdout:2/114: creat d8/de/f1f x:0 0 0 2024-09-19T09:34:56.065 INFO:tasks.workunit.client.1.smithi191.stdout:2/115: dwrite d8/db/d13/f15 [0,4194304] 0 2024-09-19T09:34:56.262 INFO:tasks.workunit.client.1.smithi191.stdout:5/121: dwrite d0/f11 [0,4194304] 0 2024-09-19T09:34:56.263 INFO:tasks.workunit.client.1.smithi191.stdout:5/122: read d0/d4/d9/fd [3193212,18311] 0 2024-09-19T09:34:56.280 INFO:tasks.workunit.client.1.smithi191.stdout:7/65: getdents d2 0 2024-09-19T09:34:56.281 INFO:tasks.workunit.client.1.smithi191.stdout:7/66: dread d2/fd [0,4194304] 0 2024-09-19T09:34:56.284 INFO:tasks.workunit.client.1.smithi191.stdout:7/67: write d2/f11 [908667,59069] 0 2024-09-19T09:34:56.311 INFO:tasks.workunit.client.1.smithi191.stdout:5/123: rmdir d0/d4/d9/d1d/d22 39 2024-09-19T09:34:56.311 INFO:tasks.workunit.client.1.smithi191.stdout:5/124: getdents d0/d4/d9/d1d/d29 0 2024-09-19T09:34:56.324 INFO:tasks.workunit.client.1.smithi191.stdout:5/125: dwrite d0/d4/d9/de/f18 [4194304,4194304] 0 2024-09-19T09:34:56.324 INFO:tasks.workunit.client.1.smithi191.stdout:5/126: creat d0/d4/d9/f2b x:0 0 0 2024-09-19T09:34:56.327 INFO:tasks.workunit.client.1.smithi191.stdout:5/127: creat d0/d4/d9/d1d/d22/f2c x:0 0 0 2024-09-19T09:34:56.335 INFO:tasks.workunit.client.1.smithi191.stdout:4/154: sync 2024-09-19T09:34:56.341 INFO:tasks.workunit.client.1.smithi191.stdout:4/155: dread d5/d1b/d1c/f29 [0,4194304] 0 2024-09-19T09:34:56.342 INFO:tasks.workunit.client.1.smithi191.stdout:4/156: read - d5/d1b/d1c/d2f/f39 zero size 2024-09-19T09:34:56.342 INFO:tasks.workunit.client.1.smithi191.stdout:4/157: read d5/fe [391097,14062] 0 2024-09-19T09:34:56.359 INFO:tasks.workunit.client.1.smithi191.stdout:4/158: dwrite d5/f35 [0,4194304] 0 2024-09-19T09:34:56.363 INFO:tasks.workunit.client.1.smithi191.stdout:4/159: creat d5/d1b/d1c/d24/d32/d21/d27/f3c x:0 0 0 2024-09-19T09:34:56.364 INFO:tasks.workunit.client.1.smithi191.stdout:4/160: read d5/d1b/d1c/d24/d32/f2d [347986,16122] 0 2024-09-19T09:34:56.364 INFO:tasks.workunit.client.1.smithi191.stdout:4/161: truncate d5/d1b/d1c/d2f/d19/f3a 378024 0 2024-09-19T09:34:56.367 INFO:tasks.workunit.client.1.smithi191.stdout:4/162: symlink d5/d1b/d1c/d24/d32/l3d 0 2024-09-19T09:34:56.415 INFO:tasks.workunit.client.0.smithi112.stdout:1/15: truncate f1 2819886 0 2024-09-19T09:34:56.467 INFO:tasks.workunit.client.1.smithi191.stdout:5/128: truncate d0/d4/d9/f3 306063 0 2024-09-19T09:34:56.468 INFO:tasks.workunit.client.1.smithi191.stdout:5/129: dread - d0/d4/d9/d1d/d22/f2c zero size 2024-09-19T09:34:56.479 INFO:tasks.workunit.client.1.smithi191.stdout:8/133: rename d1/d7/d1a/f21 to d1/d22/f2c 0 2024-09-19T09:34:56.479 INFO:tasks.workunit.client.1.smithi191.stdout:0/139: rename d0 to d0/d9/d1c/d1f/d2b 22 2024-09-19T09:34:56.483 INFO:tasks.workunit.client.1.smithi191.stdout:4/163: rename d5/d1b/c3b to d5/d38/c3e 0 2024-09-19T09:34:56.485 INFO:tasks.workunit.client.1.smithi191.stdout:0/140: rmdir d0/d9/d1c 39 2024-09-19T09:34:56.488 INFO:tasks.workunit.client.1.smithi191.stdout:4/164: symlink d5/d1b/l3f 0 2024-09-19T09:34:56.508 INFO:tasks.workunit.client.1.smithi191.stdout:0/141: getdents d0/d9/d1c/d1f/d24 0 2024-09-19T09:34:56.511 INFO:tasks.workunit.client.1.smithi191.stdout:0/142: mkdir d0/d9/d1c/d1f/d24/d29/d2c 0 2024-09-19T09:34:56.513 INFO:tasks.workunit.client.1.smithi191.stdout:0/143: rmdir d0/d9/d13 39 2024-09-19T09:34:56.515 INFO:tasks.workunit.client.1.smithi191.stdout:0/144: symlink d0/d9/d1c/d1f/d24/l2d 0 2024-09-19T09:34:56.518 INFO:tasks.workunit.client.1.smithi191.stdout:0/145: creat d0/d9/de/f2e x:0 0 0 2024-09-19T09:34:56.522 INFO:tasks.workunit.client.1.smithi191.stdout:0/146: rmdir d0/d9/d1c/d1f/d24/d29/d2c 0 2024-09-19T09:34:56.522 INFO:tasks.workunit.client.1.smithi191.stdout:0/147: truncate d0/d9/f25 143437 0 2024-09-19T09:34:56.525 INFO:tasks.workunit.client.1.smithi191.stdout:0/148: unlink d0/d9/d13/c14 0 2024-09-19T09:34:56.525 INFO:tasks.workunit.client.1.smithi191.stdout:0/149: stat d0/d9/f1a 0 2024-09-19T09:34:56.525 INFO:tasks.workunit.client.1.smithi191.stdout:0/150: readlink d0/d9/d1c/d1f/d24/l2d 0 2024-09-19T09:34:56.525 INFO:tasks.workunit.client.1.smithi191.stdout:0/151: creat d0/d9/de/f2f x:0 0 0 2024-09-19T09:34:56.525 INFO:tasks.workunit.client.1.smithi191.stdout:0/152: dread - d0/d9/d13/f1b zero size 2024-09-19T09:34:56.530 INFO:tasks.workunit.client.1.smithi191.stdout:0/153: dread d0/d9/d13/f16 [0,4194304] 0 2024-09-19T09:34:56.530 INFO:tasks.workunit.client.1.smithi191.stdout:0/154: chown d0/d9/d13/c26 337451275 1 2024-09-19T09:34:56.536 INFO:tasks.workunit.client.1.smithi191.stdout:0/155: write d0/d9/de/f10 [2488098,16900] 0 2024-09-19T09:34:56.566 INFO:tasks.workunit.client.1.smithi191.stdout:8/134: dwrite d1/d7/fe [0,4194304] 0 2024-09-19T09:34:56.568 INFO:tasks.workunit.client.1.smithi191.stdout:8/135: truncate d1/d7/d8/fc 3634351 0 2024-09-19T09:34:56.571 INFO:tasks.workunit.client.1.smithi191.stdout:8/136: creat d1/d7/d8/d28/f2d x:0 0 0 2024-09-19T09:34:56.572 INFO:tasks.workunit.client.1.smithi191.stdout:4/165: dwrite d5/d1b/d1c/d2f/d19/f3a [0,4194304] 0 2024-09-19T09:34:56.572 INFO:tasks.workunit.client.1.smithi191.stdout:4/166: chown d5/f18 338944956 1 2024-09-19T09:34:56.573 INFO:tasks.workunit.client.1.smithi191.stdout:0/156: dwrite d0/d9/d13/f16 [0,4194304] 0 2024-09-19T09:34:56.573 INFO:tasks.workunit.client.1.smithi191.stdout:0/157: chown d0/d9/de/l12 57 1 2024-09-19T09:34:56.574 INFO:tasks.workunit.client.1.smithi191.stdout:8/137: mkdir d1/d16/d2e 0 2024-09-19T09:34:56.581 INFO:tasks.workunit.client.1.smithi191.stdout:4/167: rename d5/d1b/d1c/d24/d32/d21/f2c to d5/d1b/d1c/d24/d32/d21/f40 0 2024-09-19T09:34:56.581 INFO:tasks.workunit.client.1.smithi191.stdout:4/168: stat d5/f8 0 2024-09-19T09:34:56.582 INFO:tasks.workunit.client.1.smithi191.stdout:4/169: write f1 [540003,17059] 0 2024-09-19T09:34:56.583 INFO:tasks.workunit.client.1.smithi191.stdout:8/138: symlink d1/d16/d23/l2f 0 2024-09-19T09:34:56.591 INFO:tasks.workunit.client.1.smithi191.stdout:0/158: dwrite d0/d9/de/f2e [0,4194304] 0 2024-09-19T09:34:56.597 INFO:tasks.workunit.client.1.smithi191.stdout:0/159: mkdir d0/d9/d1c/d1f/d24/d29/d30 0 2024-09-19T09:34:56.598 INFO:tasks.workunit.client.1.smithi191.stdout:0/160: readlink d0/d9/de/l12 0 2024-09-19T09:34:56.598 INFO:tasks.workunit.client.1.smithi191.stdout:4/170: dread d5/f18 [0,4194304] 0 2024-09-19T09:34:56.600 INFO:tasks.workunit.client.1.smithi191.stdout:0/161: creat d0/d9/d1c/d20/f31 x:0 0 0 2024-09-19T09:34:56.600 INFO:tasks.workunit.client.1.smithi191.stdout:0/162: readlink d0/d9/d1c/d1f/d24/l27 0 2024-09-19T09:34:56.600 INFO:tasks.workunit.client.1.smithi191.stdout:0/163: read d0/d9/d13/f18 [3220635,43019] 0 2024-09-19T09:34:56.601 INFO:tasks.workunit.client.1.smithi191.stdout:8/139: dwrite d1/d22/f2c [0,4194304] 0 2024-09-19T09:34:56.603 INFO:tasks.workunit.client.1.smithi191.stdout:0/164: symlink d0/d9/l32 0 2024-09-19T09:34:56.609 INFO:tasks.workunit.client.1.smithi191.stdout:8/140: mknod d1/d22/c30 0 2024-09-19T09:34:56.609 INFO:tasks.workunit.client.1.smithi191.stdout:8/141: creat d1/d7/d8/f31 x:0 0 0 2024-09-19T09:34:56.612 INFO:tasks.workunit.client.1.smithi191.stdout:0/165: rename d0/d9/f11 to d0/d9/d1c/d1f/d24/f33 0 2024-09-19T09:34:56.612 INFO:tasks.workunit.client.1.smithi191.stdout:0/166: fdatasync d0/f4 0 2024-09-19T09:34:56.612 INFO:tasks.workunit.client.1.smithi191.stdout:0/167: creat d0/f34 x:0 0 0 2024-09-19T09:34:56.612 INFO:tasks.workunit.client.1.smithi191.stdout:0/168: stat d0/f8 0 2024-09-19T09:34:56.613 INFO:tasks.workunit.client.1.smithi191.stdout:0/169: chown d0/d9/f25 939658014 1 2024-09-19T09:34:56.613 INFO:tasks.workunit.client.1.smithi191.stdout:0/170: fdatasync d0/d9/de/f2f 0 2024-09-19T09:34:56.613 INFO:tasks.workunit.client.1.smithi191.stdout:4/171: dwrite d5/d1b/d1c/d2f/d19/f34 [0,4194304] 0 2024-09-19T09:34:56.613 INFO:tasks.workunit.client.1.smithi191.stdout:4/172: creat d5/d1b/d1c/d24/d32/d21/d27/f41 x:0 0 0 2024-09-19T09:34:56.616 INFO:tasks.workunit.client.1.smithi191.stdout:8/142: mkdir d1/d16/d2e/d32 0 2024-09-19T09:34:56.616 INFO:tasks.workunit.client.1.smithi191.stdout:8/143: creat d1/d7/d8/d28/f33 x:0 0 0 2024-09-19T09:34:56.616 INFO:tasks.workunit.client.1.smithi191.stdout:8/144: write d1/d16/f2a [971065,6209] 0 2024-09-19T09:34:56.616 INFO:tasks.workunit.client.1.smithi191.stdout:8/145: fdatasync d1/d7/d8/d28/f2d 0 2024-09-19T09:34:56.617 INFO:tasks.workunit.client.1.smithi191.stdout:8/146: fsync d1/d16/f2a 0 2024-09-19T09:34:56.620 INFO:tasks.workunit.client.1.smithi191.stdout:0/171: dread d0/d9/f22 [0,4194304] 0 2024-09-19T09:34:56.620 INFO:tasks.workunit.client.1.smithi191.stdout:9/65: getdents d3/db 0 2024-09-19T09:34:56.621 INFO:tasks.workunit.client.1.smithi191.stdout:4/173: write f0 [2509052,8140] 0 2024-09-19T09:34:56.624 INFO:tasks.workunit.client.1.smithi191.stdout:8/147: mkdir d1/d22/d34 0 2024-09-19T09:34:56.624 INFO:tasks.workunit.client.1.smithi191.stdout:8/148: dread - d1/d7/d8/d17/f1e zero size 2024-09-19T09:34:56.624 INFO:tasks.workunit.client.1.smithi191.stdout:8/149: fdatasync d1/d7/d8/d28/f33 0 2024-09-19T09:34:56.625 INFO:tasks.workunit.client.1.smithi191.stdout:0/172: mknod d0/d9/d1c/d1f/d24/d29/d30/c35 0 2024-09-19T09:34:56.626 INFO:tasks.workunit.client.1.smithi191.stdout:9/66: truncate d3/fe 1549597 0 2024-09-19T09:34:56.628 INFO:tasks.workunit.client.1.smithi191.stdout:4/174: symlink d5/d1b/d1c/d24/d32/d21/l42 0 2024-09-19T09:34:56.629 INFO:tasks.workunit.client.1.smithi191.stdout:0/173: symlink d0/d9/d1c/d1f/d24/l36 0 2024-09-19T09:34:56.632 INFO:tasks.workunit.client.1.smithi191.stdout:0/174: link d0/f4 d0/d9/d1c/d20/f37 0 2024-09-19T09:34:56.633 INFO:tasks.workunit.client.1.smithi191.stdout:0/175: write d0/f8 [1450966,112271] 0 2024-09-19T09:34:56.633 INFO:tasks.workunit.client.1.smithi191.stdout:0/176: truncate d0/d9/d1c/d1f/d24/f33 2085475 0 2024-09-19T09:34:56.634 INFO:tasks.workunit.client.0.smithi112.stdout:0/14: creat d2/f4 x:0 0 0 2024-09-19T09:34:56.636 INFO:tasks.workunit.client.1.smithi191.stdout:4/175: write d5/d1b/d1c/d2f/d19/f20 [1495775,66205] 0 2024-09-19T09:34:56.637 INFO:tasks.workunit.client.1.smithi191.stdout:0/177: truncate d0/f4 2402736 0 2024-09-19T09:34:56.640 INFO:tasks.workunit.client.1.smithi191.stdout:0/178: creat d0/d9/d13/f38 x:0 0 0 2024-09-19T09:34:56.648 INFO:tasks.workunit.client.1.smithi191.stdout:8/150: dwrite d1/d16/f2a [0,4194304] 0 2024-09-19T09:34:56.649 INFO:tasks.workunit.client.1.smithi191.stdout:9/67: dwrite d3/d8/fc [0,4194304] 0 2024-09-19T09:34:56.649 INFO:tasks.workunit.client.1.smithi191.stdout:9/68: creat d3/d8/f15 x:0 0 0 2024-09-19T09:34:56.649 INFO:tasks.workunit.client.1.smithi191.stdout:8/151: mknod d1/d22/c35 0 2024-09-19T09:34:56.655 INFO:tasks.workunit.client.1.smithi191.stdout:8/152: creat d1/f36 x:0 0 0 2024-09-19T09:34:56.656 INFO:tasks.workunit.client.1.smithi191.stdout:8/153: fdatasync d1/d16/f2a 0 2024-09-19T09:34:56.659 INFO:tasks.workunit.client.1.smithi191.stdout:8/154: mkdir d1/d22/d37 0 2024-09-19T09:34:56.659 INFO:tasks.workunit.client.1.smithi191.stdout:4/176: dwrite d5/fa [0,4194304] 0 2024-09-19T09:34:56.659 INFO:tasks.workunit.client.1.smithi191.stdout:8/155: chown d1/d7/d8/d17/f1e 20589967 1 2024-09-19T09:34:56.659 INFO:tasks.workunit.client.1.smithi191.stdout:8/156: fsync d1/d7/fe 0 2024-09-19T09:34:56.664 INFO:tasks.workunit.client.1.smithi191.stdout:0/179: dwrite d0/f8 [0,4194304] 0 2024-09-19T09:34:56.665 INFO:tasks.workunit.client.1.smithi191.stdout:0/180: write d0/d9/d1c/d1f/d24/f33 [1713307,118862] 0 2024-09-19T09:34:56.667 INFO:tasks.workunit.client.1.smithi191.stdout:0/181: mkdir d0/d9/d1c/d1f/d24/d39 0 2024-09-19T09:34:56.670 INFO:tasks.workunit.client.1.smithi191.stdout:0/182: symlink d0/d9/d1c/d1f/d24/l3a 0 2024-09-19T09:34:56.672 INFO:tasks.workunit.client.1.smithi191.stdout:0/183: creat d0/d9/d1c/d1f/d24/d29/f3b x:0 0 0 2024-09-19T09:34:56.674 INFO:tasks.workunit.client.1.smithi191.stdout:0/184: rename d0/d9/de/f2e to d0/d9/d1c/d1f/f3c 0 2024-09-19T09:34:56.674 INFO:tasks.workunit.client.1.smithi191.stdout:0/185: creat d0/d9/d1c/d1f/d24/d29/f3d x:0 0 0 2024-09-19T09:34:56.674 INFO:tasks.workunit.client.1.smithi191.stdout:0/186: chown d0/d9/d13/f38 2702286 1 2024-09-19T09:34:56.678 INFO:tasks.workunit.client.1.smithi191.stdout:4/177: dwrite d5/fe [0,4194304] 0 2024-09-19T09:34:56.681 INFO:tasks.workunit.client.1.smithi191.stdout:0/187: write d0/f8 [2615011,102867] 0 2024-09-19T09:34:56.685 INFO:tasks.workunit.client.1.smithi191.stdout:4/178: mknod d5/d1b/d1c/d2f/d19/c43 0 2024-09-19T09:34:56.685 INFO:tasks.workunit.client.1.smithi191.stdout:8/157: dwrite d1/d16/f19 [0,4194304] 0 2024-09-19T09:34:56.689 INFO:tasks.workunit.client.1.smithi191.stdout:8/158: rename d1/f10 to d1/d16/d2e/f38 0 2024-09-19T09:34:56.689 INFO:tasks.workunit.client.1.smithi191.stdout:8/159: readlink d1/d7/d8/d17/l1b 0 2024-09-19T09:34:56.693 INFO:tasks.workunit.client.1.smithi191.stdout:0/188: dread d0/d9/d1c/d1f/d24/f33 [0,4194304] 0 2024-09-19T09:34:56.693 INFO:tasks.workunit.client.1.smithi191.stdout:4/179: mknod d5/d1b/d1c/d24/d32/c44 0 2024-09-19T09:34:56.693 INFO:tasks.workunit.client.1.smithi191.stdout:8/160: write d1/d7/fe [4775193,113865] 0 2024-09-19T09:34:56.693 INFO:tasks.workunit.client.1.smithi191.stdout:8/161: chown d1/d7/d8/f31 468362139 1 2024-09-19T09:34:56.694 INFO:tasks.workunit.client.1.smithi191.stdout:2/116: dread d8/f1d [0,4194304] 0 2024-09-19T09:34:56.694 INFO:tasks.workunit.client.1.smithi191.stdout:2/117: chown d8/db/d13 8470884 1 2024-09-19T09:34:56.694 INFO:tasks.workunit.client.1.smithi191.stdout:0/189: mknod d0/d9/d1c/c3e 0 2024-09-19T09:34:56.694 INFO:tasks.workunit.client.1.smithi191.stdout:4/180: creat d5/d38/f45 x:0 0 0 2024-09-19T09:34:56.695 INFO:tasks.workunit.client.1.smithi191.stdout:8/162: mkdir d1/d7/d8/d17/d39 0 2024-09-19T09:34:56.696 INFO:tasks.workunit.client.1.smithi191.stdout:2/118: rename d8/f9 to d8/de/f20 0 2024-09-19T09:34:56.698 INFO:tasks.workunit.client.1.smithi191.stdout:4/181: mknod d5/d1b/d1c/d24/d32/d21/d27/c46 0 2024-09-19T09:34:56.698 INFO:tasks.workunit.client.1.smithi191.stdout:4/182: chown f1 84578 1 2024-09-19T09:34:56.698 INFO:tasks.workunit.client.1.smithi191.stdout:4/183: creat d5/d1b/d1c/d2f/f47 x:0 0 0 2024-09-19T09:34:56.698 INFO:tasks.workunit.client.1.smithi191.stdout:4/184: chown d5/f35 13736 1 2024-09-19T09:34:56.706 INFO:tasks.workunit.client.1.smithi191.stdout:4/185: read d5/fe [2168808,57612] 0 2024-09-19T09:34:56.706 INFO:tasks.workunit.client.1.smithi191.stdout:4/186: chown d5/d1b/d1c/d24/d32 15917 1 2024-09-19T09:34:56.706 INFO:tasks.workunit.client.1.smithi191.stdout:4/187: chown d5/d1b/d1c/d24/d32/d21/d27/c46 20080042 1 2024-09-19T09:34:56.709 INFO:tasks.workunit.client.1.smithi191.stdout:2/119: dread d8/db/d13/f16 [0,4194304] 0 2024-09-19T09:34:56.712 INFO:tasks.workunit.client.1.smithi191.stdout:4/188: dread f1 [0,4194304] 0 2024-09-19T09:34:56.718 INFO:tasks.workunit.client.1.smithi191.stdout:8/163: dwrite d1/d22/f2c [0,4194304] 0 2024-09-19T09:34:56.719 INFO:tasks.workunit.client.1.smithi191.stdout:0/190: dwrite d0/f8 [0,4194304] 0 2024-09-19T09:34:56.721 INFO:tasks.workunit.client.1.smithi191.stdout:8/164: rmdir d1/d22/d37 0 2024-09-19T09:34:56.724 INFO:tasks.workunit.client.1.smithi191.stdout:8/165: creat d1/d7/d8/d17/f3a x:0 0 0 2024-09-19T09:34:56.732 INFO:tasks.workunit.client.1.smithi191.stdout:2/120: dwrite d8/db/d13/f15 [0,4194304] 0 2024-09-19T09:34:56.734 INFO:tasks.workunit.client.1.smithi191.stdout:2/121: getdents d8/d11/d17 0 2024-09-19T09:34:56.742 INFO:tasks.workunit.client.1.smithi191.stdout:8/166: dwrite d1/d7/d8/d28/f2d [0,4194304] 0 2024-09-19T09:34:56.747 INFO:tasks.workunit.client.1.smithi191.stdout:8/167: link d1/d7/d8/d17/f3a d1/d22/f3b 0 2024-09-19T09:34:56.747 INFO:tasks.workunit.client.1.smithi191.stdout:8/168: chown d1/d7/d1a 0 1 2024-09-19T09:34:56.759 INFO:tasks.workunit.client.1.smithi191.stdout:8/169: dwrite d1/d7/d8/d17/f3a [0,4194304] 0 2024-09-19T09:34:56.759 INFO:tasks.workunit.client.1.smithi191.stdout:8/170: chown d1/d7/d8 474507 1 2024-09-19T09:34:56.762 INFO:tasks.workunit.client.1.smithi191.stdout:8/171: unlink d1/d22/c26 0 2024-09-19T09:34:56.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:56 smithi191 ceph-mon[34834]: pgmap v10: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s rd, 7.3 MiB/s wr, 242 op/s 2024-09-19T09:34:56.853 INFO:tasks.workunit.client.0.smithi112.stdout:8/8: rename f0 to f1 0 2024-09-19T09:34:56.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:56 smithi112 ceph-mon[27605]: pgmap v10: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s rd, 7.3 MiB/s wr, 242 op/s 2024-09-19T09:34:56.939 INFO:tasks.workunit.client.0.smithi112.stdout:6/26: creat d8/f9 x:0 0 0 2024-09-19T09:34:56.939 INFO:tasks.workunit.client.0.smithi112.stdout:6/27: truncate d8/f9 161531 0 2024-09-19T09:34:56.939 INFO:tasks.workunit.client.0.smithi112.stdout:6/28: chown d8 2 1 2024-09-19T09:34:56.939 INFO:tasks.workunit.client.0.smithi112.stdout:4/7: getdents . 0 2024-09-19T09:34:56.940 INFO:tasks.workunit.client.0.smithi112.stdout:4/8: chown f0 1144666737 1 2024-09-19T09:34:56.940 INFO:tasks.workunit.client.0.smithi112.stdout:8/9: mknod c2 0 2024-09-19T09:34:56.941 INFO:tasks.workunit.client.0.smithi112.stdout:6/29: fdatasync f6 0 2024-09-19T09:34:56.943 INFO:tasks.workunit.client.0.smithi112.stdout:4/9: mkdir d1 0 2024-09-19T09:34:56.943 INFO:tasks.workunit.client.0.smithi112.stdout:6/30: mknod d8/ca 0 2024-09-19T09:34:56.944 INFO:tasks.workunit.client.0.smithi112.stdout:4/10: write f0 [8873090,99771] 0 2024-09-19T09:34:56.945 INFO:tasks.workunit.client.0.smithi112.stdout:6/31: write f5 [1455189,21275] 0 2024-09-19T09:34:56.945 INFO:tasks.workunit.client.0.smithi112.stdout:6/32: write f5 [759096,97634] 0 2024-09-19T09:34:56.945 INFO:tasks.workunit.client.0.smithi112.stdout:8/10: dread f1 [0,4194304] 0 2024-09-19T09:34:56.948 INFO:tasks.workunit.client.0.smithi112.stdout:4/11: unlink f0 0 2024-09-19T09:34:56.949 INFO:tasks.workunit.client.0.smithi112.stdout:4/12: creat d1/f2 x:0 0 0 2024-09-19T09:34:56.950 INFO:tasks.workunit.client.0.smithi112.stdout:4/13: mknod d1/c3 0 2024-09-19T09:34:56.951 INFO:tasks.workunit.client.0.smithi112.stdout:4/14: dread - d1/f2 zero size 2024-09-19T09:34:56.951 INFO:tasks.workunit.client.0.smithi112.stdout:4/15: write d1/f2 [142016,39282] 0 2024-09-19T09:34:56.951 INFO:tasks.workunit.client.0.smithi112.stdout:4/16: chown d1 179397 1 2024-09-19T09:34:56.953 INFO:tasks.workunit.client.0.smithi112.stdout:6/33: dread f5 [0,4194304] 0 2024-09-19T09:34:56.953 INFO:tasks.workunit.client.0.smithi112.stdout:6/34: write f5 [2264101,107091] 0 2024-09-19T09:34:56.953 INFO:tasks.workunit.client.0.smithi112.stdout:6/35: write f5 [725484,15214] 0 2024-09-19T09:34:56.953 INFO:tasks.workunit.client.0.smithi112.stdout:6/36: write f5 [274484,10081] 0 2024-09-19T09:34:56.956 INFO:tasks.workunit.client.0.smithi112.stdout:4/17: dread d1/f2 [0,4194304] 0 2024-09-19T09:34:56.959 INFO:tasks.workunit.client.0.smithi112.stdout:4/18: mkdir d1/d4 0 2024-09-19T09:34:56.961 INFO:tasks.workunit.client.0.smithi112.stdout:4/19: symlink d1/d4/l5 0 2024-09-19T09:34:56.961 INFO:tasks.workunit.client.0.smithi112.stdout:4/20: truncate d1/f2 1084183 0 2024-09-19T09:34:56.975 INFO:tasks.workunit.client.1.smithi191.stdout:7/68: link d2/f7 d2/f18 0 2024-09-19T09:34:56.979 INFO:tasks.workunit.client.0.smithi112.stdout:6/37: dwrite f5 [0,4194304] 0 2024-09-19T09:34:56.981 INFO:tasks.workunit.client.0.smithi112.stdout:6/38: link l7 d8/lb 0 2024-09-19T09:34:56.987 INFO:tasks.workunit.client.0.smithi112.stdout:4/21: dwrite d1/f2 [0,4194304] 0 2024-09-19T09:34:56.988 INFO:tasks.workunit.client.0.smithi112.stdout:4/22: creat d1/f6 x:0 0 0 2024-09-19T09:34:56.988 INFO:tasks.workunit.client.0.smithi112.stdout:6/39: dread f6 [0,4194304] 0 2024-09-19T09:34:56.988 INFO:tasks.workunit.client.0.smithi112.stdout:6/40: write d8/f9 [146812,104395] 0 2024-09-19T09:34:56.990 INFO:tasks.workunit.client.0.smithi112.stdout:4/23: creat d1/d4/f7 x:0 0 0 2024-09-19T09:34:56.990 INFO:tasks.workunit.client.0.smithi112.stdout:4/24: creat d1/f8 x:0 0 0 2024-09-19T09:34:56.990 INFO:tasks.workunit.client.0.smithi112.stdout:4/25: creat d1/d4/f9 x:0 0 0 2024-09-19T09:34:56.993 INFO:tasks.workunit.client.0.smithi112.stdout:4/26: mknod d1/ca 0 2024-09-19T09:34:56.993 INFO:tasks.workunit.client.0.smithi112.stdout:4/27: creat d1/d4/fb x:0 0 0 2024-09-19T09:34:56.994 INFO:tasks.workunit.client.0.smithi112.stdout:4/28: stat d1 0 2024-09-19T09:34:57.002 INFO:tasks.workunit.client.0.smithi112.stdout:6/41: dwrite f5 [0,4194304] 0 2024-09-19T09:34:57.041 INFO:tasks.workunit.client.1.smithi191.stdout:5/130: truncate d0/d4/d9/de/f18 2867819 0 2024-09-19T09:34:57.041 INFO:tasks.workunit.client.1.smithi191.stdout:5/131: creat d0/d4/d9/de/f2d x:0 0 0 2024-09-19T09:34:57.041 INFO:tasks.workunit.client.1.smithi191.stdout:5/132: write d0/d4/d9/fd [3669433,17793] 0 2024-09-19T09:34:57.049 INFO:tasks.workunit.client.1.smithi191.stdout:5/133: write d0/d4/d9/f1e [3033583,73762] 0 2024-09-19T09:34:57.051 INFO:tasks.workunit.client.1.smithi191.stdout:5/134: mknod d0/d4/d9/de/c2e 0 2024-09-19T09:34:57.051 INFO:tasks.workunit.client.1.smithi191.stdout:5/135: write d0/d4/d9/d1d/d22/f26 [813902,102927] 0 2024-09-19T09:34:57.052 INFO:tasks.workunit.client.1.smithi191.stdout:5/136: creat d0/d1f/f2f x:0 0 0 2024-09-19T09:34:57.054 INFO:tasks.workunit.client.1.smithi191.stdout:3/92: sync 2024-09-19T09:34:57.055 INFO:tasks.workunit.client.1.smithi191.stdout:1/54: sync 2024-09-19T09:34:57.055 INFO:tasks.workunit.client.1.smithi191.stdout:6/57: sync 2024-09-19T09:34:57.055 INFO:tasks.workunit.client.1.smithi191.stdout:6/58: creat d2/de/f14 x:0 0 0 2024-09-19T09:34:57.055 INFO:tasks.workunit.client.1.smithi191.stdout:6/59: chown d2/c3 195496 1 2024-09-19T09:34:57.056 INFO:tasks.workunit.client.1.smithi191.stdout:3/93: creat d12/d13/d1a/d1b/f27 x:0 0 0 2024-09-19T09:34:57.059 INFO:tasks.workunit.client.1.smithi191.stdout:1/55: symlink d3/d9/da/l12 0 2024-09-19T09:34:57.060 INFO:tasks.workunit.client.1.smithi191.stdout:6/60: mkdir d2/de/d15 0 2024-09-19T09:34:57.062 INFO:tasks.workunit.client.1.smithi191.stdout:3/94: mkdir d12/d13/d1a/d28 0 2024-09-19T09:34:57.063 INFO:tasks.workunit.client.1.smithi191.stdout:1/56: unlink f2 0 2024-09-19T09:34:57.064 INFO:tasks.workunit.client.1.smithi191.stdout:3/95: creat d12/d13/d1a/f29 x:0 0 0 2024-09-19T09:34:57.064 INFO:tasks.workunit.client.1.smithi191.stdout:3/96: dread - fe zero size 2024-09-19T09:34:57.065 INFO:tasks.workunit.client.1.smithi191.stdout:3/97: mknod d12/c2a 0 2024-09-19T09:34:57.067 INFO:tasks.workunit.client.1.smithi191.stdout:3/98: symlink d12/l2b 0 2024-09-19T09:34:57.068 INFO:tasks.workunit.client.1.smithi191.stdout:5/137: dwrite d0/d4/d9/f3 [0,4194304] 0 2024-09-19T09:34:57.069 INFO:tasks.workunit.client.1.smithi191.stdout:5/138: creat d0/d4/d9/d1d/d22/f30 x:0 0 0 2024-09-19T09:34:57.069 INFO:tasks.workunit.client.1.smithi191.stdout:5/139: write d0/d4/d9/d1d/d22/f30 [689567,125270] 0 2024-09-19T09:34:57.069 INFO:tasks.workunit.client.1.smithi191.stdout:5/140: write d0/d4/d9/f1e [1461504,1676] 0 2024-09-19T09:34:57.069 INFO:tasks.workunit.client.1.smithi191.stdout:3/99: symlink d12/d13/d1a/d28/l2c 0 2024-09-19T09:34:57.069 INFO:tasks.workunit.client.1.smithi191.stdout:3/100: stat d12/d13/d1a/c21 0 2024-09-19T09:34:57.079 INFO:tasks.workunit.client.1.smithi191.stdout:6/61: dwrite d2/de/f10 [0,4194304] 0 2024-09-19T09:34:57.081 INFO:tasks.workunit.client.1.smithi191.stdout:3/101: dread d12/f1e [0,4194304] 0 2024-09-19T09:34:57.081 INFO:tasks.workunit.client.1.smithi191.stdout:3/102: stat c10 0 2024-09-19T09:34:57.082 INFO:tasks.workunit.client.1.smithi191.stdout:6/62: getdents d2 0 2024-09-19T09:34:57.082 INFO:tasks.workunit.client.1.smithi191.stdout:6/63: creat d2/de/f16 x:0 0 0 2024-09-19T09:34:57.084 INFO:tasks.workunit.client.1.smithi191.stdout:6/64: mknod d2/de/d15/c17 0 2024-09-19T09:34:57.089 INFO:tasks.workunit.client.1.smithi191.stdout:5/141: dwrite d0/d4/d9/f3 [4194304,4194304] 0 2024-09-19T09:34:57.092 INFO:tasks.workunit.client.1.smithi191.stdout:5/142: getdents d0 0 2024-09-19T09:34:57.092 INFO:tasks.workunit.client.1.smithi191.stdout:5/143: stat d0/d4/d9/d1d/d22 0 2024-09-19T09:34:57.094 INFO:tasks.workunit.client.1.smithi191.stdout:5/144: unlink d0/d4/d9/d1d/d22/f26 0 2024-09-19T09:34:57.096 INFO:tasks.workunit.client.1.smithi191.stdout:5/145: unlink d0/d1f/f2f 0 2024-09-19T09:34:57.097 INFO:tasks.workunit.client.1.smithi191.stdout:5/146: dread - d0/d4/d9/de/f2d zero size 2024-09-19T09:34:57.097 INFO:tasks.workunit.client.1.smithi191.stdout:5/147: chown d0/d4/d9/f1e 3009 1 2024-09-19T09:34:57.097 INFO:tasks.workunit.client.1.smithi191.stdout:5/148: unlink d0/d4/f27 0 2024-09-19T09:34:57.101 INFO:tasks.workunit.client.1.smithi191.stdout:3/103: dwrite d12/d13/f19 [4194304,4194304] 0 2024-09-19T09:34:57.101 INFO:tasks.workunit.client.1.smithi191.stdout:3/104: chown d12/d13/d1a/d1b/c1f 49608 1 2024-09-19T09:34:57.101 INFO:tasks.workunit.client.1.smithi191.stdout:3/105: read - d12/f25 zero size 2024-09-19T09:34:57.103 INFO:tasks.workunit.client.1.smithi191.stdout:5/149: dread d0/d4/d9/de/ff [0,4194304] 0 2024-09-19T09:34:57.103 INFO:tasks.workunit.client.1.smithi191.stdout:5/150: chown d0/d4/l6 26351474 1 2024-09-19T09:34:57.105 INFO:tasks.workunit.client.1.smithi191.stdout:5/151: unlink d0/f11 0 2024-09-19T09:34:57.105 INFO:tasks.workunit.client.1.smithi191.stdout:5/152: write d0/d4/d9/f1e [4724937,67550] 0 2024-09-19T09:34:57.112 INFO:tasks.workunit.client.0.smithi112.stdout:0/15: write d2/f3 [4451763,128499] 0 2024-09-19T09:34:57.120 INFO:tasks.workunit.client.1.smithi191.stdout:9/69: rmdir d3/d8 39 2024-09-19T09:34:57.120 INFO:tasks.workunit.client.1.smithi191.stdout:9/70: fsync d3/db/f10 0 2024-09-19T09:34:57.120 INFO:tasks.workunit.client.1.smithi191.stdout:9/71: read - d3/ff zero size 2024-09-19T09:34:57.121 INFO:tasks.workunit.client.1.smithi191.stdout:9/72: mkdir d3/db/d16 0 2024-09-19T09:34:57.136 INFO:tasks.workunit.client.0.smithi112.stdout:0/16: dwrite d2/f3 [0,4194304] 0 2024-09-19T09:34:57.137 INFO:tasks.workunit.client.0.smithi112.stdout:0/17: symlink d2/l5 0 2024-09-19T09:34:57.137 INFO:tasks.workunit.client.0.smithi112.stdout:0/18: fdatasync d2/f4 0 2024-09-19T09:34:57.141 INFO:tasks.workunit.client.1.smithi191.stdout:4/189: truncate d5/d1b/d1c/d2f/d19/f20 853256 0 2024-09-19T09:34:57.142 INFO:tasks.workunit.client.1.smithi191.stdout:4/190: rmdir d5/d1b 39 2024-09-19T09:34:57.142 INFO:tasks.workunit.client.1.smithi191.stdout:4/191: fsync d5/d1b/d1c/d2f/f39 0 2024-09-19T09:34:57.142 INFO:tasks.workunit.client.1.smithi191.stdout:4/192: creat d5/d1b/d1c/d28/f48 x:0 0 0 2024-09-19T09:34:57.144 INFO:tasks.workunit.client.0.smithi112.stdout:0/19: read d2/f3 [3179675,6841] 0 2024-09-19T09:34:57.145 INFO:tasks.workunit.client.1.smithi191.stdout:0/191: truncate d0/d9/de/f19 1641017 0 2024-09-19T09:34:57.145 INFO:tasks.workunit.client.1.smithi191.stdout:0/192: truncate d0/d9/d1c/d20/f31 92632 0 2024-09-19T09:34:57.146 INFO:tasks.workunit.client.0.smithi112.stdout:0/20: symlink d2/l6 0 2024-09-19T09:34:57.146 INFO:tasks.workunit.client.0.smithi112.stdout:0/21: creat d2/f7 x:0 0 0 2024-09-19T09:34:57.149 INFO:tasks.workunit.client.0.smithi112.stdout:0/22: rename d2/f3 to d2/f8 0 2024-09-19T09:34:57.149 INFO:tasks.workunit.client.0.smithi112.stdout:0/23: chown d2/f7 0 1 2024-09-19T09:34:57.150 INFO:tasks.workunit.client.1.smithi191.stdout:0/193: rmdir d0/d9/d1c/d20 39 2024-09-19T09:34:57.151 INFO:tasks.workunit.client.1.smithi191.stdout:4/193: dread d5/d1b/d1c/d2f/d19/f34 [0,4194304] 0 2024-09-19T09:34:57.151 INFO:tasks.workunit.client.1.smithi191.stdout:0/194: link d0/d9/f1a d0/d9/d1c/d1f/d24/f3f 0 2024-09-19T09:34:57.151 INFO:tasks.workunit.client.1.smithi191.stdout:0/195: chown d0/d9/d1c/d20/f37 171 1 2024-09-19T09:34:57.152 INFO:tasks.workunit.client.1.smithi191.stdout:4/194: truncate d5/d1b/d1c/d24/d32/f16 1117494 0 2024-09-19T09:34:57.152 INFO:tasks.workunit.client.0.smithi112.stdout:0/24: dread d2/f8 [0,4194304] 0 2024-09-19T09:34:57.153 INFO:tasks.workunit.client.0.smithi112.stdout:0/25: creat d2/f9 x:0 0 0 2024-09-19T09:34:57.153 INFO:tasks.workunit.client.0.smithi112.stdout:0/26: creat d2/fa x:0 0 0 2024-09-19T09:34:57.156 INFO:tasks.workunit.client.1.smithi191.stdout:4/195: write d5/d1b/d1c/f29 [3274265,115786] 0 2024-09-19T09:34:57.157 INFO:tasks.workunit.client.1.smithi191.stdout:4/196: symlink d5/d38/l49 0 2024-09-19T09:34:57.158 INFO:tasks.workunit.client.1.smithi191.stdout:4/197: mkdir d5/d1b/d1c/d24/d32/d21/d4a 0 2024-09-19T09:34:57.159 INFO:tasks.workunit.client.1.smithi191.stdout:4/198: dread - d5/d1b/d1c/d28/f48 zero size 2024-09-19T09:34:57.159 INFO:tasks.workunit.client.1.smithi191.stdout:4/199: write d5/d1b/d1c/d24/d32/f2d [566257,93766] 0 2024-09-19T09:34:57.159 INFO:tasks.workunit.client.1.smithi191.stdout:4/200: write d5/d1b/d1c/d24/d32/d21/d27/f3c [1015420,99264] 0 2024-09-19T09:34:57.167 INFO:tasks.workunit.client.1.smithi191.stdout:8/172: rename d1/d7/d8 to d1/d16/d3c 0 2024-09-19T09:34:57.168 INFO:tasks.workunit.client.1.smithi191.stdout:8/173: truncate d1/d7/d1a/f1f 170203 0 2024-09-19T09:34:57.170 INFO:tasks.workunit.client.1.smithi191.stdout:1/57: rename d3/d9/da/db/ff to d3/d9/f13 0 2024-09-19T09:34:57.170 INFO:tasks.workunit.client.1.smithi191.stdout:1/58: write d3/d9/fe [581872,109693] 0 2024-09-19T09:34:57.170 INFO:tasks.workunit.client.1.smithi191.stdout:1/59: chown d3/d9/fe 4 1 2024-09-19T09:34:57.170 INFO:tasks.workunit.client.1.smithi191.stdout:8/174: symlink d1/d16/d2e/d32/l3d 0 2024-09-19T09:34:57.171 INFO:tasks.workunit.client.1.smithi191.stdout:5/153: rename d0/d4/d9/f3 to d0/d4/d9/d1d/d28/f31 0 2024-09-19T09:34:57.172 INFO:tasks.workunit.client.1.smithi191.stdout:1/60: link d3/d9/da/l12 d3/d9/da/l14 0 2024-09-19T09:34:57.174 INFO:tasks.workunit.client.1.smithi191.stdout:0/196: rename d0/d9/de/f2f to d0/d9/d13/f40 0 2024-09-19T09:34:57.174 INFO:tasks.workunit.client.1.smithi191.stdout:0/197: write d0/d9/d1c/d20/f37 [919165,50534] 0 2024-09-19T09:34:57.175 INFO:tasks.workunit.client.1.smithi191.stdout:1/61: truncate f0 101291 0 2024-09-19T09:34:57.175 INFO:tasks.workunit.client.1.smithi191.stdout:5/154: dread d0/d4/d9/d1d/d22/f30 [0,4194304] 0 2024-09-19T09:34:57.175 INFO:tasks.workunit.client.1.smithi191.stdout:4/201: dwrite d5/d1b/d1c/d24/d32/d21/f40 [0,4194304] 0 2024-09-19T09:34:57.178 INFO:tasks.workunit.client.1.smithi191.stdout:5/155: mknod d0/d4/d9/d1d/d29/c32 0 2024-09-19T09:34:57.179 INFO:tasks.workunit.client.1.smithi191.stdout:1/62: getdents d3 0 2024-09-19T09:34:57.180 INFO:tasks.workunit.client.1.smithi191.stdout:5/156: mkdir d0/d4/d9/d1d/d29/d33 0 2024-09-19T09:34:57.181 INFO:tasks.workunit.client.1.smithi191.stdout:5/157: fdatasync d0/d4/d9/d1d/d28/f31 0 2024-09-19T09:34:57.182 INFO:tasks.workunit.client.1.smithi191.stdout:5/158: link d0/d4/d9/fd d0/d4/d9/d1d/d29/d33/f34 0 2024-09-19T09:34:57.183 INFO:tasks.workunit.client.1.smithi191.stdout:5/159: mknod d0/d4/d9/de/c35 0 2024-09-19T09:34:57.183 INFO:tasks.workunit.client.1.smithi191.stdout:5/160: chown d0/d4/d9/fd 51799 1 2024-09-19T09:34:57.183 INFO:tasks.workunit.client.1.smithi191.stdout:0/198: dread d0/fd [0,4194304] 0 2024-09-19T09:34:57.186 INFO:tasks.workunit.client.1.smithi191.stdout:4/202: dread d5/f35 [0,4194304] 0 2024-09-19T09:34:57.187 INFO:tasks.workunit.client.1.smithi191.stdout:0/199: link d0/d9/d1c/d1f/d24/l3a d0/d9/d1c/d20/l41 0 2024-09-19T09:34:57.187 INFO:tasks.workunit.client.1.smithi191.stdout:4/203: creat d5/d1b/d1c/d28/f4b x:0 0 0 2024-09-19T09:34:57.187 INFO:tasks.workunit.client.1.smithi191.stdout:1/63: write d3/f6 [4139941,121061] 0 2024-09-19T09:34:57.191 INFO:tasks.workunit.client.1.smithi191.stdout:0/200: rename d0/d9/d1c/d1f/d24/c2a to d0/d9/c42 0 2024-09-19T09:34:57.192 INFO:tasks.workunit.client.1.smithi191.stdout:4/204: mknod d5/d1b/d1c/c4c 0 2024-09-19T09:34:57.193 INFO:tasks.workunit.client.1.smithi191.stdout:4/205: creat d5/d1b/d1c/d24/d32/d21/d4a/f4d x:0 0 0 2024-09-19T09:34:57.194 INFO:tasks.workunit.client.1.smithi191.stdout:4/206: creat d5/f4e x:0 0 0 2024-09-19T09:34:57.196 INFO:tasks.workunit.client.1.smithi191.stdout:4/207: link f4 d5/d1b/f4f 0 2024-09-19T09:34:57.197 INFO:tasks.workunit.client.1.smithi191.stdout:4/208: creat d5/d1b/d1c/d24/d32/d21/f50 x:0 0 0 2024-09-19T09:34:57.198 INFO:tasks.workunit.client.1.smithi191.stdout:8/175: truncate d1/d16/f2a 2681258 0 2024-09-19T09:34:57.198 INFO:tasks.workunit.client.1.smithi191.stdout:8/176: chown d1/d16/d3c/la 0 1 2024-09-19T09:34:57.198 INFO:tasks.workunit.client.1.smithi191.stdout:8/177: dread - d1/d16/d3c/d28/f33 zero size 2024-09-19T09:34:57.198 INFO:tasks.workunit.client.1.smithi191.stdout:8/178: readlink d1/d16/d2e/d32/l3d 0 2024-09-19T09:34:57.200 INFO:tasks.workunit.client.1.smithi191.stdout:0/201: dread d0/d9/d13/f16 [0,4194304] 0 2024-09-19T09:34:57.201 INFO:tasks.workunit.client.1.smithi191.stdout:0/202: mknod d0/d9/d13/c43 0 2024-09-19T09:34:57.201 INFO:tasks.workunit.client.1.smithi191.stdout:0/203: write d0/f34 [614933,108946] 0 2024-09-19T09:34:57.203 INFO:tasks.workunit.client.1.smithi191.stdout:0/204: rename d0/d9/d1c/d1f/f23 to d0/d9/d1c/d1f/d24/d29/f44 0 2024-09-19T09:34:57.207 INFO:tasks.workunit.client.1.smithi191.stdout:1/64: dwrite d3/d9/fe [0,4194304] 0 2024-09-19T09:34:57.212 INFO:tasks.workunit.client.1.smithi191.stdout:8/179: dread d1/d16/d3c/d28/f2d [0,4194304] 0 2024-09-19T09:34:57.214 INFO:tasks.workunit.client.1.smithi191.stdout:8/180: mkdir d1/d16/d23/d3e 0 2024-09-19T09:34:57.214 INFO:tasks.workunit.client.1.smithi191.stdout:4/209: write d5/fa [3437567,125577] 0 2024-09-19T09:34:57.214 INFO:tasks.workunit.client.1.smithi191.stdout:4/210: creat d5/d1b/d1c/d24/d32/d21/d4a/f51 x:0 0 0 2024-09-19T09:34:57.219 INFO:tasks.workunit.client.1.smithi191.stdout:0/205: dwrite d0/d9/f22 [0,4194304] 0 2024-09-19T09:34:57.222 INFO:tasks.workunit.client.1.smithi191.stdout:0/206: mknod d0/d9/d1c/d1f/d24/d39/c45 0 2024-09-19T09:34:57.222 INFO:tasks.workunit.client.1.smithi191.stdout:0/207: readlink d0/d9/d1c/d1f/d24/l27 0 2024-09-19T09:34:57.242 INFO:tasks.workunit.client.1.smithi191.stdout:1/65: dwrite d3/f4 [0,4194304] 0 2024-09-19T09:34:57.242 INFO:tasks.workunit.client.1.smithi191.stdout:8/181: dwrite d1/d16/d3c/d17/f3a [0,4194304] 0 2024-09-19T09:34:57.242 INFO:tasks.workunit.client.1.smithi191.stdout:8/182: chown d1/d16/d2e/d32/l3d 5024 1 2024-09-19T09:34:57.242 INFO:tasks.workunit.client.1.smithi191.stdout:8/183: chown d1/d22/f2c 4 1 2024-09-19T09:34:57.242 INFO:tasks.workunit.client.1.smithi191.stdout:4/211: dwrite d5/d1b/d1c/d24/d32/d21/d4a/f4d [0,4194304] 0 2024-09-19T09:34:57.242 INFO:tasks.workunit.client.1.smithi191.stdout:4/212: write d5/d1b/d1c/d28/f4b [845531,78938] 0 2024-09-19T09:34:57.242 INFO:tasks.workunit.client.1.smithi191.stdout:4/213: creat d5/d1b/d1c/d2f/f52 x:0 0 0 2024-09-19T09:34:57.243 INFO:tasks.workunit.client.1.smithi191.stdout:1/66: symlink d3/l15 0 2024-09-19T09:34:57.244 INFO:tasks.workunit.client.1.smithi191.stdout:8/184: mknod d1/d7/d1a/c3f 0 2024-09-19T09:34:57.244 INFO:tasks.workunit.client.1.smithi191.stdout:8/185: readlink d1/d16/d3c/d17/l1b 0 2024-09-19T09:34:57.249 INFO:tasks.workunit.client.1.smithi191.stdout:1/67: symlink d3/l16 0 2024-09-19T09:34:57.249 INFO:tasks.workunit.client.1.smithi191.stdout:1/68: write d3/d9/da/db/fd [198097,34608] 0 2024-09-19T09:34:57.249 INFO:tasks.workunit.client.1.smithi191.stdout:1/69: creat d3/d9/f17 x:0 0 0 2024-09-19T09:34:57.250 INFO:tasks.workunit.client.1.smithi191.stdout:8/186: rename d1/d16/d3c/d17/d39 to d1/d16/d2e/d32/d40 0 2024-09-19T09:34:57.251 INFO:tasks.workunit.client.1.smithi191.stdout:8/187: write d1/d16/d3c/d28/f33 [648807,129378] 0 2024-09-19T09:34:57.251 INFO:tasks.workunit.client.1.smithi191.stdout:8/188: read d1/d16/d2e/f38 [4181233,68749] 0 2024-09-19T09:34:57.252 INFO:tasks.workunit.client.1.smithi191.stdout:1/70: symlink d3/d9/da/l18 0 2024-09-19T09:34:57.253 INFO:tasks.workunit.client.1.smithi191.stdout:8/189: unlink d1/d16/d3c/d17/l1b 0 2024-09-19T09:34:57.255 INFO:tasks.workunit.client.1.smithi191.stdout:1/71: link d3/l16 d3/d9/l19 0 2024-09-19T09:34:57.255 INFO:tasks.workunit.client.1.smithi191.stdout:1/72: write d3/f6 [1878772,17912] 0 2024-09-19T09:34:57.255 INFO:tasks.workunit.client.1.smithi191.stdout:8/190: creat d1/d16/d3c/f41 x:0 0 0 2024-09-19T09:34:57.256 INFO:tasks.workunit.client.1.smithi191.stdout:8/191: rmdir d1/d7/d1a 39 2024-09-19T09:34:57.258 INFO:tasks.workunit.client.1.smithi191.stdout:8/192: symlink d1/l42 0 2024-09-19T09:34:57.260 INFO:tasks.workunit.client.1.smithi191.stdout:8/193: link d1/d16/d3c/d28/f33 d1/d16/d23/f43 0 2024-09-19T09:34:57.260 INFO:tasks.workunit.client.1.smithi191.stdout:8/194: chown d1/f14 510 1 2024-09-19T09:34:57.260 INFO:tasks.workunit.client.1.smithi191.stdout:8/195: mknod d1/d16/c44 0 2024-09-19T09:34:57.260 INFO:tasks.workunit.client.1.smithi191.stdout:8/196: readlink d1/d7/l18 0 2024-09-19T09:34:57.263 INFO:tasks.workunit.client.1.smithi191.stdout:8/197: mknod d1/c45 0 2024-09-19T09:34:57.268 INFO:tasks.workunit.client.1.smithi191.stdout:8/198: dread d1/d16/d23/f43 [0,4194304] 0 2024-09-19T09:34:57.270 INFO:tasks.workunit.client.1.smithi191.stdout:8/199: link d1/d22/f3b d1/d16/f46 0 2024-09-19T09:34:57.270 INFO:tasks.workunit.client.1.smithi191.stdout:8/200: truncate d1/d16/d3c/f41 27696 0 2024-09-19T09:34:57.271 INFO:tasks.workunit.client.1.smithi191.stdout:8/201: truncate d1/d7/d1a/f25 994501 0 2024-09-19T09:34:57.271 INFO:tasks.workunit.client.1.smithi191.stdout:8/202: dread - d1/d16/d3c/d17/f1e zero size 2024-09-19T09:34:57.271 INFO:tasks.workunit.client.1.smithi191.stdout:8/203: mkdir d1/d22/d47 0 2024-09-19T09:34:57.278 INFO:tasks.workunit.client.1.smithi191.stdout:8/204: dread d1/d16/d3c/fc [0,4194304] 0 2024-09-19T09:34:57.279 INFO:tasks.workunit.client.1.smithi191.stdout:8/205: creat d1/d16/d3c/d17/f48 x:0 0 0 2024-09-19T09:34:57.279 INFO:tasks.workunit.client.1.smithi191.stdout:8/206: truncate d1/d16/d3c/f29 290417 0 2024-09-19T09:34:57.289 INFO:tasks.workunit.client.1.smithi191.stdout:8/207: link d1/d7/fe d1/d16/d3c/d17/f49 0 2024-09-19T09:34:57.290 INFO:tasks.workunit.client.1.smithi191.stdout:8/208: stat d1/d16/d3c/la 0 2024-09-19T09:34:57.300 INFO:tasks.workunit.client.0.smithi112.stdout:8/11: getdents . 0 2024-09-19T09:34:57.300 INFO:tasks.workunit.client.0.smithi112.stdout:8/12: creat f3 x:0 0 0 2024-09-19T09:34:57.301 INFO:tasks.workunit.client.1.smithi191.stdout:8/209: read d1/d16/f46 [1560731,104587] 0 2024-09-19T09:34:57.302 INFO:tasks.workunit.client.0.smithi112.stdout:8/13: creat f4 x:0 0 0 2024-09-19T09:34:57.305 INFO:tasks.workunit.client.0.smithi112.stdout:8/14: mknod c5 0 2024-09-19T09:34:57.306 INFO:tasks.workunit.client.0.smithi112.stdout:8/15: rename c5 to c6 0 2024-09-19T09:34:57.306 INFO:tasks.workunit.client.0.smithi112.stdout:8/16: write f3 [347507,106125] 0 2024-09-19T09:34:57.309 INFO:tasks.workunit.client.1.smithi191.stdout:8/210: link d1/d16/d3c/d28/f2d d1/d16/f4a 0 2024-09-19T09:34:57.314 INFO:tasks.workunit.client.1.smithi191.stdout:7/69: mknod d2/c19 0 2024-09-19T09:34:57.314 INFO:tasks.workunit.client.1.smithi191.stdout:7/70: fdatasync d2/f7 0 2024-09-19T09:34:57.314 INFO:tasks.workunit.client.0.smithi112.stdout:4/29: write d1/f2 [4972186,62409] 0 2024-09-19T09:34:57.314 INFO:tasks.workunit.client.0.smithi112.stdout:4/30: dread - d1/d4/f7 zero size 2024-09-19T09:34:57.315 INFO:tasks.workunit.client.1.smithi191.stdout:7/71: creat d2/f1a x:0 0 0 2024-09-19T09:34:57.317 INFO:tasks.workunit.client.1.smithi191.stdout:7/72: creat d2/f1b x:0 0 0 2024-09-19T09:34:57.318 INFO:tasks.workunit.client.1.smithi191.stdout:7/73: readlink d2/la 0 2024-09-19T09:34:57.319 INFO:tasks.workunit.client.1.smithi191.stdout:7/74: rename d2 to d2/d1c 22 2024-09-19T09:34:57.320 INFO:tasks.workunit.client.1.smithi191.stdout:7/75: creat d2/f1d x:0 0 0 2024-09-19T09:34:57.322 INFO:tasks.workunit.client.1.smithi191.stdout:7/76: creat d2/f1e x:0 0 0 2024-09-19T09:34:57.324 INFO:tasks.workunit.client.1.smithi191.stdout:7/77: rename d2/f11 to d2/f1f 0 2024-09-19T09:34:57.326 INFO:tasks.workunit.client.1.smithi191.stdout:7/78: read d2/f1f [227422,35265] 0 2024-09-19T09:34:57.329 INFO:tasks.workunit.client.1.smithi191.stdout:7/79: rename l0 to d2/l20 0 2024-09-19T09:34:57.330 INFO:tasks.workunit.client.1.smithi191.stdout:7/80: truncate d2/f9 497610 0 2024-09-19T09:34:57.331 INFO:tasks.workunit.client.1.smithi191.stdout:7/81: creat d2/f21 x:0 0 0 2024-09-19T09:34:57.331 INFO:tasks.workunit.client.1.smithi191.stdout:7/82: truncate d2/f21 185990 0 2024-09-19T09:34:57.334 INFO:tasks.workunit.client.1.smithi191.stdout:6/65: truncate d2/de/f10 569423 0 2024-09-19T09:34:57.334 INFO:tasks.workunit.client.0.smithi112.stdout:4/31: dwrite d1/d4/fb [0,4194304] 0 2024-09-19T09:34:57.335 INFO:tasks.workunit.client.1.smithi191.stdout:6/66: creat d2/de/d15/f18 x:0 0 0 2024-09-19T09:34:57.336 INFO:tasks.workunit.client.0.smithi112.stdout:8/17: dwrite f1 [0,4194304] 0 2024-09-19T09:34:57.338 INFO:tasks.workunit.client.0.smithi112.stdout:4/32: rename d1/f8 to d1/fc 0 2024-09-19T09:34:57.341 INFO:tasks.workunit.client.0.smithi112.stdout:8/18: mkdir d7 0 2024-09-19T09:34:57.342 INFO:tasks.workunit.client.0.smithi112.stdout:8/19: symlink d7/l8 0 2024-09-19T09:34:57.343 INFO:tasks.workunit.client.0.smithi112.stdout:8/20: symlink d7/l9 0 2024-09-19T09:34:57.345 INFO:tasks.workunit.client.0.smithi112.stdout:8/21: creat d7/fa x:0 0 0 2024-09-19T09:34:57.346 INFO:tasks.workunit.client.0.smithi112.stdout:4/33: dread d1/d4/fb [0,4194304] 0 2024-09-19T09:34:57.346 INFO:tasks.workunit.client.0.smithi112.stdout:4/34: write d1/f6 [359935,53815] 0 2024-09-19T09:34:57.347 INFO:tasks.workunit.client.1.smithi191.stdout:9/73: rmdir d3 39 2024-09-19T09:34:57.347 INFO:tasks.workunit.client.1.smithi191.stdout:9/74: chown d3/db/fd 843 1 2024-09-19T09:34:57.347 INFO:tasks.workunit.client.1.smithi191.stdout:9/75: read - d3/db/f11 zero size 2024-09-19T09:34:57.349 INFO:tasks.workunit.client.1.smithi191.stdout:9/76: mkdir d3/db/d16/d17 0 2024-09-19T09:34:57.349 INFO:tasks.workunit.client.1.smithi191.stdout:9/77: readlink d3/l4 0 2024-09-19T09:34:57.349 INFO:tasks.workunit.client.1.smithi191.stdout:9/78: truncate d3/db/f10 608715 0 2024-09-19T09:34:57.350 INFO:tasks.workunit.client.1.smithi191.stdout:9/79: creat d3/f18 x:0 0 0 2024-09-19T09:34:57.351 INFO:tasks.workunit.client.1.smithi191.stdout:9/80: getdents d3/db 0 2024-09-19T09:34:57.351 INFO:tasks.workunit.client.1.smithi191.stdout:9/81: chown d3/l4 10770 1 2024-09-19T09:34:57.354 INFO:tasks.workunit.client.1.smithi191.stdout:4/214: link d5/d1b/d1c/d2f/d19/f20 d5/d1b/d1c/d24/d32/d21/d27/f53 0 2024-09-19T09:34:57.355 INFO:tasks.workunit.client.0.smithi112.stdout:0/27: unlink d2/f8 0 2024-09-19T09:34:57.356 INFO:tasks.workunit.client.0.smithi112.stdout:0/28: creat d2/fb x:0 0 0 2024-09-19T09:34:57.356 INFO:tasks.workunit.client.0.smithi112.stdout:0/29: truncate d2/fa 49609 0 2024-09-19T09:34:57.366 INFO:tasks.workunit.client.0.smithi112.stdout:8/22: dwrite f4 [0,4194304] 0 2024-09-19T09:34:57.366 INFO:tasks.workunit.client.0.smithi112.stdout:8/23: chown f1 108733 1 2024-09-19T09:34:57.366 INFO:tasks.workunit.client.0.smithi112.stdout:8/24: dread - d7/fa zero size 2024-09-19T09:34:57.367 INFO:tasks.workunit.client.1.smithi191.stdout:2/122: sync 2024-09-19T09:34:57.374 INFO:tasks.workunit.client.1.smithi191.stdout:5/161: rmdir d0 39 2024-09-19T09:34:57.376 INFO:tasks.workunit.client.1.smithi191.stdout:2/123: dread f0 [0,4194304] 0 2024-09-19T09:34:57.376 INFO:tasks.workunit.client.1.smithi191.stdout:5/162: creat d0/d4/d9/de/f36 x:0 0 0 2024-09-19T09:34:57.377 INFO:tasks.workunit.client.1.smithi191.stdout:5/163: fsync d0/d4/d9/d1d/d28/f31 0 2024-09-19T09:34:57.378 INFO:tasks.workunit.client.1.smithi191.stdout:2/124: creat d8/d11/d17/f21 x:0 0 0 2024-09-19T09:34:57.381 INFO:tasks.workunit.client.1.smithi191.stdout:5/164: creat d0/d4/f37 x:0 0 0 2024-09-19T09:34:57.381 INFO:tasks.workunit.client.1.smithi191.stdout:9/82: dwrite d3/d8/f15 [0,4194304] 0 2024-09-19T09:34:57.381 INFO:tasks.workunit.client.1.smithi191.stdout:9/83: rename d3/db to d3/db/d16/d19 22 2024-09-19T09:34:57.383 INFO:tasks.workunit.client.1.smithi191.stdout:9/84: truncate d3/fe 1302705 0 2024-09-19T09:34:57.383 INFO:tasks.workunit.client.1.smithi191.stdout:2/125: dread d8/f1d [0,4194304] 0 2024-09-19T09:34:57.387 INFO:tasks.workunit.client.1.smithi191.stdout:2/126: rename d8/db/f1b to d8/d11/d17/f22 0 2024-09-19T09:34:57.389 INFO:tasks.workunit.client.1.smithi191.stdout:4/215: dwrite d5/d1b/d1c/d24/d32/d21/f40 [0,4194304] 0 2024-09-19T09:34:57.396 INFO:tasks.workunit.client.1.smithi191.stdout:1/73: dwrite f0 [0,4194304] 0 2024-09-19T09:34:57.396 INFO:tasks.workunit.client.1.smithi191.stdout:1/74: dread - d3/d9/f17 zero size 2024-09-19T09:34:57.398 INFO:tasks.workunit.client.1.smithi191.stdout:1/75: creat d3/d9/da/dc/f1a x:0 0 0 2024-09-19T09:34:57.408 INFO:tasks.workunit.client.0.smithi112.stdout:8/25: dwrite f3 [0,4194304] 0 2024-09-19T09:34:57.409 INFO:tasks.workunit.client.1.smithi191.stdout:1/76: read d3/f4 [488097,22227] 0 2024-09-19T09:34:57.409 INFO:tasks.workunit.client.1.smithi191.stdout:1/77: creat d3/d9/da/db/f1b x:0 0 0 2024-09-19T09:34:57.411 INFO:tasks.workunit.client.0.smithi112.stdout:8/26: mkdir d7/db 0 2024-09-19T09:34:57.414 INFO:tasks.workunit.client.0.smithi112.stdout:8/27: symlink d7/db/lc 0 2024-09-19T09:34:57.422 INFO:tasks.workunit.client.1.smithi191.stdout:5/165: dwrite d0/d4/d9/f1e [0,4194304] 0 2024-09-19T09:34:57.424 INFO:tasks.workunit.client.1.smithi191.stdout:5/166: creat d0/d4/d9/d1d/d29/d33/f38 x:0 0 0 2024-09-19T09:34:57.427 INFO:tasks.workunit.client.1.smithi191.stdout:5/167: rename d0/d4/d9/de/l15 to d0/d4/d9/d1d/d29/l39 0 2024-09-19T09:34:57.427 INFO:tasks.workunit.client.1.smithi191.stdout:5/168: creat d0/d4/f3a x:0 0 0 2024-09-19T09:34:57.428 INFO:tasks.workunit.client.0.smithi112.stdout:8/28: dread f1 [0,4194304] 0 2024-09-19T09:34:57.428 INFO:tasks.workunit.client.0.smithi112.stdout:8/29: fdatasync d7/fa 0 2024-09-19T09:34:57.428 INFO:tasks.workunit.client.0.smithi112.stdout:8/30: fdatasync f1 0 2024-09-19T09:34:57.428 INFO:tasks.workunit.client.0.smithi112.stdout:8/31: creat d7/fd x:0 0 0 2024-09-19T09:34:57.428 INFO:tasks.workunit.client.0.smithi112.stdout:8/32: write d7/fa [166167,33971] 0 2024-09-19T09:34:57.429 INFO:tasks.workunit.client.0.smithi112.stdout:8/33: chown d7 658212 1 2024-09-19T09:34:57.429 INFO:tasks.workunit.client.1.smithi191.stdout:5/169: write d0/d4/d9/d1d/d22/f30 [27839,42203] 0 2024-09-19T09:34:57.433 INFO:tasks.workunit.client.1.smithi191.stdout:2/127: dwrite d8/db/d13/f15 [0,4194304] 0 2024-09-19T09:34:57.434 INFO:tasks.workunit.client.1.smithi191.stdout:1/78: dwrite d3/d9/da/db/f1b [0,4194304] 0 2024-09-19T09:34:57.434 INFO:tasks.workunit.client.1.smithi191.stdout:4/216: dwrite d5/f35 [0,4194304] 0 2024-09-19T09:34:57.434 INFO:tasks.workunit.client.1.smithi191.stdout:7/83: getdents d2 0 2024-09-19T09:34:57.434 INFO:tasks.workunit.client.1.smithi191.stdout:7/84: chown d2/f18 19500405 1 2024-09-19T09:34:57.434 INFO:tasks.workunit.client.1.smithi191.stdout:7/85: chown d2/c5 1861940 1 2024-09-19T09:34:57.438 INFO:tasks.workunit.client.1.smithi191.stdout:5/170: write d0/d4/d9/f1e [1546238,63485] 0 2024-09-19T09:34:57.438 INFO:tasks.workunit.client.1.smithi191.stdout:1/79: unlink d3/c11 0 2024-09-19T09:34:57.441 INFO:tasks.workunit.client.1.smithi191.stdout:4/217: symlink d5/d1b/d1c/d2f/d37/l54 0 2024-09-19T09:34:57.442 INFO:tasks.workunit.client.1.smithi191.stdout:7/86: symlink d2/l22 0 2024-09-19T09:34:57.444 INFO:tasks.workunit.client.1.smithi191.stdout:6/67: read d2/de/f10 [457622,94497] 0 2024-09-19T09:34:57.444 INFO:tasks.workunit.client.1.smithi191.stdout:2/128: dread d8/db/d13/f15 [0,4194304] 0 2024-09-19T09:34:57.444 INFO:tasks.workunit.client.0.smithi112.stdout:4/35: rename d1/fc to d1/fd 0 2024-09-19T09:34:57.446 INFO:tasks.workunit.client.1.smithi191.stdout:5/171: mkdir d0/d4/d9/d1d/d22/d3b 0 2024-09-19T09:34:57.448 INFO:tasks.workunit.client.0.smithi112.stdout:4/36: dread d1/d4/fb [0,4194304] 0 2024-09-19T09:34:57.448 INFO:tasks.workunit.client.0.smithi112.stdout:4/37: chown d1/f2 2080218 1 2024-09-19T09:34:57.449 INFO:tasks.workunit.client.1.smithi191.stdout:1/80: rename d3/d9/da/dc/f1a to d3/d9/da/dc/f1c 0 2024-09-19T09:34:57.449 INFO:tasks.workunit.client.1.smithi191.stdout:1/81: readlink d3/l15 0 2024-09-19T09:34:57.449 INFO:tasks.workunit.client.1.smithi191.stdout:1/82: write d3/f6 [4356779,107831] 0 2024-09-19T09:34:57.449 INFO:tasks.workunit.client.1.smithi191.stdout:1/83: fdatasync d3/d9/da/db/f1b 0 2024-09-19T09:34:57.451 INFO:tasks.workunit.client.1.smithi191.stdout:4/218: unlink d5/d1b/d1c/d24/d32/d21/f40 0 2024-09-19T09:34:57.451 INFO:tasks.workunit.client.1.smithi191.stdout:4/219: chown d5/f35 0 1 2024-09-19T09:34:57.451 INFO:tasks.workunit.client.1.smithi191.stdout:4/220: read - d5/d1b/d1c/d24/d32/d21/f50 zero size 2024-09-19T09:34:57.454 INFO:tasks.workunit.client.0.smithi112.stdout:8/34: dwrite f1 [0,4194304] 0 2024-09-19T09:34:57.454 INFO:tasks.workunit.client.1.smithi191.stdout:6/68: mkdir d2/de/d19 0 2024-09-19T09:34:57.454 INFO:tasks.workunit.client.1.smithi191.stdout:6/69: write d2/de/f14 [1013181,118667] 0 2024-09-19T09:34:57.455 INFO:tasks.workunit.client.1.smithi191.stdout:5/172: creat d0/d4/d9/d1d/d22/d3b/f3c x:0 0 0 2024-09-19T09:34:57.458 INFO:tasks.workunit.client.0.smithi112.stdout:8/35: rename f1 to d7/fe 0 2024-09-19T09:34:57.458 INFO:tasks.workunit.client.0.smithi112.stdout:8/36: fdatasync f3 0 2024-09-19T09:34:57.458 INFO:tasks.workunit.client.0.smithi112.stdout:8/37: truncate d7/fd 692843 0 2024-09-19T09:34:57.460 INFO:tasks.workunit.client.1.smithi191.stdout:3/106: sync 2024-09-19T09:34:57.460 INFO:tasks.workunit.client.1.smithi191.stdout:5/173: dread d0/d4/d9/fd [0,4194304] 0 2024-09-19T09:34:57.460 INFO:tasks.workunit.client.1.smithi191.stdout:5/174: read - d0/d4/d9/d1d/d22/d3b/f3c zero size 2024-09-19T09:34:57.461 INFO:tasks.workunit.client.1.smithi191.stdout:5/175: write d0/d4/d9/f2b [840099,466] 0 2024-09-19T09:34:57.462 INFO:tasks.workunit.client.0.smithi112.stdout:0/30: getdents d2 0 2024-09-19T09:34:57.463 INFO:tasks.workunit.client.0.smithi112.stdout:0/31: chown d2 55735060 1 2024-09-19T09:34:57.467 INFO:tasks.workunit.client.1.smithi191.stdout:6/70: write d2/f6 [4600030,78136] 0 2024-09-19T09:34:57.468 INFO:tasks.workunit.client.1.smithi191.stdout:5/176: mknod d0/d4/d9/d1d/d22/c3d 0 2024-09-19T09:34:57.469 INFO:tasks.workunit.client.1.smithi191.stdout:5/177: chown d0/d1f/c2a 3493 1 2024-09-19T09:34:57.469 INFO:tasks.workunit.client.1.smithi191.stdout:2/129: rename d8/de to d8/db/d13/d23 0 2024-09-19T09:34:57.470 INFO:tasks.workunit.client.1.smithi191.stdout:7/87: dwrite d2/f21 [0,4194304] 0 2024-09-19T09:34:57.470 INFO:tasks.workunit.client.1.smithi191.stdout:5/178: rename d0/d4/d9/d1d/d28 to d0/d4/d9/d1d/d28/d3e 22 2024-09-19T09:34:57.470 INFO:tasks.workunit.client.1.smithi191.stdout:9/85: fsync d3/fe 0 2024-09-19T09:34:57.472 INFO:tasks.workunit.client.1.smithi191.stdout:0/208: sync 2024-09-19T09:34:57.476 INFO:tasks.workunit.client.1.smithi191.stdout:7/88: unlink d2/lb 0 2024-09-19T09:34:57.477 INFO:tasks.workunit.client.1.smithi191.stdout:5/179: mknod d0/d1f/c3f 0 2024-09-19T09:34:57.477 INFO:tasks.workunit.client.1.smithi191.stdout:5/180: write d0/d4/d9/de/f36 [655532,15137] 0 2024-09-19T09:34:57.479 INFO:tasks.workunit.client.1.smithi191.stdout:1/84: getdents d3/d9/da/db 0 2024-09-19T09:34:57.479 INFO:tasks.workunit.client.1.smithi191.stdout:9/86: creat d3/db/d16/d17/f1a x:0 0 0 2024-09-19T09:34:57.480 INFO:tasks.workunit.client.1.smithi191.stdout:9/87: read - d3/ff zero size 2024-09-19T09:34:57.480 INFO:tasks.workunit.client.1.smithi191.stdout:9/88: chown d3/f18 261542 1 2024-09-19T09:34:57.480 INFO:tasks.workunit.client.1.smithi191.stdout:9/89: dread - d3/db/f11 zero size 2024-09-19T09:34:57.481 INFO:tasks.workunit.client.1.smithi191.stdout:5/181: rmdir d0/d4/d9/d1d/d28 39 2024-09-19T09:34:57.482 INFO:tasks.workunit.client.1.smithi191.stdout:7/89: read d2/f9 [209429,126613] 0 2024-09-19T09:34:57.482 INFO:tasks.workunit.client.1.smithi191.stdout:7/90: write d2/f1e [919096,56588] 0 2024-09-19T09:34:57.485 INFO:tasks.workunit.client.1.smithi191.stdout:9/90: rename d3/f18 to d3/db/d16/f1b 0 2024-09-19T09:34:57.485 INFO:tasks.workunit.client.1.smithi191.stdout:9/91: fdatasync d3/db/f11 0 2024-09-19T09:34:57.486 INFO:tasks.workunit.client.1.smithi191.stdout:7/91: creat d2/f23 x:0 0 0 2024-09-19T09:34:57.487 INFO:tasks.workunit.client.1.smithi191.stdout:9/92: mkdir d3/db/d16/d17/d1c 0 2024-09-19T09:34:57.488 INFO:tasks.workunit.client.1.smithi191.stdout:9/93: chown d3/fe 4482 1 2024-09-19T09:34:57.490 INFO:tasks.workunit.client.1.smithi191.stdout:1/85: getdents d3 0 2024-09-19T09:34:57.491 INFO:tasks.workunit.client.1.smithi191.stdout:9/94: creat d3/db/d16/d17/d1c/f1d x:0 0 0 2024-09-19T09:34:57.491 INFO:tasks.workunit.client.1.smithi191.stdout:9/95: creat d3/db/d16/d17/f1e x:0 0 0 2024-09-19T09:34:57.498 INFO:tasks.workunit.client.1.smithi191.stdout:8/211: sync 2024-09-19T09:34:57.500 INFO:tasks.workunit.client.1.smithi191.stdout:8/212: dread d1/d16/d3c/d28/f33 [0,4194304] 0 2024-09-19T09:34:57.501 INFO:tasks.workunit.client.1.smithi191.stdout:8/213: getdents d1/d7 0 2024-09-19T09:34:57.502 INFO:tasks.workunit.client.1.smithi191.stdout:6/71: getdents d2/de 0 2024-09-19T09:34:57.502 INFO:tasks.workunit.client.1.smithi191.stdout:6/72: stat d2/l9 0 2024-09-19T09:34:57.503 INFO:tasks.workunit.client.1.smithi191.stdout:6/73: read d2/f6 [115815,57692] 0 2024-09-19T09:34:57.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.501+0000 7fc9e2b7e640 1 -- 172.21.15.112:0/3564108902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9dc0fc700 msgr2=0x7fc9dc0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:57.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.501+0000 7fc9e2b7e640 1 --2- 172.21.15.112:0/3564108902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9dc0fc700 0x7fc9dc0fcb70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80048d0 tx=0x7fc9c8009da0 comp rx=0 tx=0).stop 2024-09-19T09:34:57.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.501+0000 7fc9e2b7e640 1 -- 172.21.15.112:0/3564108902 shutdown_connections 2024-09-19T09:34:57.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.501+0000 7fc9e2b7e640 1 --2- 172.21.15.112:0/3564108902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9dc0fc700 0x7fc9dc0fcb70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:57.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.501+0000 7fc9e2b7e640 1 --2- 172.21.15.112:0/3564108902 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9dc0fb430 0x7fc9dc0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:57.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.501+0000 7fc9e2b7e640 1 -- 172.21.15.112:0/3564108902 >> 172.21.15.112:0/3564108902 conn(0x7fc9dc0f6c10 msgr2=0x7fc9dc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:57.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.501+0000 7fc9e2b7e640 1 -- 172.21.15.112:0/3564108902 shutdown_connections 2024-09-19T09:34:57.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.501+0000 7fc9e2b7e640 1 -- 172.21.15.112:0/3564108902 wait complete. 2024-09-19T09:34:57.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.502+0000 7fc9e2b7e640 1 Processor -- start 2024-09-19T09:34:57.506 INFO:tasks.workunit.client.1.smithi191.stdout:6/74: mkdir d2/d1a 0 2024-09-19T09:34:57.506 INFO:tasks.workunit.client.1.smithi191.stdout:6/75: link d2/de/f16 d2/d1a/f1b 0 2024-09-19T09:34:57.506 INFO:tasks.workunit.client.1.smithi191.stdout:8/214: dread d1/d16/d3c/d17/f3a [0,4194304] 0 2024-09-19T09:34:57.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.503+0000 7fc9e2b7e640 1 -- start start 2024-09-19T09:34:57.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.503+0000 7fc9e2b7e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9dc0fb430 0x7fc9dc116200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:57.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.503+0000 7fc9e2b7e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9dc0fc700 0x7fc9dc118750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:57.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.503+0000 7fc9e2b7e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc0ff930 con 0x7fc9dc0fc700 2024-09-19T09:34:57.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.503+0000 7fc9e2b7e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc118c90 con 0x7fc9dc0fb430 2024-09-19T09:34:57.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.503+0000 7fc9dbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9dc0fc700 0x7fc9dc118750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:57.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.503+0000 7fc9e091a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9dc0fb430 0x7fc9dc116200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:57.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.503+0000 7fc9e091a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9dc0fb430 0x7fc9dc116200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.112:54932/0 (socket says 172.21.15.112:54932) 2024-09-19T09:34:57.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.503+0000 7fc9dbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9dc0fc700 0x7fc9dc118750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42362/0 (socket says 172.21.15.112:42362) 2024-09-19T09:34:57.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.503+0000 7fc9e091a640 1 -- 172.21.15.112:0/4079824381 learned_addr learned my addr 172.21.15.112:0/4079824381 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:34:57.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.504+0000 7fc9dbfff640 1 -- 172.21.15.112:0/4079824381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9dc0fb430 msgr2=0x7fc9dc116200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:57.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.504+0000 7fc9dbfff640 1 --2- 172.21.15.112:0/4079824381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9dc0fb430 0x7fc9dc116200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:57.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.504+0000 7fc9dbfff640 1 -- 172.21.15.112:0/4079824381 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c8005040 con 0x7fc9dc0fc700 2024-09-19T09:34:57.509 INFO:tasks.workunit.client.0.smithi112.stdout:8/38: fsync d7/fe 0 2024-09-19T09:34:57.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.504+0000 7fc9dbfff640 1 --2- 172.21.15.112:0/4079824381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9dc0fc700 0x7fc9dc118750 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80048a0 tx=0x7fc9c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:57.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.504+0000 7fc9d97fa640 1 -- 172.21.15.112:0/4079824381 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c8038070 con 0x7fc9dc0fc700 2024-09-19T09:34:57.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.505+0000 7fc9d97fa640 1 -- 172.21.15.112:0/4079824381 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc9c8004290 con 0x7fc9dc0fc700 2024-09-19T09:34:57.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.505+0000 7fc9d97fa640 1 -- 172.21.15.112:0/4079824381 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c802c8b0 con 0x7fc9dc0fc700 2024-09-19T09:34:57.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.505+0000 7fc9e2b7e640 1 -- 172.21.15.112:0/4079824381 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9dc118f10 con 0x7fc9dc0fc700 2024-09-19T09:34:57.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.505+0000 7fc9e2b7e640 1 -- 172.21.15.112:0/4079824381 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9dc1194b0 con 0x7fc9dc0fc700 2024-09-19T09:34:57.511 INFO:tasks.workunit.client.0.smithi112.stdout:0/32: dwrite d2/f9 [0,4194304] 0 2024-09-19T09:34:57.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.506+0000 7fc9e2b7e640 1 -- 172.21.15.112:0/4079824381 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9dc0fa890 con 0x7fc9dc0fc700 2024-09-19T09:34:57.511 INFO:tasks.workunit.client.0.smithi112.stdout:4/38: dwrite d1/f2 [4194304,4194304] 0 2024-09-19T09:34:57.512 INFO:tasks.workunit.client.1.smithi191.stdout:6/76: symlink d2/de/d15/l1c 0 2024-09-19T09:34:57.513 INFO:tasks.workunit.client.1.smithi191.stdout:6/77: chown d2/de/d15 98275780 1 2024-09-19T09:34:57.513 INFO:tasks.workunit.client.1.smithi191.stdout:6/78: fdatasync d2/de/f14 0 2024-09-19T09:34:57.513 INFO:tasks.workunit.client.1.smithi191.stdout:8/215: truncate d1/f14 1074972 0 2024-09-19T09:34:57.513 INFO:tasks.workunit.client.1.smithi191.stdout:6/79: creat d2/de/f1d x:0 0 0 2024-09-19T09:34:57.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.507+0000 7fc9d97fa640 1 -- 172.21.15.112:0/4079824381 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fc9c8030020 con 0x7fc9dc0fc700 2024-09-19T09:34:57.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.509+0000 7fc9d97fa640 1 --2- 172.21.15.112:0/4079824381 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fc9cc06e7b0 0x7fc9cc070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:57.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.509+0000 7fc9d97fa640 1 -- 172.21.15.112:0/4079824381 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc9c80ade10 con 0x7fc9dc0fc700 2024-09-19T09:34:57.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.509+0000 7fc9e091a640 1 --2- 172.21.15.112:0/4079824381 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fc9cc06e7b0 0x7fc9cc070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:57.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.510+0000 7fc9e091a640 1 --2- 172.21.15.112:0/4079824381 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fc9cc06e7b0 0x7fc9cc070c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc06f570 tx=0x7fc9d000b040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:57.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.515+0000 7fc9d97fa640 1 -- 172.21.15.112:0/4079824381 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fc9c8077990 con 0x7fc9dc0fc700 2024-09-19T09:34:57.525 INFO:tasks.workunit.client.1.smithi191.stdout:3/107: dwrite f9 [0,4194304] 0 2024-09-19T09:34:57.525 INFO:tasks.workunit.client.1.smithi191.stdout:3/108: dread - d12/f25 zero size 2024-09-19T09:34:57.525 INFO:tasks.workunit.client.1.smithi191.stdout:2/130: dwrite d8/db/f14 [0,4194304] 0 2024-09-19T09:34:57.525 INFO:tasks.workunit.client.1.smithi191.stdout:0/209: dwrite d0/d9/f22 [4194304,4194304] 0 2024-09-19T09:34:57.528 INFO:tasks.workunit.client.1.smithi191.stdout:3/109: symlink d12/d13/d1a/d1b/l2d 0 2024-09-19T09:34:57.528 INFO:tasks.workunit.client.1.smithi191.stdout:3/110: chown d12/d13/f19 37969 1 2024-09-19T09:34:57.528 INFO:tasks.workunit.client.1.smithi191.stdout:3/111: fdatasync ff 0 2024-09-19T09:34:57.528 INFO:tasks.workunit.client.1.smithi191.stdout:3/112: dread - d12/d13/d1a/d1b/f27 zero size 2024-09-19T09:34:57.529 INFO:tasks.workunit.client.1.smithi191.stdout:2/131: mknod d8/c24 0 2024-09-19T09:34:57.530 INFO:tasks.workunit.client.1.smithi191.stdout:3/113: mkdir d12/d13/d1a/d1b/d2e 0 2024-09-19T09:34:57.530 INFO:tasks.workunit.client.1.smithi191.stdout:3/114: write d12/f1e [3731706,16383] 0 2024-09-19T09:34:57.530 INFO:tasks.workunit.client.1.smithi191.stdout:3/115: chown ff 21025153 1 2024-09-19T09:34:57.532 INFO:tasks.workunit.client.1.smithi191.stdout:2/132: link d8/db/l1e d8/d11/l25 0 2024-09-19T09:34:57.534 INFO:tasks.workunit.client.1.smithi191.stdout:2/133: rename d8/cd to d8/db/c26 0 2024-09-19T09:34:57.541 INFO:tasks.workunit.client.1.smithi191.stdout:5/182: dwrite d0/d4/d9/d1d/d29/d33/f34 [0,4194304] 0 2024-09-19T09:34:57.541 INFO:tasks.workunit.client.1.smithi191.stdout:5/183: truncate d0/d4/d9/fd 5110400 0 2024-09-19T09:34:57.541 INFO:tasks.workunit.client.1.smithi191.stdout:5/184: creat d0/d4/d9/d1d/d29/d33/f40 x:0 0 0 2024-09-19T09:34:57.544 INFO:tasks.workunit.client.1.smithi191.stdout:5/185: mknod d0/d4/d9/d1d/d29/c41 0 2024-09-19T09:34:57.546 INFO:tasks.workunit.client.1.smithi191.stdout:5/186: rename d0/d4/d9/f2b to d0/d4/d9/d1d/d28/f42 0 2024-09-19T09:34:57.547 INFO:tasks.workunit.client.1.smithi191.stdout:7/92: dwrite d2/f1d [0,4194304] 0 2024-09-19T09:34:57.547 INFO:tasks.workunit.client.1.smithi191.stdout:1/86: dwrite f0 [4194304,4194304] 0 2024-09-19T09:34:57.548 INFO:tasks.workunit.client.1.smithi191.stdout:5/187: creat d0/d1f/f43 x:0 0 0 2024-09-19T09:34:57.549 INFO:tasks.workunit.client.0.smithi112.stdout:4/39: fdatasync d1/f6 0 2024-09-19T09:34:57.549 INFO:tasks.workunit.client.0.smithi112.stdout:4/40: chown d1/ca 34 1 2024-09-19T09:34:57.549 INFO:tasks.workunit.client.0.smithi112.stdout:4/41: creat d1/fe x:0 0 0 2024-09-19T09:34:57.549 INFO:tasks.workunit.client.0.smithi112.stdout:4/42: readlink d1/d4/l5 0 2024-09-19T09:34:57.549 INFO:tasks.workunit.client.0.smithi112.stdout:4/43: fdatasync d1/d4/f9 0 2024-09-19T09:34:57.550 INFO:tasks.workunit.client.1.smithi191.stdout:9/96: getdents d3/db/d16 0 2024-09-19T09:34:57.550 INFO:tasks.workunit.client.1.smithi191.stdout:9/97: chown d3/db/d16/f1b 15 1 2024-09-19T09:34:57.551 INFO:tasks.workunit.client.1.smithi191.stdout:7/93: write d2/f18 [322210,126365] 0 2024-09-19T09:34:57.551 INFO:tasks.workunit.client.1.smithi191.stdout:7/94: creat d2/f24 x:0 0 0 2024-09-19T09:34:57.553 INFO:tasks.workunit.client.1.smithi191.stdout:9/98: creat d3/db/d16/f1f x:0 0 0 2024-09-19T09:34:57.554 INFO:tasks.workunit.client.1.smithi191.stdout:9/99: dread - d3/db/d16/f1f zero size 2024-09-19T09:34:57.554 INFO:tasks.workunit.client.0.smithi112.stdout:8/39: dwrite f4 [0,4194304] 0 2024-09-19T09:34:57.555 INFO:tasks.workunit.client.1.smithi191.stdout:6/80: dwrite d2/de/f16 [0,4194304] 0 2024-09-19T09:34:57.556 INFO:tasks.workunit.client.1.smithi191.stdout:9/100: rename d3/d8/la to d3/db/l20 0 2024-09-19T09:34:57.557 INFO:tasks.workunit.client.0.smithi112.stdout:8/40: unlink f3 0 2024-09-19T09:34:57.558 INFO:tasks.workunit.client.0.smithi112.stdout:0/33: dwrite d2/fa [0,4194304] 0 2024-09-19T09:34:57.559 INFO:tasks.workunit.client.1.smithi191.stdout:5/188: write d0/d4/d9/d1d/d29/d33/f34 [386598,106964] 0 2024-09-19T09:34:57.560 INFO:tasks.workunit.client.1.smithi191.stdout:3/116: fsync d12/f1e 0 2024-09-19T09:34:57.560 INFO:tasks.workunit.client.1.smithi191.stdout:1/87: dread f0 [0,4194304] 0 2024-09-19T09:34:57.560 INFO:tasks.workunit.client.1.smithi191.stdout:3/117: creat d12/f2f x:0 0 0 2024-09-19T09:34:57.560 INFO:tasks.workunit.client.1.smithi191.stdout:1/88: creat d3/d9/f1d x:0 0 0 2024-09-19T09:34:57.562 INFO:tasks.workunit.client.0.smithi112.stdout:8/41: getdents d7/db 0 2024-09-19T09:34:57.563 INFO:tasks.workunit.client.0.smithi112.stdout:8/42: dread d7/fd [0,4194304] 0 2024-09-19T09:34:57.563 INFO:tasks.workunit.client.1.smithi191.stdout:0/210: dwrite d0/d9/d13/f38 [0,4194304] 0 2024-09-19T09:34:57.564 INFO:tasks.workunit.client.1.smithi191.stdout:2/134: dwrite d8/db/f14 [0,4194304] 0 2024-09-19T09:34:57.564 INFO:tasks.workunit.client.1.smithi191.stdout:6/81: mkdir d2/de/d19/d1e 0 2024-09-19T09:34:57.566 INFO:tasks.workunit.client.0.smithi112.stdout:0/34: mknod d2/cc 0 2024-09-19T09:34:57.567 INFO:tasks.workunit.client.0.smithi112.stdout:8/43: rmdir d7/db 39 2024-09-19T09:34:57.568 INFO:tasks.workunit.client.0.smithi112.stdout:8/44: creat d7/ff x:0 0 0 2024-09-19T09:34:57.568 INFO:tasks.workunit.client.0.smithi112.stdout:8/45: chown c6 23434 1 2024-09-19T09:34:57.568 INFO:tasks.workunit.client.1.smithi191.stdout:9/101: read d3/d8/f15 [3201148,5063] 0 2024-09-19T09:34:57.570 INFO:tasks.workunit.client.1.smithi191.stdout:3/118: symlink d12/d13/d1a/d1b/d2e/l30 0 2024-09-19T09:34:57.571 INFO:tasks.workunit.client.0.smithi112.stdout:8/46: stat c2 0 2024-09-19T09:34:57.572 INFO:tasks.workunit.client.1.smithi191.stdout:1/89: mkdir d3/d9/da/d1e 0 2024-09-19T09:34:57.572 INFO:tasks.workunit.client.1.smithi191.stdout:5/189: fsync d0/d4/d9/d1d/d28/f42 0 2024-09-19T09:34:57.574 INFO:tasks.workunit.client.1.smithi191.stdout:7/95: truncate d2/f1d 4033917 0 2024-09-19T09:34:57.575 INFO:tasks.workunit.client.1.smithi191.stdout:0/211: link d0/d9/d13/c26 d0/d9/c46 0 2024-09-19T09:34:57.576 INFO:tasks.workunit.client.0.smithi112.stdout:4/44: truncate d1/f2 7406731 0 2024-09-19T09:34:57.576 INFO:tasks.workunit.client.1.smithi191.stdout:2/135: mkdir d8/d27 0 2024-09-19T09:34:57.577 INFO:tasks.workunit.client.1.smithi191.stdout:6/82: rename l0 to d2/de/d19/l1f 0 2024-09-19T09:34:57.577 INFO:tasks.workunit.client.1.smithi191.stdout:6/83: chown d2/de/d19/l1f 7 1 2024-09-19T09:34:57.578 INFO:tasks.workunit.client.1.smithi191.stdout:6/84: read d2/fa [1033813,1066] 0 2024-09-19T09:34:57.578 INFO:tasks.workunit.client.0.smithi112.stdout:4/45: symlink d1/lf 0 2024-09-19T09:34:57.578 INFO:tasks.workunit.client.0.smithi112.stdout:4/46: chown d1 307133335 1 2024-09-19T09:34:57.578 INFO:tasks.workunit.client.0.smithi112.stdout:4/47: truncate d1/d4/f7 90476 0 2024-09-19T09:34:57.579 INFO:tasks.workunit.client.1.smithi191.stdout:9/102: creat d3/d8/f21 x:0 0 0 2024-09-19T09:34:57.579 INFO:tasks.workunit.client.1.smithi191.stdout:9/103: readlink d3/db/l14 0 2024-09-19T09:34:57.579 INFO:tasks.workunit.client.0.smithi112.stdout:0/35: write d2/fa [3165031,32345] 0 2024-09-19T09:34:57.580 INFO:tasks.workunit.client.1.smithi191.stdout:3/119: rmdir d12/d13/d1a/d28 39 2024-09-19T09:34:57.581 INFO:tasks.workunit.client.0.smithi112.stdout:4/48: mknod d1/d4/c10 0 2024-09-19T09:34:57.582 INFO:tasks.workunit.client.1.smithi191.stdout:5/190: symlink d0/d4/d9/de/l44 0 2024-09-19T09:34:57.583 INFO:tasks.workunit.client.0.smithi112.stdout:4/49: dread d1/f6 [0,4194304] 0 2024-09-19T09:34:57.583 INFO:tasks.workunit.client.1.smithi191.stdout:0/212: symlink d0/l47 0 2024-09-19T09:34:57.584 INFO:tasks.workunit.client.1.smithi191.stdout:2/136: truncate f6 2759931 0 2024-09-19T09:34:57.585 INFO:tasks.workunit.client.1.smithi191.stdout:1/90: rename d3/d9/da/l18 to d3/l1f 0 2024-09-19T09:34:57.586 INFO:tasks.workunit.client.1.smithi191.stdout:6/85: mknod d2/d1a/c20 0 2024-09-19T09:34:57.587 INFO:tasks.workunit.client.1.smithi191.stdout:9/104: link d3/d8/f15 d3/d8/f22 0 2024-09-19T09:34:57.587 INFO:tasks.workunit.client.0.smithi112.stdout:0/36: dread d2/f9 [0,4194304] 0 2024-09-19T09:34:57.588 INFO:tasks.workunit.client.1.smithi191.stdout:3/120: unlink d12/f18 0 2024-09-19T09:34:57.589 INFO:tasks.workunit.client.1.smithi191.stdout:5/191: mkdir d0/d4/d9/d1d/d29/d33/d45 0 2024-09-19T09:34:57.590 INFO:tasks.workunit.client.0.smithi112.stdout:0/37: truncate d2/f9 922457 0 2024-09-19T09:34:57.590 INFO:tasks.workunit.client.0.smithi112.stdout:0/38: dread - d2/f4 zero size 2024-09-19T09:34:57.590 INFO:tasks.workunit.client.0.smithi112.stdout:0/39: dread - d2/fb zero size 2024-09-19T09:34:57.590 INFO:tasks.workunit.client.0.smithi112.stdout:0/40: readlink d2/l6 0 2024-09-19T09:34:57.590 INFO:tasks.workunit.client.0.smithi112.stdout:4/50: dread d1/d4/fb [0,4194304] 0 2024-09-19T09:34:57.591 INFO:tasks.workunit.client.1.smithi191.stdout:1/91: creat d3/d9/da/f20 x:0 0 0 2024-09-19T09:34:57.592 INFO:tasks.workunit.client.0.smithi112.stdout:0/41: symlink d2/ld 0 2024-09-19T09:34:57.593 INFO:tasks.workunit.client.1.smithi191.stdout:6/86: creat d2/de/d19/d1e/f21 x:0 0 0 2024-09-19T09:34:57.595 INFO:tasks.workunit.client.0.smithi112.stdout:4/51: link d1/d4/c10 d1/c11 0 2024-09-19T09:34:57.595 INFO:tasks.workunit.client.0.smithi112.stdout:4/52: creat d1/f12 x:0 0 0 2024-09-19T09:34:57.595 INFO:tasks.workunit.client.0.smithi112.stdout:4/53: creat d1/d4/f13 x:0 0 0 2024-09-19T09:34:57.595 INFO:tasks.workunit.client.0.smithi112.stdout:4/54: dread - d1/d4/f9 zero size 2024-09-19T09:34:57.595 INFO:tasks.workunit.client.0.smithi112.stdout:4/55: read - d1/fd zero size 2024-09-19T09:34:57.595 INFO:tasks.workunit.client.0.smithi112.stdout:4/56: write d1/d4/f13 [259783,41361] 0 2024-09-19T09:34:57.595 INFO:tasks.workunit.client.0.smithi112.stdout:4/57: truncate d1/d4/f9 249290 0 2024-09-19T09:34:57.596 INFO:tasks.workunit.client.0.smithi112.stdout:8/47: truncate f4 3112121 0 2024-09-19T09:34:57.597 INFO:tasks.workunit.client.1.smithi191.stdout:6/87: read d2/de/f14 [338418,35844] 0 2024-09-19T09:34:57.597 INFO:tasks.workunit.client.1.smithi191.stdout:6/88: creat d2/de/f22 x:0 0 0 2024-09-19T09:34:57.597 INFO:tasks.workunit.client.1.smithi191.stdout:6/89: stat d2/de/d15/c17 0 2024-09-19T09:34:57.597 INFO:tasks.workunit.client.1.smithi191.stdout:6/90: dread - d2/de/f22 zero size 2024-09-19T09:34:57.597 INFO:tasks.workunit.client.1.smithi191.stdout:6/91: write d2/de/f10 [9844,94000] 0 2024-09-19T09:34:57.597 INFO:tasks.workunit.client.1.smithi191.stdout:3/121: mknod d12/d13/c31 0 2024-09-19T09:34:57.597 INFO:tasks.workunit.client.1.smithi191.stdout:3/122: readlink l6 0 2024-09-19T09:34:57.597 INFO:tasks.workunit.client.1.smithi191.stdout:3/123: stat c10 0 2024-09-19T09:34:57.597 INFO:tasks.workunit.client.1.smithi191.stdout:3/124: dread - d12/f25 zero size 2024-09-19T09:34:57.597 INFO:tasks.workunit.client.1.smithi191.stdout:3/125: fdatasync ff 0 2024-09-19T09:34:57.599 INFO:tasks.workunit.client.1.smithi191.stdout:5/192: rename d0/d4/d9/fd to d0/d4/d9/d1d/f46 0 2024-09-19T09:34:57.599 INFO:tasks.workunit.client.1.smithi191.stdout:5/193: write d0/d4/d9/d1d/d29/d33/f38 [160370,76127] 0 2024-09-19T09:34:57.601 INFO:tasks.workunit.client.1.smithi191.stdout:0/213: getdents d0/d9 0 2024-09-19T09:34:57.602 INFO:tasks.workunit.client.0.smithi112.stdout:4/58: mkdir d1/d4/d14 0 2024-09-19T09:34:57.602 INFO:tasks.workunit.client.0.smithi112.stdout:4/59: chown d1/d4/f9 1002 1 2024-09-19T09:34:57.603 INFO:tasks.workunit.client.0.smithi112.stdout:4/60: dread d1/d4/f9 [0,4194304] 0 2024-09-19T09:34:57.603 INFO:tasks.workunit.client.1.smithi191.stdout:1/92: mknod d3/d9/da/c21 0 2024-09-19T09:34:57.604 INFO:tasks.workunit.client.0.smithi112.stdout:8/48: mkdir d7/d10 0 2024-09-19T09:34:57.606 INFO:tasks.workunit.client.0.smithi112.stdout:8/49: fdatasync d7/fa 0 2024-09-19T09:34:57.607 INFO:tasks.workunit.client.0.smithi112.stdout:8/50: write d7/fd [78474,84909] 0 2024-09-19T09:34:57.608 INFO:tasks.workunit.client.0.smithi112.stdout:4/61: link d1/f2 d1/d4/f15 0 2024-09-19T09:34:57.609 INFO:tasks.workunit.client.1.smithi191.stdout:0/214: dread d0/f8 [0,4194304] 0 2024-09-19T09:34:57.620 INFO:tasks.workunit.client.1.smithi191.stdout:6/92: symlink d2/de/d19/l23 0 2024-09-19T09:34:57.620 INFO:tasks.workunit.client.1.smithi191.stdout:6/93: readlink d2/de/d19/l23 0 2024-09-19T09:34:57.620 INFO:tasks.workunit.client.0.smithi112.stdout:0/42: dread d2/f9 [0,4194304] 0 2024-09-19T09:34:57.621 INFO:tasks.workunit.client.1.smithi191.stdout:5/194: getdents d0/d4/d9/d1d/d29 0 2024-09-19T09:34:57.622 INFO:tasks.workunit.client.1.smithi191.stdout:5/195: creat d0/d4/d9/de/f47 x:0 0 0 2024-09-19T09:34:57.623 INFO:tasks.workunit.client.1.smithi191.stdout:1/93: truncate d3/f6 2610843 0 2024-09-19T09:34:57.626 INFO:tasks.workunit.client.1.smithi191.stdout:0/215: creat d0/d9/d1c/d20/f48 x:0 0 0 2024-09-19T09:34:57.628 INFO:tasks.workunit.client.1.smithi191.stdout:9/105: getdents d3/db/d16/d17/d1c 0 2024-09-19T09:34:57.628 INFO:tasks.workunit.client.1.smithi191.stdout:9/106: fsync d3/fe 0 2024-09-19T09:34:57.628 INFO:tasks.workunit.client.1.smithi191.stdout:9/107: truncate d3/db/fd 4292568 0 2024-09-19T09:34:57.628 INFO:tasks.workunit.client.1.smithi191.stdout:9/108: readlink d3/l4 0 2024-09-19T09:34:57.628 INFO:tasks.workunit.client.1.smithi191.stdout:9/109: fdatasync d3/d8/f13 0 2024-09-19T09:34:57.628 INFO:tasks.workunit.client.1.smithi191.stdout:6/94: mkdir d2/de/d19/d24 0 2024-09-19T09:34:57.630 INFO:tasks.workunit.client.1.smithi191.stdout:5/196: creat d0/d4/d9/d1d/f48 x:0 0 0 2024-09-19T09:34:57.630 INFO:tasks.workunit.client.1.smithi191.stdout:5/197: dread - d0/d4/d9/de/f47 zero size 2024-09-19T09:34:57.631 INFO:tasks.workunit.client.1.smithi191.stdout:5/198: readlink d0/l23 0 2024-09-19T09:34:57.632 INFO:tasks.workunit.client.1.smithi191.stdout:1/94: creat d3/d9/da/db/f22 x:0 0 0 2024-09-19T09:34:57.632 INFO:tasks.workunit.client.1.smithi191.stdout:1/95: chown d3/f4 14301521 1 2024-09-19T09:34:57.633 INFO:tasks.workunit.client.1.smithi191.stdout:0/216: rename d0/d9/d13/f38 to d0/d9/d1c/d1f/d24/d29/f49 0 2024-09-19T09:34:57.634 INFO:tasks.workunit.client.1.smithi191.stdout:6/95: mknod d2/de/c25 0 2024-09-19T09:34:57.634 INFO:tasks.workunit.client.1.smithi191.stdout:6/96: stat d2/cf 0 2024-09-19T09:34:57.638 INFO:tasks.workunit.client.1.smithi191.stdout:0/217: creat d0/d9/f4a x:0 0 0 2024-09-19T09:34:57.639 INFO:tasks.workunit.client.0.smithi112.stdout:8/51: rmdir d7 39 2024-09-19T09:34:57.641 INFO:tasks.workunit.client.1.smithi191.stdout:6/97: unlink d2/cf 0 2024-09-19T09:34:57.641 INFO:tasks.workunit.client.1.smithi191.stdout:6/98: chown d2/lb 1087 1 2024-09-19T09:34:57.641 INFO:tasks.workunit.client.1.smithi191.stdout:6/99: truncate d2/de/f14 2089767 0 2024-09-19T09:34:57.642 INFO:tasks.workunit.client.1.smithi191.stdout:6/100: creat d2/de/d15/f26 x:0 0 0 2024-09-19T09:34:57.642 INFO:tasks.workunit.client.1.smithi191.stdout:6/101: creat d2/de/f27 x:0 0 0 2024-09-19T09:34:57.642 INFO:tasks.workunit.client.1.smithi191.stdout:2/137: dwrite d8/f1d [0,4194304] 0 2024-09-19T09:34:57.642 INFO:tasks.workunit.client.1.smithi191.stdout:2/138: fdatasync d8/f1d 0 2024-09-19T09:34:57.642 INFO:tasks.workunit.client.1.smithi191.stdout:9/110: write d3/db/fd [1512443,119552] 0 2024-09-19T09:34:57.642 INFO:tasks.workunit.client.1.smithi191.stdout:7/96: truncate d2/f1d 1136369 0 2024-09-19T09:34:57.642 INFO:tasks.workunit.client.1.smithi191.stdout:7/97: write d2/f1b [564044,32586] 0 2024-09-19T09:34:57.642 INFO:tasks.workunit.client.1.smithi191.stdout:7/98: truncate d2/f17 443617 0 2024-09-19T09:34:57.645 INFO:tasks.workunit.client.0.smithi112.stdout:4/62: dwrite d1/d4/f7 [0,4194304] 0 2024-09-19T09:34:57.647 INFO:tasks.workunit.client.0.smithi112.stdout:0/43: dwrite d2/f4 [0,4194304] 0 2024-09-19T09:34:57.648 INFO:tasks.workunit.client.1.smithi191.stdout:6/102: symlink d2/de/d15/l28 0 2024-09-19T09:34:57.655 INFO:tasks.workunit.client.0.smithi112.stdout:8/52: dread d7/fe [0,4194304] 0 2024-09-19T09:34:57.656 INFO:tasks.workunit.client.1.smithi191.stdout:2/139: mknod d8/d11/c28 0 2024-09-19T09:34:57.656 INFO:tasks.workunit.client.1.smithi191.stdout:2/140: stat d8/d11/d17/f21 0 2024-09-19T09:34:57.656 INFO:tasks.workunit.client.1.smithi191.stdout:2/141: dread - d8/f19 zero size 2024-09-19T09:34:57.659 INFO:tasks.workunit.client.1.smithi191.stdout:0/218: dwrite d0/d9/f22 [4194304,4194304] 0 2024-09-19T09:34:57.659 INFO:tasks.workunit.client.1.smithi191.stdout:0/219: read d0/d9/d1c/d1f/d24/f3f [308537,75579] 0 2024-09-19T09:34:57.661 INFO:tasks.workunit.client.1.smithi191.stdout:9/111: unlink d3/db/d16/d17/f1e 0 2024-09-19T09:34:57.662 INFO:tasks.workunit.client.0.smithi112.stdout:4/63: write d1/d4/f15 [6650242,5356] 0 2024-09-19T09:34:57.665 INFO:tasks.workunit.client.0.smithi112.stdout:0/44: creat d2/fe x:0 0 0 2024-09-19T09:34:57.668 INFO:tasks.workunit.client.0.smithi112.stdout:0/45: link d2/l6 d2/lf 0 2024-09-19T09:34:57.669 INFO:tasks.workunit.client.1.smithi191.stdout:1/96: rmdir d3/d9 39 2024-09-19T09:34:57.673 INFO:tasks.workunit.client.1.smithi191.stdout:2/142: creat d8/db/d13/d23/f29 x:0 0 0 2024-09-19T09:34:57.678 INFO:tasks.workunit.client.1.smithi191.stdout:0/220: creat d0/d9/d1c/d1f/d24/f4b x:0 0 0 2024-09-19T09:34:57.678 INFO:tasks.workunit.client.1.smithi191.stdout:0/221: write d0/f34 [1155627,2705] 0 2024-09-19T09:34:57.679 INFO:tasks.workunit.client.1.smithi191.stdout:9/112: write d3/db/d16/f1b [941113,79068] 0 2024-09-19T09:34:57.680 INFO:tasks.workunit.client.1.smithi191.stdout:0/222: dread d0/d9/f25 [0,4194304] 0 2024-09-19T09:34:57.681 INFO:tasks.workunit.client.0.smithi112.stdout:4/64: write d1/d4/f15 [208453,12884] 0 2024-09-19T09:34:57.681 INFO:tasks.workunit.client.0.smithi112.stdout:4/65: chown d1/d4/d14 0 1 2024-09-19T09:34:57.681 INFO:tasks.workunit.client.0.smithi112.stdout:4/66: write d1/d4/f9 [1200149,28103] 0 2024-09-19T09:34:57.682 INFO:tasks.workunit.client.1.smithi191.stdout:2/143: rename d8/d27 to d8/d2a 0 2024-09-19T09:34:57.682 INFO:tasks.workunit.client.1.smithi191.stdout:6/103: dwrite d2/fa [0,4194304] 0 2024-09-19T09:34:57.683 INFO:tasks.workunit.client.1.smithi191.stdout:9/113: symlink d3/db/l23 0 2024-09-19T09:34:57.683 INFO:tasks.workunit.client.1.smithi191.stdout:9/114: chown d3/d8/f22 293 1 2024-09-19T09:34:57.683 INFO:tasks.workunit.client.1.smithi191.stdout:9/115: dread - d3/d8/f21 zero size 2024-09-19T09:34:57.686 INFO:tasks.workunit.client.1.smithi191.stdout:0/223: symlink d0/d9/d1c/d1f/d24/d29/d30/l4c 0 2024-09-19T09:34:57.686 INFO:tasks.workunit.client.1.smithi191.stdout:0/224: write d0/fd [1793013,59767] 0 2024-09-19T09:34:57.688 INFO:tasks.workunit.client.1.smithi191.stdout:2/144: creat d8/d11/f2b x:0 0 0 2024-09-19T09:34:57.689 INFO:tasks.workunit.client.1.smithi191.stdout:2/145: fdatasync d8/db/d13/f16 0 2024-09-19T09:34:57.690 INFO:tasks.workunit.client.0.smithi112.stdout:4/67: mknod d1/c16 0 2024-09-19T09:34:57.690 INFO:tasks.workunit.client.0.smithi112.stdout:4/68: creat d1/f17 x:0 0 0 2024-09-19T09:34:57.692 INFO:tasks.workunit.client.1.smithi191.stdout:6/104: dread d2/f6 [0,4194304] 0 2024-09-19T09:34:57.693 INFO:tasks.workunit.client.1.smithi191.stdout:1/97: dwrite d3/d9/da/db/f1b [0,4194304] 0 2024-09-19T09:34:57.695 INFO:tasks.workunit.client.0.smithi112.stdout:8/53: dwrite d7/ff [0,4194304] 0 2024-09-19T09:34:57.699 INFO:tasks.workunit.client.1.smithi191.stdout:0/225: rename d0/d9/f4a to d0/d9/f4d 0 2024-09-19T09:34:57.699 INFO:tasks.workunit.client.1.smithi191.stdout:0/226: truncate d0/d9/d1c/d20/f48 19666 0 2024-09-19T09:34:57.705 INFO:tasks.workunit.client.0.smithi112.stdout:8/54: mkdir d7/d10/d11 0 2024-09-19T09:34:57.705 INFO:tasks.workunit.client.0.smithi112.stdout:8/55: chown d7/fe 13 1 2024-09-19T09:34:57.707 INFO:tasks.workunit.client.1.smithi191.stdout:1/98: creat d3/d9/da/f23 x:0 0 0 2024-09-19T09:34:57.708 INFO:tasks.workunit.client.1.smithi191.stdout:0/227: link d0/d9/d1c/c3e d0/d9/d1c/d1f/d24/c4e 0 2024-09-19T09:34:57.710 INFO:tasks.workunit.client.0.smithi112.stdout:8/56: creat d7/d10/d11/f12 x:0 0 0 2024-09-19T09:34:57.712 INFO:tasks.workunit.client.1.smithi191.stdout:9/116: getdents d3/db 0 2024-09-19T09:34:57.712 INFO:tasks.workunit.client.1.smithi191.stdout:9/117: creat d3/db/d16/d17/f24 x:0 0 0 2024-09-19T09:34:57.713 INFO:tasks.workunit.client.1.smithi191.stdout:1/99: creat d3/d9/f24 x:0 0 0 2024-09-19T09:34:57.713 INFO:tasks.workunit.client.1.smithi191.stdout:1/100: dread - d3/d9/da/db/f22 zero size 2024-09-19T09:34:57.713 INFO:tasks.workunit.client.0.smithi112.stdout:4/69: dwrite d1/d4/f15 [4194304,4194304] 0 2024-09-19T09:34:57.718 INFO:tasks.workunit.client.1.smithi191.stdout:1/101: dread d3/f6 [0,4194304] 0 2024-09-19T09:34:57.718 INFO:tasks.workunit.client.1.smithi191.stdout:9/118: symlink d3/db/d16/l25 0 2024-09-19T09:34:57.719 INFO:tasks.workunit.client.1.smithi191.stdout:9/119: read d3/d8/f22 [3896311,91344] 0 2024-09-19T09:34:57.719 INFO:tasks.workunit.client.1.smithi191.stdout:9/120: fsync d3/d8/fc 0 2024-09-19T09:34:57.719 INFO:tasks.workunit.client.1.smithi191.stdout:2/146: getdents d8/d11 0 2024-09-19T09:34:57.719 INFO:tasks.workunit.client.1.smithi191.stdout:6/105: dwrite d2/de/d19/d1e/f21 [0,4194304] 0 2024-09-19T09:34:57.720 INFO:tasks.workunit.client.1.smithi191.stdout:1/102: mkdir d3/d9/da/d1e/d25 0 2024-09-19T09:34:57.720 INFO:tasks.workunit.client.1.smithi191.stdout:1/103: dread - d3/d9/f17 zero size 2024-09-19T09:34:57.720 INFO:tasks.workunit.client.1.smithi191.stdout:1/104: creat d3/d9/f26 x:0 0 0 2024-09-19T09:34:57.720 INFO:tasks.workunit.client.1.smithi191.stdout:1/105: write d3/d9/f17 [599990,81945] 0 2024-09-19T09:34:57.721 INFO:tasks.workunit.client.1.smithi191.stdout:9/121: symlink d3/d8/l26 0 2024-09-19T09:34:57.721 INFO:tasks.workunit.client.1.smithi191.stdout:2/147: mknod d8/d11/d17/c2c 0 2024-09-19T09:34:57.725 INFO:tasks.workunit.client.1.smithi191.stdout:6/106: creat d2/de/d19/d24/f29 x:0 0 0 2024-09-19T09:34:57.726 INFO:tasks.workunit.client.1.smithi191.stdout:1/106: symlink d3/d9/da/d1e/l27 0 2024-09-19T09:34:57.728 INFO:tasks.workunit.client.1.smithi191.stdout:6/107: dread d2/de/f10 [0,4194304] 0 2024-09-19T09:34:57.728 INFO:tasks.workunit.client.1.smithi191.stdout:9/122: link d3/db/f10 d3/db/d16/d17/d1c/f27 0 2024-09-19T09:34:57.728 INFO:tasks.workunit.client.1.smithi191.stdout:9/123: fsync f2 0 2024-09-19T09:34:57.728 INFO:tasks.workunit.client.1.smithi191.stdout:9/124: stat d3/d8/f21 0 2024-09-19T09:34:57.729 INFO:tasks.workunit.client.1.smithi191.stdout:9/125: write d3/d8/f15 [3742148,33647] 0 2024-09-19T09:34:57.729 INFO:tasks.workunit.client.0.smithi112.stdout:4/70: dread d1/d4/f7 [0,4194304] 0 2024-09-19T09:34:57.729 INFO:tasks.workunit.client.1.smithi191.stdout:2/148: symlink d8/d11/d17/l2d 0 2024-09-19T09:34:57.730 INFO:tasks.workunit.client.1.smithi191.stdout:6/108: mkdir d2/de/d2a 0 2024-09-19T09:34:57.731 INFO:tasks.workunit.client.1.smithi191.stdout:6/109: truncate d2/de/f27 204904 0 2024-09-19T09:34:57.731 INFO:tasks.workunit.client.1.smithi191.stdout:6/110: fdatasync d2/de/f14 0 2024-09-19T09:34:57.731 INFO:tasks.workunit.client.1.smithi191.stdout:6/111: chown d2/de/d15/f26 1 1 2024-09-19T09:34:57.733 INFO:tasks.workunit.client.1.smithi191.stdout:9/126: symlink d3/db/l28 0 2024-09-19T09:34:57.733 INFO:tasks.workunit.client.1.smithi191.stdout:9/127: chown d3/db/d16/d17/f24 3701954 1 2024-09-19T09:34:57.733 INFO:tasks.workunit.client.1.smithi191.stdout:9/128: write d3/d8/f22 [1048663,26132] 0 2024-09-19T09:34:57.733 INFO:tasks.workunit.client.1.smithi191.stdout:0/228: dwrite d0/d9/d1c/d20/f31 [0,4194304] 0 2024-09-19T09:34:57.734 INFO:tasks.workunit.client.1.smithi191.stdout:0/229: fsync d0/d9/d1c/d1f/d24/d29/f44 0 2024-09-19T09:34:57.734 INFO:tasks.workunit.client.1.smithi191.stdout:0/230: stat d0/d9/d1c/d1f/d24/f3f 0 2024-09-19T09:34:57.734 INFO:tasks.workunit.client.1.smithi191.stdout:0/231: stat d0/d9/d1c/d1f/d24/d29/f44 0 2024-09-19T09:34:57.735 INFO:tasks.workunit.client.1.smithi191.stdout:2/149: symlink d8/db/l2e 0 2024-09-19T09:34:57.735 INFO:tasks.workunit.client.1.smithi191.stdout:2/150: dread - d8/d11/d17/f21 zero size 2024-09-19T09:34:57.740 INFO:tasks.workunit.client.1.smithi191.stdout:2/151: rename d8/db/d13/f16 to d8/f2f 0 2024-09-19T09:34:57.741 INFO:tasks.workunit.client.1.smithi191.stdout:2/152: stat d8/d11/d17/f22 0 2024-09-19T09:34:57.747 INFO:tasks.workunit.client.1.smithi191.stdout:9/129: fdatasync d3/d8/f15 0 2024-09-19T09:34:57.747 INFO:tasks.workunit.client.1.smithi191.stdout:9/130: fsync d3/d8/f15 0 2024-09-19T09:34:57.752 INFO:tasks.workunit.client.1.smithi191.stdout:9/131: link d3/db/f10 d3/db/d16/f29 0 2024-09-19T09:34:57.754 INFO:tasks.workunit.client.1.smithi191.stdout:9/132: rename d3/db/d16/d17/f24 to d3/db/d16/f2a 0 2024-09-19T09:34:57.755 INFO:tasks.workunit.client.1.smithi191.stdout:9/133: creat d3/db/d16/f2b x:0 0 0 2024-09-19T09:34:57.757 INFO:tasks.workunit.client.1.smithi191.stdout:9/134: rename d3/db/d16/f2b to d3/f2c 0 2024-09-19T09:34:57.770 INFO:tasks.workunit.client.0.smithi112.stdout:4/71: dwrite d1/f2 [4194304,4194304] 0 2024-09-19T09:34:57.770 INFO:tasks.workunit.client.1.smithi191.stdout:1/107: dwrite d3/d9/da/db/f22 [0,4194304] 0 2024-09-19T09:34:57.771 INFO:tasks.workunit.client.1.smithi191.stdout:4/221: sync 2024-09-19T09:34:57.771 INFO:tasks.workunit.client.1.smithi191.stdout:4/222: write d5/f4e [796334,117193] 0 2024-09-19T09:34:57.771 INFO:tasks.workunit.client.1.smithi191.stdout:0/232: dwrite d0/d9/d1c/d1f/d24/f33 [0,4194304] 0 2024-09-19T09:34:57.772 INFO:tasks.workunit.client.0.smithi112.stdout:4/72: mkdir d1/d4/d14/d18 0 2024-09-19T09:34:57.774 INFO:tasks.workunit.client.1.smithi191.stdout:1/108: symlink d3/d9/da/d1e/d25/l28 0 2024-09-19T09:34:57.774 INFO:tasks.workunit.client.1.smithi191.stdout:6/112: dwrite d2/de/f22 [0,4194304] 0 2024-09-19T09:34:57.774 INFO:tasks.workunit.client.1.smithi191.stdout:6/113: fdatasync d2/de/f22 0 2024-09-19T09:34:57.776 INFO:tasks.workunit.client.1.smithi191.stdout:0/233: write d0/f8 [3112012,80639] 0 2024-09-19T09:34:57.778 INFO:tasks.workunit.client.1.smithi191.stdout:1/109: rename d3/d9/da/db/fd to d3/d9/da/d1e/d25/f29 0 2024-09-19T09:34:57.779 INFO:tasks.workunit.client.1.smithi191.stdout:9/135: dread d3/db/d16/f1b [0,4194304] 0 2024-09-19T09:34:57.784 INFO:tasks.workunit.client.1.smithi191.stdout:0/234: unlink d0/fd 0 2024-09-19T09:34:57.784 INFO:tasks.workunit.client.1.smithi191.stdout:2/153: dwrite d8/db/d13/f15 [4194304,4194304] 0 2024-09-19T09:34:57.784 INFO:tasks.workunit.client.1.smithi191.stdout:4/223: dread d5/f35 [0,4194304] 0 2024-09-19T09:34:57.784 INFO:tasks.workunit.client.1.smithi191.stdout:4/224: fsync d5/fa 0 2024-09-19T09:34:57.789 INFO:tasks.workunit.client.1.smithi191.stdout:1/110: symlink d3/d9/da/l2a 0 2024-09-19T09:34:57.790 INFO:tasks.workunit.client.1.smithi191.stdout:6/114: rmdir d2/de/d19/d24 39 2024-09-19T09:34:57.790 INFO:tasks.workunit.client.0.smithi112.stdout:4/73: dwrite d1/d4/fb [0,4194304] 0 2024-09-19T09:34:57.792 INFO:tasks.workunit.client.1.smithi191.stdout:2/154: creat d8/d2a/f30 x:0 0 0 2024-09-19T09:34:57.793 INFO:tasks.workunit.client.1.smithi191.stdout:2/155: chown d8/d11/d17/l2d 24 1 2024-09-19T09:34:57.793 INFO:tasks.workunit.client.0.smithi112.stdout:4/74: symlink d1/d4/l19 0 2024-09-19T09:34:57.793 INFO:tasks.workunit.client.0.smithi112.stdout:4/75: write d1/f2 [738368,51219] 0 2024-09-19T09:34:57.794 INFO:tasks.workunit.client.1.smithi191.stdout:4/225: truncate d5/d1b/f4f 350219 0 2024-09-19T09:34:57.795 INFO:tasks.workunit.client.1.smithi191.stdout:1/111: symlink d3/d9/da/l2b 0 2024-09-19T09:34:57.796 INFO:tasks.workunit.client.0.smithi112.stdout:4/76: mkdir d1/d4/d1a 0 2024-09-19T09:34:57.796 INFO:tasks.workunit.client.1.smithi191.stdout:0/235: dread d0/f4 [0,4194304] 0 2024-09-19T09:34:57.797 INFO:tasks.workunit.client.1.smithi191.stdout:6/115: symlink d2/de/d15/l2b 0 2024-09-19T09:34:57.797 INFO:tasks.workunit.client.1.smithi191.stdout:4/226: symlink d5/d1b/d1c/d24/d32/d21/l55 0 2024-09-19T09:34:57.797 INFO:tasks.workunit.client.1.smithi191.stdout:4/227: stat d5/d1b/d1c 0 2024-09-19T09:34:57.799 INFO:tasks.workunit.client.1.smithi191.stdout:9/136: dwrite d3/db/f10 [0,4194304] 0 2024-09-19T09:34:57.800 INFO:tasks.workunit.client.0.smithi112.stdout:4/77: rename d1/d4/l19 to d1/l1b 0 2024-09-19T09:34:57.800 INFO:tasks.workunit.client.0.smithi112.stdout:4/78: fdatasync d1/d4/f9 0 2024-09-19T09:34:57.800 INFO:tasks.workunit.client.0.smithi112.stdout:4/79: write d1/d4/f15 [2914581,20074] 0 2024-09-19T09:34:57.801 INFO:tasks.workunit.client.1.smithi191.stdout:6/116: unlink d2/de/d15/f18 0 2024-09-19T09:34:57.802 INFO:tasks.workunit.client.1.smithi191.stdout:4/228: mkdir d5/d1b/d1c/d24/d32/d21/d56 0 2024-09-19T09:34:57.802 INFO:tasks.workunit.client.1.smithi191.stdout:4/229: read - d5/d1b/d1c/d2f/f52 zero size 2024-09-19T09:34:57.805 INFO:tasks.workunit.client.1.smithi191.stdout:9/137: getdents d3/db 0 2024-09-19T09:34:57.805 INFO:tasks.workunit.client.1.smithi191.stdout:9/138: dread - d3/d8/f21 zero size 2024-09-19T09:34:57.806 INFO:tasks.workunit.client.1.smithi191.stdout:0/236: getdents d0/d9/de 0 2024-09-19T09:34:57.806 INFO:tasks.workunit.client.1.smithi191.stdout:4/230: truncate d5/d1b/d1c/d2f/d19/f34 1571590 0 2024-09-19T09:34:57.807 INFO:tasks.workunit.client.1.smithi191.stdout:9/139: mknod d3/c2d 0 2024-09-19T09:34:57.807 INFO:tasks.workunit.client.1.smithi191.stdout:9/140: write f2 [531653,66210] 0 2024-09-19T09:34:57.808 INFO:tasks.workunit.client.1.smithi191.stdout:0/237: link d0/d9/l32 d0/d9/de/l4f 0 2024-09-19T09:34:57.808 INFO:tasks.workunit.client.1.smithi191.stdout:0/238: creat d0/f50 x:0 0 0 2024-09-19T09:34:57.808 INFO:tasks.workunit.client.1.smithi191.stdout:0/239: read - d0/d9/d1c/d1f/d24/f4b zero size 2024-09-19T09:34:57.811 INFO:tasks.workunit.client.1.smithi191.stdout:0/240: mknod d0/d9/c51 0 2024-09-19T09:34:57.811 INFO:tasks.workunit.client.1.smithi191.stdout:9/141: mknod d3/db/d16/c2e 0 2024-09-19T09:34:57.819 INFO:tasks.workunit.client.1.smithi191.stdout:6/117: write d2/de/f16 [1341020,53722] 0 2024-09-19T09:34:57.819 INFO:tasks.workunit.client.1.smithi191.stdout:6/118: write d2/d1a/f1b [4295988,6158] 0 2024-09-19T09:34:57.819 INFO:tasks.workunit.client.1.smithi191.stdout:6/119: chown d2/de/f22 1951669 1 2024-09-19T09:34:57.819 INFO:tasks.workunit.client.1.smithi191.stdout:6/120: write d2/de/f14 [543917,49117] 0 2024-09-19T09:34:57.819 INFO:tasks.workunit.client.1.smithi191.stdout:1/112: dwrite d3/d9/da/db/f1b [0,4194304] 0 2024-09-19T09:34:57.821 INFO:tasks.workunit.client.1.smithi191.stdout:1/113: getdents d3 0 2024-09-19T09:34:57.823 INFO:tasks.workunit.client.1.smithi191.stdout:6/121: getdents d2/de 0 2024-09-19T09:34:57.825 INFO:tasks.workunit.client.1.smithi191.stdout:6/122: creat d2/de/d19/d24/f2c x:0 0 0 2024-09-19T09:34:57.825 INFO:tasks.workunit.client.1.smithi191.stdout:6/123: chown d2/de/f1d 449013541 1 2024-09-19T09:34:57.829 INFO:tasks.workunit.client.1.smithi191.stdout:8/216: sync 2024-09-19T09:34:57.831 INFO:tasks.workunit.client.1.smithi191.stdout:8/217: creat d1/d16/d23/d3e/f4b x:0 0 0 2024-09-19T09:34:57.832 INFO:tasks.workunit.client.1.smithi191.stdout:8/218: write d1/d16/d3c/d28/f33 [1210867,102639] 0 2024-09-19T09:34:57.833 INFO:tasks.workunit.client.0.smithi112.stdout:4/80: dwrite d1/f6 [0,4194304] 0 2024-09-19T09:34:57.834 INFO:tasks.workunit.client.1.smithi191.stdout:8/219: dread d1/d16/d3c/f29 [0,4194304] 0 2024-09-19T09:34:57.834 INFO:tasks.workunit.client.1.smithi191.stdout:8/220: write d1/d16/d3c/d17/f1e [648331,37394] 0 2024-09-19T09:34:57.836 INFO:tasks.workunit.client.1.smithi191.stdout:4/231: dwrite d5/f8 [0,4194304] 0 2024-09-19T09:34:57.836 INFO:tasks.workunit.client.1.smithi191.stdout:8/221: truncate d1/d16/d3c/d17/f49 1348250 0 2024-09-19T09:34:57.836 INFO:tasks.workunit.client.1.smithi191.stdout:8/222: fdatasync d1/d22/f2c 0 2024-09-19T09:34:57.836 INFO:tasks.workunit.client.1.smithi191.stdout:8/223: truncate d1/f15 978442 0 2024-09-19T09:34:57.836 INFO:tasks.workunit.client.1.smithi191.stdout:4/232: write d5/d1b/d1c/d2f/f39 [271274,109574] 0 2024-09-19T09:34:57.836 INFO:tasks.workunit.client.1.smithi191.stdout:4/233: creat d5/d1b/d1c/d28/f57 x:0 0 0 2024-09-19T09:34:57.836 INFO:tasks.workunit.client.1.smithi191.stdout:4/234: creat d5/d1b/d1c/d28/f58 x:0 0 0 2024-09-19T09:34:57.837 INFO:tasks.workunit.client.1.smithi191.stdout:8/224: rmdir d1/d16/d3c 39 2024-09-19T09:34:57.837 INFO:tasks.workunit.client.1.smithi191.stdout:8/225: fdatasync d1/d16/d3c/d17/f48 0 2024-09-19T09:34:57.837 INFO:tasks.workunit.client.1.smithi191.stdout:8/226: write d1/d22/f2c [4687398,48489] 0 2024-09-19T09:34:57.837 INFO:tasks.workunit.client.1.smithi191.stdout:8/227: readlink d1/d16/d23/l2f 0 2024-09-19T09:34:57.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.843+0000 7fc9e2b7e640 1 -- 172.21.15.112:0/4079824381 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9dc11a010 con 0x7fc9cc06e7b0 2024-09-19T09:34:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.845+0000 7fc9d97fa640 1 -- 172.21.15.112:0/4079824381 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fc9dc11a010 con 0x7fc9cc06e7b0 2024-09-19T09:34:57.847 INFO:tasks.workunit.client.0.smithi112.stdout:4/81: write d1/f2 [7645019,121694] 0 2024-09-19T09:34:57.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.847+0000 7fc9e2b7e640 1 -- 172.21.15.112:0/4079824381 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fc9cc06e7b0 msgr2=0x7fc9cc070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:57.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.847+0000 7fc9e2b7e640 1 --2- 172.21.15.112:0/4079824381 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fc9cc06e7b0 0x7fc9cc070c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc06f570 tx=0x7fc9d000b040 comp rx=0 tx=0).stop 2024-09-19T09:34:57.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.847+0000 7fc9e2b7e640 1 -- 172.21.15.112:0/4079824381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9dc0fc700 msgr2=0x7fc9dc118750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:57.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.847+0000 7fc9e2b7e640 1 --2- 172.21.15.112:0/4079824381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9dc0fc700 0x7fc9dc118750 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80048a0 tx=0x7fc9c8009da0 comp rx=0 tx=0).stop 2024-09-19T09:34:57.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.847+0000 7fc9e2b7e640 1 -- 172.21.15.112:0/4079824381 shutdown_connections 2024-09-19T09:34:57.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.847+0000 7fc9e2b7e640 1 --2- 172.21.15.112:0/4079824381 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fc9cc06e7b0 0x7fc9cc070c60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:57.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.847+0000 7fc9e2b7e640 1 --2- 172.21.15.112:0/4079824381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9dc0fc700 0x7fc9dc118750 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:57.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.847+0000 7fc9e2b7e640 1 --2- 172.21.15.112:0/4079824381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9dc0fb430 0x7fc9dc116200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:57.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.847+0000 7fc9e2b7e640 1 -- 172.21.15.112:0/4079824381 >> 172.21.15.112:0/4079824381 conn(0x7fc9dc0f6c10 msgr2=0x7fc9dc0f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:57.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.848+0000 7fc9e2b7e640 1 -- 172.21.15.112:0/4079824381 shutdown_connections 2024-09-19T09:34:57.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.848+0000 7fc9e2b7e640 1 -- 172.21.15.112:0/4079824381 wait complete. 2024-09-19T09:34:57.850 INFO:tasks.workunit.client.1.smithi191.stdout:0/241: dwrite d0/d9/f4d [0,4194304] 0 2024-09-19T09:34:57.851 INFO:tasks.workunit.client.1.smithi191.stdout:1/114: dwrite d3/d9/f1d [0,4194304] 0 2024-09-19T09:34:57.851 INFO:tasks.workunit.client.1.smithi191.stdout:1/115: readlink d3/l15 0 2024-09-19T09:34:57.851 INFO:tasks.workunit.client.1.smithi191.stdout:1/116: write d3/d9/da/f23 [906458,10106] 0 2024-09-19T09:34:57.856 INFO:tasks.workunit.client.1.smithi191.stdout:9/142: dwrite f2 [0,4194304] 0 2024-09-19T09:34:57.860 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:34:57.860 INFO:tasks.workunit.client.1.smithi191.stdout:0/242: read d0/d9/d13/f16 [76390,91894] 0 2024-09-19T09:34:57.869 INFO:tasks.workunit.client.1.smithi191.stdout:0/243: write d0/d9/d1c/d20/f31 [140714,91133] 0 2024-09-19T09:34:57.869 INFO:tasks.workunit.client.1.smithi191.stdout:0/244: creat d0/d9/d13/f52 x:0 0 0 2024-09-19T09:34:57.869 INFO:tasks.workunit.client.1.smithi191.stdout:0/245: stat d0/d9/d13/f40 0 2024-09-19T09:34:57.882 INFO:tasks.workunit.client.1.smithi191.stdout:4/235: mkdir d5/d1b/d1c/d2f/d37/d59 0 2024-09-19T09:34:57.882 INFO:tasks.workunit.client.1.smithi191.stdout:4/236: fdatasync f4 0 2024-09-19T09:34:57.882 INFO:tasks.workunit.client.1.smithi191.stdout:4/237: creat d5/d1b/d1c/f5a x:0 0 0 2024-09-19T09:34:57.885 INFO:tasks.workunit.client.0.smithi112.stdout:4/82: mknod d1/d4/d14/d18/c1c 0 2024-09-19T09:34:57.885 INFO:tasks.workunit.client.0.smithi112.stdout:4/83: fsync d1/f6 0 2024-09-19T09:34:57.888 INFO:tasks.workunit.client.0.smithi112.stdout:4/84: getdents d1/d4/d14 0 2024-09-19T09:34:57.888 INFO:tasks.workunit.client.0.smithi112.stdout:4/85: creat d1/f1d x:0 0 0 2024-09-19T09:34:57.888 INFO:tasks.workunit.client.0.smithi112.stdout:4/86: chown d1/f12 645390 1 2024-09-19T09:34:57.888 INFO:tasks.workunit.client.0.smithi112.stdout:4/87: getdents d1/d4/d14 0 2024-09-19T09:34:57.890 INFO:tasks.workunit.client.0.smithi112.stdout:4/88: symlink d1/d4/d1a/l1e 0 2024-09-19T09:34:57.892 INFO:tasks.workunit.client.1.smithi191.stdout:1/117: unlink d3/d9/f26 0 2024-09-19T09:34:57.895 INFO:tasks.workunit.client.1.smithi191.stdout:9/143: symlink d3/l2f 0 2024-09-19T09:34:57.896 INFO:tasks.workunit.client.0.smithi112.stdout:4/89: dread d1/d4/f7 [0,4194304] 0 2024-09-19T09:34:57.896 INFO:tasks.workunit.client.0.smithi112.stdout:4/90: chown d1/fd 278067278 1 2024-09-19T09:34:57.897 INFO:tasks.workunit.client.0.smithi112.stdout:4/91: creat d1/f1f x:0 0 0 2024-09-19T09:34:57.897 INFO:tasks.workunit.client.1.smithi191.stdout:0/246: mkdir d0/d9/d1c/d1f/d24/d53 0 2024-09-19T09:34:57.899 INFO:tasks.workunit.client.0.smithi112.stdout:4/92: mknod d1/d4/c20 0 2024-09-19T09:34:57.900 INFO:tasks.workunit.client.0.smithi112.stdout:4/93: truncate d1/f12 663970 0 2024-09-19T09:34:57.901 INFO:tasks.workunit.client.1.smithi191.stdout:4/238: symlink d5/d1b/d1c/d28/l5b 0 2024-09-19T09:34:57.901 INFO:tasks.workunit.client.1.smithi191.stdout:4/239: chown d5/d1b/d1c/d24/d32/f2d 2558470 1 2024-09-19T09:34:57.901 INFO:tasks.workunit.client.1.smithi191.stdout:4/240: write d5/d1b/d1c/d24/d32/d21/f50 [950871,117639] 0 2024-09-19T09:34:57.902 INFO:tasks.workunit.client.1.smithi191.stdout:8/228: symlink d1/l4c 0 2024-09-19T09:34:57.902 INFO:tasks.workunit.client.0.smithi112.stdout:4/94: symlink d1/d4/d14/d18/l21 0 2024-09-19T09:34:57.902 INFO:tasks.workunit.client.0.smithi112.stdout:4/95: read - d1/fe zero size 2024-09-19T09:34:57.903 INFO:tasks.workunit.client.0.smithi112.stdout:4/96: rmdir d1/d4/d1a 39 2024-09-19T09:34:57.905 INFO:tasks.workunit.client.0.smithi112.stdout:4/97: rename d1/f12 to d1/d4/d14/f22 0 2024-09-19T09:34:57.906 INFO:tasks.workunit.client.0.smithi112.stdout:4/98: creat d1/d4/d1a/f23 x:0 0 0 2024-09-19T09:34:57.907 INFO:tasks.workunit.client.0.smithi112.stdout:4/99: truncate d1/f6 3676341 0 2024-09-19T09:34:57.908 INFO:tasks.workunit.client.1.smithi191.stdout:1/118: rename d3/f6 to d3/d9/da/dc/f2c 0 2024-09-19T09:34:57.909 INFO:tasks.workunit.client.1.smithi191.stdout:4/241: mkdir d5/d1b/d1c/d24/d32/d21/d5c 0 2024-09-19T09:34:57.909 INFO:tasks.workunit.client.1.smithi191.stdout:4/242: chown d5/d1b/d1c/d24/d32/d21/d4a/f51 11 1 2024-09-19T09:34:57.909 INFO:tasks.workunit.client.0.smithi112.stdout:4/100: link d1/c3 d1/d4/d14/c24 0 2024-09-19T09:34:57.911 INFO:tasks.workunit.client.1.smithi191.stdout:8/229: rmdir d1/d16/d2e/d32/d40 0 2024-09-19T09:34:57.911 INFO:tasks.workunit.client.1.smithi191.stdout:0/247: dwrite d0/d9/d13/f52 [0,4194304] 0 2024-09-19T09:34:57.913 INFO:tasks.workunit.client.1.smithi191.stdout:9/144: rename d3/db/d16/c2e to d3/db/d16/d17/c30 0 2024-09-19T09:34:57.916 INFO:tasks.workunit.client.1.smithi191.stdout:8/230: unlink d1/d7/d1a/f1f 0 2024-09-19T09:34:57.916 INFO:tasks.workunit.client.1.smithi191.stdout:8/231: truncate d1/f15 1256197 0 2024-09-19T09:34:57.917 INFO:tasks.workunit.client.0.smithi112.stdout:4/101: link d1/f1d d1/d4/f25 0 2024-09-19T09:34:57.919 INFO:tasks.workunit.client.0.smithi112.stdout:4/102: dread d1/d4/f13 [0,4194304] 0 2024-09-19T09:34:57.919 INFO:tasks.workunit.client.0.smithi112.stdout:4/103: creat d1/d4/f26 x:0 0 0 2024-09-19T09:34:57.921 INFO:tasks.workunit.client.1.smithi191.stdout:0/248: mkdir d0/d9/d54 0 2024-09-19T09:34:57.921 INFO:tasks.workunit.client.1.smithi191.stdout:0/249: truncate d0/d9/d1c/d20/f48 793997 0 2024-09-19T09:34:57.921 INFO:tasks.workunit.client.1.smithi191.stdout:0/250: truncate d0/d9/d1c/d1f/d24/f3f 1194152 0 2024-09-19T09:34:57.924 INFO:tasks.workunit.client.1.smithi191.stdout:8/232: write d1/d7/fe [733804,12386] 0 2024-09-19T09:34:57.924 INFO:tasks.workunit.client.1.smithi191.stdout:8/233: stat d1/c45 0 2024-09-19T09:34:57.924 INFO:tasks.workunit.client.1.smithi191.stdout:8/234: stat d1/d16/c44 0 2024-09-19T09:34:57.924 INFO:tasks.workunit.client.1.smithi191.stdout:9/145: creat d3/db/f31 x:0 0 0 2024-09-19T09:34:57.928 INFO:tasks.workunit.client.1.smithi191.stdout:4/243: link d5/d38/f45 d5/d1b/d1c/d24/d32/f5d 0 2024-09-19T09:34:57.930 INFO:tasks.workunit.client.1.smithi191.stdout:9/146: truncate d3/d8/f15 2168607 0 2024-09-19T09:34:57.930 INFO:tasks.workunit.client.1.smithi191.stdout:9/147: creat d3/db/d16/d17/f32 x:0 0 0 2024-09-19T09:34:57.933 INFO:tasks.workunit.client.1.smithi191.stdout:9/148: symlink d3/db/l33 0 2024-09-19T09:34:57.935 INFO:tasks.workunit.client.1.smithi191.stdout:4/244: dread f1 [0,4194304] 0 2024-09-19T09:34:57.935 INFO:tasks.workunit.client.1.smithi191.stdout:1/119: dwrite d3/d9/da/dc/f2c [0,4194304] 0 2024-09-19T09:34:57.948 INFO:tasks.workunit.client.1.smithi191.stdout:1/120: dread f0 [4194304,4194304] 0 2024-09-19T09:34:57.948 INFO:tasks.workunit.client.1.smithi191.stdout:1/121: write d3/d9/da/f23 [999399,2526] 0 2024-09-19T09:34:57.951 INFO:tasks.workunit.client.1.smithi191.stdout:1/122: creat d3/d9/da/d1e/f2d x:0 0 0 2024-09-19T09:34:57.951 INFO:tasks.workunit.client.1.smithi191.stdout:1/123: write d3/d9/da/db/f1b [4692336,99344] 0 2024-09-19T09:34:57.951 INFO:tasks.workunit.client.1.smithi191.stdout:1/124: write d3/d9/da/dc/f1c [199158,112727] 0 2024-09-19T09:34:57.951 INFO:tasks.workunit.client.1.smithi191.stdout:1/125: readlink d3/l1f 0 2024-09-19T09:34:57.953 INFO:tasks.workunit.client.1.smithi191.stdout:1/126: creat d3/d9/da/dc/f2e x:0 0 0 2024-09-19T09:34:57.955 INFO:tasks.workunit.client.1.smithi191.stdout:1/127: mkdir d3/d9/da/d1e/d25/d2f 0 2024-09-19T09:34:57.955 INFO:tasks.workunit.client.1.smithi191.stdout:1/128: write d3/d9/da/d1e/f2d [937360,112015] 0 2024-09-19T09:34:57.956 INFO:tasks.workunit.client.1.smithi191.stdout:1/129: stat d3/d9/da/f23 0 2024-09-19T09:34:57.956 INFO:tasks.workunit.client.1.smithi191.stdout:1/130: write d3/d9/da/f23 [1701699,23808] 0 2024-09-19T09:34:57.956 INFO:tasks.workunit.client.1.smithi191.stdout:1/131: chown d3/d9/da/l2a 2 1 2024-09-19T09:34:57.957 INFO:tasks.workunit.client.1.smithi191.stdout:1/132: getdents d3/d9/da 0 2024-09-19T09:34:57.957 INFO:tasks.workunit.client.1.smithi191.stdout:1/133: creat d3/d9/da/d1e/d25/f30 x:0 0 0 2024-09-19T09:34:57.959 INFO:tasks.workunit.client.1.smithi191.stdout:1/134: rmdir d3/d9/da/d1e/d25/d2f 0 2024-09-19T09:34:57.961 INFO:tasks.workunit.client.0.smithi112.stdout:4/104: dwrite d1/f17 [0,4194304] 0 2024-09-19T09:34:57.961 INFO:tasks.workunit.client.1.smithi191.stdout:0/251: dwrite d0/d9/f22 [0,4194304] 0 2024-09-19T09:34:57.961 INFO:tasks.workunit.client.1.smithi191.stdout:8/235: dwrite d1/d16/d23/d3e/f4b [0,4194304] 0 2024-09-19T09:34:57.962 INFO:tasks.workunit.client.1.smithi191.stdout:9/149: dwrite d3/db/d16/d17/d1c/f27 [0,4194304] 0 2024-09-19T09:34:57.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.960+0000 7fa015732640 1 -- 172.21.15.112:0/3136362150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0100fd840 msgr2=0x7fa0100fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:57.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.960+0000 7fa015732640 1 --2- 172.21.15.112:0/3136362150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0100fd840 0x7fa0100fdcb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa0040048d0 tx=0x7fa004009da0 comp rx=0 tx=0).stop 2024-09-19T09:34:57.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.961+0000 7fa015732640 1 -- 172.21.15.112:0/3136362150 shutdown_connections 2024-09-19T09:34:57.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.961+0000 7fa015732640 1 --2- 172.21.15.112:0/3136362150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0100fd840 0x7fa0100fdcb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:57.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.961+0000 7fa015732640 1 --2- 172.21.15.112:0/3136362150 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0100fc570 0x7fa0100fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:57.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.961+0000 7fa015732640 1 -- 172.21.15.112:0/3136362150 >> 172.21.15.112:0/3136362150 conn(0x7fa0100f7d30 msgr2=0x7fa0100fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:57.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.961+0000 7fa015732640 1 -- 172.21.15.112:0/3136362150 shutdown_connections 2024-09-19T09:34:57.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.961+0000 7fa015732640 1 -- 172.21.15.112:0/3136362150 wait complete. 2024-09-19T09:34:57.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.962+0000 7fa015732640 1 Processor -- start 2024-09-19T09:34:57.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.962+0000 7fa015732640 1 -- start start 2024-09-19T09:34:57.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.962+0000 7fa015732640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0100fc570 0x7fa01010f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:57.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.962+0000 7fa015732640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0100fd840 0x7fa01010f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:57.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.962+0000 7fa015732640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01010fe00 con 0x7fa0100fc570 2024-09-19T09:34:57.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.962+0000 7fa015732640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa010110620 con 0x7fa0100fd840 2024-09-19T09:34:57.965 INFO:tasks.workunit.client.0.smithi112.stdout:4/105: rmdir d1/d4/d14 39 2024-09-19T09:34:57.965 INFO:tasks.workunit.client.0.smithi112.stdout:4/106: dread - d1/d4/d1a/f23 zero size 2024-09-19T09:34:57.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.962+0000 7fa00effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0100fc570 0x7fa01010f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:57.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.962+0000 7fa00effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0100fc570 0x7fa01010f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42374/0 (socket says 172.21.15.112:42374) 2024-09-19T09:34:57.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.962+0000 7fa00effd640 1 -- 172.21.15.112:0/1970216591 learned_addr learned my addr 172.21.15.112:0/1970216591 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:34:57.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.962+0000 7fa00e7fc640 1 --2- 172.21.15.112:0/1970216591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0100fd840 0x7fa01010f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:57.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.963+0000 7fa00effd640 1 -- 172.21.15.112:0/1970216591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0100fd840 msgr2=0x7fa01010f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:57.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.963+0000 7fa00effd640 1 --2- 172.21.15.112:0/1970216591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0100fd840 0x7fa01010f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:57.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.963+0000 7fa00effd640 1 -- 172.21.15.112:0/1970216591 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa004005040 con 0x7fa0100fc570 2024-09-19T09:34:57.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.963+0000 7fa00e7fc640 1 --2- 172.21.15.112:0/1970216591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0100fd840 0x7fa01010f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:57.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.963+0000 7fa00effd640 1 --2- 172.21.15.112:0/1970216591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0100fc570 0x7fa01010f270 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa00000e940 tx=0x7fa00000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:57.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.963+0000 7f9ff77fe640 1 -- 172.21.15.112:0/1970216591 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa00000eed0 con 0x7fa0100fc570 2024-09-19T09:34:57.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.963+0000 7f9ff77fe640 1 -- 172.21.15.112:0/1970216591 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa00000f040 con 0x7fa0100fc570 2024-09-19T09:34:57.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.963+0000 7f9ff77fe640 1 -- 172.21.15.112:0/1970216591 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa00000ca00 con 0x7fa0100fc570 2024-09-19T09:34:57.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.963+0000 7fa015732640 1 -- 172.21.15.112:0/1970216591 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa010110850 con 0x7fa0100fc570 2024-09-19T09:34:57.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.963+0000 7fa015732640 1 -- 172.21.15.112:0/1970216591 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa010110cd0 con 0x7fa0100fc570 2024-09-19T09:34:57.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.964+0000 7fa015732640 1 -- 172.21.15.112:0/1970216591 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0100fb9d0 con 0x7fa0100fc570 2024-09-19T09:34:57.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.966+0000 7f9ff77fe640 1 -- 172.21.15.112:0/1970216591 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fa000007bd0 con 0x7fa0100fc570 2024-09-19T09:34:57.968 INFO:tasks.workunit.client.0.smithi112.stdout:4/107: link d1/d4/f9 d1/d4/d1a/f27 0 2024-09-19T09:34:57.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.967+0000 7f9ff77fe640 1 --2- 172.21.15.112:0/1970216591 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f9ff806e6e0 0x7f9ff8070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:57.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.967+0000 7f9ff77fe640 1 -- 172.21.15.112:0/1970216591 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa00008e040 con 0x7fa0100fc570 2024-09-19T09:34:57.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.968+0000 7fa00e7fc640 1 --2- 172.21.15.112:0/1970216591 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f9ff806e6e0 0x7f9ff8070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:57.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.968+0000 7fa00e7fc640 1 --2- 172.21.15.112:0/1970216591 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f9ff806e6e0 0x7f9ff8070b90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa01010f020 tx=0x7fa004035040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:57.971 INFO:tasks.workunit.client.1.smithi191.stdout:1/135: write d3/d9/fe [2873325,126511] 0 2024-09-19T09:34:57.972 INFO:tasks.workunit.client.0.smithi112.stdout:4/108: mknod d1/d4/c28 0 2024-09-19T09:34:57.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:57.972+0000 7f9ff77fe640 1 -- 172.21.15.112:0/1970216591 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fa000057970 con 0x7fa0100fc570 2024-09-19T09:34:57.974 INFO:tasks.workunit.client.0.smithi112.stdout:4/109: dread d1/d4/f13 [0,4194304] 0 2024-09-19T09:34:57.974 INFO:tasks.workunit.client.0.smithi112.stdout:4/110: dread - d1/f1f zero size 2024-09-19T09:34:57.975 INFO:tasks.workunit.client.1.smithi191.stdout:0/252: dread d0/d9/f22 [4194304,4194304] 0 2024-09-19T09:34:57.975 INFO:tasks.workunit.client.1.smithi191.stdout:0/253: chown d0/d9/d1c/d1f/d24/l2d 0 1 2024-09-19T09:34:57.976 INFO:tasks.workunit.client.0.smithi112.stdout:4/111: getdents d1/d4/d14/d18 0 2024-09-19T09:34:57.976 INFO:tasks.workunit.client.0.smithi112.stdout:4/112: stat d1/d4/c20 0 2024-09-19T09:34:57.978 INFO:tasks.workunit.client.1.smithi191.stdout:8/236: dwrite d1/d16/d23/d3e/f4b [0,4194304] 0 2024-09-19T09:34:57.980 INFO:tasks.workunit.client.1.smithi191.stdout:9/150: rename d3/db/d16/l25 to d3/d8/l34 0 2024-09-19T09:34:57.981 INFO:tasks.workunit.client.1.smithi191.stdout:0/254: write d0/d9/de/f10 [1117494,84971] 0 2024-09-19T09:34:57.981 INFO:tasks.workunit.client.1.smithi191.stdout:0/255: write d0/d9/f1a [2003308,52216] 0 2024-09-19T09:34:57.981 INFO:tasks.workunit.client.1.smithi191.stdout:0/256: write d0/d9/f25 [239552,11671] 0 2024-09-19T09:34:57.981 INFO:tasks.workunit.client.0.smithi112.stdout:4/113: fdatasync d1/f2 0 2024-09-19T09:34:57.981 INFO:tasks.workunit.client.0.smithi112.stdout:4/114: creat d1/f29 x:0 0 0 2024-09-19T09:34:57.982 INFO:tasks.workunit.client.1.smithi191.stdout:8/237: link d1/d16/d3c/d28/f33 d1/d16/d3c/d17/f4d 0 2024-09-19T09:34:57.983 INFO:tasks.workunit.client.1.smithi191.stdout:8/238: fdatasync d1/f14 0 2024-09-19T09:34:57.983 INFO:tasks.workunit.client.1.smithi191.stdout:8/239: chown d1/d16/d2e/d32 506 1 2024-09-19T09:34:57.983 INFO:tasks.workunit.client.1.smithi191.stdout:0/257: fsync d0/d9/f1a 0 2024-09-19T09:34:57.984 INFO:tasks.workunit.client.1.smithi191.stdout:1/136: rename d3/d9/f1d to d3/d9/da/d1e/f31 0 2024-09-19T09:34:57.987 INFO:tasks.workunit.client.1.smithi191.stdout:9/151: mkdir d3/db/d16/d17/d1c/d35 0 2024-09-19T09:34:57.989 INFO:tasks.workunit.client.0.smithi112.stdout:4/115: creat d1/d4/d14/f2a x:0 0 0 2024-09-19T09:34:57.989 INFO:tasks.workunit.client.0.smithi112.stdout:4/116: chown d1/d4/d14 62 1 2024-09-19T09:34:57.994 INFO:tasks.workunit.client.1.smithi191.stdout:8/240: write d1/d16/f19 [340052,58249] 0 2024-09-19T09:34:57.994 INFO:tasks.workunit.client.0.smithi112.stdout:4/117: truncate d1/f6 666218 0 2024-09-19T09:34:57.996 INFO:tasks.workunit.client.1.smithi191.stdout:8/241: mknod d1/d22/d34/c4e 0 2024-09-19T09:34:57.996 INFO:tasks.workunit.client.1.smithi191.stdout:8/242: truncate d1/d16/d3c/f31 322188 0 2024-09-19T09:34:57.997 INFO:tasks.workunit.client.0.smithi112.stdout:4/118: mknod d1/d4/d1a/c2b 0 2024-09-19T09:34:57.998 INFO:tasks.workunit.client.0.smithi112.stdout:4/119: creat d1/f2c x:0 0 0 2024-09-19T09:34:57.999 INFO:tasks.workunit.client.1.smithi191.stdout:1/137: dread f0 [0,4194304] 0 2024-09-19T09:34:58.000 INFO:tasks.workunit.client.0.smithi112.stdout:4/120: mknod d1/d4/c2d 0 2024-09-19T09:34:58.000 INFO:tasks.workunit.client.0.smithi112.stdout:4/121: creat d1/d4/d14/f2e x:0 0 0 2024-09-19T09:34:58.001 INFO:tasks.workunit.client.1.smithi191.stdout:1/138: mkdir d3/d9/da/d1e/d32 0 2024-09-19T09:34:58.006 INFO:tasks.workunit.client.1.smithi191.stdout:1/139: creat d3/d9/da/db/f33 x:0 0 0 2024-09-19T09:34:58.007 INFO:tasks.workunit.client.1.smithi191.stdout:9/152: dwrite d3/db/d16/d17/f1a [0,4194304] 0 2024-09-19T09:34:58.007 INFO:tasks.workunit.client.1.smithi191.stdout:9/153: stat d3/d8/f21 0 2024-09-19T09:34:58.011 INFO:tasks.workunit.client.1.smithi191.stdout:1/140: dread d3/d9/f13 [0,4194304] 0 2024-09-19T09:34:58.011 INFO:tasks.workunit.client.1.smithi191.stdout:1/141: readlink d3/d9/da/l14 0 2024-09-19T09:34:58.013 INFO:tasks.workunit.client.1.smithi191.stdout:1/142: read d3/d9/f17 [556254,7163] 0 2024-09-19T09:34:58.013 INFO:tasks.workunit.client.1.smithi191.stdout:1/143: rename d3 to d3/d9/d34 22 2024-09-19T09:34:58.013 INFO:tasks.workunit.client.1.smithi191.stdout:1/144: readlink d3/d9/da/l14 0 2024-09-19T09:34:58.013 INFO:tasks.workunit.client.1.smithi191.stdout:9/154: getdents d3/db/d16 0 2024-09-19T09:34:58.013 INFO:tasks.workunit.client.1.smithi191.stdout:9/155: truncate d3/db/f31 19991 0 2024-09-19T09:34:58.015 INFO:tasks.workunit.client.0.smithi112.stdout:4/122: fsync d1/f29 0 2024-09-19T09:34:58.020 INFO:tasks.workunit.client.1.smithi191.stdout:8/243: dwrite d1/d7/f24 [0,4194304] 0 2024-09-19T09:34:58.020 INFO:tasks.workunit.client.1.smithi191.stdout:8/244: fsync d1/d16/d23/f43 0 2024-09-19T09:34:58.023 INFO:tasks.workunit.client.1.smithi191.stdout:1/145: rmdir d3/d9/da/db 39 2024-09-19T09:34:58.025 INFO:tasks.workunit.client.1.smithi191.stdout:1/146: symlink d3/d9/da/d1e/l35 0 2024-09-19T09:34:58.026 INFO:tasks.workunit.client.1.smithi191.stdout:1/147: write d3/d9/da/db/f22 [5238127,85183] 0 2024-09-19T09:34:58.026 INFO:tasks.workunit.client.1.smithi191.stdout:8/245: mkdir d1/d4f 0 2024-09-19T09:34:58.026 INFO:tasks.workunit.client.1.smithi191.stdout:0/258: dwrite d0/d9/d1c/d1f/f3c [0,4194304] 0 2024-09-19T09:34:58.027 INFO:tasks.workunit.client.1.smithi191.stdout:9/156: dread d3/db/fd [0,4194304] 0 2024-09-19T09:34:58.027 INFO:tasks.workunit.client.1.smithi191.stdout:0/259: chown d0/d9/d13/f52 105 1 2024-09-19T09:34:58.028 INFO:tasks.workunit.client.1.smithi191.stdout:1/148: creat d3/d9/da/d1e/d32/f36 x:0 0 0 2024-09-19T09:34:58.029 INFO:tasks.workunit.client.1.smithi191.stdout:8/246: symlink d1/d16/d3c/l50 0 2024-09-19T09:34:58.031 INFO:tasks.workunit.client.1.smithi191.stdout:8/247: creat d1/d16/d3c/d17/f51 x:0 0 0 2024-09-19T09:34:58.031 INFO:tasks.workunit.client.1.smithi191.stdout:8/248: truncate d1/d7/d1a/f25 1204848 0 2024-09-19T09:34:58.031 INFO:tasks.workunit.client.1.smithi191.stdout:8/249: write d1/d16/d3c/d17/f1e [1670677,42268] 0 2024-09-19T09:34:58.031 INFO:tasks.workunit.client.1.smithi191.stdout:0/260: link d0/d9/d1c/d1f/d24/d29/f3b d0/d9/de/f55 0 2024-09-19T09:34:58.034 INFO:tasks.workunit.client.0.smithi112.stdout:4/123: dwrite d1/f29 [0,4194304] 0 2024-09-19T09:34:58.034 INFO:tasks.workunit.client.0.smithi112.stdout:4/124: write d1/f1d [676517,2067] 0 2024-09-19T09:34:58.034 INFO:tasks.workunit.client.0.smithi112.stdout:4/125: fsync d1/fd 0 2024-09-19T09:34:58.034 INFO:tasks.workunit.client.0.smithi112.stdout:4/126: write d1/d4/f13 [334851,74476] 0 2024-09-19T09:34:58.034 INFO:tasks.workunit.client.0.smithi112.stdout:4/127: fsync d1/d4/d14/f22 0 2024-09-19T09:34:58.035 INFO:tasks.workunit.client.1.smithi191.stdout:0/261: fsync d0/d9/de/f10 0 2024-09-19T09:34:58.035 INFO:tasks.workunit.client.1.smithi191.stdout:0/262: fsync d0/d9/d1c/d1f/d24/f3f 0 2024-09-19T09:34:58.035 INFO:tasks.workunit.client.1.smithi191.stdout:0/263: rmdir d0/d9/d1c 39 2024-09-19T09:34:58.035 INFO:tasks.workunit.client.1.smithi191.stdout:1/149: dread d3/d9/da/d1e/f2d [0,4194304] 0 2024-09-19T09:34:58.037 INFO:tasks.workunit.client.0.smithi112.stdout:4/128: creat d1/d4/d14/d18/f2f x:0 0 0 2024-09-19T09:34:58.037 INFO:tasks.workunit.client.0.smithi112.stdout:4/129: write d1/f1f [800870,36944] 0 2024-09-19T09:34:58.037 INFO:tasks.workunit.client.0.smithi112.stdout:4/130: write d1/fe [847102,47567] 0 2024-09-19T09:34:58.037 INFO:tasks.workunit.client.1.smithi191.stdout:8/250: getdents d1 0 2024-09-19T09:34:58.037 INFO:tasks.workunit.client.1.smithi191.stdout:8/251: truncate d1/d16/f4a 5110176 0 2024-09-19T09:34:58.039 INFO:tasks.workunit.client.1.smithi191.stdout:9/157: write d3/db/d16/f29 [3183702,13228] 0 2024-09-19T09:34:58.039 INFO:tasks.workunit.client.1.smithi191.stdout:9/158: stat d3/db/d16/d17/f32 0 2024-09-19T09:34:58.039 INFO:tasks.workunit.client.1.smithi191.stdout:9/159: dread - d3/db/f11 zero size 2024-09-19T09:34:58.040 INFO:tasks.workunit.client.0.smithi112.stdout:4/131: symlink d1/l30 0 2024-09-19T09:34:58.041 INFO:tasks.workunit.client.1.smithi191.stdout:8/252: creat d1/f52 x:0 0 0 2024-09-19T09:34:58.041 INFO:tasks.workunit.client.1.smithi191.stdout:1/150: getdents d3/d9/da/dc 0 2024-09-19T09:34:58.043 INFO:tasks.workunit.client.0.smithi112.stdout:4/132: mkdir d1/d31 0 2024-09-19T09:34:58.043 INFO:tasks.workunit.client.0.smithi112.stdout:4/133: truncate d1/d4/d14/d18/f2f 141691 0 2024-09-19T09:34:58.043 INFO:tasks.workunit.client.0.smithi112.stdout:4/134: chown d1/fd 0 1 2024-09-19T09:34:58.044 INFO:tasks.workunit.client.1.smithi191.stdout:8/253: dread d1/d16/d3c/d17/f4d [0,4194304] 0 2024-09-19T09:34:58.045 INFO:tasks.workunit.client.1.smithi191.stdout:1/151: mknod d3/d9/da/d1e/d32/c37 0 2024-09-19T09:34:58.045 INFO:tasks.workunit.client.1.smithi191.stdout:7/99: sync 2024-09-19T09:34:58.045 INFO:tasks.workunit.client.1.smithi191.stdout:5/199: sync 2024-09-19T09:34:58.045 INFO:tasks.workunit.client.1.smithi191.stdout:3/126: sync 2024-09-19T09:34:58.045 INFO:tasks.workunit.client.1.smithi191.stdout:3/127: creat d12/d13/d1a/f32 x:0 0 0 2024-09-19T09:34:58.045 INFO:tasks.workunit.client.1.smithi191.stdout:6/124: sync 2024-09-19T09:34:58.046 INFO:tasks.workunit.client.1.smithi191.stdout:6/125: fsync d2/de/f10 0 2024-09-19T09:34:58.046 INFO:tasks.workunit.client.1.smithi191.stdout:2/156: sync 2024-09-19T09:34:58.046 INFO:tasks.workunit.client.1.smithi191.stdout:2/157: stat d8/la 0 2024-09-19T09:34:58.046 INFO:tasks.workunit.client.1.smithi191.stdout:7/100: write d2/ff [698763,114096] 0 2024-09-19T09:34:58.046 INFO:tasks.workunit.client.1.smithi191.stdout:7/101: truncate d2/f1d 1533860 0 2024-09-19T09:34:58.049 INFO:tasks.workunit.client.0.smithi112.stdout:4/135: getdents d1/d4/d14 0 2024-09-19T09:34:58.049 INFO:tasks.workunit.client.0.smithi112.stdout:4/136: truncate d1/d4/f26 249915 0 2024-09-19T09:34:58.049 INFO:tasks.workunit.client.0.smithi112.stdout:4/137: creat d1/d4/f32 x:0 0 0 2024-09-19T09:34:58.049 INFO:tasks.workunit.client.0.smithi112.stdout:4/138: dread - d1/d4/d14/f2e zero size 2024-09-19T09:34:58.049 INFO:tasks.workunit.client.1.smithi191.stdout:6/126: dread d2/de/f14 [0,4194304] 0 2024-09-19T09:34:58.054 INFO:tasks.workunit.client.1.smithi191.stdout:1/152: rename d3/d9/da/l14 to d3/l38 0 2024-09-19T09:34:58.054 INFO:tasks.workunit.client.1.smithi191.stdout:1/153: creat d3/d9/f39 x:0 0 0 2024-09-19T09:34:58.055 INFO:tasks.workunit.client.1.smithi191.stdout:1/154: write d3/d9/f17 [939532,60061] 0 2024-09-19T09:34:58.055 INFO:tasks.workunit.client.0.smithi112.stdout:4/139: symlink d1/l33 0 2024-09-19T09:34:58.055 INFO:tasks.workunit.client.0.smithi112.stdout:4/140: stat d1/d4/d1a/f27 0 2024-09-19T09:34:58.056 INFO:tasks.workunit.client.1.smithi191.stdout:9/160: dwrite d3/d8/f13 [0,4194304] 0 2024-09-19T09:34:58.057 INFO:tasks.workunit.client.0.smithi112.stdout:4/141: mknod d1/d4/d1a/c34 0 2024-09-19T09:34:58.058 INFO:tasks.workunit.client.1.smithi191.stdout:3/128: rmdir d12/d13/d1a/d1b/d2e 39 2024-09-19T09:34:58.058 INFO:tasks.workunit.client.1.smithi191.stdout:3/129: fsync d12/d13/f19 0 2024-09-19T09:34:58.059 INFO:tasks.workunit.client.1.smithi191.stdout:2/158: unlink d8/lf 0 2024-09-19T09:34:58.059 INFO:tasks.workunit.client.1.smithi191.stdout:2/159: write d8/d11/d17/f22 [1000574,3604] 0 2024-09-19T09:34:58.059 INFO:tasks.workunit.client.0.smithi112.stdout:4/142: mknod d1/d4/d14/c35 0 2024-09-19T09:34:58.060 INFO:tasks.workunit.client.1.smithi191.stdout:6/127: unlink d2/c7 0 2024-09-19T09:34:58.061 INFO:tasks.workunit.client.0.smithi112.stdout:4/143: mknod d1/c36 0 2024-09-19T09:34:58.063 INFO:tasks.workunit.client.1.smithi191.stdout:1/155: link d3/d9/da/db/f1b d3/d9/da/d1e/d25/f3a 0 2024-09-19T09:34:58.063 INFO:tasks.workunit.client.1.smithi191.stdout:1/156: chown d3/d9/da/d1e/d32/f36 228483759 1 2024-09-19T09:34:58.063 INFO:tasks.workunit.client.1.smithi191.stdout:1/157: fsync d3/d9/da/d1e/f31 0 2024-09-19T09:34:58.063 INFO:tasks.workunit.client.1.smithi191.stdout:1/158: write d3/d9/f39 [612170,86162] 0 2024-09-19T09:34:58.063 INFO:tasks.workunit.client.0.smithi112.stdout:4/144: mkdir d1/d4/d14/d18/d37 0 2024-09-19T09:34:58.063 INFO:tasks.workunit.client.0.smithi112.stdout:4/145: chown d1/d4/d14/f2a 18770315 1 2024-09-19T09:34:58.064 INFO:tasks.workunit.client.1.smithi191.stdout:5/200: rmdir d0/d4/d9/d1d/d22/d3b 39 2024-09-19T09:34:58.064 INFO:tasks.workunit.client.1.smithi191.stdout:5/201: stat d0/d4/d9/d1d/d22/d3b/f3c 0 2024-09-19T09:34:58.066 INFO:tasks.workunit.client.0.smithi112.stdout:4/146: unlink d1/f2 0 2024-09-19T09:34:58.067 INFO:tasks.workunit.client.1.smithi191.stdout:8/254: dwrite d1/d16/d3c/d17/f4d [0,4194304] 0 2024-09-19T09:34:58.067 INFO:tasks.workunit.client.1.smithi191.stdout:8/255: write d1/d16/f19 [675796,67421] 0 2024-09-19T09:34:58.068 INFO:tasks.workunit.client.1.smithi191.stdout:3/130: write d12/f15 [6610931,15020] 0 2024-09-19T09:34:58.068 INFO:tasks.workunit.client.1.smithi191.stdout:7/102: dwrite d2/f17 [0,4194304] 0 2024-09-19T09:34:58.068 INFO:tasks.workunit.client.1.smithi191.stdout:7/103: truncate d2/f1b 1162701 0 2024-09-19T09:34:58.070 INFO:tasks.workunit.client.0.smithi112.stdout:4/147: rename d1/d4/d14/f2e to d1/d31/f38 0 2024-09-19T09:34:58.070 INFO:tasks.workunit.client.0.smithi112.stdout:4/148: read d1/fe [179290,108732] 0 2024-09-19T09:34:58.071 INFO:tasks.workunit.client.1.smithi191.stdout:9/161: rename d3/db/d16/d17/f1a to d3/db/d16/d17/d1c/f36 0 2024-09-19T09:34:58.073 INFO:tasks.workunit.client.1.smithi191.stdout:1/159: truncate d3/d9/f13 6041203 0 2024-09-19T09:34:58.074 INFO:tasks.workunit.client.0.smithi112.stdout:4/149: rename d1/c11 to d1/d31/c39 0 2024-09-19T09:34:58.076 INFO:tasks.workunit.client.1.smithi191.stdout:5/202: symlink d0/d4/d9/d1d/d29/d33/d45/l49 0 2024-09-19T09:34:58.076 INFO:tasks.workunit.client.1.smithi191.stdout:5/203: write d0/d4/d9/d1d/d29/d33/f40 [516094,10351] 0 2024-09-19T09:34:58.076 INFO:tasks.workunit.client.1.smithi191.stdout:6/128: dwrite d2/de/f1d [0,4194304] 0 2024-09-19T09:34:58.078 INFO:tasks.workunit.client.1.smithi191.stdout:5/204: dread d0/d4/d9/d1d/d22/f30 [0,4194304] 0 2024-09-19T09:34:58.078 INFO:tasks.workunit.client.1.smithi191.stdout:5/205: write d0/d4/d9/de/f47 [1029877,69253] 0 2024-09-19T09:34:58.080 INFO:tasks.workunit.client.1.smithi191.stdout:8/256: creat d1/d7/f53 x:0 0 0 2024-09-19T09:34:58.087 INFO:tasks.workunit.client.1.smithi191.stdout:3/131: mkdir d12/d13/d1a/d1b/d2e/d33 0 2024-09-19T09:34:58.088 INFO:tasks.workunit.client.1.smithi191.stdout:7/104: mknod d2/c25 0 2024-09-19T09:34:58.088 INFO:tasks.workunit.client.1.smithi191.stdout:7/105: write d2/ff [597215,81279] 0 2024-09-19T09:34:58.090 INFO:tasks.workunit.client.1.smithi191.stdout:2/160: rename c4 to d8/c31 0 2024-09-19T09:34:58.090 INFO:tasks.workunit.client.1.smithi191.stdout:2/161: dread - d8/d11/f2b zero size 2024-09-19T09:34:58.090 INFO:tasks.workunit.client.1.smithi191.stdout:2/162: write d8/db/d13/d23/f29 [481891,4372] 0 2024-09-19T09:34:58.090 INFO:tasks.workunit.client.1.smithi191.stdout:9/162: link f2 d3/db/d16/f37 0 2024-09-19T09:34:58.091 INFO:tasks.workunit.client.0.smithi112.stdout:4/150: rename d1/d4/d14 to d1/d4/d3a 0 2024-09-19T09:34:58.094 INFO:tasks.workunit.client.0.smithi112.stdout:4/151: symlink d1/d4/d1a/l3b 0 2024-09-19T09:34:58.095 INFO:tasks.workunit.client.1.smithi191.stdout:5/206: dwrite d0/d4/f3a [0,4194304] 0 2024-09-19T09:34:58.099 INFO:tasks.workunit.client.1.smithi191.stdout:8/257: creat d1/d22/f54 x:0 0 0 2024-09-19T09:34:58.099 INFO:tasks.workunit.client.1.smithi191.stdout:5/207: dread d0/d4/d9/de/f47 [0,4194304] 0 2024-09-19T09:34:58.100 INFO:tasks.workunit.client.1.smithi191.stdout:3/132: creat d12/d13/d1a/d28/f34 x:0 0 0 2024-09-19T09:34:58.101 INFO:tasks.workunit.client.1.smithi191.stdout:3/133: creat d12/d13/d1a/d1b/f35 x:0 0 0 2024-09-19T09:34:58.101 INFO:tasks.workunit.client.1.smithi191.stdout:3/134: dread - f11 zero size 2024-09-19T09:34:58.102 INFO:tasks.workunit.client.1.smithi191.stdout:7/106: mknod d2/c26 0 2024-09-19T09:34:58.103 INFO:tasks.workunit.client.1.smithi191.stdout:6/129: rename d2/d1a to d2/de/d2a/d2d 0 2024-09-19T09:34:58.103 INFO:tasks.workunit.client.1.smithi191.stdout:6/130: truncate d2/de/d15/f26 132427 0 2024-09-19T09:34:58.104 INFO:tasks.workunit.client.1.smithi191.stdout:2/163: link d8/db/d13/d23/f1f d8/d2a/f32 0 2024-09-19T09:34:58.109 INFO:tasks.workunit.client.1.smithi191.stdout:1/160: rmdir d3/d9 39 2024-09-19T09:34:58.111 INFO:tasks.workunit.client.1.smithi191.stdout:8/258: symlink d1/l55 0 2024-09-19T09:34:58.111 INFO:tasks.workunit.client.1.smithi191.stdout:8/259: chown d1/d7/f53 10376 1 2024-09-19T09:34:58.112 INFO:tasks.workunit.client.1.smithi191.stdout:5/208: mkdir d0/d4/d4a 0 2024-09-19T09:34:58.112 INFO:tasks.workunit.client.1.smithi191.stdout:5/209: read - d0/d4/d9/de/f2d zero size 2024-09-19T09:34:58.112 INFO:tasks.workunit.client.1.smithi191.stdout:5/210: chown d0/d4/d9/d1d/d29/d33/f34 4439 1 2024-09-19T09:34:58.113 INFO:tasks.workunit.client.1.smithi191.stdout:3/135: unlink d12/f2f 0 2024-09-19T09:34:58.113 INFO:tasks.workunit.client.1.smithi191.stdout:3/136: chown c10 11061 1 2024-09-19T09:34:58.114 INFO:tasks.workunit.client.1.smithi191.stdout:3/137: fdatasync fe 0 2024-09-19T09:34:58.114 INFO:tasks.workunit.client.1.smithi191.stdout:3/138: creat d12/d13/d1a/d1b/f36 x:0 0 0 2024-09-19T09:34:58.114 INFO:tasks.workunit.client.1.smithi191.stdout:3/139: chown d12/d13/d1a/f29 2518 1 2024-09-19T09:34:58.114 INFO:tasks.workunit.client.1.smithi191.stdout:7/107: mknod d2/c27 0 2024-09-19T09:34:58.114 INFO:tasks.workunit.client.1.smithi191.stdout:7/108: stat d2/f7 0 2024-09-19T09:34:58.114 INFO:tasks.workunit.client.1.smithi191.stdout:7/109: creat d2/f28 x:0 0 0 2024-09-19T09:34:58.115 INFO:tasks.workunit.client.1.smithi191.stdout:7/110: write d2/f24 [1047267,78114] 0 2024-09-19T09:34:58.115 INFO:tasks.workunit.client.0.smithi112.stdout:4/152: dwrite d1/d4/f26 [0,4194304] 0 2024-09-19T09:34:58.115 INFO:tasks.workunit.client.1.smithi191.stdout:9/163: rename d3/db/d16/d17/d1c/d35 to d3/db/d16/d38 0 2024-09-19T09:34:58.115 INFO:tasks.workunit.client.1.smithi191.stdout:9/164: readlink d3/db/l23 0 2024-09-19T09:34:58.116 INFO:tasks.workunit.client.1.smithi191.stdout:6/131: symlink d2/de/l2e 0 2024-09-19T09:34:58.120 INFO:tasks.workunit.client.1.smithi191.stdout:2/164: unlink d8/d11/d17/l2d 0 2024-09-19T09:34:58.120 INFO:tasks.workunit.client.1.smithi191.stdout:2/165: readlink d8/la 0 2024-09-19T09:34:58.120 INFO:tasks.workunit.client.1.smithi191.stdout:8/260: mknod d1/d4f/c56 0 2024-09-19T09:34:58.120 INFO:tasks.workunit.client.1.smithi191.stdout:8/261: stat d1/d22/d47 0 2024-09-19T09:34:58.124 INFO:tasks.workunit.client.1.smithi191.stdout:5/211: creat d0/d4/d4a/f4b x:0 0 0 2024-09-19T09:34:58.128 INFO:tasks.workunit.client.1.smithi191.stdout:1/161: dwrite f0 [4194304,4194304] 0 2024-09-19T09:34:58.130 INFO:tasks.workunit.client.0.smithi112.stdout:4/153: creat d1/d4/d3a/d18/d37/f3c x:0 0 0 2024-09-19T09:34:58.132 INFO:tasks.workunit.client.1.smithi191.stdout:3/140: unlink d12/d13/d1a/d1b/f35 0 2024-09-19T09:34:58.132 INFO:tasks.workunit.client.1.smithi191.stdout:3/141: truncate d12/d13/d1a/d28/f34 713292 0 2024-09-19T09:34:58.132 INFO:tasks.workunit.client.1.smithi191.stdout:3/142: readlink l6 0 2024-09-19T09:34:58.132 INFO:tasks.workunit.client.1.smithi191.stdout:3/143: write f11 [307388,38672] 0 2024-09-19T09:34:58.133 INFO:tasks.workunit.client.0.smithi112.stdout:4/154: stat d1/d4/f25 0 2024-09-19T09:34:58.139 INFO:tasks.workunit.client.1.smithi191.stdout:9/165: mknod d3/d8/c39 0 2024-09-19T09:34:58.141 INFO:tasks.workunit.client.1.smithi191.stdout:2/166: rename d8/db/l2e to d8/db/d13/d23/l33 0 2024-09-19T09:34:58.142 INFO:tasks.workunit.client.1.smithi191.stdout:9/166: rename d3 to d3/db/d16/d3a 22 2024-09-19T09:34:58.142 INFO:tasks.workunit.client.1.smithi191.stdout:2/167: dread - d8/d2a/f32 zero size 2024-09-19T09:34:58.143 INFO:tasks.workunit.client.1.smithi191.stdout:8/262: mkdir d1/d16/d2e/d57 0 2024-09-19T09:34:58.143 INFO:tasks.workunit.client.1.smithi191.stdout:8/263: chown d1/d7/f24 1600183 1 2024-09-19T09:34:58.145 INFO:tasks.workunit.client.1.smithi191.stdout:1/162: creat d3/d9/da/f3b x:0 0 0 2024-09-19T09:34:58.146 INFO:tasks.workunit.client.1.smithi191.stdout:9/167: unlink d3/db/d16/d17/f32 0 2024-09-19T09:34:58.146 INFO:tasks.workunit.client.1.smithi191.stdout:7/111: dwrite d2/f18 [0,4194304] 0 2024-09-19T09:34:58.147 INFO:tasks.workunit.client.1.smithi191.stdout:8/264: rmdir d1/d16/d3c 39 2024-09-19T09:34:58.147 INFO:tasks.workunit.client.1.smithi191.stdout:8/265: creat d1/d22/f58 x:0 0 0 2024-09-19T09:34:58.148 INFO:tasks.workunit.client.1.smithi191.stdout:1/163: unlink d3/d9/da/f23 0 2024-09-19T09:34:58.149 INFO:tasks.workunit.client.1.smithi191.stdout:6/132: dwrite d2/de/d15/f26 [0,4194304] 0 2024-09-19T09:34:58.151 INFO:tasks.workunit.client.1.smithi191.stdout:9/168: rename d3/db/d16/d17/d1c/f27 to d3/d8/f3b 0 2024-09-19T09:34:58.152 INFO:tasks.workunit.client.1.smithi191.stdout:5/212: dwrite d0/d4/d9/f1e [4194304,4194304] 0 2024-09-19T09:34:58.152 INFO:tasks.workunit.client.1.smithi191.stdout:7/112: mknod d2/c29 0 2024-09-19T09:34:58.153 INFO:tasks.workunit.client.1.smithi191.stdout:3/144: dread f11 [0,4194304] 0 2024-09-19T09:34:58.154 INFO:tasks.workunit.client.1.smithi191.stdout:8/266: unlink d1/d16/c44 0 2024-09-19T09:34:58.158 INFO:tasks.workunit.client.0.smithi112.stdout:4/155: dwrite d1/f17 [0,4194304] 0 2024-09-19T09:34:58.160 INFO:tasks.workunit.client.0.smithi112.stdout:4/156: unlink d1/d4/d3a/f2a 0 2024-09-19T09:34:58.162 INFO:tasks.workunit.client.1.smithi191.stdout:3/145: read ff [3950061,37719] 0 2024-09-19T09:34:58.163 INFO:tasks.workunit.client.1.smithi191.stdout:6/133: unlink d2/de/d15/c17 0 2024-09-19T09:34:58.163 INFO:tasks.workunit.client.1.smithi191.stdout:9/169: mkdir d3/db/d16/d17/d3c 0 2024-09-19T09:34:58.164 INFO:tasks.workunit.client.1.smithi191.stdout:5/213: mknod d0/d4/d9/de/c4c 0 2024-09-19T09:34:58.167 INFO:tasks.workunit.client.1.smithi191.stdout:8/267: symlink d1/d16/d23/l59 0 2024-09-19T09:34:58.167 INFO:tasks.workunit.client.1.smithi191.stdout:3/146: mkdir d12/d37 0 2024-09-19T09:34:58.167 INFO:tasks.workunit.client.1.smithi191.stdout:6/134: mknod d2/de/d19/c2f 0 2024-09-19T09:34:58.169 INFO:tasks.workunit.client.1.smithi191.stdout:8/268: creat d1/d22/d47/f5a x:0 0 0 2024-09-19T09:34:58.170 INFO:tasks.workunit.client.1.smithi191.stdout:6/135: mkdir d2/de/d2a/d2d/d30 0 2024-09-19T09:34:58.172 INFO:tasks.workunit.client.1.smithi191.stdout:8/269: creat d1/d7/d1a/f5b x:0 0 0 2024-09-19T09:34:58.173 INFO:tasks.workunit.client.1.smithi191.stdout:6/136: symlink d2/de/d2a/l31 0 2024-09-19T09:34:58.174 INFO:tasks.workunit.client.1.smithi191.stdout:6/137: rename d2/de/c25 to d2/de/d19/d1e/c32 0 2024-09-19T09:34:58.176 INFO:tasks.workunit.client.1.smithi191.stdout:2/168: dwrite d8/d11/f2b [0,4194304] 0 2024-09-19T09:34:58.176 INFO:tasks.workunit.client.1.smithi191.stdout:2/169: creat d8/d11/d17/f34 x:0 0 0 2024-09-19T09:34:58.177 INFO:tasks.workunit.client.1.smithi191.stdout:6/138: mknod d2/de/d19/d24/c33 0 2024-09-19T09:34:58.179 INFO:tasks.workunit.client.1.smithi191.stdout:2/170: mkdir d8/db/d13/d35 0 2024-09-19T09:34:58.180 INFO:tasks.workunit.client.1.smithi191.stdout:1/164: dwrite d3/d9/fe [0,4194304] 0 2024-09-19T09:34:58.180 INFO:tasks.workunit.client.1.smithi191.stdout:1/165: creat d3/d9/da/f3c x:0 0 0 2024-09-19T09:34:58.181 INFO:tasks.workunit.client.1.smithi191.stdout:1/166: read - d3/d9/da/f20 zero size 2024-09-19T09:34:58.181 INFO:tasks.workunit.client.0.smithi112.stdout:4/157: write d1/f29 [1623181,62740] 0 2024-09-19T09:34:58.181 INFO:tasks.workunit.client.1.smithi191.stdout:2/171: creat d8/db/d13/d35/f36 x:0 0 0 2024-09-19T09:34:58.183 INFO:tasks.workunit.client.0.smithi112.stdout:4/158: mkdir d1/d3d 0 2024-09-19T09:34:58.183 INFO:tasks.workunit.client.0.smithi112.stdout:4/159: read d1/f1d [116106,33532] 0 2024-09-19T09:34:58.184 INFO:tasks.workunit.client.0.smithi112.stdout:4/160: write d1/f2c [388790,33554] 0 2024-09-19T09:34:58.184 INFO:tasks.workunit.client.1.smithi191.stdout:1/167: symlink d3/d9/da/db/l3d 0 2024-09-19T09:34:58.185 INFO:tasks.workunit.client.1.smithi191.stdout:3/147: write f9 [1341635,104246] 0 2024-09-19T09:34:58.185 INFO:tasks.workunit.client.1.smithi191.stdout:3/148: write f9 [1903005,29215] 0 2024-09-19T09:34:58.185 INFO:tasks.workunit.client.1.smithi191.stdout:3/149: truncate d12/d13/d1a/f32 171244 0 2024-09-19T09:34:58.186 INFO:tasks.workunit.client.0.smithi112.stdout:4/161: truncate d1/d4/f7 2373338 0 2024-09-19T09:34:58.188 INFO:tasks.workunit.client.1.smithi191.stdout:3/150: mkdir d12/d38 0 2024-09-19T09:34:58.188 INFO:tasks.workunit.client.1.smithi191.stdout:3/151: stat d12/d13/d1a/d28 0 2024-09-19T09:34:58.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:58.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:58.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: Adjusting osd_memory_target on smithi191 to 2581M 2024-09-19T09:34:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-19T09:34:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-19T09:34:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:34:58.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:34:58.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:34:58.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: pgmap v11: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.4 MiB/s rd, 15 MiB/s wr, 295 op/s 2024-09-19T09:34:58.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:57 smithi112 ceph-mon[27605]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:34:58.190 INFO:tasks.workunit.client.1.smithi191.stdout:6/139: dread d2/de/f1d [0,4194304] 0 2024-09-19T09:34:58.191 INFO:tasks.workunit.client.1.smithi191.stdout:6/140: fdatasync d2/de/d19/d24/f2c 0 2024-09-19T09:34:58.191 INFO:tasks.workunit.client.1.smithi191.stdout:3/152: rmdir d12/d38 0 2024-09-19T09:34:58.191 INFO:tasks.workunit.client.1.smithi191.stdout:3/153: fsync d12/f25 0 2024-09-19T09:34:58.191 INFO:tasks.workunit.client.1.smithi191.stdout:3/154: chown d12/d37 192 1 2024-09-19T09:34:58.191 INFO:tasks.workunit.client.0.smithi112.stdout:4/162: link d1/d4/d1a/c2b d1/d3d/c3e 0 2024-09-19T09:34:58.195 INFO:tasks.workunit.client.1.smithi191.stdout:6/141: unlink d2/c3 0 2024-09-19T09:34:58.197 INFO:tasks.workunit.client.1.smithi191.stdout:6/142: creat d2/f34 x:0 0 0 2024-09-19T09:34:58.200 INFO:tasks.workunit.client.1.smithi191.stdout:7/113: rmdir d2 39 2024-09-19T09:34:58.208 INFO:tasks.workunit.client.1.smithi191.stdout:6/143: write d2/de/f22 [3298767,79353] 0 2024-09-19T09:34:58.209 INFO:tasks.workunit.client.1.smithi191.stdout:4/245: sync 2024-09-19T09:34:58.210 INFO:tasks.workunit.client.1.smithi191.stdout:6/144: mknod d2/de/d19/c35 0 2024-09-19T09:34:58.210 INFO:tasks.workunit.client.1.smithi191.stdout:6/145: creat d2/de/d15/f36 x:0 0 0 2024-09-19T09:34:58.211 INFO:tasks.workunit.client.1.smithi191.stdout:7/114: read d2/f21 [66469,99010] 0 2024-09-19T09:34:58.213 INFO:tasks.workunit.client.1.smithi191.stdout:6/146: link d2/lb d2/de/d2a/l37 0 2024-09-19T09:34:58.214 INFO:tasks.workunit.client.1.smithi191.stdout:7/115: mkdir d2/d2a 0 2024-09-19T09:34:58.214 INFO:tasks.workunit.client.1.smithi191.stdout:5/214: dwrite d0/d4/d9/f1e [4194304,4194304] 0 2024-09-19T09:34:58.215 INFO:tasks.workunit.client.1.smithi191.stdout:6/147: dread d2/de/f27 [0,4194304] 0 2024-09-19T09:34:58.215 INFO:tasks.workunit.client.1.smithi191.stdout:9/170: dwrite d3/db/d16/d17/d1c/f36 [4194304,4194304] 0 2024-09-19T09:34:58.215 INFO:tasks.workunit.client.1.smithi191.stdout:9/171: stat d3/db/d16/f1b 0 2024-09-19T09:34:58.215 INFO:tasks.workunit.client.1.smithi191.stdout:9/172: write d3/d8/f22 [684468,61356] 0 2024-09-19T09:34:58.218 INFO:tasks.workunit.client.1.smithi191.stdout:7/116: rename d2/c27 to d2/c2b 0 2024-09-19T09:34:58.218 INFO:tasks.workunit.client.1.smithi191.stdout:6/148: write d2/de/f1d [1613908,50892] 0 2024-09-19T09:34:58.220 INFO:tasks.workunit.client.1.smithi191.stdout:3/155: dwrite d12/d13/f14 [0,4194304] 0 2024-09-19T09:34:58.222 INFO:tasks.workunit.client.1.smithi191.stdout:8/270: dwrite d1/d22/f3b [0,4194304] 0 2024-09-19T09:34:58.222 INFO:tasks.workunit.client.1.smithi191.stdout:1/168: dwrite d3/d9/da/dc/f2e [0,4194304] 0 2024-09-19T09:34:58.223 INFO:tasks.workunit.client.1.smithi191.stdout:9/173: creat d3/db/d16/d38/f3d x:0 0 0 2024-09-19T09:34:58.231 INFO:tasks.workunit.client.1.smithi191.stdout:9/174: write d3/db/f31 [12133,6930] 0 2024-09-19T09:34:58.237 INFO:tasks.workunit.client.1.smithi191.stdout:1/169: creat d3/d9/da/d1e/d32/f3e x:0 0 0 2024-09-19T09:34:58.240 INFO:tasks.workunit.client.1.smithi191.stdout:8/271: write d1/d16/d3c/d28/f33 [3635219,48136] 0 2024-09-19T09:34:58.240 INFO:tasks.workunit.client.1.smithi191.stdout:4/246: dwrite d5/fe [0,4194304] 0 2024-09-19T09:34:58.243 INFO:tasks.workunit.client.1.smithi191.stdout:4/247: mknod d5/d1b/d1c/d2f/d37/c5e 0 2024-09-19T09:34:58.243 INFO:tasks.workunit.client.1.smithi191.stdout:4/248: stat d5/f35 0 2024-09-19T09:34:58.244 INFO:tasks.workunit.client.1.smithi191.stdout:8/272: dread d1/d16/d3c/d17/f1e [0,4194304] 0 2024-09-19T09:34:58.252 INFO:tasks.workunit.client.1.smithi191.stdout:1/170: write d3/d9/fe [1744874,86112] 0 2024-09-19T09:34:58.252 INFO:tasks.workunit.client.1.smithi191.stdout:1/171: readlink d3/d9/da/l12 0 2024-09-19T09:34:58.257 INFO:tasks.workunit.client.1.smithi191.stdout:5/215: dwrite d0/d1f/f43 [0,4194304] 0 2024-09-19T09:34:58.257 INFO:tasks.workunit.client.1.smithi191.stdout:5/216: chown d0/d4/f37 28 1 2024-09-19T09:34:58.257 INFO:tasks.workunit.client.1.smithi191.stdout:4/249: dread d5/fe [0,4194304] 0 2024-09-19T09:34:58.259 INFO:tasks.workunit.client.1.smithi191.stdout:8/273: dread d1/f14 [0,4194304] 0 2024-09-19T09:34:58.259 INFO:tasks.workunit.client.1.smithi191.stdout:8/274: readlink d1/l42 0 2024-09-19T09:34:58.259 INFO:tasks.workunit.client.1.smithi191.stdout:8/275: chown d1/d16/f46 46092918 1 2024-09-19T09:34:58.261 INFO:tasks.workunit.client.1.smithi191.stdout:7/117: dwrite d2/f24 [0,4194304] 0 2024-09-19T09:34:58.262 INFO:tasks.workunit.client.1.smithi191.stdout:4/250: symlink d5/d1b/d1c/d24/d32/l5f 0 2024-09-19T09:34:58.262 INFO:tasks.workunit.client.1.smithi191.stdout:4/251: truncate d5/d1b/d1c/d2f/f47 458324 0 2024-09-19T09:34:58.264 INFO:tasks.workunit.client.1.smithi191.stdout:6/149: dwrite d2/f34 [0,4194304] 0 2024-09-19T09:34:58.264 INFO:tasks.workunit.client.1.smithi191.stdout:6/150: fsync d2/de/d19/d1e/f21 0 2024-09-19T09:34:58.264 INFO:tasks.workunit.client.1.smithi191.stdout:6/151: readlink d2/de/d19/l1f 0 2024-09-19T09:34:58.264 INFO:tasks.workunit.client.1.smithi191.stdout:6/152: chown d2/l11 3713 1 2024-09-19T09:34:58.265 INFO:tasks.workunit.client.1.smithi191.stdout:9/175: dwrite d3/db/d16/f1f [0,4194304] 0 2024-09-19T09:34:58.267 INFO:tasks.workunit.client.1.smithi191.stdout:7/118: link d2/c4 d2/d2a/c2c 0 2024-09-19T09:34:58.271 INFO:tasks.workunit.client.1.smithi191.stdout:6/153: mknod d2/de/d19/d1e/c38 0 2024-09-19T09:34:58.277 INFO:tasks.workunit.client.1.smithi191.stdout:7/119: creat d2/d2a/f2d x:0 0 0 2024-09-19T09:34:58.279 INFO:tasks.workunit.client.1.smithi191.stdout:7/120: mknod d2/c2e 0 2024-09-19T09:34:58.279 INFO:tasks.workunit.client.1.smithi191.stdout:7/121: creat d2/d2a/f2f x:0 0 0 2024-09-19T09:34:58.281 INFO:tasks.workunit.client.1.smithi191.stdout:1/172: dwrite d3/d9/da/dc/f2e [0,4194304] 0 2024-09-19T09:34:58.282 INFO:tasks.workunit.client.1.smithi191.stdout:7/122: symlink d2/d2a/l30 0 2024-09-19T09:34:58.284 INFO:tasks.workunit.client.1.smithi191.stdout:1/173: creat d3/f3f x:0 0 0 2024-09-19T09:34:58.284 INFO:tasks.workunit.client.1.smithi191.stdout:1/174: chown d3/d9/da 14933 1 2024-09-19T09:34:58.285 INFO:tasks.workunit.client.1.smithi191.stdout:1/175: chown d3/d9/f24 12206457 1 2024-09-19T09:34:58.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:58.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:58.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:58.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:58.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:58.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:58.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:58.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:58.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: Adjusting osd_memory_target on smithi191 to 2581M 2024-09-19T09:34:58.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:58.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:58.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:58.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-19T09:34:58.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-19T09:34:58.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:34:58.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:34:58.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:34:58.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: pgmap v11: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.4 MiB/s rd, 15 MiB/s wr, 295 op/s 2024-09-19T09:34:58.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:58 smithi191 ceph-mon[34834]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:34:58.287 INFO:tasks.workunit.client.1.smithi191.stdout:6/154: dread d2/de/f22 [0,4194304] 0 2024-09-19T09:34:58.287 INFO:tasks.workunit.client.1.smithi191.stdout:6/155: chown d2/de/d15/l2b 467653 1 2024-09-19T09:34:58.287 INFO:tasks.workunit.client.1.smithi191.stdout:6/156: write d2/de/d2a/d2d/f1b [2897364,125863] 0 2024-09-19T09:34:58.287 INFO:tasks.workunit.client.1.smithi191.stdout:1/176: unlink d3/d9/f39 0 2024-09-19T09:34:58.287 INFO:tasks.workunit.client.1.smithi191.stdout:0/264: sync 2024-09-19T09:34:58.287 INFO:tasks.workunit.client.1.smithi191.stdout:0/265: chown d0/f4 1239257 1 2024-09-19T09:34:58.288 INFO:tasks.workunit.client.1.smithi191.stdout:1/177: write d3/d9/da/f3c [618647,22620] 0 2024-09-19T09:34:58.288 INFO:tasks.workunit.client.1.smithi191.stdout:6/157: mkdir d2/de/d2a/d39 0 2024-09-19T09:34:58.289 INFO:tasks.workunit.client.1.smithi191.stdout:8/276: dwrite d1/d7/f53 [0,4194304] 0 2024-09-19T09:34:58.290 INFO:tasks.workunit.client.1.smithi191.stdout:1/178: mkdir d3/d9/da/d1e/d25/d40 0 2024-09-19T09:34:58.290 INFO:tasks.workunit.client.1.smithi191.stdout:5/217: dwrite d0/d4/d9/d1d/d22/d3b/f3c [0,4194304] 0 2024-09-19T09:34:58.290 INFO:tasks.workunit.client.1.smithi191.stdout:5/218: stat d0/d4/d9/d1d/d22/d3b 0 2024-09-19T09:34:58.290 INFO:tasks.workunit.client.1.smithi191.stdout:0/266: mkdir d0/d9/d1c/d1f/d24/d29/d30/d56 0 2024-09-19T09:34:58.291 INFO:tasks.workunit.client.1.smithi191.stdout:6/158: symlink d2/de/d2a/d39/l3a 0 2024-09-19T09:34:58.294 INFO:tasks.workunit.client.1.smithi191.stdout:8/277: dread d1/f15 [0,4194304] 0 2024-09-19T09:34:58.296 INFO:tasks.workunit.client.1.smithi191.stdout:1/179: getdents d3/d9/da/db 0 2024-09-19T09:34:58.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.295+0000 7fa015732640 1 -- 172.21.15.112:0/1970216591 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa010110f50 con 0x7f9ff806e6e0 2024-09-19T09:34:58.298 INFO:tasks.workunit.client.1.smithi191.stdout:5/219: link d0/d4/d9/d1d/d29/c41 d0/d4/d9/de/c4d 0 2024-09-19T09:34:58.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.298+0000 7f9ff77fe640 1 -- 172.21.15.112:0/1970216591 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fa010110f50 con 0x7f9ff806e6e0 2024-09-19T09:34:58.300 INFO:tasks.workunit.client.1.smithi191.stdout:5/220: mknod d0/d4/d9/d1d/d29/d33/d45/c4e 0 2024-09-19T09:34:58.300 INFO:tasks.workunit.client.1.smithi191.stdout:5/221: chown d0/d4/d9/d1d/d29/d33/d45/l49 18788021 1 2024-09-19T09:34:58.300 INFO:tasks.workunit.client.1.smithi191.stdout:5/222: truncate d0/d4/d9/de/f36 1057269 0 2024-09-19T09:34:58.301 INFO:tasks.workunit.client.1.smithi191.stdout:0/267: link d0/d9/de/c15 d0/d9/d1c/c57 0 2024-09-19T09:34:58.302 INFO:tasks.workunit.client.1.smithi191.stdout:5/223: mknod d0/d4/d9/d1d/d22/d3b/c4f 0 2024-09-19T09:34:58.302 INFO:tasks.workunit.client.1.smithi191.stdout:5/224: creat d0/d4/d9/d1d/f50 x:0 0 0 2024-09-19T09:34:58.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.302+0000 7fa015732640 1 -- 172.21.15.112:0/1970216591 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f9ff806e6e0 msgr2=0x7f9ff8070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:58.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.302+0000 7fa015732640 1 --2- 172.21.15.112:0/1970216591 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f9ff806e6e0 0x7f9ff8070b90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa01010f020 tx=0x7fa004035040 comp rx=0 tx=0).stop 2024-09-19T09:34:58.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.302+0000 7fa015732640 1 -- 172.21.15.112:0/1970216591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0100fc570 msgr2=0x7fa01010f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:58.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.302+0000 7fa015732640 1 --2- 172.21.15.112:0/1970216591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0100fc570 0x7fa01010f270 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa00000e940 tx=0x7fa00000b040 comp rx=0 tx=0).stop 2024-09-19T09:34:58.305 INFO:tasks.workunit.client.1.smithi191.stdout:0/268: unlink d0/d9/d1c/d20/f48 0 2024-09-19T09:34:58.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.302+0000 7fa015732640 1 -- 172.21.15.112:0/1970216591 shutdown_connections 2024-09-19T09:34:58.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.302+0000 7fa015732640 1 --2- 172.21.15.112:0/1970216591 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f9ff806e6e0 0x7f9ff8070b90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.302+0000 7fa015732640 1 --2- 172.21.15.112:0/1970216591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0100fd840 0x7fa01010f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.302+0000 7fa015732640 1 --2- 172.21.15.112:0/1970216591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0100fc570 0x7fa01010f270 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.302+0000 7fa015732640 1 -- 172.21.15.112:0/1970216591 >> 172.21.15.112:0/1970216591 conn(0x7fa0100f7d30 msgr2=0x7fa0100f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:58.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.302+0000 7fa015732640 1 -- 172.21.15.112:0/1970216591 shutdown_connections 2024-09-19T09:34:58.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.302+0000 7fa015732640 1 -- 172.21.15.112:0/1970216591 wait complete. 2024-09-19T09:34:58.306 INFO:tasks.workunit.client.1.smithi191.stdout:5/225: link d0/d1f/c3f d0/d4/d9/d1d/d22/c51 0 2024-09-19T09:34:58.307 INFO:tasks.workunit.client.1.smithi191.stdout:4/252: dwrite d5/d1b/d1c/d24/d32/d21/d4a/f51 [0,4194304] 0 2024-09-19T09:34:58.307 INFO:tasks.workunit.client.1.smithi191.stdout:6/159: dread d2/de/d19/d1e/f21 [0,4194304] 0 2024-09-19T09:34:58.308 INFO:tasks.workunit.client.1.smithi191.stdout:5/226: mkdir d0/d4/d9/d1d/d29/d33/d52 0 2024-09-19T09:34:58.308 INFO:tasks.workunit.client.1.smithi191.stdout:7/123: dwrite d2/f21 [0,4194304] 0 2024-09-19T09:34:58.310 INFO:tasks.workunit.client.1.smithi191.stdout:6/160: mknod d2/de/d2a/d2d/d30/c3b 0 2024-09-19T09:34:58.312 INFO:tasks.workunit.client.1.smithi191.stdout:0/269: rename d0/d9/d13 to d0/d9/d1c/d1f/d24/d39/d58 0 2024-09-19T09:34:58.312 INFO:tasks.workunit.client.1.smithi191.stdout:0/270: readlink d0/d9/d1c/d1f/d24/l2d 0 2024-09-19T09:34:58.312 INFO:tasks.workunit.client.1.smithi191.stdout:0/271: chown d0/d9/d1c/d20 33 1 2024-09-19T09:34:58.312 INFO:tasks.workunit.client.1.smithi191.stdout:5/227: mkdir d0/d4/d9/d1d/d28/d53 0 2024-09-19T09:34:58.313 INFO:tasks.workunit.client.1.smithi191.stdout:0/272: symlink d0/d9/d1c/d1f/d24/d39/l59 0 2024-09-19T09:34:58.313 INFO:tasks.workunit.client.1.smithi191.stdout:0/273: write d0/f50 [113559,99676] 0 2024-09-19T09:34:58.315 INFO:tasks.workunit.client.1.smithi191.stdout:7/124: read d2/f1d [1370395,81409] 0 2024-09-19T09:34:58.315 INFO:tasks.workunit.client.1.smithi191.stdout:7/125: stat d2/f23 0 2024-09-19T09:34:58.315 INFO:tasks.workunit.client.1.smithi191.stdout:7/126: creat d2/d2a/f31 x:0 0 0 2024-09-19T09:34:58.317 INFO:tasks.workunit.client.1.smithi191.stdout:7/127: symlink d2/d2a/l32 0 2024-09-19T09:34:58.319 INFO:tasks.workunit.client.1.smithi191.stdout:9/176: dwrite d3/db/d16/f29 [0,4194304] 0 2024-09-19T09:34:58.319 INFO:tasks.workunit.client.1.smithi191.stdout:7/128: mkdir d2/d2a/d33 0 2024-09-19T09:34:58.325 INFO:tasks.workunit.client.1.smithi191.stdout:6/161: dread d2/de/d19/d1e/f21 [0,4194304] 0 2024-09-19T09:34:58.325 INFO:tasks.workunit.client.1.smithi191.stdout:6/162: write d2/de/f16 [1713613,123113] 0 2024-09-19T09:34:58.326 INFO:tasks.workunit.client.1.smithi191.stdout:8/278: dwrite d1/d16/d23/d3e/f4b [0,4194304] 0 2024-09-19T09:34:58.331 INFO:tasks.workunit.client.1.smithi191.stdout:1/180: dwrite d3/d9/da/f20 [0,4194304] 0 2024-09-19T09:34:58.331 INFO:tasks.workunit.client.1.smithi191.stdout:5/228: dread d0/d4/d9/d1d/d28/f31 [4194304,4194304] 0 2024-09-19T09:34:58.331 INFO:tasks.workunit.client.1.smithi191.stdout:5/229: read - d0/d4/d9/d1d/d22/f2c zero size 2024-09-19T09:34:58.331 INFO:tasks.workunit.client.1.smithi191.stdout:5/230: dread - d0/d4/d9/d1d/f48 zero size 2024-09-19T09:34:58.332 INFO:tasks.workunit.client.1.smithi191.stdout:6/163: dread d2/de/d19/d1e/f21 [0,4194304] 0 2024-09-19T09:34:58.337 INFO:tasks.workunit.client.1.smithi191.stdout:5/231: link d0/d4/d9/d1d/d29/c41 d0/d4/d9/d1d/d29/c54 0 2024-09-19T09:34:58.338 INFO:tasks.workunit.client.1.smithi191.stdout:5/232: dread - d0/d4/d4a/f4b zero size 2024-09-19T09:34:58.338 INFO:tasks.workunit.client.1.smithi191.stdout:6/164: rmdir d2/de/d2a/d2d 39 2024-09-19T09:34:58.339 INFO:tasks.workunit.client.1.smithi191.stdout:6/165: truncate d2/de/d19/d24/f29 950760 0 2024-09-19T09:34:58.339 INFO:tasks.workunit.client.1.smithi191.stdout:7/129: write d2/f21 [3005585,101621] 0 2024-09-19T09:34:58.346 INFO:tasks.workunit.client.1.smithi191.stdout:1/181: getdents d3/d9/da 0 2024-09-19T09:34:58.347 INFO:tasks.workunit.client.1.smithi191.stdout:5/233: creat d0/d4/d9/d1d/d28/f55 x:0 0 0 2024-09-19T09:34:58.347 INFO:tasks.workunit.client.1.smithi191.stdout:5/234: fdatasync d0/f20 0 2024-09-19T09:34:58.347 INFO:tasks.workunit.client.1.smithi191.stdout:5/235: creat d0/d1f/f56 x:0 0 0 2024-09-19T09:34:58.348 INFO:tasks.workunit.client.1.smithi191.stdout:6/166: unlink d2/f6 0 2024-09-19T09:34:58.350 INFO:tasks.workunit.client.1.smithi191.stdout:7/130: creat d2/f34 x:0 0 0 2024-09-19T09:34:58.350 INFO:tasks.workunit.client.1.smithi191.stdout:7/131: chown d2/f24 981447 1 2024-09-19T09:34:58.350 INFO:tasks.workunit.client.1.smithi191.stdout:7/132: stat d2/fd 0 2024-09-19T09:34:58.350 INFO:tasks.workunit.client.1.smithi191.stdout:7/133: chown d2/f23 98 1 2024-09-19T09:34:58.350 INFO:tasks.workunit.client.1.smithi191.stdout:0/274: dwrite d0/d9/d1c/d1f/d24/f3f [0,4194304] 0 2024-09-19T09:34:58.350 INFO:tasks.workunit.client.1.smithi191.stdout:1/182: rename d3/d9/da/c21 to d3/d9/c41 0 2024-09-19T09:34:58.351 INFO:tasks.workunit.client.1.smithi191.stdout:4/253: dwrite d5/fa [0,4194304] 0 2024-09-19T09:34:58.351 INFO:tasks.workunit.client.1.smithi191.stdout:8/279: dwrite d1/d7/f53 [0,4194304] 0 2024-09-19T09:34:58.351 INFO:tasks.workunit.client.1.smithi191.stdout:9/177: dwrite d3/db/f11 [0,4194304] 0 2024-09-19T09:34:58.352 INFO:tasks.workunit.client.1.smithi191.stdout:7/134: link d2/c26 d2/c35 0 2024-09-19T09:34:58.354 INFO:tasks.workunit.client.1.smithi191.stdout:1/183: mkdir d3/d9/da/d42 0 2024-09-19T09:34:58.354 INFO:tasks.workunit.client.1.smithi191.stdout:7/135: dread d2/f1f [0,4194304] 0 2024-09-19T09:34:58.355 INFO:tasks.workunit.client.1.smithi191.stdout:5/236: rename d0/d4/d9/de/c4c to d0/d4/d9/d1d/d29/d33/d52/c57 0 2024-09-19T09:34:58.357 INFO:tasks.workunit.client.1.smithi191.stdout:4/254: symlink d5/d1b/d1c/d2f/d37/l60 0 2024-09-19T09:34:58.360 INFO:tasks.workunit.client.1.smithi191.stdout:1/184: unlink d3/d9/da/dc/f2e 0 2024-09-19T09:34:58.361 INFO:tasks.workunit.client.1.smithi191.stdout:7/136: mknod d2/d2a/c36 0 2024-09-19T09:34:58.361 INFO:tasks.workunit.client.1.smithi191.stdout:7/137: fdatasync d2/f17 0 2024-09-19T09:34:58.361 INFO:tasks.workunit.client.1.smithi191.stdout:7/138: fsync d2/f18 0 2024-09-19T09:34:58.361 INFO:tasks.workunit.client.1.smithi191.stdout:7/139: write d2/f1d [364695,44071] 0 2024-09-19T09:34:58.362 INFO:tasks.workunit.client.1.smithi191.stdout:7/140: read - d2/f34 zero size 2024-09-19T09:34:58.362 INFO:tasks.workunit.client.1.smithi191.stdout:9/178: dread d3/db/f11 [0,4194304] 0 2024-09-19T09:34:58.363 INFO:tasks.workunit.client.1.smithi191.stdout:6/167: rename d2/de/c13 to d2/de/d19/d1e/c3c 0 2024-09-19T09:34:58.364 INFO:tasks.workunit.client.1.smithi191.stdout:6/168: read - d2/de/d19/d24/f2c zero size 2024-09-19T09:34:58.364 INFO:tasks.workunit.client.1.smithi191.stdout:5/237: truncate d0/d4/d9/d1d/f46 486472 0 2024-09-19T09:34:58.365 INFO:tasks.workunit.client.1.smithi191.stdout:4/255: truncate d5/d1b/d1c/d24/d32/d21/d27/f3c 1104507 0 2024-09-19T09:34:58.367 INFO:tasks.workunit.client.1.smithi191.stdout:8/280: rmdir d1/d16 39 2024-09-19T09:34:58.368 INFO:tasks.workunit.client.1.smithi191.stdout:8/281: dread d1/d16/d3c/f41 [0,4194304] 0 2024-09-19T09:34:58.369 INFO:tasks.workunit.client.1.smithi191.stdout:8/282: chown d1/d16/d3c/d17 563234209 1 2024-09-19T09:34:58.369 INFO:tasks.workunit.client.1.smithi191.stdout:1/185: creat d3/d9/da/f43 x:0 0 0 2024-09-19T09:34:58.370 INFO:tasks.workunit.client.1.smithi191.stdout:1/186: chown d3/d9/da/c10 91 1 2024-09-19T09:34:58.370 INFO:tasks.workunit.client.1.smithi191.stdout:7/141: rename d2/l20 to d2/l37 0 2024-09-19T09:34:58.371 INFO:tasks.workunit.client.1.smithi191.stdout:9/179: rmdir d3/db/d16/d38 39 2024-09-19T09:34:58.373 INFO:tasks.workunit.client.1.smithi191.stdout:6/169: mknod d2/de/d15/c3d 0 2024-09-19T09:34:58.373 INFO:tasks.workunit.client.1.smithi191.stdout:6/170: creat d2/de/d19/d1e/f3e x:0 0 0 2024-09-19T09:34:58.379 INFO:tasks.workunit.client.1.smithi191.stdout:4/256: mkdir d5/d1b/d61 0 2024-09-19T09:34:58.380 INFO:tasks.workunit.client.1.smithi191.stdout:1/187: creat d3/d9/da/d1e/f44 x:0 0 0 2024-09-19T09:34:58.383 INFO:tasks.workunit.client.1.smithi191.stdout:9/180: dread d3/db/fd [0,4194304] 0 2024-09-19T09:34:58.384 INFO:tasks.workunit.client.1.smithi191.stdout:1/188: dread d3/d9/da/db/f1b [4194304,4194304] 0 2024-09-19T09:34:58.385 INFO:tasks.workunit.client.1.smithi191.stdout:6/171: creat d2/de/d2a/d2d/d30/f3f x:0 0 0 2024-09-19T09:34:58.385 INFO:tasks.workunit.client.1.smithi191.stdout:0/275: write d0/d9/f1a [4671860,35406] 0 2024-09-19T09:34:58.385 INFO:tasks.workunit.client.1.smithi191.stdout:5/238: rmdir d0/d1f 39 2024-09-19T09:34:58.385 INFO:tasks.workunit.client.1.smithi191.stdout:0/276: fsync d0/d9/d1c/d1f/d24/d29/f49 0 2024-09-19T09:34:58.387 INFO:tasks.workunit.client.1.smithi191.stdout:4/257: creat d5/d1b/d1c/d2f/d37/f62 x:0 0 0 2024-09-19T09:34:58.388 INFO:tasks.workunit.client.1.smithi191.stdout:1/189: unlink c1 0 2024-09-19T09:34:58.389 INFO:tasks.workunit.client.1.smithi191.stdout:1/190: chown d3/d9/da/l2b 27585146 1 2024-09-19T09:34:58.389 INFO:tasks.workunit.client.1.smithi191.stdout:1/191: dread - d3/d9/da/db/f33 zero size 2024-09-19T09:34:58.389 INFO:tasks.workunit.client.1.smithi191.stdout:1/192: creat d3/d9/da/d1e/d32/f45 x:0 0 0 2024-09-19T09:34:58.390 INFO:tasks.workunit.client.1.smithi191.stdout:5/239: mknod d0/d4/d9/d1d/d29/c58 0 2024-09-19T09:34:58.391 INFO:tasks.workunit.client.1.smithi191.stdout:5/240: chown d0/d4/d4a/f4b 1 1 2024-09-19T09:34:58.393 INFO:tasks.workunit.client.1.smithi191.stdout:1/193: symlink d3/d9/l46 0 2024-09-19T09:34:58.396 INFO:tasks.workunit.client.1.smithi191.stdout:1/194: mknod d3/d9/c47 0 2024-09-19T09:34:58.396 INFO:tasks.workunit.client.1.smithi191.stdout:5/241: creat d0/d4/d9/f59 x:0 0 0 2024-09-19T09:34:58.396 INFO:tasks.workunit.client.1.smithi191.stdout:1/195: write d3/d9/da/f3c [1480638,104492] 0 2024-09-19T09:34:58.396 INFO:tasks.workunit.client.1.smithi191.stdout:7/142: dwrite d2/f7 [0,4194304] 0 2024-09-19T09:34:58.398 INFO:tasks.workunit.client.1.smithi191.stdout:5/242: getdents d0/d4/d9/d1d/d22/d3b 0 2024-09-19T09:34:58.398 INFO:tasks.workunit.client.1.smithi191.stdout:5/243: write d0/d1f/f56 [658646,115744] 0 2024-09-19T09:34:58.399 INFO:tasks.workunit.client.1.smithi191.stdout:0/277: dread d0/d9/d1c/d1f/d24/d39/d58/f52 [0,4194304] 0 2024-09-19T09:34:58.399 INFO:tasks.workunit.client.1.smithi191.stdout:0/278: dread - d0/d9/d1c/d1f/d24/d29/f3d zero size 2024-09-19T09:34:58.400 INFO:tasks.workunit.client.1.smithi191.stdout:1/196: rename d3/d9/da/d1e/d25/d40 to d3/d9/da/db/d48 0 2024-09-19T09:34:58.400 INFO:tasks.workunit.client.1.smithi191.stdout:1/197: write d3/d9/da/d1e/d25/f30 [213574,131002] 0 2024-09-19T09:34:58.400 INFO:tasks.workunit.client.1.smithi191.stdout:4/258: dread d5/f18 [0,4194304] 0 2024-09-19T09:34:58.400 INFO:tasks.workunit.client.1.smithi191.stdout:4/259: write d5/d1b/d1c/d24/d32/d21/d4a/f4d [5179032,108511] 0 2024-09-19T09:34:58.402 INFO:tasks.workunit.client.1.smithi191.stdout:8/283: dwrite d1/f15 [0,4194304] 0 2024-09-19T09:34:58.404 INFO:tasks.workunit.client.1.smithi191.stdout:0/279: symlink d0/d9/l5a 0 2024-09-19T09:34:58.404 INFO:tasks.workunit.client.1.smithi191.stdout:2/172: sync 2024-09-19T09:34:58.404 INFO:tasks.workunit.client.1.smithi191.stdout:2/173: chown d8/c24 1812990 1 2024-09-19T09:34:58.405 INFO:tasks.workunit.client.1.smithi191.stdout:2/174: write d8/d2a/f32 [963047,7941] 0 2024-09-19T09:34:58.406 INFO:tasks.workunit.client.1.smithi191.stdout:6/172: dwrite d2/de/d19/d1e/f3e [0,4194304] 0 2024-09-19T09:34:58.407 INFO:tasks.workunit.client.1.smithi191.stdout:6/173: read d2/de/d2a/d2d/f1b [3356080,65092] 0 2024-09-19T09:34:58.407 INFO:tasks.workunit.client.1.smithi191.stdout:6/174: write d2/f34 [4970191,41979] 0 2024-09-19T09:34:58.407 INFO:tasks.workunit.client.1.smithi191.stdout:6/175: fdatasync d2/de/d2a/d2d/d30/f3f 0 2024-09-19T09:34:58.407 INFO:tasks.workunit.client.1.smithi191.stdout:1/198: rename d3/d9/da/d1e/d32/f36 to d3/d9/da/db/f49 0 2024-09-19T09:34:58.414 INFO:tasks.workunit.client.1.smithi191.stdout:8/284: mknod d1/d16/d3c/d28/c5c 0 2024-09-19T09:34:58.415 INFO:tasks.workunit.client.1.smithi191.stdout:0/280: creat d0/d9/d1c/d1f/d24/d29/d30/f5b x:0 0 0 2024-09-19T09:34:58.418 INFO:tasks.workunit.client.1.smithi191.stdout:4/260: rename d5/d1b/d1c/d24/d32/d21/d27/f41 to d5/d1b/d1c/f63 0 2024-09-19T09:34:58.418 INFO:tasks.workunit.client.1.smithi191.stdout:4/261: write d5/d1b/d1c/d2f/d19/f20 [745412,56335] 0 2024-09-19T09:34:58.418 INFO:tasks.workunit.client.1.smithi191.stdout:4/262: write d5/d1b/d1c/d24/d32/f2d [399036,94425] 0 2024-09-19T09:34:58.419 INFO:tasks.workunit.client.1.smithi191.stdout:4/263: read - d5/d1b/d1c/f5a zero size 2024-09-19T09:34:58.419 INFO:tasks.workunit.client.1.smithi191.stdout:8/285: dread d1/d16/d3c/d17/f49 [0,4194304] 0 2024-09-19T09:34:58.419 INFO:tasks.workunit.client.1.smithi191.stdout:8/286: truncate d1/d7/d1a/f5b 990813 0 2024-09-19T09:34:58.419 INFO:tasks.workunit.client.1.smithi191.stdout:8/287: fsync d1/d16/d3c/f29 0 2024-09-19T09:34:58.419 INFO:tasks.workunit.client.1.smithi191.stdout:8/288: truncate d1/d16/d3c/d17/f49 1482570 0 2024-09-19T09:34:58.419 INFO:tasks.workunit.client.1.smithi191.stdout:8/289: creat d1/d7/d1a/f5d x:0 0 0 2024-09-19T09:34:58.419 INFO:tasks.workunit.client.1.smithi191.stdout:9/181: dwrite d3/db/d16/f1f [0,4194304] 0 2024-09-19T09:34:58.419 INFO:tasks.workunit.client.1.smithi191.stdout:2/175: dread d8/f1d [0,4194304] 0 2024-09-19T09:34:58.419 INFO:tasks.workunit.client.1.smithi191.stdout:9/182: readlink d3/d8/l26 0 2024-09-19T09:34:58.421 INFO:tasks.workunit.client.1.smithi191.stdout:6/176: rename d2/de/d2a/l37 to d2/de/d19/d1e/l40 0 2024-09-19T09:34:58.421 INFO:tasks.workunit.client.1.smithi191.stdout:6/177: chown d2/lc 10 1 2024-09-19T09:34:58.421 INFO:tasks.workunit.client.1.smithi191.stdout:6/178: read d2/de/f14 [362460,88649] 0 2024-09-19T09:34:58.421 INFO:tasks.workunit.client.1.smithi191.stdout:6/179: creat d2/de/d15/f41 x:0 0 0 2024-09-19T09:34:58.421 INFO:tasks.workunit.client.1.smithi191.stdout:0/281: symlink d0/d9/d54/l5c 0 2024-09-19T09:34:58.421 INFO:tasks.workunit.client.1.smithi191.stdout:0/282: fsync d0/d9/de/f55 0 2024-09-19T09:34:58.424 INFO:tasks.workunit.client.1.smithi191.stdout:5/244: dwrite d0/d4/f24 [0,4194304] 0 2024-09-19T09:34:58.425 INFO:tasks.workunit.client.1.smithi191.stdout:5/245: fdatasync d0/d4/d9/de/f18 0 2024-09-19T09:34:58.425 INFO:tasks.workunit.client.1.smithi191.stdout:1/199: dread d3/d9/da/db/f22 [0,4194304] 0 2024-09-19T09:34:58.426 INFO:tasks.workunit.client.1.smithi191.stdout:2/176: rename d8/d11/f2b to d8/db/d13/d35/f37 0 2024-09-19T09:34:58.429 INFO:tasks.workunit.client.1.smithi191.stdout:6/180: symlink d2/de/d2a/d2d/l42 0 2024-09-19T09:34:58.429 INFO:tasks.workunit.client.1.smithi191.stdout:6/181: write d2/de/f10 [424648,39025] 0 2024-09-19T09:34:58.429 INFO:tasks.workunit.client.1.smithi191.stdout:7/143: dwrite d2/d2a/f2f [0,4194304] 0 2024-09-19T09:34:58.430 INFO:tasks.workunit.client.1.smithi191.stdout:7/144: readlink d2/l10 0 2024-09-19T09:34:58.431 INFO:tasks.workunit.client.1.smithi191.stdout:0/283: mkdir d0/d9/d1c/d1f/d24/d29/d30/d56/d5d 0 2024-09-19T09:34:58.431 INFO:tasks.workunit.client.1.smithi191.stdout:0/284: fdatasync d0/d9/d1c/d1f/d24/d39/d58/f52 0 2024-09-19T09:34:58.434 INFO:tasks.workunit.client.1.smithi191.stdout:1/200: unlink d3/d9/da/l2b 0 2024-09-19T09:34:58.438 INFO:tasks.workunit.client.1.smithi191.stdout:5/246: rename d0/d4/f3a to d0/d4/d9/f5a 0 2024-09-19T09:34:58.444 INFO:tasks.workunit.client.1.smithi191.stdout:7/145: mkdir d2/d2a/d38 0 2024-09-19T09:34:58.444 INFO:tasks.workunit.client.1.smithi191.stdout:7/146: chown d2/c35 100503738 1 2024-09-19T09:34:58.445 INFO:tasks.workunit.client.1.smithi191.stdout:0/285: mknod d0/c5e 0 2024-09-19T09:34:58.445 INFO:tasks.workunit.client.1.smithi191.stdout:0/286: truncate d0/d9/de/f55 926710 0 2024-09-19T09:34:58.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.443+0000 7fac29436640 1 -- 172.21.15.112:0/1249129027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac240fc700 msgr2=0x7fac240fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:58.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.443+0000 7fac29436640 1 --2- 172.21.15.112:0/1249129027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac240fc700 0x7fac240fcb70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0048d0 tx=0x7fac0c009da0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.443+0000 7fac29436640 1 -- 172.21.15.112:0/1249129027 shutdown_connections 2024-09-19T09:34:58.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.443+0000 7fac29436640 1 --2- 172.21.15.112:0/1249129027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac240fc700 0x7fac240fcb70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.443+0000 7fac29436640 1 --2- 172.21.15.112:0/1249129027 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac240fb430 0x7fac240fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.443+0000 7fac29436640 1 -- 172.21.15.112:0/1249129027 >> 172.21.15.112:0/1249129027 conn(0x7fac240f6c10 msgr2=0x7fac240f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:58.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.444+0000 7fac29436640 1 -- 172.21.15.112:0/1249129027 shutdown_connections 2024-09-19T09:34:58.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.444+0000 7fac29436640 1 -- 172.21.15.112:0/1249129027 wait complete. 2024-09-19T09:34:58.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.445+0000 7fac29436640 1 Processor -- start 2024-09-19T09:34:58.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.445+0000 7fac29436640 1 -- start start 2024-09-19T09:34:58.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.445+0000 7fac29436640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac240fb430 0x7fac2410f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:58.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.445+0000 7fac29436640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac240fc700 0x7fac2410f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:58.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.445+0000 7fac29436640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac241106c0 con 0x7fac240fb430 2024-09-19T09:34:58.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.445+0000 7fac29436640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac24110830 con 0x7fac240fc700 2024-09-19T09:34:58.448 INFO:tasks.workunit.client.1.smithi191.stdout:5/247: link d0/l1c d0/d4/d9/d1d/d29/d33/d45/l5b 0 2024-09-19T09:34:58.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.445+0000 7fac22ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac240fb430 0x7fac2410f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:58.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.445+0000 7fac22ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac240fb430 0x7fac2410f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59110/0 (socket says 172.21.15.112:59110) 2024-09-19T09:34:58.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.445+0000 7fac22ffd640 1 -- 172.21.15.112:0/1199302107 learned_addr learned my addr 172.21.15.112:0/1199302107 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:34:58.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.446+0000 7fac22ffd640 1 -- 172.21.15.112:0/1199302107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac240fc700 msgr2=0x7fac2410f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:58.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.446+0000 7fac227fc640 1 --2- 172.21.15.112:0/1199302107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac240fc700 0x7fac2410f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:58.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.446+0000 7fac22ffd640 1 --2- 172.21.15.112:0/1199302107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac240fc700 0x7fac2410f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.446+0000 7fac22ffd640 1 -- 172.21.15.112:0/1199302107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c005040 con 0x7fac240fb430 2024-09-19T09:34:58.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.446+0000 7fac227fc640 1 --2- 172.21.15.112:0/1199302107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac240fc700 0x7fac2410f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:58.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.446+0000 7fac22ffd640 1 --2- 172.21.15.112:0/1199302107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac240fb430 0x7fac2410f310 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fac1400b790 tx=0x7fac140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:58.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.447+0000 7fac1b7fe640 1 -- 172.21.15.112:0/1199302107 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac1400c700 con 0x7fac240fb430 2024-09-19T09:34:58.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.447+0000 7fac29436640 1 -- 172.21.15.112:0/1199302107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac24110b10 con 0x7fac240fb430 2024-09-19T09:34:58.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.447+0000 7fac29436640 1 -- 172.21.15.112:0/1199302107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac24111030 con 0x7fac240fb430 2024-09-19T09:34:58.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.447+0000 7fac1b7fe640 1 -- 172.21.15.112:0/1199302107 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fac1400cd00 con 0x7fac240fb430 2024-09-19T09:34:58.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.447+0000 7fac1b7fe640 1 -- 172.21.15.112:0/1199302107 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac14015e80 con 0x7fac240fb430 2024-09-19T09:34:58.451 INFO:tasks.workunit.client.1.smithi191.stdout:7/147: mkdir d2/d39 0 2024-09-19T09:34:58.451 INFO:tasks.workunit.client.1.smithi191.stdout:3/156: sync 2024-09-19T09:34:58.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.448+0000 7fac29436640 1 -- 172.21.15.112:0/1199302107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac04005210 con 0x7fac240fb430 2024-09-19T09:34:58.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.449+0000 7fac1b7fe640 1 -- 172.21.15.112:0/1199302107 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fac14012070 con 0x7fac240fb430 2024-09-19T09:34:58.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.450+0000 7fac1b7fe640 1 --2- 172.21.15.112:0/1199302107 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fac1006e7b0 0x7fac10070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:58.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.450+0000 7fac1b7fe640 1 -- 172.21.15.112:0/1199302107 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fac1408d6c0 con 0x7fac240fb430 2024-09-19T09:34:58.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.450+0000 7fac227fc640 1 --2- 172.21.15.112:0/1199302107 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fac1006e7b0 0x7fac10070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:58.452 INFO:tasks.workunit.client.1.smithi191.stdout:0/287: link d0/c5e d0/d9/d1c/d1f/c5f 0 2024-09-19T09:34:58.452 INFO:tasks.workunit.client.1.smithi191.stdout:1/201: dread d3/d9/da/d1e/f31 [0,4194304] 0 2024-09-19T09:34:58.453 INFO:tasks.workunit.client.1.smithi191.stdout:0/288: stat d0/d9/d1c/d1f/d24/d39/d58/l1e 0 2024-09-19T09:34:58.453 INFO:tasks.workunit.client.1.smithi191.stdout:0/289: fsync d0/f4 0 2024-09-19T09:34:58.453 INFO:tasks.workunit.client.1.smithi191.stdout:0/290: chown d0/d9/c51 26 1 2024-09-19T09:34:58.453 INFO:tasks.workunit.client.1.smithi191.stdout:0/291: readlink d0/d9/d1c/d1f/d24/d39/l59 0 2024-09-19T09:34:58.453 INFO:tasks.workunit.client.1.smithi191.stdout:5/248: mkdir d0/d4/d9/d1d/d22/d5c 0 2024-09-19T09:34:58.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.452+0000 7fac227fc640 1 --2- 172.21.15.112:0/1199302107 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fac1006e7b0 0x7fac10070c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00b020 tx=0x7fac0c009da0 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:58.454 INFO:tasks.workunit.client.1.smithi191.stdout:1/202: symlink d3/d9/da/db/d48/l4a 0 2024-09-19T09:34:58.455 INFO:tasks.workunit.client.1.smithi191.stdout:0/292: unlink d0/d9/d1c/d1f/d24/d39/d58/c26 0 2024-09-19T09:34:58.457 INFO:tasks.workunit.client.1.smithi191.stdout:0/293: write d0/d9/d1c/d1f/d24/d29/f3b [140800,24504] 0 2024-09-19T09:34:58.457 INFO:tasks.workunit.client.1.smithi191.stdout:0/294: fsync d0/d9/d1c/d1f/d24/d39/d58/f40 0 2024-09-19T09:34:58.457 INFO:tasks.workunit.client.1.smithi191.stdout:5/249: rename d0/d4/d9/d1d/f50 to d0/d4/d9/d1d/d22/f5d 0 2024-09-19T09:34:58.458 INFO:tasks.workunit.client.1.smithi191.stdout:0/295: rename d0/d9/d1c/d1f/d24/f33 to d0/d9/d1c/d1f/d24/f60 0 2024-09-19T09:34:58.459 INFO:tasks.workunit.client.1.smithi191.stdout:6/182: dread d2/fa [0,4194304] 0 2024-09-19T09:34:58.459 INFO:tasks.workunit.client.1.smithi191.stdout:6/183: truncate d2/de/d19/d24/f2c 606809 0 2024-09-19T09:34:58.459 INFO:tasks.workunit.client.1.smithi191.stdout:6/184: fsync d2/de/d19/d24/f29 0 2024-09-19T09:34:58.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.457+0000 7fac1b7fe640 1 -- 172.21.15.112:0/1199302107 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fac14057050 con 0x7fac240fb430 2024-09-19T09:34:58.460 INFO:tasks.workunit.client.1.smithi191.stdout:1/203: rename d3/l7 to d3/d9/da/d42/l4b 0 2024-09-19T09:34:58.460 INFO:tasks.workunit.client.1.smithi191.stdout:1/204: readlink d3/d9/da/d1e/d25/l28 0 2024-09-19T09:34:58.460 INFO:tasks.workunit.client.1.smithi191.stdout:5/250: rmdir d0/d4/d9/d1d/d29 39 2024-09-19T09:34:58.461 INFO:tasks.workunit.client.1.smithi191.stdout:6/185: symlink d2/de/d19/l43 0 2024-09-19T09:34:58.464 INFO:tasks.workunit.client.1.smithi191.stdout:8/290: dwrite d1/d16/d3c/f31 [0,4194304] 0 2024-09-19T09:34:58.464 INFO:tasks.workunit.client.1.smithi191.stdout:8/291: chown d1/d22/d47/f5a 218901136 1 2024-09-19T09:34:58.464 INFO:tasks.workunit.client.1.smithi191.stdout:8/292: write d1/d16/d3c/d28/f33 [705820,74951] 0 2024-09-19T09:34:58.464 INFO:tasks.workunit.client.1.smithi191.stdout:4/264: dwrite d5/f6 [0,4194304] 0 2024-09-19T09:34:58.464 INFO:tasks.workunit.client.1.smithi191.stdout:9/183: dwrite d3/db/d16/f1b [0,4194304] 0 2024-09-19T09:34:58.464 INFO:tasks.workunit.client.1.smithi191.stdout:9/184: stat d3/db 0 2024-09-19T09:34:58.465 INFO:tasks.workunit.client.1.smithi191.stdout:5/251: creat d0/d4/d9/d1d/d22/d5c/f5e x:0 0 0 2024-09-19T09:34:58.465 INFO:tasks.workunit.client.1.smithi191.stdout:5/252: write d0/d1f/f43 [4659569,919] 0 2024-09-19T09:34:58.465 INFO:tasks.workunit.client.1.smithi191.stdout:5/253: creat d0/d4/d4a/f5f x:0 0 0 2024-09-19T09:34:58.466 INFO:tasks.workunit.client.1.smithi191.stdout:6/186: mkdir d2/de/d19/d24/d44 0 2024-09-19T09:34:58.467 INFO:tasks.workunit.client.1.smithi191.stdout:2/177: dwrite d8/db/d13/d23/f29 [0,4194304] 0 2024-09-19T09:34:58.471 INFO:tasks.workunit.client.1.smithi191.stdout:4/265: dread d5/f4e [0,4194304] 0 2024-09-19T09:34:58.471 INFO:tasks.workunit.client.1.smithi191.stdout:4/266: dread - d5/d1b/d1c/d24/d32/f1e zero size 2024-09-19T09:34:58.472 INFO:tasks.workunit.client.1.smithi191.stdout:7/148: dwrite d2/f1f [0,4194304] 0 2024-09-19T09:34:58.474 INFO:tasks.workunit.client.1.smithi191.stdout:0/296: write d0/d9/f1a [1812051,49424] 0 2024-09-19T09:34:58.476 INFO:tasks.workunit.client.1.smithi191.stdout:5/254: truncate d0/d4/d9/d1d/d28/f31 5637807 0 2024-09-19T09:34:58.476 INFO:tasks.workunit.client.1.smithi191.stdout:5/255: write d0/d4/d9/d1d/d29/d33/f38 [1064937,55568] 0 2024-09-19T09:34:58.476 INFO:tasks.workunit.client.1.smithi191.stdout:5/256: chown d0/d4/f24 10 1 2024-09-19T09:34:58.477 INFO:tasks.workunit.client.1.smithi191.stdout:6/187: stat d2/de/d19/d1e/c3c 0 2024-09-19T09:34:58.479 INFO:tasks.workunit.client.1.smithi191.stdout:9/185: dread d3/d8/f13 [0,4194304] 0 2024-09-19T09:34:58.479 INFO:tasks.workunit.client.1.smithi191.stdout:9/186: write d3/ff [274255,129824] 0 2024-09-19T09:34:58.481 INFO:tasks.workunit.client.1.smithi191.stdout:2/178: rename f0 to d8/d11/f38 0 2024-09-19T09:34:58.482 INFO:tasks.workunit.client.1.smithi191.stdout:2/179: creat d8/d11/d17/f39 x:0 0 0 2024-09-19T09:34:58.482 INFO:tasks.workunit.client.1.smithi191.stdout:2/180: creat d8/db/d13/f3a x:0 0 0 2024-09-19T09:34:58.482 INFO:tasks.workunit.client.1.smithi191.stdout:4/267: creat d5/d1b/d61/f64 x:0 0 0 2024-09-19T09:34:58.484 INFO:tasks.workunit.client.1.smithi191.stdout:7/149: mkdir d2/d39/d3a 0 2024-09-19T09:34:58.485 INFO:tasks.workunit.client.1.smithi191.stdout:7/150: dread - d2/d2a/f31 zero size 2024-09-19T09:34:58.485 INFO:tasks.workunit.client.1.smithi191.stdout:3/157: dwrite d12/f1e [0,4194304] 0 2024-09-19T09:34:58.486 INFO:tasks.workunit.client.1.smithi191.stdout:6/188: rename d2/de/d2a/d2d/l42 to d2/de/d2a/d2d/l45 0 2024-09-19T09:34:58.487 INFO:tasks.workunit.client.1.smithi191.stdout:9/187: creat d3/db/d16/d38/f3e x:0 0 0 2024-09-19T09:34:58.487 INFO:tasks.workunit.client.1.smithi191.stdout:9/188: stat d3/db/d16/d38 0 2024-09-19T09:34:58.487 INFO:tasks.workunit.client.1.smithi191.stdout:9/189: rename d3/d8 to d3/d8/d3f 22 2024-09-19T09:34:58.487 INFO:tasks.workunit.client.1.smithi191.stdout:9/190: write d3/d8/fc [3138820,18070] 0 2024-09-19T09:34:58.490 INFO:tasks.workunit.client.1.smithi191.stdout:2/181: link d8/db/d13/d23/f20 d8/db/d13/d23/f3b 0 2024-09-19T09:34:58.490 INFO:tasks.workunit.client.1.smithi191.stdout:2/182: write d8/db/d13/f3a [832501,61637] 0 2024-09-19T09:34:58.490 INFO:tasks.workunit.client.1.smithi191.stdout:4/268: mknod d5/d1b/d1c/d24/d32/d21/d5c/c65 0 2024-09-19T09:34:58.490 INFO:tasks.workunit.client.1.smithi191.stdout:4/269: write d5/d1b/d1c/d24/d32/f2d [869460,60127] 0 2024-09-19T09:34:58.491 INFO:tasks.workunit.client.1.smithi191.stdout:3/158: mknod d12/d13/d1a/d1b/d2e/c39 0 2024-09-19T09:34:58.496 INFO:tasks.workunit.client.1.smithi191.stdout:3/159: creat d12/d13/d1a/d1b/d2e/f3a x:0 0 0 2024-09-19T09:34:58.497 INFO:tasks.workunit.client.1.smithi191.stdout:6/189: link d2/l9 d2/de/d19/l46 0 2024-09-19T09:34:58.497 INFO:tasks.workunit.client.1.smithi191.stdout:6/190: stat d2/de/d19/d1e/f3e 0 2024-09-19T09:34:58.498 INFO:tasks.workunit.client.1.smithi191.stdout:1/205: dwrite d3/d9/da/f3b [0,4194304] 0 2024-09-19T09:34:58.498 INFO:tasks.workunit.client.1.smithi191.stdout:1/206: readlink d3/l38 0 2024-09-19T09:34:58.500 INFO:tasks.workunit.client.1.smithi191.stdout:4/270: read d5/d1b/d1c/d24/d32/f36 [298076,72408] 0 2024-09-19T09:34:58.500 INFO:tasks.workunit.client.1.smithi191.stdout:4/271: fsync d5/d1b/d1c/d24/d32/f16 0 2024-09-19T09:34:58.501 INFO:tasks.workunit.client.1.smithi191.stdout:4/272: read - d5/d38/f45 zero size 2024-09-19T09:34:58.501 INFO:tasks.workunit.client.1.smithi191.stdout:3/160: link d12/d13/d1a/f29 d12/d13/f3b 0 2024-09-19T09:34:58.501 INFO:tasks.workunit.client.1.smithi191.stdout:3/161: write d12/f25 [912787,104748] 0 2024-09-19T09:34:58.501 INFO:tasks.workunit.client.1.smithi191.stdout:3/162: truncate d12/f25 1728738 0 2024-09-19T09:34:58.502 INFO:tasks.workunit.client.1.smithi191.stdout:7/151: rmdir d2/d2a 39 2024-09-19T09:34:58.502 INFO:tasks.workunit.client.1.smithi191.stdout:6/191: symlink d2/de/d2a/d2d/l47 0 2024-09-19T09:34:58.502 INFO:tasks.workunit.client.1.smithi191.stdout:6/192: truncate d2/de/d2a/d2d/d30/f3f 692864 0 2024-09-19T09:34:58.502 INFO:tasks.workunit.client.1.smithi191.stdout:6/193: chown d2/de/d19 1 1 2024-09-19T09:34:58.505 INFO:tasks.workunit.client.1.smithi191.stdout:8/293: dwrite d1/d22/f58 [0,4194304] 0 2024-09-19T09:34:58.505 INFO:tasks.workunit.client.1.smithi191.stdout:8/294: chown d1/d16/d23/d3e/f4b 4 1 2024-09-19T09:34:58.505 INFO:tasks.workunit.client.1.smithi191.stdout:8/295: fsync d1/d16/d3c/d17/f48 0 2024-09-19T09:34:58.505 INFO:tasks.workunit.client.1.smithi191.stdout:8/296: creat d1/f5e x:0 0 0 2024-09-19T09:34:58.505 INFO:tasks.workunit.client.1.smithi191.stdout:8/297: write d1/d7/d1a/f5b [47121,45534] 0 2024-09-19T09:34:58.507 INFO:tasks.workunit.client.1.smithi191.stdout:8/298: write d1/d7/d1a/f25 [307747,104250] 0 2024-09-19T09:34:58.509 INFO:tasks.workunit.client.1.smithi191.stdout:0/297: dwrite d0/d9/de/f55 [0,4194304] 0 2024-09-19T09:34:58.509 INFO:tasks.workunit.client.1.smithi191.stdout:1/207: symlink d3/d9/da/l4c 0 2024-09-19T09:34:58.509 INFO:tasks.workunit.client.1.smithi191.stdout:6/194: dread d2/de/f22 [0,4194304] 0 2024-09-19T09:34:58.510 INFO:tasks.workunit.client.1.smithi191.stdout:4/273: link d5/d1b/d1c/d24/d32/l3d d5/d1b/d1c/d2f/d37/d59/l66 0 2024-09-19T09:34:58.510 INFO:tasks.workunit.client.1.smithi191.stdout:4/274: truncate d5/d38/f45 378765 0 2024-09-19T09:34:58.511 INFO:tasks.workunit.client.1.smithi191.stdout:3/163: mkdir d12/d13/d1a/d1b/d3c 0 2024-09-19T09:34:58.512 INFO:tasks.workunit.client.1.smithi191.stdout:7/152: link d2/l10 d2/l3b 0 2024-09-19T09:34:58.514 INFO:tasks.workunit.client.1.smithi191.stdout:5/257: getdents d0/d4/d9/d1d/d22 0 2024-09-19T09:34:58.514 INFO:tasks.workunit.client.1.smithi191.stdout:5/258: stat d0/d4/f24 0 2024-09-19T09:34:58.514 INFO:tasks.workunit.client.1.smithi191.stdout:5/259: creat d0/d4/d4a/f60 x:0 0 0 2024-09-19T09:34:58.522 INFO:tasks.workunit.client.1.smithi191.stdout:8/299: truncate d1/d16/f19 1288081 0 2024-09-19T09:34:58.522 INFO:tasks.workunit.client.1.smithi191.stdout:0/298: write d0/d9/d1c/d1f/d24/d29/f3b [4021002,70523] 0 2024-09-19T09:34:58.525 INFO:tasks.workunit.client.1.smithi191.stdout:3/164: write d12/f1e [1765006,114036] 0 2024-09-19T09:34:58.528 INFO:tasks.workunit.client.1.smithi191.stdout:9/191: dwrite d3/db/f10 [0,4194304] 0 2024-09-19T09:34:58.528 INFO:tasks.workunit.client.1.smithi191.stdout:3/165: write fe [1022852,29379] 0 2024-09-19T09:34:58.528 INFO:tasks.workunit.client.1.smithi191.stdout:9/192: write d3/db/d16/d17/d1c/f1d [722762,60260] 0 2024-09-19T09:34:58.529 INFO:tasks.workunit.client.1.smithi191.stdout:9/193: dread d3/ff [0,4194304] 0 2024-09-19T09:34:58.532 INFO:tasks.workunit.client.1.smithi191.stdout:1/208: rename d3/d9/da/db/f22 to d3/d9/da/db/f4d 0 2024-09-19T09:34:58.541 INFO:tasks.workunit.client.1.smithi191.stdout:4/275: dwrite d5/d1b/d1c/d2f/d19/f3a [0,4194304] 0 2024-09-19T09:34:58.541 INFO:tasks.workunit.client.1.smithi191.stdout:4/276: readlink d5/d1b/d1c/d24/d32/l3d 0 2024-09-19T09:34:58.541 INFO:tasks.workunit.client.1.smithi191.stdout:6/195: dwrite d2/f34 [4194304,4194304] 0 2024-09-19T09:34:58.542 INFO:tasks.workunit.client.1.smithi191.stdout:7/153: mkdir d2/d39/d3a/d3c 0 2024-09-19T09:34:58.544 INFO:tasks.workunit.client.1.smithi191.stdout:5/260: symlink d0/d1f/l61 0 2024-09-19T09:34:58.544 INFO:tasks.workunit.client.1.smithi191.stdout:5/261: truncate d0/d4/d9/d1d/f46 1457291 0 2024-09-19T09:34:58.550 INFO:tasks.workunit.client.1.smithi191.stdout:1/209: dwrite d3/d9/da/db/f33 [0,4194304] 0 2024-09-19T09:34:58.552 INFO:tasks.workunit.client.1.smithi191.stdout:4/277: rename d5/f35 to d5/d1b/f67 0 2024-09-19T09:34:58.554 INFO:tasks.workunit.client.1.smithi191.stdout:6/196: mknod d2/de/d2a/d2d/d30/c48 0 2024-09-19T09:34:58.559 INFO:tasks.workunit.client.1.smithi191.stdout:7/154: rmdir d2/d2a 39 2024-09-19T09:34:58.565 INFO:tasks.workunit.client.1.smithi191.stdout:8/300: rmdir d1 39 2024-09-19T09:34:58.567 INFO:tasks.workunit.client.1.smithi191.stdout:1/210: dwrite d3/d9/da/db/f49 [0,4194304] 0 2024-09-19T09:34:58.567 INFO:tasks.workunit.client.1.smithi191.stdout:1/211: write d3/d9/fe [2852025,85632] 0 2024-09-19T09:34:58.569 INFO:tasks.workunit.client.1.smithi191.stdout:4/278: mknod d5/d38/c68 0 2024-09-19T09:34:58.569 INFO:tasks.workunit.client.1.smithi191.stdout:4/279: write d5/d1b/d1c/d2f/f39 [544301,20672] 0 2024-09-19T09:34:58.569 INFO:tasks.workunit.client.1.smithi191.stdout:4/280: creat d5/d1b/d1c/d24/d32/d21/f69 x:0 0 0 2024-09-19T09:34:58.569 INFO:tasks.workunit.client.1.smithi191.stdout:4/281: write d5/d1b/d1c/d24/d32/f13 [1191756,94359] 0 2024-09-19T09:34:58.570 INFO:tasks.workunit.client.1.smithi191.stdout:4/282: readlink d5/d1b/d1c/d24/d32/l3d 0 2024-09-19T09:34:58.570 INFO:tasks.workunit.client.1.smithi191.stdout:7/155: symlink d2/d2a/l3d 0 2024-09-19T09:34:58.572 INFO:tasks.workunit.client.1.smithi191.stdout:8/301: symlink d1/d16/d23/l5f 0 2024-09-19T09:34:58.574 INFO:tasks.workunit.client.1.smithi191.stdout:1/212: unlink d3/d9/da/d1e/d25/f3a 0 2024-09-19T09:34:58.574 INFO:tasks.workunit.client.1.smithi191.stdout:0/299: dwrite d0/d9/d1c/d1f/d24/d29/f3d [0,4194304] 0 2024-09-19T09:34:58.574 INFO:tasks.workunit.client.1.smithi191.stdout:1/213: read d3/f4 [2419174,77358] 0 2024-09-19T09:34:58.574 INFO:tasks.workunit.client.1.smithi191.stdout:1/214: write d3/d9/f24 [48386,85841] 0 2024-09-19T09:34:58.574 INFO:tasks.workunit.client.1.smithi191.stdout:1/215: chown f0 145 1 2024-09-19T09:34:58.575 INFO:tasks.workunit.client.1.smithi191.stdout:7/156: creat d2/d2a/d33/f3e x:0 0 0 2024-09-19T09:34:58.577 INFO:tasks.workunit.client.1.smithi191.stdout:8/302: creat d1/d22/d47/f60 x:0 0 0 2024-09-19T09:34:58.577 INFO:tasks.workunit.client.1.smithi191.stdout:8/303: dread - d1/d22/d47/f60 zero size 2024-09-19T09:34:58.577 INFO:tasks.workunit.client.1.smithi191.stdout:8/304: write d1/d22/f54 [173786,11223] 0 2024-09-19T09:34:58.577 INFO:tasks.workunit.client.1.smithi191.stdout:8/305: fsync d1/d7/fe 0 2024-09-19T09:34:58.578 INFO:tasks.workunit.client.1.smithi191.stdout:8/306: chown d1/d16/d3c/la 3298523 1 2024-09-19T09:34:58.578 INFO:tasks.workunit.client.1.smithi191.stdout:5/262: getdents d0/d4/d4a 0 2024-09-19T09:34:58.583 INFO:tasks.workunit.client.1.smithi191.stdout:1/216: creat d3/d9/f4e x:0 0 0 2024-09-19T09:34:58.584 INFO:tasks.workunit.client.1.smithi191.stdout:7/157: mknod d2/c3f 0 2024-09-19T09:34:58.584 INFO:tasks.workunit.client.1.smithi191.stdout:7/158: creat d2/f40 x:0 0 0 2024-09-19T09:34:58.585 INFO:tasks.workunit.client.1.smithi191.stdout:4/283: read d5/fa [2129310,30231] 0 2024-09-19T09:34:58.585 INFO:tasks.workunit.client.1.smithi191.stdout:6/197: dwrite d2/de/f22 [0,4194304] 0 2024-09-19T09:34:58.586 INFO:tasks.workunit.client.1.smithi191.stdout:8/307: dread d1/d16/d3c/d17/f4d [0,4194304] 0 2024-09-19T09:34:58.588 INFO:tasks.workunit.client.1.smithi191.stdout:3/166: truncate fe 992119 0 2024-09-19T09:34:58.591 INFO:tasks.workunit.client.1.smithi191.stdout:5/263: link d0/d4/d9/d1d/d22/d5c/f5e d0/d4/d9/d1d/d29/f62 0 2024-09-19T09:34:58.593 INFO:tasks.workunit.client.1.smithi191.stdout:1/217: symlink d3/d9/da/d1e/d25/l4f 0 2024-09-19T09:34:58.596 INFO:tasks.workunit.client.1.smithi191.stdout:7/159: symlink d2/l41 0 2024-09-19T09:34:58.599 INFO:tasks.workunit.client.1.smithi191.stdout:6/198: link d2/de/d19/l23 d2/de/d2a/d39/l49 0 2024-09-19T09:34:58.600 INFO:tasks.workunit.client.1.smithi191.stdout:8/308: mknod d1/d22/c61 0 2024-09-19T09:34:58.601 INFO:tasks.workunit.client.1.smithi191.stdout:8/309: write d1/d16/d3c/d17/f48 [926325,87416] 0 2024-09-19T09:34:58.601 INFO:tasks.workunit.client.1.smithi191.stdout:8/310: dread - d1/d22/d47/f5a zero size 2024-09-19T09:34:58.601 INFO:tasks.workunit.client.1.smithi191.stdout:3/167: mkdir d12/d37/d3d 0 2024-09-19T09:34:58.603 INFO:tasks.workunit.client.1.smithi191.stdout:0/300: mkdir d0/d9/de/d61 0 2024-09-19T09:34:58.604 INFO:tasks.workunit.client.1.smithi191.stdout:1/218: symlink d3/d9/da/d1e/d32/l50 0 2024-09-19T09:34:58.606 INFO:tasks.workunit.client.1.smithi191.stdout:7/160: creat d2/d2a/d38/f42 x:0 0 0 2024-09-19T09:34:58.607 INFO:tasks.workunit.client.1.smithi191.stdout:3/168: mknod d12/d13/c3e 0 2024-09-19T09:34:58.608 INFO:tasks.workunit.client.1.smithi191.stdout:0/301: mknod d0/d9/de/d61/c62 0 2024-09-19T09:34:58.608 INFO:tasks.workunit.client.1.smithi191.stdout:0/302: fsync d0/d9/d1c/d1f/d24/f4b 0 2024-09-19T09:34:58.609 INFO:tasks.workunit.client.1.smithi191.stdout:0/303: write d0/d9/d1c/d20/f37 [3251031,111143] 0 2024-09-19T09:34:58.610 INFO:tasks.workunit.client.1.smithi191.stdout:4/284: dwrite d5/f18 [0,4194304] 0 2024-09-19T09:34:58.611 INFO:tasks.workunit.client.1.smithi191.stdout:1/219: link d3/d9/da/d1e/d25/f30 d3/d9/da/dc/f51 0 2024-09-19T09:34:58.611 INFO:tasks.workunit.client.1.smithi191.stdout:4/285: read d5/d1b/d1c/d2f/f47 [327213,110929] 0 2024-09-19T09:34:58.612 INFO:tasks.workunit.client.1.smithi191.stdout:7/161: symlink d2/d2a/d33/l43 0 2024-09-19T09:34:58.613 INFO:tasks.workunit.client.1.smithi191.stdout:0/304: rmdir d0/d9/d1c 39 2024-09-19T09:34:58.615 INFO:tasks.workunit.client.1.smithi191.stdout:6/199: write d2/f34 [4070835,77795] 0 2024-09-19T09:34:58.617 INFO:tasks.workunit.client.1.smithi191.stdout:4/286: rename d5/d1b/l25 to d5/d1b/d61/l6a 0 2024-09-19T09:34:58.617 INFO:tasks.workunit.client.1.smithi191.stdout:4/287: dread - d5/d1b/d1c/d28/f58 zero size 2024-09-19T09:34:58.620 INFO:tasks.workunit.client.1.smithi191.stdout:6/200: symlink d2/de/d19/d24/l4a 0 2024-09-19T09:34:58.622 INFO:tasks.workunit.client.1.smithi191.stdout:7/162: rename d2/la to d2/d39/l44 0 2024-09-19T09:34:58.622 INFO:tasks.workunit.client.1.smithi191.stdout:7/163: truncate d2/d2a/d33/f3e 166838 0 2024-09-19T09:34:58.623 INFO:tasks.workunit.client.1.smithi191.stdout:5/264: dwrite d0/d4/d9/d1d/d22/d3b/f3c [0,4194304] 0 2024-09-19T09:34:58.624 INFO:tasks.workunit.client.1.smithi191.stdout:0/305: rmdir d0/d9/d1c/d1f/d24/d29/d30/d56/d5d 0 2024-09-19T09:34:58.624 INFO:tasks.workunit.client.1.smithi191.stdout:0/306: chown d0/d9/d1c/d1f/d24/d29/d30/c35 22536 1 2024-09-19T09:34:58.625 INFO:tasks.workunit.client.1.smithi191.stdout:6/201: creat d2/de/d2a/f4b x:0 0 0 2024-09-19T09:34:58.628 INFO:tasks.workunit.client.1.smithi191.stdout:7/164: unlink d2/f24 0 2024-09-19T09:34:58.628 INFO:tasks.workunit.client.1.smithi191.stdout:7/165: read - d2/d2a/d38/f42 zero size 2024-09-19T09:34:58.629 INFO:tasks.workunit.client.1.smithi191.stdout:7/166: creat d2/d2a/d33/f45 x:0 0 0 2024-09-19T09:34:58.629 INFO:tasks.workunit.client.1.smithi191.stdout:0/307: link d0/d9/d1c/d1f/d24/d39/d58/f1b d0/d9/d1c/d1f/d24/f63 0 2024-09-19T09:34:58.630 INFO:tasks.workunit.client.1.smithi191.stdout:7/167: symlink d2/d2a/d38/l46 0 2024-09-19T09:34:58.630 INFO:tasks.workunit.client.1.smithi191.stdout:0/308: chown d0/d9/l32 1 1 2024-09-19T09:34:58.631 INFO:tasks.workunit.client.1.smithi191.stdout:0/309: mknod d0/d9/d1c/d1f/c64 0 2024-09-19T09:34:58.634 INFO:tasks.workunit.client.1.smithi191.stdout:3/169: dwrite d12/f25 [0,4194304] 0 2024-09-19T09:34:58.634 INFO:tasks.workunit.client.1.smithi191.stdout:3/170: read d12/f15 [99521,15479] 0 2024-09-19T09:34:58.634 INFO:tasks.workunit.client.1.smithi191.stdout:8/311: dwrite d1/d16/d3c/d28/f2d [0,4194304] 0 2024-09-19T09:34:58.636 INFO:tasks.workunit.client.1.smithi191.stdout:3/171: mkdir d12/d13/d1a/d1b/d3c/d3f 0 2024-09-19T09:34:58.636 INFO:tasks.workunit.client.1.smithi191.stdout:8/312: rmdir d1 39 2024-09-19T09:34:58.636 INFO:tasks.workunit.client.1.smithi191.stdout:8/313: write d1/d16/f2a [2741964,130243] 0 2024-09-19T09:34:58.637 INFO:tasks.workunit.client.1.smithi191.stdout:3/172: creat d12/d37/d3d/f40 x:0 0 0 2024-09-19T09:34:58.637 INFO:tasks.workunit.client.1.smithi191.stdout:3/173: stat d12/d13/d1a/d1b/d2e/d33 0 2024-09-19T09:34:58.637 INFO:tasks.workunit.client.1.smithi191.stdout:8/314: creat d1/d16/d3c/f62 x:0 0 0 2024-09-19T09:34:58.650 INFO:tasks.workunit.client.1.smithi191.stdout:3/174: dread ff [0,4194304] 0 2024-09-19T09:34:58.651 INFO:tasks.workunit.client.1.smithi191.stdout:3/175: truncate d12/f15 6286252 0 2024-09-19T09:34:58.652 INFO:tasks.workunit.client.1.smithi191.stdout:4/288: dwrite d5/d1b/d1c/f29 [0,4194304] 0 2024-09-19T09:34:58.652 INFO:tasks.workunit.client.1.smithi191.stdout:3/176: unlink d12/d13/f17 0 2024-09-19T09:34:58.654 INFO:tasks.workunit.client.1.smithi191.stdout:4/289: truncate d5/d1b/d1c/d2f/d19/f3a 881712 0 2024-09-19T09:34:58.654 INFO:tasks.workunit.client.1.smithi191.stdout:4/290: fsync d5/d1b/d1c/f5a 0 2024-09-19T09:34:58.657 INFO:tasks.workunit.client.1.smithi191.stdout:6/202: dwrite d2/de/d2a/d2d/d30/f3f [0,4194304] 0 2024-09-19T09:34:58.657 INFO:tasks.workunit.client.1.smithi191.stdout:1/220: getdents d3/d9/da/d1e/d32 0 2024-09-19T09:34:58.657 INFO:tasks.workunit.client.1.smithi191.stdout:1/221: chown d3/d9/da/dc/f2c 54905 1 2024-09-19T09:34:58.657 INFO:tasks.workunit.client.1.smithi191.stdout:6/203: chown d2/de/d19/d1e/l40 42 1 2024-09-19T09:34:58.657 INFO:tasks.workunit.client.1.smithi191.stdout:5/265: dwrite d0/d4/d9/d1d/d22/f5d [0,4194304] 0 2024-09-19T09:34:58.660 INFO:tasks.workunit.client.1.smithi191.stdout:8/315: dwrite d1/d16/d23/f43 [0,4194304] 0 2024-09-19T09:34:58.660 INFO:tasks.workunit.client.1.smithi191.stdout:8/316: getdents d1/d16/d2e/d57 0 2024-09-19T09:34:58.661 INFO:tasks.workunit.client.1.smithi191.stdout:6/204: rename d2/de/d19/d24/l4a to d2/de/d2a/l4c 0 2024-09-19T09:34:58.665 INFO:tasks.workunit.client.1.smithi191.stdout:1/222: getdents d3/d9/da/dc 0 2024-09-19T09:34:58.668 INFO:tasks.workunit.client.1.smithi191.stdout:3/177: dwrite d12/f25 [0,4194304] 0 2024-09-19T09:34:58.672 INFO:tasks.workunit.client.1.smithi191.stdout:8/317: rename d1/d16/d3c/f41 to d1/d7/d1a/f63 0 2024-09-19T09:34:58.673 INFO:tasks.workunit.client.1.smithi191.stdout:5/266: getdents d0/d4/d9/d1d/d29/d33 0 2024-09-19T09:34:58.674 INFO:tasks.workunit.client.1.smithi191.stdout:1/223: getdents d3/d9/da/d1e/d25 0 2024-09-19T09:34:58.674 INFO:tasks.workunit.client.1.smithi191.stdout:1/224: truncate d3/d9/f13 8889159 0 2024-09-19T09:34:58.675 INFO:tasks.workunit.client.1.smithi191.stdout:1/225: read d3/d9/f13 [8654981,44913] 0 2024-09-19T09:34:58.675 INFO:tasks.workunit.client.1.smithi191.stdout:1/226: stat d3/d9/da/dc/f51 0 2024-09-19T09:34:58.678 INFO:tasks.workunit.client.1.smithi191.stdout:6/205: dwrite d2/de/d2a/d2d/d30/f3f [0,4194304] 0 2024-09-19T09:34:58.678 INFO:tasks.workunit.client.1.smithi191.stdout:6/206: stat d2/de/d2a/d2d/d30/c48 0 2024-09-19T09:34:58.678 INFO:tasks.workunit.client.1.smithi191.stdout:1/227: link d3/d9/l46 d3/d9/da/dc/l52 0 2024-09-19T09:34:58.679 INFO:tasks.workunit.client.1.smithi191.stdout:1/228: chown d3/d9/da/db/l3d 7 1 2024-09-19T09:34:58.679 INFO:tasks.workunit.client.1.smithi191.stdout:1/229: truncate d3/d9/da/d1e/d32/f45 521971 0 2024-09-19T09:34:58.680 INFO:tasks.workunit.client.1.smithi191.stdout:0/310: truncate d0/f4 2235836 0 2024-09-19T09:34:58.681 INFO:tasks.workunit.client.1.smithi191.stdout:5/267: dread d0/d4/d9/d1d/d28/f31 [4194304,4194304] 0 2024-09-19T09:34:58.690 INFO:tasks.workunit.client.1.smithi191.stdout:8/318: dwrite d1/d16/d3c/d17/f48 [0,4194304] 0 2024-09-19T09:34:58.691 INFO:tasks.workunit.client.1.smithi191.stdout:5/268: unlink d0/d4/d9/d1d/d28/f55 0 2024-09-19T09:34:58.692 INFO:tasks.workunit.client.1.smithi191.stdout:6/207: rmdir d2 39 2024-09-19T09:34:58.694 INFO:tasks.workunit.client.1.smithi191.stdout:8/319: creat d1/d16/d2e/d32/f64 x:0 0 0 2024-09-19T09:34:58.695 INFO:tasks.workunit.client.1.smithi191.stdout:5/269: symlink d0/d4/d9/d1d/d22/d5c/l63 0 2024-09-19T09:34:58.696 INFO:tasks.workunit.client.1.smithi191.stdout:6/208: creat d2/de/d19/d24/f4d x:0 0 0 2024-09-19T09:34:58.697 INFO:tasks.workunit.client.1.smithi191.stdout:6/209: read - d2/de/d2a/f4b zero size 2024-09-19T09:34:58.697 INFO:tasks.workunit.client.1.smithi191.stdout:6/210: chown d2/de/d19/l46 0 1 2024-09-19T09:34:58.697 INFO:tasks.workunit.client.1.smithi191.stdout:8/320: symlink d1/d16/d2e/l65 0 2024-09-19T09:34:58.700 INFO:tasks.workunit.client.1.smithi191.stdout:1/230: rename d3/d9/da/dc to d3/d9/da/d1e/d32/d53 0 2024-09-19T09:34:58.700 INFO:tasks.workunit.client.1.smithi191.stdout:9/194: sync 2024-09-19T09:34:58.700 INFO:tasks.workunit.client.1.smithi191.stdout:2/183: sync 2024-09-19T09:34:58.701 INFO:tasks.workunit.client.1.smithi191.stdout:2/184: chown d8/d11/f38 92 1 2024-09-19T09:34:58.701 INFO:tasks.workunit.client.1.smithi191.stdout:1/231: symlink d3/l54 0 2024-09-19T09:34:58.704 INFO:tasks.workunit.client.1.smithi191.stdout:9/195: unlink d3/db/l23 0 2024-09-19T09:34:58.704 INFO:tasks.workunit.client.1.smithi191.stdout:9/196: stat d3/fe 0 2024-09-19T09:34:58.704 INFO:tasks.workunit.client.1.smithi191.stdout:9/197: chown d3/d8/f3b 119567 1 2024-09-19T09:34:58.704 INFO:tasks.workunit.client.1.smithi191.stdout:9/198: dread - d3/db/d16/d38/f3d zero size 2024-09-19T09:34:58.704 INFO:tasks.workunit.client.1.smithi191.stdout:6/211: dread d2/de/d2a/d2d/f1b [0,4194304] 0 2024-09-19T09:34:58.704 INFO:tasks.workunit.client.1.smithi191.stdout:0/311: dwrite d0/d9/f1a [0,4194304] 0 2024-09-19T09:34:58.705 INFO:tasks.workunit.client.1.smithi191.stdout:2/185: mknod d8/c3c 0 2024-09-19T09:34:58.706 INFO:tasks.workunit.client.1.smithi191.stdout:1/232: creat d3/d9/da/d42/f55 x:0 0 0 2024-09-19T09:34:58.706 INFO:tasks.workunit.client.1.smithi191.stdout:1/233: creat d3/d9/da/d42/f56 x:0 0 0 2024-09-19T09:34:58.708 INFO:tasks.workunit.client.1.smithi191.stdout:2/186: mknod d8/db/c3d 0 2024-09-19T09:34:58.716 INFO:tasks.workunit.client.1.smithi191.stdout:6/212: dread d2/de/d2a/d2d/d30/f3f [0,4194304] 0 2024-09-19T09:34:58.717 INFO:tasks.workunit.client.1.smithi191.stdout:9/199: dread d3/db/f10 [0,4194304] 0 2024-09-19T09:34:58.718 INFO:tasks.workunit.client.1.smithi191.stdout:6/213: getdents d2/de/d19 0 2024-09-19T09:34:58.724 INFO:tasks.workunit.client.1.smithi191.stdout:1/234: dread d3/d9/da/db/f4d [0,4194304] 0 2024-09-19T09:34:58.725 INFO:tasks.workunit.client.1.smithi191.stdout:1/235: truncate d3/d9/f13 7256785 0 2024-09-19T09:34:58.726 INFO:tasks.workunit.client.1.smithi191.stdout:1/236: chown d3/d9/da/db/f49 1669940 1 2024-09-19T09:34:58.726 INFO:tasks.workunit.client.1.smithi191.stdout:1/237: chown d3/d9/da/db/f33 1447830821 1 2024-09-19T09:34:58.727 INFO:tasks.workunit.client.1.smithi191.stdout:6/214: write d2/de/d19/d1e/f3e [607141,4194] 0 2024-09-19T09:34:58.728 INFO:tasks.workunit.client.1.smithi191.stdout:5/270: dwrite d0/d4/d9/f59 [0,4194304] 0 2024-09-19T09:34:58.729 INFO:tasks.workunit.client.1.smithi191.stdout:6/215: rmdir d2/de/d2a/d2d 39 2024-09-19T09:34:58.732 INFO:tasks.workunit.client.1.smithi191.stdout:8/321: dwrite d1/d7/d1a/f63 [0,4194304] 0 2024-09-19T09:34:58.732 INFO:tasks.workunit.client.1.smithi191.stdout:5/271: mkdir d0/d4/d9/d1d/d29/d33/d45/d64 0 2024-09-19T09:34:58.733 INFO:tasks.workunit.client.1.smithi191.stdout:6/216: rmdir d2/de 39 2024-09-19T09:34:58.733 INFO:tasks.workunit.client.1.smithi191.stdout:6/217: fsync d2/de/d19/d24/f29 0 2024-09-19T09:34:58.733 INFO:tasks.workunit.client.1.smithi191.stdout:6/218: fdatasync d2/de/d15/f36 0 2024-09-19T09:34:58.733 INFO:tasks.workunit.client.1.smithi191.stdout:6/219: chown d2/de/d2a/f4b 0 1 2024-09-19T09:34:58.734 INFO:tasks.workunit.client.1.smithi191.stdout:1/238: rmdir d3/d9/da 39 2024-09-19T09:34:58.736 INFO:tasks.workunit.client.1.smithi191.stdout:8/322: mknod d1/d22/d34/c66 0 2024-09-19T09:34:58.736 INFO:tasks.workunit.client.1.smithi191.stdout:8/323: chown d1/d16/d3c/f29 97657767 1 2024-09-19T09:34:58.737 INFO:tasks.workunit.client.1.smithi191.stdout:5/272: symlink d0/d4/l65 0 2024-09-19T09:34:58.737 INFO:tasks.workunit.client.1.smithi191.stdout:6/220: dread d2/de/f10 [0,4194304] 0 2024-09-19T09:34:58.737 INFO:tasks.workunit.client.1.smithi191.stdout:6/221: fdatasync d2/de/d19/d24/f2c 0 2024-09-19T09:34:58.739 INFO:tasks.workunit.client.1.smithi191.stdout:5/273: rename d0/d4/d9/d1d/d22/c3d to d0/d4/d4a/c66 0 2024-09-19T09:34:58.739 INFO:tasks.workunit.client.1.smithi191.stdout:5/274: write d0/d4/d9/d1d/d22/f2c [746559,129130] 0 2024-09-19T09:34:58.741 INFO:tasks.workunit.client.1.smithi191.stdout:5/275: rename d0/d4/d9/d1d/d29/d33/d52/c57 to d0/d4/d9/d1d/d28/d53/c67 0 2024-09-19T09:34:58.743 INFO:tasks.workunit.client.1.smithi191.stdout:0/312: dwrite d0/d9/d1c/d1f/d24/d39/d58/f16 [0,4194304] 0 2024-09-19T09:34:58.743 INFO:tasks.workunit.client.1.smithi191.stdout:9/200: dwrite d3/db/d16/d38/f3d [0,4194304] 0 2024-09-19T09:34:58.743 INFO:tasks.workunit.client.1.smithi191.stdout:0/313: dread - d0/d9/d1c/d1f/d24/d39/d58/f40 zero size 2024-09-19T09:34:58.743 INFO:tasks.workunit.client.1.smithi191.stdout:9/201: write d3/db/d16/f2a [725576,32088] 0 2024-09-19T09:34:58.743 INFO:tasks.workunit.client.1.smithi191.stdout:9/202: creat d3/f40 x:0 0 0 2024-09-19T09:34:58.744 INFO:tasks.workunit.client.1.smithi191.stdout:9/203: write d3/db/d16/f29 [4863109,62138] 0 2024-09-19T09:34:58.744 INFO:tasks.workunit.client.1.smithi191.stdout:2/187: dwrite d8/db/d13/f15 [4194304,4194304] 0 2024-09-19T09:34:58.744 INFO:tasks.workunit.client.1.smithi191.stdout:2/188: rename d8 to d8/db/d3e 22 2024-09-19T09:34:58.746 INFO:tasks.workunit.client.1.smithi191.stdout:0/314: mknod d0/d9/d1c/d1f/d24/d29/d30/c65 0 2024-09-19T09:34:58.747 INFO:tasks.workunit.client.1.smithi191.stdout:9/204: truncate d3/d8/fc 2949759 0 2024-09-19T09:34:58.750 INFO:tasks.workunit.client.1.smithi191.stdout:8/324: dread d1/d16/d3c/f31 [0,4194304] 0 2024-09-19T09:34:58.750 INFO:tasks.workunit.client.1.smithi191.stdout:8/325: creat d1/d16/d3c/f67 x:0 0 0 2024-09-19T09:34:58.750 INFO:tasks.workunit.client.1.smithi191.stdout:8/326: creat d1/d16/d3c/f68 x:0 0 0 2024-09-19T09:34:58.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.749+0000 7fac29436640 1 -- 172.21.15.112:0/1199302107 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fac04000bc0 con 0x7fac1006e7b0 2024-09-19T09:34:58.752 INFO:tasks.workunit.client.1.smithi191.stdout:1/239: dwrite d3/d9/da/db/f33 [0,4194304] 0 2024-09-19T09:34:58.753 INFO:tasks.workunit.client.1.smithi191.stdout:0/315: creat d0/d9/d1c/d1f/d24/d29/d30/d56/f66 x:0 0 0 2024-09-19T09:34:58.753 INFO:tasks.workunit.client.1.smithi191.stdout:5/276: write d0/d4/d9/d1d/d22/f5d [1718374,9251] 0 2024-09-19T09:34:58.753 INFO:tasks.workunit.client.1.smithi191.stdout:9/205: mknod d3/c41 0 2024-09-19T09:34:58.753 INFO:tasks.workunit.client.1.smithi191.stdout:9/206: fsync d3/fe 0 2024-09-19T09:34:58.754 INFO:tasks.workunit.client.1.smithi191.stdout:8/327: dread d1/d16/f19 [0,4194304] 0 2024-09-19T09:34:58.756 INFO:tasks.workunit.client.1.smithi191.stdout:1/240: truncate d3/d9/da/f3c 1476881 0 2024-09-19T09:34:58.756 INFO:tasks.workunit.client.1.smithi191.stdout:9/207: dread d3/d8/f22 [0,4194304] 0 2024-09-19T09:34:58.758 INFO:tasks.workunit.client.1.smithi191.stdout:0/316: link d0/f50 d0/d9/d1c/d1f/d24/d39/d58/f67 0 2024-09-19T09:34:58.760 INFO:tasks.workunit.client.1.smithi191.stdout:5/277: unlink d0/d4/d9/d1d/d22/c51 0 2024-09-19T09:34:58.762 INFO:tasks.workunit.client.1.smithi191.stdout:2/189: rename d8/d11/d17 to d8/d11/d3f 0 2024-09-19T09:34:58.763 INFO:tasks.workunit.client.1.smithi191.stdout:8/328: mknod d1/d16/d3c/d17/c69 0 2024-09-19T09:34:58.763 INFO:tasks.workunit.client.1.smithi191.stdout:5/278: symlink d0/d4/d9/de/l68 0 2024-09-19T09:34:58.765 INFO:tasks.workunit.client.1.smithi191.stdout:2/190: mkdir d8/db/d13/d40 0 2024-09-19T09:34:58.766 INFO:tasks.workunit.client.1.smithi191.stdout:8/329: mknod d1/d16/c6a 0 2024-09-19T09:34:58.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.765+0000 7fac1b7fe640 1 -- 172.21.15.112:0/1199302107 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fac04000bc0 con 0x7fac1006e7b0 2024-09-19T09:34:58.767 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:34:58.767 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (6m) 5s ago 7m 25.1M - 0.25.0 c8568f914cd2 bc75f08f7e02 2024-09-19T09:34:58.767 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (8m) 5s ago 8m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1513f1075df5 2024-09-19T09:34:58.767 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (7m) 8s ago 7m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6c313b300b35 2024-09-19T09:34:58.767 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (6m) 5s ago 7m 87.2M - 9.4.7 954c08fa6188 aeb5727c19ca 2024-09-19T09:34:58.767 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (2m) 5s ago 2m 170M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:34:58.767 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (2m) 5s ago 2m 96.1M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:34:58.767 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (2m) 8s ago 2m 11.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:34:58.768 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (2m) 8s ago 2m 14.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:34:58.768 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:9283,8765,8443 running (9m) 5s ago 9m 189M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a963c39d50ce 2024-09-19T09:34:58.768 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283 running (31s) 8s ago 6m 482M - 19.1.1-361-g2f599a46 d2baa855c067 b9c59e3583b1 2024-09-19T09:34:58.768 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (9m) 5s ago 9m 50.4M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 34676d67b669 2024-09-19T09:34:58.768 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (6m) 8s ago 6m 39.9M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 35690ef0929b 2024-09-19T09:34:58.768 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (7m) 5s ago 7m 15.7M - 1.5.0 0da6a335fe13 a5e6a378cf2f 2024-09-19T09:34:58.768 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (7m) 8s ago 6m 16.8M - 1.5.0 0da6a335fe13 6b6c7c67cf29 2024-09-19T09:34:58.768 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (6m) 5s ago 6m 108M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 621693067dce 2024-09-19T09:34:58.768 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (5m) 5s ago 5m 115M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1742e5964367 2024-09-19T09:34:58.768 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (5m) 5s ago 5m 104M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 4dcca18af229 2024-09-19T09:34:58.768 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (4m) 8s ago 4m 116M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:34:58.768 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (4m) 8s ago 4m 111M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:34:58.768 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (3m) 8s ago 3m 109M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:34:58.769 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (6m) 5s ago 7m 56.2M - 2.43.0 a07b618ecd1d 9499df984e6a 2024-09-19T09:34:58.770 INFO:tasks.workunit.client.1.smithi191.stdout:5/279: creat d0/d4/d4a/f69 x:0 0 0 2024-09-19T09:34:58.770 INFO:tasks.workunit.client.1.smithi191.stdout:5/280: dread - d0/f20 zero size 2024-09-19T09:34:58.770 INFO:tasks.workunit.client.1.smithi191.stdout:5/281: read d0/d4/d9/d1d/d29/d33/f40 [311140,90147] 0 2024-09-19T09:34:58.770 INFO:tasks.workunit.client.1.smithi191.stdout:2/191: mkdir d8/db/d41 0 2024-09-19T09:34:58.770 INFO:tasks.workunit.client.1.smithi191.stdout:2/192: creat d8/f42 x:0 0 0 2024-09-19T09:34:58.770 INFO:tasks.workunit.client.1.smithi191.stdout:2/193: truncate d8/d2a/f30 1032509 0 2024-09-19T09:34:58.770 INFO:tasks.workunit.client.1.smithi191.stdout:8/330: truncate d1/d16/f46 3056501 0 2024-09-19T09:34:58.770 INFO:tasks.workunit.client.1.smithi191.stdout:8/331: readlink d1/d7/d1a/l20 0 2024-09-19T09:34:58.771 INFO:tasks.workunit.client.1.smithi191.stdout:5/282: mknod d0/d4/d9/de/c6a 0 2024-09-19T09:34:58.771 INFO:tasks.workunit.client.1.smithi191.stdout:0/317: dread d0/d9/d1c/d1f/d24/d29/f49 [0,4194304] 0 2024-09-19T09:34:58.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.769+0000 7fac29436640 1 -- 172.21.15.112:0/1199302107 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fac1006e7b0 msgr2=0x7fac10070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:58.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.769+0000 7fac29436640 1 --2- 172.21.15.112:0/1199302107 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fac1006e7b0 0x7fac10070c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00b020 tx=0x7fac0c009da0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.769+0000 7fac29436640 1 -- 172.21.15.112:0/1199302107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac240fb430 msgr2=0x7fac2410f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:58.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.769+0000 7fac29436640 1 --2- 172.21.15.112:0/1199302107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac240fb430 0x7fac2410f310 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fac1400b790 tx=0x7fac140091d0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.769+0000 7fac29436640 1 -- 172.21.15.112:0/1199302107 shutdown_connections 2024-09-19T09:34:58.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.769+0000 7fac29436640 1 --2- 172.21.15.112:0/1199302107 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fac1006e7b0 0x7fac10070c60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.769+0000 7fac29436640 1 --2- 172.21.15.112:0/1199302107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac240fc700 0x7fac2410f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.769+0000 7fac29436640 1 --2- 172.21.15.112:0/1199302107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac240fb430 0x7fac2410f310 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.769+0000 7fac29436640 1 -- 172.21.15.112:0/1199302107 >> 172.21.15.112:0/1199302107 conn(0x7fac240f6c10 msgr2=0x7fac24065630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:58.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.769+0000 7fac29436640 1 -- 172.21.15.112:0/1199302107 shutdown_connections 2024-09-19T09:34:58.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.769+0000 7fac29436640 1 -- 172.21.15.112:0/1199302107 wait complete. 2024-09-19T09:34:58.773 INFO:tasks.workunit.client.1.smithi191.stdout:2/194: dread d8/db/d13/d23/f1f [0,4194304] 0 2024-09-19T09:34:58.773 INFO:tasks.workunit.client.1.smithi191.stdout:6/222: dwrite d2/de/d15/f36 [0,4194304] 0 2024-09-19T09:34:58.773 INFO:tasks.workunit.client.1.smithi191.stdout:1/241: dwrite d3/d9/da/d1e/d32/f45 [0,4194304] 0 2024-09-19T09:34:58.774 INFO:tasks.workunit.client.1.smithi191.stdout:1/242: fdatasync d3/d9/da/db/f49 0 2024-09-19T09:34:58.774 INFO:tasks.workunit.client.1.smithi191.stdout:8/332: mkdir d1/d4f/d6b 0 2024-09-19T09:34:58.774 INFO:tasks.workunit.client.1.smithi191.stdout:5/283: symlink d0/d4/d9/d1d/d22/l6b 0 2024-09-19T09:34:58.775 INFO:tasks.workunit.client.1.smithi191.stdout:2/195: rename d8/d2a/f30 to d8/db/d13/d23/f43 0 2024-09-19T09:34:58.777 INFO:tasks.workunit.client.1.smithi191.stdout:6/223: rmdir d2/de/d2a 39 2024-09-19T09:34:58.777 INFO:tasks.workunit.client.1.smithi191.stdout:2/196: dread d8/db/d13/d23/f1f [0,4194304] 0 2024-09-19T09:34:58.783 INFO:tasks.workunit.client.1.smithi191.stdout:5/284: creat d0/d4/d9/d1d/d29/d33/d45/d64/f6c x:0 0 0 2024-09-19T09:34:58.783 INFO:tasks.workunit.client.1.smithi191.stdout:5/285: readlink d0/d4/l6 0 2024-09-19T09:34:58.783 INFO:tasks.workunit.client.1.smithi191.stdout:5/286: chown d0/d4/d4a/f4b 7668 1 2024-09-19T09:34:58.784 INFO:tasks.workunit.client.1.smithi191.stdout:6/224: symlink d2/de/d2a/d2d/l4e 0 2024-09-19T09:34:58.801 INFO:tasks.workunit.client.1.smithi191.stdout:0/318: dwrite d0/d9/d1c/d1f/d24/d39/d58/f18 [0,4194304] 0 2024-09-19T09:34:58.802 INFO:tasks.workunit.client.1.smithi191.stdout:5/287: dread d0/d4/d9/d1d/d22/d3b/f3c [0,4194304] 0 2024-09-19T09:34:58.802 INFO:tasks.workunit.client.1.smithi191.stdout:5/288: stat d0/d4/d9/d1d/d29/c32 0 2024-09-19T09:34:58.805 INFO:tasks.workunit.client.1.smithi191.stdout:5/289: creat d0/d4/d9/d1d/d22/f6d x:0 0 0 2024-09-19T09:34:58.806 INFO:tasks.workunit.client.1.smithi191.stdout:0/319: write d0/d9/d1c/d1f/d24/d29/f49 [2938235,74306] 0 2024-09-19T09:34:58.808 INFO:tasks.workunit.client.1.smithi191.stdout:2/197: dwrite d8/f19 [0,4194304] 0 2024-09-19T09:34:58.808 INFO:tasks.workunit.client.1.smithi191.stdout:2/198: chown d8/db/d13/d40 0 1 2024-09-19T09:34:58.808 INFO:tasks.workunit.client.1.smithi191.stdout:2/199: dread - d8/f42 zero size 2024-09-19T09:34:58.808 INFO:tasks.workunit.client.1.smithi191.stdout:2/200: creat d8/f44 x:0 0 0 2024-09-19T09:34:58.808 INFO:tasks.workunit.client.1.smithi191.stdout:1/243: dwrite d3/d9/da/d1e/d25/f30 [0,4194304] 0 2024-09-19T09:34:58.809 INFO:tasks.workunit.client.1.smithi191.stdout:1/244: fsync d3/d9/f24 0 2024-09-19T09:34:58.809 INFO:tasks.workunit.client.1.smithi191.stdout:1/245: stat d3/d9/da/db/f4d 0 2024-09-19T09:34:58.810 INFO:tasks.workunit.client.1.smithi191.stdout:6/225: dwrite d2/fa [0,4194304] 0 2024-09-19T09:34:58.813 INFO:tasks.workunit.client.1.smithi191.stdout:2/201: creat d8/db/d41/f45 x:0 0 0 2024-09-19T09:34:58.813 INFO:tasks.workunit.client.1.smithi191.stdout:2/202: stat d8/db/d13/d23/f1f 0 2024-09-19T09:34:58.813 INFO:tasks.workunit.client.1.smithi191.stdout:2/203: fsync d8/db/d13/d23/f43 0 2024-09-19T09:34:58.814 INFO:tasks.workunit.client.1.smithi191.stdout:0/320: mknod d0/d9/c68 0 2024-09-19T09:34:58.814 INFO:tasks.workunit.client.1.smithi191.stdout:0/321: truncate d0/d9/d1c/d1f/d24/d39/d58/f67 1205788 0 2024-09-19T09:34:58.817 INFO:tasks.workunit.client.1.smithi191.stdout:4/291: sync 2024-09-19T09:34:58.817 INFO:tasks.workunit.client.1.smithi191.stdout:7/168: sync 2024-09-19T09:34:58.817 INFO:tasks.workunit.client.1.smithi191.stdout:7/169: truncate d2/f28 307849 0 2024-09-19T09:34:58.817 INFO:tasks.workunit.client.1.smithi191.stdout:7/170: creat d2/f47 x:0 0 0 2024-09-19T09:34:58.817 INFO:tasks.workunit.client.1.smithi191.stdout:7/171: write d2/f9 [580326,61014] 0 2024-09-19T09:34:58.818 INFO:tasks.workunit.client.1.smithi191.stdout:7/172: read - d2/f1a zero size 2024-09-19T09:34:58.818 INFO:tasks.workunit.client.1.smithi191.stdout:7/173: read - d2/f47 zero size 2024-09-19T09:34:58.819 INFO:tasks.workunit.client.1.smithi191.stdout:1/246: mkdir d3/d9/da/d1e/d32/d53/d57 0 2024-09-19T09:34:58.821 INFO:tasks.workunit.client.1.smithi191.stdout:0/322: mknod d0/d9/d1c/d20/c69 0 2024-09-19T09:34:58.824 INFO:tasks.workunit.client.1.smithi191.stdout:7/174: unlink d2/l15 0 2024-09-19T09:34:58.825 INFO:tasks.workunit.client.1.smithi191.stdout:0/323: fsync d0/d9/f25 0 2024-09-19T09:34:58.825 INFO:tasks.workunit.client.1.smithi191.stdout:0/324: fdatasync d0/d9/de/f55 0 2024-09-19T09:34:58.826 INFO:tasks.workunit.client.1.smithi191.stdout:0/325: readlink d0/d9/l5a 0 2024-09-19T09:34:58.833 INFO:tasks.workunit.client.1.smithi191.stdout:7/175: dread d2/f18 [0,4194304] 0 2024-09-19T09:34:58.833 INFO:tasks.workunit.client.1.smithi191.stdout:2/204: dread d8/db/d13/f15 [4194304,4194304] 0 2024-09-19T09:34:58.833 INFO:tasks.workunit.client.1.smithi191.stdout:2/205: write d8/f42 [560747,63105] 0 2024-09-19T09:34:58.833 INFO:tasks.workunit.client.1.smithi191.stdout:2/206: chown d8/c31 5819258 1 2024-09-19T09:34:58.834 INFO:tasks.workunit.client.1.smithi191.stdout:7/176: link d2/c35 d2/d2a/d33/c48 0 2024-09-19T09:34:58.835 INFO:tasks.workunit.client.1.smithi191.stdout:6/226: dwrite d2/de/f14 [0,4194304] 0 2024-09-19T09:34:58.835 INFO:tasks.workunit.client.1.smithi191.stdout:6/227: write d2/f34 [3329686,33459] 0 2024-09-19T09:34:58.837 INFO:tasks.workunit.client.1.smithi191.stdout:7/177: link d2/c19 d2/d2a/d38/c49 0 2024-09-19T09:34:58.839 INFO:tasks.workunit.client.1.smithi191.stdout:6/228: truncate d2/de/d2a/d2d/f1b 1097414 0 2024-09-19T09:34:58.839 INFO:tasks.workunit.client.1.smithi191.stdout:6/229: dread - d2/de/d19/d24/f4d zero size 2024-09-19T09:34:58.841 INFO:tasks.workunit.client.1.smithi191.stdout:6/230: mknod d2/de/d2a/d2d/d30/c4f 0 2024-09-19T09:34:58.843 INFO:tasks.workunit.client.1.smithi191.stdout:7/178: dread d2/f21 [0,4194304] 0 2024-09-19T09:34:58.844 INFO:tasks.workunit.client.1.smithi191.stdout:7/179: fdatasync d2/d2a/f2f 0 2024-09-19T09:34:58.844 INFO:tasks.workunit.client.1.smithi191.stdout:1/247: dwrite d3/d9/da/d42/f56 [0,4194304] 0 2024-09-19T09:34:58.844 INFO:tasks.workunit.client.1.smithi191.stdout:2/207: dread d8/db/d13/d23/f20 [0,4194304] 0 2024-09-19T09:34:58.844 INFO:tasks.workunit.client.1.smithi191.stdout:1/248: write d3/d9/da/d1e/f2d [572549,75850] 0 2024-09-19T09:34:58.845 INFO:tasks.workunit.client.1.smithi191.stdout:7/180: unlink d2/f1f 0 2024-09-19T09:34:58.848 INFO:tasks.workunit.client.1.smithi191.stdout:2/208: truncate d8/f2f 619458 0 2024-09-19T09:34:58.850 INFO:tasks.workunit.client.1.smithi191.stdout:2/209: getdents d8/db/d13 0 2024-09-19T09:34:58.851 INFO:tasks.workunit.client.1.smithi191.stdout:6/231: dread d2/de/d19/d1e/f21 [0,4194304] 0 2024-09-19T09:34:58.852 INFO:tasks.workunit.client.1.smithi191.stdout:6/232: getdents d2/de/d19/d24/d44 0 2024-09-19T09:34:58.859 INFO:tasks.workunit.client.1.smithi191.stdout:6/233: dread d2/de/f1d [0,4194304] 0 2024-09-19T09:34:58.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.883+0000 7f0b264d1640 1 -- 172.21.15.112:0/3352527316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b200fb440 msgr2=0x7f0b200fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:58.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.883+0000 7f0b264d1640 1 --2- 172.21.15.112:0/3352527316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b200fb440 0x7f0b200fb850 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0b100048d0 tx=0x7f0b10009da0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.883+0000 7f0b264d1640 1 -- 172.21.15.112:0/3352527316 shutdown_connections 2024-09-19T09:34:58.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.883+0000 7f0b264d1640 1 --2- 172.21.15.112:0/3352527316 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b200fc710 0x7f0b200fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.883+0000 7f0b264d1640 1 --2- 172.21.15.112:0/3352527316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b200fb440 0x7f0b200fb850 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.883+0000 7f0b264d1640 1 -- 172.21.15.112:0/3352527316 >> 172.21.15.112:0/3352527316 conn(0x7f0b200f6c20 msgr2=0x7f0b200f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:58.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.883+0000 7f0b264d1640 1 -- 172.21.15.112:0/3352527316 shutdown_connections 2024-09-19T09:34:58.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.883+0000 7f0b264d1640 1 -- 172.21.15.112:0/3352527316 wait complete. 2024-09-19T09:34:58.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.883+0000 7f0b264d1640 1 Processor -- start 2024-09-19T09:34:58.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.884+0000 7f0b264d1640 1 -- start start 2024-09-19T09:34:58.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.884+0000 7f0b264d1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b200fb440 0x7f0b2010fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:58.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.884+0000 7f0b264d1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b200fc710 0x7f0b20112350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:58.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.884+0000 7f0b264d1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200666d0 con 0x7f0b200fc710 2024-09-19T09:34:58.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.884+0000 7f0b264d1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b20066840 con 0x7f0b200fb440 2024-09-19T09:34:58.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.884+0000 7f0b1f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b200fc710 0x7f0b20112350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:58.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.884+0000 7f0b1f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b200fc710 0x7f0b20112350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59126/0 (socket says 172.21.15.112:59126) 2024-09-19T09:34:58.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.884+0000 7f0b1f7fe640 1 -- 172.21.15.112:0/1565488523 learned_addr learned my addr 172.21.15.112:0/1565488523 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:34:58.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.884+0000 7f0b1ffff640 1 --2- 172.21.15.112:0/1565488523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b200fb440 0x7f0b2010fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:58.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.884+0000 7f0b1f7fe640 1 -- 172.21.15.112:0/1565488523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b200fb440 msgr2=0x7f0b2010fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:58.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.884+0000 7f0b1f7fe640 1 --2- 172.21.15.112:0/1565488523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b200fb440 0x7f0b2010fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:58.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.884+0000 7f0b1f7fe640 1 -- 172.21.15.112:0/1565488523 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b10005040 con 0x7f0b200fc710 2024-09-19T09:34:58.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.884+0000 7f0b1f7fe640 1 --2- 172.21.15.112:0/1565488523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b200fc710 0x7f0b20112350 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0b14002a80 tx=0x7f0b14004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.884+0000 7f0b1cff9640 1 -- 172.21.15.112:0/1565488523 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b14007c30 con 0x7f0b200fc710 2024-09-19T09:34:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.885+0000 7f0b1cff9640 1 -- 172.21.15.112:0/1565488523 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0b1400f040 con 0x7f0b200fc710 2024-09-19T09:34:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.885+0000 7f0b264d1640 1 -- 172.21.15.112:0/1565488523 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b201128f0 con 0x7f0b200fc710 2024-09-19T09:34:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.885+0000 7f0b1cff9640 1 -- 172.21.15.112:0/1565488523 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b1400dab0 con 0x7f0b200fc710 2024-09-19T09:34:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.885+0000 7f0b264d1640 1 -- 172.21.15.112:0/1565488523 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b20112de0 con 0x7f0b200fc710 2024-09-19T09:34:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.886+0000 7f0b264d1640 1 -- 172.21.15.112:0/1565488523 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b200fa8a0 con 0x7f0b200fc710 2024-09-19T09:34:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.886+0000 7f0b1cff9640 1 -- 172.21.15.112:0/1565488523 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f0b1400dc10 con 0x7f0b200fc710 2024-09-19T09:34:58.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.886+0000 7f0b1cff9640 1 --2- 172.21.15.112:0/1565488523 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f0b0806e6e0 0x7f0b08070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:58.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.887+0000 7f0b1cff9640 1 -- 172.21.15.112:0/1565488523 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f0b1408d6c0 con 0x7f0b200fc710 2024-09-19T09:34:58.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.887+0000 7f0b1ffff640 1 --2- 172.21.15.112:0/1565488523 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f0b0806e6e0 0x7f0b08070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:58.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.887+0000 7f0b1ffff640 1 --2- 172.21.15.112:0/1565488523 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f0b0806e6e0 0x7f0b08070b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0b10000c00 tx=0x7f0b10035040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:58.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:58.891+0000 7f0b1cff9640 1 -- 172.21.15.112:0/1565488523 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f0b1404f6d0 con 0x7f0b200fc710 2024-09-19T09:34:58.933 INFO:tasks.workunit.client.1.smithi191.stdout:0/326: dwrite d0/d9/d1c/d1f/d24/d29/d30/d56/f66 [0,4194304] 0 2024-09-19T09:34:58.934 INFO:tasks.workunit.client.1.smithi191.stdout:1/249: dwrite d3/d9/da/d1e/d32/f3e [0,4194304] 0 2024-09-19T09:34:58.935 INFO:tasks.workunit.client.1.smithi191.stdout:2/210: rename d8/db/d13/d23/f3b to d8/d11/f46 0 2024-09-19T09:34:58.940 INFO:tasks.workunit.client.1.smithi191.stdout:0/327: link d0/d9/d1c/d1f/d24/d29/f3d d0/d9/de/d61/f6a 0 2024-09-19T09:34:58.946 INFO:tasks.workunit.client.1.smithi191.stdout:7/181: dwrite d2/f9 [0,4194304] 0 2024-09-19T09:34:58.946 INFO:tasks.workunit.client.1.smithi191.stdout:7/182: chown d2/ff 779967741 1 2024-09-19T09:34:58.946 INFO:tasks.workunit.client.1.smithi191.stdout:7/183: chown d2/d2a/d38/l46 973954 1 2024-09-19T09:34:58.946 INFO:tasks.workunit.client.1.smithi191.stdout:7/184: creat d2/f4a x:0 0 0 2024-09-19T09:34:58.946 INFO:tasks.workunit.client.1.smithi191.stdout:7/185: read - d2/f1a zero size 2024-09-19T09:34:58.948 INFO:tasks.workunit.client.1.smithi191.stdout:1/250: rename d3/l1f to d3/d9/da/d1e/d32/l58 0 2024-09-19T09:34:58.950 INFO:tasks.workunit.client.1.smithi191.stdout:2/211: write d8/db/f14 [313835,115613] 0 2024-09-19T09:34:58.950 INFO:tasks.workunit.client.1.smithi191.stdout:2/212: stat d8/d11/c28 0 2024-09-19T09:34:58.950 INFO:tasks.workunit.client.1.smithi191.stdout:2/213: creat d8/db/f47 x:0 0 0 2024-09-19T09:34:58.950 INFO:tasks.workunit.client.1.smithi191.stdout:2/214: creat d8/db/d13/d35/f48 x:0 0 0 2024-09-19T09:34:58.952 INFO:tasks.workunit.client.1.smithi191.stdout:1/251: symlink d3/d9/da/d1e/d32/l59 0 2024-09-19T09:34:58.953 INFO:tasks.workunit.client.1.smithi191.stdout:1/252: stat d3/d9/fe 0 2024-09-19T09:34:58.954 INFO:tasks.workunit.client.1.smithi191.stdout:0/328: link d0/d9/d1c/d1f/d24/d39/d58/f40 d0/d9/d54/f6b 0 2024-09-19T09:34:58.956 INFO:tasks.workunit.client.1.smithi191.stdout:7/186: dread d2/d2a/f2f [0,4194304] 0 2024-09-19T09:34:58.956 INFO:tasks.workunit.client.1.smithi191.stdout:7/187: stat d2/d2a/d33/f45 0 2024-09-19T09:34:58.957 INFO:tasks.workunit.client.1.smithi191.stdout:2/215: creat d8/d11/f49 x:0 0 0 2024-09-19T09:34:58.958 INFO:tasks.workunit.client.1.smithi191.stdout:2/216: chown d8/db/d13/d23/f29 5888619 1 2024-09-19T09:34:58.958 INFO:tasks.workunit.client.1.smithi191.stdout:1/253: symlink d3/d9/da/d1e/l5a 0 2024-09-19T09:34:58.959 INFO:tasks.workunit.client.1.smithi191.stdout:7/188: read d2/f7 [1320208,112002] 0 2024-09-19T09:34:58.959 INFO:tasks.workunit.client.1.smithi191.stdout:7/189: read - d2/f47 zero size 2024-09-19T09:34:58.960 INFO:tasks.workunit.client.1.smithi191.stdout:9/208: sync 2024-09-19T09:34:58.960 INFO:tasks.workunit.client.1.smithi191.stdout:3/178: sync 2024-09-19T09:34:58.960 INFO:tasks.workunit.client.1.smithi191.stdout:9/209: stat d3/db/d16/f1b 0 2024-09-19T09:34:58.961 INFO:tasks.workunit.client.1.smithi191.stdout:3/179: read fe [927009,44541] 0 2024-09-19T09:34:58.961 INFO:tasks.workunit.client.1.smithi191.stdout:3/180: fsync f9 0 2024-09-19T09:34:58.962 INFO:tasks.workunit.client.1.smithi191.stdout:2/217: rename d8/db/c26 to d8/db/d13/d23/c4a 0 2024-09-19T09:34:58.962 INFO:tasks.workunit.client.1.smithi191.stdout:2/218: rename d8/db/d13 to d8/db/d13/d23/d4b 22 2024-09-19T09:34:58.962 INFO:tasks.workunit.client.1.smithi191.stdout:2/219: write d8/db/d13/d23/f43 [61611,7432] 0 2024-09-19T09:34:58.962 INFO:tasks.workunit.client.1.smithi191.stdout:2/220: truncate d8/db/f47 84654 0 2024-09-19T09:34:58.963 INFO:tasks.workunit.client.1.smithi191.stdout:1/254: mkdir d3/d9/da/d1e/d32/d5b 0 2024-09-19T09:34:58.964 INFO:tasks.workunit.client.1.smithi191.stdout:7/190: creat d2/d39/f4b x:0 0 0 2024-09-19T09:34:58.966 INFO:tasks.workunit.client.1.smithi191.stdout:9/210: unlink d3/db/fd 0 2024-09-19T09:34:58.967 INFO:tasks.workunit.client.1.smithi191.stdout:3/181: creat d12/d13/d1a/d1b/d2e/d33/f41 x:0 0 0 2024-09-19T09:34:58.969 INFO:tasks.workunit.client.1.smithi191.stdout:2/221: symlink d8/db/d41/l4c 0 2024-09-19T09:34:58.969 INFO:tasks.workunit.client.1.smithi191.stdout:0/329: dread d0/d9/f4d [0,4194304] 0 2024-09-19T09:34:58.969 INFO:tasks.workunit.client.1.smithi191.stdout:7/191: dread d2/f28 [0,4194304] 0 2024-09-19T09:34:58.970 INFO:tasks.workunit.client.1.smithi191.stdout:1/255: link d3/d9/da/l4c d3/d9/l5c 0 2024-09-19T09:34:58.972 INFO:tasks.workunit.client.1.smithi191.stdout:9/211: mknod d3/db/d16/d17/d1c/c42 0 2024-09-19T09:34:58.973 INFO:tasks.workunit.client.1.smithi191.stdout:7/192: symlink d2/d2a/d33/l4c 0 2024-09-19T09:34:58.974 INFO:tasks.workunit.client.1.smithi191.stdout:1/256: truncate d3/d9/da/d1e/f31 3164787 0 2024-09-19T09:34:58.976 INFO:tasks.workunit.client.1.smithi191.stdout:7/193: symlink d2/d39/l4d 0 2024-09-19T09:34:58.976 INFO:tasks.workunit.client.1.smithi191.stdout:7/194: read d2/f18 [3783641,25857] 0 2024-09-19T09:34:58.978 INFO:tasks.workunit.client.1.smithi191.stdout:0/330: dread d0/d9/d1c/d1f/d24/d39/d58/f18 [0,4194304] 0 2024-09-19T09:34:58.978 INFO:tasks.workunit.client.1.smithi191.stdout:1/257: dread d3/d9/f17 [0,4194304] 0 2024-09-19T09:34:58.978 INFO:tasks.workunit.client.1.smithi191.stdout:1/258: chown d3/d9/da/d1e/d32/d53/f2c 159897712 1 2024-09-19T09:34:58.979 INFO:tasks.workunit.client.1.smithi191.stdout:9/212: write d3/db/f10 [2902653,31277] 0 2024-09-19T09:34:58.979 INFO:tasks.workunit.client.1.smithi191.stdout:9/213: chown d3/d8/c39 16095 1 2024-09-19T09:34:58.979 INFO:tasks.workunit.client.1.smithi191.stdout:9/214: stat d3/db/d16/d38/f3e 0 2024-09-19T09:34:58.979 INFO:tasks.workunit.client.1.smithi191.stdout:9/215: fdatasync d3/db/d16/d17/d1c/f1d 0 2024-09-19T09:34:58.981 INFO:tasks.workunit.client.1.smithi191.stdout:0/331: mkdir d0/d9/d1c/d1f/d24/d39/d58/d6c 0 2024-09-19T09:34:58.982 INFO:tasks.workunit.client.1.smithi191.stdout:2/222: write d8/db/d13/d23/f29 [629170,15409] 0 2024-09-19T09:34:58.984 INFO:tasks.workunit.client.1.smithi191.stdout:3/182: dwrite f11 [0,4194304] 0 2024-09-19T09:34:58.984 INFO:tasks.workunit.client.1.smithi191.stdout:3/183: fdatasync d12/d13/d1a/d1b/f27 0 2024-09-19T09:34:58.984 INFO:tasks.workunit.client.1.smithi191.stdout:3/184: rename d12/d13/d1a to d12/d13/d1a/d1b/d3c/d3f/d42 22 2024-09-19T09:34:58.984 INFO:tasks.workunit.client.1.smithi191.stdout:1/259: rename d3/d9/f13 to d3/d9/f5d 0 2024-09-19T09:34:58.984 INFO:tasks.workunit.client.1.smithi191.stdout:4/292: sync 2024-09-19T09:34:58.984 INFO:tasks.workunit.client.1.smithi191.stdout:5/290: sync 2024-09-19T09:34:58.984 INFO:tasks.workunit.client.1.smithi191.stdout:8/333: sync 2024-09-19T09:34:58.984 INFO:tasks.workunit.client.1.smithi191.stdout:6/234: sync 2024-09-19T09:34:58.984 INFO:tasks.workunit.client.1.smithi191.stdout:8/334: chown d1/d22/d34 153448 1 2024-09-19T09:34:58.984 INFO:tasks.workunit.client.1.smithi191.stdout:5/291: chown d0/d4/d9/f59 24804 1 2024-09-19T09:34:58.984 INFO:tasks.workunit.client.1.smithi191.stdout:6/235: chown d2/de/d2a/d2d/c20 198061 1 2024-09-19T09:34:58.984 INFO:tasks.workunit.client.1.smithi191.stdout:4/293: write f4 [688248,52226] 0 2024-09-19T09:34:58.985 INFO:tasks.workunit.client.1.smithi191.stdout:7/195: getdents d2/d2a/d38 0 2024-09-19T09:34:58.987 INFO:tasks.workunit.client.1.smithi191.stdout:0/332: mkdir d0/d9/d1c/d1f/d24/d6d 0 2024-09-19T09:34:58.990 INFO:tasks.workunit.client.1.smithi191.stdout:3/185: mkdir d12/d43 0 2024-09-19T09:34:58.991 INFO:tasks.workunit.client.1.smithi191.stdout:1/260: mknod d3/d9/da/d1e/d32/d53/d57/c5e 0 2024-09-19T09:34:58.992 INFO:tasks.workunit.client.1.smithi191.stdout:0/333: dread d0/d9/d1c/d1f/d24/d29/f3b [0,4194304] 0 2024-09-19T09:34:58.992 INFO:tasks.workunit.client.1.smithi191.stdout:0/334: fsync d0/d9/d1c/d1f/d24/d29/f49 0 2024-09-19T09:34:58.993 INFO:tasks.workunit.client.1.smithi191.stdout:7/196: write d2/f17 [1874022,90111] 0 2024-09-19T09:34:58.993 INFO:tasks.workunit.client.1.smithi191.stdout:7/197: readlink d2/d2a/l30 0 2024-09-19T09:34:58.994 INFO:tasks.workunit.client.1.smithi191.stdout:8/335: symlink d1/d16/d23/d3e/l6c 0 2024-09-19T09:34:58.994 INFO:tasks.workunit.client.1.smithi191.stdout:0/335: dread d0/f50 [0,4194304] 0 2024-09-19T09:34:58.995 INFO:tasks.workunit.client.1.smithi191.stdout:6/236: rename d2/de/l12 to d2/de/d15/l50 0 2024-09-19T09:34:58.997 INFO:tasks.workunit.client.1.smithi191.stdout:4/294: mkdir d5/d38/d6b 0 2024-09-19T09:34:58.997 INFO:tasks.workunit.client.1.smithi191.stdout:4/295: fdatasync d5/d1b/d1c/d2f/f47 0 2024-09-19T09:34:58.997 INFO:tasks.workunit.client.1.smithi191.stdout:4/296: chown d5/d1b/d1c/d24/d32/f13 44441 1 2024-09-19T09:34:58.998 INFO:tasks.workunit.client.1.smithi191.stdout:3/186: dread f9 [0,4194304] 0 2024-09-19T09:34:58.998 INFO:tasks.workunit.client.1.smithi191.stdout:5/292: rmdir d0/d4/d9/d1d/d22/d5c 39 2024-09-19T09:34:58.998 INFO:tasks.workunit.client.1.smithi191.stdout:5/293: write d0/d1f/f56 [1384024,24617] 0 2024-09-19T09:34:59.000 INFO:tasks.workunit.client.1.smithi191.stdout:7/198: unlink d2/fc 0 2024-09-19T09:34:59.003 INFO:tasks.workunit.client.1.smithi191.stdout:0/336: link d0/d9/d1c/d1f/d24/d39/d58/c43 d0/d9/d1c/d1f/d24/d39/d58/c6e 0 2024-09-19T09:34:59.003 INFO:tasks.workunit.client.1.smithi191.stdout:0/337: write d0/d9/d1c/d1f/d24/d39/d58/f1b [877660,13489] 0 2024-09-19T09:34:59.004 INFO:tasks.workunit.client.1.smithi191.stdout:1/261: write d3/d9/da/db/f49 [395564,42379] 0 2024-09-19T09:34:59.004 INFO:tasks.workunit.client.1.smithi191.stdout:1/262: readlink d3/d9/da/d1e/d25/l28 0 2024-09-19T09:34:59.004 INFO:tasks.workunit.client.1.smithi191.stdout:1/263: dread - d3/d9/f4e zero size 2024-09-19T09:34:59.005 INFO:tasks.workunit.client.1.smithi191.stdout:1/264: chown d3/d9/da/d1e/d32 10281 1 2024-09-19T09:34:59.005 INFO:tasks.workunit.client.1.smithi191.stdout:8/336: write d1/d16/d23/f43 [3157598,49177] 0 2024-09-19T09:34:59.007 INFO:tasks.workunit.client.1.smithi191.stdout:1/265: dread d3/d9/da/d1e/f2d [0,4194304] 0 2024-09-19T09:34:59.007 INFO:tasks.workunit.client.1.smithi191.stdout:3/187: rename d12/d13/d1a/d1b/d2e/d33/f41 to d12/d43/f44 0 2024-09-19T09:34:59.008 INFO:tasks.workunit.client.1.smithi191.stdout:5/294: rmdir d0/d4/d9/d1d/d29 39 2024-09-19T09:34:59.010 INFO:tasks.workunit.client.1.smithi191.stdout:0/338: mkdir d0/d6f 0 2024-09-19T09:34:59.013 INFO:tasks.workunit.client.1.smithi191.stdout:8/337: mkdir d1/d7/d1a/d6d 0 2024-09-19T09:34:59.014 INFO:tasks.workunit.client.1.smithi191.stdout:8/338: chown d1/d7/d1a/d6d 3 1 2024-09-19T09:34:59.015 INFO:tasks.workunit.client.1.smithi191.stdout:0/339: mknod d0/d9/d1c/d1f/d24/d39/d58/d6c/c70 0 2024-09-19T09:34:59.016 INFO:tasks.workunit.client.1.smithi191.stdout:3/188: dread f11 [0,4194304] 0 2024-09-19T09:34:59.016 INFO:tasks.workunit.client.1.smithi191.stdout:3/189: dread - d12/d43/f44 zero size 2024-09-19T09:34:59.016 INFO:tasks.workunit.client.1.smithi191.stdout:3/190: fdatasync d12/d13/d1a/d1b/f27 0 2024-09-19T09:34:59.016 INFO:tasks.workunit.client.1.smithi191.stdout:6/237: getdents d2/de/d15 0 2024-09-19T09:34:59.018 INFO:tasks.workunit.client.1.smithi191.stdout:5/295: getdents d0/d4/d9 0 2024-09-19T09:34:59.018 INFO:tasks.workunit.client.1.smithi191.stdout:3/191: symlink d12/d13/l45 0 2024-09-19T09:34:59.018 INFO:tasks.workunit.client.1.smithi191.stdout:3/192: write ff [2108442,41092] 0 2024-09-19T09:34:59.020 INFO:tasks.workunit.client.1.smithi191.stdout:6/238: truncate d2/de/d2a/d2d/f1b 295258 0 2024-09-19T09:34:59.021 INFO:tasks.workunit.client.1.smithi191.stdout:3/193: mknod d12/d13/d1a/c46 0 2024-09-19T09:34:59.021 INFO:tasks.workunit.client.1.smithi191.stdout:6/239: truncate d2/de/f27 151194 0 2024-09-19T09:34:59.023 INFO:tasks.workunit.client.1.smithi191.stdout:3/194: mknod d12/d13/c47 0 2024-09-19T09:34:59.024 INFO:tasks.workunit.client.1.smithi191.stdout:1/266: dread d3/d9/da/db/f49 [0,4194304] 0 2024-09-19T09:34:59.024 INFO:tasks.workunit.client.1.smithi191.stdout:6/240: symlink d2/l51 0 2024-09-19T09:34:59.025 INFO:tasks.workunit.client.1.smithi191.stdout:0/340: write d0/d9/d1c/d1f/d24/f60 [3764619,95724] 0 2024-09-19T09:34:59.026 INFO:tasks.workunit.client.1.smithi191.stdout:4/297: dwrite d5/fe [0,4194304] 0 2024-09-19T09:34:59.026 INFO:tasks.workunit.client.1.smithi191.stdout:3/195: rename lb to d12/d13/d1a/l48 0 2024-09-19T09:34:59.026 INFO:tasks.workunit.client.1.smithi191.stdout:4/298: write d5/d1b/d1c/d24/d32/d21/d27/f53 [782272,73138] 0 2024-09-19T09:34:59.026 INFO:tasks.workunit.client.1.smithi191.stdout:4/299: write d5/f4e [1637708,14706] 0 2024-09-19T09:34:59.026 INFO:tasks.workunit.client.1.smithi191.stdout:7/199: dwrite d2/d2a/f31 [0,4194304] 0 2024-09-19T09:34:59.028 INFO:tasks.workunit.client.1.smithi191.stdout:6/241: creat d2/de/f52 x:0 0 0 2024-09-19T09:34:59.029 INFO:tasks.workunit.client.1.smithi191.stdout:3/196: symlink d12/d13/d1a/d1b/l49 0 2024-09-19T09:34:59.030 INFO:tasks.workunit.client.1.smithi191.stdout:1/267: dread d3/d9/fe [0,4194304] 0 2024-09-19T09:34:59.030 INFO:tasks.workunit.client.1.smithi191.stdout:1/268: read d3/d9/da/d1e/d32/d53/f1c [232730,11637] 0 2024-09-19T09:34:59.035 INFO:tasks.workunit.client.1.smithi191.stdout:5/296: dread d0/d4/d9/de/ff [0,4194304] 0 2024-09-19T09:34:59.035 INFO:tasks.workunit.client.1.smithi191.stdout:5/297: dread - d0/d4/d9/d1d/d29/f62 zero size 2024-09-19T09:34:59.038 INFO:tasks.workunit.client.1.smithi191.stdout:3/197: symlink d12/d37/d3d/l4a 0 2024-09-19T09:34:59.038 INFO:tasks.workunit.client.1.smithi191.stdout:3/198: write f9 [4157505,83537] 0 2024-09-19T09:34:59.039 INFO:tasks.workunit.client.1.smithi191.stdout:7/200: rmdir d2 39 2024-09-19T09:34:59.039 INFO:tasks.workunit.client.1.smithi191.stdout:6/242: dread d2/de/d15/f26 [0,4194304] 0 2024-09-19T09:34:59.039 INFO:tasks.workunit.client.1.smithi191.stdout:6/243: fsync d2/de/d19/d1e/f21 0 2024-09-19T09:34:59.039 INFO:tasks.workunit.client.1.smithi191.stdout:6/244: fdatasync d2/de/d2a/d2d/f1b 0 2024-09-19T09:34:59.040 INFO:tasks.workunit.client.1.smithi191.stdout:6/245: write d2/de/f52 [734834,62107] 0 2024-09-19T09:34:59.040 INFO:tasks.workunit.client.1.smithi191.stdout:0/341: dread d0/d9/d1c/d20/f31 [0,4194304] 0 2024-09-19T09:34:59.040 INFO:tasks.workunit.client.1.smithi191.stdout:0/342: write d0/d9/d1c/d1f/d24/f63 [1445484,39492] 0 2024-09-19T09:34:59.042 INFO:tasks.workunit.client.1.smithi191.stdout:7/201: rmdir d2/d2a/d38 39 2024-09-19T09:34:59.044 INFO:tasks.workunit.client.1.smithi191.stdout:6/246: symlink d2/de/d19/d24/l53 0 2024-09-19T09:34:59.044 INFO:tasks.workunit.client.1.smithi191.stdout:6/247: creat d2/de/d19/d24/f54 x:0 0 0 2024-09-19T09:34:59.045 INFO:tasks.workunit.client.1.smithi191.stdout:6/248: dread d2/de/d19/d24/f29 [0,4194304] 0 2024-09-19T09:34:59.045 INFO:tasks.workunit.client.1.smithi191.stdout:6/249: write d2/f34 [9166388,87885] 0 2024-09-19T09:34:59.045 INFO:tasks.workunit.client.1.smithi191.stdout:6/250: chown d2/de/f14 5 1 2024-09-19T09:34:59.045 INFO:tasks.workunit.client.1.smithi191.stdout:0/343: symlink d0/d9/d1c/d1f/d24/d53/l71 0 2024-09-19T09:34:59.045 INFO:tasks.workunit.client.1.smithi191.stdout:0/344: truncate d0/d9/d1c/d1f/d24/f3f 5702554 0 2024-09-19T09:34:59.046 INFO:tasks.workunit.client.1.smithi191.stdout:7/202: mknod d2/d39/c4e 0 2024-09-19T09:34:59.046 INFO:tasks.workunit.client.1.smithi191.stdout:7/203: chown d2/f4a 109 1 2024-09-19T09:34:59.047 INFO:tasks.workunit.client.1.smithi191.stdout:4/300: dwrite d5/d1b/d1c/d28/f4b [0,4194304] 0 2024-09-19T09:34:59.047 INFO:tasks.workunit.client.1.smithi191.stdout:4/301: write d5/d1b/d1c/f5a [436555,10109] 0 2024-09-19T09:34:59.048 INFO:tasks.workunit.client.1.smithi191.stdout:6/251: getdents d2 0 2024-09-19T09:34:59.048 INFO:tasks.workunit.client.1.smithi191.stdout:6/252: creat d2/de/d19/d24/f55 x:0 0 0 2024-09-19T09:34:59.048 INFO:tasks.workunit.client.1.smithi191.stdout:0/345: creat d0/d9/d1c/d1f/f72 x:0 0 0 2024-09-19T09:34:59.051 INFO:tasks.workunit.client.1.smithi191.stdout:6/253: rmdir d2/de/d2a 39 2024-09-19T09:34:59.051 INFO:tasks.workunit.client.1.smithi191.stdout:6/254: stat d2/de/d19/d24/f4d 0 2024-09-19T09:34:59.059 INFO:tasks.workunit.client.1.smithi191.stdout:7/204: write d2/fd [915813,120213] 0 2024-09-19T09:34:59.059 INFO:tasks.workunit.client.1.smithi191.stdout:7/205: chown d2/c26 5033 1 2024-09-19T09:34:59.059 INFO:tasks.workunit.client.1.smithi191.stdout:7/206: fsync d2/f18 0 2024-09-19T09:34:59.060 INFO:tasks.workunit.client.1.smithi191.stdout:7/207: mkdir d2/d2a/d4f 0 2024-09-19T09:34:59.061 INFO:tasks.workunit.client.1.smithi191.stdout:7/208: rename d2/l3b to d2/d2a/d4f/l50 0 2024-09-19T09:34:59.061 INFO:tasks.workunit.client.1.smithi191.stdout:0/346: dread d0/d9/f4d [0,4194304] 0 2024-09-19T09:34:59.061 INFO:tasks.workunit.client.1.smithi191.stdout:0/347: read d0/d9/d1c/d1f/d24/f60 [16006,63794] 0 2024-09-19T09:34:59.063 INFO:tasks.workunit.client.1.smithi191.stdout:7/209: rename d2/c2e to d2/d39/d3a/c51 0 2024-09-19T09:34:59.065 INFO:tasks.workunit.client.1.smithi191.stdout:0/348: mkdir d0/d9/d1c/d20/d73 0 2024-09-19T09:34:59.065 INFO:tasks.workunit.client.1.smithi191.stdout:7/210: mknod d2/d39/d3a/d3c/c52 0 2024-09-19T09:34:59.066 INFO:tasks.workunit.client.1.smithi191.stdout:7/211: write d2/f7 [847753,43252] 0 2024-09-19T09:34:59.067 INFO:tasks.workunit.client.1.smithi191.stdout:4/302: dwrite d5/d1b/d1c/d24/d32/f36 [0,4194304] 0 2024-09-19T09:34:59.067 INFO:tasks.workunit.client.1.smithi191.stdout:0/349: creat d0/d9/d1c/f74 x:0 0 0 2024-09-19T09:34:59.069 INFO:tasks.workunit.client.1.smithi191.stdout:7/212: link d2/d2a/c2c d2/d2a/d4f/c53 0 2024-09-19T09:34:59.070 INFO:tasks.workunit.client.1.smithi191.stdout:4/303: mknod d5/d1b/d1c/d24/c6c 0 2024-09-19T09:34:59.070 INFO:tasks.workunit.client.1.smithi191.stdout:4/304: chown d5/fe 1852893 1 2024-09-19T09:34:59.071 INFO:tasks.workunit.client.1.smithi191.stdout:7/213: truncate d2/f9 3765803 0 2024-09-19T09:34:59.073 INFO:tasks.workunit.client.1.smithi191.stdout:4/305: mkdir d5/d38/d6d 0 2024-09-19T09:34:59.075 INFO:tasks.workunit.client.1.smithi191.stdout:4/306: rename d5/d1b/c26 to d5/d1b/d1c/d2f/c6e 0 2024-09-19T09:34:59.075 INFO:tasks.workunit.client.1.smithi191.stdout:4/307: readlink d5/d1b/d1c/d24/d32/l1a 0 2024-09-19T09:34:59.075 INFO:tasks.workunit.client.1.smithi191.stdout:6/255: dwrite d2/de/f52 [0,4194304] 0 2024-09-19T09:34:59.075 INFO:tasks.workunit.client.1.smithi191.stdout:6/256: write d2/de/d2a/d2d/f1b [1137770,30177] 0 2024-09-19T09:34:59.075 INFO:tasks.workunit.client.1.smithi191.stdout:6/257: fsync d2/de/d19/d24/f55 0 2024-09-19T09:34:59.077 INFO:tasks.workunit.client.1.smithi191.stdout:4/308: link d5/d1b/d1c/d24/d32/d21/d5c/c65 d5/d1b/d1c/d24/d32/d21/c6f 0 2024-09-19T09:34:59.087 INFO:tasks.workunit.client.1.smithi191.stdout:4/309: symlink d5/d1b/d1c/d24/d32/d21/d56/l70 0 2024-09-19T09:34:59.087 INFO:tasks.workunit.client.1.smithi191.stdout:4/310: getdents d5/d38/d6b 0 2024-09-19T09:34:59.088 INFO:tasks.workunit.client.1.smithi191.stdout:4/311: mknod d5/d1b/d1c/d24/d32/d21/d56/c71 0 2024-09-19T09:34:59.088 INFO:tasks.workunit.client.1.smithi191.stdout:4/312: dread - d5/d1b/d61/f64 zero size 2024-09-19T09:34:59.089 INFO:tasks.workunit.client.1.smithi191.stdout:4/313: creat d5/d1b/d1c/d24/d32/d21/d56/f72 x:0 0 0 2024-09-19T09:34:59.090 INFO:tasks.workunit.client.1.smithi191.stdout:4/314: readlink d5/d1b/d61/l6a 0 2024-09-19T09:34:59.090 INFO:tasks.workunit.client.1.smithi191.stdout:4/315: truncate d5/d1b/d1c/d24/d32/f2d 169745 0 2024-09-19T09:34:59.091 INFO:tasks.workunit.client.1.smithi191.stdout:4/316: mkdir d5/d38/d73 0 2024-09-19T09:34:59.093 INFO:tasks.workunit.client.1.smithi191.stdout:7/214: dwrite d2/d2a/f2f [4194304,4194304] 0 2024-09-19T09:34:59.093 INFO:tasks.workunit.client.1.smithi191.stdout:6/258: dwrite d2/de/d19/d24/f2c [0,4194304] 0 2024-09-19T09:34:59.099 INFO:tasks.workunit.client.1.smithi191.stdout:7/215: dread d2/f18 [0,4194304] 0 2024-09-19T09:34:59.102 INFO:tasks.workunit.client.1.smithi191.stdout:6/259: dread d2/de/d15/f36 [0,4194304] 0 2024-09-19T09:34:59.102 INFO:tasks.workunit.client.1.smithi191.stdout:6/260: creat d2/de/d19/d24/f56 x:0 0 0 2024-09-19T09:34:59.107 INFO:tasks.workunit.client.1.smithi191.stdout:4/317: dwrite d5/d1b/d1c/d24/d32/f1e [0,4194304] 0 2024-09-19T09:34:59.107 INFO:tasks.workunit.client.1.smithi191.stdout:4/318: fdatasync d5/d1b/d1c/d2f/d37/f62 0 2024-09-19T09:34:59.108 INFO:tasks.workunit.client.1.smithi191.stdout:4/319: mkdir d5/d1b/d74 0 2024-09-19T09:34:59.109 INFO:tasks.workunit.client.1.smithi191.stdout:4/320: rename d5/d1b/d1c/d24/d32/f2d to d5/d1b/d1c/d24/d32/d21/f75 0 2024-09-19T09:34:59.110 INFO:tasks.workunit.client.1.smithi191.stdout:4/321: creat d5/d1b/d1c/d24/d32/f76 x:0 0 0 2024-09-19T09:34:59.111 INFO:tasks.workunit.client.1.smithi191.stdout:4/322: chown d5/d1b/d1c/d24/d32/d21/d27/f53 322341 1 2024-09-19T09:34:59.117 INFO:tasks.workunit.client.1.smithi191.stdout:7/216: dwrite d2/f47 [0,4194304] 0 2024-09-19T09:34:59.119 INFO:tasks.workunit.client.1.smithi191.stdout:7/217: creat d2/d2a/d33/f54 x:0 0 0 2024-09-19T09:34:59.120 INFO:tasks.workunit.client.1.smithi191.stdout:7/218: symlink d2/l55 0 2024-09-19T09:34:59.121 INFO:tasks.workunit.client.1.smithi191.stdout:7/219: creat d2/d39/d3a/d3c/f56 x:0 0 0 2024-09-19T09:34:59.121 INFO:tasks.workunit.client.1.smithi191.stdout:7/220: chown d2/d2a/d4f 328 1 2024-09-19T09:34:59.121 INFO:tasks.workunit.client.1.smithi191.stdout:7/221: chown d2/l22 24916 1 2024-09-19T09:34:59.121 INFO:tasks.workunit.client.1.smithi191.stdout:7/222: fdatasync d2/d39/f4b 0 2024-09-19T09:34:59.122 INFO:tasks.workunit.client.1.smithi191.stdout:2/223: sync 2024-09-19T09:34:59.122 INFO:tasks.workunit.client.1.smithi191.stdout:9/216: sync 2024-09-19T09:34:59.122 INFO:tasks.workunit.client.1.smithi191.stdout:9/217: chown d3/db/f11 4153662 1 2024-09-19T09:34:59.124 INFO:tasks.workunit.client.1.smithi191.stdout:2/224: mkdir d8/db/d4d 0 2024-09-19T09:34:59.124 INFO:tasks.workunit.client.1.smithi191.stdout:2/225: write d8/db/d13/d23/f43 [27149,28732] 0 2024-09-19T09:34:59.124 INFO:tasks.workunit.client.1.smithi191.stdout:2/226: mkdir d8/db/d4e 0 2024-09-19T09:34:59.124 INFO:tasks.workunit.client.1.smithi191.stdout:2/227: dread - d8/db/d13/d35/f48 zero size 2024-09-19T09:34:59.125 INFO:tasks.workunit.client.1.smithi191.stdout:4/323: dwrite d5/d1b/d1c/d2f/d19/f3a [0,4194304] 0 2024-09-19T09:34:59.125 INFO:tasks.workunit.client.1.smithi191.stdout:4/324: fsync d5/d1b/d61/f64 0 2024-09-19T09:34:59.126 INFO:tasks.workunit.client.1.smithi191.stdout:4/325: write d5/d1b/d1c/d28/f48 [127904,79223] 0 2024-09-19T09:34:59.126 INFO:tasks.workunit.client.1.smithi191.stdout:4/326: chown d5/d1b/d1c/d24/d32/f16 11226834 1 2024-09-19T09:34:59.126 INFO:tasks.workunit.client.1.smithi191.stdout:2/228: symlink d8/d11/l4f 0 2024-09-19T09:34:59.126 INFO:tasks.workunit.client.1.smithi191.stdout:9/218: dread d3/d8/f13 [0,4194304] 0 2024-09-19T09:34:59.126 INFO:tasks.workunit.client.1.smithi191.stdout:9/219: chown d3/d8 38455701 1 2024-09-19T09:34:59.126 INFO:tasks.workunit.client.1.smithi191.stdout:9/220: chown d3/db/d16 0 1 2024-09-19T09:34:59.126 INFO:tasks.workunit.client.1.smithi191.stdout:4/327: mknod d5/d1b/d1c/d2f/c77 0 2024-09-19T09:34:59.127 INFO:tasks.workunit.client.1.smithi191.stdout:9/221: truncate d3/d8/f15 1852107 0 2024-09-19T09:34:59.128 INFO:tasks.workunit.client.1.smithi191.stdout:4/328: mkdir d5/d1b/d1c/d24/d32/d21/d78 0 2024-09-19T09:34:59.129 INFO:tasks.workunit.client.1.smithi191.stdout:9/222: creat d3/db/d16/f43 x:0 0 0 2024-09-19T09:34:59.130 INFO:tasks.workunit.client.1.smithi191.stdout:4/329: rename d5/d1b/d1c/d24/d32/d21/d27/f3c to d5/d1b/d1c/d24/d32/d21/d78/f79 0 2024-09-19T09:34:59.131 INFO:tasks.workunit.client.1.smithi191.stdout:9/223: truncate d3/d8/fc 320827 0 2024-09-19T09:34:59.132 INFO:tasks.workunit.client.1.smithi191.stdout:9/224: mknod d3/c44 0 2024-09-19T09:34:59.138 INFO:tasks.workunit.client.1.smithi191.stdout:2/229: write d8/d11/f38 [143390,100802] 0 2024-09-19T09:34:59.138 INFO:tasks.workunit.client.1.smithi191.stdout:2/230: truncate d8/f42 1056945 0 2024-09-19T09:34:59.159 INFO:tasks.workunit.client.1.smithi191.stdout:4/330: dwrite d5/d1b/d1c/d24/d32/d21/d78/f79 [0,4194304] 0 2024-09-19T09:34:59.159 INFO:tasks.workunit.client.1.smithi191.stdout:2/231: dwrite d8/db/d13/d23/f1f [0,4194304] 0 2024-09-19T09:34:59.159 INFO:tasks.workunit.client.1.smithi191.stdout:9/225: dwrite d3/db/d16/f1f [0,4194304] 0 2024-09-19T09:34:59.159 INFO:tasks.workunit.client.1.smithi191.stdout:9/226: read d3/d8/fc [186169,33985] 0 2024-09-19T09:34:59.164 INFO:tasks.workunit.client.1.smithi191.stdout:2/232: rename d8/db/d13/d23/c4a to d8/d11/d3f/c50 0 2024-09-19T09:34:59.164 INFO:tasks.workunit.client.1.smithi191.stdout:9/227: truncate d3/d8/f15 1814242 0 2024-09-19T09:34:59.165 INFO:tasks.workunit.client.1.smithi191.stdout:9/228: chown d3/c44 174667 1 2024-09-19T09:34:59.166 INFO:tasks.workunit.client.1.smithi191.stdout:2/233: truncate d8/f2f 516304 0 2024-09-19T09:34:59.166 INFO:tasks.workunit.client.1.smithi191.stdout:2/234: readlink d8/db/d41/l4c 0 2024-09-19T09:34:59.167 INFO:tasks.workunit.client.1.smithi191.stdout:9/229: truncate d3/db/d16/d17/d1c/f36 1262937 0 2024-09-19T09:34:59.168 INFO:tasks.workunit.client.1.smithi191.stdout:9/230: mknod d3/db/c45 0 2024-09-19T09:34:59.179 INFO:tasks.workunit.client.1.smithi191.stdout:4/331: dwrite d5/d1b/d1c/d24/d32/f5d [0,4194304] 0 2024-09-19T09:34:59.180 INFO:tasks.workunit.client.1.smithi191.stdout:4/332: chown d5/d1b/d1c/d2f/d37/d59 83674660 1 2024-09-19T09:34:59.180 INFO:tasks.workunit.client.1.smithi191.stdout:4/333: creat d5/d1b/d1c/d2f/d37/f7a x:0 0 0 2024-09-19T09:34:59.183 INFO:tasks.workunit.client.1.smithi191.stdout:4/334: creat d5/d1b/d1c/d24/d32/d21/d78/f7b x:0 0 0 2024-09-19T09:34:59.185 INFO:tasks.workunit.client.1.smithi191.stdout:4/335: link d5/d1b/d1c/d2f/d19/cb d5/d1b/d1c/d24/d32/c7c 0 2024-09-19T09:34:59.186 INFO:tasks.workunit.client.1.smithi191.stdout:4/336: mknod d5/c7d 0 2024-09-19T09:34:59.188 INFO:tasks.workunit.client.1.smithi191.stdout:4/337: mknod d5/d38/c7e 0 2024-09-19T09:34:59.192 INFO:tasks.workunit.client.1.smithi191.stdout:9/231: dwrite f2 [0,4194304] 0 2024-09-19T09:34:59.192 INFO:tasks.workunit.client.1.smithi191.stdout:2/235: dwrite d8/db/d41/f45 [0,4194304] 0 2024-09-19T09:34:59.202 INFO:tasks.workunit.client.1.smithi191.stdout:2/236: truncate d8/db/d41/f45 660401 0 2024-09-19T09:34:59.203 INFO:tasks.workunit.client.1.smithi191.stdout:9/232: write d3/db/d16/f37 [2514836,38837] 0 2024-09-19T09:34:59.204 INFO:tasks.workunit.client.1.smithi191.stdout:9/233: unlink d3/c41 0 2024-09-19T09:34:59.204 INFO:tasks.workunit.client.1.smithi191.stdout:9/234: fdatasync d3/db/d16/f2a 0 2024-09-19T09:34:59.206 INFO:tasks.workunit.client.1.smithi191.stdout:9/235: rename d3/db/d16/d17/c30 to d3/d8/c46 0 2024-09-19T09:34:59.206 INFO:tasks.workunit.client.1.smithi191.stdout:4/338: dwrite d5/d1b/d1c/d2f/d19/f34 [0,4194304] 0 2024-09-19T09:34:59.206 INFO:tasks.workunit.client.1.smithi191.stdout:4/339: creat d5/d1b/d1c/d24/d32/d21/d4a/f7f x:0 0 0 2024-09-19T09:34:59.206 INFO:tasks.workunit.client.1.smithi191.stdout:4/340: write d5/d1b/d1c/d24/d32/d21/d78/f79 [4489898,114599] 0 2024-09-19T09:34:59.208 INFO:tasks.workunit.client.1.smithi191.stdout:9/236: mkdir d3/db/d16/d47 0 2024-09-19T09:34:59.208 INFO:tasks.workunit.client.1.smithi191.stdout:9/237: write d3/d8/f3b [3136522,78208] 0 2024-09-19T09:34:59.211 INFO:tasks.workunit.client.1.smithi191.stdout:4/341: link d5/d1b/d1c/d2f/d37/d59/l66 d5/d1b/l80 0 2024-09-19T09:34:59.212 INFO:tasks.workunit.client.1.smithi191.stdout:1/269: sync 2024-09-19T09:34:59.212 INFO:tasks.workunit.client.1.smithi191.stdout:0/350: sync 2024-09-19T09:34:59.212 INFO:tasks.workunit.client.1.smithi191.stdout:8/339: sync 2024-09-19T09:34:59.213 INFO:tasks.workunit.client.1.smithi191.stdout:3/199: sync 2024-09-19T09:34:59.213 INFO:tasks.workunit.client.1.smithi191.stdout:3/200: write d12/d43/f44 [890532,106820] 0 2024-09-19T09:34:59.213 INFO:tasks.workunit.client.1.smithi191.stdout:5/298: sync 2024-09-19T09:34:59.214 INFO:tasks.workunit.client.1.smithi191.stdout:8/340: rmdir d1 39 2024-09-19T09:34:59.214 INFO:tasks.workunit.client.1.smithi191.stdout:8/341: fdatasync d1/d16/f4a 0 2024-09-19T09:34:59.217 INFO:tasks.workunit.client.1.smithi191.stdout:3/201: rename d12/d13/c1d to d12/d13/d1a/d1b/c4b 0 2024-09-19T09:34:59.217 INFO:tasks.workunit.client.1.smithi191.stdout:3/202: creat d12/d13/d1a/f4c x:0 0 0 2024-09-19T09:34:59.217 INFO:tasks.workunit.client.1.smithi191.stdout:3/203: chown d12/d13/f14 1460 1 2024-09-19T09:34:59.217 INFO:tasks.workunit.client.1.smithi191.stdout:3/204: chown d12/f25 7 1 2024-09-19T09:34:59.218 INFO:tasks.workunit.client.1.smithi191.stdout:5/299: symlink d0/d4/l6e 0 2024-09-19T09:34:59.221 INFO:tasks.workunit.client.1.smithi191.stdout:3/205: creat d12/d13/d1a/d1b/d3c/d3f/f4d x:0 0 0 2024-09-19T09:34:59.221 INFO:tasks.workunit.client.1.smithi191.stdout:3/206: creat d12/d13/d1a/d1b/d3c/d3f/f4e x:0 0 0 2024-09-19T09:34:59.221 INFO:tasks.workunit.client.1.smithi191.stdout:3/207: fsync d12/d13/f3b 0 2024-09-19T09:34:59.221 INFO:tasks.workunit.client.1.smithi191.stdout:3/208: readlink d12/d13/d1a/d1b/l49 0 2024-09-19T09:34:59.223 INFO:tasks.workunit.client.1.smithi191.stdout:1/270: dread d3/d9/da/d1e/d32/f45 [0,4194304] 0 2024-09-19T09:34:59.225 INFO:tasks.workunit.client.1.smithi191.stdout:5/300: mknod d0/d4/d9/d1d/d28/c6f 0 2024-09-19T09:34:59.230 INFO:tasks.workunit.client.1.smithi191.stdout:1/271: truncate d3/d9/da/d1e/d25/f30 1923491 0 2024-09-19T09:34:59.232 INFO:tasks.workunit.client.1.smithi191.stdout:2/237: dwrite d8/f19 [0,4194304] 0 2024-09-19T09:34:59.232 INFO:tasks.workunit.client.1.smithi191.stdout:1/272: creat d3/d9/da/f5f x:0 0 0 2024-09-19T09:34:59.233 INFO:tasks.workunit.client.1.smithi191.stdout:2/238: symlink d8/db/d13/d23/l51 0 2024-09-19T09:34:59.234 INFO:tasks.workunit.client.1.smithi191.stdout:1/273: unlink d3/d9/da/db/d48/l4a 0 2024-09-19T09:34:59.236 INFO:tasks.workunit.client.1.smithi191.stdout:2/239: creat d8/db/d13/d40/f52 x:0 0 0 2024-09-19T09:34:59.238 INFO:tasks.workunit.client.1.smithi191.stdout:2/240: creat d8/d2a/f53 x:0 0 0 2024-09-19T09:34:59.238 INFO:tasks.workunit.client.1.smithi191.stdout:2/241: chown d8/d11/d3f/c18 117 1 2024-09-19T09:34:59.240 INFO:tasks.workunit.client.1.smithi191.stdout:5/301: rmdir d0/d4/d9/d1d/d28 39 2024-09-19T09:34:59.245 INFO:tasks.workunit.client.1.smithi191.stdout:1/274: write d3/d9/f5d [1885413,90518] 0 2024-09-19T09:34:59.246 INFO:tasks.workunit.client.1.smithi191.stdout:0/351: dwrite d0/d9/de/f19 [4194304,4194304] 0 2024-09-19T09:34:59.247 INFO:tasks.workunit.client.1.smithi191.stdout:0/352: chown d0/d9/f1a 11 1 2024-09-19T09:34:59.247 INFO:tasks.workunit.client.1.smithi191.stdout:9/238: dwrite d3/db/d16/d38/f3d [0,4194304] 0 2024-09-19T09:34:59.248 INFO:tasks.workunit.client.1.smithi191.stdout:1/275: mknod d3/d9/da/db/d48/c60 0 2024-09-19T09:34:59.248 INFO:tasks.workunit.client.1.smithi191.stdout:1/276: write d3/d9/da/d1e/d32/f45 [5150397,119105] 0 2024-09-19T09:34:59.251 INFO:tasks.workunit.client.1.smithi191.stdout:3/209: dwrite d12/d37/d3d/f40 [0,4194304] 0 2024-09-19T09:34:59.252 INFO:tasks.workunit.client.1.smithi191.stdout:9/239: rename d3/db/d16/d38/f3d to d3/db/d16/d38/f48 0 2024-09-19T09:34:59.253 INFO:tasks.workunit.client.1.smithi191.stdout:1/277: creat d3/d9/da/db/d48/f61 x:0 0 0 2024-09-19T09:34:59.256 INFO:tasks.workunit.client.1.smithi191.stdout:3/210: rename d12/d13/d1a/f4c to d12/d13/d1a/d1b/d3c/f4f 0 2024-09-19T09:34:59.257 INFO:tasks.workunit.client.1.smithi191.stdout:0/353: dread d0/d9/f4d [0,4194304] 0 2024-09-19T09:34:59.257 INFO:tasks.workunit.client.1.smithi191.stdout:0/354: fdatasync d0/d9/d1c/d1f/d24/d29/f49 0 2024-09-19T09:34:59.258 INFO:tasks.workunit.client.1.smithi191.stdout:9/240: link d3/db/c45 d3/c49 0 2024-09-19T09:34:59.258 INFO:tasks.workunit.client.1.smithi191.stdout:9/241: creat d3/db/d16/d17/f4a x:0 0 0 2024-09-19T09:34:59.258 INFO:tasks.workunit.client.1.smithi191.stdout:9/242: stat d3/db/d16 0 2024-09-19T09:34:59.259 INFO:tasks.workunit.client.1.smithi191.stdout:3/211: creat d12/d13/d1a/d1b/d3c/f50 x:0 0 0 2024-09-19T09:34:59.259 INFO:tasks.workunit.client.1.smithi191.stdout:3/212: fdatasync fe 0 2024-09-19T09:34:59.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.258+0000 7f0b264d1640 1 -- 172.21.15.112:0/1565488523 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0b2004b720 con 0x7f0b200fc710 2024-09-19T09:34:59.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.259+0000 7f0b1cff9640 1 -- 172.21.15.112:0/1565488523 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f0b14057070 con 0x7f0b200fc710 2024-09-19T09:34:59.261 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:34:59.261 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:34:59.261 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T09:34:59.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:34:59.261 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:34:59.261 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 1, 2024-09-19T09:34:59.261 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T09:34:59.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:34:59.261 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:34:59.261 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T09:34:59.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:34:59.262 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:34:59.262 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:34:59.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:34:59.262 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:34:59.262 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 13, 2024-09-19T09:34:59.262 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T09:34:59.262 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:34:59.262 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:34:59.264 INFO:tasks.workunit.client.1.smithi191.stdout:1/278: write d3/d9/da/d1e/f31 [314274,39979] 0 2024-09-19T09:34:59.264 INFO:tasks.workunit.client.1.smithi191.stdout:9/243: dread d3/d8/f13 [0,4194304] 0 2024-09-19T09:34:59.264 INFO:tasks.workunit.client.1.smithi191.stdout:1/279: truncate d3/d9/da/d1e/d25/f30 2629715 0 2024-09-19T09:34:59.264 INFO:tasks.workunit.client.1.smithi191.stdout:1/280: chown d3/d9/da/db/f4d 207345 1 2024-09-19T09:34:59.264 INFO:tasks.workunit.client.1.smithi191.stdout:1/281: chown d3/d9/l5c 3083 1 2024-09-19T09:34:59.264 INFO:tasks.workunit.client.1.smithi191.stdout:9/244: fsync d3/db/f10 0 2024-09-19T09:34:59.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.263+0000 7f0b264d1640 1 -- 172.21.15.112:0/1565488523 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f0b0806e6e0 msgr2=0x7f0b08070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:59.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.263+0000 7f0b264d1640 1 --2- 172.21.15.112:0/1565488523 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f0b0806e6e0 0x7f0b08070b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0b10000c00 tx=0x7f0b10035040 comp rx=0 tx=0).stop 2024-09-19T09:34:59.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.263+0000 7f0b264d1640 1 -- 172.21.15.112:0/1565488523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b200fc710 msgr2=0x7f0b20112350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:59.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.263+0000 7f0b264d1640 1 --2- 172.21.15.112:0/1565488523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b200fc710 0x7f0b20112350 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0b14002a80 tx=0x7f0b14004600 comp rx=0 tx=0).stop 2024-09-19T09:34:59.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.263+0000 7f0b264d1640 1 -- 172.21.15.112:0/1565488523 shutdown_connections 2024-09-19T09:34:59.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.263+0000 7f0b264d1640 1 --2- 172.21.15.112:0/1565488523 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f0b0806e6e0 0x7f0b08070b90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:59.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.263+0000 7f0b264d1640 1 --2- 172.21.15.112:0/1565488523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b200fc710 0x7f0b20112350 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:59.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.263+0000 7f0b264d1640 1 --2- 172.21.15.112:0/1565488523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b200fb440 0x7f0b2010fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:59.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.263+0000 7f0b264d1640 1 -- 172.21.15.112:0/1565488523 >> 172.21.15.112:0/1565488523 conn(0x7f0b200f6c20 msgr2=0x7f0b200f8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:59.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.263+0000 7f0b264d1640 1 -- 172.21.15.112:0/1565488523 shutdown_connections 2024-09-19T09:34:59.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.263+0000 7f0b264d1640 1 -- 172.21.15.112:0/1565488523 wait complete. 2024-09-19T09:34:59.266 INFO:tasks.workunit.client.1.smithi191.stdout:2/242: dwrite d8/db/d13/d40/f52 [0,4194304] 0 2024-09-19T09:34:59.266 INFO:tasks.workunit.client.1.smithi191.stdout:9/245: symlink d3/l4b 0 2024-09-19T09:34:59.267 INFO:tasks.workunit.client.1.smithi191.stdout:2/243: write d8/db/d13/d35/f37 [4653056,94126] 0 2024-09-19T09:34:59.267 INFO:tasks.workunit.client.1.smithi191.stdout:2/244: write d8/d2a/f32 [5199392,123845] 0 2024-09-19T09:34:59.267 INFO:tasks.workunit.client.1.smithi191.stdout:5/302: dwrite d0/d4/d9/de/f47 [0,4194304] 0 2024-09-19T09:34:59.267 INFO:tasks.workunit.client.1.smithi191.stdout:5/303: fsync d0/d4/d4a/f69 0 2024-09-19T09:34:59.274 INFO:tasks.workunit.client.1.smithi191.stdout:5/304: creat d0/d4/d9/d1d/d28/d53/f70 x:0 0 0 2024-09-19T09:34:59.276 INFO:tasks.workunit.client.1.smithi191.stdout:5/305: creat d0/d4/d9/d1d/d29/d33/d52/f71 x:0 0 0 2024-09-19T09:34:59.276 INFO:tasks.workunit.client.1.smithi191.stdout:5/306: fdatasync d0/d4/d9/d1d/d28/f42 0 2024-09-19T09:34:59.276 INFO:tasks.workunit.client.1.smithi191.stdout:5/307: chown d0/d4/d9/d1d/d22/d3b 41 1 2024-09-19T09:34:59.276 INFO:tasks.workunit.client.1.smithi191.stdout:5/308: stat d0/d4/d9/de/f47 0 2024-09-19T09:34:59.277 INFO:tasks.workunit.client.1.smithi191.stdout:5/309: symlink d0/d4/d9/d1d/d29/d33/l72 0 2024-09-19T09:34:59.280 INFO:tasks.workunit.client.1.smithi191.stdout:5/310: mknod d0/d4/d4a/c73 0 2024-09-19T09:34:59.281 INFO:tasks.workunit.client.1.smithi191.stdout:2/245: write d8/d2a/f32 [3207995,29658] 0 2024-09-19T09:34:59.283 INFO:tasks.workunit.client.1.smithi191.stdout:2/246: mknod d8/d11/c54 0 2024-09-19T09:34:59.284 INFO:tasks.workunit.client.1.smithi191.stdout:2/247: symlink d8/db/d13/d23/l55 0 2024-09-19T09:34:59.284 INFO:tasks.workunit.client.1.smithi191.stdout:2/248: write d8/db/f47 [97157,108642] 0 2024-09-19T09:34:59.286 INFO:tasks.workunit.client.1.smithi191.stdout:2/249: mkdir d8/d11/d56 0 2024-09-19T09:34:59.286 INFO:tasks.workunit.client.1.smithi191.stdout:2/250: truncate d8/d11/d3f/f21 705250 0 2024-09-19T09:34:59.286 INFO:tasks.workunit.client.1.smithi191.stdout:2/251: chown d8/d11/c54 136 1 2024-09-19T09:34:59.289 INFO:tasks.workunit.client.1.smithi191.stdout:2/252: rename d8/f19 to d8/db/d13/d23/f57 0 2024-09-19T09:34:59.289 INFO:tasks.workunit.client.1.smithi191.stdout:2/253: write d8/db/f47 [1191226,7247] 0 2024-09-19T09:34:59.289 INFO:tasks.workunit.client.1.smithi191.stdout:2/254: chown f6 39 1 2024-09-19T09:34:59.289 INFO:tasks.workunit.client.1.smithi191.stdout:2/255: truncate d8/d11/f49 125044 0 2024-09-19T09:34:59.289 INFO:tasks.workunit.client.1.smithi191.stdout:2/256: readlink d8/db/l1e 0 2024-09-19T09:34:59.290 INFO:tasks.workunit.client.1.smithi191.stdout:0/355: dwrite d0/d9/d1c/d1f/d24/d39/d58/f18 [0,4194304] 0 2024-09-19T09:34:59.290 INFO:tasks.workunit.client.1.smithi191.stdout:0/356: fdatasync d0/d9/d1c/d1f/d24/d39/d58/f40 0 2024-09-19T09:34:59.290 INFO:tasks.workunit.client.1.smithi191.stdout:0/357: getdents d0/d6f 0 2024-09-19T09:34:59.290 INFO:tasks.workunit.client.1.smithi191.stdout:2/257: symlink d8/db/d13/l58 0 2024-09-19T09:34:59.294 INFO:tasks.workunit.client.1.smithi191.stdout:0/358: dread d0/d9/d1c/d1f/d24/d39/d58/f1b [0,4194304] 0 2024-09-19T09:34:59.295 INFO:tasks.workunit.client.1.smithi191.stdout:0/359: creat d0/d9/d1c/d1f/d24/d53/f75 x:0 0 0 2024-09-19T09:34:59.296 INFO:tasks.workunit.client.1.smithi191.stdout:0/360: mkdir d0/d6f/d76 0 2024-09-19T09:34:59.299 INFO:tasks.workunit.client.1.smithi191.stdout:1/282: dwrite d3/d9/da/d1e/d25/f29 [0,4194304] 0 2024-09-19T09:34:59.300 INFO:tasks.workunit.client.1.smithi191.stdout:1/283: write d3/d9/da/f3c [1138532,130003] 0 2024-09-19T09:34:59.303 INFO:tasks.workunit.client.1.smithi191.stdout:1/284: mknod d3/d9/da/d1e/d32/d5b/c62 0 2024-09-19T09:34:59.303 INFO:tasks.workunit.client.1.smithi191.stdout:2/258: dread d8/db/d13/d35/f37 [4194304,4194304] 0 2024-09-19T09:34:59.303 INFO:tasks.workunit.client.1.smithi191.stdout:3/213: dwrite d12/f1e [0,4194304] 0 2024-09-19T09:34:59.304 INFO:tasks.workunit.client.1.smithi191.stdout:9/246: dwrite d3/db/d16/d38/f48 [0,4194304] 0 2024-09-19T09:34:59.304 INFO:tasks.workunit.client.1.smithi191.stdout:9/247: truncate d3/db/d16/f2a 1181979 0 2024-09-19T09:34:59.305 INFO:tasks.workunit.client.1.smithi191.stdout:2/259: symlink d8/db/l59 0 2024-09-19T09:34:59.305 INFO:tasks.workunit.client.1.smithi191.stdout:2/260: creat d8/db/d13/d35/f5a x:0 0 0 2024-09-19T09:34:59.306 INFO:tasks.workunit.client.1.smithi191.stdout:3/214: mkdir d12/d37/d51 0 2024-09-19T09:34:59.306 INFO:tasks.workunit.client.1.smithi191.stdout:5/311: dwrite d0/d4/f24 [0,4194304] 0 2024-09-19T09:34:59.306 INFO:tasks.workunit.client.1.smithi191.stdout:3/215: readlink d12/d13/d1a/l48 0 2024-09-19T09:34:59.307 INFO:tasks.workunit.client.1.smithi191.stdout:9/248: rename d3/db/d16/d17/d1c/f36 to d3/db/d16/d17/f4c 0 2024-09-19T09:34:59.309 INFO:tasks.workunit.client.1.smithi191.stdout:0/361: dread d0/d9/d1c/d1f/d24/d29/f3d [0,4194304] 0 2024-09-19T09:34:59.309 INFO:tasks.workunit.client.1.smithi191.stdout:3/216: read d12/d43/f44 [885736,107353] 0 2024-09-19T09:34:59.313 INFO:tasks.workunit.client.1.smithi191.stdout:1/285: dread d3/d9/da/f3b [0,4194304] 0 2024-09-19T09:34:59.318 INFO:tasks.workunit.client.1.smithi191.stdout:5/312: stat d0/d4/d9/d1d/d29/c41 0 2024-09-19T09:34:59.319 INFO:tasks.workunit.client.1.smithi191.stdout:0/362: link d0/d9/d1c/d1f/d24/f63 d0/d9/d1c/d1f/f77 0 2024-09-19T09:34:59.321 INFO:tasks.workunit.client.1.smithi191.stdout:3/217: link d12/d13/d1a/d1b/d3c/f4f d12/d43/f52 0 2024-09-19T09:34:59.321 INFO:tasks.workunit.client.1.smithi191.stdout:3/218: creat d12/d13/d1a/d1b/d2e/f53 x:0 0 0 2024-09-19T09:34:59.321 INFO:tasks.workunit.client.1.smithi191.stdout:3/219: chown d12/d13/c23 2154921 1 2024-09-19T09:34:59.322 INFO:tasks.workunit.client.1.smithi191.stdout:1/286: rename d3/d9/da/l4c to d3/l63 0 2024-09-19T09:34:59.323 INFO:tasks.workunit.client.1.smithi191.stdout:5/313: creat d0/d4/d9/d1d/d22/d3b/f74 x:0 0 0 2024-09-19T09:34:59.323 INFO:tasks.workunit.client.1.smithi191.stdout:0/363: truncate d0/d9/d1c/d1f/d24/f3f 5253738 0 2024-09-19T09:34:59.325 INFO:tasks.workunit.client.1.smithi191.stdout:3/220: truncate f9 2702615 0 2024-09-19T09:34:59.325 INFO:tasks.workunit.client.1.smithi191.stdout:3/221: read - d12/d13/d1a/f29 zero size 2024-09-19T09:34:59.325 INFO:tasks.workunit.client.1.smithi191.stdout:1/287: creat d3/d9/da/d1e/d25/f64 x:0 0 0 2024-09-19T09:34:59.325 INFO:tasks.workunit.client.1.smithi191.stdout:1/288: write d3/f3f [282763,67639] 0 2024-09-19T09:34:59.326 INFO:tasks.workunit.client.1.smithi191.stdout:5/314: rename d0/d4/d9/d1d/f48 to d0/d4/d9/d1d/d28/d53/f75 0 2024-09-19T09:34:59.326 INFO:tasks.workunit.client.1.smithi191.stdout:5/315: chown d0/d1f/f43 838 1 2024-09-19T09:34:59.326 INFO:tasks.workunit.client.1.smithi191.stdout:3/222: rename d12/d13/d1a/d1b to d12/d13/d1a/d1b/d3c/d3f/d54 22 2024-09-19T09:34:59.327 INFO:tasks.workunit.client.1.smithi191.stdout:3/223: unlink lc 0 2024-09-19T09:34:59.346 INFO:tasks.workunit.client.1.smithi191.stdout:5/316: dwrite d0/d4/d9/d1d/d22/f2c [0,4194304] 0 2024-09-19T09:34:59.373 INFO:tasks.workunit.client.1.smithi191.stdout:2/261: dwrite d8/f44 [0,4194304] 0 2024-09-19T09:34:59.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.374+0000 7efe62a1f640 1 -- 172.21.15.112:0/2208916858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe5c0fb430 msgr2=0x7efe5c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:59.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.374+0000 7efe62a1f640 1 --2- 172.21.15.112:0/2208916858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe5c0fb430 0x7efe5c0fb840 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0048d0 tx=0x7efe4c009da0 comp rx=0 tx=0).stop 2024-09-19T09:34:59.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.374+0000 7efe62a1f640 1 -- 172.21.15.112:0/2208916858 shutdown_connections 2024-09-19T09:34:59.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.374+0000 7efe62a1f640 1 --2- 172.21.15.112:0/2208916858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe5c0fc700 0x7efe5c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:59.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.374+0000 7efe62a1f640 1 --2- 172.21.15.112:0/2208916858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe5c0fb430 0x7efe5c0fb840 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:59.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.374+0000 7efe62a1f640 1 -- 172.21.15.112:0/2208916858 >> 172.21.15.112:0/2208916858 conn(0x7efe5c0f6c10 msgr2=0x7efe5c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:59.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.374+0000 7efe62a1f640 1 -- 172.21.15.112:0/2208916858 shutdown_connections 2024-09-19T09:34:59.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.374+0000 7efe62a1f640 1 -- 172.21.15.112:0/2208916858 wait complete. 2024-09-19T09:34:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.375+0000 7efe62a1f640 1 Processor -- start 2024-09-19T09:34:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.375+0000 7efe62a1f640 1 -- start start 2024-09-19T09:34:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.375+0000 7efe62a1f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe5c0fb430 0x7efe5c10fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.375+0000 7efe62a1f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe5c0fc700 0x7efe5c112290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.375+0000 7efe62a1f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c065cc0 con 0x7efe5c0fc700 2024-09-19T09:34:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.375+0000 7efe62a1f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c065e30 con 0x7efe5c0fb430 2024-09-19T09:34:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.375+0000 7efe5b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe5c0fc700 0x7efe5c112290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.375+0000 7efe5b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe5c0fc700 0x7efe5c112290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59144/0 (socket says 172.21.15.112:59144) 2024-09-19T09:34:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.375+0000 7efe5b7fe640 1 -- 172.21.15.112:0/3559450987 learned_addr learned my addr 172.21.15.112:0/3559450987 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:34:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.375+0000 7efe5bfff640 1 --2- 172.21.15.112:0/3559450987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe5c0fb430 0x7efe5c10fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.376+0000 7efe5b7fe640 1 -- 172.21.15.112:0/3559450987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe5c0fb430 msgr2=0x7efe5c10fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.376+0000 7efe5b7fe640 1 --2- 172.21.15.112:0/3559450987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe5c0fb430 0x7efe5c10fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.376+0000 7efe5b7fe640 1 -- 172.21.15.112:0/3559450987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c005040 con 0x7efe5c0fc700 2024-09-19T09:34:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.376+0000 7efe5b7fe640 1 --2- 172.21.15.112:0/3559450987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe5c0fc700 0x7efe5c112290 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c810 tx=0x7efe500043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:59.379 INFO:tasks.workunit.client.1.smithi191.stdout:1/289: truncate d3/d9/da/f3c 1181434 0 2024-09-19T09:34:59.379 INFO:tasks.workunit.client.1.smithi191.stdout:1/290: fsync d3/d9/da/d42/f55 0 2024-09-19T09:34:59.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.376+0000 7efe58ff9640 1 -- 172.21.15.112:0/3559450987 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe5000a7a0 con 0x7efe5c0fc700 2024-09-19T09:34:59.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.376+0000 7efe62a1f640 1 -- 172.21.15.112:0/3559450987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5c112890 con 0x7efe5c0fc700 2024-09-19T09:34:59.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.376+0000 7efe58ff9640 1 -- 172.21.15.112:0/3559450987 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efe5000ada0 con 0x7efe5c0fc700 2024-09-19T09:34:59.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.376+0000 7efe58ff9640 1 -- 172.21.15.112:0/3559450987 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe50011380 con 0x7efe5c0fc700 2024-09-19T09:34:59.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.376+0000 7efe62a1f640 1 -- 172.21.15.112:0/3559450987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5c112e00 con 0x7efe5c0fc700 2024-09-19T09:34:59.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.378+0000 7efe62a1f640 1 -- 172.21.15.112:0/3559450987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5c0fa890 con 0x7efe5c0fc700 2024-09-19T09:34:59.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.378+0000 7efe58ff9640 1 -- 172.21.15.112:0/3559450987 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7efe500127d0 con 0x7efe5c0fc700 2024-09-19T09:34:59.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.379+0000 7efe58ff9640 1 --2- 172.21.15.112:0/3559450987 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7efe4406e6e0 0x7efe44070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:59.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.379+0000 7efe58ff9640 1 -- 172.21.15.112:0/3559450987 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7efe5008e210 con 0x7efe5c0fc700 2024-09-19T09:34:59.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.379+0000 7efe5bfff640 1 --2- 172.21.15.112:0/3559450987 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7efe4406e6e0 0x7efe44070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:59.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.380+0000 7efe5bfff640 1 --2- 172.21.15.112:0/3559450987 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7efe4406e6e0 0x7efe44070b90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efe4c000c00 tx=0x7efe4c035040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:59.381 INFO:tasks.workunit.client.1.smithi191.stdout:3/224: dwrite d12/d13/d1a/f29 [0,4194304] 0 2024-09-19T09:34:59.381 INFO:tasks.workunit.client.1.smithi191.stdout:1/291: rename d3/d9/da/d42/f56 to d3/d9/da/db/d48/f65 0 2024-09-19T09:34:59.384 INFO:tasks.workunit.client.1.smithi191.stdout:6/261: sync 2024-09-19T09:34:59.384 INFO:tasks.workunit.client.1.smithi191.stdout:7/223: sync 2024-09-19T09:34:59.384 INFO:tasks.workunit.client.1.smithi191.stdout:4/342: sync 2024-09-19T09:34:59.384 INFO:tasks.workunit.client.1.smithi191.stdout:7/224: dread - d2/d2a/d33/f45 zero size 2024-09-19T09:34:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.384+0000 7efe58ff9640 1 -- 172.21.15.112:0/3559450987 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7efe5005b750 con 0x7efe5c0fc700 2024-09-19T09:34:59.386 INFO:tasks.workunit.client.1.smithi191.stdout:5/317: dwrite d0/d4/d9/d1d/d22/d3b/f3c [0,4194304] 0 2024-09-19T09:34:59.386 INFO:tasks.workunit.client.1.smithi191.stdout:7/225: mknod d2/d2a/d38/c57 0 2024-09-19T09:34:59.397 INFO:tasks.workunit.client.1.smithi191.stdout:1/292: dwrite d3/d9/da/db/f4d [4194304,4194304] 0 2024-09-19T09:34:59.400 INFO:tasks.workunit.client.1.smithi191.stdout:1/293: mknod d3/d9/da/d1e/d32/d53/d57/c66 0 2024-09-19T09:34:59.404 INFO:tasks.workunit.client.1.smithi191.stdout:1/294: dread d3/d9/f24 [0,4194304] 0 2024-09-19T09:34:59.405 INFO:tasks.workunit.client.1.smithi191.stdout:8/342: sync 2024-09-19T09:34:59.405 INFO:tasks.workunit.client.1.smithi191.stdout:8/343: readlink d1/d7/l18 0 2024-09-19T09:34:59.405 INFO:tasks.workunit.client.1.smithi191.stdout:8/344: readlink d1/d7/d1a/l20 0 2024-09-19T09:34:59.420 INFO:tasks.workunit.client.1.smithi191.stdout:0/364: dwrite d0/d9/f1a [0,4194304] 0 2024-09-19T09:34:59.421 INFO:tasks.workunit.client.1.smithi191.stdout:0/365: write d0/f4 [1901201,123479] 0 2024-09-19T09:34:59.421 INFO:tasks.workunit.client.1.smithi191.stdout:0/366: fdatasync d0/d9/d1c/d1f/f3c 0 2024-09-19T09:34:59.421 INFO:tasks.workunit.client.1.smithi191.stdout:0/367: creat d0/d9/d1c/d1f/d24/d29/f78 x:0 0 0 2024-09-19T09:34:59.421 INFO:tasks.workunit.client.1.smithi191.stdout:0/368: write d0/d9/d1c/d1f/d24/d29/f49 [4738474,80790] 0 2024-09-19T09:34:59.421 INFO:tasks.workunit.client.1.smithi191.stdout:0/369: chown d0/d9/d1c/d1f/d24/d39/d58/f1b 2356171 1 2024-09-19T09:34:59.421 INFO:tasks.workunit.client.1.smithi191.stdout:6/262: dwrite d2/de/d2a/f4b [0,4194304] 0 2024-09-19T09:34:59.425 INFO:tasks.workunit.client.1.smithi191.stdout:0/370: mknod d0/d9/d1c/c79 0 2024-09-19T09:34:59.427 INFO:tasks.workunit.client.1.smithi191.stdout:1/295: dwrite f0 [4194304,4194304] 0 2024-09-19T09:34:59.428 INFO:tasks.workunit.client.1.smithi191.stdout:1/296: chown d3/d9/da/d1e/l35 326 1 2024-09-19T09:34:59.428 INFO:tasks.workunit.client.1.smithi191.stdout:6/263: mkdir d2/de/d15/d57 0 2024-09-19T09:34:59.429 INFO:tasks.workunit.client.1.smithi191.stdout:8/345: dwrite d1/d16/d3c/d28/f33 [0,4194304] 0 2024-09-19T09:34:59.429 INFO:tasks.workunit.client.1.smithi191.stdout:0/371: mkdir d0/d9/d1c/d1f/d24/d39/d7a 0 2024-09-19T09:34:59.430 INFO:tasks.workunit.client.1.smithi191.stdout:1/297: mkdir d3/d9/da/d1e/d32/d67 0 2024-09-19T09:34:59.431 INFO:tasks.workunit.client.1.smithi191.stdout:6/264: creat d2/de/d15/f58 x:0 0 0 2024-09-19T09:34:59.432 INFO:tasks.workunit.client.1.smithi191.stdout:6/265: rmdir d2/de/d2a/d2d 39 2024-09-19T09:34:59.432 INFO:tasks.workunit.client.1.smithi191.stdout:6/266: chown d2/lc 0 1 2024-09-19T09:34:59.433 INFO:tasks.workunit.client.1.smithi191.stdout:6/267: getdents d2/de/d2a 0 2024-09-19T09:34:59.445 INFO:tasks.workunit.client.1.smithi191.stdout:0/372: read d0/d9/de/d61/f6a [2970446,9466] 0 2024-09-19T09:34:59.454 INFO:tasks.workunit.client.1.smithi191.stdout:0/373: dread d0/d9/d1c/d1f/d24/f3f [0,4194304] 0 2024-09-19T09:34:59.454 INFO:tasks.workunit.client.1.smithi191.stdout:0/374: truncate d0/d9/d1c/d1f/d24/f4b 520747 0 2024-09-19T09:34:59.454 INFO:tasks.workunit.client.1.smithi191.stdout:1/298: dwrite d3/d9/da/d1e/f31 [0,4194304] 0 2024-09-19T09:34:59.454 INFO:tasks.workunit.client.1.smithi191.stdout:1/299: chown d3/d9/da/d1e/d25/f64 11684 1 2024-09-19T09:34:59.455 INFO:tasks.workunit.client.1.smithi191.stdout:6/268: dwrite d2/de/d2a/d2d/f1b [0,4194304] 0 2024-09-19T09:34:59.456 INFO:tasks.workunit.client.1.smithi191.stdout:0/375: rename d0/d9/d54 to d0/d6f/d7b 0 2024-09-19T09:34:59.456 INFO:tasks.workunit.client.1.smithi191.stdout:0/376: fdatasync d0/d9/d1c/d1f/d24/d39/d58/f1b 0 2024-09-19T09:34:59.458 INFO:tasks.workunit.client.1.smithi191.stdout:1/300: symlink d3/d9/da/d1e/d32/d53/l68 0 2024-09-19T09:34:59.458 INFO:tasks.workunit.client.1.smithi191.stdout:1/301: chown d3/d9/l46 4 1 2024-09-19T09:34:59.459 INFO:tasks.workunit.client.1.smithi191.stdout:6/269: link d2/de/d2a/d2d/d30/c3b d2/de/d15/d57/c59 0 2024-09-19T09:34:59.460 INFO:tasks.workunit.client.1.smithi191.stdout:1/302: mknod d3/d9/c69 0 2024-09-19T09:34:59.460 INFO:tasks.workunit.client.1.smithi191.stdout:6/270: symlink d2/de/d15/d57/l5a 0 2024-09-19T09:34:59.462 INFO:tasks.workunit.client.1.smithi191.stdout:1/303: creat d3/d9/da/d1e/d32/d53/d57/f6a x:0 0 0 2024-09-19T09:34:59.462 INFO:tasks.workunit.client.1.smithi191.stdout:1/304: chown d3/d9/da/d1e/d32/f3e 13538 1 2024-09-19T09:34:59.462 INFO:tasks.workunit.client.1.smithi191.stdout:1/305: stat d3/d9/f5d 0 2024-09-19T09:34:59.463 INFO:tasks.workunit.client.1.smithi191.stdout:6/271: link d2/de/d19/d1e/c3c d2/de/d19/d24/d44/c5b 0 2024-09-19T09:34:59.465 INFO:tasks.workunit.client.1.smithi191.stdout:1/306: unlink d3/d9/da/f3c 0 2024-09-19T09:34:59.465 INFO:tasks.workunit.client.1.smithi191.stdout:1/307: readlink d3/d9/l19 0 2024-09-19T09:34:59.465 INFO:tasks.workunit.client.1.smithi191.stdout:1/308: chown d3/d9/da/d1e/d25/f30 7836 1 2024-09-19T09:34:59.467 INFO:tasks.workunit.client.1.smithi191.stdout:6/272: symlink d2/de/d2a/d2d/d30/l5c 0 2024-09-19T09:34:59.469 INFO:tasks.workunit.client.1.smithi191.stdout:6/273: mkdir d2/de/d19/d5d 0 2024-09-19T09:34:59.469 INFO:tasks.workunit.client.1.smithi191.stdout:6/274: chown d2/de/d2a/d2d/f1b 251833 1 2024-09-19T09:34:59.469 INFO:tasks.workunit.client.1.smithi191.stdout:6/275: write d2/de/d19/d24/f54 [702950,53026] 0 2024-09-19T09:34:59.470 INFO:tasks.workunit.client.1.smithi191.stdout:6/276: truncate d2/de/d15/f26 3962312 0 2024-09-19T09:34:59.471 INFO:tasks.workunit.client.1.smithi191.stdout:6/277: symlink d2/de/d15/l5e 0 2024-09-19T09:34:59.481 INFO:tasks.workunit.client.1.smithi191.stdout:0/377: dwrite d0/d6f/d7b/f6b [0,4194304] 0 2024-09-19T09:34:59.481 INFO:tasks.workunit.client.1.smithi191.stdout:0/378: chown d0/d9/d1c/d1f/d24/d39/d58/c43 1530066 1 2024-09-19T09:34:59.484 INFO:tasks.workunit.client.1.smithi191.stdout:1/309: dwrite f0 [8388608,4194304] 0 2024-09-19T09:34:59.486 INFO:tasks.workunit.client.1.smithi191.stdout:1/310: mknod d3/d9/da/d1e/c6b 0 2024-09-19T09:34:59.486 INFO:tasks.workunit.client.1.smithi191.stdout:1/311: write d3/d9/da/f5f [841300,48604] 0 2024-09-19T09:34:59.486 INFO:tasks.workunit.client.1.smithi191.stdout:1/312: write d3/d9/da/d1e/f44 [824139,30357] 0 2024-09-19T09:34:59.487 INFO:tasks.workunit.client.1.smithi191.stdout:1/313: link d3/d9/da/db/l3d d3/d9/l6c 0 2024-09-19T09:34:59.498 INFO:tasks.workunit.client.1.smithi191.stdout:6/278: dwrite d2/de/d15/f36 [0,4194304] 0 2024-09-19T09:34:59.498 INFO:tasks.workunit.client.1.smithi191.stdout:6/279: fsync d2/de/f10 0 2024-09-19T09:34:59.500 INFO:tasks.workunit.client.1.smithi191.stdout:6/280: symlink d2/de/d19/l5f 0 2024-09-19T09:34:59.500 INFO:tasks.workunit.client.1.smithi191.stdout:6/281: dread - d2/de/d19/d24/f55 zero size 2024-09-19T09:34:59.500 INFO:tasks.workunit.client.1.smithi191.stdout:6/282: mkdir d2/de/d2a/d60 0 2024-09-19T09:34:59.502 INFO:tasks.workunit.client.1.smithi191.stdout:6/283: mkdir d2/de/d19/d24/d61 0 2024-09-19T09:34:59.502 INFO:tasks.workunit.client.1.smithi191.stdout:6/284: dread d2/de/d19/d24/f29 [0,4194304] 0 2024-09-19T09:34:59.502 INFO:tasks.workunit.client.1.smithi191.stdout:6/285: truncate d2/de/d19/d24/f55 50395 0 2024-09-19T09:34:59.504 INFO:tasks.workunit.client.1.smithi191.stdout:6/286: creat d2/de/d2a/d39/f62 x:0 0 0 2024-09-19T09:34:59.509 INFO:tasks.workunit.client.1.smithi191.stdout:1/314: dwrite d3/d9/da/d1e/d25/f29 [4194304,4194304] 0 2024-09-19T09:34:59.509 INFO:tasks.workunit.client.1.smithi191.stdout:9/249: sync 2024-09-19T09:34:59.509 INFO:tasks.workunit.client.1.smithi191.stdout:2/262: sync 2024-09-19T09:34:59.509 INFO:tasks.workunit.client.1.smithi191.stdout:0/379: dwrite d0/d9/d1c/d1f/d24/d29/f3d [0,4194304] 0 2024-09-19T09:34:59.510 INFO:tasks.workunit.client.1.smithi191.stdout:9/250: mkdir d3/db/d16/d4d 0 2024-09-19T09:34:59.511 INFO:tasks.workunit.client.1.smithi191.stdout:2/263: mknod d8/db/d13/d23/c5b 0 2024-09-19T09:34:59.511 INFO:tasks.workunit.client.1.smithi191.stdout:2/264: fdatasync d8/f1d 0 2024-09-19T09:34:59.512 INFO:tasks.workunit.client.1.smithi191.stdout:2/265: truncate d8/d11/d3f/f21 1435103 0 2024-09-19T09:34:59.519 INFO:tasks.workunit.client.1.smithi191.stdout:0/380: read d0/d9/d1c/d1f/f3c [2747591,113755] 0 2024-09-19T09:34:59.519 INFO:tasks.workunit.client.1.smithi191.stdout:0/381: stat d0/d9/d1c/d1f/d24/d29/d30/d56 0 2024-09-19T09:34:59.519 INFO:tasks.workunit.client.1.smithi191.stdout:0/382: dread - d0/d9/d1c/d1f/d24/d29/f78 zero size 2024-09-19T09:34:59.520 INFO:tasks.workunit.client.1.smithi191.stdout:6/287: dwrite d2/de/d19/d1e/f3e [0,4194304] 0 2024-09-19T09:34:59.520 INFO:tasks.workunit.client.1.smithi191.stdout:6/288: chown d2/de/d2a/l31 7 1 2024-09-19T09:34:59.525 INFO:tasks.workunit.client.1.smithi191.stdout:0/383: dread d0/f34 [0,4194304] 0 2024-09-19T09:34:59.525 INFO:tasks.workunit.client.1.smithi191.stdout:6/289: link d2/de/d2a/f4b d2/f63 0 2024-09-19T09:34:59.525 INFO:tasks.workunit.client.1.smithi191.stdout:6/290: write d2/de/d19/d24/f56 [426272,26378] 0 2024-09-19T09:34:59.525 INFO:tasks.workunit.client.1.smithi191.stdout:6/291: readlink d2/lc 0 2024-09-19T09:34:59.525 INFO:tasks.workunit.client.1.smithi191.stdout:6/292: fdatasync d2/de/f27 0 2024-09-19T09:34:59.525 INFO:tasks.workunit.client.1.smithi191.stdout:6/293: chown d2/de/d19/d24/d61 60528019 1 2024-09-19T09:34:59.526 INFO:tasks.workunit.client.1.smithi191.stdout:9/251: dread d3/db/d16/d38/f48 [0,4194304] 0 2024-09-19T09:34:59.528 INFO:tasks.workunit.client.1.smithi191.stdout:9/252: read d3/db/d16/d17/d1c/f1d [139938,89107] 0 2024-09-19T09:34:59.528 INFO:tasks.workunit.client.1.smithi191.stdout:9/253: chown d3/db/d16/d17 1591663 1 2024-09-19T09:34:59.528 INFO:tasks.workunit.client.1.smithi191.stdout:9/254: write d3/f40 [149783,65046] 0 2024-09-19T09:34:59.528 INFO:tasks.workunit.client.1.smithi191.stdout:9/255: write d3/d8/fc [189837,72559] 0 2024-09-19T09:34:59.529 INFO:tasks.workunit.client.1.smithi191.stdout:9/256: creat d3/db/d16/d17/d1c/f4e x:0 0 0 2024-09-19T09:34:59.529 INFO:tasks.workunit.client.1.smithi191.stdout:9/257: creat d3/db/d16/d17/d1c/f4f x:0 0 0 2024-09-19T09:34:59.541 INFO:tasks.workunit.client.1.smithi191.stdout:2/266: dwrite d8/d11/f38 [4194304,4194304] 0 2024-09-19T09:34:59.548 INFO:tasks.workunit.client.1.smithi191.stdout:2/267: dread d8/f2f [0,4194304] 0 2024-09-19T09:34:59.548 INFO:tasks.workunit.client.1.smithi191.stdout:3/225: sync 2024-09-19T09:34:59.548 INFO:tasks.workunit.client.1.smithi191.stdout:3/226: fdatasync d12/d13/d1a/f29 0 2024-09-19T09:34:59.548 INFO:tasks.workunit.client.1.smithi191.stdout:2/268: rename d8/db/d41/f45 to d8/db/d41/f5c 0 2024-09-19T09:34:59.548 INFO:tasks.workunit.client.1.smithi191.stdout:2/269: fsync d8/db/d13/d23/f20 0 2024-09-19T09:34:59.549 INFO:tasks.workunit.client.1.smithi191.stdout:3/227: link d12/d13/d1a/d1b/d2e/l30 d12/d13/d1a/d1b/d2e/l55 0 2024-09-19T09:34:59.550 INFO:tasks.workunit.client.1.smithi191.stdout:0/384: dwrite d0/f34 [0,4194304] 0 2024-09-19T09:34:59.555 INFO:tasks.workunit.client.1.smithi191.stdout:9/258: dwrite d3/db/f11 [0,4194304] 0 2024-09-19T09:34:59.556 INFO:tasks.workunit.client.1.smithi191.stdout:6/294: dwrite d2/de/d19/d24/f56 [0,4194304] 0 2024-09-19T09:34:59.563 INFO:tasks.workunit.client.1.smithi191.stdout:9/259: rmdir d3/db/d16/d38 39 2024-09-19T09:34:59.564 INFO:tasks.workunit.client.1.smithi191.stdout:0/385: dread d0/d6f/d7b/f6b [0,4194304] 0 2024-09-19T09:34:59.564 INFO:tasks.workunit.client.1.smithi191.stdout:0/386: fsync d0/d9/d1c/d20/f37 0 2024-09-19T09:34:59.564 INFO:tasks.workunit.client.1.smithi191.stdout:0/387: fdatasync d0/d9/d1c/d1f/d24/d29/f49 0 2024-09-19T09:34:59.565 INFO:tasks.workunit.client.1.smithi191.stdout:9/260: creat d3/db/d16/d4d/f50 x:0 0 0 2024-09-19T09:34:59.565 INFO:tasks.workunit.client.1.smithi191.stdout:9/261: chown d3/db/l14 695 1 2024-09-19T09:34:59.566 INFO:tasks.workunit.client.1.smithi191.stdout:9/262: symlink d3/db/d16/d47/l51 0 2024-09-19T09:34:59.567 INFO:tasks.workunit.client.1.smithi191.stdout:9/263: symlink d3/l52 0 2024-09-19T09:34:59.592 INFO:tasks.workunit.client.1.smithi191.stdout:2/270: dwrite d8/d11/d3f/f22 [0,4194304] 0 2024-09-19T09:34:59.594 INFO:tasks.workunit.client.1.smithi191.stdout:2/271: unlink d8/c3c 0 2024-09-19T09:34:59.594 INFO:tasks.workunit.client.1.smithi191.stdout:2/272: creat d8/d11/f5d x:0 0 0 2024-09-19T09:34:59.601 INFO:tasks.workunit.client.1.smithi191.stdout:2/273: dread d8/db/d13/d23/f20 [0,4194304] 0 2024-09-19T09:34:59.601 INFO:tasks.workunit.client.1.smithi191.stdout:2/274: chown d8/d11/d3f/c50 483 1 2024-09-19T09:34:59.602 INFO:tasks.workunit.client.1.smithi191.stdout:2/275: chown d8/d11/c1c 54306205 1 2024-09-19T09:34:59.603 INFO:tasks.workunit.client.1.smithi191.stdout:9/264: dwrite d3/db/d16/f43 [0,4194304] 0 2024-09-19T09:34:59.603 INFO:tasks.workunit.client.1.smithi191.stdout:3/228: dwrite d12/f25 [4194304,4194304] 0 2024-09-19T09:34:59.603 INFO:tasks.workunit.client.1.smithi191.stdout:6/295: dwrite d2/de/d2a/d2d/d30/f3f [4194304,4194304] 0 2024-09-19T09:34:59.603 INFO:tasks.workunit.client.1.smithi191.stdout:6/296: chown d2/de/d15/f26 124 1 2024-09-19T09:34:59.604 INFO:tasks.workunit.client.1.smithi191.stdout:2/276: dread d8/f42 [0,4194304] 0 2024-09-19T09:34:59.604 INFO:tasks.workunit.client.1.smithi191.stdout:2/277: truncate d8/d11/d3f/f22 4586979 0 2024-09-19T09:34:59.605 INFO:tasks.workunit.client.1.smithi191.stdout:9/265: mkdir d3/db/d53 0 2024-09-19T09:34:59.605 INFO:tasks.workunit.client.1.smithi191.stdout:9/266: creat d3/db/d16/d4d/f54 x:0 0 0 2024-09-19T09:34:59.605 INFO:tasks.workunit.client.1.smithi191.stdout:9/267: fsync d3/db/d16/d38/f48 0 2024-09-19T09:34:59.608 INFO:tasks.workunit.client.1.smithi191.stdout:2/278: rename d8/d11/f5d to d8/db/d13/d40/f5e 0 2024-09-19T09:34:59.611 INFO:tasks.workunit.client.1.smithi191.stdout:2/279: mknod d8/db/d13/d23/c5f 0 2024-09-19T09:34:59.612 INFO:tasks.workunit.client.1.smithi191.stdout:2/280: link d8/d11/l4f d8/db/d41/l60 0 2024-09-19T09:34:59.612 INFO:tasks.workunit.client.1.smithi191.stdout:2/281: read - d8/db/d13/d35/f36 zero size 2024-09-19T09:34:59.613 INFO:tasks.workunit.client.1.smithi191.stdout:6/297: write d2/de/f14 [3015703,95783] 0 2024-09-19T09:34:59.613 INFO:tasks.workunit.client.1.smithi191.stdout:2/282: creat d8/d2a/f61 x:0 0 0 2024-09-19T09:34:59.613 INFO:tasks.workunit.client.1.smithi191.stdout:2/283: truncate d8/db/d13/f15 8576014 0 2024-09-19T09:34:59.616 INFO:tasks.workunit.client.1.smithi191.stdout:6/298: getdents d2/de 0 2024-09-19T09:34:59.616 INFO:tasks.workunit.client.1.smithi191.stdout:6/299: fdatasync d2/de/d15/f58 0 2024-09-19T09:34:59.620 INFO:tasks.workunit.client.1.smithi191.stdout:3/229: truncate d12/f25 698066 0 2024-09-19T09:34:59.620 INFO:tasks.workunit.client.1.smithi191.stdout:3/230: truncate d12/d13/d1a/d1b/d2e/f3a 318040 0 2024-09-19T09:34:59.620 INFO:tasks.workunit.client.1.smithi191.stdout:3/231: write d12/d13/d1a/f32 [876964,59087] 0 2024-09-19T09:34:59.626 INFO:tasks.workunit.client.1.smithi191.stdout:2/284: dwrite d8/f42 [0,4194304] 0 2024-09-19T09:34:59.629 INFO:tasks.workunit.client.1.smithi191.stdout:2/285: mknod d8/db/d13/d35/c62 0 2024-09-19T09:34:59.629 INFO:tasks.workunit.client.1.smithi191.stdout:2/286: dread - d8/db/d13/d35/f5a zero size 2024-09-19T09:34:59.629 INFO:tasks.workunit.client.1.smithi191.stdout:2/287: creat d8/db/f63 x:0 0 0 2024-09-19T09:34:59.635 INFO:tasks.workunit.client.1.smithi191.stdout:3/232: dwrite f9 [0,4194304] 0 2024-09-19T09:34:59.635 INFO:tasks.workunit.client.1.smithi191.stdout:3/233: truncate d12/d13/d1a/d1b/d2e/f3a 600395 0 2024-09-19T09:34:59.637 INFO:tasks.workunit.client.1.smithi191.stdout:3/234: chown d12/d13/d1a/d1b/d3c/f50 233245922 1 2024-09-19T09:34:59.638 INFO:tasks.workunit.client.1.smithi191.stdout:3/235: unlink d12/d13/d1a/d1b/d2e/c39 0 2024-09-19T09:34:59.640 INFO:tasks.workunit.client.1.smithi191.stdout:3/236: getdents d12/d13/d1a 0 2024-09-19T09:34:59.640 INFO:tasks.workunit.client.1.smithi191.stdout:3/237: dread - d12/d13/d1a/d1b/d3c/f50 zero size 2024-09-19T09:34:59.640 INFO:tasks.workunit.client.1.smithi191.stdout:3/238: getdents d12/d13/d1a 0 2024-09-19T09:34:59.640 INFO:tasks.workunit.client.1.smithi191.stdout:3/239: fdatasync d12/d13/d1a/d28/f34 0 2024-09-19T09:34:59.640 INFO:tasks.workunit.client.1.smithi191.stdout:3/240: rmdir d12/d13/d1a/d1b 39 2024-09-19T09:34:59.640 INFO:tasks.workunit.client.1.smithi191.stdout:3/241: fsync d12/d13/f19 0 2024-09-19T09:34:59.640 INFO:tasks.workunit.client.1.smithi191.stdout:3/242: symlink d12/d13/l56 0 2024-09-19T09:34:59.641 INFO:tasks.workunit.client.1.smithi191.stdout:3/243: chown d12/d13/d1a/d28/l2c 1425466 1 2024-09-19T09:34:59.649 INFO:tasks.workunit.client.1.smithi191.stdout:3/244: write d12/d13/f3b [4006964,73085] 0 2024-09-19T09:34:59.656 INFO:tasks.workunit.client.1.smithi191.stdout:3/245: write d12/d13/f19 [6753320,14701] 0 2024-09-19T09:34:59.659 INFO:tasks.workunit.client.1.smithi191.stdout:3/246: read f11 [1108254,22299] 0 2024-09-19T09:34:59.659 INFO:tasks.workunit.client.1.smithi191.stdout:3/247: truncate d12/f1e 2628105 0 2024-09-19T09:34:59.661 INFO:tasks.workunit.client.1.smithi191.stdout:3/248: getdents d12/d13/d1a/d1b/d3c 0 2024-09-19T09:34:59.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.663+0000 7efe62a1f640 1 -- 172.21.15.112:0/3559450987 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe5c100b60 con 0x7efe4406e6e0 2024-09-19T09:34:59.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.664+0000 7efe58ff9640 1 -- 172.21.15.112:0/3559450987 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7efe5c100b60 con 0x7efe4406e6e0 2024-09-19T09:34:59.666 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:34:59.666 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:34:59.666 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:34:59.666 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-19T09:34:59.666 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [], 2024-09-19T09:34:59.666 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "1/2 daemons upgraded", 2024-09-19T09:34:59.666 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "", 2024-09-19T09:34:59.667 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:34:59.667 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:34:59.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.667+0000 7efe62a1f640 1 -- 172.21.15.112:0/3559450987 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7efe4406e6e0 msgr2=0x7efe44070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:59.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.667+0000 7efe62a1f640 1 --2- 172.21.15.112:0/3559450987 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7efe4406e6e0 0x7efe44070b90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efe4c000c00 tx=0x7efe4c035040 comp rx=0 tx=0).stop 2024-09-19T09:34:59.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.667+0000 7efe62a1f640 1 -- 172.21.15.112:0/3559450987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe5c0fc700 msgr2=0x7efe5c112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:59.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.667+0000 7efe62a1f640 1 --2- 172.21.15.112:0/3559450987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe5c0fc700 0x7efe5c112290 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c810 tx=0x7efe500043c0 comp rx=0 tx=0).stop 2024-09-19T09:34:59.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.667+0000 7efe62a1f640 1 -- 172.21.15.112:0/3559450987 shutdown_connections 2024-09-19T09:34:59.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.667+0000 7efe62a1f640 1 --2- 172.21.15.112:0/3559450987 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7efe4406e6e0 0x7efe44070b90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:59.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.667+0000 7efe62a1f640 1 --2- 172.21.15.112:0/3559450987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe5c0fc700 0x7efe5c112290 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:59.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.667+0000 7efe62a1f640 1 --2- 172.21.15.112:0/3559450987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe5c0fb430 0x7efe5c10fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:59.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.667+0000 7efe62a1f640 1 -- 172.21.15.112:0/3559450987 >> 172.21.15.112:0/3559450987 conn(0x7efe5c0f6c10 msgr2=0x7efe5c0f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:59.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.667+0000 7efe62a1f640 1 -- 172.21.15.112:0/3559450987 shutdown_connections 2024-09-19T09:34:59.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:34:59.667+0000 7efe62a1f640 1 -- 172.21.15.112:0/3559450987 wait complete. 2024-09-19T09:34:59.679 INFO:tasks.workunit.client.1.smithi191.stdout:3/249: dwrite d12/d13/d1a/d1b/d3c/f50 [0,4194304] 0 2024-09-19T09:34:59.679 INFO:tasks.workunit.client.1.smithi191.stdout:3/250: readlink d12/l2b 0 2024-09-19T09:34:59.679 INFO:tasks.workunit.client.1.smithi191.stdout:3/251: chown d12/d37/d51 5958 1 2024-09-19T09:34:59.679 INFO:tasks.workunit.client.1.smithi191.stdout:3/252: chown d12/d13/d1a/d1b/d3c/f4f 78532421 1 2024-09-19T09:34:59.680 INFO:tasks.workunit.client.1.smithi191.stdout:3/253: unlink d12/d13/l45 0 2024-09-19T09:34:59.688 INFO:tasks.workunit.client.1.smithi191.stdout:3/254: read d12/d13/f14 [754978,11166] 0 2024-09-19T09:34:59.689 INFO:tasks.workunit.client.1.smithi191.stdout:3/255: stat d12/d13/d1a/d28/l2c 0 2024-09-19T09:34:59.689 INFO:tasks.workunit.client.1.smithi191.stdout:3/256: dread - d12/d13/d1a/d1b/f36 zero size 2024-09-19T09:34:59.689 INFO:tasks.workunit.client.1.smithi191.stdout:3/257: chown d12/d43 28320 1 2024-09-19T09:34:59.695 INFO:tasks.workunit.client.1.smithi191.stdout:3/258: read d12/f1e [2100910,19399] 0 2024-09-19T09:34:59.696 INFO:tasks.workunit.client.1.smithi191.stdout:3/259: creat d12/d13/d1a/f57 x:0 0 0 2024-09-19T09:34:59.718 INFO:tasks.workunit.client.1.smithi191.stdout:3/260: truncate d12/d13/d1a/f32 859869 0 2024-09-19T09:34:59.723 INFO:tasks.workunit.client.1.smithi191.stdout:3/261: truncate d12/d13/f19 3003964 0 2024-09-19T09:34:59.723 INFO:tasks.workunit.client.1.smithi191.stdout:3/262: write fe [21074,90078] 0 2024-09-19T09:34:59.723 INFO:tasks.workunit.client.1.smithi191.stdout:3/263: creat d12/d13/d1a/d28/f58 x:0 0 0 2024-09-19T09:34:59.724 INFO:tasks.workunit.client.1.smithi191.stdout:3/264: symlink d12/d37/d3d/l59 0 2024-09-19T09:34:59.724 INFO:tasks.workunit.client.1.smithi191.stdout:3/265: stat d12/d43/f44 0 2024-09-19T09:34:59.729 INFO:tasks.workunit.client.1.smithi191.stdout:3/266: dread d12/d43/f44 [0,4194304] 0 2024-09-19T09:34:59.729 INFO:tasks.workunit.client.1.smithi191.stdout:3/267: read d12/d13/f19 [195192,57400] 0 2024-09-19T09:34:59.729 INFO:tasks.workunit.client.1.smithi191.stdout:3/268: read - d12/d13/d1a/d1b/f36 zero size 2024-09-19T09:34:59.729 INFO:tasks.workunit.client.1.smithi191.stdout:3/269: fdatasync d12/d13/d1a/d28/f58 0 2024-09-19T09:34:59.729 INFO:tasks.workunit.client.1.smithi191.stdout:3/270: write d12/f25 [1560908,39249] 0 2024-09-19T09:34:59.729 INFO:tasks.workunit.client.1.smithi191.stdout:3/271: getdents d12/d37/d51 0 2024-09-19T09:34:59.731 INFO:tasks.workunit.client.1.smithi191.stdout:6/300: dread d2/de/d19/d24/f56 [0,4194304] 0 2024-09-19T09:34:59.739 INFO:tasks.workunit.client.1.smithi191.stdout:0/388: dwrite d0/d9/de/d61/f6a [0,4194304] 0 2024-09-19T09:34:59.739 INFO:tasks.workunit.client.1.smithi191.stdout:0/389: write d0/d9/d1c/d1f/f3c [4151146,17034] 0 2024-09-19T09:34:59.741 INFO:tasks.workunit.client.1.smithi191.stdout:9/268: dwrite d3/d8/f3b [0,4194304] 0 2024-09-19T09:34:59.741 INFO:tasks.workunit.client.1.smithi191.stdout:2/288: dwrite d8/d11/f46 [0,4194304] 0 2024-09-19T09:34:59.747 INFO:tasks.workunit.client.1.smithi191.stdout:0/390: mkdir d0/d9/d1c/d1f/d24/d29/d30/d7c 0 2024-09-19T09:34:59.749 INFO:tasks.workunit.client.1.smithi191.stdout:2/289: mkdir d8/d11/d3f/d64 0 2024-09-19T09:34:59.752 INFO:tasks.workunit.client.1.smithi191.stdout:2/290: getdents d8 0 2024-09-19T09:34:59.754 INFO:tasks.workunit.client.1.smithi191.stdout:9/269: dwrite d3/db/d16/d17/d1c/f4e [0,4194304] 0 2024-09-19T09:34:59.760 INFO:tasks.workunit.client.1.smithi191.stdout:9/270: rename d3/db/d16/d17/d1c to d3/db/d16/d47/d55 0 2024-09-19T09:34:59.760 INFO:tasks.workunit.client.1.smithi191.stdout:9/271: read d3/fe [929064,25670] 0 2024-09-19T09:34:59.760 INFO:tasks.workunit.client.1.smithi191.stdout:1/315: sync 2024-09-19T09:34:59.760 INFO:tasks.workunit.client.1.smithi191.stdout:5/318: sync 2024-09-19T09:34:59.760 INFO:tasks.workunit.client.1.smithi191.stdout:9/272: creat d3/d8/f56 x:0 0 0 2024-09-19T09:34:59.760 INFO:tasks.workunit.client.1.smithi191.stdout:8/346: sync 2024-09-19T09:34:59.760 INFO:tasks.workunit.client.1.smithi191.stdout:4/343: sync 2024-09-19T09:34:59.760 INFO:tasks.workunit.client.1.smithi191.stdout:7/226: sync 2024-09-19T09:34:59.762 INFO:tasks.workunit.client.1.smithi191.stdout:1/316: truncate d3/d9/da/d1e/f31 3058871 0 2024-09-19T09:34:59.763 INFO:tasks.workunit.client.1.smithi191.stdout:9/273: rename d3/l52 to d3/db/l57 0 2024-09-19T09:34:59.764 INFO:tasks.workunit.client.1.smithi191.stdout:5/319: mknod d0/d4/d4a/c76 0 2024-09-19T09:34:59.765 INFO:tasks.workunit.client.1.smithi191.stdout:5/320: truncate d0/d4/d9/d1d/d29/f62 707004 0 2024-09-19T09:34:59.766 INFO:tasks.workunit.client.1.smithi191.stdout:7/227: unlink d2/d2a/d38/c57 0 2024-09-19T09:34:59.766 INFO:tasks.workunit.client.1.smithi191.stdout:7/228: write d2/f1d [1283487,127519] 0 2024-09-19T09:34:59.766 INFO:tasks.workunit.client.1.smithi191.stdout:7/229: write d2/d2a/d33/f45 [434264,109106] 0 2024-09-19T09:34:59.766 INFO:tasks.workunit.client.1.smithi191.stdout:7/230: read d2/d2a/d33/f3e [24641,41963] 0 2024-09-19T09:34:59.766 INFO:tasks.workunit.client.1.smithi191.stdout:1/317: mkdir d3/d9/da/d1e/d32/d53/d57/d6d 0 2024-09-19T09:34:59.767 INFO:tasks.workunit.client.1.smithi191.stdout:9/274: unlink d3/db/d16/f1f 0 2024-09-19T09:34:59.768 INFO:tasks.workunit.client.1.smithi191.stdout:1/318: symlink d3/d9/da/d1e/d32/d53/l6e 0 2024-09-19T09:34:59.770 INFO:tasks.workunit.client.1.smithi191.stdout:9/275: rename d3/db/d16/f29 to d3/db/d16/d4d/f58 0 2024-09-19T09:34:59.770 INFO:tasks.workunit.client.1.smithi191.stdout:9/276: chown d3/d8/f21 30 1 2024-09-19T09:34:59.771 INFO:tasks.workunit.client.1.smithi191.stdout:5/321: dread d0/d4/d9/d1d/f46 [0,4194304] 0 2024-09-19T09:34:59.773 INFO:tasks.workunit.client.1.smithi191.stdout:8/347: write d1/d16/d23/f43 [2335949,119956] 0 2024-09-19T09:34:59.780 INFO:tasks.workunit.client.1.smithi191.stdout:7/231: read d2/d2a/f2f [5524370,80194] 0 2024-09-19T09:34:59.781 INFO:tasks.workunit.client.1.smithi191.stdout:0/391: dwrite d0/d9/de/f55 [0,4194304] 0 2024-09-19T09:34:59.781 INFO:tasks.workunit.client.1.smithi191.stdout:0/392: fsync d0/d9/de/f10 0 2024-09-19T09:34:59.782 INFO:tasks.workunit.client.1.smithi191.stdout:2/291: dwrite d8/d11/d3f/f34 [0,4194304] 0 2024-09-19T09:34:59.782 INFO:tasks.workunit.client.1.smithi191.stdout:4/344: dwrite d5/f8 [0,4194304] 0 2024-09-19T09:34:59.782 INFO:tasks.workunit.client.1.smithi191.stdout:4/345: fdatasync d5/d1b/d1c/d24/d32/d21/d4a/f4d 0 2024-09-19T09:34:59.782 INFO:tasks.workunit.client.1.smithi191.stdout:0/393: creat d0/d6f/d76/f7d x:0 0 0 2024-09-19T09:34:59.783 INFO:tasks.workunit.client.1.smithi191.stdout:0/394: readlink d0/d9/d1c/d20/l41 0 2024-09-19T09:34:59.783 INFO:tasks.workunit.client.1.smithi191.stdout:0/395: fsync d0/d9/d1c/d1f/d24/f60 0 2024-09-19T09:34:59.784 INFO:tasks.workunit.client.1.smithi191.stdout:8/348: write d1/d22/f3b [650821,9068] 0 2024-09-19T09:34:59.784 INFO:tasks.workunit.client.1.smithi191.stdout:2/292: mkdir d8/d2a/d65 0 2024-09-19T09:34:59.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:59.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:34:59.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:34:59.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:59.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:34:59.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:59.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:34:59 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/1565488523' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:34:59.786 INFO:tasks.workunit.client.1.smithi191.stdout:8/349: read d1/d7/d1a/f25 [485338,122049] 0 2024-09-19T09:34:59.786 INFO:tasks.workunit.client.1.smithi191.stdout:4/346: rename d5/d1b/d1c/d2f/d37/l60 to d5/d1b/l81 0 2024-09-19T09:34:59.786 INFO:tasks.workunit.client.1.smithi191.stdout:4/347: write d5/d1b/d1c/d28/f58 [610997,60610] 0 2024-09-19T09:34:59.787 INFO:tasks.workunit.client.1.smithi191.stdout:2/293: link d8/f1d d8/d11/d3f/d64/f66 0 2024-09-19T09:34:59.788 INFO:tasks.workunit.client.1.smithi191.stdout:8/350: creat d1/d16/d2e/d57/f6e x:0 0 0 2024-09-19T09:34:59.790 INFO:tasks.workunit.client.1.smithi191.stdout:8/351: creat d1/d16/d2e/f6f x:0 0 0 2024-09-19T09:34:59.793 INFO:tasks.workunit.client.1.smithi191.stdout:1/319: dwrite d3/d9/da/db/d48/f61 [0,4194304] 0 2024-09-19T09:34:59.795 INFO:tasks.workunit.client.1.smithi191.stdout:1/320: truncate d3/d9/da/d1e/f44 311608 0 2024-09-19T09:34:59.798 INFO:tasks.workunit.client.1.smithi191.stdout:1/321: mkdir d3/d9/da/d1e/d32/d6f 0 2024-09-19T09:34:59.798 INFO:tasks.workunit.client.1.smithi191.stdout:1/322: write d3/d9/da/f43 [722306,129101] 0 2024-09-19T09:34:59.800 INFO:tasks.workunit.client.1.smithi191.stdout:1/323: mkdir d3/d9/da/d1e/d25/d70 0 2024-09-19T09:34:59.800 INFO:tasks.workunit.client.1.smithi191.stdout:1/324: stat d3/d9/da/d1e/d32/d53/f1c 0 2024-09-19T09:34:59.800 INFO:tasks.workunit.client.1.smithi191.stdout:1/325: fdatasync d3/d9/da/d1e/f31 0 2024-09-19T09:34:59.802 INFO:tasks.workunit.client.1.smithi191.stdout:1/326: unlink d3/d9/da/l12 0 2024-09-19T09:34:59.802 INFO:tasks.workunit.client.1.smithi191.stdout:1/327: fsync d3/d9/da/d1e/d25/f64 0 2024-09-19T09:34:59.803 INFO:tasks.workunit.client.1.smithi191.stdout:2/294: write d8/db/d13/d23/f57 [950022,54808] 0 2024-09-19T09:34:59.803 INFO:tasks.workunit.client.1.smithi191.stdout:1/328: creat d3/d9/da/db/d48/f71 x:0 0 0 2024-09-19T09:34:59.803 INFO:tasks.workunit.client.1.smithi191.stdout:2/295: symlink d8/db/d13/d23/l67 0 2024-09-19T09:34:59.805 INFO:tasks.workunit.client.1.smithi191.stdout:1/329: rename f0 to d3/d9/da/d1e/d25/d70/f72 0 2024-09-19T09:34:59.805 INFO:tasks.workunit.client.1.smithi191.stdout:1/330: stat d3/d9/da/d1e/l5a 0 2024-09-19T09:34:59.806 INFO:tasks.workunit.client.1.smithi191.stdout:2/296: rmdir d8/d11/d3f/d64 39 2024-09-19T09:34:59.807 INFO:tasks.workunit.client.1.smithi191.stdout:1/331: mkdir d3/d9/d73 0 2024-09-19T09:34:59.809 INFO:tasks.workunit.client.1.smithi191.stdout:1/332: creat d3/d9/da/d1e/d32/f74 x:0 0 0 2024-09-19T09:34:59.810 INFO:tasks.workunit.client.1.smithi191.stdout:1/333: creat d3/d9/da/d1e/d32/d53/d57/d6d/f75 x:0 0 0 2024-09-19T09:34:59.811 INFO:tasks.workunit.client.1.smithi191.stdout:1/334: symlink d3/d9/da/d1e/d25/d70/l76 0 2024-09-19T09:34:59.811 INFO:tasks.workunit.client.1.smithi191.stdout:1/335: stat d3/d9/da/db/d48/f71 0 2024-09-19T09:34:59.811 INFO:tasks.workunit.client.1.smithi191.stdout:1/336: creat d3/d9/da/d1e/d32/d53/d57/d6d/f77 x:0 0 0 2024-09-19T09:34:59.811 INFO:tasks.workunit.client.1.smithi191.stdout:1/337: truncate d3/d9/da/d1e/f31 3354136 0 2024-09-19T09:34:59.812 INFO:tasks.workunit.client.1.smithi191.stdout:1/338: rename d3/d9/da/f43 to d3/d9/f78 0 2024-09-19T09:34:59.813 INFO:tasks.workunit.client.1.smithi191.stdout:1/339: mknod d3/d9/d73/c79 0 2024-09-19T09:34:59.814 INFO:tasks.workunit.client.1.smithi191.stdout:7/232: dwrite d2/fd [0,4194304] 0 2024-09-19T09:34:59.819 INFO:tasks.workunit.client.1.smithi191.stdout:7/233: mkdir d2/d58 0 2024-09-19T09:34:59.819 INFO:tasks.workunit.client.1.smithi191.stdout:2/297: dread d8/db/d13/d35/f37 [0,4194304] 0 2024-09-19T09:34:59.820 INFO:tasks.workunit.client.1.smithi191.stdout:7/234: mkdir d2/d2a/d4f/d59 0 2024-09-19T09:34:59.820 INFO:tasks.workunit.client.1.smithi191.stdout:9/277: rmdir d3/db/d16/d4d 39 2024-09-19T09:34:59.822 INFO:tasks.workunit.client.1.smithi191.stdout:7/235: symlink d2/d2a/d4f/d59/l5a 0 2024-09-19T09:34:59.822 INFO:tasks.workunit.client.1.smithi191.stdout:7/236: fsync d2/d2a/f2f 0 2024-09-19T09:34:59.822 INFO:tasks.workunit.client.1.smithi191.stdout:4/348: dwrite d5/d1b/d61/f64 [0,4194304] 0 2024-09-19T09:34:59.824 INFO:tasks.workunit.client.1.smithi191.stdout:0/396: dwrite d0/d9/de/f55 [4194304,4194304] 0 2024-09-19T09:34:59.825 INFO:tasks.workunit.client.1.smithi191.stdout:0/397: creat d0/d9/d1c/f7e x:0 0 0 2024-09-19T09:34:59.825 INFO:tasks.workunit.client.1.smithi191.stdout:8/352: dwrite d1/d16/d2e/d57/f6e [0,4194304] 0 2024-09-19T09:34:59.827 INFO:tasks.workunit.client.1.smithi191.stdout:4/349: mkdir d5/d1b/d1c/d24/d82 0 2024-09-19T09:34:59.827 INFO:tasks.workunit.client.1.smithi191.stdout:1/340: dread d3/d9/f78 [0,4194304] 0 2024-09-19T09:34:59.827 INFO:tasks.workunit.client.1.smithi191.stdout:1/341: chown d3/d9/da/d1e/d32/f45 1 1 2024-09-19T09:34:59.834 INFO:tasks.workunit.client.1.smithi191.stdout:8/353: write d1/d7/f24 [130727,62682] 0 2024-09-19T09:34:59.834 INFO:tasks.workunit.client.1.smithi191.stdout:8/354: chown d1/d16/d3c/d28 2 1 2024-09-19T09:34:59.834 INFO:tasks.workunit.client.1.smithi191.stdout:8/355: dread - d1/d7/d1a/f5d zero size 2024-09-19T09:34:59.834 INFO:tasks.workunit.client.1.smithi191.stdout:8/356: write d1/d7/f53 [5235540,107909] 0 2024-09-19T09:34:59.849 INFO:tasks.workunit.client.1.smithi191.stdout:2/298: dwrite d8/db/d13/d23/f29 [0,4194304] 0 2024-09-19T09:34:59.853 INFO:tasks.workunit.client.1.smithi191.stdout:4/350: write d5/d1b/d1c/d24/d32/f36 [1342700,113667] 0 2024-09-19T09:34:59.853 INFO:tasks.workunit.client.1.smithi191.stdout:4/351: chown d5/d1b/d61 412 1 2024-09-19T09:34:59.855 INFO:tasks.workunit.client.1.smithi191.stdout:4/352: link d5/d1b/d1c/d24/d32/d21/f50 d5/d1b/d1c/d28/f83 0 2024-09-19T09:34:59.856 INFO:tasks.workunit.client.1.smithi191.stdout:4/353: mknod d5/d38/d6d/c84 0 2024-09-19T09:34:59.857 INFO:tasks.workunit.client.1.smithi191.stdout:4/354: truncate f4 315058 0 2024-09-19T09:34:59.864 INFO:tasks.workunit.client.1.smithi191.stdout:2/299: dread d8/db/d13/d40/f52 [0,4194304] 0 2024-09-19T09:34:59.864 INFO:tasks.workunit.client.1.smithi191.stdout:9/278: dwrite d3/db/d16/d17/f4a [0,4194304] 0 2024-09-19T09:34:59.867 INFO:tasks.workunit.client.1.smithi191.stdout:9/279: link d3/db/l33 d3/db/d53/l59 0 2024-09-19T09:34:59.867 INFO:tasks.workunit.client.1.smithi191.stdout:9/280: readlink d3/db/l57 0 2024-09-19T09:34:59.869 INFO:tasks.workunit.client.1.smithi191.stdout:0/398: dwrite d0/d9/de/d61/f6a [0,4194304] 0 2024-09-19T09:34:59.874 INFO:tasks.workunit.client.1.smithi191.stdout:1/342: dwrite d3/d9/da/d1e/d25/f64 [0,4194304] 0 2024-09-19T09:34:59.878 INFO:tasks.workunit.client.1.smithi191.stdout:1/343: symlink d3/d9/da/d1e/d25/d70/l7a 0 2024-09-19T09:34:59.878 INFO:tasks.workunit.client.1.smithi191.stdout:1/344: truncate d3/d9/da/f3b 4975129 0 2024-09-19T09:34:59.878 INFO:tasks.workunit.client.1.smithi191.stdout:1/345: fdatasync d3/d9/da/f5f 0 2024-09-19T09:34:59.904 INFO:tasks.workunit.client.1.smithi191.stdout:8/357: dwrite d1/d7/f24 [0,4194304] 0 2024-09-19T09:34:59.904 INFO:tasks.workunit.client.1.smithi191.stdout:8/358: stat d1/d22/c61 0 2024-09-19T09:34:59.904 INFO:tasks.workunit.client.1.smithi191.stdout:8/359: read - d1/d22/d47/f5a zero size 2024-09-19T09:34:59.904 INFO:tasks.workunit.client.1.smithi191.stdout:0/399: dwrite d0/d6f/d76/f7d [0,4194304] 0 2024-09-19T09:34:59.905 INFO:tasks.workunit.client.1.smithi191.stdout:0/400: chown d0/d9/d1c/d20/f31 0 1 2024-09-19T09:34:59.905 INFO:tasks.workunit.client.1.smithi191.stdout:8/360: read d1/d16/d3c/f29 [221662,42082] 0 2024-09-19T09:34:59.905 INFO:tasks.workunit.client.1.smithi191.stdout:8/361: write d1/d16/d2e/d32/f64 [615685,4668] 0 2024-09-19T09:34:59.906 INFO:tasks.workunit.client.1.smithi191.stdout:4/355: dwrite d5/fe [0,4194304] 0 2024-09-19T09:34:59.906 INFO:tasks.workunit.client.1.smithi191.stdout:4/356: chown d5/d1b/d1c/d24/d32/l5f 759 1 2024-09-19T09:34:59.906 INFO:tasks.workunit.client.1.smithi191.stdout:0/401: creat d0/d9/f7f x:0 0 0 2024-09-19T09:34:59.907 INFO:tasks.workunit.client.1.smithi191.stdout:9/281: dwrite d3/db/d16/d17/f4c [0,4194304] 0 2024-09-19T09:34:59.907 INFO:tasks.workunit.client.1.smithi191.stdout:1/346: dwrite d3/d9/fe [0,4194304] 0 2024-09-19T09:34:59.907 INFO:tasks.workunit.client.1.smithi191.stdout:8/362: link d1/d16/c6a d1/d22/d34/c70 0 2024-09-19T09:34:59.907 INFO:tasks.workunit.client.1.smithi191.stdout:8/363: chown d1/d16/f4a 1 1 2024-09-19T09:34:59.909 INFO:tasks.workunit.client.1.smithi191.stdout:9/282: creat d3/db/d16/d17/d3c/f5a x:0 0 0 2024-09-19T09:34:59.910 INFO:tasks.workunit.client.1.smithi191.stdout:1/347: mknod d3/d9/da/db/c7b 0 2024-09-19T09:34:59.911 INFO:tasks.workunit.client.1.smithi191.stdout:6/301: sync 2024-09-19T09:34:59.911 INFO:tasks.workunit.client.1.smithi191.stdout:3/272: sync 2024-09-19T09:34:59.912 INFO:tasks.workunit.client.1.smithi191.stdout:4/357: dread d5/f4e [0,4194304] 0 2024-09-19T09:34:59.912 INFO:tasks.workunit.client.1.smithi191.stdout:4/358: chown d5/d1b/d1c/d24/d32/f16 10 1 2024-09-19T09:34:59.913 INFO:tasks.workunit.client.1.smithi191.stdout:4/359: link d5/d1b/c2a d5/d1b/d1c/c85 0 2024-09-19T09:34:59.914 INFO:tasks.workunit.client.1.smithi191.stdout:4/360: stat d5/d1b/d1c/d24/d32/d21/f75 0 2024-09-19T09:34:59.914 INFO:tasks.workunit.client.1.smithi191.stdout:6/302: rename d2/de/d19/d24 to d2/de/d19/d1e/d64 0 2024-09-19T09:34:59.915 INFO:tasks.workunit.client.1.smithi191.stdout:4/361: truncate d5/d1b/f67 1920963 0 2024-09-19T09:34:59.915 INFO:tasks.workunit.client.1.smithi191.stdout:4/362: chown f0 3387769 1 2024-09-19T09:34:59.917 INFO:tasks.workunit.client.1.smithi191.stdout:9/283: write d3/d8/f13 [631563,75555] 0 2024-09-19T09:34:59.919 INFO:tasks.workunit.client.1.smithi191.stdout:9/284: truncate d3/db/d16/f43 2028429 0 2024-09-19T09:34:59.921 INFO:tasks.workunit.client.1.smithi191.stdout:9/285: mkdir d3/db/d16/d17/d5b 0 2024-09-19T09:34:59.921 INFO:tasks.workunit.client.1.smithi191.stdout:9/286: truncate d3/db/d16/d17/d3c/f5a 1010610 0 2024-09-19T09:34:59.922 INFO:tasks.workunit.client.1.smithi191.stdout:9/287: fdatasync d3/db/d16/d38/f3e 0 2024-09-19T09:34:59.922 INFO:tasks.workunit.client.1.smithi191.stdout:6/303: dread d2/de/f1d [0,4194304] 0 2024-09-19T09:34:59.922 INFO:tasks.workunit.client.1.smithi191.stdout:6/304: write d2/de/d19/d1e/d64/f4d [490715,42026] 0 2024-09-19T09:34:59.922 INFO:tasks.workunit.client.1.smithi191.stdout:6/305: chown d2/l9 667 1 2024-09-19T09:34:59.923 INFO:tasks.workunit.client.1.smithi191.stdout:1/348: dread d3/d9/da/d1e/d32/d53/f1c [0,4194304] 0 2024-09-19T09:34:59.923 INFO:tasks.workunit.client.1.smithi191.stdout:9/288: symlink d3/db/d16/d17/d5b/l5c 0 2024-09-19T09:34:59.924 INFO:tasks.workunit.client.1.smithi191.stdout:6/306: mkdir d2/de/d19/d1e/d64/d44/d65 0 2024-09-19T09:34:59.925 INFO:tasks.workunit.client.1.smithi191.stdout:9/289: symlink d3/db/d16/d17/d5b/l5d 0 2024-09-19T09:34:59.925 INFO:tasks.workunit.client.1.smithi191.stdout:9/290: stat d3/f40 0 2024-09-19T09:34:59.925 INFO:tasks.workunit.client.1.smithi191.stdout:9/291: fdatasync d3/db/d16/d47/d55/f4f 0 2024-09-19T09:34:59.925 INFO:tasks.workunit.client.1.smithi191.stdout:9/292: chown d3/d8 10782087 1 2024-09-19T09:34:59.927 INFO:tasks.workunit.client.1.smithi191.stdout:9/293: rename d3/db/d16/f1b to d3/db/d16/d47/d55/f5e 0 2024-09-19T09:34:59.932 INFO:tasks.workunit.client.1.smithi191.stdout:1/349: dread d3/d9/da/f20 [0,4194304] 0 2024-09-19T09:34:59.935 INFO:tasks.workunit.client.1.smithi191.stdout:6/307: dread d2/f34 [0,4194304] 0 2024-09-19T09:34:59.936 INFO:tasks.workunit.client.1.smithi191.stdout:6/308: symlink d2/de/d2a/d39/l66 0 2024-09-19T09:34:59.937 INFO:tasks.workunit.client.1.smithi191.stdout:6/309: fdatasync d2/de/d19/d1e/f21 0 2024-09-19T09:34:59.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:59.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:34:59.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:34:59.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:59.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:34:59.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:59.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:34:59.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:34:59 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1565488523' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:34:59.940 INFO:tasks.workunit.client.1.smithi191.stdout:9/294: dread d3/db/d16/d38/f48 [0,4194304] 0 2024-09-19T09:34:59.941 INFO:tasks.workunit.client.1.smithi191.stdout:9/295: chown d3/db/d16/d17 48387 1 2024-09-19T09:34:59.941 INFO:tasks.workunit.client.1.smithi191.stdout:9/296: chown d3/db/f11 3 1 2024-09-19T09:34:59.941 INFO:tasks.workunit.client.1.smithi191.stdout:9/297: truncate d3/db/d16/d47/d55/f4e 949789 0 2024-09-19T09:34:59.941 INFO:tasks.workunit.client.1.smithi191.stdout:9/298: chown f2 1 1 2024-09-19T09:34:59.941 INFO:tasks.workunit.client.1.smithi191.stdout:9/299: creat d3/db/d16/d38/f5f x:0 0 0 2024-09-19T09:34:59.942 INFO:tasks.workunit.client.1.smithi191.stdout:0/402: dwrite d0/d9/d1c/f74 [0,4194304] 0 2024-09-19T09:34:59.942 INFO:tasks.workunit.client.1.smithi191.stdout:0/403: truncate d0/d9/d1c/d1f/d24/d29/f44 339202 0 2024-09-19T09:34:59.943 INFO:tasks.workunit.client.1.smithi191.stdout:0/404: symlink d0/d6f/l80 0 2024-09-19T09:34:59.943 INFO:tasks.workunit.client.1.smithi191.stdout:0/405: fsync d0/d9/d1c/d1f/d24/d39/d58/f67 0 2024-09-19T09:34:59.945 INFO:tasks.workunit.client.1.smithi191.stdout:8/364: dwrite d1/d16/d3c/f68 [0,4194304] 0 2024-09-19T09:34:59.945 INFO:tasks.workunit.client.1.smithi191.stdout:3/273: dwrite d12/d13/d1a/f57 [0,4194304] 0 2024-09-19T09:34:59.945 INFO:tasks.workunit.client.1.smithi191.stdout:0/406: rename d0/d9/d1c/d1f/d24/d6d to d0/d9/de/d81 0 2024-09-19T09:34:59.946 INFO:tasks.workunit.client.1.smithi191.stdout:4/363: dwrite d5/d1b/d1c/f63 [0,4194304] 0 2024-09-19T09:34:59.947 INFO:tasks.workunit.client.1.smithi191.stdout:1/350: read d3/d9/da/d1e/d32/d53/f2c [282723,93588] 0 2024-09-19T09:34:59.948 INFO:tasks.workunit.client.1.smithi191.stdout:8/365: creat d1/d16/d23/d3e/f71 x:0 0 0 2024-09-19T09:34:59.948 INFO:tasks.workunit.client.1.smithi191.stdout:8/366: truncate d1/d7/fe 1575962 0 2024-09-19T09:34:59.951 INFO:tasks.workunit.client.1.smithi191.stdout:0/407: unlink d0/d9/d1c/c3e 0 2024-09-19T09:34:59.954 INFO:tasks.workunit.client.1.smithi191.stdout:9/300: write d3/db/d16/d17/f4c [16773,74911] 0 2024-09-19T09:34:59.958 INFO:tasks.workunit.client.1.smithi191.stdout:4/364: mkdir d5/d1b/d1c/d24/d32/d21/d56/d86 0 2024-09-19T09:34:59.959 INFO:tasks.workunit.client.1.smithi191.stdout:1/351: symlink d3/d9/da/d1e/l7c 0 2024-09-19T09:34:59.960 INFO:tasks.workunit.client.1.smithi191.stdout:1/352: read - d3/d9/f4e zero size 2024-09-19T09:34:59.964 INFO:tasks.workunit.client.1.smithi191.stdout:3/274: rename d12/l2b to d12/d13/d1a/d1b/l5a 0 2024-09-19T09:34:59.966 INFO:tasks.workunit.client.1.smithi191.stdout:1/353: link d3/d9/da/d1e/d32/d5b/c62 d3/d9/da/d1e/d32/d5b/c7d 0 2024-09-19T09:34:59.967 INFO:tasks.workunit.client.1.smithi191.stdout:4/365: write d5/d1b/d61/f64 [746757,96082] 0 2024-09-19T09:34:59.968 INFO:tasks.workunit.client.1.smithi191.stdout:8/367: rename d1/d22/c35 to d1/d16/d23/c72 0 2024-09-19T09:34:59.968 INFO:tasks.workunit.client.1.smithi191.stdout:8/368: write d1/d16/d2e/d32/f64 [1243854,115999] 0 2024-09-19T09:34:59.968 INFO:tasks.workunit.client.1.smithi191.stdout:8/369: stat d1/d16/d3c/l50 0 2024-09-19T09:34:59.969 INFO:tasks.workunit.client.1.smithi191.stdout:8/370: write d1/f14 [574244,59485] 0 2024-09-19T09:34:59.973 INFO:tasks.workunit.client.1.smithi191.stdout:0/408: rename d0/d9/d1c/d1f/d24/f60 to d0/d6f/d7b/f82 0 2024-09-19T09:34:59.974 INFO:tasks.workunit.client.1.smithi191.stdout:3/275: truncate d12/d13/d1a/f29 3011688 0 2024-09-19T09:34:59.975 INFO:tasks.workunit.client.1.smithi191.stdout:3/276: creat d12/d13/d1a/d1b/d2e/f5b x:0 0 0 2024-09-19T09:34:59.975 INFO:tasks.workunit.client.1.smithi191.stdout:3/277: getdents d12/d37/d51 0 2024-09-19T09:34:59.976 INFO:tasks.workunit.client.1.smithi191.stdout:9/301: rename d3/db/d16/d4d to d3/d60 0 2024-09-19T09:34:59.977 INFO:tasks.workunit.client.1.smithi191.stdout:0/409: symlink d0/d9/d1c/d1f/d24/d53/l83 0 2024-09-19T09:34:59.978 INFO:tasks.workunit.client.1.smithi191.stdout:9/302: read d3/db/d16/f2a [295090,31582] 0 2024-09-19T09:34:59.980 INFO:tasks.workunit.client.1.smithi191.stdout:3/278: creat d12/d13/d1a/f5c x:0 0 0 2024-09-19T09:34:59.980 INFO:tasks.workunit.client.1.smithi191.stdout:3/279: write d12/d13/d1a/f32 [1417594,88570] 0 2024-09-19T09:34:59.982 INFO:tasks.workunit.client.1.smithi191.stdout:0/410: mknod d0/d9/d1c/d1f/d24/d39/d7a/c84 0 2024-09-19T09:34:59.982 INFO:tasks.workunit.client.1.smithi191.stdout:0/411: chown d0/d9/d1c/d1f/d24/d53/f75 4 1 2024-09-19T09:34:59.983 INFO:tasks.workunit.client.1.smithi191.stdout:9/303: mknod d3/db/d16/d17/d3c/c61 0 2024-09-19T09:34:59.985 INFO:tasks.workunit.client.1.smithi191.stdout:0/412: link d0/d9/d1c/d1f/d24/d29/f44 d0/d9/d1c/d1f/f85 0 2024-09-19T09:34:59.986 INFO:tasks.workunit.client.1.smithi191.stdout:3/280: mkdir d12/d13/d1a/d5d 0 2024-09-19T09:34:59.986 INFO:tasks.workunit.client.1.smithi191.stdout:3/281: chown d12/d13/d1a/d1b/d2e/l55 301487 1 2024-09-19T09:34:59.988 INFO:tasks.workunit.client.1.smithi191.stdout:3/282: mknod d12/d43/c5e 0 2024-09-19T09:34:59.989 INFO:tasks.workunit.client.1.smithi191.stdout:8/371: dwrite d1/d22/f58 [4194304,4194304] 0 2024-09-19T09:34:59.989 INFO:tasks.workunit.client.1.smithi191.stdout:8/372: write d1/d22/d47/f60 [603739,112021] 0 2024-09-19T09:34:59.989 INFO:tasks.workunit.client.1.smithi191.stdout:8/373: chown d1/d16/d3c 163555565 1 2024-09-19T09:34:59.991 INFO:tasks.workunit.client.1.smithi191.stdout:3/283: creat d12/d13/d1a/d5d/f5f x:0 0 0 2024-09-19T09:34:59.991 INFO:tasks.workunit.client.1.smithi191.stdout:3/284: dread - d12/d13/d1a/d28/f58 zero size 2024-09-19T09:34:59.994 INFO:tasks.workunit.client.1.smithi191.stdout:8/374: rmdir d1/d7 39 2024-09-19T09:34:59.994 INFO:tasks.workunit.client.1.smithi191.stdout:8/375: fdatasync d1/d22/f54 0 2024-09-19T09:34:59.994 INFO:tasks.workunit.client.1.smithi191.stdout:8/376: write d1/d16/d3c/f29 [106579,32758] 0 2024-09-19T09:34:59.994 INFO:tasks.workunit.client.1.smithi191.stdout:8/377: chown d1/d16/d3c/d17/f4d 56617346 1 2024-09-19T09:34:59.995 INFO:tasks.workunit.client.1.smithi191.stdout:5/322: sync 2024-09-19T09:34:59.995 INFO:tasks.workunit.client.1.smithi191.stdout:5/323: dread - d0/f20 zero size 2024-09-19T09:34:59.995 INFO:tasks.workunit.client.1.smithi191.stdout:5/324: fsync d0/d4/d9/de/f47 0 2024-09-19T09:34:59.997 INFO:tasks.workunit.client.1.smithi191.stdout:8/378: creat d1/d16/d23/f73 x:0 0 0 2024-09-19T09:34:59.998 INFO:tasks.workunit.client.1.smithi191.stdout:3/285: mkdir d12/d13/d1a/d1b/d60 0 2024-09-19T09:34:59.999 INFO:tasks.workunit.client.1.smithi191.stdout:8/379: creat d1/f74 x:0 0 0 2024-09-19T09:35:00.000 INFO:tasks.workunit.client.1.smithi191.stdout:3/286: mkdir d12/d43/d61 0 2024-09-19T09:35:00.002 INFO:tasks.workunit.client.1.smithi191.stdout:8/380: mknod d1/d22/c75 0 2024-09-19T09:35:00.005 INFO:tasks.workunit.client.1.smithi191.stdout:8/381: mknod d1/d22/d34/c76 0 2024-09-19T09:35:00.005 INFO:tasks.workunit.client.1.smithi191.stdout:8/382: creat d1/d16/d2e/d32/f77 x:0 0 0 2024-09-19T09:35:00.005 INFO:tasks.workunit.client.1.smithi191.stdout:8/383: chown d1/d7/d1a/f5d 3299650 1 2024-09-19T09:35:00.006 INFO:tasks.workunit.client.1.smithi191.stdout:7/237: sync 2024-09-19T09:35:00.006 INFO:tasks.workunit.client.1.smithi191.stdout:2/300: sync 2024-09-19T09:35:00.006 INFO:tasks.workunit.client.1.smithi191.stdout:1/354: rename d3/d9/da/d1e/d32/d5b to d3/d9/da/d7e 0 2024-09-19T09:35:00.008 INFO:tasks.workunit.client.1.smithi191.stdout:9/304: dwrite d3/d60/f50 [0,4194304] 0 2024-09-19T09:35:00.008 INFO:tasks.workunit.client.1.smithi191.stdout:9/305: write d3/d8/f15 [485775,95513] 0 2024-09-19T09:35:00.008 INFO:tasks.workunit.client.1.smithi191.stdout:9/306: stat d3/l2f 0 2024-09-19T09:35:00.010 INFO:tasks.workunit.client.1.smithi191.stdout:8/384: symlink d1/d16/d2e/d32/l78 0 2024-09-19T09:35:00.011 INFO:tasks.workunit.client.1.smithi191.stdout:7/238: creat d2/d2a/d4f/d59/f5b x:0 0 0 2024-09-19T09:35:00.011 INFO:tasks.workunit.client.1.smithi191.stdout:7/239: write d2/f17 [1191053,10495] 0 2024-09-19T09:35:00.012 INFO:tasks.workunit.client.1.smithi191.stdout:0/413: dwrite d0/d9/d1c/d1f/d24/d29/f3b [0,4194304] 0 2024-09-19T09:35:00.014 INFO:tasks.workunit.client.1.smithi191.stdout:2/301: symlink d8/db/d41/l68 0 2024-09-19T09:35:00.015 INFO:tasks.workunit.client.1.smithi191.stdout:2/302: dread - d8/db/d13/d40/f5e zero size 2024-09-19T09:35:00.018 INFO:tasks.workunit.client.1.smithi191.stdout:4/366: rename d5/d1b/d1c/c85 to d5/d1b/d1c/d2f/d19/c87 0 2024-09-19T09:35:00.022 INFO:tasks.workunit.client.1.smithi191.stdout:8/385: mkdir d1/d16/d3c/d28/d79 0 2024-09-19T09:35:00.025 INFO:tasks.workunit.client.1.smithi191.stdout:7/240: rmdir d2 39 2024-09-19T09:35:00.027 INFO:tasks.workunit.client.1.smithi191.stdout:0/414: chown d0/d9/d1c/d1f/d24/d29/d30/c35 1 1 2024-09-19T09:35:00.028 INFO:tasks.workunit.client.1.smithi191.stdout:3/287: dwrite d12/d13/d1a/d1b/d3c/f4f [0,4194304] 0 2024-09-19T09:35:00.029 INFO:tasks.workunit.client.1.smithi191.stdout:2/303: creat d8/d11/d56/f69 x:0 0 0 2024-09-19T09:35:00.029 INFO:tasks.workunit.client.1.smithi191.stdout:2/304: write d8/f2f [1162560,54505] 0 2024-09-19T09:35:00.029 INFO:tasks.workunit.client.1.smithi191.stdout:5/325: dwrite d0/d4/d9/d1d/d22/f2c [0,4194304] 0 2024-09-19T09:35:00.030 INFO:tasks.workunit.client.1.smithi191.stdout:5/326: read - d0/f20 zero size 2024-09-19T09:35:00.030 INFO:tasks.workunit.client.1.smithi191.stdout:9/307: dwrite d3/d8/f13 [0,4194304] 0 2024-09-19T09:35:00.030 INFO:tasks.workunit.client.1.smithi191.stdout:9/308: creat d3/db/d16/d17/d3c/f62 x:0 0 0 2024-09-19T09:35:00.031 INFO:tasks.workunit.client.1.smithi191.stdout:4/367: truncate d5/d1b/d1c/d24/d32/f5d 655003 0 2024-09-19T09:35:00.032 INFO:tasks.workunit.client.1.smithi191.stdout:4/368: write d5/d1b/d1c/d2f/f47 [131117,28407] 0 2024-09-19T09:35:00.032 INFO:tasks.workunit.client.1.smithi191.stdout:4/369: write d5/d1b/d1c/d24/d32/f36 [1057290,66195] 0 2024-09-19T09:35:00.037 INFO:tasks.workunit.client.1.smithi191.stdout:5/327: mkdir d0/d77 0 2024-09-19T09:35:00.037 INFO:tasks.workunit.client.1.smithi191.stdout:5/328: fsync d0/d4/d9/d1d/d29/f62 0 2024-09-19T09:35:00.041 INFO:tasks.workunit.client.1.smithi191.stdout:2/305: dread d8/f42 [0,4194304] 0 2024-09-19T09:35:00.041 INFO:tasks.workunit.client.1.smithi191.stdout:2/306: chown d8/d11/f38 7 1 2024-09-19T09:35:00.041 INFO:tasks.workunit.client.1.smithi191.stdout:1/355: getdents d3/d9/da/d1e/d32 0 2024-09-19T09:35:00.042 INFO:tasks.workunit.client.1.smithi191.stdout:4/370: read d5/fe [64468,103750] 0 2024-09-19T09:35:00.042 INFO:tasks.workunit.client.1.smithi191.stdout:4/371: truncate d5/d1b/f67 2847636 0 2024-09-19T09:35:00.044 INFO:tasks.workunit.client.1.smithi191.stdout:0/415: mkdir d0/d9/d1c/d1f/d24/d39/d58/d6c/d86 0 2024-09-19T09:35:00.045 INFO:tasks.workunit.client.1.smithi191.stdout:2/307: dread d8/db/d13/d23/f43 [0,4194304] 0 2024-09-19T09:35:00.045 INFO:tasks.workunit.client.1.smithi191.stdout:7/241: dwrite d2/f4a [0,4194304] 0 2024-09-19T09:35:00.045 INFO:tasks.workunit.client.1.smithi191.stdout:7/242: write d2/f21 [1913189,73094] 0 2024-09-19T09:35:00.047 INFO:tasks.workunit.client.1.smithi191.stdout:4/372: dread d5/d1b/d61/f64 [0,4194304] 0 2024-09-19T09:35:00.049 INFO:tasks.workunit.client.1.smithi191.stdout:2/308: truncate d8/d11/d3f/f22 863285 0 2024-09-19T09:35:00.051 INFO:tasks.workunit.client.1.smithi191.stdout:7/243: symlink d2/d2a/d4f/d59/l5c 0 2024-09-19T09:35:00.051 INFO:tasks.workunit.client.1.smithi191.stdout:7/244: write d2/f34 [396971,79632] 0 2024-09-19T09:35:00.057 INFO:tasks.workunit.client.1.smithi191.stdout:3/288: rename d12/d13/d1a/d1b/d2e/d33 to d12/d37/d51/d62 0 2024-09-19T09:35:00.057 INFO:tasks.workunit.client.1.smithi191.stdout:4/373: dread d5/d1b/d1c/d28/f4b [0,4194304] 0 2024-09-19T09:35:00.058 INFO:tasks.workunit.client.1.smithi191.stdout:0/416: mkdir d0/d9/d1c/d1f/d24/d87 0 2024-09-19T09:35:00.059 INFO:tasks.workunit.client.1.smithi191.stdout:2/309: symlink d8/d11/d3f/l6a 0 2024-09-19T09:35:00.059 INFO:tasks.workunit.client.1.smithi191.stdout:2/310: chown d8/d11/f49 2110981276 1 2024-09-19T09:35:00.059 INFO:tasks.workunit.client.1.smithi191.stdout:2/311: stat d8/db/d41/f5c 0 2024-09-19T09:35:00.060 INFO:tasks.workunit.client.1.smithi191.stdout:3/289: link d12/d37/d3d/f40 d12/d43/d61/f63 0 2024-09-19T09:35:00.061 INFO:tasks.workunit.client.1.smithi191.stdout:4/374: mkdir d5/d1b/d61/d88 0 2024-09-19T09:35:00.062 INFO:tasks.workunit.client.1.smithi191.stdout:0/417: link d0/d9/d1c/f7e d0/d6f/d76/f88 0 2024-09-19T09:35:00.062 INFO:tasks.workunit.client.1.smithi191.stdout:1/356: dwrite d3/f4 [0,4194304] 0 2024-09-19T09:35:00.063 INFO:tasks.workunit.client.1.smithi191.stdout:2/312: creat d8/d2a/d65/f6b x:0 0 0 2024-09-19T09:35:00.064 INFO:tasks.workunit.client.1.smithi191.stdout:7/245: rmdir d2/d2a/d38 39 2024-09-19T09:35:00.066 INFO:tasks.workunit.client.1.smithi191.stdout:3/290: mkdir d12/d37/d64 0 2024-09-19T09:35:00.067 INFO:tasks.workunit.client.1.smithi191.stdout:4/375: mknod d5/d1b/d1c/d2f/d37/d59/c89 0 2024-09-19T09:35:00.069 INFO:tasks.workunit.client.1.smithi191.stdout:0/418: creat d0/d9/d1c/d1f/d24/f89 x:0 0 0 2024-09-19T09:35:00.071 INFO:tasks.workunit.client.1.smithi191.stdout:2/313: mknod d8/db/d4e/c6c 0 2024-09-19T09:35:00.072 INFO:tasks.workunit.client.1.smithi191.stdout:3/291: dread d12/f1e [0,4194304] 0 2024-09-19T09:35:00.072 INFO:tasks.workunit.client.1.smithi191.stdout:3/292: chown d12/d13/d1a/d1b/l5a 56960220 1 2024-09-19T09:35:00.073 INFO:tasks.workunit.client.1.smithi191.stdout:0/419: stat d0/d9/d1c/d1f/d24/f63 0 2024-09-19T09:35:00.075 INFO:tasks.workunit.client.1.smithi191.stdout:4/376: mknod d5/d1b/d1c/d24/d32/c8a 0 2024-09-19T09:35:00.075 INFO:tasks.workunit.client.1.smithi191.stdout:3/293: dread d12/d13/f3b [0,4194304] 0 2024-09-19T09:35:00.076 INFO:tasks.workunit.client.1.smithi191.stdout:0/420: unlink d0/d9/d1c/c79 0 2024-09-19T09:35:00.077 INFO:tasks.workunit.client.1.smithi191.stdout:3/294: creat d12/d37/d51/f65 x:0 0 0 2024-09-19T09:35:00.080 INFO:tasks.workunit.client.1.smithi191.stdout:0/421: creat d0/d9/de/d81/f8a x:0 0 0 2024-09-19T09:35:00.082 INFO:tasks.workunit.client.1.smithi191.stdout:0/422: mkdir d0/d9/d1c/d1f/d24/d39/d8b 0 2024-09-19T09:35:00.083 INFO:tasks.workunit.client.1.smithi191.stdout:2/314: dread d8/d11/f38 [4194304,4194304] 0 2024-09-19T09:35:00.083 INFO:tasks.workunit.client.1.smithi191.stdout:2/315: chown d8/c24 0 1 2024-09-19T09:35:00.087 INFO:tasks.workunit.client.1.smithi191.stdout:3/295: dread d12/d43/f52 [0,4194304] 0 2024-09-19T09:35:00.088 INFO:tasks.workunit.client.1.smithi191.stdout:2/316: write d8/db/d13/d40/f52 [3668496,94000] 0 2024-09-19T09:35:00.089 INFO:tasks.workunit.client.1.smithi191.stdout:3/296: rename d12/d13/d1a/d5d/f5f to d12/d13/d1a/d1b/f66 0 2024-09-19T09:35:00.089 INFO:tasks.workunit.client.1.smithi191.stdout:3/297: creat d12/d13/d1a/d1b/d3c/d3f/f67 x:0 0 0 2024-09-19T09:35:00.089 INFO:tasks.workunit.client.1.smithi191.stdout:3/298: fdatasync d12/d13/d1a/f57 0 2024-09-19T09:35:00.094 INFO:tasks.workunit.client.1.smithi191.stdout:0/423: dread d0/d9/d1c/f74 [0,4194304] 0 2024-09-19T09:35:00.094 INFO:tasks.workunit.client.1.smithi191.stdout:0/424: creat d0/d6f/d76/f8c x:0 0 0 2024-09-19T09:35:00.096 INFO:tasks.workunit.client.1.smithi191.stdout:0/425: rename d0/f4 to d0/d9/d1c/d1f/d24/d39/d8b/f8d 0 2024-09-19T09:35:00.100 INFO:tasks.workunit.client.1.smithi191.stdout:0/426: rmdir d0/d9/d1c/d1f/d24 39 2024-09-19T09:35:00.102 INFO:tasks.workunit.client.1.smithi191.stdout:1/357: dwrite d3/d9/da/d1e/d32/d53/d57/f6a [0,4194304] 0 2024-09-19T09:35:00.102 INFO:tasks.workunit.client.1.smithi191.stdout:7/246: dwrite d2/d2a/d4f/d59/f5b [0,4194304] 0 2024-09-19T09:35:00.102 INFO:tasks.workunit.client.1.smithi191.stdout:1/358: write d3/d9/da/d1e/d32/f74 [617104,119591] 0 2024-09-19T09:35:00.102 INFO:tasks.workunit.client.1.smithi191.stdout:2/317: write d8/db/d13/d23/f20 [3886846,41559] 0 2024-09-19T09:35:00.102 INFO:tasks.workunit.client.1.smithi191.stdout:2/318: dread - d8/d11/d3f/f39 zero size 2024-09-19T09:35:00.102 INFO:tasks.workunit.client.1.smithi191.stdout:2/319: write d8/d11/f46 [597007,39899] 0 2024-09-19T09:35:00.102 INFO:tasks.workunit.client.1.smithi191.stdout:2/320: dread - d8/db/d13/d40/f5e zero size 2024-09-19T09:35:00.103 INFO:tasks.workunit.client.1.smithi191.stdout:4/377: dwrite d5/d1b/d1c/d2f/f39 [0,4194304] 0 2024-09-19T09:35:00.103 INFO:tasks.workunit.client.1.smithi191.stdout:4/378: chown d5/d1b/d1c/c4c 986906 1 2024-09-19T09:35:00.106 INFO:tasks.workunit.client.1.smithi191.stdout:7/247: rename d2/f21 to d2/d2a/d33/f5d 0 2024-09-19T09:35:00.106 INFO:tasks.workunit.client.1.smithi191.stdout:0/427: dread d0/d6f/d7b/f82 [0,4194304] 0 2024-09-19T09:35:00.108 INFO:tasks.workunit.client.1.smithi191.stdout:7/248: mkdir d2/d5e 0 2024-09-19T09:35:00.110 INFO:tasks.workunit.client.1.smithi191.stdout:7/249: rmdir d2/d2a 39 2024-09-19T09:35:00.110 INFO:tasks.workunit.client.1.smithi191.stdout:7/250: read - d2/d2a/d33/f54 zero size 2024-09-19T09:35:00.110 INFO:tasks.workunit.client.1.smithi191.stdout:7/251: write d2/f40 [673338,37152] 0 2024-09-19T09:35:00.111 INFO:tasks.workunit.client.1.smithi191.stdout:0/428: symlink d0/d9/de/l8e 0 2024-09-19T09:35:00.112 INFO:tasks.workunit.client.1.smithi191.stdout:7/252: rename d2/c16 to d2/d5e/c5f 0 2024-09-19T09:35:00.114 INFO:tasks.workunit.client.1.smithi191.stdout:7/253: creat d2/f60 x:0 0 0 2024-09-19T09:35:00.114 INFO:tasks.workunit.client.1.smithi191.stdout:7/254: chown d2/d2a/c2c 0 1 2024-09-19T09:35:00.115 INFO:tasks.workunit.client.1.smithi191.stdout:0/429: rename d0/d9/d1c/d1f/d24/f63 to d0/d9/de/f8f 0 2024-09-19T09:35:00.116 INFO:tasks.workunit.client.1.smithi191.stdout:7/255: rmdir d2/d58 0 2024-09-19T09:35:00.116 INFO:tasks.workunit.client.1.smithi191.stdout:7/256: chown d2/d2a/d4f/d59/f5b 926589 1 2024-09-19T09:35:00.117 INFO:tasks.workunit.client.1.smithi191.stdout:0/430: creat d0/d9/d1c/d1f/d24/f90 x:0 0 0 2024-09-19T09:35:00.117 INFO:tasks.workunit.client.1.smithi191.stdout:0/431: chown d0/d9/d1c/d1f/d24/d29/d30/f5b 0 1 2024-09-19T09:35:00.129 INFO:tasks.workunit.client.1.smithi191.stdout:6/310: sync 2024-09-19T09:35:00.130 INFO:tasks.workunit.client.1.smithi191.stdout:6/311: mknod d2/de/d2a/d2d/c67 0 2024-09-19T09:35:00.131 INFO:tasks.workunit.client.1.smithi191.stdout:6/312: creat d2/de/d19/d1e/d64/d44/f68 x:0 0 0 2024-09-19T09:35:00.132 INFO:tasks.workunit.client.1.smithi191.stdout:6/313: creat d2/de/f69 x:0 0 0 2024-09-19T09:35:00.133 INFO:tasks.workunit.client.1.smithi191.stdout:4/379: dwrite d5/d1b/d1c/d2f/d19/f3a [0,4194304] 0 2024-09-19T09:35:00.134 INFO:tasks.workunit.client.1.smithi191.stdout:1/359: dwrite d3/d9/da/d1e/d25/f29 [4194304,4194304] 0 2024-09-19T09:35:00.134 INFO:tasks.workunit.client.1.smithi191.stdout:2/321: dwrite d8/d11/f38 [4194304,4194304] 0 2024-09-19T09:35:00.134 INFO:tasks.workunit.client.1.smithi191.stdout:6/314: creat d2/de/d15/d57/f6a x:0 0 0 2024-09-19T09:35:00.134 INFO:tasks.workunit.client.1.smithi191.stdout:6/315: write d2/de/f10 [221832,47133] 0 2024-09-19T09:35:00.134 INFO:tasks.workunit.client.1.smithi191.stdout:6/316: stat d2/de/d19/d1e/d64/l53 0 2024-09-19T09:35:00.134 INFO:tasks.workunit.client.1.smithi191.stdout:6/317: stat d2/de/d2a/d2d/c20 0 2024-09-19T09:35:00.135 INFO:tasks.workunit.client.1.smithi191.stdout:7/257: getdents d2/d5e 0 2024-09-19T09:35:00.135 INFO:tasks.workunit.client.1.smithi191.stdout:7/258: write d2/f7 [3955306,53285] 0 2024-09-19T09:35:00.135 INFO:tasks.workunit.client.1.smithi191.stdout:4/380: creat d5/d38/d6b/f8b x:0 0 0 2024-09-19T09:35:00.136 INFO:tasks.workunit.client.1.smithi191.stdout:1/360: rename d3/d9/da/d1e/l35 to d3/d9/da/d1e/d32/l7f 0 2024-09-19T09:35:00.137 INFO:tasks.workunit.client.1.smithi191.stdout:2/322: symlink d8/l6d 0 2024-09-19T09:35:00.139 INFO:tasks.workunit.client.1.smithi191.stdout:4/381: mkdir d5/d1b/d1c/d24/d32/d21/d5c/d8c 0 2024-09-19T09:35:00.140 INFO:tasks.workunit.client.1.smithi191.stdout:1/361: truncate d3/f3f 574784 0 2024-09-19T09:35:00.140 INFO:tasks.workunit.client.1.smithi191.stdout:2/323: truncate d8/db/f47 1068405 0 2024-09-19T09:35:00.141 INFO:tasks.workunit.client.1.smithi191.stdout:6/318: getdents d2/de/d2a/d39 0 2024-09-19T09:35:00.141 INFO:tasks.workunit.client.1.smithi191.stdout:7/259: write d2/fd [703741,89207] 0 2024-09-19T09:35:00.142 INFO:tasks.workunit.client.1.smithi191.stdout:4/382: mkdir d5/d38/d73/d8d 0 2024-09-19T09:35:00.143 INFO:tasks.workunit.client.1.smithi191.stdout:2/324: mkdir d8/db/d13/d23/d6e 0 2024-09-19T09:35:00.144 INFO:tasks.workunit.client.1.smithi191.stdout:6/319: link d2/de/d15/d57/f6a d2/de/d15/d57/f6b 0 2024-09-19T09:35:00.145 INFO:tasks.workunit.client.1.smithi191.stdout:4/383: dread d5/d1b/d1c/d28/f83 [0,4194304] 0 2024-09-19T09:35:00.146 INFO:tasks.workunit.client.1.smithi191.stdout:7/260: mkdir d2/d39/d61 0 2024-09-19T09:35:00.147 INFO:tasks.workunit.client.1.smithi191.stdout:4/384: read d5/d1b/d1c/d28/f83 [830477,7149] 0 2024-09-19T09:35:00.148 INFO:tasks.workunit.client.1.smithi191.stdout:7/261: write d2/f34 [240536,116919] 0 2024-09-19T09:35:00.148 INFO:tasks.workunit.client.1.smithi191.stdout:7/262: readlink d2/l22 0 2024-09-19T09:35:00.148 INFO:tasks.workunit.client.1.smithi191.stdout:7/263: dread - d2/f1a zero size 2024-09-19T09:35:00.148 INFO:tasks.workunit.client.1.smithi191.stdout:2/325: symlink d8/db/l6f 0 2024-09-19T09:35:00.149 INFO:tasks.workunit.client.1.smithi191.stdout:7/264: write d2/f1e [130518,8876] 0 2024-09-19T09:35:00.150 INFO:tasks.workunit.client.1.smithi191.stdout:2/326: rmdir d8/db/d13/d23/d6e 0 2024-09-19T09:35:00.150 INFO:tasks.workunit.client.1.smithi191.stdout:2/327: chown d8/d11/l25 485 1 2024-09-19T09:35:00.150 INFO:tasks.workunit.client.1.smithi191.stdout:2/328: dread - d8/db/d13/d35/f36 zero size 2024-09-19T09:35:00.150 INFO:tasks.workunit.client.1.smithi191.stdout:2/329: truncate d8/d2a/f53 614612 0 2024-09-19T09:35:00.152 INFO:tasks.workunit.client.1.smithi191.stdout:7/265: rmdir d2/d39/d61 0 2024-09-19T09:35:00.152 INFO:tasks.workunit.client.1.smithi191.stdout:7/266: chown d2/l14 194955 1 2024-09-19T09:35:00.152 INFO:tasks.workunit.client.1.smithi191.stdout:7/267: dread - d2/d39/f4b zero size 2024-09-19T09:35:00.152 INFO:tasks.workunit.client.1.smithi191.stdout:7/268: write d2/d2a/f2d [993096,104335] 0 2024-09-19T09:35:00.153 INFO:tasks.workunit.client.1.smithi191.stdout:7/269: rename d2/fd to d2/d39/f62 0 2024-09-19T09:35:00.154 INFO:tasks.workunit.client.1.smithi191.stdout:7/270: mkdir d2/d2a/d38/d63 0 2024-09-19T09:35:00.155 INFO:tasks.workunit.client.1.smithi191.stdout:7/271: truncate d2/f40 365845 0 2024-09-19T09:35:00.158 INFO:tasks.workunit.client.1.smithi191.stdout:1/362: dwrite d3/d9/f4e [0,4194304] 0 2024-09-19T09:35:00.158 INFO:tasks.workunit.client.1.smithi191.stdout:1/363: write d3/d9/f24 [61008,87177] 0 2024-09-19T09:35:00.161 INFO:tasks.workunit.client.1.smithi191.stdout:2/330: write d8/db/d13/d35/f37 [3542150,39196] 0 2024-09-19T09:35:00.162 INFO:tasks.workunit.client.1.smithi191.stdout:4/385: dread d5/fe [0,4194304] 0 2024-09-19T09:35:00.163 INFO:tasks.workunit.client.1.smithi191.stdout:1/364: creat d3/d9/da/d1e/d32/f80 x:0 0 0 2024-09-19T09:35:00.165 INFO:tasks.workunit.client.1.smithi191.stdout:2/331: dread d8/f2f [0,4194304] 0 2024-09-19T09:35:00.167 INFO:tasks.workunit.client.1.smithi191.stdout:4/386: mkdir d5/d1b/d8e 0 2024-09-19T09:35:00.170 INFO:tasks.workunit.client.1.smithi191.stdout:4/387: mkdir d5/d1b/d1c/d24/d32/d8f 0 2024-09-19T09:35:00.170 INFO:tasks.workunit.client.1.smithi191.stdout:4/388: write d5/d1b/d61/f64 [3878496,52651] 0 2024-09-19T09:35:00.171 INFO:tasks.workunit.client.1.smithi191.stdout:4/389: truncate d5/d1b/d1c/d24/d32/d21/d78/f79 1857716 0 2024-09-19T09:35:00.171 INFO:tasks.workunit.client.1.smithi191.stdout:4/390: chown d5/d1b/d1c/d2f/d37/d59/l66 527 1 2024-09-19T09:35:00.171 INFO:tasks.workunit.client.1.smithi191.stdout:4/391: truncate d5/d1b/d1c/f5a 585971 0 2024-09-19T09:35:00.175 INFO:tasks.workunit.client.1.smithi191.stdout:7/272: dwrite d2/f47 [0,4194304] 0 2024-09-19T09:35:00.175 INFO:tasks.workunit.client.1.smithi191.stdout:7/273: stat d2/f1e 0 2024-09-19T09:35:00.178 INFO:tasks.workunit.client.1.smithi191.stdout:2/332: dread d8/d11/d3f/f34 [0,4194304] 0 2024-09-19T09:35:00.179 INFO:tasks.workunit.client.1.smithi191.stdout:1/365: write d3/d9/da/db/f1b [373469,8673] 0 2024-09-19T09:35:00.179 INFO:tasks.workunit.client.1.smithi191.stdout:7/274: getdents d2/d39/d3a/d3c 0 2024-09-19T09:35:00.180 INFO:tasks.workunit.client.1.smithi191.stdout:7/275: symlink d2/d2a/d4f/l64 0 2024-09-19T09:35:00.181 INFO:tasks.workunit.client.1.smithi191.stdout:8/386: sync 2024-09-19T09:35:00.181 INFO:tasks.workunit.client.1.smithi191.stdout:7/276: rename d2/f18 to d2/d2a/d4f/d59/f65 0 2024-09-19T09:35:00.182 INFO:tasks.workunit.client.1.smithi191.stdout:7/277: mknod d2/d39/c66 0 2024-09-19T09:35:00.182 INFO:tasks.workunit.client.1.smithi191.stdout:7/278: write d2/f1e [1308354,83981] 0 2024-09-19T09:35:00.187 INFO:tasks.workunit.client.1.smithi191.stdout:7/279: fsync d2/f1e 0 2024-09-19T09:35:00.188 INFO:tasks.workunit.client.1.smithi191.stdout:4/392: dwrite d5/d1b/d1c/d2f/d19/f34 [4194304,4194304] 0 2024-09-19T09:35:00.190 INFO:tasks.workunit.client.1.smithi191.stdout:2/333: write d8/f1d [3343045,95009] 0 2024-09-19T09:35:00.190 INFO:tasks.workunit.client.1.smithi191.stdout:2/334: fsync d8/db/d13/d23/f20 0 2024-09-19T09:35:00.191 INFO:tasks.workunit.client.1.smithi191.stdout:1/366: write d3/d9/da/d1e/d32/f3e [1375019,128830] 0 2024-09-19T09:35:00.193 INFO:tasks.workunit.client.1.smithi191.stdout:8/387: write d1/d16/d3c/f68 [2975528,73406] 0 2024-09-19T09:35:00.193 INFO:tasks.workunit.client.1.smithi191.stdout:8/388: chown d1/d7/cd 240176 1 2024-09-19T09:35:00.194 INFO:tasks.workunit.client.1.smithi191.stdout:4/393: creat d5/d1b/d1c/d24/d82/f90 x:0 0 0 2024-09-19T09:35:00.195 INFO:tasks.workunit.client.1.smithi191.stdout:7/280: rmdir d2/d2a/d33 39 2024-09-19T09:35:00.195 INFO:tasks.workunit.client.1.smithi191.stdout:7/281: chown d2/d2a/d4f/d59/l5c 2 1 2024-09-19T09:35:00.197 INFO:tasks.workunit.client.1.smithi191.stdout:2/335: mkdir d8/db/d13/d35/d70 0 2024-09-19T09:35:00.198 INFO:tasks.workunit.client.1.smithi191.stdout:9/309: sync 2024-09-19T09:35:00.199 INFO:tasks.workunit.client.1.smithi191.stdout:9/310: creat d3/db/f63 x:0 0 0 2024-09-19T09:35:00.199 INFO:tasks.workunit.client.1.smithi191.stdout:1/367: symlink d3/d9/da/d42/l81 0 2024-09-19T09:35:00.202 INFO:tasks.workunit.client.1.smithi191.stdout:9/311: symlink d3/db/d16/d17/d5b/l64 0 2024-09-19T09:35:00.202 INFO:tasks.workunit.client.1.smithi191.stdout:4/394: dread d5/d1b/d1c/d2f/d19/f3a [0,4194304] 0 2024-09-19T09:35:00.203 INFO:tasks.workunit.client.1.smithi191.stdout:1/368: link d3/d9/da/d1e/d32/l50 d3/d9/da/d1e/d32/l82 0 2024-09-19T09:35:00.204 INFO:tasks.workunit.client.1.smithi191.stdout:8/389: getdents d1/d16/d2e/d57 0 2024-09-19T09:35:00.204 INFO:tasks.workunit.client.1.smithi191.stdout:2/336: getdents d8/db/d41 0 2024-09-19T09:35:00.205 INFO:tasks.workunit.client.1.smithi191.stdout:2/337: read d8/d11/f46 [1725556,50273] 0 2024-09-19T09:35:00.206 INFO:tasks.workunit.client.1.smithi191.stdout:2/338: link d8/db/d13/d35/c62 d8/db/d13/d35/d70/c71 0 2024-09-19T09:35:00.207 INFO:tasks.workunit.client.1.smithi191.stdout:2/339: rename d8/d11/c28 to d8/db/d4e/c72 0 2024-09-19T09:35:00.209 INFO:tasks.workunit.client.1.smithi191.stdout:7/282: dwrite d2/f40 [0,4194304] 0 2024-09-19T09:35:00.210 INFO:tasks.workunit.client.1.smithi191.stdout:2/340: getdents d8/db/d13/d40 0 2024-09-19T09:35:00.210 INFO:tasks.workunit.client.1.smithi191.stdout:1/369: dread d3/d9/da/d1e/d32/d53/f1c [0,4194304] 0 2024-09-19T09:35:00.213 INFO:tasks.workunit.client.1.smithi191.stdout:7/283: link d2/f60 d2/f67 0 2024-09-19T09:35:00.214 INFO:tasks.workunit.client.1.smithi191.stdout:1/370: link d3/d9/da/d7e/c62 d3/d9/da/d1e/d32/c83 0 2024-09-19T09:35:00.214 INFO:tasks.workunit.client.1.smithi191.stdout:1/371: creat d3/d9/da/d1e/d25/f84 x:0 0 0 2024-09-19T09:35:00.214 INFO:tasks.workunit.client.1.smithi191.stdout:1/372: fsync d3/d9/da/d1e/d32/d53/d57/d6d/f75 0 2024-09-19T09:35:00.214 INFO:tasks.workunit.client.1.smithi191.stdout:1/373: fdatasync d3/f3f 0 2024-09-19T09:35:00.215 INFO:tasks.workunit.client.1.smithi191.stdout:2/341: symlink d8/db/d13/d40/l73 0 2024-09-19T09:35:00.217 INFO:tasks.workunit.client.1.smithi191.stdout:7/284: rename d2/d2a/d4f/c53 to d2/d2a/c68 0 2024-09-19T09:35:00.219 INFO:tasks.workunit.client.1.smithi191.stdout:8/390: dread d1/d16/d3c/fc [0,4194304] 0 2024-09-19T09:35:00.219 INFO:tasks.workunit.client.1.smithi191.stdout:8/391: truncate d1/d16/d23/f73 160598 0 2024-09-19T09:35:00.220 INFO:tasks.workunit.client.1.smithi191.stdout:8/392: mkdir d1/d16/d2e/d7a 0 2024-09-19T09:35:00.220 INFO:tasks.workunit.client.1.smithi191.stdout:8/393: truncate d1/d7/fe 1787872 0 2024-09-19T09:35:00.220 INFO:tasks.workunit.client.1.smithi191.stdout:8/394: write d1/d16/d3c/d17/f3a [1393119,43745] 0 2024-09-19T09:35:00.220 INFO:tasks.workunit.client.1.smithi191.stdout:8/395: fsync d1/f5e 0 2024-09-19T09:35:00.221 INFO:tasks.workunit.client.1.smithi191.stdout:8/396: getdents d1/d7/d1a 0 2024-09-19T09:35:00.221 INFO:tasks.workunit.client.1.smithi191.stdout:8/397: mknod d1/d16/c7b 0 2024-09-19T09:35:00.222 INFO:tasks.workunit.client.1.smithi191.stdout:8/398: symlink d1/d16/l7c 0 2024-09-19T09:35:00.222 INFO:tasks.workunit.client.1.smithi191.stdout:8/399: write d1/d7/d1a/f63 [5107227,80703] 0 2024-09-19T09:35:00.222 INFO:tasks.workunit.client.1.smithi191.stdout:8/400: chown d1/d16/d3c/d17/f3a 13 1 2024-09-19T09:35:00.227 INFO:tasks.workunit.client.1.smithi191.stdout:4/395: dwrite d5/d1b/d1c/d24/d32/d21/d4a/f4d [4194304,4194304] 0 2024-09-19T09:35:00.227 INFO:tasks.workunit.client.1.smithi191.stdout:1/374: dread d3/d9/f4e [0,4194304] 0 2024-09-19T09:35:00.228 INFO:tasks.workunit.client.1.smithi191.stdout:9/312: dwrite d3/db/d16/d47/d55/f5e [0,4194304] 0 2024-09-19T09:35:00.228 INFO:tasks.workunit.client.1.smithi191.stdout:4/396: stat d5/d1b/d1c/d24/d32/c7c 0 2024-09-19T09:35:00.230 INFO:tasks.workunit.client.1.smithi191.stdout:7/285: dread d2/f47 [0,4194304] 0 2024-09-19T09:35:00.230 INFO:tasks.workunit.client.1.smithi191.stdout:4/397: dread d5/d1b/d1c/d24/d32/d21/f50 [0,4194304] 0 2024-09-19T09:35:00.235 INFO:tasks.workunit.client.1.smithi191.stdout:1/375: rmdir d3/d9/d73 39 2024-09-19T09:35:00.235 INFO:tasks.workunit.client.1.smithi191.stdout:1/376: fdatasync d3/d9/da/d1e/d32/f80 0 2024-09-19T09:35:00.236 INFO:tasks.workunit.client.1.smithi191.stdout:9/313: mknod d3/db/d16/d47/c65 0 2024-09-19T09:35:00.237 INFO:tasks.workunit.client.1.smithi191.stdout:2/342: dread f6 [0,4194304] 0 2024-09-19T09:35:00.237 INFO:tasks.workunit.client.1.smithi191.stdout:4/398: link d5/d38/f45 d5/f91 0 2024-09-19T09:35:00.238 INFO:tasks.workunit.client.1.smithi191.stdout:8/401: read d1/d16/d3c/d28/f2d [300840,117660] 0 2024-09-19T09:35:00.238 INFO:tasks.workunit.client.1.smithi191.stdout:7/286: getdents d2/d2a 0 2024-09-19T09:35:00.240 INFO:tasks.workunit.client.1.smithi191.stdout:9/314: mknod d3/d8/c66 0 2024-09-19T09:35:00.240 INFO:tasks.workunit.client.1.smithi191.stdout:9/315: creat d3/db/d16/d38/f67 x:0 0 0 2024-09-19T09:35:00.241 INFO:tasks.workunit.client.1.smithi191.stdout:8/402: truncate d1/d22/f58 8019867 0 2024-09-19T09:35:00.241 INFO:tasks.workunit.client.1.smithi191.stdout:8/403: chown d1/d16/d3c/d17/f49 1499372 1 2024-09-19T09:35:00.242 INFO:tasks.workunit.client.1.smithi191.stdout:8/404: dread d1/d7/d1a/f5b [0,4194304] 0 2024-09-19T09:35:00.242 INFO:tasks.workunit.client.1.smithi191.stdout:7/287: creat d2/d39/d3a/d3c/f69 x:0 0 0 2024-09-19T09:35:00.246 INFO:tasks.workunit.client.1.smithi191.stdout:9/316: truncate d3/d8/f22 1543593 0 2024-09-19T09:35:00.246 INFO:tasks.workunit.client.1.smithi191.stdout:1/377: dread d3/d9/da/d1e/d32/d53/d57/f6a [0,4194304] 0 2024-09-19T09:35:00.246 INFO:tasks.workunit.client.1.smithi191.stdout:8/405: creat d1/d16/d2e/d57/f7d x:0 0 0 2024-09-19T09:35:00.248 INFO:tasks.workunit.client.1.smithi191.stdout:3/299: sync 2024-09-19T09:35:00.248 INFO:tasks.workunit.client.1.smithi191.stdout:5/329: sync 2024-09-19T09:35:00.248 INFO:tasks.workunit.client.1.smithi191.stdout:6/320: sync 2024-09-19T09:35:00.248 INFO:tasks.workunit.client.1.smithi191.stdout:0/432: sync 2024-09-19T09:35:00.248 INFO:tasks.workunit.client.1.smithi191.stdout:1/378: mknod d3/d9/da/d7e/c85 0 2024-09-19T09:35:00.251 INFO:tasks.workunit.client.1.smithi191.stdout:9/317: mkdir d3/db/d16/d17/d5b/d68 0 2024-09-19T09:35:00.252 INFO:tasks.workunit.client.1.smithi191.stdout:8/406: mkdir d1/d16/d2e/d32/d7e 0 2024-09-19T09:35:00.252 INFO:tasks.workunit.client.1.smithi191.stdout:8/407: stat d1/d7 0 2024-09-19T09:35:00.256 INFO:tasks.workunit.client.1.smithi191.stdout:8/408: write d1/d22/f2c [4585350,46943] 0 2024-09-19T09:35:00.257 INFO:tasks.workunit.client.1.smithi191.stdout:5/330: rename d0/d4/d9/d1d/d28/f42 to d0/d4/f78 0 2024-09-19T09:35:00.257 INFO:tasks.workunit.client.1.smithi191.stdout:1/379: getdents d3/d9/da/d42 0 2024-09-19T09:35:00.257 INFO:tasks.workunit.client.1.smithi191.stdout:1/380: fdatasync d3/d9/da/d1e/d32/d53/f2c 0 2024-09-19T09:35:00.257 INFO:tasks.workunit.client.1.smithi191.stdout:1/381: fsync d3/d9/da/d1e/d32/d53/d57/f6a 0 2024-09-19T09:35:00.258 INFO:tasks.workunit.client.1.smithi191.stdout:3/300: unlink d12/d13/d1a/c21 0 2024-09-19T09:35:00.258 INFO:tasks.workunit.client.1.smithi191.stdout:3/301: chown d12/d37 44123198 1 2024-09-19T09:35:00.259 INFO:tasks.workunit.client.1.smithi191.stdout:8/409: creat d1/d16/d3c/d28/d79/f7f x:0 0 0 2024-09-19T09:35:00.261 INFO:tasks.workunit.client.1.smithi191.stdout:0/433: rename d0/d6f/d7b/f82 to d0/d9/d1c/d1f/d24/d29/d30/f91 0 2024-09-19T09:35:00.263 INFO:tasks.workunit.client.1.smithi191.stdout:5/331: link d0/d4/d9/d1d/d22/d5c/l63 d0/d4/d9/d1d/d29/d33/d45/l79 0 2024-09-19T09:35:00.264 INFO:tasks.workunit.client.1.smithi191.stdout:5/332: chown d0/d4/d4a/f4b 124042955 1 2024-09-19T09:35:00.265 INFO:tasks.workunit.client.1.smithi191.stdout:1/382: creat d3/d9/da/db/f86 x:0 0 0 2024-09-19T09:35:00.265 INFO:tasks.workunit.client.1.smithi191.stdout:6/321: read d2/de/f22 [2409752,80843] 0 2024-09-19T09:35:00.265 INFO:tasks.workunit.client.1.smithi191.stdout:6/322: chown d2/de/d15/l1c 5219 1 2024-09-19T09:35:00.265 INFO:tasks.workunit.client.1.smithi191.stdout:8/410: link d1/d16/d2e/d57/f6e d1/d22/d34/f80 0 2024-09-19T09:35:00.266 INFO:tasks.workunit.client.1.smithi191.stdout:3/302: rename d12/d43/d61/f63 to d12/d13/d1a/d1b/d3c/f68 0 2024-09-19T09:35:00.267 INFO:tasks.workunit.client.1.smithi191.stdout:3/303: chown d12/d43 6028 1 2024-09-19T09:35:00.267 INFO:tasks.workunit.client.1.smithi191.stdout:3/304: stat d12/d37/d3d/l4a 0 2024-09-19T09:35:00.268 INFO:tasks.workunit.client.1.smithi191.stdout:1/383: creat d3/f87 x:0 0 0 2024-09-19T09:35:00.268 INFO:tasks.workunit.client.1.smithi191.stdout:8/411: truncate d1/f14 32517 0 2024-09-19T09:35:00.269 INFO:tasks.workunit.client.1.smithi191.stdout:1/384: link d3/d9/da/d1e/d32/l82 d3/d9/da/d1e/d32/d53/d57/d6d/l88 0 2024-09-19T09:35:00.270 INFO:tasks.workunit.client.1.smithi191.stdout:8/412: creat d1/d22/f81 x:0 0 0 2024-09-19T09:35:00.271 INFO:tasks.workunit.client.1.smithi191.stdout:3/305: getdents d12 0 2024-09-19T09:35:00.272 INFO:tasks.workunit.client.1.smithi191.stdout:1/385: mknod d3/d9/da/db/c89 0 2024-09-19T09:35:00.272 INFO:tasks.workunit.client.1.smithi191.stdout:1/386: dread - d3/d9/da/db/f86 zero size 2024-09-19T09:35:00.274 INFO:tasks.workunit.client.1.smithi191.stdout:1/387: rmdir d3/d9/da/d42 39 2024-09-19T09:35:00.275 INFO:tasks.workunit.client.1.smithi191.stdout:8/413: write d1/d16/d3c/fc [2765011,95198] 0 2024-09-19T09:35:00.275 INFO:tasks.workunit.client.1.smithi191.stdout:7/288: dwrite d2/f1b [0,4194304] 0 2024-09-19T09:35:00.275 INFO:tasks.workunit.client.1.smithi191.stdout:2/343: dwrite d8/db/f14 [0,4194304] 0 2024-09-19T09:35:00.281 INFO:tasks.workunit.client.1.smithi191.stdout:7/289: unlink d2/c3f 0 2024-09-19T09:35:00.282 INFO:tasks.workunit.client.1.smithi191.stdout:9/318: dwrite d3/d60/f50 [4194304,4194304] 0 2024-09-19T09:35:00.282 INFO:tasks.workunit.client.1.smithi191.stdout:9/319: chown f2 90 1 2024-09-19T09:35:00.282 INFO:tasks.workunit.client.1.smithi191.stdout:9/320: dread - d3/db/d16/d38/f67 zero size 2024-09-19T09:35:00.283 INFO:tasks.workunit.client.1.smithi191.stdout:4/399: dwrite d5/fa [0,4194304] 0 2024-09-19T09:35:00.283 INFO:tasks.workunit.client.1.smithi191.stdout:4/400: readlink d5/d1b/d1c/d24/d32/d21/d56/l70 0 2024-09-19T09:35:00.283 INFO:tasks.workunit.client.1.smithi191.stdout:4/401: write f4 [41525,81233] 0 2024-09-19T09:35:00.285 INFO:tasks.workunit.client.1.smithi191.stdout:9/321: rename d3/db/d16/d17/d3c/f5a to d3/db/d16/d47/f69 0 2024-09-19T09:35:00.286 INFO:tasks.workunit.client.1.smithi191.stdout:4/402: unlink d5/d1b/d1c/d2f/c77 0 2024-09-19T09:35:00.286 INFO:tasks.workunit.client.1.smithi191.stdout:4/403: fdatasync d5/d1b/d1c/d28/f58 0 2024-09-19T09:35:00.286 INFO:tasks.workunit.client.1.smithi191.stdout:4/404: truncate d5/d1b/d1c/d28/f48 380099 0 2024-09-19T09:35:00.288 INFO:tasks.workunit.client.1.smithi191.stdout:9/322: rename d3/c2d to d3/d8/c6a 0 2024-09-19T09:35:00.288 INFO:tasks.workunit.client.1.smithi191.stdout:9/323: write d3/f2c [261682,102552] 0 2024-09-19T09:35:00.288 INFO:tasks.workunit.client.1.smithi191.stdout:9/324: chown d3/d8 68606 1 2024-09-19T09:35:00.288 INFO:tasks.workunit.client.1.smithi191.stdout:9/325: chown f2 297798 1 2024-09-19T09:35:00.292 INFO:tasks.workunit.client.1.smithi191.stdout:8/414: dread d1/d16/f46 [0,4194304] 0 2024-09-19T09:35:00.292 INFO:tasks.workunit.client.1.smithi191.stdout:8/415: fdatasync d1/d16/d3c/d17/f51 0 2024-09-19T09:35:00.292 INFO:tasks.workunit.client.1.smithi191.stdout:8/416: write d1/d16/d3c/f62 [2935,126047] 0 2024-09-19T09:35:00.295 INFO:tasks.workunit.client.1.smithi191.stdout:7/290: dread d2/f4a [0,4194304] 0 2024-09-19T09:35:00.297 INFO:tasks.workunit.client.1.smithi191.stdout:7/291: link d2/f40 d2/d2a/d38/d63/f6a 0 2024-09-19T09:35:00.297 INFO:tasks.workunit.client.1.smithi191.stdout:7/292: read d2/f7 [1405574,54724] 0 2024-09-19T09:35:00.305 INFO:tasks.workunit.client.1.smithi191.stdout:6/323: dwrite d2/de/d15/d57/f6a [0,4194304] 0 2024-09-19T09:35:00.305 INFO:tasks.workunit.client.1.smithi191.stdout:6/324: fdatasync d2/de/d19/d1e/d64/d44/f68 0 2024-09-19T09:35:00.313 INFO:tasks.workunit.client.1.smithi191.stdout:7/293: dread d2/d2a/d4f/d59/f5b [0,4194304] 0 2024-09-19T09:35:00.313 INFO:tasks.workunit.client.1.smithi191.stdout:7/294: stat d2/f23 0 2024-09-19T09:35:00.318 INFO:tasks.workunit.client.1.smithi191.stdout:2/344: dwrite d8/db/d13/d35/f5a [0,4194304] 0 2024-09-19T09:35:00.318 INFO:tasks.workunit.client.1.smithi191.stdout:2/345: chown d8/db/d13/d23/l33 0 1 2024-09-19T09:35:00.321 INFO:tasks.workunit.client.1.smithi191.stdout:4/405: dwrite d5/d1b/d1c/f29 [0,4194304] 0 2024-09-19T09:35:00.321 INFO:tasks.workunit.client.1.smithi191.stdout:2/346: read d8/db/d41/f5c [264936,116398] 0 2024-09-19T09:35:00.321 INFO:tasks.workunit.client.1.smithi191.stdout:5/333: dwrite d0/d4/d9/f5a [0,4194304] 0 2024-09-19T09:35:00.322 INFO:tasks.workunit.client.1.smithi191.stdout:0/434: dwrite d0/d9/d1c/d1f/d24/d39/d8b/f8d [0,4194304] 0 2024-09-19T09:35:00.326 INFO:tasks.workunit.client.1.smithi191.stdout:8/417: dwrite d1/d16/d3c/d28/f2d [0,4194304] 0 2024-09-19T09:35:00.327 INFO:tasks.workunit.client.1.smithi191.stdout:9/326: dwrite d3/db/d16/f2a [0,4194304] 0 2024-09-19T09:35:00.327 INFO:tasks.workunit.client.1.smithi191.stdout:5/334: rename d0/d4/f24 to d0/d4/d9/d1d/d22/d3b/f7a 0 2024-09-19T09:35:00.327 INFO:tasks.workunit.client.1.smithi191.stdout:5/335: chown d0/d4/d9/d1d/d28/d53/f75 876660 1 2024-09-19T09:35:00.327 INFO:tasks.workunit.client.1.smithi191.stdout:5/336: write d0/d4/d9/d1d/d29/d33/f34 [1960996,63736] 0 2024-09-19T09:35:00.330 INFO:tasks.workunit.client.1.smithi191.stdout:0/435: mknod d0/d9/d1c/d1f/d24/d29/d30/d56/c92 0 2024-09-19T09:35:00.330 INFO:tasks.workunit.client.1.smithi191.stdout:0/436: chown d0/d9/f7f 63 1 2024-09-19T09:35:00.330 INFO:tasks.workunit.client.1.smithi191.stdout:0/437: truncate d0/d9/d1c/d1f/d24/d39/d58/f67 1995213 0 2024-09-19T09:35:00.330 INFO:tasks.workunit.client.1.smithi191.stdout:0/438: write d0/d9/f7f [501685,112523] 0 2024-09-19T09:35:00.335 INFO:tasks.workunit.client.1.smithi191.stdout:4/406: getdents d5 0 2024-09-19T09:35:00.335 INFO:tasks.workunit.client.1.smithi191.stdout:4/407: write d5/f4e [2548926,108957] 0 2024-09-19T09:35:00.338 INFO:tasks.workunit.client.1.smithi191.stdout:9/327: rmdir d3/db/d16/d17/d5b 39 2024-09-19T09:35:00.341 INFO:tasks.workunit.client.1.smithi191.stdout:4/408: truncate d5/d1b/d1c/d24/d32/d21/d78/f79 465407 0 2024-09-19T09:35:00.341 INFO:tasks.workunit.client.1.smithi191.stdout:5/337: dwrite d0/d4/d9/d1d/d29/d33/f34 [0,4194304] 0 2024-09-19T09:35:00.342 INFO:tasks.workunit.client.1.smithi191.stdout:5/338: truncate d0/d4/d9/d1d/d29/d33/d45/d64/f6c 362350 0 2024-09-19T09:35:00.342 INFO:tasks.workunit.client.1.smithi191.stdout:5/339: readlink d0/d4/d9/d1d/d22/d5c/l63 0 2024-09-19T09:35:00.342 INFO:tasks.workunit.client.1.smithi191.stdout:5/340: readlink d0/l1c 0 2024-09-19T09:35:00.343 INFO:tasks.workunit.client.1.smithi191.stdout:9/328: symlink d3/db/d16/d17/d5b/l6b 0 2024-09-19T09:35:00.343 INFO:tasks.workunit.client.1.smithi191.stdout:9/329: write d3/db/f10 [4995621,6941] 0 2024-09-19T09:35:00.343 INFO:tasks.workunit.client.1.smithi191.stdout:9/330: write d3/db/d16/d47/d55/f1d [1487511,109926] 0 2024-09-19T09:35:00.344 INFO:tasks.workunit.client.1.smithi191.stdout:0/439: symlink d0/d9/d1c/d1f/d24/l93 0 2024-09-19T09:35:00.348 INFO:tasks.workunit.client.1.smithi191.stdout:5/341: creat d0/d4/d9/f7b x:0 0 0 2024-09-19T09:35:00.348 INFO:tasks.workunit.client.1.smithi191.stdout:5/342: chown d0/d4/d9/d1d/d22 29 1 2024-09-19T09:35:00.348 INFO:tasks.workunit.client.1.smithi191.stdout:5/343: read - d0/d4/f37 zero size 2024-09-19T09:35:00.355 INFO:tasks.workunit.client.1.smithi191.stdout:5/344: dread d0/d4/d9/f59 [0,4194304] 0 2024-09-19T09:35:00.356 INFO:tasks.workunit.client.1.smithi191.stdout:5/345: mknod d0/d4/d9/d1d/d22/c7c 0 2024-09-19T09:35:00.357 INFO:tasks.workunit.client.1.smithi191.stdout:5/346: symlink d0/d4/d9/l7d 0 2024-09-19T09:35:00.358 INFO:tasks.workunit.client.1.smithi191.stdout:4/409: truncate d5/fa 2161374 0 2024-09-19T09:35:00.359 INFO:tasks.workunit.client.1.smithi191.stdout:4/410: mkdir d5/d1b/d1c/d24/d32/d21/d92 0 2024-09-19T09:35:00.359 INFO:tasks.workunit.client.1.smithi191.stdout:0/440: dwrite d0/f8 [0,4194304] 0 2024-09-19T09:35:00.361 INFO:tasks.workunit.client.1.smithi191.stdout:4/411: rename d5/d1b/d1c/d24/d32/d21/f75 to d5/d1b/d8e/f93 0 2024-09-19T09:35:00.363 INFO:tasks.workunit.client.1.smithi191.stdout:8/418: truncate d1/d16/f4a 710862 0 2024-09-19T09:35:00.363 INFO:tasks.workunit.client.1.smithi191.stdout:8/419: chown d1/d16/d23/d3e/l6c 203456 1 2024-09-19T09:35:00.363 INFO:tasks.workunit.client.1.smithi191.stdout:8/420: stat d1/d7/f53 0 2024-09-19T09:35:00.368 INFO:tasks.workunit.client.1.smithi191.stdout:4/412: symlink d5/d38/l94 0 2024-09-19T09:35:00.368 INFO:tasks.workunit.client.1.smithi191.stdout:8/421: mknod d1/d16/d3c/d28/c82 0 2024-09-19T09:35:00.369 INFO:tasks.workunit.client.1.smithi191.stdout:8/422: mkdir d1/d4f/d6b/d83 0 2024-09-19T09:35:00.375 INFO:tasks.workunit.client.1.smithi191.stdout:6/325: sync 2024-09-19T09:35:00.376 INFO:tasks.workunit.client.1.smithi191.stdout:3/306: sync 2024-09-19T09:35:00.376 INFO:tasks.workunit.client.1.smithi191.stdout:7/295: sync 2024-09-19T09:35:00.376 INFO:tasks.workunit.client.1.smithi191.stdout:1/388: sync 2024-09-19T09:35:00.377 INFO:tasks.workunit.client.1.smithi191.stdout:3/307: rename d12/d13/l56 to d12/d43/d61/l69 0 2024-09-19T09:35:00.379 INFO:tasks.workunit.client.1.smithi191.stdout:7/296: symlink d2/d2a/d38/d63/l6b 0 2024-09-19T09:35:00.379 INFO:tasks.workunit.client.1.smithi191.stdout:7/297: fdatasync d2/d39/f4b 0 2024-09-19T09:35:00.381 INFO:tasks.workunit.client.1.smithi191.stdout:1/389: mkdir d3/d9/da/d42/d8a 0 2024-09-19T09:35:00.381 INFO:tasks.workunit.client.1.smithi191.stdout:1/390: stat d3/d9/da/d1e/d25/f84 0 2024-09-19T09:35:00.382 INFO:tasks.workunit.client.1.smithi191.stdout:7/298: symlink d2/l6c 0 2024-09-19T09:35:00.382 INFO:tasks.workunit.client.1.smithi191.stdout:7/299: creat d2/f6d x:0 0 0 2024-09-19T09:35:00.382 INFO:tasks.workunit.client.1.smithi191.stdout:7/300: write d2/f23 [785885,50018] 0 2024-09-19T09:35:00.384 INFO:tasks.workunit.client.1.smithi191.stdout:1/391: rename d3/d9/da/d1e/d25/d70/f72 to d3/d9/da/d1e/d32/f8b 0 2024-09-19T09:35:00.387 INFO:tasks.workunit.client.1.smithi191.stdout:1/392: truncate d3/f4 2576337 0 2024-09-19T09:35:00.387 INFO:tasks.workunit.client.1.smithi191.stdout:6/326: dread d2/de/f14 [0,4194304] 0 2024-09-19T09:35:00.387 INFO:tasks.workunit.client.1.smithi191.stdout:6/327: chown d2/de/d19/d1e/d64/c33 6739 1 2024-09-19T09:35:00.389 INFO:tasks.workunit.client.1.smithi191.stdout:6/328: symlink d2/de/d19/d1e/d64/l6c 0 2024-09-19T09:35:00.389 INFO:tasks.workunit.client.1.smithi191.stdout:6/329: chown d2/de/f16 1316110 1 2024-09-19T09:35:00.390 INFO:tasks.workunit.client.1.smithi191.stdout:0/441: dwrite d0/d9/f4d [0,4194304] 0 2024-09-19T09:35:00.394 INFO:tasks.workunit.client.1.smithi191.stdout:7/301: dread d2/f40 [0,4194304] 0 2024-09-19T09:35:00.394 INFO:tasks.workunit.client.1.smithi191.stdout:4/413: dwrite d5/d1b/d1c/d24/d32/f76 [0,4194304] 0 2024-09-19T09:35:00.395 INFO:tasks.workunit.client.1.smithi191.stdout:4/414: write f1 [792708,83393] 0 2024-09-19T09:35:00.395 INFO:tasks.workunit.client.1.smithi191.stdout:4/415: fdatasync d5/d1b/d1c/d2f/f52 0 2024-09-19T09:35:00.395 INFO:tasks.workunit.client.1.smithi191.stdout:4/416: write d5/d1b/d1c/d24/d32/f16 [1819225,23427] 0 2024-09-19T09:35:00.397 INFO:tasks.workunit.client.1.smithi191.stdout:7/302: rmdir d2/d2a/d4f/d59 39 2024-09-19T09:35:00.401 INFO:tasks.workunit.client.1.smithi191.stdout:1/393: dread d3/d9/da/db/d48/f61 [0,4194304] 0 2024-09-19T09:35:00.401 INFO:tasks.workunit.client.1.smithi191.stdout:1/394: chown d3/d9/da/d1e/d32/d53/l6e 5555 1 2024-09-19T09:35:00.401 INFO:tasks.workunit.client.1.smithi191.stdout:1/395: read d3/d9/f24 [121133,54188] 0 2024-09-19T09:35:00.404 INFO:tasks.workunit.client.1.smithi191.stdout:1/396: rename d3/d9/da/d1e/d32/d67 to d3/d9/da/d8c 0 2024-09-19T09:35:00.405 INFO:tasks.workunit.client.1.smithi191.stdout:1/397: mknod d3/d9/da/db/d48/c8d 0 2024-09-19T09:35:00.405 INFO:tasks.workunit.client.1.smithi191.stdout:1/398: getdents d3/d9/da/d1e/d32/d6f 0 2024-09-19T09:35:00.405 INFO:tasks.workunit.client.1.smithi191.stdout:1/399: mknod d3/d9/da/d8c/c8e 0 2024-09-19T09:35:00.407 INFO:tasks.workunit.client.1.smithi191.stdout:4/417: write d5/d1b/d1c/f63 [2284969,119457] 0 2024-09-19T09:35:00.407 INFO:tasks.workunit.client.1.smithi191.stdout:1/400: dread d3/d9/da/db/f1b [4194304,4194304] 0 2024-09-19T09:35:00.409 INFO:tasks.workunit.client.1.smithi191.stdout:4/418: rename d5/d38/d6d to d5/d1b/d1c/d2f/d95 0 2024-09-19T09:35:00.409 INFO:tasks.workunit.client.1.smithi191.stdout:4/419: chown d5/d1b/d1c/d2f/f47 615 1 2024-09-19T09:35:00.410 INFO:tasks.workunit.client.1.smithi191.stdout:1/401: symlink d3/d9/da/d1e/d32/d53/l8f 0 2024-09-19T09:35:00.410 INFO:tasks.workunit.client.1.smithi191.stdout:1/402: chown d3/d9/f17 17279188 1 2024-09-19T09:35:00.414 INFO:tasks.workunit.client.1.smithi191.stdout:7/303: dread d2/d2a/f31 [0,4194304] 0 2024-09-19T09:35:00.415 INFO:tasks.workunit.client.1.smithi191.stdout:7/304: mknod d2/d5e/c6e 0 2024-09-19T09:35:00.415 INFO:tasks.workunit.client.1.smithi191.stdout:7/305: write d2/d39/f62 [2932593,77661] 0 2024-09-19T09:35:00.415 INFO:tasks.workunit.client.1.smithi191.stdout:7/306: write d2/f17 [3206443,82831] 0 2024-09-19T09:35:00.419 INFO:tasks.workunit.client.1.smithi191.stdout:0/442: dread d0/d9/d1c/d1f/d24/d39/d8b/f8d [0,4194304] 0 2024-09-19T09:35:00.420 INFO:tasks.workunit.client.1.smithi191.stdout:1/403: write d3/d9/da/db/f33 [2100670,22152] 0 2024-09-19T09:35:00.421 INFO:tasks.workunit.client.1.smithi191.stdout:7/307: dread d2/ff [0,4194304] 0 2024-09-19T09:35:00.422 INFO:tasks.workunit.client.1.smithi191.stdout:1/404: creat d3/d9/da/d8c/f90 x:0 0 0 2024-09-19T09:35:00.422 INFO:tasks.workunit.client.1.smithi191.stdout:1/405: readlink d3/d9/da/d1e/d25/l4f 0 2024-09-19T09:35:00.423 INFO:tasks.workunit.client.1.smithi191.stdout:7/308: rename d2/f6d to d2/d39/d3a/d3c/f6f 0 2024-09-19T09:35:00.426 INFO:tasks.workunit.client.1.smithi191.stdout:8/423: dwrite d1/d16/d2e/d57/f7d [0,4194304] 0 2024-09-19T09:35:00.426 INFO:tasks.workunit.client.1.smithi191.stdout:3/308: dwrite d12/d37/d3d/f40 [0,4194304] 0 2024-09-19T09:35:00.426 INFO:tasks.workunit.client.1.smithi191.stdout:3/309: creat d12/d37/d3d/f6a x:0 0 0 2024-09-19T09:35:00.426 INFO:tasks.workunit.client.1.smithi191.stdout:3/310: chown d12/d37/d51 7381835 1 2024-09-19T09:35:00.427 INFO:tasks.workunit.client.1.smithi191.stdout:4/420: dwrite d5/d1b/d1c/d2f/f47 [0,4194304] 0 2024-09-19T09:35:00.429 INFO:tasks.workunit.client.1.smithi191.stdout:6/330: dwrite d2/de/d19/d1e/d64/f56 [0,4194304] 0 2024-09-19T09:35:00.432 INFO:tasks.workunit.client.1.smithi191.stdout:0/443: read d0/d9/f4d [2250355,76501] 0 2024-09-19T09:35:00.432 INFO:tasks.workunit.client.1.smithi191.stdout:8/424: mkdir d1/d22/d34/d84 0 2024-09-19T09:35:00.432 INFO:tasks.workunit.client.1.smithi191.stdout:3/311: link d12/d43/c5e d12/d37/d51/d62/c6b 0 2024-09-19T09:35:00.434 INFO:tasks.workunit.client.1.smithi191.stdout:4/421: mkdir d5/d1b/d1c/d28/d96 0 2024-09-19T09:35:00.435 INFO:tasks.workunit.client.1.smithi191.stdout:4/422: chown d5/d1b/d1c/d28/f48 12002780 1 2024-09-19T09:35:00.436 INFO:tasks.workunit.client.1.smithi191.stdout:1/406: dread d3/d9/da/d1e/d25/f29 [0,4194304] 0 2024-09-19T09:35:00.436 INFO:tasks.workunit.client.1.smithi191.stdout:1/407: dread - d3/d9/da/d8c/f90 zero size 2024-09-19T09:35:00.436 INFO:tasks.workunit.client.1.smithi191.stdout:1/408: chown d3/d9/da/db/f33 666 1 2024-09-19T09:35:00.436 INFO:tasks.workunit.client.1.smithi191.stdout:4/423: write d5/f4e [403957,115030] 0 2024-09-19T09:35:00.436 INFO:tasks.workunit.client.1.smithi191.stdout:4/424: creat d5/d1b/d1c/d28/f97 x:0 0 0 2024-09-19T09:35:00.436 INFO:tasks.workunit.client.1.smithi191.stdout:4/425: truncate d5/d1b/d1c/d28/f83 1952998 0 2024-09-19T09:35:00.437 INFO:tasks.workunit.client.1.smithi191.stdout:7/309: dwrite d2/f1a [0,4194304] 0 2024-09-19T09:35:00.443 INFO:tasks.workunit.client.1.smithi191.stdout:0/444: creat d0/d9/de/d81/f94 x:0 0 0 2024-09-19T09:35:00.444 INFO:tasks.workunit.client.1.smithi191.stdout:3/312: getdents d12/d37 0 2024-09-19T09:35:00.444 INFO:tasks.workunit.client.1.smithi191.stdout:3/313: chown d12/d43/d61 14 1 2024-09-19T09:35:00.444 INFO:tasks.workunit.client.1.smithi191.stdout:3/314: write d12/d13/d1a/f29 [3080577,42272] 0 2024-09-19T09:35:00.449 INFO:tasks.workunit.client.1.smithi191.stdout:7/310: symlink d2/d2a/d33/l70 0 2024-09-19T09:35:00.449 INFO:tasks.workunit.client.1.smithi191.stdout:7/311: read d2/ff [213376,26072] 0 2024-09-19T09:35:00.450 INFO:tasks.workunit.client.1.smithi191.stdout:8/425: rmdir d1/d16/d2e/d57 39 2024-09-19T09:35:00.450 INFO:tasks.workunit.client.1.smithi191.stdout:6/331: dwrite d2/de/d15/f26 [0,4194304] 0 2024-09-19T09:35:00.451 INFO:tasks.workunit.client.1.smithi191.stdout:0/445: creat d0/d9/d1c/d1f/d24/d39/f95 x:0 0 0 2024-09-19T09:35:00.452 INFO:tasks.workunit.client.1.smithi191.stdout:0/446: chown d0/d9/de/f10 0 1 2024-09-19T09:35:00.453 INFO:tasks.workunit.client.1.smithi191.stdout:3/315: symlink d12/d13/l6c 0 2024-09-19T09:35:00.454 INFO:tasks.workunit.client.1.smithi191.stdout:1/409: rmdir d3/d9/da/d1e/d32/d53/d57 39 2024-09-19T09:35:00.455 INFO:tasks.workunit.client.1.smithi191.stdout:7/312: creat d2/d2a/f71 x:0 0 0 2024-09-19T09:35:00.456 INFO:tasks.workunit.client.1.smithi191.stdout:7/313: dread d2/f28 [0,4194304] 0 2024-09-19T09:35:00.456 INFO:tasks.workunit.client.1.smithi191.stdout:6/332: creat d2/de/d19/d1e/d64/f6d x:0 0 0 2024-09-19T09:35:00.456 INFO:tasks.workunit.client.1.smithi191.stdout:2/347: sync 2024-09-19T09:35:00.457 INFO:tasks.workunit.client.1.smithi191.stdout:9/331: sync 2024-09-19T09:35:00.457 INFO:tasks.workunit.client.1.smithi191.stdout:5/347: sync 2024-09-19T09:35:00.461 INFO:tasks.workunit.client.1.smithi191.stdout:5/348: write d0/d4/d9/f59 [2072059,97540] 0 2024-09-19T09:35:00.461 INFO:tasks.workunit.client.1.smithi191.stdout:0/447: mknod d0/d6f/c96 0 2024-09-19T09:35:00.463 INFO:tasks.workunit.client.1.smithi191.stdout:3/316: creat d12/d13/d1a/f6d x:0 0 0 2024-09-19T09:35:00.463 INFO:tasks.workunit.client.1.smithi191.stdout:1/410: creat d3/d9/da/d42/f91 x:0 0 0 2024-09-19T09:35:00.466 INFO:tasks.workunit.client.1.smithi191.stdout:9/332: symlink d3/db/d16/d17/d5b/l6c 0 2024-09-19T09:35:00.466 INFO:tasks.workunit.client.1.smithi191.stdout:9/333: fsync d3/db/d16/d38/f3e 0 2024-09-19T09:35:00.466 INFO:tasks.workunit.client.1.smithi191.stdout:9/334: write d3/db/f31 [123875,2101] 0 2024-09-19T09:35:00.466 INFO:tasks.workunit.client.1.smithi191.stdout:9/335: fsync d3/d8/f56 0 2024-09-19T09:35:00.468 INFO:tasks.workunit.client.1.smithi191.stdout:2/348: dread d8/db/d13/d35/f5a [0,4194304] 0 2024-09-19T09:35:00.468 INFO:tasks.workunit.client.1.smithi191.stdout:8/426: dwrite d1/d22/f81 [0,4194304] 0 2024-09-19T09:35:00.468 INFO:tasks.workunit.client.1.smithi191.stdout:5/349: truncate d0/d4/d9/f1e 230033 0 2024-09-19T09:35:00.468 INFO:tasks.workunit.client.1.smithi191.stdout:5/350: creat d0/d4/d9/d1d/d22/d3b/f7e x:0 0 0 2024-09-19T09:35:00.469 INFO:tasks.workunit.client.1.smithi191.stdout:5/351: fsync d0/d4/d9/d1d/d22/d5c/f5e 0 2024-09-19T09:35:00.473 INFO:tasks.workunit.client.1.smithi191.stdout:8/427: unlink d1/d4f/c56 0 2024-09-19T09:35:00.473 INFO:tasks.workunit.client.1.smithi191.stdout:8/428: dread - d1/d16/d3c/d17/f51 zero size 2024-09-19T09:35:00.476 INFO:tasks.workunit.client.1.smithi191.stdout:5/352: mkdir d0/d4/d9/d1d/d29/d7f 0 2024-09-19T09:35:00.476 INFO:tasks.workunit.client.1.smithi191.stdout:1/411: dread d3/f3f [0,4194304] 0 2024-09-19T09:35:00.478 INFO:tasks.workunit.client.1.smithi191.stdout:3/317: rename d12/d13/d1a/d1b/f27 to d12/d13/d1a/d1b/d3c/f6e 0 2024-09-19T09:35:00.480 INFO:tasks.workunit.client.1.smithi191.stdout:9/336: rename d3/db/d16/d17/f4a to d3/db/d16/d47/d55/f6d 0 2024-09-19T09:35:00.480 INFO:tasks.workunit.client.1.smithi191.stdout:6/333: dwrite d2/de/d15/f58 [0,4194304] 0 2024-09-19T09:35:00.482 INFO:tasks.workunit.client.1.smithi191.stdout:9/337: unlink d3/d8/f15 0 2024-09-19T09:35:00.482 INFO:tasks.workunit.client.1.smithi191.stdout:2/349: rename d8/db/c3d to d8/db/d4e/c74 0 2024-09-19T09:35:00.482 INFO:tasks.workunit.client.1.smithi191.stdout:6/334: dread d2/de/d19/d1e/d64/f55 [0,4194304] 0 2024-09-19T09:35:00.485 INFO:tasks.workunit.client.1.smithi191.stdout:2/350: mkdir d8/db/d13/d40/d75 0 2024-09-19T09:35:00.486 INFO:tasks.workunit.client.1.smithi191.stdout:2/351: fsync d8/d11/d56/f69 0 2024-09-19T09:35:00.486 INFO:tasks.workunit.client.1.smithi191.stdout:8/429: write d1/d7/f53 [1078218,106495] 0 2024-09-19T09:35:00.486 INFO:tasks.workunit.client.1.smithi191.stdout:8/430: readlink d1/d7/d1a/l20 0 2024-09-19T09:35:00.487 INFO:tasks.workunit.client.1.smithi191.stdout:8/431: symlink d1/d16/d2e/l85 0 2024-09-19T09:35:00.487 INFO:tasks.workunit.client.1.smithi191.stdout:8/432: write d1/d22/f54 [747902,11815] 0 2024-09-19T09:35:00.489 INFO:tasks.workunit.client.1.smithi191.stdout:8/433: unlink d1/d7/f24 0 2024-09-19T09:35:00.489 INFO:tasks.workunit.client.1.smithi191.stdout:8/434: write d1/d16/d3c/d17/f4d [1460828,61892] 0 2024-09-19T09:35:00.489 INFO:tasks.workunit.client.1.smithi191.stdout:7/314: dwrite d2/d2a/d4f/d59/f65 [0,4194304] 0 2024-09-19T09:35:00.489 INFO:tasks.workunit.client.1.smithi191.stdout:3/318: fdatasync d12/d13/d1a/f29 0 2024-09-19T09:35:00.492 INFO:tasks.workunit.client.1.smithi191.stdout:3/319: symlink d12/d13/d1a/d1b/d3c/d3f/l6f 0 2024-09-19T09:35:00.493 INFO:tasks.workunit.client.1.smithi191.stdout:3/320: mknod d12/d13/c70 0 2024-09-19T09:35:00.494 INFO:tasks.workunit.client.1.smithi191.stdout:9/338: dread d3/db/f11 [0,4194304] 0 2024-09-19T09:35:00.496 INFO:tasks.workunit.client.1.smithi191.stdout:3/321: mkdir d12/d13/d1a/d1b/d3c/d71 0 2024-09-19T09:35:00.498 INFO:tasks.workunit.client.1.smithi191.stdout:6/335: read d2/de/d19/d1e/d64/f2c [2399043,48697] 0 2024-09-19T09:35:00.498 INFO:tasks.workunit.client.1.smithi191.stdout:9/339: mknod d3/db/d16/d17/d5b/c6e 0 2024-09-19T09:35:00.500 INFO:tasks.workunit.client.1.smithi191.stdout:3/322: creat d12/d13/d1a/d1b/d60/f72 x:0 0 0 2024-09-19T09:35:00.500 INFO:tasks.workunit.client.1.smithi191.stdout:3/323: chown f11 50843 1 2024-09-19T09:35:00.501 INFO:tasks.workunit.client.1.smithi191.stdout:3/324: getdents d12/d37 0 2024-09-19T09:35:00.501 INFO:tasks.workunit.client.1.smithi191.stdout:3/325: dread - d12/d13/d1a/d1b/d3c/f6e zero size 2024-09-19T09:35:00.501 INFO:tasks.workunit.client.1.smithi191.stdout:6/336: dread d2/de/d19/d1e/d64/f2c [0,4194304] 0 2024-09-19T09:35:00.501 INFO:tasks.workunit.client.1.smithi191.stdout:6/337: dread - d2/de/d15/f41 zero size 2024-09-19T09:35:00.502 INFO:tasks.workunit.client.1.smithi191.stdout:9/340: unlink d3/ff 0 2024-09-19T09:35:00.504 INFO:tasks.workunit.client.1.smithi191.stdout:3/326: mkdir d12/d37/d64/d73 0 2024-09-19T09:35:00.507 INFO:tasks.workunit.client.1.smithi191.stdout:9/341: creat d3/db/d53/f6f x:0 0 0 2024-09-19T09:35:00.508 INFO:tasks.workunit.client.1.smithi191.stdout:6/338: getdents d2/de/d15/d57 0 2024-09-19T09:35:00.509 INFO:tasks.workunit.client.1.smithi191.stdout:6/339: truncate d2/de/d19/d1e/d64/f2c 1481948 0 2024-09-19T09:35:00.511 INFO:tasks.workunit.client.1.smithi191.stdout:5/353: dwrite d0/d1f/f43 [0,4194304] 0 2024-09-19T09:35:00.511 INFO:tasks.workunit.client.1.smithi191.stdout:5/354: read - d0/d4/d4a/f60 zero size 2024-09-19T09:35:00.511 INFO:tasks.workunit.client.1.smithi191.stdout:5/355: dread - d0/d4/d9/d1d/d29/d33/d52/f71 zero size 2024-09-19T09:35:00.511 INFO:tasks.workunit.client.1.smithi191.stdout:5/356: chown d0/d4/d9 154 1 2024-09-19T09:35:00.511 INFO:tasks.workunit.client.1.smithi191.stdout:5/357: readlink d0/d4/l6 0 2024-09-19T09:35:00.511 INFO:tasks.workunit.client.1.smithi191.stdout:6/340: creat d2/de/d19/f6e x:0 0 0 2024-09-19T09:35:00.511 INFO:tasks.workunit.client.1.smithi191.stdout:0/448: dwrite d0/d9/d1c/d1f/d24/d29/f3d [0,4194304] 0 2024-09-19T09:35:00.511 INFO:tasks.workunit.client.1.smithi191.stdout:0/449: chown d0/d9/de/d61 522750828 1 2024-09-19T09:35:00.512 INFO:tasks.workunit.client.1.smithi191.stdout:5/358: creat d0/d4/d9/d1d/d29/f80 x:0 0 0 2024-09-19T09:35:00.513 INFO:tasks.workunit.client.1.smithi191.stdout:6/341: creat d2/de/d19/d5d/f6f x:0 0 0 2024-09-19T09:35:00.515 INFO:tasks.workunit.client.1.smithi191.stdout:0/450: getdents d0/d9/d1c/d1f/d24/d39/d8b 0 2024-09-19T09:35:00.515 INFO:tasks.workunit.client.1.smithi191.stdout:0/451: stat d0/d6f 0 2024-09-19T09:35:00.516 INFO:tasks.workunit.client.1.smithi191.stdout:6/342: mknod d2/de/d19/d1e/d64/c70 0 2024-09-19T09:35:00.517 INFO:tasks.workunit.client.1.smithi191.stdout:0/452: mknod d0/d9/d1c/d1f/d24/d29/d30/d56/c97 0 2024-09-19T09:35:00.517 INFO:tasks.workunit.client.1.smithi191.stdout:0/453: readlink d0/d9/d1c/d20/l41 0 2024-09-19T09:35:00.517 INFO:tasks.workunit.client.1.smithi191.stdout:0/454: getdents d0/d9/d1c/d1f/d24/d29/d30/d7c 0 2024-09-19T09:35:00.517 INFO:tasks.workunit.client.1.smithi191.stdout:0/455: stat d0/d9/d1c/d1f/f85 0 2024-09-19T09:35:00.520 INFO:tasks.workunit.client.1.smithi191.stdout:9/342: dread d3/f40 [0,4194304] 0 2024-09-19T09:35:00.520 INFO:tasks.workunit.client.1.smithi191.stdout:9/343: creat d3/db/d16/d17/f70 x:0 0 0 2024-09-19T09:35:00.521 INFO:tasks.workunit.client.1.smithi191.stdout:9/344: creat d3/db/f71 x:0 0 0 2024-09-19T09:35:00.522 INFO:tasks.workunit.client.1.smithi191.stdout:9/345: mknod d3/db/d16/d47/d55/c72 0 2024-09-19T09:35:00.527 INFO:tasks.workunit.client.1.smithi191.stdout:5/359: write d0/d1f/f43 [2294927,108051] 0 2024-09-19T09:35:00.528 INFO:tasks.workunit.client.1.smithi191.stdout:5/360: stat d0/d4/d9/d1d/d22/d5c 0 2024-09-19T09:35:00.536 INFO:tasks.workunit.client.1.smithi191.stdout:9/346: dread d3/db/d16/d47/d55/f6d [0,4194304] 0 2024-09-19T09:35:00.537 INFO:tasks.workunit.client.1.smithi191.stdout:9/347: mknod d3/db/d16/d17/c73 0 2024-09-19T09:35:00.540 INFO:tasks.workunit.client.1.smithi191.stdout:8/435: dwrite d1/d16/d2e/d57/f6e [0,4194304] 0 2024-09-19T09:35:00.540 INFO:tasks.workunit.client.1.smithi191.stdout:2/352: dwrite d8/d11/d56/f69 [0,4194304] 0 2024-09-19T09:35:00.540 INFO:tasks.workunit.client.1.smithi191.stdout:2/353: fsync f6 0 2024-09-19T09:35:00.544 INFO:tasks.workunit.client.1.smithi191.stdout:8/436: mknod d1/d4f/d6b/c86 0 2024-09-19T09:35:00.545 INFO:tasks.workunit.client.1.smithi191.stdout:7/315: dwrite d2/d2a/d33/f54 [0,4194304] 0 2024-09-19T09:35:00.545 INFO:tasks.workunit.client.1.smithi191.stdout:7/316: write d2/d2a/f71 [73453,116307] 0 2024-09-19T09:35:00.545 INFO:tasks.workunit.client.1.smithi191.stdout:7/317: stat d2/d2a 0 2024-09-19T09:35:00.545 INFO:tasks.workunit.client.1.smithi191.stdout:3/327: dwrite d12/d37/d3d/f40 [0,4194304] 0 2024-09-19T09:35:00.545 INFO:tasks.workunit.client.1.smithi191.stdout:3/328: write d12/f15 [5486169,91300] 0 2024-09-19T09:35:00.545 INFO:tasks.workunit.client.1.smithi191.stdout:3/329: creat d12/d13/d1a/d1b/d60/f74 x:0 0 0 2024-09-19T09:35:00.546 INFO:tasks.workunit.client.1.smithi191.stdout:0/456: dwrite d0/d9/d1c/d1f/d24/d53/f75 [0,4194304] 0 2024-09-19T09:35:00.547 INFO:tasks.workunit.client.1.smithi191.stdout:2/354: unlink d8/db/d13/d35/f5a 0 2024-09-19T09:35:00.553 INFO:tasks.workunit.client.1.smithi191.stdout:7/318: creat d2/d2a/d4f/f72 x:0 0 0 2024-09-19T09:35:00.556 INFO:tasks.workunit.client.1.smithi191.stdout:3/330: unlink d12/d13/d1a/d1b/l5a 0 2024-09-19T09:35:00.556 INFO:tasks.workunit.client.1.smithi191.stdout:3/331: creat d12/d13/d1a/d1b/d3c/d3f/f75 x:0 0 0 2024-09-19T09:35:00.560 INFO:tasks.workunit.client.1.smithi191.stdout:9/348: dwrite d3/db/d16/d47/d55/f6d [0,4194304] 0 2024-09-19T09:35:00.561 INFO:tasks.workunit.client.1.smithi191.stdout:8/437: dwrite d1/d16/d3c/d28/d79/f7f [0,4194304] 0 2024-09-19T09:35:00.610 INFO:tasks.workunit.client.1.smithi191.stdout:0/457: creat d0/d6f/f98 x:0 0 0 2024-09-19T09:35:00.611 INFO:tasks.workunit.client.1.smithi191.stdout:0/458: read d0/d9/de/f19 [128495,105595] 0 2024-09-19T09:35:00.616 INFO:tasks.workunit.client.1.smithi191.stdout:7/319: creat d2/d2a/d33/f73 x:0 0 0 2024-09-19T09:35:00.616 INFO:tasks.workunit.client.1.smithi191.stdout:7/320: write d2/d39/d3a/d3c/f6f [641371,96017] 0 2024-09-19T09:35:00.622 INFO:tasks.workunit.client.1.smithi191.stdout:3/332: symlink d12/d13/d1a/d1b/d3c/d3f/l76 0 2024-09-19T09:35:00.628 INFO:tasks.workunit.client.1.smithi191.stdout:9/349: creat d3/d8/f74 x:0 0 0 2024-09-19T09:35:00.628 INFO:tasks.workunit.client.1.smithi191.stdout:9/350: write d3/f40 [503820,126693] 0 2024-09-19T09:35:00.634 INFO:tasks.workunit.client.1.smithi191.stdout:4/426: sync 2024-09-19T09:35:00.634 INFO:tasks.workunit.client.1.smithi191.stdout:4/427: fsync d5/d1b/d1c/d2f/f47 0 2024-09-19T09:35:00.649 INFO:tasks.workunit.client.1.smithi191.stdout:8/438: symlink d1/d22/d34/d84/l87 0 2024-09-19T09:35:00.649 INFO:tasks.workunit.client.1.smithi191.stdout:8/439: chown d1/d16/d2e/f6f 2 1 2024-09-19T09:35:00.711 INFO:tasks.workunit.client.1.smithi191.stdout:0/459: mknod d0/d9/de/d61/c99 0 2024-09-19T09:35:00.711 INFO:tasks.workunit.client.1.smithi191.stdout:0/460: fsync d0/d9/d1c/d1f/d24/d39/f95 0 2024-09-19T09:35:00.711 INFO:tasks.workunit.client.1.smithi191.stdout:0/461: getdents d0/d9/d1c/d1f/d24/d29/d30/d7c 0 2024-09-19T09:35:00.713 INFO:tasks.workunit.client.1.smithi191.stdout:9/351: symlink d3/db/d16/d38/l75 0 2024-09-19T09:35:00.715 INFO:tasks.workunit.client.1.smithi191.stdout:8/440: symlink d1/d7/d1a/l88 0 2024-09-19T09:35:00.717 INFO:tasks.workunit.client.1.smithi191.stdout:7/321: getdents d2/d2a 0 2024-09-19T09:35:00.720 INFO:tasks.workunit.client.1.smithi191.stdout:8/441: symlink d1/d16/d2e/d7a/l89 0 2024-09-19T09:35:00.721 INFO:tasks.workunit.client.1.smithi191.stdout:7/322: creat d2/d2a/f74 x:0 0 0 2024-09-19T09:35:00.723 INFO:tasks.workunit.client.1.smithi191.stdout:8/442: truncate d1/d16/d3c/d28/f33 3994471 0 2024-09-19T09:35:00.724 INFO:tasks.workunit.client.1.smithi191.stdout:9/352: rename d3/d8/l34 to d3/d8/l76 0 2024-09-19T09:35:00.725 INFO:tasks.workunit.client.1.smithi191.stdout:7/323: rmdir d2/d39/d3a/d3c 39 2024-09-19T09:35:00.725 INFO:tasks.workunit.client.1.smithi191.stdout:8/443: dread d1/d7/fe [0,4194304] 0 2024-09-19T09:35:00.726 INFO:tasks.workunit.client.1.smithi191.stdout:9/353: symlink d3/db/d16/d17/d5b/d68/l77 0 2024-09-19T09:35:00.727 INFO:tasks.workunit.client.1.smithi191.stdout:8/444: symlink d1/d4f/d6b/l8a 0 2024-09-19T09:35:00.727 INFO:tasks.workunit.client.1.smithi191.stdout:9/354: mkdir d3/d60/d78 0 2024-09-19T09:35:00.728 INFO:tasks.workunit.client.1.smithi191.stdout:9/355: fsync d3/db/d16/d47/d55/f4f 0 2024-09-19T09:35:00.729 INFO:tasks.workunit.client.1.smithi191.stdout:9/356: rename d3/db/d16/d17/d3c/f62 to d3/db/d16/d17/d3c/f79 0 2024-09-19T09:35:00.729 INFO:tasks.workunit.client.1.smithi191.stdout:9/357: chown d3/l12 3400 1 2024-09-19T09:35:00.729 INFO:tasks.workunit.client.1.smithi191.stdout:9/358: read - d3/db/d16/d38/f5f zero size 2024-09-19T09:35:00.729 INFO:tasks.workunit.client.1.smithi191.stdout:9/359: truncate d3/d60/f54 234061 0 2024-09-19T09:35:00.729 INFO:tasks.workunit.client.1.smithi191.stdout:9/360: write d3/db/d16/d17/f4c [3719236,43077] 0 2024-09-19T09:35:00.730 INFO:tasks.workunit.client.1.smithi191.stdout:0/462: truncate d0/d9/d1c/d1f/d24/d53/f75 2496556 0 2024-09-19T09:35:00.730 INFO:tasks.workunit.client.1.smithi191.stdout:0/463: dread - d0/d9/d1c/d1f/d24/d29/d30/f5b zero size 2024-09-19T09:35:00.732 INFO:tasks.workunit.client.1.smithi191.stdout:0/464: getdents d0/d9/d1c/d20 0 2024-09-19T09:35:00.732 INFO:tasks.workunit.client.1.smithi191.stdout:0/465: write d0/d9/f4d [829366,75717] 0 2024-09-19T09:35:00.756 INFO:tasks.workunit.client.1.smithi191.stdout:7/324: dwrite d2/d39/f62 [0,4194304] 0 2024-09-19T09:35:00.756 INFO:tasks.workunit.client.1.smithi191.stdout:9/361: dwrite d3/db/f71 [0,4194304] 0 2024-09-19T09:35:00.770 INFO:tasks.workunit.client.1.smithi191.stdout:7/325: dwrite d2/f1d [0,4194304] 0 2024-09-19T09:35:00.770 INFO:tasks.workunit.client.1.smithi191.stdout:9/362: dread d3/d8/f13 [0,4194304] 0 2024-09-19T09:35:00.770 INFO:tasks.workunit.client.1.smithi191.stdout:7/326: creat d2/f75 x:0 0 0 2024-09-19T09:35:00.771 INFO:tasks.workunit.client.1.smithi191.stdout:7/327: chown d2/d2a/f74 267433435 1 2024-09-19T09:35:00.771 INFO:tasks.workunit.client.1.smithi191.stdout:9/363: chown d3/db/c45 775332 1 2024-09-19T09:35:00.773 INFO:tasks.workunit.client.1.smithi191.stdout:9/364: creat d3/d60/f7a x:0 0 0 2024-09-19T09:35:00.774 INFO:tasks.workunit.client.1.smithi191.stdout:7/328: rename d2/d2a/d33/f45 to d2/d2a/d4f/f76 0 2024-09-19T09:35:00.776 INFO:tasks.workunit.client.1.smithi191.stdout:9/365: link d3/db/d16/f37 d3/d60/d78/f7b 0 2024-09-19T09:35:00.780 INFO:tasks.workunit.client.1.smithi191.stdout:9/366: dread d3/f40 [0,4194304] 0 2024-09-19T09:35:00.781 INFO:tasks.workunit.client.1.smithi191.stdout:7/329: mknod d2/d39/d3a/c77 0 2024-09-19T09:35:00.781 INFO:tasks.workunit.client.1.smithi191.stdout:7/330: fdatasync d2/d39/f62 0 2024-09-19T09:35:00.781 INFO:tasks.workunit.client.1.smithi191.stdout:7/331: dread - d2/d2a/d38/f42 zero size 2024-09-19T09:35:00.794 INFO:tasks.workunit.client.1.smithi191.stdout:3/333: mknod d12/d13/d1a/c77 0 2024-09-19T09:35:00.797 INFO:tasks.workunit.client.1.smithi191.stdout:4/428: symlink d5/d1b/d1c/d24/l98 0 2024-09-19T09:35:00.797 INFO:tasks.workunit.client.1.smithi191.stdout:4/429: truncate d5/d1b/d1c/d24/d32/d21/d78/f7b 897303 0 2024-09-19T09:35:00.799 INFO:tasks.workunit.client.1.smithi191.stdout:4/430: creat d5/f99 x:0 0 0 2024-09-19T09:35:00.802 INFO:tasks.workunit.client.1.smithi191.stdout:1/412: sync 2024-09-19T09:35:00.802 INFO:tasks.workunit.client.1.smithi191.stdout:5/361: sync 2024-09-19T09:35:00.802 INFO:tasks.workunit.client.1.smithi191.stdout:6/343: sync 2024-09-19T09:35:00.802 INFO:tasks.workunit.client.1.smithi191.stdout:5/362: chown d0/d4/d9/d1d/d29/d33/d45/c4e 97 1 2024-09-19T09:35:00.802 INFO:tasks.workunit.client.1.smithi191.stdout:6/344: truncate d2/de/f69 744386 0 2024-09-19T09:35:00.803 INFO:tasks.workunit.client.1.smithi191.stdout:1/413: write d3/d9/da/d1e/d32/d53/d57/d6d/f77 [757743,38871] 0 2024-09-19T09:35:00.803 INFO:tasks.workunit.client.1.smithi191.stdout:2/355: rmdir d8/d11/d56 39 2024-09-19T09:35:00.804 INFO:tasks.workunit.client.1.smithi191.stdout:9/367: write d3/d8/f3b [837157,86343] 0 2024-09-19T09:35:00.804 INFO:tasks.workunit.client.1.smithi191.stdout:9/368: dread - d3/d8/f74 zero size 2024-09-19T09:35:00.805 INFO:tasks.workunit.client.1.smithi191.stdout:6/345: creat d2/de/d2a/d39/f71 x:0 0 0 2024-09-19T09:35:00.805 INFO:tasks.workunit.client.1.smithi191.stdout:6/346: chown d2/de/d2a/d39/f71 1 1 2024-09-19T09:35:00.805 INFO:tasks.workunit.client.1.smithi191.stdout:2/356: symlink d8/db/d4e/l76 0 2024-09-19T09:35:00.807 INFO:tasks.workunit.client.1.smithi191.stdout:9/369: unlink d3/db/d16/d17/d5b/l5c 0 2024-09-19T09:35:00.809 INFO:tasks.workunit.client.1.smithi191.stdout:2/357: symlink d8/db/d13/d23/l77 0 2024-09-19T09:35:00.810 INFO:tasks.workunit.client.1.smithi191.stdout:2/358: dread d8/db/d13/d23/f43 [0,4194304] 0 2024-09-19T09:35:00.811 INFO:tasks.workunit.client.1.smithi191.stdout:9/370: getdents d3/db/d53 0 2024-09-19T09:35:00.811 INFO:tasks.workunit.client.1.smithi191.stdout:2/359: fdatasync d8/db/d13/d23/f1f 0 2024-09-19T09:35:00.811 INFO:tasks.workunit.client.1.smithi191.stdout:2/360: chown d8/d2a/d65 66518661 1 2024-09-19T09:35:00.813 INFO:tasks.workunit.client.1.smithi191.stdout:2/361: rename d8/f1d to d8/db/d13/d23/f78 0 2024-09-19T09:35:00.814 INFO:tasks.workunit.client.1.smithi191.stdout:8/445: write d1/d16/d23/f43 [4272117,25489] 0 2024-09-19T09:35:00.816 INFO:tasks.workunit.client.1.smithi191.stdout:9/371: symlink d3/d8/l7c 0 2024-09-19T09:35:00.816 INFO:tasks.workunit.client.1.smithi191.stdout:9/372: write d3/db/f10 [2339416,96749] 0 2024-09-19T09:35:00.816 INFO:tasks.workunit.client.1.smithi191.stdout:9/373: write d3/db/d16/d38/f3e [842502,113718] 0 2024-09-19T09:35:00.819 INFO:tasks.workunit.client.1.smithi191.stdout:6/347: read d2/de/d15/d57/f6b [3602984,39275] 0 2024-09-19T09:35:00.819 INFO:tasks.workunit.client.1.smithi191.stdout:6/348: truncate d2/de/d2a/d39/f71 981825 0 2024-09-19T09:35:00.819 INFO:tasks.workunit.client.1.smithi191.stdout:6/349: creat d2/de/d19/f72 x:0 0 0 2024-09-19T09:35:00.821 INFO:tasks.workunit.client.1.smithi191.stdout:8/446: mkdir d1/d16/d2e/d32/d7e/d8b 0 2024-09-19T09:35:00.824 INFO:tasks.workunit.client.1.smithi191.stdout:4/431: dwrite d5/d38/d6b/f8b [0,4194304] 0 2024-09-19T09:35:00.824 INFO:tasks.workunit.client.1.smithi191.stdout:4/432: fsync d5/d1b/d1c/d24/d32/f1e 0 2024-09-19T09:35:00.824 INFO:tasks.workunit.client.1.smithi191.stdout:7/332: dwrite d2/d2a/f2f [4194304,4194304] 0 2024-09-19T09:35:00.825 INFO:tasks.workunit.client.1.smithi191.stdout:6/350: symlink d2/de/d19/d1e/l73 0 2024-09-19T09:35:00.827 INFO:tasks.workunit.client.1.smithi191.stdout:7/333: write d2/f4a [889055,72098] 0 2024-09-19T09:35:00.827 INFO:tasks.workunit.client.1.smithi191.stdout:9/374: getdents d3/db/d16 0 2024-09-19T09:35:00.827 INFO:tasks.workunit.client.1.smithi191.stdout:9/375: truncate d3/db/d16/d38/f3e 1562399 0 2024-09-19T09:35:00.830 INFO:tasks.workunit.client.1.smithi191.stdout:7/334: mkdir d2/d2a/d4f/d78 0 2024-09-19T09:35:00.831 INFO:tasks.workunit.client.1.smithi191.stdout:7/335: rmdir d2/d2a/d38/d63 39 2024-09-19T09:35:00.834 INFO:tasks.workunit.client.1.smithi191.stdout:7/336: mkdir d2/d2a/d79 0 2024-09-19T09:35:00.836 INFO:tasks.workunit.client.1.smithi191.stdout:1/414: dwrite d3/d9/f17 [0,4194304] 0 2024-09-19T09:35:00.836 INFO:tasks.workunit.client.1.smithi191.stdout:5/363: dwrite d0/d4/d9/d1d/d22/d3b/f74 [0,4194304] 0 2024-09-19T09:35:00.848 INFO:tasks.workunit.client.1.smithi191.stdout:5/364: mknod d0/d4/c81 0 2024-09-19T09:35:00.848 INFO:tasks.workunit.client.1.smithi191.stdout:9/376: dread d3/d8/f3b [0,4194304] 0 2024-09-19T09:35:00.849 INFO:tasks.workunit.client.1.smithi191.stdout:5/365: unlink d0/d4/d9/d1d/d28/d53/f75 0 2024-09-19T09:35:00.851 INFO:tasks.workunit.client.1.smithi191.stdout:9/377: mknod d3/db/d16/d17/d3c/c7d 0 2024-09-19T09:35:00.852 INFO:tasks.workunit.client.1.smithi191.stdout:5/366: symlink d0/d4/d9/d1d/d29/d33/l82 0 2024-09-19T09:35:00.852 INFO:tasks.workunit.client.1.smithi191.stdout:5/367: fdatasync d0/d4/d4a/f4b 0 2024-09-19T09:35:00.853 INFO:tasks.workunit.client.1.smithi191.stdout:9/378: creat d3/db/d16/f7e x:0 0 0 2024-09-19T09:35:00.853 INFO:tasks.workunit.client.1.smithi191.stdout:4/433: dwrite d5/fe [0,4194304] 0 2024-09-19T09:35:00.854 INFO:tasks.workunit.client.1.smithi191.stdout:9/379: symlink d3/d8/l7f 0 2024-09-19T09:35:00.855 INFO:tasks.workunit.client.1.smithi191.stdout:8/447: rename d1/d16/d3c/la to d1/d16/d2e/d32/l8c 0 2024-09-19T09:35:00.857 INFO:tasks.workunit.client.1.smithi191.stdout:9/380: mknod d3/db/c80 0 2024-09-19T09:35:00.857 INFO:tasks.workunit.client.1.smithi191.stdout:9/381: readlink d3/db/d53/l59 0 2024-09-19T09:35:00.858 INFO:tasks.workunit.client.1.smithi191.stdout:4/434: rename d5/d1b/d1c/d28/f4b to d5/d1b/d1c/d28/d96/f9a 0 2024-09-19T09:35:00.859 INFO:tasks.workunit.client.1.smithi191.stdout:4/435: fdatasync d5/f18 0 2024-09-19T09:35:00.859 INFO:tasks.workunit.client.1.smithi191.stdout:8/448: mknod d1/d4f/c8d 0 2024-09-19T09:35:00.860 INFO:tasks.workunit.client.1.smithi191.stdout:9/382: read d3/db/f11 [3742417,31661] 0 2024-09-19T09:35:00.860 INFO:tasks.workunit.client.1.smithi191.stdout:6/351: dwrite d2/de/d2a/d2d/d30/f3f [0,4194304] 0 2024-09-19T09:35:00.861 INFO:tasks.workunit.client.1.smithi191.stdout:4/436: creat d5/d1b/d1c/d2f/d37/d59/f9b x:0 0 0 2024-09-19T09:35:00.863 INFO:tasks.workunit.client.1.smithi191.stdout:8/449: unlink d1/d16/d3c/d28/f2d 0 2024-09-19T09:35:00.863 INFO:tasks.workunit.client.1.smithi191.stdout:8/450: chown d1/d16/d2e/d57/f7d 2 1 2024-09-19T09:35:00.864 INFO:tasks.workunit.client.1.smithi191.stdout:3/334: mknod d12/d13/c78 0 2024-09-19T09:35:00.864 INFO:tasks.workunit.client.1.smithi191.stdout:3/335: truncate d12/d13/d1a/d1b/d3c/f6e 687383 0 2024-09-19T09:35:00.865 INFO:tasks.workunit.client.1.smithi191.stdout:8/451: rmdir d1 39 2024-09-19T09:35:00.865 INFO:tasks.workunit.client.1.smithi191.stdout:8/452: creat d1/d16/d2e/f8e x:0 0 0 2024-09-19T09:35:00.866 INFO:tasks.workunit.client.1.smithi191.stdout:3/336: rename d12/d13/d1a/d1b/d3c/f50 to d12/d37/d64/d73/f79 0 2024-09-19T09:35:00.868 INFO:tasks.workunit.client.1.smithi191.stdout:4/437: dread d5/d38/f45 [0,4194304] 0 2024-09-19T09:35:00.869 INFO:tasks.workunit.client.1.smithi191.stdout:4/438: dread d5/d1b/d8e/f93 [0,4194304] 0 2024-09-19T09:35:00.869 INFO:tasks.workunit.client.1.smithi191.stdout:8/453: link d1/d16/d3c/f62 d1/d16/d3c/d17/f8f 0 2024-09-19T09:35:00.870 INFO:tasks.workunit.client.1.smithi191.stdout:8/454: read - d1/d16/d3c/f67 zero size 2024-09-19T09:35:00.870 INFO:tasks.workunit.client.1.smithi191.stdout:8/455: readlink d1/d16/d23/l2f 0 2024-09-19T09:35:00.870 INFO:tasks.workunit.client.1.smithi191.stdout:8/456: readlink d1/d7/d1a/l88 0 2024-09-19T09:35:00.870 INFO:tasks.workunit.client.1.smithi191.stdout:8/457: stat d1/d16/d23/d3e/f71 0 2024-09-19T09:35:00.870 INFO:tasks.workunit.client.1.smithi191.stdout:1/415: dwrite d3/d9/f78 [0,4194304] 0 2024-09-19T09:35:00.870 INFO:tasks.workunit.client.1.smithi191.stdout:3/337: rmdir d12/d37/d51/d62 39 2024-09-19T09:35:00.873 INFO:tasks.workunit.client.1.smithi191.stdout:4/439: rename d5/d1b/d1c/d2f/d37/f62 to d5/d1b/d61/d88/f9c 0 2024-09-19T09:35:00.873 INFO:tasks.workunit.client.1.smithi191.stdout:4/440: chown d5/d1b/d1c/d24/d32/d21/d27 1761 1 2024-09-19T09:35:00.874 INFO:tasks.workunit.client.1.smithi191.stdout:9/383: dread d3/d60/d78/f7b [0,4194304] 0 2024-09-19T09:35:00.874 INFO:tasks.workunit.client.1.smithi191.stdout:5/368: dwrite d0/d4/d9/d1d/d29/d33/d52/f71 [0,4194304] 0 2024-09-19T09:35:00.874 INFO:tasks.workunit.client.1.smithi191.stdout:6/352: read d2/fa [2555645,13433] 0 2024-09-19T09:35:00.874 INFO:tasks.workunit.client.1.smithi191.stdout:7/337: dwrite d2/d2a/f2d [0,4194304] 0 2024-09-19T09:35:00.874 INFO:tasks.workunit.client.1.smithi191.stdout:7/338: stat d2/f23 0 2024-09-19T09:35:00.876 INFO:tasks.workunit.client.1.smithi191.stdout:1/416: mkdir d3/d9/da/d92 0 2024-09-19T09:35:00.877 INFO:tasks.workunit.client.1.smithi191.stdout:3/338: mkdir d12/d13/d1a/d1b/d60/d7a 0 2024-09-19T09:35:00.878 INFO:tasks.workunit.client.1.smithi191.stdout:4/441: link d5/fe d5/d1b/d1c/d2f/f9d 0 2024-09-19T09:35:00.879 INFO:tasks.workunit.client.1.smithi191.stdout:4/442: truncate d5/f91 1356314 0 2024-09-19T09:35:00.879 INFO:tasks.workunit.client.1.smithi191.stdout:4/443: chown d5/d1b/d1c/d24/d32/d21/d78 287 1 2024-09-19T09:35:00.879 INFO:tasks.workunit.client.1.smithi191.stdout:2/362: rmdir d8/db/d13/d23 39 2024-09-19T09:35:00.879 INFO:tasks.workunit.client.1.smithi191.stdout:4/444: readlink d5/d1b/l3f 0 2024-09-19T09:35:00.881 INFO:tasks.workunit.client.1.smithi191.stdout:8/458: dread d1/d16/d2e/d57/f7d [0,4194304] 0 2024-09-19T09:35:00.882 INFO:tasks.workunit.client.1.smithi191.stdout:5/369: truncate d0/d4/d9/d1d/d22/f5d 2282957 0 2024-09-19T09:35:00.882 INFO:tasks.workunit.client.1.smithi191.stdout:2/363: dread d8/db/d13/d23/f43 [0,4194304] 0 2024-09-19T09:35:00.882 INFO:tasks.workunit.client.1.smithi191.stdout:2/364: write d8/d11/d3f/f22 [1230536,70798] 0 2024-09-19T09:35:00.886 INFO:tasks.workunit.client.1.smithi191.stdout:5/370: dread d0/d4/d9/d1d/d29/f62 [0,4194304] 0 2024-09-19T09:35:00.886 INFO:tasks.workunit.client.1.smithi191.stdout:7/339: rename d2/d2a/c36 to d2/d2a/d4f/d59/c7a 0 2024-09-19T09:35:00.887 INFO:tasks.workunit.client.1.smithi191.stdout:7/340: creat d2/d2a/d4f/f7b x:0 0 0 2024-09-19T09:35:00.887 INFO:tasks.workunit.client.1.smithi191.stdout:7/341: fdatasync d2/d39/d3a/d3c/f6f 0 2024-09-19T09:35:00.888 INFO:tasks.workunit.client.1.smithi191.stdout:7/342: chown d2/d2a/d33/f73 833 1 2024-09-19T09:35:00.888 INFO:tasks.workunit.client.1.smithi191.stdout:1/417: getdents d3/d9/da/d7e 0 2024-09-19T09:35:00.889 INFO:tasks.workunit.client.1.smithi191.stdout:8/459: mknod d1/d16/d3c/d28/d79/c90 0 2024-09-19T09:35:00.889 INFO:tasks.workunit.client.1.smithi191.stdout:8/460: chown d1/d16/d3c/f62 1662247441 1 2024-09-19T09:35:00.890 INFO:tasks.workunit.client.1.smithi191.stdout:2/365: creat d8/d11/d56/f79 x:0 0 0 2024-09-19T09:35:00.890 INFO:tasks.workunit.client.1.smithi191.stdout:2/366: chown d8/d11/d3f/c2c 108989130 1 2024-09-19T09:35:00.890 INFO:tasks.workunit.client.1.smithi191.stdout:2/367: fsync d8/d11/d3f/f34 0 2024-09-19T09:35:00.890 INFO:tasks.workunit.client.1.smithi191.stdout:2/368: dread - d8/d2a/d65/f6b zero size 2024-09-19T09:35:00.891 INFO:tasks.workunit.client.1.smithi191.stdout:5/371: symlink d0/d4/d9/d1d/d22/d3b/l83 0 2024-09-19T09:35:00.891 INFO:tasks.workunit.client.1.smithi191.stdout:5/372: chown d0/d4 5184424 1 2024-09-19T09:35:00.894 INFO:tasks.workunit.client.1.smithi191.stdout:7/343: rename d2/d2a/d4f/d59/f5b to d2/d2a/d33/f7c 0 2024-09-19T09:35:00.894 INFO:tasks.workunit.client.1.smithi191.stdout:7/344: chown d2/f34 1910 1 2024-09-19T09:35:00.894 INFO:tasks.workunit.client.1.smithi191.stdout:7/345: write d2/d2a/d33/f3e [823732,81928] 0 2024-09-19T09:35:00.894 INFO:tasks.workunit.client.1.smithi191.stdout:7/346: dread - d2/d39/d3a/d3c/f69 zero size 2024-09-19T09:35:00.896 INFO:tasks.workunit.client.1.smithi191.stdout:7/347: read d2/d39/d3a/d3c/f6f [627818,97207] 0 2024-09-19T09:35:00.896 INFO:tasks.workunit.client.1.smithi191.stdout:7/348: readlink d2/d2a/l3d 0 2024-09-19T09:35:00.896 INFO:tasks.workunit.client.1.smithi191.stdout:8/461: creat d1/d16/d2e/d32/d7e/d8b/f91 x:0 0 0 2024-09-19T09:35:00.896 INFO:tasks.workunit.client.1.smithi191.stdout:8/462: chown d1/d16/d3c/d28/d79 115552124 1 2024-09-19T09:35:00.896 INFO:tasks.workunit.client.1.smithi191.stdout:8/463: dread - d1/d16/d2e/f6f zero size 2024-09-19T09:35:00.896 INFO:tasks.workunit.client.1.smithi191.stdout:8/464: dread - d1/f36 zero size 2024-09-19T09:35:00.896 INFO:tasks.workunit.client.1.smithi191.stdout:8/465: dread - d1/d16/d3c/f67 zero size 2024-09-19T09:35:00.897 INFO:tasks.workunit.client.1.smithi191.stdout:2/369: symlink d8/d11/l7a 0 2024-09-19T09:35:00.899 INFO:tasks.workunit.client.1.smithi191.stdout:5/373: link d0/d4/d9/d1d/d22/d5c/f5e d0/d1f/f84 0 2024-09-19T09:35:00.899 INFO:tasks.workunit.client.1.smithi191.stdout:5/374: chown d0/d4/d4a/c76 505 1 2024-09-19T09:35:00.899 INFO:tasks.workunit.client.1.smithi191.stdout:5/375: readlink d0/d4/d9/de/l44 0 2024-09-19T09:35:00.899 INFO:tasks.workunit.client.1.smithi191.stdout:5/376: stat d0 0 2024-09-19T09:35:00.899 INFO:tasks.workunit.client.1.smithi191.stdout:5/377: write d0/d4/d9/f1e [1263918,109147] 0 2024-09-19T09:35:00.900 INFO:tasks.workunit.client.1.smithi191.stdout:8/466: symlink d1/d4f/l92 0 2024-09-19T09:35:00.900 INFO:tasks.workunit.client.1.smithi191.stdout:8/467: read d1/d16/d3c/d17/f49 [334577,69430] 0 2024-09-19T09:35:00.900 INFO:tasks.workunit.client.1.smithi191.stdout:8/468: creat d1/d16/d2e/f93 x:0 0 0 2024-09-19T09:35:00.900 INFO:tasks.workunit.client.1.smithi191.stdout:8/469: write d1/d16/d23/f43 [93904,21259] 0 2024-09-19T09:35:00.901 INFO:tasks.workunit.client.1.smithi191.stdout:2/370: rename d8/db/d4e/c74 to d8/d11/d3f/d64/c7b 0 2024-09-19T09:35:00.901 INFO:tasks.workunit.client.1.smithi191.stdout:5/378: creat d0/d4/d9/d1d/d28/f85 x:0 0 0 2024-09-19T09:35:00.903 INFO:tasks.workunit.client.1.smithi191.stdout:5/379: link d0/d4/d9/de/f36 d0/d4/d9/d1d/d29/d33/d52/f86 0 2024-09-19T09:35:00.904 INFO:tasks.workunit.client.1.smithi191.stdout:7/349: dread d2/f1e [0,4194304] 0 2024-09-19T09:35:00.904 INFO:tasks.workunit.client.1.smithi191.stdout:7/350: read - d2/d2a/d33/f73 zero size 2024-09-19T09:35:00.914 INFO:tasks.workunit.client.1.smithi191.stdout:9/384: dwrite d3/d8/f13 [0,4194304] 0 2024-09-19T09:35:00.915 INFO:tasks.workunit.client.1.smithi191.stdout:9/385: chown d3/db/d16/d17/c73 108340 1 2024-09-19T09:35:00.916 INFO:tasks.workunit.client.1.smithi191.stdout:0/466: sync 2024-09-19T09:35:00.924 INFO:tasks.workunit.client.1.smithi191.stdout:7/351: rmdir d2/d2a/d4f 39 2024-09-19T09:35:00.925 INFO:tasks.workunit.client.1.smithi191.stdout:7/352: write d2/d2a/d33/f3e [652546,123165] 0 2024-09-19T09:35:00.925 INFO:tasks.workunit.client.1.smithi191.stdout:7/353: creat d2/f7d x:0 0 0 2024-09-19T09:35:00.925 INFO:tasks.workunit.client.1.smithi191.stdout:7/354: dread - d2/d2a/d4f/f72 zero size 2024-09-19T09:35:00.927 INFO:tasks.workunit.client.1.smithi191.stdout:7/355: symlink d2/d2a/l7e 0 2024-09-19T09:35:00.927 INFO:tasks.workunit.client.1.smithi191.stdout:7/356: fdatasync d2/d2a/d33/f54 0 2024-09-19T09:35:00.928 INFO:tasks.workunit.client.1.smithi191.stdout:0/467: dread d0/d9/d1c/d1f/d24/d29/f49 [0,4194304] 0 2024-09-19T09:35:00.928 INFO:tasks.workunit.client.1.smithi191.stdout:0/468: read d0/d9/f4d [847706,1580] 0 2024-09-19T09:35:00.929 INFO:tasks.workunit.client.1.smithi191.stdout:3/339: dwrite d12/d37/d51/f65 [0,4194304] 0 2024-09-19T09:35:00.930 INFO:tasks.workunit.client.1.smithi191.stdout:3/340: chown d12/d13/c26 1278 1 2024-09-19T09:35:00.930 INFO:tasks.workunit.client.1.smithi191.stdout:3/341: dread - d12/d13/d1a/d1b/d2e/f53 zero size 2024-09-19T09:35:00.930 INFO:tasks.workunit.client.1.smithi191.stdout:7/357: mkdir d2/d2a/d79/d7f 0 2024-09-19T09:35:00.930 INFO:tasks.workunit.client.1.smithi191.stdout:7/358: stat d2/d2a/d4f/d59/l5c 0 2024-09-19T09:35:00.930 INFO:tasks.workunit.client.1.smithi191.stdout:6/353: dwrite d2/f63 [0,4194304] 0 2024-09-19T09:35:00.930 INFO:tasks.workunit.client.1.smithi191.stdout:6/354: creat d2/de/d15/f74 x:0 0 0 2024-09-19T09:35:00.931 INFO:tasks.workunit.client.1.smithi191.stdout:0/469: readlink d0/d9/d1c/d1f/d24/l36 0 2024-09-19T09:35:00.932 INFO:tasks.workunit.client.1.smithi191.stdout:7/359: dread d2/f40 [0,4194304] 0 2024-09-19T09:35:00.934 INFO:tasks.workunit.client.1.smithi191.stdout:3/342: link d12/d13/c78 d12/d13/d1a/d1b/d60/d7a/c7b 0 2024-09-19T09:35:00.936 INFO:tasks.workunit.client.1.smithi191.stdout:6/355: rename d2/de/d15/l1c to d2/de/d2a/d39/l75 0 2024-09-19T09:35:00.936 INFO:tasks.workunit.client.1.smithi191.stdout:4/445: dwrite d5/d1b/d1c/f5a [0,4194304] 0 2024-09-19T09:35:00.936 INFO:tasks.workunit.client.1.smithi191.stdout:4/446: fdatasync d5/d38/d6b/f8b 0 2024-09-19T09:35:00.936 INFO:tasks.workunit.client.1.smithi191.stdout:4/447: getdents d5/d1b/d1c/d24/d32/d21/d5c/d8c 0 2024-09-19T09:35:00.938 INFO:tasks.workunit.client.1.smithi191.stdout:1/418: dwrite d3/d9/da/db/d48/f65 [0,4194304] 0 2024-09-19T09:35:00.938 INFO:tasks.workunit.client.1.smithi191.stdout:8/470: dwrite d1/d16/d3c/f68 [0,4194304] 0 2024-09-19T09:35:00.938 INFO:tasks.workunit.client.1.smithi191.stdout:1/419: write d3/d9/da/d1e/d32/d53/d57/d6d/f75 [261163,21229] 0 2024-09-19T09:35:00.939 INFO:tasks.workunit.client.1.smithi191.stdout:3/343: unlink d12/d13/d1a/d1b/d60/f74 0 2024-09-19T09:35:00.939 INFO:tasks.workunit.client.1.smithi191.stdout:3/344: chown d12/d13/d1a/f32 182 1 2024-09-19T09:35:00.939 INFO:tasks.workunit.client.1.smithi191.stdout:3/345: fdatasync d12/d37/d51/f65 0 2024-09-19T09:35:00.939 INFO:tasks.workunit.client.1.smithi191.stdout:3/346: readlink d12/d13/l6c 0 2024-09-19T09:35:00.939 INFO:tasks.workunit.client.1.smithi191.stdout:5/380: dwrite d0/d4/d9/d1d/d22/d3b/f3c [0,4194304] 0 2024-09-19T09:35:00.939 INFO:tasks.workunit.client.1.smithi191.stdout:2/371: dwrite d8/d11/d56/f79 [0,4194304] 0 2024-09-19T09:35:00.939 INFO:tasks.workunit.client.1.smithi191.stdout:6/356: mkdir d2/de/d19/d1e/d64/d76 0 2024-09-19T09:35:00.939 INFO:tasks.workunit.client.1.smithi191.stdout:6/357: dread - d2/de/d19/d1e/d64/f6d zero size 2024-09-19T09:35:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:00 smithi112 ceph-mon[27605]: Reconfiguring node-exporter.smithi112 (dependencies changed)... 2024-09-19T09:35:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:00 smithi112 ceph-mon[27605]: Deploying daemon node-exporter.smithi112 on smithi112 2024-09-19T09:35:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:00 smithi112 ceph-mon[27605]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:00.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:00 smithi112 ceph-mon[27605]: pgmap v12: 65 pgs: 65 active+clean; 606 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 49 MiB/s rd, 65 MiB/s wr, 692 op/s 2024-09-19T09:35:00.940 INFO:tasks.workunit.client.1.smithi191.stdout:3/347: dread d12/d13/d1a/d1b/d3c/f6e [0,4194304] 0 2024-09-19T09:35:00.941 INFO:tasks.workunit.client.1.smithi191.stdout:0/470: unlink d0/d9/c51 0 2024-09-19T09:35:00.942 INFO:tasks.workunit.client.1.smithi191.stdout:0/471: fsync d0/d9/d1c/d1f/d24/d39/d58/f18 0 2024-09-19T09:35:00.943 INFO:tasks.workunit.client.1.smithi191.stdout:1/420: mknod d3/d9/da/d1e/d32/c93 0 2024-09-19T09:35:00.943 INFO:tasks.workunit.client.1.smithi191.stdout:7/360: write d2/d2a/d33/f54 [210053,91888] 0 2024-09-19T09:35:00.944 INFO:tasks.workunit.client.1.smithi191.stdout:5/381: unlink d0/d4/d9/de/f2d 0 2024-09-19T09:35:00.947 INFO:tasks.workunit.client.1.smithi191.stdout:4/448: dread d5/d1b/d1c/d28/d96/f9a [0,4194304] 0 2024-09-19T09:35:00.949 INFO:tasks.workunit.client.1.smithi191.stdout:3/348: truncate d12/d13/d1a/d1b/d3c/f68 181241 0 2024-09-19T09:35:00.951 INFO:tasks.workunit.client.1.smithi191.stdout:0/472: link d0/d9/de/f8f d0/d9/d1c/d1f/d24/d29/d30/f9a 0 2024-09-19T09:35:00.953 INFO:tasks.workunit.client.1.smithi191.stdout:8/471: link d1/d22/d34/c4e d1/d16/d2e/d32/d7e/d8b/c94 0 2024-09-19T09:35:00.954 INFO:tasks.workunit.client.1.smithi191.stdout:1/421: mkdir d3/d9/d73/d94 0 2024-09-19T09:35:00.955 INFO:tasks.workunit.client.1.smithi191.stdout:7/361: creat d2/d2a/d4f/f80 x:0 0 0 2024-09-19T09:35:00.956 INFO:tasks.workunit.client.1.smithi191.stdout:2/372: getdents d8/d2a/d65 0 2024-09-19T09:35:00.958 INFO:tasks.workunit.client.1.smithi191.stdout:4/449: creat d5/d1b/d1c/d24/d32/d21/d92/f9e x:0 0 0 2024-09-19T09:35:00.961 INFO:tasks.workunit.client.1.smithi191.stdout:6/358: rmdir d2/de/d19 39 2024-09-19T09:35:00.961 INFO:tasks.workunit.client.1.smithi191.stdout:7/362: dread d2/f23 [0,4194304] 0 2024-09-19T09:35:00.962 INFO:tasks.workunit.client.1.smithi191.stdout:0/473: symlink d0/d9/d1c/d1f/d24/d29/d30/d56/l9b 0 2024-09-19T09:35:00.962 INFO:tasks.workunit.client.1.smithi191.stdout:0/474: write d0/d9/d1c/d1f/d24/d53/f75 [2683193,26255] 0 2024-09-19T09:35:00.962 INFO:tasks.workunit.client.1.smithi191.stdout:0/475: chown d0/d9/d1c/d1f/d24/d29/d30/d56 471561 1 2024-09-19T09:35:00.962 INFO:tasks.workunit.client.1.smithi191.stdout:8/472: getdents d1/d16/d2e/d57 0 2024-09-19T09:35:00.963 INFO:tasks.workunit.client.1.smithi191.stdout:1/422: creat d3/d9/da/db/d48/f95 x:0 0 0 2024-09-19T09:35:00.963 INFO:tasks.workunit.client.1.smithi191.stdout:1/423: write d3/d9/da/d1e/d32/d53/f51 [3181441,108014] 0 2024-09-19T09:35:00.964 INFO:tasks.workunit.client.1.smithi191.stdout:1/424: write d3/d9/fe [4758621,106745] 0 2024-09-19T09:35:00.964 INFO:tasks.workunit.client.1.smithi191.stdout:4/450: symlink d5/d38/l9f 0 2024-09-19T09:35:00.964 INFO:tasks.workunit.client.1.smithi191.stdout:4/451: write d5/d1b/d1c/d24/d32/d21/d92/f9e [197522,318] 0 2024-09-19T09:35:00.965 INFO:tasks.workunit.client.1.smithi191.stdout:9/386: dwrite d3/db/d16/d38/f3e [0,4194304] 0 2024-09-19T09:35:00.965 INFO:tasks.workunit.client.1.smithi191.stdout:9/387: readlink d3/d8/l7f 0 2024-09-19T09:35:00.965 INFO:tasks.workunit.client.1.smithi191.stdout:6/359: unlink d2/de/d15/f26 0 2024-09-19T09:35:00.966 INFO:tasks.workunit.client.1.smithi191.stdout:7/363: mkdir d2/d2a/d4f/d59/d81 0 2024-09-19T09:35:00.966 INFO:tasks.workunit.client.1.smithi191.stdout:5/382: dwrite d0/d4/d9/d1d/d28/f85 [0,4194304] 0 2024-09-19T09:35:00.967 INFO:tasks.workunit.client.1.smithi191.stdout:0/476: mknod d0/d9/d1c/d1f/d24/d53/c9c 0 2024-09-19T09:35:00.967 INFO:tasks.workunit.client.1.smithi191.stdout:0/477: chown d0/d9/de/f19 6958 1 2024-09-19T09:35:00.967 INFO:tasks.workunit.client.1.smithi191.stdout:0/478: creat d0/d6f/d76/f9d x:0 0 0 2024-09-19T09:35:00.967 INFO:tasks.workunit.client.1.smithi191.stdout:0/479: dread - d0/d9/d1c/d1f/d24/f89 zero size 2024-09-19T09:35:00.967 INFO:tasks.workunit.client.1.smithi191.stdout:8/473: truncate d1/d16/d2e/d32/f64 609810 0 2024-09-19T09:35:00.970 INFO:tasks.workunit.client.1.smithi191.stdout:6/360: mkdir d2/de/d19/d1e/d64/d77 0 2024-09-19T09:35:00.970 INFO:tasks.workunit.client.1.smithi191.stdout:6/361: creat d2/de/d15/f78 x:0 0 0 2024-09-19T09:35:00.970 INFO:tasks.workunit.client.1.smithi191.stdout:7/364: mknod d2/c82 0 2024-09-19T09:35:00.972 INFO:tasks.workunit.client.1.smithi191.stdout:5/383: rmdir d0 39 2024-09-19T09:35:00.972 INFO:tasks.workunit.client.1.smithi191.stdout:0/480: dread d0/d9/f7f [0,4194304] 0 2024-09-19T09:35:00.972 INFO:tasks.workunit.client.1.smithi191.stdout:0/481: truncate d0/d9/d1c/d1f/f85 853098 0 2024-09-19T09:35:00.974 INFO:tasks.workunit.client.1.smithi191.stdout:8/474: mkdir d1/d16/d2e/d7a/d95 0 2024-09-19T09:35:00.975 INFO:tasks.workunit.client.1.smithi191.stdout:9/388: rmdir d3/d8 39 2024-09-19T09:35:00.980 INFO:tasks.workunit.client.1.smithi191.stdout:0/482: mknod d0/d9/d1c/d1f/d24/d39/c9e 0 2024-09-19T09:35:00.981 INFO:tasks.workunit.client.1.smithi191.stdout:8/475: symlink d1/d22/d47/l96 0 2024-09-19T09:35:00.982 INFO:tasks.workunit.client.1.smithi191.stdout:9/389: truncate d3/d8/fc 432955 0 2024-09-19T09:35:00.982 INFO:tasks.workunit.client.1.smithi191.stdout:6/362: dread d2/de/d19/d1e/f21 [0,4194304] 0 2024-09-19T09:35:00.983 INFO:tasks.workunit.client.1.smithi191.stdout:4/452: read d5/d1b/d1c/d24/d32/f1e [2104672,1684] 0 2024-09-19T09:35:00.984 INFO:tasks.workunit.client.1.smithi191.stdout:1/425: dread d3/d9/fe [0,4194304] 0 2024-09-19T09:35:00.985 INFO:tasks.workunit.client.1.smithi191.stdout:6/363: rename d2/de/d19/d1e/d64/l6c to d2/de/d15/l79 0 2024-09-19T09:35:00.985 INFO:tasks.workunit.client.1.smithi191.stdout:6/364: fsync d2/de/f27 0 2024-09-19T09:35:00.987 INFO:tasks.workunit.client.1.smithi191.stdout:1/426: creat d3/d9/d73/d94/f96 x:0 0 0 2024-09-19T09:35:00.987 INFO:tasks.workunit.client.1.smithi191.stdout:2/373: dwrite d8/db/d13/d23/f20 [4194304,4194304] 0 2024-09-19T09:35:00.988 INFO:tasks.workunit.client.1.smithi191.stdout:4/453: rmdir d5/d1b/d1c/d24/d32/d21/d92 39 2024-09-19T09:35:00.988 INFO:tasks.workunit.client.1.smithi191.stdout:4/454: chown d5/d1b/d1c/d2f/f52 2480204 1 2024-09-19T09:35:00.988 INFO:tasks.workunit.client.1.smithi191.stdout:4/455: write d5/d1b/d1c/d24/d32/d21/d4a/f7f [209351,57790] 0 2024-09-19T09:35:00.989 INFO:tasks.workunit.client.1.smithi191.stdout:0/483: dread d0/d9/f1a [4194304,4194304] 0 2024-09-19T09:35:00.989 INFO:tasks.workunit.client.1.smithi191.stdout:6/365: truncate d2/de/f16 3217600 0 2024-09-19T09:35:00.991 INFO:tasks.workunit.client.1.smithi191.stdout:1/427: mkdir d3/d9/da/d8c/d97 0 2024-09-19T09:35:00.991 INFO:tasks.workunit.client.1.smithi191.stdout:1/428: fsync d3/d9/da/d1e/d32/f74 0 2024-09-19T09:35:00.991 INFO:tasks.workunit.client.1.smithi191.stdout:1/429: dread - d3/d9/da/db/d48/f71 zero size 2024-09-19T09:35:00.991 INFO:tasks.workunit.client.1.smithi191.stdout:1/430: write d3/d9/da/d1e/f2d [2085167,97843] 0 2024-09-19T09:35:00.991 INFO:tasks.workunit.client.1.smithi191.stdout:9/390: dread d3/db/f71 [0,4194304] 0 2024-09-19T09:35:00.993 INFO:tasks.workunit.client.1.smithi191.stdout:2/374: rmdir d8/d11/d3f 39 2024-09-19T09:35:00.993 INFO:tasks.workunit.client.1.smithi191.stdout:2/375: truncate d8/d11/f49 412370 0 2024-09-19T09:35:00.993 INFO:tasks.workunit.client.1.smithi191.stdout:0/484: creat d0/d9/f9f x:0 0 0 2024-09-19T09:35:00.994 INFO:tasks.workunit.client.1.smithi191.stdout:4/456: dread d5/d1b/d1c/d2f/d19/f20 [0,4194304] 0 2024-09-19T09:35:00.995 INFO:tasks.workunit.client.1.smithi191.stdout:4/457: creat d5/d1b/d1c/d2f/d37/d59/fa0 x:0 0 0 2024-09-19T09:35:00.996 INFO:tasks.workunit.client.1.smithi191.stdout:1/431: rename d3/d9/f24 to d3/d9/da/d1e/d25/f98 0 2024-09-19T09:35:00.998 INFO:tasks.workunit.client.1.smithi191.stdout:9/391: unlink d3/db/d16/d47/c65 0 2024-09-19T09:35:00.999 INFO:tasks.workunit.client.1.smithi191.stdout:3/349: dwrite d12/d13/d1a/d1b/f66 [0,4194304] 0 2024-09-19T09:35:01.000 INFO:tasks.workunit.client.1.smithi191.stdout:2/376: mknod d8/d2a/c7c 0 2024-09-19T09:35:01.002 INFO:tasks.workunit.client.1.smithi191.stdout:6/366: getdents d2/de/d15 0 2024-09-19T09:35:01.006 INFO:tasks.workunit.client.1.smithi191.stdout:7/365: dwrite d2/d2a/f2d [4194304,4194304] 0 2024-09-19T09:35:01.008 INFO:tasks.workunit.client.1.smithi191.stdout:9/392: dread d3/d60/f50 [0,4194304] 0 2024-09-19T09:35:01.011 INFO:tasks.workunit.client.1.smithi191.stdout:3/350: write d12/d37/d64/d73/f79 [458525,13725] 0 2024-09-19T09:35:01.011 INFO:tasks.workunit.client.1.smithi191.stdout:5/384: dwrite d0/d4/d9/de/f18 [0,4194304] 0 2024-09-19T09:35:01.011 INFO:tasks.workunit.client.1.smithi191.stdout:5/385: fsync d0/d4/d9/d1d/d28/d53/f70 0 2024-09-19T09:35:01.012 INFO:tasks.workunit.client.1.smithi191.stdout:8/476: dwrite d1/d16/f4a [0,4194304] 0 2024-09-19T09:35:01.012 INFO:tasks.workunit.client.1.smithi191.stdout:8/477: fdatasync d1/d22/f54 0 2024-09-19T09:35:01.012 INFO:tasks.workunit.client.1.smithi191.stdout:2/377: creat d8/db/d4e/f7d x:0 0 0 2024-09-19T09:35:01.013 INFO:tasks.workunit.client.1.smithi191.stdout:2/378: readlink d8/db/l6f 0 2024-09-19T09:35:01.016 INFO:tasks.workunit.client.1.smithi191.stdout:1/432: rename d3/d9/da/d1e/d32/c83 to d3/c99 0 2024-09-19T09:35:01.016 INFO:tasks.workunit.client.1.smithi191.stdout:3/351: rename d12/d13/d1a/d1b/d3c/d3f to d12/d13/d1a/d1b/d3c/d3f/d7c 22 2024-09-19T09:35:01.016 INFO:tasks.workunit.client.1.smithi191.stdout:1/433: fsync d3/d9/da/db/f4d 0 2024-09-19T09:35:01.016 INFO:tasks.workunit.client.1.smithi191.stdout:1/434: truncate d3/d9/da/d1e/d32/f80 618865 0 2024-09-19T09:35:01.018 INFO:tasks.workunit.client.1.smithi191.stdout:7/366: creat d2/d2a/d38/f83 x:0 0 0 2024-09-19T09:35:01.021 INFO:tasks.workunit.client.1.smithi191.stdout:2/379: link d8/d11/d3f/d64/c7b d8/db/c7e 0 2024-09-19T09:35:01.021 INFO:tasks.workunit.client.1.smithi191.stdout:2/380: dread - d8/d11/d3f/f39 zero size 2024-09-19T09:35:01.021 INFO:tasks.workunit.client.1.smithi191.stdout:1/435: creat d3/d9/da/db/d48/f9a x:0 0 0 2024-09-19T09:35:01.022 INFO:tasks.workunit.client.1.smithi191.stdout:7/367: getdents d2/d39 0 2024-09-19T09:35:01.024 INFO:tasks.workunit.client.1.smithi191.stdout:5/386: dread d0/d4/d9/de/f18 [0,4194304] 0 2024-09-19T09:35:01.024 INFO:tasks.workunit.client.1.smithi191.stdout:8/478: getdents d1/d16/d2e 0 2024-09-19T09:35:01.024 INFO:tasks.workunit.client.1.smithi191.stdout:8/479: chown d1/d16/d2e/d7a/d95 1 1 2024-09-19T09:35:01.024 INFO:tasks.workunit.client.1.smithi191.stdout:2/381: creat d8/db/d13/d23/f7f x:0 0 0 2024-09-19T09:35:01.025 INFO:tasks.workunit.client.1.smithi191.stdout:1/436: creat d3/d9/da/d42/d8a/f9b x:0 0 0 2024-09-19T09:35:01.025 INFO:tasks.workunit.client.1.smithi191.stdout:1/437: fsync d3/d9/da/d1e/d32/f74 0 2024-09-19T09:35:01.025 INFO:tasks.workunit.client.1.smithi191.stdout:9/393: write d3/db/d16/d38/f48 [539465,29061] 0 2024-09-19T09:35:01.025 INFO:tasks.workunit.client.1.smithi191.stdout:9/394: fsync d3/d8/f74 0 2024-09-19T09:35:01.025 INFO:tasks.workunit.client.1.smithi191.stdout:5/387: mknod d0/d4/c87 0 2024-09-19T09:35:01.025 INFO:tasks.workunit.client.1.smithi191.stdout:2/382: symlink d8/db/d41/l80 0 2024-09-19T09:35:01.026 INFO:tasks.workunit.client.1.smithi191.stdout:7/368: dread d2/f34 [0,4194304] 0 2024-09-19T09:35:01.026 INFO:tasks.workunit.client.1.smithi191.stdout:8/480: symlink d1/d22/d34/l97 0 2024-09-19T09:35:01.026 INFO:tasks.workunit.client.1.smithi191.stdout:8/481: write d1/f36 [413587,42710] 0 2024-09-19T09:35:01.026 INFO:tasks.workunit.client.1.smithi191.stdout:0/485: dwrite d0/d9/d1c/d1f/f77 [0,4194304] 0 2024-09-19T09:35:01.028 INFO:tasks.workunit.client.1.smithi191.stdout:1/438: creat d3/d9/f9c x:0 0 0 2024-09-19T09:35:01.030 INFO:tasks.workunit.client.1.smithi191.stdout:2/383: link d8/db/d13/d23/c5b d8/db/d13/d23/c81 0 2024-09-19T09:35:01.030 INFO:tasks.workunit.client.1.smithi191.stdout:2/384: chown d8/db/d4e/l76 0 1 2024-09-19T09:35:01.030 INFO:tasks.workunit.client.1.smithi191.stdout:9/395: dread d3/db/d16/d47/d55/f1d [0,4194304] 0 2024-09-19T09:35:01.030 INFO:tasks.workunit.client.1.smithi191.stdout:6/367: dwrite d2/de/d15/f78 [0,4194304] 0 2024-09-19T09:35:01.030 INFO:tasks.workunit.client.1.smithi191.stdout:6/368: write d2/de/d19/d1e/d64/f2c [453001,89491] 0 2024-09-19T09:35:01.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:00 smithi191 ceph-mon[34834]: Reconfiguring node-exporter.smithi112 (dependencies changed)... 2024-09-19T09:35:01.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:00 smithi191 ceph-mon[34834]: Deploying daemon node-exporter.smithi112 on smithi112 2024-09-19T09:35:01.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:00 smithi191 ceph-mon[34834]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:01.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:00 smithi191 ceph-mon[34834]: pgmap v12: 65 pgs: 65 active+clean; 606 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 49 MiB/s rd, 65 MiB/s wr, 692 op/s 2024-09-19T09:35:01.035 INFO:tasks.workunit.client.1.smithi191.stdout:7/369: write d2/f7 [2429089,27677] 0 2024-09-19T09:35:01.036 INFO:tasks.workunit.client.1.smithi191.stdout:7/370: chown d2/l55 9567041 1 2024-09-19T09:35:01.037 INFO:tasks.workunit.client.1.smithi191.stdout:8/482: dread d1/d16/d3c/f31 [0,4194304] 0 2024-09-19T09:35:01.037 INFO:tasks.workunit.client.1.smithi191.stdout:8/483: chown d1/f52 8125 1 2024-09-19T09:35:01.043 INFO:tasks.workunit.client.1.smithi191.stdout:4/458: truncate d5/fe 1663326 0 2024-09-19T09:35:01.045 INFO:tasks.workunit.client.1.smithi191.stdout:1/439: creat d3/d9/da/d1e/d32/d53/f9d x:0 0 0 2024-09-19T09:35:01.045 INFO:tasks.workunit.client.1.smithi191.stdout:1/440: fdatasync d3/d9/da/d1e/d32/d53/f9d 0 2024-09-19T09:35:01.050 INFO:tasks.workunit.client.1.smithi191.stdout:2/385: symlink d8/db/l82 0 2024-09-19T09:35:01.052 INFO:tasks.workunit.client.1.smithi191.stdout:2/386: dread d8/db/d13/f3a [0,4194304] 0 2024-09-19T09:35:01.062 INFO:tasks.workunit.client.1.smithi191.stdout:8/484: mkdir d1/d4f/d6b/d83/d98 0 2024-09-19T09:35:01.062 INFO:tasks.workunit.client.1.smithi191.stdout:9/396: getdents d3/db/d16/d17/d5b 0 2024-09-19T09:35:01.063 INFO:tasks.workunit.client.1.smithi191.stdout:2/387: mknod d8/db/d13/d35/d70/c83 0 2024-09-19T09:35:01.064 INFO:tasks.workunit.client.1.smithi191.stdout:8/485: symlink d1/d7/d1a/l99 0 2024-09-19T09:35:01.065 INFO:tasks.workunit.client.1.smithi191.stdout:8/486: dread - d1/d16/d2e/f8e zero size 2024-09-19T09:35:01.065 INFO:tasks.workunit.client.1.smithi191.stdout:8/487: stat d1/d16/d2e/f93 0 2024-09-19T09:35:01.065 INFO:tasks.workunit.client.1.smithi191.stdout:9/397: mkdir d3/db/d16/d17/d81 0 2024-09-19T09:35:01.065 INFO:tasks.workunit.client.1.smithi191.stdout:9/398: fsync d3/db/d16/d47/d55/f1d 0 2024-09-19T09:35:01.065 INFO:tasks.workunit.client.1.smithi191.stdout:5/388: dwrite d0/d4/d4a/f5f [0,4194304] 0 2024-09-19T09:35:01.066 INFO:tasks.workunit.client.1.smithi191.stdout:2/388: mknod d8/d11/d3f/d64/c84 0 2024-09-19T09:35:01.067 INFO:tasks.workunit.client.1.smithi191.stdout:8/488: creat d1/d16/d3c/d17/f9a x:0 0 0 2024-09-19T09:35:01.069 INFO:tasks.workunit.client.1.smithi191.stdout:9/399: creat d3/db/d16/d17/d81/f82 x:0 0 0 2024-09-19T09:35:01.069 INFO:tasks.workunit.client.1.smithi191.stdout:9/400: creat d3/db/d16/d38/f83 x:0 0 0 2024-09-19T09:35:01.070 INFO:tasks.workunit.client.1.smithi191.stdout:0/486: dwrite d0/d9/d1c/d1f/d24/d39/d58/f1b [0,4194304] 0 2024-09-19T09:35:01.070 INFO:tasks.workunit.client.1.smithi191.stdout:0/487: truncate d0/d9/d1c/d1f/d24/d29/d30/f9a 4863274 0 2024-09-19T09:35:01.070 INFO:tasks.workunit.client.1.smithi191.stdout:0/488: truncate d0/d9/d1c/d1f/d24/d29/f3b 8925730 0 2024-09-19T09:35:01.070 INFO:tasks.workunit.client.1.smithi191.stdout:7/371: dwrite d2/f75 [0,4194304] 0 2024-09-19T09:35:01.070 INFO:tasks.workunit.client.1.smithi191.stdout:7/372: creat d2/f84 x:0 0 0 2024-09-19T09:35:01.070 INFO:tasks.workunit.client.1.smithi191.stdout:7/373: fsync d2/d2a/f31 0 2024-09-19T09:35:01.071 INFO:tasks.workunit.client.1.smithi191.stdout:5/389: mkdir d0/d4/d88 0 2024-09-19T09:35:01.071 INFO:tasks.workunit.client.1.smithi191.stdout:4/459: dwrite d5/d1b/d1c/d24/d82/f90 [0,4194304] 0 2024-09-19T09:35:01.071 INFO:tasks.workunit.client.1.smithi191.stdout:4/460: chown d5/d1b/d8e 457 1 2024-09-19T09:35:01.072 INFO:tasks.workunit.client.1.smithi191.stdout:4/461: creat d5/d1b/d1c/d2f/d37/d59/fa1 x:0 0 0 2024-09-19T09:35:01.072 INFO:tasks.workunit.client.1.smithi191.stdout:5/390: write d0/d4/d9/f1e [1164397,1023] 0 2024-09-19T09:35:01.073 INFO:tasks.workunit.client.1.smithi191.stdout:2/389: truncate d8/d11/f38 7162440 0 2024-09-19T09:35:01.074 INFO:tasks.workunit.client.1.smithi191.stdout:8/489: creat d1/d22/d34/d84/f9b x:0 0 0 2024-09-19T09:35:01.075 INFO:tasks.workunit.client.1.smithi191.stdout:1/441: dwrite d3/d9/f5d [8388608,4194304] 0 2024-09-19T09:35:01.076 INFO:tasks.workunit.client.1.smithi191.stdout:9/401: symlink d3/db/d16/d47/d55/l84 0 2024-09-19T09:35:01.080 INFO:tasks.workunit.client.1.smithi191.stdout:9/402: dread d3/d60/d78/f7b [0,4194304] 0 2024-09-19T09:35:01.080 INFO:tasks.workunit.client.1.smithi191.stdout:9/403: read - d3/db/d16/d38/f67 zero size 2024-09-19T09:35:01.080 INFO:tasks.workunit.client.1.smithi191.stdout:4/462: dread d5/d1b/f67 [0,4194304] 0 2024-09-19T09:35:01.085 INFO:tasks.workunit.client.1.smithi191.stdout:0/489: mknod d0/d9/d1c/d1f/d24/d39/ca0 0 2024-09-19T09:35:01.085 INFO:tasks.workunit.client.1.smithi191.stdout:0/490: chown d0/d9/d1c/d1f/d24/d29/d30/l4c 63712 1 2024-09-19T09:35:01.086 INFO:tasks.workunit.client.1.smithi191.stdout:0/491: write d0/d9/f7f [750120,14665] 0 2024-09-19T09:35:01.087 INFO:tasks.workunit.client.1.smithi191.stdout:7/374: truncate d2/d2a/f2f 3292560 0 2024-09-19T09:35:01.095 INFO:tasks.workunit.client.1.smithi191.stdout:2/390: unlink d8/db/d13/d35/f36 0 2024-09-19T09:35:01.096 INFO:tasks.workunit.client.1.smithi191.stdout:8/490: mknod d1/d22/c9c 0 2024-09-19T09:35:01.099 INFO:tasks.workunit.client.1.smithi191.stdout:0/492: unlink d0/d9/d1c/d1f/d24/d53/c9c 0 2024-09-19T09:35:01.100 INFO:tasks.workunit.client.1.smithi191.stdout:7/375: dwrite d2/d39/d3a/d3c/f56 [0,4194304] 0 2024-09-19T09:35:01.100 INFO:tasks.workunit.client.1.smithi191.stdout:7/376: truncate d2/ff 1467983 0 2024-09-19T09:35:01.100 INFO:tasks.workunit.client.1.smithi191.stdout:7/377: chown d2/d2a/l30 22018130 1 2024-09-19T09:35:01.100 INFO:tasks.workunit.client.1.smithi191.stdout:7/378: chown d2/d2a/f71 2 1 2024-09-19T09:35:01.100 INFO:tasks.workunit.client.1.smithi191.stdout:7/379: chown d2/d2a/d38 55296 1 2024-09-19T09:35:01.100 INFO:tasks.workunit.client.1.smithi191.stdout:5/391: rmdir d0/d4/d9/d1d/d22 39 2024-09-19T09:35:01.101 INFO:tasks.workunit.client.1.smithi191.stdout:2/391: stat d8/db/l1e 0 2024-09-19T09:35:01.102 INFO:tasks.workunit.client.1.smithi191.stdout:8/491: mkdir d1/d22/d47/d9d 0 2024-09-19T09:35:01.103 INFO:tasks.workunit.client.1.smithi191.stdout:0/493: rename d0/d9/d1c/d1f/c5f to d0/d9/d1c/d1f/d24/d39/d7a/ca1 0 2024-09-19T09:35:01.103 INFO:tasks.workunit.client.1.smithi191.stdout:0/494: chown d0/d9/de/l4f 961 1 2024-09-19T09:35:01.108 INFO:tasks.workunit.client.1.smithi191.stdout:7/380: dread d2/f17 [0,4194304] 0 2024-09-19T09:35:01.108 INFO:tasks.workunit.client.1.smithi191.stdout:7/381: write d2/d2a/f74 [924390,47336] 0 2024-09-19T09:35:01.108 INFO:tasks.workunit.client.1.smithi191.stdout:7/382: creat d2/d2a/d38/f85 x:0 0 0 2024-09-19T09:35:01.108 INFO:tasks.workunit.client.1.smithi191.stdout:7/383: creat d2/d2a/f86 x:0 0 0 2024-09-19T09:35:01.108 INFO:tasks.workunit.client.1.smithi191.stdout:7/384: readlink d2/d2a/d4f/l50 0 2024-09-19T09:35:01.109 INFO:tasks.workunit.client.1.smithi191.stdout:5/392: link d0/d4/d9/de/f47 d0/d4/d88/f89 0 2024-09-19T09:35:01.110 INFO:tasks.workunit.client.1.smithi191.stdout:2/392: unlink d8/db/l82 0 2024-09-19T09:35:01.111 INFO:tasks.workunit.client.1.smithi191.stdout:8/492: symlink d1/d16/d3c/d28/l9e 0 2024-09-19T09:35:01.111 INFO:tasks.workunit.client.1.smithi191.stdout:7/385: dread d2/d2a/d38/d63/f6a [0,4194304] 0 2024-09-19T09:35:01.112 INFO:tasks.workunit.client.1.smithi191.stdout:0/495: symlink d0/d9/d1c/d1f/d24/d29/la2 0 2024-09-19T09:35:01.116 INFO:tasks.workunit.client.1.smithi191.stdout:5/393: link d0/d4/f37 d0/d4/d9/d1d/d29/d33/d45/f8a 0 2024-09-19T09:35:01.117 INFO:tasks.workunit.client.1.smithi191.stdout:8/493: chown d1/d16/c6a 169850426 1 2024-09-19T09:35:01.117 INFO:tasks.workunit.client.1.smithi191.stdout:8/494: write d1/d16/d3c/f62 [1097821,94413] 0 2024-09-19T09:35:01.118 INFO:tasks.workunit.client.1.smithi191.stdout:8/495: chown d1/d7/d1a/c3f 380055 1 2024-09-19T09:35:01.121 INFO:tasks.workunit.client.1.smithi191.stdout:8/496: rename d1/d16/c6a to d1/c9f 0 2024-09-19T09:35:01.121 INFO:tasks.workunit.client.1.smithi191.stdout:8/497: read d1/d22/f3b [1491329,4108] 0 2024-09-19T09:35:01.124 INFO:tasks.workunit.client.1.smithi191.stdout:8/498: creat d1/d16/d3c/d28/fa0 x:0 0 0 2024-09-19T09:35:01.124 INFO:tasks.workunit.client.1.smithi191.stdout:8/499: truncate d1/d16/d3c/d28/fa0 1047183 0 2024-09-19T09:35:01.136 INFO:tasks.workunit.client.1.smithi191.stdout:2/393: dwrite d8/d2a/f53 [0,4194304] 0 2024-09-19T09:35:01.137 INFO:tasks.workunit.client.1.smithi191.stdout:2/394: fdatasync f6 0 2024-09-19T09:35:01.141 INFO:tasks.workunit.client.1.smithi191.stdout:3/352: sync 2024-09-19T09:35:01.143 INFO:tasks.workunit.client.1.smithi191.stdout:3/353: creat d12/d37/d64/d73/f7d x:0 0 0 2024-09-19T09:35:01.144 INFO:tasks.workunit.client.1.smithi191.stdout:3/354: creat d12/d37/d3d/f7e x:0 0 0 2024-09-19T09:35:01.144 INFO:tasks.workunit.client.1.smithi191.stdout:5/394: dwrite d0/d4/d9/d1d/f46 [0,4194304] 0 2024-09-19T09:35:01.145 INFO:tasks.workunit.client.1.smithi191.stdout:0/496: dwrite d0/d9/d1c/d1f/d24/f3f [0,4194304] 0 2024-09-19T09:35:01.145 INFO:tasks.workunit.client.1.smithi191.stdout:0/497: fdatasync d0/d9/d1c/d1f/d24/d39/f95 0 2024-09-19T09:35:01.146 INFO:tasks.workunit.client.1.smithi191.stdout:3/355: truncate d12/d43/f44 391084 0 2024-09-19T09:35:01.148 INFO:tasks.workunit.client.1.smithi191.stdout:0/498: link d0/d9/d1c/d1f/d24/d29/f49 d0/d9/d1c/d1f/d24/d39/d58/fa3 0 2024-09-19T09:35:01.148 INFO:tasks.workunit.client.1.smithi191.stdout:0/499: dread - d0/d6f/d76/f9d zero size 2024-09-19T09:35:01.149 INFO:tasks.workunit.client.1.smithi191.stdout:5/395: getdents d0/d4/d9/d1d 0 2024-09-19T09:35:01.149 INFO:tasks.workunit.client.1.smithi191.stdout:5/396: chown d0/d1f/c2a 32504 1 2024-09-19T09:35:01.151 INFO:tasks.workunit.client.1.smithi191.stdout:0/500: rename d0/d6f/f98 to d0/d9/d1c/d20/fa4 0 2024-09-19T09:35:01.152 INFO:tasks.workunit.client.1.smithi191.stdout:5/397: rmdir d0 39 2024-09-19T09:35:01.152 INFO:tasks.workunit.client.1.smithi191.stdout:5/398: dread - d0/d4/d9/d1d/d29/f80 zero size 2024-09-19T09:35:01.152 INFO:tasks.workunit.client.1.smithi191.stdout:2/395: dread d8/db/d13/d35/f37 [0,4194304] 0 2024-09-19T09:35:01.153 INFO:tasks.workunit.client.1.smithi191.stdout:5/399: rmdir d0/d4/d88 39 2024-09-19T09:35:01.154 INFO:tasks.workunit.client.1.smithi191.stdout:3/356: write d12/d13/d1a/d1b/d3c/f4f [1366002,14936] 0 2024-09-19T09:35:01.154 INFO:tasks.workunit.client.1.smithi191.stdout:3/357: write d12/f15 [2440992,104075] 0 2024-09-19T09:35:01.154 INFO:tasks.workunit.client.1.smithi191.stdout:3/358: readlink d12/d13/d1a/d1b/d3c/d3f/l76 0 2024-09-19T09:35:01.158 INFO:tasks.workunit.client.1.smithi191.stdout:3/359: mkdir d12/d13/d1a/d1b/d3c/d71/d7f 0 2024-09-19T09:35:01.159 INFO:tasks.workunit.client.1.smithi191.stdout:3/360: readlink d12/d13/d1a/d28/l2c 0 2024-09-19T09:35:01.160 INFO:tasks.workunit.client.1.smithi191.stdout:5/400: getdents d0/d4/d88 0 2024-09-19T09:35:01.160 INFO:tasks.workunit.client.1.smithi191.stdout:0/501: write d0/d9/d1c/d1f/d24/d29/d30/d56/f66 [4133281,65843] 0 2024-09-19T09:35:01.162 INFO:tasks.workunit.client.1.smithi191.stdout:5/401: unlink d0/d4/d9/de/c4d 0 2024-09-19T09:35:01.162 INFO:tasks.workunit.client.1.smithi191.stdout:5/402: stat d0/d4/d9/d1d/d29/d33/d45/f8a 0 2024-09-19T09:35:01.164 INFO:tasks.workunit.client.1.smithi191.stdout:5/403: link d0/d4/d9/d1d/d22/d3b/c4f d0/d4/d88/c8b 0 2024-09-19T09:35:01.166 INFO:tasks.workunit.client.1.smithi191.stdout:5/404: mknod d0/d4/d9/d1d/d22/d3b/c8c 0 2024-09-19T09:35:01.168 INFO:tasks.workunit.client.1.smithi191.stdout:2/396: dwrite d8/d11/d56/f69 [0,4194304] 0 2024-09-19T09:35:01.168 INFO:tasks.workunit.client.1.smithi191.stdout:2/397: chown d8/d2a 142 1 2024-09-19T09:35:01.168 INFO:tasks.workunit.client.1.smithi191.stdout:2/398: fdatasync d8/d11/d3f/f34 0 2024-09-19T09:35:01.171 INFO:tasks.workunit.client.1.smithi191.stdout:3/361: dread d12/d43/f44 [0,4194304] 0 2024-09-19T09:35:01.171 INFO:tasks.workunit.client.1.smithi191.stdout:3/362: write d12/d13/d1a/d1b/d2e/f3a [518242,124622] 0 2024-09-19T09:35:01.178 INFO:tasks.workunit.client.1.smithi191.stdout:2/399: rename d8/db/d13/d23/l55 to d8/db/d13/d40/d75/l85 0 2024-09-19T09:35:01.178 INFO:tasks.workunit.client.1.smithi191.stdout:0/502: truncate d0/d9/d1c/d1f/d24/f3f 5119616 0 2024-09-19T09:35:01.179 INFO:tasks.workunit.client.1.smithi191.stdout:0/503: fsync d0/d9/d1c/d20/fa4 0 2024-09-19T09:35:01.181 INFO:tasks.workunit.client.1.smithi191.stdout:3/363: rename d12/f15 to d12/d13/d1a/d1b/d3c/f80 0 2024-09-19T09:35:01.183 INFO:tasks.workunit.client.1.smithi191.stdout:0/504: creat d0/d9/d1c/d1f/d24/d39/d58/d6c/d86/fa5 x:0 0 0 2024-09-19T09:35:01.184 INFO:tasks.workunit.client.1.smithi191.stdout:3/364: creat d12/f81 x:0 0 0 2024-09-19T09:35:01.188 INFO:tasks.workunit.client.1.smithi191.stdout:5/405: dwrite d0/f20 [0,4194304] 0 2024-09-19T09:35:01.192 INFO:tasks.workunit.client.1.smithi191.stdout:4/463: sync 2024-09-19T09:35:01.192 INFO:tasks.workunit.client.1.smithi191.stdout:6/369: sync 2024-09-19T09:35:01.192 INFO:tasks.workunit.client.1.smithi191.stdout:1/442: sync 2024-09-19T09:35:01.192 INFO:tasks.workunit.client.1.smithi191.stdout:9/404: sync 2024-09-19T09:35:01.192 INFO:tasks.workunit.client.1.smithi191.stdout:1/443: truncate d3/d9/da/d1e/d32/d53/f9d 38904 0 2024-09-19T09:35:01.193 INFO:tasks.workunit.client.1.smithi191.stdout:5/406: creat d0/d4/d9/d1d/d22/d5c/f8d x:0 0 0 2024-09-19T09:35:01.196 INFO:tasks.workunit.client.1.smithi191.stdout:6/370: symlink d2/de/d2a/d2d/d30/l7a 0 2024-09-19T09:35:01.196 INFO:tasks.workunit.client.1.smithi191.stdout:6/371: chown d2/de/d15/c3d 16 1 2024-09-19T09:35:01.197 INFO:tasks.workunit.client.1.smithi191.stdout:5/407: dread d0/d4/d9/d1d/d29/d33/d52/f86 [0,4194304] 0 2024-09-19T09:35:01.197 INFO:tasks.workunit.client.1.smithi191.stdout:5/408: chown d0/d4/d9/d1d/d29/d33/d45/l5b 5840109 1 2024-09-19T09:35:01.197 INFO:tasks.workunit.client.1.smithi191.stdout:2/400: dwrite d8/d11/d3f/f21 [0,4194304] 0 2024-09-19T09:35:01.198 INFO:tasks.workunit.client.1.smithi191.stdout:4/464: creat d5/d1b/d1c/d24/d32/d21/d5c/d8c/fa2 x:0 0 0 2024-09-19T09:35:01.199 INFO:tasks.workunit.client.1.smithi191.stdout:8/500: sync 2024-09-19T09:35:01.199 INFO:tasks.workunit.client.1.smithi191.stdout:7/386: sync 2024-09-19T09:35:01.199 INFO:tasks.workunit.client.1.smithi191.stdout:7/387: getdents d2/d2a/d4f/d78 0 2024-09-19T09:35:01.199 INFO:tasks.workunit.client.1.smithi191.stdout:9/405: dread d3/f2c [0,4194304] 0 2024-09-19T09:35:01.199 INFO:tasks.workunit.client.1.smithi191.stdout:3/365: dread d12/d13/d1a/f29 [0,4194304] 0 2024-09-19T09:35:01.204 INFO:tasks.workunit.client.1.smithi191.stdout:7/388: creat d2/d39/d3a/d3c/f87 x:0 0 0 2024-09-19T09:35:01.204 INFO:tasks.workunit.client.1.smithi191.stdout:7/389: write d2/f47 [4718958,47290] 0 2024-09-19T09:35:01.204 INFO:tasks.workunit.client.1.smithi191.stdout:6/372: getdents d2/de 0 2024-09-19T09:35:01.206 INFO:tasks.workunit.client.1.smithi191.stdout:4/465: link f4 d5/d1b/d1c/d24/d32/fa3 0 2024-09-19T09:35:01.206 INFO:tasks.workunit.client.1.smithi191.stdout:4/466: creat d5/d1b/d1c/d2f/d19/fa4 x:0 0 0 2024-09-19T09:35:01.206 INFO:tasks.workunit.client.1.smithi191.stdout:8/501: rename d1/d22/d34 to d1/d16/d3c/d17/da1 0 2024-09-19T09:35:01.208 INFO:tasks.workunit.client.1.smithi191.stdout:7/390: creat d2/d2a/d4f/d59/f88 x:0 0 0 2024-09-19T09:35:01.208 INFO:tasks.workunit.client.1.smithi191.stdout:7/391: write d2/d2a/d4f/d59/f88 [1012440,2878] 0 2024-09-19T09:35:01.208 INFO:tasks.workunit.client.1.smithi191.stdout:4/467: write d5/f91 [1349494,93368] 0 2024-09-19T09:35:01.208 INFO:tasks.workunit.client.1.smithi191.stdout:4/468: write f1 [404232,97764] 0 2024-09-19T09:35:01.208 INFO:tasks.workunit.client.1.smithi191.stdout:4/469: stat d5/d1b/d1c/d2f/d19/f34 0 2024-09-19T09:35:01.208 INFO:tasks.workunit.client.1.smithi191.stdout:6/373: mknod d2/de/d19/d1e/c7b 0 2024-09-19T09:35:01.209 INFO:tasks.workunit.client.1.smithi191.stdout:6/374: read d2/de/d15/d57/f6a [951967,24009] 0 2024-09-19T09:35:01.209 INFO:tasks.workunit.client.1.smithi191.stdout:2/401: dread d8/db/d13/d23/f1f [0,4194304] 0 2024-09-19T09:35:01.212 INFO:tasks.workunit.client.1.smithi191.stdout:9/406: rename d3/f40 to d3/db/d16/d17/f85 0 2024-09-19T09:35:01.213 INFO:tasks.workunit.client.1.smithi191.stdout:0/505: dwrite d0/d9/d1c/d1f/f77 [0,4194304] 0 2024-09-19T09:35:01.213 INFO:tasks.workunit.client.1.smithi191.stdout:8/502: mkdir d1/d16/d3c/d28/d79/da2 0 2024-09-19T09:35:01.215 INFO:tasks.workunit.client.1.smithi191.stdout:7/392: mkdir d2/d5e/d89 0 2024-09-19T09:35:01.215 INFO:tasks.workunit.client.1.smithi191.stdout:7/393: truncate d2/d39/d3a/d3c/f87 995423 0 2024-09-19T09:35:01.215 INFO:tasks.workunit.client.1.smithi191.stdout:7/394: fsync d2/f84 0 2024-09-19T09:35:01.215 INFO:tasks.workunit.client.1.smithi191.stdout:7/395: read d2/d2a/d4f/d59/f65 [2403090,53548] 0 2024-09-19T09:35:01.215 INFO:tasks.workunit.client.1.smithi191.stdout:7/396: readlink d2/d2a/d4f/d59/l5a 0 2024-09-19T09:35:01.217 INFO:tasks.workunit.client.1.smithi191.stdout:0/506: creat d0/d9/d1c/d20/fa6 x:0 0 0 2024-09-19T09:35:01.219 INFO:tasks.workunit.client.1.smithi191.stdout:8/503: unlink d1/d22/c9c 0 2024-09-19T09:35:01.219 INFO:tasks.workunit.client.1.smithi191.stdout:8/504: chown d1/d7/d1a/l20 1 1 2024-09-19T09:35:01.221 INFO:tasks.workunit.client.1.smithi191.stdout:0/507: mknod d0/d9/d1c/d1f/d24/d29/d30/ca7 0 2024-09-19T09:35:01.221 INFO:tasks.workunit.client.1.smithi191.stdout:1/444: dwrite d3/d9/f78 [0,4194304] 0 2024-09-19T09:35:01.221 INFO:tasks.workunit.client.1.smithi191.stdout:0/508: chown d0/d9/d1c/d1f/d24/f90 15462 1 2024-09-19T09:35:01.222 INFO:tasks.workunit.client.1.smithi191.stdout:8/505: creat d1/d16/d3c/d28/d79/da2/fa3 x:0 0 0 2024-09-19T09:35:01.223 INFO:tasks.workunit.client.1.smithi191.stdout:8/506: truncate d1/d16/d3c/d17/f49 1791029 0 2024-09-19T09:35:01.223 INFO:tasks.workunit.client.1.smithi191.stdout:8/507: chown d1/c9f 1711 1 2024-09-19T09:35:01.223 INFO:tasks.workunit.client.1.smithi191.stdout:4/470: dread d5/d1b/d1c/f63 [0,4194304] 0 2024-09-19T09:35:01.225 INFO:tasks.workunit.client.1.smithi191.stdout:8/508: link d1/d7/d1a/l20 d1/d16/d3c/d17/da1/la4 0 2024-09-19T09:35:01.225 INFO:tasks.workunit.client.1.smithi191.stdout:8/509: dread - d1/d16/d3c/d28/d79/da2/fa3 zero size 2024-09-19T09:35:01.225 INFO:tasks.workunit.client.1.smithi191.stdout:4/471: truncate d5/d1b/d1c/d24/d32/f36 3592195 0 2024-09-19T09:35:01.227 INFO:tasks.workunit.client.1.smithi191.stdout:8/510: symlink d1/d16/d2e/d32/la5 0 2024-09-19T09:35:01.229 INFO:tasks.workunit.client.1.smithi191.stdout:4/472: mkdir d5/d38/da5 0 2024-09-19T09:35:01.229 INFO:tasks.workunit.client.1.smithi191.stdout:4/473: creat d5/fa6 x:0 0 0 2024-09-19T09:35:01.230 INFO:tasks.workunit.client.1.smithi191.stdout:8/511: mknod d1/d22/d47/d9d/ca6 0 2024-09-19T09:35:01.232 INFO:tasks.workunit.client.1.smithi191.stdout:4/474: creat d5/d1b/d1c/d24/d32/d21/d56/d86/fa7 x:0 0 0 2024-09-19T09:35:01.235 INFO:tasks.workunit.client.1.smithi191.stdout:1/445: dread d3/d9/da/d1e/d25/f64 [0,4194304] 0 2024-09-19T09:35:01.235 INFO:tasks.workunit.client.1.smithi191.stdout:3/366: dwrite d12/d13/d1a/f29 [0,4194304] 0 2024-09-19T09:35:01.237 INFO:tasks.workunit.client.1.smithi191.stdout:5/409: dwrite d0/d4/d9/d1d/d22/d3b/f3c [0,4194304] 0 2024-09-19T09:35:01.238 INFO:tasks.workunit.client.1.smithi191.stdout:1/446: rename d3/d9/da/db/c89 to d3/d9/da/d1e/d25/c9e 0 2024-09-19T09:35:01.238 INFO:tasks.workunit.client.1.smithi191.stdout:1/447: creat d3/d9/d73/d94/f9f x:0 0 0 2024-09-19T09:35:01.238 INFO:tasks.workunit.client.1.smithi191.stdout:0/509: dread d0/d9/d1c/d1f/d24/d39/d58/f16 [0,4194304] 0 2024-09-19T09:35:01.239 INFO:tasks.workunit.client.1.smithi191.stdout:3/367: symlink d12/d43/d61/l82 0 2024-09-19T09:35:01.239 INFO:tasks.workunit.client.1.smithi191.stdout:3/368: creat d12/d13/d1a/d1b/d3c/d3f/f83 x:0 0 0 2024-09-19T09:35:01.239 INFO:tasks.workunit.client.1.smithi191.stdout:9/407: dwrite d3/db/d53/f6f [0,4194304] 0 2024-09-19T09:35:01.239 INFO:tasks.workunit.client.1.smithi191.stdout:3/369: stat d12/d37/d64/d73 0 2024-09-19T09:35:01.239 INFO:tasks.workunit.client.1.smithi191.stdout:3/370: creat d12/f84 x:0 0 0 2024-09-19T09:35:01.242 INFO:tasks.workunit.client.1.smithi191.stdout:5/410: creat d0/d1f/f8e x:0 0 0 2024-09-19T09:35:01.244 INFO:tasks.workunit.client.1.smithi191.stdout:1/448: mkdir d3/d9/da/d1e/d25/d70/da0 0 2024-09-19T09:35:01.249 INFO:tasks.workunit.client.1.smithi191.stdout:8/512: dwrite d1/d16/d3c/d17/f51 [0,4194304] 0 2024-09-19T09:35:01.249 INFO:tasks.workunit.client.1.smithi191.stdout:8/513: write d1/d16/d3c/d17/f49 [105757,125113] 0 2024-09-19T09:35:01.249 INFO:tasks.workunit.client.1.smithi191.stdout:0/510: creat d0/d9/fa8 x:0 0 0 2024-09-19T09:35:01.249 INFO:tasks.workunit.client.1.smithi191.stdout:0/511: chown d0/d9/c68 8 1 2024-09-19T09:35:01.250 INFO:tasks.workunit.client.1.smithi191.stdout:9/408: dread d3/db/d16/d47/d55/f6d [0,4194304] 0 2024-09-19T09:35:01.251 INFO:tasks.workunit.client.1.smithi191.stdout:7/397: dwrite d2/d2a/f31 [0,4194304] 0 2024-09-19T09:35:01.253 INFO:tasks.workunit.client.1.smithi191.stdout:3/371: mkdir d12/d37/d51/d62/d85 0 2024-09-19T09:35:01.254 INFO:tasks.workunit.client.1.smithi191.stdout:1/449: unlink d3/d9/da/d1e/d32/d53/l52 0 2024-09-19T09:35:01.254 INFO:tasks.workunit.client.1.smithi191.stdout:5/411: read d0/d4/d9/f5a [2855760,49301] 0 2024-09-19T09:35:01.254 INFO:tasks.workunit.client.1.smithi191.stdout:5/412: write d0/d4/d9/d1d/d28/d53/f70 [640434,54168] 0 2024-09-19T09:35:01.254 INFO:tasks.workunit.client.1.smithi191.stdout:5/413: creat d0/d4/d9/de/f8f x:0 0 0 2024-09-19T09:35:01.257 INFO:tasks.workunit.client.1.smithi191.stdout:0/512: mkdir d0/d9/d1c/d1f/da9 0 2024-09-19T09:35:01.257 INFO:tasks.workunit.client.1.smithi191.stdout:0/513: write d0/d9/d1c/d1f/d24/f89 [1006895,27238] 0 2024-09-19T09:35:01.258 INFO:tasks.workunit.client.1.smithi191.stdout:9/409: creat d3/d8/f86 x:0 0 0 2024-09-19T09:35:01.259 INFO:tasks.workunit.client.1.smithi191.stdout:7/398: symlink d2/d2a/d4f/l8a 0 2024-09-19T09:35:01.260 INFO:tasks.workunit.client.1.smithi191.stdout:3/372: mkdir d12/d37/d51/d62/d86 0 2024-09-19T09:35:01.260 INFO:tasks.workunit.client.1.smithi191.stdout:3/373: fdatasync d12/d13/f19 0 2024-09-19T09:35:01.261 INFO:tasks.workunit.client.1.smithi191.stdout:1/450: mkdir d3/d9/da/d1e/d32/d53/d57/d6d/da1 0 2024-09-19T09:35:01.263 INFO:tasks.workunit.client.1.smithi191.stdout:5/414: rename d0/d4/d9/d1d/d22/l6b to d0/d4/d9/d1d/d29/d7f/l90 0 2024-09-19T09:35:01.264 INFO:tasks.workunit.client.1.smithi191.stdout:0/514: truncate d0/d9/de/d61/f6a 1180186 0 2024-09-19T09:35:01.267 INFO:tasks.workunit.client.1.smithi191.stdout:9/410: rename d3/db/d16/d47/d55/l84 to d3/db/l87 0 2024-09-19T09:35:01.267 INFO:tasks.workunit.client.1.smithi191.stdout:5/415: mknod d0/d4/d9/c91 0 2024-09-19T09:35:01.269 INFO:tasks.workunit.client.1.smithi191.stdout:8/514: link d1/d16/d23/c72 d1/d16/ca7 0 2024-09-19T09:35:01.271 INFO:tasks.workunit.client.1.smithi191.stdout:7/399: rename d2/d2a/d4f/l50 to d2/d2a/d4f/d59/l8b 0 2024-09-19T09:35:01.275 INFO:tasks.workunit.client.1.smithi191.stdout:3/374: dwrite d12/d43/f52 [0,4194304] 0 2024-09-19T09:35:01.276 INFO:tasks.workunit.client.1.smithi191.stdout:9/411: unlink d3/f2c 0 2024-09-19T09:35:01.277 INFO:tasks.workunit.client.1.smithi191.stdout:5/416: symlink d0/d4/d9/d1d/d29/d7f/l92 0 2024-09-19T09:35:01.277 INFO:tasks.workunit.client.1.smithi191.stdout:9/412: creat d3/db/d16/f88 x:0 0 0 2024-09-19T09:35:01.277 INFO:tasks.workunit.client.1.smithi191.stdout:0/515: dread d0/d9/d1c/d1f/d24/d39/d8b/f8d [0,4194304] 0 2024-09-19T09:35:01.278 INFO:tasks.workunit.client.1.smithi191.stdout:1/451: rename d3/d9/l5c to d3/d9/da/d1e/d25/d70/da0/la2 0 2024-09-19T09:35:01.278 INFO:tasks.workunit.client.1.smithi191.stdout:9/413: dread d3/d60/f54 [0,4194304] 0 2024-09-19T09:35:01.280 INFO:tasks.workunit.client.1.smithi191.stdout:3/375: dread d12/d13/d1a/f32 [0,4194304] 0 2024-09-19T09:35:01.281 INFO:tasks.workunit.client.1.smithi191.stdout:3/376: write d12/d13/d1a/d28/f34 [566370,24781] 0 2024-09-19T09:35:01.281 INFO:tasks.workunit.client.1.smithi191.stdout:3/377: chown f9 4 1 2024-09-19T09:35:01.281 INFO:tasks.workunit.client.1.smithi191.stdout:5/417: link d0/d4/d9/d1d/d29/d7f/l92 d0/d4/d9/d1d/d29/l93 0 2024-09-19T09:35:01.282 INFO:tasks.workunit.client.1.smithi191.stdout:1/452: creat d3/d9/da/fa3 x:0 0 0 2024-09-19T09:35:01.287 INFO:tasks.workunit.client.1.smithi191.stdout:3/378: rmdir d12/d13/d1a/d1b/d3c/d71/d7f 0 2024-09-19T09:35:01.287 INFO:tasks.workunit.client.1.smithi191.stdout:3/379: fdatasync d12/d13/d1a/d1b/d3c/d3f/f4d 0 2024-09-19T09:35:01.288 INFO:tasks.workunit.client.1.smithi191.stdout:5/418: mkdir d0/d4/d9/d1d/d29/d7f/d94 0 2024-09-19T09:35:01.288 INFO:tasks.workunit.client.1.smithi191.stdout:5/419: stat d0/d4/d9/d1d/d22/d3b 0 2024-09-19T09:35:01.290 INFO:tasks.workunit.client.1.smithi191.stdout:0/516: dread d0/d9/d1c/d1f/d24/d29/d30/f9a [0,4194304] 0 2024-09-19T09:35:01.290 INFO:tasks.workunit.client.1.smithi191.stdout:3/380: rename d12/c16 to d12/d13/d1a/d1b/d60/d7a/c87 0 2024-09-19T09:35:01.290 INFO:tasks.workunit.client.1.smithi191.stdout:3/381: write d12/f25 [1755345,129405] 0 2024-09-19T09:35:01.291 INFO:tasks.workunit.client.1.smithi191.stdout:5/420: symlink d0/d4/d9/d1d/d22/l95 0 2024-09-19T09:35:01.291 INFO:tasks.workunit.client.1.smithi191.stdout:5/421: creat d0/d1f/f96 x:0 0 0 2024-09-19T09:35:01.293 INFO:tasks.workunit.client.1.smithi191.stdout:3/382: rename d12/c2a to d12/d37/d3d/c88 0 2024-09-19T09:35:01.299 INFO:tasks.workunit.client.1.smithi191.stdout:9/414: getdents d3 0 2024-09-19T09:35:01.301 INFO:tasks.workunit.client.1.smithi191.stdout:9/415: mkdir d3/db/d16/d47/d89 0 2024-09-19T09:35:01.301 INFO:tasks.workunit.client.1.smithi191.stdout:9/416: creat d3/db/d16/d17/d81/f8a x:0 0 0 2024-09-19T09:35:01.301 INFO:tasks.workunit.client.1.smithi191.stdout:9/417: dread - d3/db/d16/d47/d55/f4f zero size 2024-09-19T09:35:01.305 INFO:tasks.workunit.client.1.smithi191.stdout:8/515: dwrite d1/d16/d3c/fc [0,4194304] 0 2024-09-19T09:35:01.311 INFO:tasks.workunit.client.1.smithi191.stdout:8/516: dread d1/d16/f19 [0,4194304] 0 2024-09-19T09:35:01.312 INFO:tasks.workunit.client.1.smithi191.stdout:8/517: rmdir d1/d16/d3c 39 2024-09-19T09:35:01.314 INFO:tasks.workunit.client.1.smithi191.stdout:8/518: mkdir d1/d7/d1a/d6d/da8 0 2024-09-19T09:35:01.315 INFO:tasks.workunit.client.1.smithi191.stdout:8/519: mkdir d1/d4f/d6b/da9 0 2024-09-19T09:35:01.315 INFO:tasks.workunit.client.1.smithi191.stdout:8/520: stat d1/d7/d1a/l99 0 2024-09-19T09:35:01.321 INFO:tasks.workunit.client.1.smithi191.stdout:7/400: dwrite d2/f17 [0,4194304] 0 2024-09-19T09:35:01.324 INFO:tasks.workunit.client.1.smithi191.stdout:7/401: stat d2/d2a/d33/c48 0 2024-09-19T09:35:01.324 INFO:tasks.workunit.client.1.smithi191.stdout:7/402: creat d2/d2a/d33/f8c x:0 0 0 2024-09-19T09:35:01.324 INFO:tasks.workunit.client.1.smithi191.stdout:7/403: write d2/f34 [601835,42526] 0 2024-09-19T09:35:01.326 INFO:tasks.workunit.client.1.smithi191.stdout:7/404: getdents d2/d2a 0 2024-09-19T09:35:01.326 INFO:tasks.workunit.client.1.smithi191.stdout:7/405: fsync d2/d39/f62 0 2024-09-19T09:35:01.328 INFO:tasks.workunit.client.1.smithi191.stdout:1/453: dwrite d3/d9/da/d42/f55 [0,4194304] 0 2024-09-19T09:35:01.330 INFO:tasks.workunit.client.1.smithi191.stdout:8/521: read d1/d16/d23/d3e/f4b [3316892,110760] 0 2024-09-19T09:35:01.331 INFO:tasks.workunit.client.1.smithi191.stdout:1/454: creat d3/d9/da/d1e/d25/d70/fa4 x:0 0 0 2024-09-19T09:35:01.332 INFO:tasks.workunit.client.1.smithi191.stdout:8/522: mknod d1/d16/d3c/d28/d79/da2/caa 0 2024-09-19T09:35:01.332 INFO:tasks.workunit.client.1.smithi191.stdout:8/523: stat d1/d16/d2e/d32/l78 0 2024-09-19T09:35:01.332 INFO:tasks.workunit.client.1.smithi191.stdout:8/524: chown d1/d16/d2e/d32 103797 1 2024-09-19T09:35:01.333 INFO:tasks.workunit.client.1.smithi191.stdout:0/517: dwrite d0/d9/d1c/d1f/f77 [4194304,4194304] 0 2024-09-19T09:35:01.333 INFO:tasks.workunit.client.1.smithi191.stdout:0/518: write d0/d9/d1c/d1f/d24/d39/d58/d6c/d86/fa5 [479895,60971] 0 2024-09-19T09:35:01.333 INFO:tasks.workunit.client.1.smithi191.stdout:3/383: dwrite ff [0,4194304] 0 2024-09-19T09:35:01.333 INFO:tasks.workunit.client.1.smithi191.stdout:3/384: chown d12/d13/d1a/d1b/d3c/d3f/f75 6316632 1 2024-09-19T09:35:01.333 INFO:tasks.workunit.client.1.smithi191.stdout:5/422: dwrite d0/d1f/f8e [0,4194304] 0 2024-09-19T09:35:01.333 INFO:tasks.workunit.client.1.smithi191.stdout:9/418: dwrite d3/db/d16/d17/f70 [0,4194304] 0 2024-09-19T09:35:01.333 INFO:tasks.workunit.client.1.smithi191.stdout:9/419: dread - d3/db/f63 zero size 2024-09-19T09:35:01.334 INFO:tasks.workunit.client.1.smithi191.stdout:1/455: rename d3/f4 to d3/d9/da/d1e/d32/d53/d57/d6d/fa5 0 2024-09-19T09:35:01.335 INFO:tasks.workunit.client.1.smithi191.stdout:8/525: mkdir d1/d4f/d6b/d83/dab 0 2024-09-19T09:35:01.336 INFO:tasks.workunit.client.1.smithi191.stdout:0/519: creat d0/d9/d1c/d1f/d24/d87/faa x:0 0 0 2024-09-19T09:35:01.338 INFO:tasks.workunit.client.1.smithi191.stdout:4/475: sync 2024-09-19T09:35:01.339 INFO:tasks.workunit.client.1.smithi191.stdout:6/375: sync 2024-09-19T09:35:01.339 INFO:tasks.workunit.client.1.smithi191.stdout:2/402: sync 2024-09-19T09:35:01.339 INFO:tasks.workunit.client.1.smithi191.stdout:6/376: readlink d2/de/d15/l2b 0 2024-09-19T09:35:01.340 INFO:tasks.workunit.client.1.smithi191.stdout:3/385: mkdir d12/d37/d51/d62/d85/d89 0 2024-09-19T09:35:01.343 INFO:tasks.workunit.client.1.smithi191.stdout:5/423: mkdir d0/d4/d9/d1d/d29/d33/d45/d97 0 2024-09-19T09:35:01.347 INFO:tasks.workunit.client.1.smithi191.stdout:3/386: dread d12/d13/f19 [0,4194304] 0 2024-09-19T09:35:01.348 INFO:tasks.workunit.client.1.smithi191.stdout:1/456: mknod d3/d9/d73/d94/ca6 0 2024-09-19T09:35:01.348 INFO:tasks.workunit.client.1.smithi191.stdout:0/520: mknod d0/d9/de/d61/cab 0 2024-09-19T09:35:01.348 INFO:tasks.workunit.client.1.smithi191.stdout:0/521: creat d0/d9/d1c/d1f/d24/d39/fac x:0 0 0 2024-09-19T09:35:01.348 INFO:tasks.workunit.client.1.smithi191.stdout:1/457: write d3/d9/d73/d94/f9f [180401,101099] 0 2024-09-19T09:35:01.348 INFO:tasks.workunit.client.1.smithi191.stdout:2/403: rename d8/db/d4e/c6c to d8/c86 0 2024-09-19T09:35:01.349 INFO:tasks.workunit.client.1.smithi191.stdout:6/377: mknod d2/de/d19/c7c 0 2024-09-19T09:35:01.349 INFO:tasks.workunit.client.1.smithi191.stdout:6/378: fdatasync d2/de/f10 0 2024-09-19T09:35:01.349 INFO:tasks.workunit.client.1.smithi191.stdout:6/379: write d2/de/d15/d57/f6a [2864398,122356] 0 2024-09-19T09:35:01.350 INFO:tasks.workunit.client.1.smithi191.stdout:4/476: creat d5/d1b/d1c/d24/d32/d21/d92/fa8 x:0 0 0 2024-09-19T09:35:01.351 INFO:tasks.workunit.client.1.smithi191.stdout:3/387: link d12/d37/d64/d73/f79 d12/d37/d51/d62/d86/f8a 0 2024-09-19T09:35:01.353 INFO:tasks.workunit.client.1.smithi191.stdout:0/522: creat d0/d9/d1c/d1f/da9/fad x:0 0 0 2024-09-19T09:35:01.353 INFO:tasks.workunit.client.1.smithi191.stdout:1/458: mkdir d3/d9/da/d1e/d32/d53/d57/d6d/da1/da7 0 2024-09-19T09:35:01.354 INFO:tasks.workunit.client.1.smithi191.stdout:2/404: mknod d8/db/d13/d35/d70/c87 0 2024-09-19T09:35:01.354 INFO:tasks.workunit.client.1.smithi191.stdout:2/405: stat d8 0 2024-09-19T09:35:01.354 INFO:tasks.workunit.client.1.smithi191.stdout:2/406: write d8/d11/d3f/f21 [5139240,23054] 0 2024-09-19T09:35:01.355 INFO:tasks.workunit.client.1.smithi191.stdout:6/380: truncate d2/de/f14 3626702 0 2024-09-19T09:35:01.358 INFO:tasks.workunit.client.1.smithi191.stdout:6/381: rename d2/de/d15/d57 to d2/de/d2a/d7d 0 2024-09-19T09:35:01.362 INFO:tasks.workunit.client.1.smithi191.stdout:6/382: dread d2/de/d19/d1e/d64/f54 [0,4194304] 0 2024-09-19T09:35:01.363 INFO:tasks.workunit.client.1.smithi191.stdout:3/388: write d12/d13/f3b [1208060,111474] 0 2024-09-19T09:35:01.365 INFO:tasks.workunit.client.1.smithi191.stdout:6/383: link d2/de/d19/l5f d2/de/d19/d1e/d64/d77/l7e 0 2024-09-19T09:35:01.366 INFO:tasks.workunit.client.1.smithi191.stdout:4/477: dread d5/d1b/d1c/d24/d82/f90 [0,4194304] 0 2024-09-19T09:35:01.369 INFO:tasks.workunit.client.1.smithi191.stdout:4/478: mkdir d5/d1b/d1c/d24/d32/d21/d5c/da9 0 2024-09-19T09:35:01.369 INFO:tasks.workunit.client.1.smithi191.stdout:4/479: write d5/d1b/d1c/d24/d32/f1e [4450495,110365] 0 2024-09-19T09:35:01.369 INFO:tasks.workunit.client.1.smithi191.stdout:4/480: read d5/d1b/d1c/d2f/d19/f34 [3526437,88588] 0 2024-09-19T09:35:01.369 INFO:tasks.workunit.client.1.smithi191.stdout:1/459: dread d3/d9/f17 [0,4194304] 0 2024-09-19T09:35:01.369 INFO:tasks.workunit.client.1.smithi191.stdout:1/460: dread - d3/d9/da/db/f86 zero size 2024-09-19T09:35:01.371 INFO:tasks.workunit.client.1.smithi191.stdout:1/461: symlink d3/d9/da/d1e/d25/d70/la8 0 2024-09-19T09:35:01.371 INFO:tasks.workunit.client.1.smithi191.stdout:7/406: dwrite d2/d39/d3a/d3c/f69 [0,4194304] 0 2024-09-19T09:35:01.373 INFO:tasks.workunit.client.1.smithi191.stdout:1/462: mknod d3/d9/da/d1e/d32/ca9 0 2024-09-19T09:35:01.374 INFO:tasks.workunit.client.1.smithi191.stdout:0/523: dread d0/d9/d1c/d20/f37 [0,4194304] 0 2024-09-19T09:35:01.374 INFO:tasks.workunit.client.1.smithi191.stdout:0/524: fdatasync d0/d9/d1c/d1f/d24/d39/d58/f52 0 2024-09-19T09:35:01.374 INFO:tasks.workunit.client.1.smithi191.stdout:0/525: fsync d0/d9/d1c/d1f/f77 0 2024-09-19T09:35:01.375 INFO:tasks.workunit.client.1.smithi191.stdout:5/424: dwrite d0/d4/d88/f89 [0,4194304] 0 2024-09-19T09:35:01.375 INFO:tasks.workunit.client.1.smithi191.stdout:5/425: creat d0/d4/d4a/f98 x:0 0 0 2024-09-19T09:35:01.377 INFO:tasks.workunit.client.1.smithi191.stdout:8/526: dwrite d1/d16/d23/d3e/f71 [0,4194304] 0 2024-09-19T09:35:01.377 INFO:tasks.workunit.client.1.smithi191.stdout:8/527: truncate d1/d16/d3c/d17/f49 2339966 0 2024-09-19T09:35:01.378 INFO:tasks.workunit.client.1.smithi191.stdout:7/407: rename d2/d2a/f86 to d2/d5e/d89/f8d 0 2024-09-19T09:35:01.381 INFO:tasks.workunit.client.1.smithi191.stdout:1/463: mknod d3/d9/da/d1e/d32/d53/caa 0 2024-09-19T09:35:01.382 INFO:tasks.workunit.client.1.smithi191.stdout:1/464: chown d3/d9/da/d1e/d32/d53/d57/d6d/f75 1064 1 2024-09-19T09:35:01.382 INFO:tasks.workunit.client.1.smithi191.stdout:1/465: readlink d3/d9/da/d1e/d32/l59 0 2024-09-19T09:35:01.382 INFO:tasks.workunit.client.1.smithi191.stdout:1/466: truncate d3/d9/da/d1e/d32/f80 901627 0 2024-09-19T09:35:01.382 INFO:tasks.workunit.client.1.smithi191.stdout:4/481: dread d5/d1b/d1c/d24/d32/d21/d4a/f4d [4194304,4194304] 0 2024-09-19T09:35:01.382 INFO:tasks.workunit.client.1.smithi191.stdout:4/482: stat d5/d1b/d1c/d28/f48 0 2024-09-19T09:35:01.382 INFO:tasks.workunit.client.1.smithi191.stdout:8/528: dread d1/d16/d3c/d28/fa0 [0,4194304] 0 2024-09-19T09:35:01.385 INFO:tasks.workunit.client.1.smithi191.stdout:4/483: dread d5/d1b/f4f [0,4194304] 0 2024-09-19T09:35:01.385 INFO:tasks.workunit.client.1.smithi191.stdout:4/484: chown d5/d1b/d1c/d2f/d95/c84 28 1 2024-09-19T09:35:01.385 INFO:tasks.workunit.client.1.smithi191.stdout:4/485: write d5/fa6 [763581,56423] 0 2024-09-19T09:35:01.386 INFO:tasks.workunit.client.1.smithi191.stdout:6/384: dwrite d2/de/d19/d1e/d64/f56 [0,4194304] 0 2024-09-19T09:35:01.386 INFO:tasks.workunit.client.1.smithi191.stdout:5/426: rename d0/d4/d9/d1d/d29/c32 to d0/d4/d9/d1d/d29/d33/c99 0 2024-09-19T09:35:01.387 INFO:tasks.workunit.client.1.smithi191.stdout:7/408: link d2/c4 d2/d5e/d89/c8e 0 2024-09-19T09:35:01.389 INFO:tasks.workunit.client.1.smithi191.stdout:1/467: symlink d3/d9/da/d1e/d25/lab 0 2024-09-19T09:35:01.389 INFO:tasks.workunit.client.1.smithi191.stdout:2/407: rmdir d8/db/d4e 39 2024-09-19T09:35:01.389 INFO:tasks.workunit.client.1.smithi191.stdout:2/408: write d8/d11/f49 [1029039,117623] 0 2024-09-19T09:35:01.390 INFO:tasks.workunit.client.1.smithi191.stdout:8/529: creat d1/d4f/d6b/d83/d98/fac x:0 0 0 2024-09-19T09:35:01.391 INFO:tasks.workunit.client.1.smithi191.stdout:4/486: link d5/d1b/d8e/f93 d5/d1b/faa 0 2024-09-19T09:35:01.391 INFO:tasks.workunit.client.1.smithi191.stdout:4/487: truncate d5/d1b/d1c/d2f/d37/d59/f9b 778531 0 2024-09-19T09:35:01.392 INFO:tasks.workunit.client.1.smithi191.stdout:1/468: creat d3/d9/da/d7e/fac x:0 0 0 2024-09-19T09:35:01.394 INFO:tasks.workunit.client.1.smithi191.stdout:4/488: fdatasync d5/fa6 0 2024-09-19T09:35:01.394 INFO:tasks.workunit.client.1.smithi191.stdout:2/409: rename d8/d2a/d65 to d8/d11/d3f/d88 0 2024-09-19T09:35:01.396 INFO:tasks.workunit.client.1.smithi191.stdout:8/530: creat d1/d7/d1a/d6d/fad x:0 0 0 2024-09-19T09:35:01.396 INFO:tasks.workunit.client.1.smithi191.stdout:8/531: truncate d1/d22/f54 1023389 0 2024-09-19T09:35:01.396 INFO:tasks.workunit.client.1.smithi191.stdout:8/532: read d1/d16/d3c/f62 [320853,107031] 0 2024-09-19T09:35:01.397 INFO:tasks.workunit.client.1.smithi191.stdout:1/469: creat d3/d9/da/d92/fad x:0 0 0 2024-09-19T09:35:01.398 INFO:tasks.workunit.client.1.smithi191.stdout:4/489: link d5/d1b/d1c/d2f/d19/cb d5/d1b/d1c/d2f/d19/cab 0 2024-09-19T09:35:01.400 INFO:tasks.workunit.client.1.smithi191.stdout:2/410: mknod d8/db/d13/d23/c89 0 2024-09-19T09:35:01.401 INFO:tasks.workunit.client.1.smithi191.stdout:1/470: mknod d3/d9/da/d1e/cae 0 2024-09-19T09:35:01.402 INFO:tasks.workunit.client.1.smithi191.stdout:5/427: dread d0/d1f/f43 [0,4194304] 0 2024-09-19T09:35:01.403 INFO:tasks.workunit.client.1.smithi191.stdout:2/411: unlink d8/d11/d3f/f34 0 2024-09-19T09:35:01.404 INFO:tasks.workunit.client.1.smithi191.stdout:5/428: mknod d0/d4/d88/c9a 0 2024-09-19T09:35:01.406 INFO:tasks.workunit.client.1.smithi191.stdout:5/429: creat d0/d4/d9/f9b x:0 0 0 2024-09-19T09:35:01.411 INFO:tasks.workunit.client.1.smithi191.stdout:4/490: write d5/d1b/d1c/d2f/f47 [1240886,113749] 0 2024-09-19T09:35:01.415 INFO:tasks.workunit.client.1.smithi191.stdout:4/491: mknod d5/d1b/d1c/cac 0 2024-09-19T09:35:01.420 INFO:tasks.workunit.client.1.smithi191.stdout:7/409: dwrite d2/f47 [4194304,4194304] 0 2024-09-19T09:35:01.420 INFO:tasks.workunit.client.1.smithi191.stdout:1/471: dread d3/d9/da/d1e/d25/f29 [0,4194304] 0 2024-09-19T09:35:01.420 INFO:tasks.workunit.client.1.smithi191.stdout:6/385: dwrite d2/de/f16 [0,4194304] 0 2024-09-19T09:35:01.420 INFO:tasks.workunit.client.1.smithi191.stdout:6/386: readlink d2/de/d2a/d39/l49 0 2024-09-19T09:35:01.420 INFO:tasks.workunit.client.1.smithi191.stdout:2/412: write d8/f42 [2688167,70629] 0 2024-09-19T09:35:01.422 INFO:tasks.workunit.client.1.smithi191.stdout:1/472: getdents d3 0 2024-09-19T09:35:01.422 INFO:tasks.workunit.client.1.smithi191.stdout:1/473: chown d3/d9/da/d42/f91 22247 1 2024-09-19T09:35:01.422 INFO:tasks.workunit.client.1.smithi191.stdout:1/474: creat d3/d9/da/d1e/d32/faf x:0 0 0 2024-09-19T09:35:01.424 INFO:tasks.workunit.client.1.smithi191.stdout:8/533: dwrite d1/d16/d3c/d28/d79/f7f [4194304,4194304] 0 2024-09-19T09:35:01.424 INFO:tasks.workunit.client.1.smithi191.stdout:8/534: readlink d1/d16/d2e/d32/l78 0 2024-09-19T09:35:01.424 INFO:tasks.workunit.client.1.smithi191.stdout:7/410: creat d2/d2a/d4f/d78/f8f x:0 0 0 2024-09-19T09:35:01.424 INFO:tasks.workunit.client.1.smithi191.stdout:7/411: chown d2/d2a/d4f/d59/d81 4396 1 2024-09-19T09:35:01.425 INFO:tasks.workunit.client.1.smithi191.stdout:2/413: rename d8/db/d13/d40/d75 to d8/d11/d3f/d8a 0 2024-09-19T09:35:01.427 INFO:tasks.workunit.client.1.smithi191.stdout:5/430: rmdir d0/d4/d9 39 2024-09-19T09:35:01.431 INFO:tasks.workunit.client.1.smithi191.stdout:6/387: dread d2/de/d15/f78 [0,4194304] 0 2024-09-19T09:35:01.434 INFO:tasks.workunit.client.1.smithi191.stdout:2/414: write d8/d11/f38 [4735051,40726] 0 2024-09-19T09:35:01.435 INFO:tasks.workunit.client.1.smithi191.stdout:8/535: creat d1/d4f/d6b/d83/fae x:0 0 0 2024-09-19T09:35:01.436 INFO:tasks.workunit.client.1.smithi191.stdout:7/412: creat d2/d2a/d79/d7f/f90 x:0 0 0 2024-09-19T09:35:01.439 INFO:tasks.workunit.client.1.smithi191.stdout:6/388: dread d2/de/d2a/d7d/f6b [0,4194304] 0 2024-09-19T09:35:01.441 INFO:tasks.workunit.client.1.smithi191.stdout:2/415: rename d8/db/d13/d40/l73 to d8/d11/d3f/d8a/l8b 0 2024-09-19T09:35:01.441 INFO:tasks.workunit.client.1.smithi191.stdout:2/416: write d8/db/d13/d23/f7f [935400,95464] 0 2024-09-19T09:35:01.441 INFO:tasks.workunit.client.1.smithi191.stdout:2/417: creat d8/d11/d56/f8c x:0 0 0 2024-09-19T09:35:01.442 INFO:tasks.workunit.client.1.smithi191.stdout:7/413: dread d2/f1e [0,4194304] 0 2024-09-19T09:35:01.442 INFO:tasks.workunit.client.1.smithi191.stdout:1/475: getdents d3/d9/da/d1e/d25/d70 0 2024-09-19T09:35:01.442 INFO:tasks.workunit.client.1.smithi191.stdout:8/536: mkdir d1/d7/daf 0 2024-09-19T09:35:01.442 INFO:tasks.workunit.client.1.smithi191.stdout:8/537: truncate d1/d16/d3c/d17/f4d 4841523 0 2024-09-19T09:35:01.443 INFO:tasks.workunit.client.1.smithi191.stdout:6/389: link d2/de/d19/d1e/d64/f4d d2/de/d2a/d2d/f7f 0 2024-09-19T09:35:01.445 INFO:tasks.workunit.client.1.smithi191.stdout:2/418: creat d8/db/d13/d35/d70/f8d x:0 0 0 2024-09-19T09:35:01.445 INFO:tasks.workunit.client.1.smithi191.stdout:7/414: symlink d2/d2a/d79/d7f/l91 0 2024-09-19T09:35:01.446 INFO:tasks.workunit.client.1.smithi191.stdout:7/415: mknod d2/d2a/d4f/d78/c92 0 2024-09-19T09:35:01.449 INFO:tasks.workunit.client.1.smithi191.stdout:7/416: rename d2/d2a/l32 to d2/d2a/d4f/d59/d81/l93 0 2024-09-19T09:35:01.449 INFO:tasks.workunit.client.1.smithi191.stdout:7/417: creat d2/d39/d3a/d3c/f94 x:0 0 0 2024-09-19T09:35:01.449 INFO:tasks.workunit.client.1.smithi191.stdout:7/418: read - d2/f60 zero size 2024-09-19T09:35:01.451 INFO:tasks.workunit.client.1.smithi191.stdout:9/420: sync 2024-09-19T09:35:01.452 INFO:tasks.workunit.client.1.smithi191.stdout:1/476: write d3/d9/da/d1e/d32/f45 [2529144,128388] 0 2024-09-19T09:35:01.452 INFO:tasks.workunit.client.1.smithi191.stdout:7/419: creat d2/d2a/d38/d63/f95 x:0 0 0 2024-09-19T09:35:01.452 INFO:tasks.workunit.client.1.smithi191.stdout:7/420: chown d2/d2a/f74 113 1 2024-09-19T09:35:01.453 INFO:tasks.workunit.client.1.smithi191.stdout:8/538: write d1/d16/d3c/f62 [684975,5161] 0 2024-09-19T09:35:01.453 INFO:tasks.workunit.client.1.smithi191.stdout:8/539: fdatasync d1/d16/d2e/f93 0 2024-09-19T09:35:01.453 INFO:tasks.workunit.client.1.smithi191.stdout:8/540: write d1/d16/d2e/f93 [239549,129942] 0 2024-09-19T09:35:01.453 INFO:tasks.workunit.client.1.smithi191.stdout:9/421: creat d3/db/d16/d17/d5b/d68/f8b x:0 0 0 2024-09-19T09:35:01.454 INFO:tasks.workunit.client.1.smithi191.stdout:7/421: symlink d2/d2a/d79/l96 0 2024-09-19T09:35:01.454 INFO:tasks.workunit.client.1.smithi191.stdout:2/419: dread d8/f44 [0,4194304] 0 2024-09-19T09:35:01.454 INFO:tasks.workunit.client.1.smithi191.stdout:8/541: mkdir d1/d16/d3c/db0 0 2024-09-19T09:35:01.455 INFO:tasks.workunit.client.1.smithi191.stdout:8/542: readlink d1/d7/d1a/l88 0 2024-09-19T09:35:01.455 INFO:tasks.workunit.client.1.smithi191.stdout:8/543: write d1/d16/d3c/f29 [409191,39110] 0 2024-09-19T09:35:01.455 INFO:tasks.workunit.client.1.smithi191.stdout:9/422: mknod d3/db/d16/d47/d55/c8c 0 2024-09-19T09:35:01.455 INFO:tasks.workunit.client.1.smithi191.stdout:9/423: truncate d3/db/d16/d17/d81/f82 62542 0 2024-09-19T09:35:01.455 INFO:tasks.workunit.client.1.smithi191.stdout:9/424: dread - d3/db/d16/d17/d5b/d68/f8b zero size 2024-09-19T09:35:01.456 INFO:tasks.workunit.client.1.smithi191.stdout:7/422: unlink d2/d2a/d4f/d78/f8f 0 2024-09-19T09:35:01.457 INFO:tasks.workunit.client.1.smithi191.stdout:8/544: rmdir d1/d7/daf 0 2024-09-19T09:35:01.457 INFO:tasks.workunit.client.1.smithi191.stdout:8/545: write d1/d16/d3c/d17/da1/d84/f9b [85641,48678] 0 2024-09-19T09:35:01.458 INFO:tasks.workunit.client.1.smithi191.stdout:5/431: dwrite d0/d4/d9/d1d/d22/f2c [0,4194304] 0 2024-09-19T09:35:01.460 INFO:tasks.workunit.client.1.smithi191.stdout:9/425: mkdir d3/db/d16/d17/d81/d8d 0 2024-09-19T09:35:01.460 INFO:tasks.workunit.client.1.smithi191.stdout:9/426: creat d3/db/d16/d17/d81/f8e x:0 0 0 2024-09-19T09:35:01.463 INFO:tasks.workunit.client.1.smithi191.stdout:6/390: dwrite d2/de/d2a/d2d/f1b [4194304,4194304] 0 2024-09-19T09:35:01.463 INFO:tasks.workunit.client.1.smithi191.stdout:7/423: dread d2/ff [0,4194304] 0 2024-09-19T09:35:01.463 INFO:tasks.workunit.client.1.smithi191.stdout:7/424: fsync d2/d2a/d33/f3e 0 2024-09-19T09:35:01.471 INFO:tasks.workunit.client.1.smithi191.stdout:9/427: write d3/db/d16/d38/f3e [2296500,26809] 0 2024-09-19T09:35:01.474 INFO:tasks.workunit.client.1.smithi191.stdout:8/546: fdatasync d1/d16/d3c/f62 0 2024-09-19T09:35:01.475 INFO:tasks.workunit.client.1.smithi191.stdout:8/547: creat d1/d7/fb1 x:0 0 0 2024-09-19T09:35:01.479 INFO:tasks.workunit.client.1.smithi191.stdout:7/425: dread d2/d2a/d4f/f76 [0,4194304] 0 2024-09-19T09:35:01.479 INFO:tasks.workunit.client.1.smithi191.stdout:7/426: fdatasync d2/f4a 0 2024-09-19T09:35:01.479 INFO:tasks.workunit.client.1.smithi191.stdout:7/427: chown d2/d2a/d4f/d59/d81 2426904 1 2024-09-19T09:35:01.480 INFO:tasks.workunit.client.1.smithi191.stdout:7/428: truncate d2/d2a/f31 4275060 0 2024-09-19T09:35:01.481 INFO:tasks.workunit.client.1.smithi191.stdout:1/477: dwrite d3/d9/da/d1e/d32/d53/d57/d6d/fa5 [0,4194304] 0 2024-09-19T09:35:01.481 INFO:tasks.workunit.client.1.smithi191.stdout:7/429: unlink d2/f4a 0 2024-09-19T09:35:01.484 INFO:tasks.workunit.client.1.smithi191.stdout:1/478: getdents d3/d9/da/db/d48 0 2024-09-19T09:35:01.484 INFO:tasks.workunit.client.1.smithi191.stdout:1/479: write d3/d9/da/d1e/d32/f8b [3855958,116018] 0 2024-09-19T09:35:01.486 INFO:tasks.workunit.client.1.smithi191.stdout:1/480: mknod d3/d9/da/d42/cb0 0 2024-09-19T09:35:01.486 INFO:tasks.workunit.client.1.smithi191.stdout:1/481: truncate d3/d9/da/d1e/d25/f29 9411546 0 2024-09-19T09:35:01.486 INFO:tasks.workunit.client.1.smithi191.stdout:9/428: write d3/db/d16/d47/d55/f6d [688356,10102] 0 2024-09-19T09:35:01.486 INFO:tasks.workunit.client.1.smithi191.stdout:1/482: creat d3/d9/da/d92/fb1 x:0 0 0 2024-09-19T09:35:01.487 INFO:tasks.workunit.client.1.smithi191.stdout:2/420: dwrite d8/f44 [4194304,4194304] 0 2024-09-19T09:35:01.487 INFO:tasks.workunit.client.1.smithi191.stdout:2/421: chown d8/db/f14 9 1 2024-09-19T09:35:01.487 INFO:tasks.workunit.client.1.smithi191.stdout:5/432: dwrite d0/d4/d9/d1d/d22/d5c/f5e [0,4194304] 0 2024-09-19T09:35:01.487 INFO:tasks.workunit.client.1.smithi191.stdout:7/430: dread d2/f7 [0,4194304] 0 2024-09-19T09:35:01.489 INFO:tasks.workunit.client.1.smithi191.stdout:9/429: symlink d3/db/l8f 0 2024-09-19T09:35:01.491 INFO:tasks.workunit.client.1.smithi191.stdout:1/483: mkdir d3/d9/da/d1e/d32/d6f/db2 0 2024-09-19T09:35:01.493 INFO:tasks.workunit.client.1.smithi191.stdout:1/484: dread d3/d9/da/d1e/d25/f98 [0,4194304] 0 2024-09-19T09:35:01.493 INFO:tasks.workunit.client.1.smithi191.stdout:2/422: rmdir d8/db/d41 39 2024-09-19T09:35:01.493 INFO:tasks.workunit.client.1.smithi191.stdout:1/485: stat d3/d9/da/db 0 2024-09-19T09:35:01.497 INFO:tasks.workunit.client.1.smithi191.stdout:5/433: symlink d0/d4/d9/d1d/d29/d33/d45/d64/l9c 0 2024-09-19T09:35:01.498 INFO:tasks.workunit.client.1.smithi191.stdout:8/548: dwrite d1/d16/d2e/f93 [0,4194304] 0 2024-09-19T09:35:01.498 INFO:tasks.workunit.client.1.smithi191.stdout:8/549: creat d1/d22/fb2 x:0 0 0 2024-09-19T09:35:01.500 INFO:tasks.workunit.client.1.smithi191.stdout:9/430: rename d3/l4 to d3/db/d16/d17/l90 0 2024-09-19T09:35:01.501 INFO:tasks.workunit.client.1.smithi191.stdout:1/486: creat d3/fb3 x:0 0 0 2024-09-19T09:35:01.502 INFO:tasks.workunit.client.1.smithi191.stdout:5/434: symlink d0/d4/d9/d1d/d29/d33/d52/l9d 0 2024-09-19T09:35:01.502 INFO:tasks.workunit.client.1.smithi191.stdout:5/435: readlink d0/l25 0 2024-09-19T09:35:01.508 INFO:tasks.workunit.client.1.smithi191.stdout:9/431: mknod d3/db/d16/d38/c91 0 2024-09-19T09:35:01.509 INFO:tasks.workunit.client.1.smithi191.stdout:5/436: mknod d0/d4/d9/d1d/d29/d33/d45/d64/c9e 0 2024-09-19T09:35:01.509 INFO:tasks.workunit.client.1.smithi191.stdout:5/437: chown d0/ca 1381594540 1 2024-09-19T09:35:01.510 INFO:tasks.workunit.client.1.smithi191.stdout:5/438: rename d0/d4/d9/d1d/d29/f80 to d0/d4/d9/f9f 0 2024-09-19T09:35:01.512 INFO:tasks.workunit.client.1.smithi191.stdout:5/439: symlink d0/d4/d9/d1d/d22/d3b/la0 0 2024-09-19T09:35:01.512 INFO:tasks.workunit.client.1.smithi191.stdout:7/431: dwrite d2/f40 [0,4194304] 0 2024-09-19T09:35:01.512 INFO:tasks.workunit.client.1.smithi191.stdout:7/432: creat d2/d2a/d38/d63/f97 x:0 0 0 2024-09-19T09:35:01.515 INFO:tasks.workunit.client.1.smithi191.stdout:5/440: creat d0/d4/d9/d1d/d29/d7f/d94/fa1 x:0 0 0 2024-09-19T09:35:01.515 INFO:tasks.workunit.client.1.smithi191.stdout:5/441: chown d0/d4/d9/de/f18 3904053 1 2024-09-19T09:35:01.515 INFO:tasks.workunit.client.1.smithi191.stdout:5/442: fdatasync d0/d4/d9/d1d/d29/d33/f34 0 2024-09-19T09:35:01.516 INFO:tasks.workunit.client.1.smithi191.stdout:8/550: dread d1/d22/f2c [0,4194304] 0 2024-09-19T09:35:01.516 INFO:tasks.workunit.client.1.smithi191.stdout:7/433: creat d2/d2a/d79/f98 x:0 0 0 2024-09-19T09:35:01.516 INFO:tasks.workunit.client.1.smithi191.stdout:3/389: sync 2024-09-19T09:35:01.518 INFO:tasks.workunit.client.1.smithi191.stdout:8/551: unlink d1/d16/d2e/f6f 0 2024-09-19T09:35:01.519 INFO:tasks.workunit.client.1.smithi191.stdout:3/390: mknod d12/d37/d51/d62/d86/c8b 0 2024-09-19T09:35:01.519 INFO:tasks.workunit.client.1.smithi191.stdout:3/391: write d12/d13/d1a/d1b/f36 [783186,70191] 0 2024-09-19T09:35:01.519 INFO:tasks.workunit.client.1.smithi191.stdout:3/392: creat d12/d37/d3d/f8c x:0 0 0 2024-09-19T09:35:01.520 INFO:tasks.workunit.client.1.smithi191.stdout:3/393: creat d12/d13/d1a/d1b/d60/f8d x:0 0 0 2024-09-19T09:35:01.520 INFO:tasks.workunit.client.1.smithi191.stdout:3/394: write d12/f1e [2298311,79465] 0 2024-09-19T09:35:01.534 INFO:tasks.workunit.client.1.smithi191.stdout:0/526: sync 2024-09-19T09:35:01.534 INFO:tasks.workunit.client.1.smithi191.stdout:4/492: sync 2024-09-19T09:35:01.534 INFO:tasks.workunit.client.1.smithi191.stdout:4/493: fsync d5/d1b/d8e/f93 0 2024-09-19T09:35:01.535 INFO:tasks.workunit.client.1.smithi191.stdout:3/395: dread d12/d13/f14 [0,4194304] 0 2024-09-19T09:35:01.536 INFO:tasks.workunit.client.1.smithi191.stdout:0/527: creat d0/d9/d1c/d1f/d24/d39/d7a/fae x:0 0 0 2024-09-19T09:35:01.537 INFO:tasks.workunit.client.1.smithi191.stdout:3/396: creat d12/d37/d64/f8e x:0 0 0 2024-09-19T09:35:01.538 INFO:tasks.workunit.client.1.smithi191.stdout:0/528: unlink d0/d9/de/f55 0 2024-09-19T09:35:01.538 INFO:tasks.workunit.client.1.smithi191.stdout:0/529: chown d0/d6f/d7b 0 1 2024-09-19T09:35:01.538 INFO:tasks.workunit.client.1.smithi191.stdout:0/530: truncate d0/d9/d1c/d1f/f77 3646264 0 2024-09-19T09:35:01.539 INFO:tasks.workunit.client.1.smithi191.stdout:8/552: dread d1/d16/d3c/d28/f33 [0,4194304] 0 2024-09-19T09:35:01.539 INFO:tasks.workunit.client.1.smithi191.stdout:4/494: rename d5/d38/d6b to d5/d1b/d8e/dad 0 2024-09-19T09:35:01.539 INFO:tasks.workunit.client.1.smithi191.stdout:3/397: rename d12/d37/d51 to d12/d37/d51/d62/d86/d8f 22 2024-09-19T09:35:01.541 INFO:tasks.workunit.client.1.smithi191.stdout:0/531: creat d0/d9/d1c/d1f/d24/d29/faf x:0 0 0 2024-09-19T09:35:01.549 INFO:tasks.workunit.client.1.smithi191.stdout:8/553: dread d1/d16/d2e/f93 [0,4194304] 0 2024-09-19T09:35:01.549 INFO:tasks.workunit.client.1.smithi191.stdout:7/434: dwrite d2/d2a/d38/f42 [0,4194304] 0 2024-09-19T09:35:01.549 INFO:tasks.workunit.client.1.smithi191.stdout:8/554: creat d1/d7/d1a/d6d/fb3 x:0 0 0 2024-09-19T09:35:01.550 INFO:tasks.workunit.client.1.smithi191.stdout:5/443: dwrite d0/d4/d9/d1d/d22/d3b/f3c [0,4194304] 0 2024-09-19T09:35:01.550 INFO:tasks.workunit.client.1.smithi191.stdout:5/444: dread - d0/d4/d9/d1d/d29/d33/d45/f8a zero size 2024-09-19T09:35:01.554 INFO:tasks.workunit.client.1.smithi191.stdout:7/435: rmdir d2/d5e/d89 39 2024-09-19T09:35:01.556 INFO:tasks.workunit.client.1.smithi191.stdout:5/445: unlink d0/d4/d9/d1d/d22/d3b/f7e 0 2024-09-19T09:35:01.556 INFO:tasks.workunit.client.1.smithi191.stdout:5/446: write d0/d4/d9/f9b [7028,80827] 0 2024-09-19T09:35:01.558 INFO:tasks.workunit.client.1.smithi191.stdout:5/447: creat d0/fa2 x:0 0 0 2024-09-19T09:35:01.558 INFO:tasks.workunit.client.1.smithi191.stdout:5/448: chown d0/d4/d4a/f69 461512 1 2024-09-19T09:35:01.560 INFO:tasks.workunit.client.1.smithi191.stdout:5/449: read d0/d1f/f43 [4260896,93929] 0 2024-09-19T09:35:01.561 INFO:tasks.workunit.client.1.smithi191.stdout:5/450: mknod d0/d4/d9/d1d/d22/d5c/ca3 0 2024-09-19T09:35:01.567 INFO:tasks.workunit.client.1.smithi191.stdout:5/451: dread d0/d4/d9/f1e [0,4194304] 0 2024-09-19T09:35:01.569 INFO:tasks.workunit.client.1.smithi191.stdout:8/555: write d1/d16/d23/d3e/f71 [1042269,49421] 0 2024-09-19T09:35:01.577 INFO:tasks.workunit.client.1.smithi191.stdout:4/495: dwrite d5/d1b/d1c/d28/f97 [0,4194304] 0 2024-09-19T09:35:01.579 INFO:tasks.workunit.client.1.smithi191.stdout:3/398: dwrite d12/d13/d1a/d1b/d2e/f53 [0,4194304] 0 2024-09-19T09:35:01.580 INFO:tasks.workunit.client.1.smithi191.stdout:4/496: dread d5/d1b/d1c/d24/d32/d21/d78/f79 [0,4194304] 0 2024-09-19T09:35:01.582 INFO:tasks.workunit.client.1.smithi191.stdout:3/399: mknod d12/d43/c90 0 2024-09-19T09:35:01.588 INFO:tasks.workunit.client.1.smithi191.stdout:0/532: dwrite d0/d9/d1c/f7e [0,4194304] 0 2024-09-19T09:35:01.590 INFO:tasks.workunit.client.1.smithi191.stdout:0/533: symlink d0/d9/de/d81/lb0 0 2024-09-19T09:35:01.590 INFO:tasks.workunit.client.1.smithi191.stdout:0/534: readlink d0/d9/d1c/d1f/d24/l93 0 2024-09-19T09:35:01.597 INFO:tasks.workunit.client.1.smithi191.stdout:4/497: dwrite d5/d1b/d1c/d2f/d19/f3a [4194304,4194304] 0 2024-09-19T09:35:01.597 INFO:tasks.workunit.client.1.smithi191.stdout:4/498: chown d5/f91 11275 1 2024-09-19T09:35:01.597 INFO:tasks.workunit.client.1.smithi191.stdout:4/499: truncate d5/d1b/d1c/d24/d32/f76 4863350 0 2024-09-19T09:35:01.597 INFO:tasks.workunit.client.1.smithi191.stdout:7/436: dwrite d2/d2a/d33/f54 [0,4194304] 0 2024-09-19T09:35:01.597 INFO:tasks.workunit.client.1.smithi191.stdout:5/452: dwrite d0/d4/d9/d1d/d22/d3b/f7a [0,4194304] 0 2024-09-19T09:35:01.597 INFO:tasks.workunit.client.1.smithi191.stdout:7/437: fdatasync d2/f17 0 2024-09-19T09:35:01.599 INFO:tasks.workunit.client.1.smithi191.stdout:4/500: symlink d5/d1b/d1c/d24/d32/d21/d56/lae 0 2024-09-19T09:35:01.600 INFO:tasks.workunit.client.1.smithi191.stdout:4/501: dread d5/d1b/d1c/d24/d32/f76 [4194304,4194304] 0 2024-09-19T09:35:01.605 INFO:tasks.workunit.client.1.smithi191.stdout:5/453: mkdir d0/d4/d9/d1d/d29/d33/d52/da4 0 2024-09-19T09:35:01.605 INFO:tasks.workunit.client.1.smithi191.stdout:5/454: chown d0/d4/d88/f89 1190902608 1 2024-09-19T09:35:01.605 INFO:tasks.workunit.client.1.smithi191.stdout:5/455: stat d0/d4/d9/d1d/d22/f6d 0 2024-09-19T09:35:01.606 INFO:tasks.workunit.client.1.smithi191.stdout:4/502: creat d5/d1b/d61/d88/faf x:0 0 0 2024-09-19T09:35:01.607 INFO:tasks.workunit.client.1.smithi191.stdout:4/503: fsync d5/d1b/d1c/d24/d32/f76 0 2024-09-19T09:35:01.607 INFO:tasks.workunit.client.1.smithi191.stdout:4/504: fsync d5/d1b/d1c/d24/d32/fa3 0 2024-09-19T09:35:01.607 INFO:tasks.workunit.client.1.smithi191.stdout:3/400: getdents d12/d43 0 2024-09-19T09:35:01.607 INFO:tasks.workunit.client.1.smithi191.stdout:5/456: symlink d0/d4/d9/d1d/d29/d33/d45/d64/la5 0 2024-09-19T09:35:01.608 INFO:tasks.workunit.client.1.smithi191.stdout:4/505: unlink d5/d1b/d1c/d24/d32/c7c 0 2024-09-19T09:35:01.609 INFO:tasks.workunit.client.1.smithi191.stdout:3/401: mkdir d12/d37/d3d/d91 0 2024-09-19T09:35:01.609 INFO:tasks.workunit.client.1.smithi191.stdout:3/402: chown d12/d13/f3b 1611284 1 2024-09-19T09:35:01.610 INFO:tasks.workunit.client.1.smithi191.stdout:5/457: mknod d0/d4/d9/ca6 0 2024-09-19T09:35:01.611 INFO:tasks.workunit.client.1.smithi191.stdout:4/506: link d5/c14 d5/d1b/d1c/d2f/d37/d59/cb0 0 2024-09-19T09:35:01.612 INFO:tasks.workunit.client.1.smithi191.stdout:3/403: rename d12/d13/d1a/f29 to d12/d13/d1a/d1b/d60/d7a/f92 0 2024-09-19T09:35:01.613 INFO:tasks.workunit.client.1.smithi191.stdout:6/391: sync 2024-09-19T09:35:01.614 INFO:tasks.workunit.client.1.smithi191.stdout:0/535: dwrite d0/d9/f4d [0,4194304] 0 2024-09-19T09:35:01.614 INFO:tasks.workunit.client.1.smithi191.stdout:3/404: rmdir d12/d37/d64/d73 39 2024-09-19T09:35:01.614 INFO:tasks.workunit.client.1.smithi191.stdout:6/392: mknod d2/de/d19/d1e/d64/c80 0 2024-09-19T09:35:01.615 INFO:tasks.workunit.client.1.smithi191.stdout:7/438: dwrite d2/f7d [0,4194304] 0 2024-09-19T09:35:01.615 INFO:tasks.workunit.client.1.smithi191.stdout:7/439: readlink d2/d2a/d38/l46 0 2024-09-19T09:35:01.616 INFO:tasks.workunit.client.1.smithi191.stdout:3/405: mkdir d12/d13/d1a/d1b/d60/d7a/d93 0 2024-09-19T09:35:01.616 INFO:tasks.workunit.client.1.smithi191.stdout:3/406: fsync d12/d13/d1a/d1b/d3c/d3f/f4e 0 2024-09-19T09:35:01.616 INFO:tasks.workunit.client.1.smithi191.stdout:3/407: chown d12/d13/c70 2497635 1 2024-09-19T09:35:01.616 INFO:tasks.workunit.client.1.smithi191.stdout:6/393: mkdir d2/de/d19/d1e/d64/d61/d81 0 2024-09-19T09:35:01.617 INFO:tasks.workunit.client.1.smithi191.stdout:6/394: truncate d2/de/d19/d1e/d64/f56 5100762 0 2024-09-19T09:35:01.619 INFO:tasks.workunit.client.1.smithi191.stdout:7/440: mknod d2/d5e/c99 0 2024-09-19T09:35:01.619 INFO:tasks.workunit.client.1.smithi191.stdout:7/441: write d2/d2a/d79/f98 [648739,63903] 0 2024-09-19T09:35:01.621 INFO:tasks.workunit.client.1.smithi191.stdout:3/408: link d12/d37/d3d/f7e d12/d13/d1a/d1b/d60/d7a/d93/f94 0 2024-09-19T09:35:01.623 INFO:tasks.workunit.client.1.smithi191.stdout:6/395: mkdir d2/de/d19/d1e/d64/d77/d82 0 2024-09-19T09:35:01.623 INFO:tasks.workunit.client.1.smithi191.stdout:4/507: dread d5/d1b/d1c/d2f/f39 [0,4194304] 0 2024-09-19T09:35:01.625 INFO:tasks.workunit.client.1.smithi191.stdout:7/442: rename d2/d5e/d89 to d2/d2a/d38/d63/d9a 0 2024-09-19T09:35:01.625 INFO:tasks.workunit.client.1.smithi191.stdout:3/409: symlink d12/d37/l95 0 2024-09-19T09:35:01.626 INFO:tasks.workunit.client.1.smithi191.stdout:6/396: mknod d2/de/d19/d1e/d64/c83 0 2024-09-19T09:35:01.626 INFO:tasks.workunit.client.1.smithi191.stdout:6/397: chown d2/de/d2a/d2d/d30/l7a 2 1 2024-09-19T09:35:01.627 INFO:tasks.workunit.client.1.smithi191.stdout:5/458: dwrite d0/d4/d9/de/f8f [0,4194304] 0 2024-09-19T09:35:01.627 INFO:tasks.workunit.client.1.smithi191.stdout:5/459: fsync d0/d4/d9/f7b 0 2024-09-19T09:35:01.628 INFO:tasks.workunit.client.1.smithi191.stdout:2/423: sync 2024-09-19T09:35:01.628 INFO:tasks.workunit.client.1.smithi191.stdout:7/443: rename d2/d2a/f71 to d2/d2a/d4f/d59/d81/f9b 0 2024-09-19T09:35:01.628 INFO:tasks.workunit.client.1.smithi191.stdout:7/444: chown d2/d2a/d33/f5d 229475 1 2024-09-19T09:35:01.629 INFO:tasks.workunit.client.1.smithi191.stdout:7/445: write d2/d39/d3a/d3c/f87 [1555180,8298] 0 2024-09-19T09:35:01.629 INFO:tasks.workunit.client.1.smithi191.stdout:7/446: write d2/d2a/d33/f3e [446928,98528] 0 2024-09-19T09:35:01.629 INFO:tasks.workunit.client.1.smithi191.stdout:7/447: readlink d2/d2a/l3d 0 2024-09-19T09:35:01.629 INFO:tasks.workunit.client.1.smithi191.stdout:3/410: mknod d12/d13/c96 0 2024-09-19T09:35:01.629 INFO:tasks.workunit.client.1.smithi191.stdout:1/487: sync 2024-09-19T09:35:01.630 INFO:tasks.workunit.client.1.smithi191.stdout:6/398: mkdir d2/de/d2a/d84 0 2024-09-19T09:35:01.630 INFO:tasks.workunit.client.1.smithi191.stdout:9/432: sync 2024-09-19T09:35:01.632 INFO:tasks.workunit.client.1.smithi191.stdout:4/508: dread d5/f4e [0,4194304] 0 2024-09-19T09:35:01.633 INFO:tasks.workunit.client.1.smithi191.stdout:2/424: creat d8/d11/f8e x:0 0 0 2024-09-19T09:35:01.633 INFO:tasks.workunit.client.1.smithi191.stdout:2/425: write d8/d11/f46 [22925,122773] 0 2024-09-19T09:35:01.633 INFO:tasks.workunit.client.1.smithi191.stdout:2/426: chown d8/db/d13/d35/d70/c83 47674459 1 2024-09-19T09:35:01.635 INFO:tasks.workunit.client.1.smithi191.stdout:3/411: rename d12/d37/d3d/l59 to d12/d37/d51/l97 0 2024-09-19T09:35:01.635 INFO:tasks.workunit.client.1.smithi191.stdout:0/536: dwrite d0/d9/d1c/d1f/d24/d39/d58/f16 [0,4194304] 0 2024-09-19T09:35:01.635 INFO:tasks.workunit.client.1.smithi191.stdout:6/399: symlink d2/de/d2a/l85 0 2024-09-19T09:35:01.636 INFO:tasks.workunit.client.1.smithi191.stdout:6/400: write d2/de/d2a/f4b [4235590,12683] 0 2024-09-19T09:35:01.637 INFO:tasks.workunit.client.1.smithi191.stdout:9/433: mkdir d3/db/d16/d38/d92 0 2024-09-19T09:35:01.639 INFO:tasks.workunit.client.1.smithi191.stdout:4/509: unlink d5/d1b/d1c/d24/d32/d21/d4a/f4d 0 2024-09-19T09:35:01.639 INFO:tasks.workunit.client.1.smithi191.stdout:4/510: chown d5/d1b/d61/l6a 364418296 1 2024-09-19T09:35:01.639 INFO:tasks.workunit.client.1.smithi191.stdout:4/511: dread - d5/d1b/d1c/d24/d32/d21/d56/d86/fa7 zero size 2024-09-19T09:35:01.640 INFO:tasks.workunit.client.1.smithi191.stdout:3/412: write d12/f25 [1098013,11529] 0 2024-09-19T09:35:01.645 INFO:tasks.workunit.client.1.smithi191.stdout:1/488: rename d3/d9/da/d42/cb0 to d3/d9/da/d1e/d25/d70/da0/cb4 0 2024-09-19T09:35:01.645 INFO:tasks.workunit.client.1.smithi191.stdout:7/448: dwrite d2/f34 [0,4194304] 0 2024-09-19T09:35:01.645 INFO:tasks.workunit.client.1.smithi191.stdout:7/449: fdatasync d2/d2a/d33/f54 0 2024-09-19T09:35:01.645 INFO:tasks.workunit.client.1.smithi191.stdout:0/537: dread d0/d9/d1c/d1f/f3c [0,4194304] 0 2024-09-19T09:35:01.646 INFO:tasks.workunit.client.1.smithi191.stdout:0/538: dread - d0/d9/d1c/d1f/d24/f90 zero size 2024-09-19T09:35:01.646 INFO:tasks.workunit.client.1.smithi191.stdout:0/539: chown d0/d9/d1c/d1f/d24/d29/d30/d56/c97 9333 1 2024-09-19T09:35:01.646 INFO:tasks.workunit.client.1.smithi191.stdout:9/434: dread d3/d8/fc [0,4194304] 0 2024-09-19T09:35:01.650 INFO:tasks.workunit.client.1.smithi191.stdout:6/401: stat d2/de/d19/l23 0 2024-09-19T09:35:01.652 INFO:tasks.workunit.client.1.smithi191.stdout:4/512: creat d5/d1b/d1c/d24/d32/d21/d5c/fb1 x:0 0 0 2024-09-19T09:35:01.654 INFO:tasks.workunit.client.1.smithi191.stdout:3/413: mkdir d12/d43/d61/d98 0 2024-09-19T09:35:01.655 INFO:tasks.workunit.client.1.smithi191.stdout:2/427: rmdir d8/d11/d3f 39 2024-09-19T09:35:01.658 INFO:tasks.workunit.client.1.smithi191.stdout:7/450: mkdir d2/d39/d3a/d9c 0 2024-09-19T09:35:01.659 INFO:tasks.workunit.client.1.smithi191.stdout:0/540: symlink d0/d9/d1c/d1f/d24/d87/lb1 0 2024-09-19T09:35:01.659 INFO:tasks.workunit.client.1.smithi191.stdout:0/541: chown d0/d9/d1c/d1f/d24/d29/f3d 1760 1 2024-09-19T09:35:01.660 INFO:tasks.workunit.client.1.smithi191.stdout:9/435: mkdir d3/db/d16/d47/d93 0 2024-09-19T09:35:01.661 INFO:tasks.workunit.client.1.smithi191.stdout:7/451: dread d2/d2a/d4f/d59/f65 [0,4194304] 0 2024-09-19T09:35:01.661 INFO:tasks.workunit.client.1.smithi191.stdout:7/452: readlink d2/d2a/d4f/l64 0 2024-09-19T09:35:01.661 INFO:tasks.workunit.client.1.smithi191.stdout:7/453: write d2/d39/d3a/d3c/f87 [1894436,24268] 0 2024-09-19T09:35:01.662 INFO:tasks.workunit.client.1.smithi191.stdout:4/513: mkdir d5/d1b/d1c/d24/d32/d21/d92/db2 0 2024-09-19T09:35:01.662 INFO:tasks.workunit.client.1.smithi191.stdout:4/514: chown d5/d1b/d1c/d28/f97 26 1 2024-09-19T09:35:01.664 INFO:tasks.workunit.client.1.smithi191.stdout:3/414: rename d12/d37/d3d/l4a to d12/d13/d1a/d1b/d60/d7a/l99 0 2024-09-19T09:35:01.664 INFO:tasks.workunit.client.1.smithi191.stdout:3/415: chown d12/d13/c23 109375995 1 2024-09-19T09:35:01.664 INFO:tasks.workunit.client.1.smithi191.stdout:3/416: truncate d12/d13/d1a/d1b/f36 1315892 0 2024-09-19T09:35:01.665 INFO:tasks.workunit.client.1.smithi191.stdout:0/542: symlink d0/d9/d1c/d1f/d24/d29/lb2 0 2024-09-19T09:35:01.666 INFO:tasks.workunit.client.1.smithi191.stdout:3/417: write d12/d13/d1a/f32 [864345,33379] 0 2024-09-19T09:35:01.666 INFO:tasks.workunit.client.1.smithi191.stdout:9/436: link d3/db/d16/d38/l75 d3/d60/l94 0 2024-09-19T09:35:01.666 INFO:tasks.workunit.client.1.smithi191.stdout:9/437: write d3/db/d16/d38/f48 [4721216,115044] 0 2024-09-19T09:35:01.667 INFO:tasks.workunit.client.1.smithi191.stdout:2/428: rename d8/d11/d3f/d88 to d8/d11/d3f/d8a/d8f 0 2024-09-19T09:35:01.669 INFO:tasks.workunit.client.1.smithi191.stdout:0/543: truncate d0/f50 619959 0 2024-09-19T09:35:01.670 INFO:tasks.workunit.client.1.smithi191.stdout:3/418: truncate d12/f1e 1889370 0 2024-09-19T09:35:01.671 INFO:tasks.workunit.client.1.smithi191.stdout:3/419: dread - d12/d37/d64/f8e zero size 2024-09-19T09:35:01.671 INFO:tasks.workunit.client.1.smithi191.stdout:3/420: write d12/d13/d1a/d1b/d60/d7a/d93/f94 [555712,58959] 0 2024-09-19T09:35:01.671 INFO:tasks.workunit.client.1.smithi191.stdout:3/421: readlink d12/d13/l6c 0 2024-09-19T09:35:01.671 INFO:tasks.workunit.client.1.smithi191.stdout:8/556: sync 2024-09-19T09:35:01.672 INFO:tasks.workunit.client.1.smithi191.stdout:9/438: truncate d3/db/d16/f43 1862185 0 2024-09-19T09:35:01.674 INFO:tasks.workunit.client.1.smithi191.stdout:7/454: rename d2/d39/d3a/d3c/f94 to d2/f9d 0 2024-09-19T09:35:01.677 INFO:tasks.workunit.client.1.smithi191.stdout:2/429: link d8/d11/d56/f69 d8/db/d13/d35/f90 0 2024-09-19T09:35:01.677 INFO:tasks.workunit.client.1.smithi191.stdout:2/430: write d8/db/d13/d23/f57 [4021723,95617] 0 2024-09-19T09:35:01.678 INFO:tasks.workunit.client.1.smithi191.stdout:3/422: mknod d12/d13/d1a/d1b/d60/d7a/c9a 0 2024-09-19T09:35:01.680 INFO:tasks.workunit.client.1.smithi191.stdout:9/439: mknod d3/db/d16/d17/d3c/c95 0 2024-09-19T09:35:01.681 INFO:tasks.workunit.client.1.smithi191.stdout:7/455: mknod d2/d5e/c9e 0 2024-09-19T09:35:01.682 INFO:tasks.workunit.client.1.smithi191.stdout:2/431: rmdir d8/d11/d3f/d8a 39 2024-09-19T09:35:01.682 INFO:tasks.workunit.client.1.smithi191.stdout:2/432: fdatasync d8/db/d4e/f7d 0 2024-09-19T09:35:01.682 INFO:tasks.workunit.client.1.smithi191.stdout:2/433: dread - d8/db/d13/d35/d70/f8d zero size 2024-09-19T09:35:01.683 INFO:tasks.workunit.client.1.smithi191.stdout:2/434: fsync d8/f2f 0 2024-09-19T09:35:01.683 INFO:tasks.workunit.client.1.smithi191.stdout:8/557: rmdir d1/d16/d3c/d28/d79 39 2024-09-19T09:35:01.685 INFO:tasks.workunit.client.1.smithi191.stdout:9/440: creat d3/d60/d78/f96 x:0 0 0 2024-09-19T09:35:01.686 INFO:tasks.workunit.client.1.smithi191.stdout:3/423: write d12/d13/d1a/f57 [348576,53112] 0 2024-09-19T09:35:01.687 INFO:tasks.workunit.client.1.smithi191.stdout:3/424: truncate d12/d13/d1a/d1b/d60/f8d 627571 0 2024-09-19T09:35:01.688 INFO:tasks.workunit.client.1.smithi191.stdout:8/558: unlink d1/d16/d23/c72 0 2024-09-19T09:35:01.688 INFO:tasks.workunit.client.1.smithi191.stdout:8/559: fdatasync d1/d16/d3c/d28/fa0 0 2024-09-19T09:35:01.691 INFO:tasks.workunit.client.1.smithi191.stdout:9/441: mknod d3/c97 0 2024-09-19T09:35:01.693 INFO:tasks.workunit.client.1.smithi191.stdout:8/560: creat d1/d7/d1a/d6d/da8/fb4 x:0 0 0 2024-09-19T09:35:01.696 INFO:tasks.workunit.client.1.smithi191.stdout:9/442: link d3/db/d16/d47/d55/f4f d3/db/d16/d17/d81/d8d/f98 0 2024-09-19T09:35:01.707 INFO:tasks.workunit.client.1.smithi191.stdout:0/544: dwrite d0/d9/d1c/d1f/d24/f90 [0,4194304] 0 2024-09-19T09:35:01.709 INFO:tasks.workunit.client.1.smithi191.stdout:0/545: mknod d0/d9/d1c/d20/d73/cb3 0 2024-09-19T09:35:01.710 INFO:tasks.workunit.client.1.smithi191.stdout:0/546: creat d0/fb4 x:0 0 0 2024-09-19T09:35:01.712 INFO:tasks.workunit.client.1.smithi191.stdout:2/435: dwrite d8/d2a/f32 [4194304,4194304] 0 2024-09-19T09:35:01.713 INFO:tasks.workunit.client.1.smithi191.stdout:2/436: mknod d8/db/d13/d40/c91 0 2024-09-19T09:35:01.713 INFO:tasks.workunit.client.1.smithi191.stdout:2/437: write d8/db/d13/d23/f57 [1557117,120797] 0 2024-09-19T09:35:01.717 INFO:tasks.workunit.client.1.smithi191.stdout:2/438: write d8/f44 [4062687,14195] 0 2024-09-19T09:35:01.718 INFO:tasks.workunit.client.1.smithi191.stdout:2/439: creat d8/d11/d56/f92 x:0 0 0 2024-09-19T09:35:01.719 INFO:tasks.workunit.client.1.smithi191.stdout:2/440: creat d8/db/d41/f93 x:0 0 0 2024-09-19T09:35:01.719 INFO:tasks.workunit.client.1.smithi191.stdout:2/441: chown d8/db/d13/f15 532 1 2024-09-19T09:35:01.719 INFO:tasks.workunit.client.1.smithi191.stdout:2/442: rmdir d8/d11/d3f 39 2024-09-19T09:35:01.720 INFO:tasks.workunit.client.1.smithi191.stdout:2/443: symlink d8/d11/d3f/d8a/l94 0 2024-09-19T09:35:01.720 INFO:tasks.workunit.client.1.smithi191.stdout:2/444: chown d8/d2a/f32 743 1 2024-09-19T09:35:01.721 INFO:tasks.workunit.client.1.smithi191.stdout:2/445: write d8/d11/d3f/d8a/d8f/f6b [703205,66505] 0 2024-09-19T09:35:01.721 INFO:tasks.workunit.client.1.smithi191.stdout:2/446: mknod d8/db/d13/c95 0 2024-09-19T09:35:01.722 INFO:tasks.workunit.client.1.smithi191.stdout:3/425: dwrite d12/d13/d1a/d1b/d3c/f68 [0,4194304] 0 2024-09-19T09:35:01.723 INFO:tasks.workunit.client.1.smithi191.stdout:3/426: chown d12/d13/d1a/d1b/d2e/l55 32182248 1 2024-09-19T09:35:01.723 INFO:tasks.workunit.client.1.smithi191.stdout:3/427: rmdir d12/d37/d51/d62/d85/d89 0 2024-09-19T09:35:01.724 INFO:tasks.workunit.client.1.smithi191.stdout:9/443: dwrite d3/db/d16/d38/f83 [0,4194304] 0 2024-09-19T09:35:01.724 INFO:tasks.workunit.client.1.smithi191.stdout:9/444: write d3/d60/f54 [878978,22446] 0 2024-09-19T09:35:01.724 INFO:tasks.workunit.client.1.smithi191.stdout:8/561: dwrite d1/d16/d3c/d17/f1e [0,4194304] 0 2024-09-19T09:35:01.737 INFO:tasks.workunit.client.1.smithi191.stdout:8/562: symlink d1/d16/d3c/db0/lb5 0 2024-09-19T09:35:01.737 INFO:tasks.workunit.client.1.smithi191.stdout:3/428: rmdir d12/d37/d3d 39 2024-09-19T09:35:01.738 INFO:tasks.workunit.client.1.smithi191.stdout:2/447: rmdir d8/d11/d56 39 2024-09-19T09:35:01.740 INFO:tasks.workunit.client.1.smithi191.stdout:9/445: getdents d3/db 0 2024-09-19T09:35:01.741 INFO:tasks.workunit.client.1.smithi191.stdout:8/563: rename d1/d16/d2e to d1/d16/d2e/d32/d7e/d8b/db6 22 2024-09-19T09:35:01.742 INFO:tasks.workunit.client.1.smithi191.stdout:3/429: mknod d12/d37/d51/d62/c9b 0 2024-09-19T09:35:01.743 INFO:tasks.workunit.client.1.smithi191.stdout:2/448: creat d8/d11/d3f/d8a/d8f/f96 x:0 0 0 2024-09-19T09:35:01.744 INFO:tasks.workunit.client.1.smithi191.stdout:9/446: symlink d3/db/l99 0 2024-09-19T09:35:01.745 INFO:tasks.workunit.client.1.smithi191.stdout:8/564: unlink d1/d7/d1a/d6d/fb3 0 2024-09-19T09:35:01.746 INFO:tasks.workunit.client.1.smithi191.stdout:3/430: mknod d12/d37/d51/d62/d86/c9c 0 2024-09-19T09:35:01.747 INFO:tasks.workunit.client.1.smithi191.stdout:2/449: unlink d8/d11/l4f 0 2024-09-19T09:35:01.748 INFO:tasks.workunit.client.1.smithi191.stdout:9/447: truncate f2 1765644 0 2024-09-19T09:35:01.748 INFO:tasks.workunit.client.1.smithi191.stdout:9/448: readlink d3/d60/l94 0 2024-09-19T09:35:01.749 INFO:tasks.workunit.client.1.smithi191.stdout:8/565: write d1/d16/d3c/d17/f4d [139665,51933] 0 2024-09-19T09:35:01.749 INFO:tasks.workunit.client.1.smithi191.stdout:8/566: fsync d1/d16/d3c/d17/f3a 0 2024-09-19T09:35:01.749 INFO:tasks.workunit.client.1.smithi191.stdout:8/567: chown d1/d7/d1a/f63 5 1 2024-09-19T09:35:01.750 INFO:tasks.workunit.client.1.smithi191.stdout:3/431: symlink d12/d37/d64/l9d 0 2024-09-19T09:35:01.750 INFO:tasks.workunit.client.1.smithi191.stdout:3/432: chown d12/d13/d1a/d1b 553150 1 2024-09-19T09:35:01.750 INFO:tasks.workunit.client.1.smithi191.stdout:3/433: dread - d12/d13/d1a/d1b/d2e/f5b zero size 2024-09-19T09:35:01.751 INFO:tasks.workunit.client.1.smithi191.stdout:2/450: rename d8/db/d13/d23/l77 to d8/db/d4e/l97 0 2024-09-19T09:35:01.751 INFO:tasks.workunit.client.1.smithi191.stdout:9/449: fdatasync d3/d8/f56 0 2024-09-19T09:35:01.754 INFO:tasks.workunit.client.1.smithi191.stdout:8/568: link d1/d16/d2e/f8e d1/d16/d3c/d28/fb7 0 2024-09-19T09:35:01.754 INFO:tasks.workunit.client.1.smithi191.stdout:5/460: sync 2024-09-19T09:35:01.754 INFO:tasks.workunit.client.1.smithi191.stdout:2/451: mkdir d8/d11/d98 0 2024-09-19T09:35:01.755 INFO:tasks.workunit.client.1.smithi191.stdout:9/450: mknod d3/d60/c9a 0 2024-09-19T09:35:01.757 INFO:tasks.workunit.client.1.smithi191.stdout:8/569: unlink d1/f52 0 2024-09-19T09:35:01.758 INFO:tasks.workunit.client.1.smithi191.stdout:5/461: mkdir d0/da7 0 2024-09-19T09:35:01.759 INFO:tasks.workunit.client.1.smithi191.stdout:9/451: creat d3/db/f9b x:0 0 0 2024-09-19T09:35:01.761 INFO:tasks.workunit.client.1.smithi191.stdout:8/570: getdents d1/d16/d3c/d28/d79/da2 0 2024-09-19T09:35:01.761 INFO:tasks.workunit.client.1.smithi191.stdout:8/571: creat d1/d7/fb8 x:0 0 0 2024-09-19T09:35:01.762 INFO:tasks.workunit.client.1.smithi191.stdout:5/462: symlink d0/d4/d9/d1d/d29/d7f/d94/la8 0 2024-09-19T09:35:01.762 INFO:tasks.workunit.client.1.smithi191.stdout:5/463: write d0/d4/d9/d1d/d22/d5c/f5e [4393955,57920] 0 2024-09-19T09:35:01.763 INFO:tasks.workunit.client.1.smithi191.stdout:9/452: rename d3/db/d16/d17/d3c/c7d to d3/db/d53/c9c 0 2024-09-19T09:35:01.764 INFO:tasks.workunit.client.1.smithi191.stdout:2/452: write d8/d11/d56/f79 [672371,77284] 0 2024-09-19T09:35:01.766 INFO:tasks.workunit.client.1.smithi191.stdout:8/572: mkdir d1/d4f/d6b/db9 0 2024-09-19T09:35:01.766 INFO:tasks.workunit.client.1.smithi191.stdout:8/573: chown d1/d16/d2e/d32/l8c 15 1 2024-09-19T09:35:01.772 INFO:tasks.workunit.client.1.smithi191.stdout:5/464: dread d0/d4/d9/d1d/d29/d33/f34 [0,4194304] 0 2024-09-19T09:35:01.774 INFO:tasks.workunit.client.1.smithi191.stdout:5/465: mkdir d0/d4/d9/d1d/d22/d5c/da9 0 2024-09-19T09:35:01.774 INFO:tasks.workunit.client.1.smithi191.stdout:5/466: dread - d0/fa2 zero size 2024-09-19T09:35:01.776 INFO:tasks.workunit.client.1.smithi191.stdout:9/453: dread d3/db/f11 [0,4194304] 0 2024-09-19T09:35:01.776 INFO:tasks.workunit.client.1.smithi191.stdout:8/574: read d1/d22/f58 [4512225,105453] 0 2024-09-19T09:35:01.778 INFO:tasks.workunit.client.1.smithi191.stdout:8/575: rename d1/d22/d47/f60 to d1/d7/d1a/d6d/fba 0 2024-09-19T09:35:01.780 INFO:tasks.workunit.client.1.smithi191.stdout:5/467: write d0/d4/d9/de/f18 [2091637,56045] 0 2024-09-19T09:35:01.780 INFO:tasks.workunit.client.1.smithi191.stdout:5/468: fsync d0/d1f/f8e 0 2024-09-19T09:35:01.781 INFO:tasks.workunit.client.1.smithi191.stdout:5/469: symlink d0/d4/d9/d1d/d29/d33/d45/laa 0 2024-09-19T09:35:01.783 INFO:tasks.workunit.client.1.smithi191.stdout:5/470: dread d0/d4/d9/d1d/d29/d33/f40 [0,4194304] 0 2024-09-19T09:35:01.783 INFO:tasks.workunit.client.1.smithi191.stdout:5/471: chown d0/d1f/l61 1123 1 2024-09-19T09:35:01.786 INFO:tasks.workunit.client.1.smithi191.stdout:2/453: dwrite d8/f2f [4194304,4194304] 0 2024-09-19T09:35:01.786 INFO:tasks.workunit.client.1.smithi191.stdout:3/434: dwrite d12/d13/f14 [4194304,4194304] 0 2024-09-19T09:35:01.786 INFO:tasks.workunit.client.1.smithi191.stdout:3/435: dread - d12/d13/d1a/d1b/d3c/d3f/f83 zero size 2024-09-19T09:35:01.787 INFO:tasks.workunit.client.1.smithi191.stdout:9/454: dread d3/db/f71 [0,4194304] 0 2024-09-19T09:35:01.790 INFO:tasks.workunit.client.1.smithi191.stdout:2/454: mknod d8/d2a/c99 0 2024-09-19T09:35:01.791 INFO:tasks.workunit.client.1.smithi191.stdout:2/455: chown d8/db/d13/d23/l51 596 1 2024-09-19T09:35:01.791 INFO:tasks.workunit.client.1.smithi191.stdout:2/456: chown d8/db/d41/f5c 3433 1 2024-09-19T09:35:01.792 INFO:tasks.workunit.client.1.smithi191.stdout:2/457: stat d8/db/d41/l68 0 2024-09-19T09:35:01.793 INFO:tasks.workunit.client.1.smithi191.stdout:2/458: creat d8/d11/d98/f9a x:0 0 0 2024-09-19T09:35:01.793 INFO:tasks.workunit.client.1.smithi191.stdout:2/459: chown d8/f44 6906 1 2024-09-19T09:35:01.803 INFO:tasks.workunit.client.1.smithi191.stdout:9/455: read d3/db/d16/d38/f83 [1921608,118605] 0 2024-09-19T09:35:01.803 INFO:tasks.workunit.client.1.smithi191.stdout:9/456: chown d3 449272598 1 2024-09-19T09:35:01.804 INFO:tasks.workunit.client.1.smithi191.stdout:8/576: dwrite d1/d16/d2e/d32/f64 [0,4194304] 0 2024-09-19T09:35:01.804 INFO:tasks.workunit.client.1.smithi191.stdout:8/577: chown d1/d22/f54 0 1 2024-09-19T09:35:01.806 INFO:tasks.workunit.client.1.smithi191.stdout:5/472: dwrite d0/d4/d9/f5a [4194304,4194304] 0 2024-09-19T09:35:01.806 INFO:tasks.workunit.client.1.smithi191.stdout:9/457: mknod d3/db/d16/d38/d92/c9d 0 2024-09-19T09:35:01.806 INFO:tasks.workunit.client.1.smithi191.stdout:9/458: readlink d3/db/d16/d17/d5b/l6c 0 2024-09-19T09:35:01.807 INFO:tasks.workunit.client.1.smithi191.stdout:7/456: sync 2024-09-19T09:35:01.807 INFO:tasks.workunit.client.1.smithi191.stdout:4/515: sync 2024-09-19T09:35:01.807 INFO:tasks.workunit.client.1.smithi191.stdout:0/547: sync 2024-09-19T09:35:01.808 INFO:tasks.workunit.client.1.smithi191.stdout:6/402: sync 2024-09-19T09:35:01.808 INFO:tasks.workunit.client.1.smithi191.stdout:2/460: write d8/db/d13/d23/f29 [910315,8829] 0 2024-09-19T09:35:01.809 INFO:tasks.workunit.client.1.smithi191.stdout:5/473: symlink d0/d4/d9/d1d/d29/lab 0 2024-09-19T09:35:01.809 INFO:tasks.workunit.client.1.smithi191.stdout:5/474: dread - d0/d4/d9/f9f zero size 2024-09-19T09:35:01.809 INFO:tasks.workunit.client.1.smithi191.stdout:1/489: sync 2024-09-19T09:35:01.810 INFO:tasks.workunit.client.1.smithi191.stdout:9/459: mknod d3/db/d16/d47/d89/c9e 0 2024-09-19T09:35:01.810 INFO:tasks.workunit.client.1.smithi191.stdout:9/460: write d3/db/d16/d38/f3e [5103633,58305] 0 2024-09-19T09:35:01.810 INFO:tasks.workunit.client.1.smithi191.stdout:7/457: dread d2/d39/d3a/d3c/f87 [0,4194304] 0 2024-09-19T09:35:01.813 INFO:tasks.workunit.client.1.smithi191.stdout:0/548: unlink d0/l47 0 2024-09-19T09:35:01.813 INFO:tasks.workunit.client.1.smithi191.stdout:0/549: write d0/d9/d1c/d1f/d24/d39/d7a/fae [1004030,89976] 0 2024-09-19T09:35:01.814 INFO:tasks.workunit.client.1.smithi191.stdout:4/516: unlink d5/d1b/d1c/f63 0 2024-09-19T09:35:01.814 INFO:tasks.workunit.client.1.smithi191.stdout:4/517: write d5/d1b/d1c/d2f/f52 [463238,35080] 0 2024-09-19T09:35:01.814 INFO:tasks.workunit.client.1.smithi191.stdout:4/518: write d5/d1b/d1c/d24/d32/f16 [2411974,75246] 0 2024-09-19T09:35:01.814 INFO:tasks.workunit.client.1.smithi191.stdout:4/519: truncate d5/f4e 2671796 0 2024-09-19T09:35:01.815 INFO:tasks.workunit.client.1.smithi191.stdout:6/403: creat d2/de/d2a/d84/f86 x:0 0 0 2024-09-19T09:35:01.817 INFO:tasks.workunit.client.1.smithi191.stdout:9/461: symlink d3/l9f 0 2024-09-19T09:35:01.818 INFO:tasks.workunit.client.1.smithi191.stdout:7/458: mknod d2/d2a/d4f/d59/d81/c9f 0 2024-09-19T09:35:01.819 INFO:tasks.workunit.client.1.smithi191.stdout:1/490: dread d3/d9/da/db/f33 [0,4194304] 0 2024-09-19T09:35:01.819 INFO:tasks.workunit.client.1.smithi191.stdout:1/491: chown d3/d9/da/d1e/d32/ca9 113325 1 2024-09-19T09:35:01.819 INFO:tasks.workunit.client.1.smithi191.stdout:1/492: readlink d3/d9/da/d1e/d25/d70/la8 0 2024-09-19T09:35:01.821 INFO:tasks.workunit.client.1.smithi191.stdout:6/404: symlink d2/de/d2a/d2d/d30/l87 0 2024-09-19T09:35:01.821 INFO:tasks.workunit.client.1.smithi191.stdout:1/493: dread d3/d9/da/d1e/d32/d53/f1c [0,4194304] 0 2024-09-19T09:35:01.821 INFO:tasks.workunit.client.1.smithi191.stdout:5/475: write d0/d4/d9/d1d/d22/f2c [1613980,93123] 0 2024-09-19T09:35:01.822 INFO:tasks.workunit.client.1.smithi191.stdout:5/476: fsync d0/d4/d9/d1d/d22/f30 0 2024-09-19T09:35:01.822 INFO:tasks.workunit.client.1.smithi191.stdout:5/477: stat d0/d4/d9/l7d 0 2024-09-19T09:35:01.822 INFO:tasks.workunit.client.1.smithi191.stdout:5/478: write d0/d4/d9/d1d/d22/f5d [606033,46986] 0 2024-09-19T09:35:01.822 INFO:tasks.workunit.client.1.smithi191.stdout:5/479: chown d0/d4/d9/d1d/d22/d3b 5898 1 2024-09-19T09:35:01.823 INFO:tasks.workunit.client.1.smithi191.stdout:9/462: rename d3/db/c45 to d3/db/d16/d47/d89/ca0 0 2024-09-19T09:35:01.823 INFO:tasks.workunit.client.1.smithi191.stdout:9/463: write d3/db/d16/f7e [735850,25805] 0 2024-09-19T09:35:01.823 INFO:tasks.workunit.client.1.smithi191.stdout:0/550: read d0/d9/d1c/d1f/d24/d39/d58/f52 [854088,82692] 0 2024-09-19T09:35:01.823 INFO:tasks.workunit.client.1.smithi191.stdout:0/551: chown d0/d9/d1c/d1f/d24/d29/d30/f5b 48348 1 2024-09-19T09:35:01.823 INFO:tasks.workunit.client.1.smithi191.stdout:0/552: creat d0/d9/d1c/d20/fb5 x:0 0 0 2024-09-19T09:35:01.823 INFO:tasks.workunit.client.1.smithi191.stdout:0/553: readlink d0/d9/d1c/d1f/d24/l93 0 2024-09-19T09:35:01.824 INFO:tasks.workunit.client.1.smithi191.stdout:5/480: rmdir d0/d4/d9/d1d/d29/d7f 39 2024-09-19T09:35:01.824 INFO:tasks.workunit.client.1.smithi191.stdout:5/481: write d0/d4/d9/f1e [1309566,91375] 0 2024-09-19T09:35:01.824 INFO:tasks.workunit.client.1.smithi191.stdout:0/554: dread d0/d9/f1a [4194304,4194304] 0 2024-09-19T09:35:01.825 INFO:tasks.workunit.client.1.smithi191.stdout:6/405: rename d2/de/d19/d1e/d64/d44 to d2/de/d19/d1e/d64/d76/d88 0 2024-09-19T09:35:01.826 INFO:tasks.workunit.client.1.smithi191.stdout:9/464: mkdir d3/da1 0 2024-09-19T09:35:01.828 INFO:tasks.workunit.client.1.smithi191.stdout:5/482: creat d0/da7/fac x:0 0 0 2024-09-19T09:35:01.830 INFO:tasks.workunit.client.1.smithi191.stdout:6/406: unlink d2/de/d2a/d2d/f7f 0 2024-09-19T09:35:01.831 INFO:tasks.workunit.client.1.smithi191.stdout:1/494: dread d3/d9/da/d1e/d25/f30 [0,4194304] 0 2024-09-19T09:35:01.832 INFO:tasks.workunit.client.1.smithi191.stdout:5/483: link d0/d4/d9/f9b d0/d77/fad 0 2024-09-19T09:35:01.832 INFO:tasks.workunit.client.1.smithi191.stdout:5/484: dread - d0/d4/d9/d1d/d22/d5c/f8d zero size 2024-09-19T09:35:01.832 INFO:tasks.workunit.client.1.smithi191.stdout:5/485: write d0/d4/d9/d1d/d29/d33/f38 [1970474,89148] 0 2024-09-19T09:35:01.832 INFO:tasks.workunit.client.1.smithi191.stdout:5/486: chown d0/d4/d9/de/f47 51 1 2024-09-19T09:35:01.832 INFO:tasks.workunit.client.1.smithi191.stdout:7/459: dread d2/d2a/f31 [0,4194304] 0 2024-09-19T09:35:01.832 INFO:tasks.workunit.client.1.smithi191.stdout:8/578: dwrite d1/d16/d3c/d28/fa0 [0,4194304] 0 2024-09-19T09:35:01.833 INFO:tasks.workunit.client.1.smithi191.stdout:8/579: chown d1/d4f/c8d 1 1 2024-09-19T09:35:01.833 INFO:tasks.workunit.client.1.smithi191.stdout:1/495: mkdir d3/d9/da/d1e/d32/d53/d57/d6d/da1/db5 0 2024-09-19T09:35:01.837 INFO:tasks.workunit.client.1.smithi191.stdout:1/496: link d3/d9/da/d1e/d32/f3e d3/d9/da/d7e/fb6 0 2024-09-19T09:35:01.838 INFO:tasks.workunit.client.1.smithi191.stdout:1/497: truncate d3/d9/da/f3b 4678802 0 2024-09-19T09:35:01.841 INFO:tasks.workunit.client.1.smithi191.stdout:1/498: symlink d3/d9/da/d1e/d32/d53/lb7 0 2024-09-19T09:35:01.844 INFO:tasks.workunit.client.1.smithi191.stdout:6/407: dread d2/de/d2a/d2d/d30/f3f [0,4194304] 0 2024-09-19T09:35:01.844 INFO:tasks.workunit.client.1.smithi191.stdout:6/408: truncate d2/de/d2a/d84/f86 766981 0 2024-09-19T09:35:01.844 INFO:tasks.workunit.client.1.smithi191.stdout:6/409: chown d2/de/l2e 649856 1 2024-09-19T09:35:01.845 INFO:tasks.workunit.client.1.smithi191.stdout:0/555: dread d0/d6f/d7b/f6b [0,4194304] 0 2024-09-19T09:35:01.845 INFO:tasks.workunit.client.1.smithi191.stdout:2/461: dwrite d8/db/d13/d23/f29 [4194304,4194304] 0 2024-09-19T09:35:01.846 INFO:tasks.workunit.client.1.smithi191.stdout:1/499: dread d3/d9/da/d1e/d32/d53/d57/d6d/f75 [0,4194304] 0 2024-09-19T09:35:01.846 INFO:tasks.workunit.client.1.smithi191.stdout:6/410: getdents d2/de/d19/d5d 0 2024-09-19T09:35:01.847 INFO:tasks.workunit.client.1.smithi191.stdout:0/556: mknod d0/d9/d1c/d20/d73/cb6 0 2024-09-19T09:35:01.848 INFO:tasks.workunit.client.1.smithi191.stdout:2/462: symlink d8/db/l9b 0 2024-09-19T09:35:01.848 INFO:tasks.workunit.client.1.smithi191.stdout:2/463: chown d8/db/d13/d23/f7f 79447027 1 2024-09-19T09:35:01.848 INFO:tasks.workunit.client.1.smithi191.stdout:1/500: creat d3/d9/da/d1e/d32/d6f/fb8 x:0 0 0 2024-09-19T09:35:01.849 INFO:tasks.workunit.client.1.smithi191.stdout:2/464: creat d8/f9c x:0 0 0 2024-09-19T09:35:01.849 INFO:tasks.workunit.client.1.smithi191.stdout:2/465: chown d8/db/d13/d23/l33 80208232 1 2024-09-19T09:35:01.849 INFO:tasks.workunit.client.1.smithi191.stdout:2/466: truncate d8/d11/d56/f8c 282607 0 2024-09-19T09:35:01.850 INFO:tasks.workunit.client.1.smithi191.stdout:2/467: symlink d8/d11/d56/l9d 0 2024-09-19T09:35:01.851 INFO:tasks.workunit.client.1.smithi191.stdout:2/468: creat d8/f9e x:0 0 0 2024-09-19T09:35:01.853 INFO:tasks.workunit.client.1.smithi191.stdout:2/469: getdents d8/db/d13/d35/d70 0 2024-09-19T09:35:01.854 INFO:tasks.workunit.client.1.smithi191.stdout:5/487: write d0/d4/d4a/f5f [4110128,104997] 0 2024-09-19T09:35:01.856 INFO:tasks.workunit.client.1.smithi191.stdout:9/465: dwrite d3/db/d16/d17/d81/f8e [0,4194304] 0 2024-09-19T09:35:01.856 INFO:tasks.workunit.client.1.smithi191.stdout:2/470: unlink d8/d11/d3f/d8a/l8b 0 2024-09-19T09:35:01.856 INFO:tasks.workunit.client.1.smithi191.stdout:2/471: chown d8/la 3360021 1 2024-09-19T09:35:01.861 INFO:tasks.workunit.client.1.smithi191.stdout:5/488: mkdir d0/d4/dae 0 2024-09-19T09:35:01.861 INFO:tasks.workunit.client.1.smithi191.stdout:6/411: dread d2/f63 [0,4194304] 0 2024-09-19T09:35:01.867 INFO:tasks.workunit.client.1.smithi191.stdout:2/472: symlink d8/db/d13/d35/l9f 0 2024-09-19T09:35:01.868 INFO:tasks.workunit.client.1.smithi191.stdout:5/489: unlink d0/d4/d9/ca6 0 2024-09-19T09:35:01.869 INFO:tasks.workunit.client.1.smithi191.stdout:9/466: dread d3/d8/f13 [0,4194304] 0 2024-09-19T09:35:01.869 INFO:tasks.workunit.client.1.smithi191.stdout:7/460: dwrite d2/d2a/d38/f83 [0,4194304] 0 2024-09-19T09:35:01.869 INFO:tasks.workunit.client.1.smithi191.stdout:6/412: unlink d2/de/d2a/d2d/l45 0 2024-09-19T09:35:01.871 INFO:tasks.workunit.client.1.smithi191.stdout:2/473: unlink d8/db/d13/d23/f7f 0 2024-09-19T09:35:01.873 INFO:tasks.workunit.client.1.smithi191.stdout:9/467: mkdir d3/db/d53/da2 0 2024-09-19T09:35:01.873 INFO:tasks.workunit.client.1.smithi191.stdout:5/490: dread d0/d4/d9/de/f36 [0,4194304] 0 2024-09-19T09:35:01.881 INFO:tasks.workunit.client.1.smithi191.stdout:1/501: dwrite d3/d9/da/d1e/d32/f74 [0,4194304] 0 2024-09-19T09:35:01.883 INFO:tasks.workunit.client.1.smithi191.stdout:6/413: unlink d2/de/d15/l5e 0 2024-09-19T09:35:01.883 INFO:tasks.workunit.client.1.smithi191.stdout:0/557: dwrite d0/d6f/d76/f8c [0,4194304] 0 2024-09-19T09:35:01.884 INFO:tasks.workunit.client.1.smithi191.stdout:9/468: truncate d3/db/d16/d47/d55/f6d 3498668 0 2024-09-19T09:35:01.886 INFO:tasks.workunit.client.1.smithi191.stdout:8/580: truncate d1/d16/d3c/d28/fa0 2619071 0 2024-09-19T09:35:01.887 INFO:tasks.workunit.client.1.smithi191.stdout:1/502: symlink d3/d9/da/d8c/lb9 0 2024-09-19T09:35:01.888 INFO:tasks.workunit.client.1.smithi191.stdout:5/491: dwrite d0/d4/d4a/f69 [0,4194304] 0 2024-09-19T09:35:01.892 INFO:tasks.workunit.client.1.smithi191.stdout:0/558: creat d0/d9/d1c/d1f/d24/d39/d8b/fb7 x:0 0 0 2024-09-19T09:35:01.894 INFO:tasks.workunit.client.1.smithi191.stdout:9/469: symlink d3/d60/d78/la3 0 2024-09-19T09:35:01.894 INFO:tasks.workunit.client.1.smithi191.stdout:9/470: creat d3/db/d16/d17/d3c/fa4 x:0 0 0 2024-09-19T09:35:01.894 INFO:tasks.workunit.client.1.smithi191.stdout:9/471: fsync d3/db/d16/f7e 0 2024-09-19T09:35:01.894 INFO:tasks.workunit.client.1.smithi191.stdout:9/472: write d3/db/d16/d17/d81/f8a [172284,56961] 0 2024-09-19T09:35:01.894 INFO:tasks.workunit.client.1.smithi191.stdout:7/461: dwrite d2/d2a/d38/f83 [0,4194304] 0 2024-09-19T09:35:01.895 INFO:tasks.workunit.client.1.smithi191.stdout:1/503: creat d3/d9/da/d1e/fba x:0 0 0 2024-09-19T09:35:01.898 INFO:tasks.workunit.client.1.smithi191.stdout:5/492: rmdir d0/d4/d9/d1d/d22/d5c 39 2024-09-19T09:35:01.899 INFO:tasks.workunit.client.1.smithi191.stdout:8/581: dread d1/d16/d2e/f38 [0,4194304] 0 2024-09-19T09:35:01.901 INFO:tasks.workunit.client.1.smithi191.stdout:7/462: mknod d2/d2a/d38/ca0 0 2024-09-19T09:35:01.903 INFO:tasks.workunit.client.1.smithi191.stdout:1/504: symlink d3/d9/da/d42/d8a/lbb 0 2024-09-19T09:35:01.903 INFO:tasks.workunit.client.1.smithi191.stdout:1/505: creat d3/d9/d73/d94/fbc x:0 0 0 2024-09-19T09:35:01.903 INFO:tasks.workunit.client.1.smithi191.stdout:6/414: dwrite d2/de/f27 [0,4194304] 0 2024-09-19T09:35:01.905 INFO:tasks.workunit.client.1.smithi191.stdout:5/493: rmdir d0/d4/d9/d1d/d29/d33/d45 39 2024-09-19T09:35:01.905 INFO:tasks.workunit.client.1.smithi191.stdout:5/494: chown d0/d4/d9/d1d/d29/d33/d45/d64/c9e 5935165 1 2024-09-19T09:35:01.905 INFO:tasks.workunit.client.1.smithi191.stdout:5/495: read d0/d4/d4a/f5f [2236170,128947] 0 2024-09-19T09:35:01.906 INFO:tasks.workunit.client.1.smithi191.stdout:8/582: creat d1/d4f/d6b/da9/fbb x:0 0 0 2024-09-19T09:35:01.906 INFO:tasks.workunit.client.1.smithi191.stdout:8/583: getdents d1/d16/d2e/d57 0 2024-09-19T09:35:01.907 INFO:tasks.workunit.client.1.smithi191.stdout:7/463: mknod d2/d2a/d4f/d78/ca1 0 2024-09-19T09:35:01.907 INFO:tasks.workunit.client.1.smithi191.stdout:7/464: fdatasync d2/d2a/d4f/f76 0 2024-09-19T09:35:01.912 INFO:tasks.workunit.client.1.smithi191.stdout:0/559: write d0/d6f/d76/f88 [1031977,71721] 0 2024-09-19T09:35:01.912 INFO:tasks.workunit.client.1.smithi191.stdout:0/560: dread - d0/d9/d1c/d1f/d24/d39/f95 zero size 2024-09-19T09:35:01.912 INFO:tasks.workunit.client.1.smithi191.stdout:8/584: read d1/d16/d23/d3e/f71 [2427585,124170] 0 2024-09-19T09:35:01.914 INFO:tasks.workunit.client.1.smithi191.stdout:7/465: truncate d2/f75 2063293 0 2024-09-19T09:35:01.914 INFO:tasks.workunit.client.1.smithi191.stdout:7/466: chown d2/f67 634853 1 2024-09-19T09:35:01.915 INFO:tasks.workunit.client.1.smithi191.stdout:0/561: getdents d0/d9/d1c/d1f/d24/d39/d58/d6c 0 2024-09-19T09:35:01.916 INFO:tasks.workunit.client.1.smithi191.stdout:6/415: read d2/de/d19/d1e/f21 [1843734,106504] 0 2024-09-19T09:35:01.916 INFO:tasks.workunit.client.1.smithi191.stdout:6/416: write d2/de/f1d [1553267,100179] 0 2024-09-19T09:35:01.971 INFO:tasks.workunit.client.1.smithi191.stdout:7/467: rmdir d2/d39 39 2024-09-19T09:35:01.972 INFO:tasks.workunit.client.1.smithi191.stdout:9/473: dwrite d3/db/d16/d47/d55/f1d [0,4194304] 0 2024-09-19T09:35:01.972 INFO:tasks.workunit.client.1.smithi191.stdout:0/562: rmdir d0/d9/de 39 2024-09-19T09:35:01.973 INFO:tasks.workunit.client.1.smithi191.stdout:0/563: write d0/d9/d1c/d1f/d24/d29/f44 [647532,94496] 0 2024-09-19T09:35:01.973 INFO:tasks.workunit.client.1.smithi191.stdout:7/468: mkdir d2/d2a/d38/d63/da2 0 2024-09-19T09:35:01.977 INFO:tasks.workunit.client.1.smithi191.stdout:9/474: creat d3/db/d16/d47/d93/fa5 x:0 0 0 2024-09-19T09:35:01.977 INFO:tasks.workunit.client.1.smithi191.stdout:9/475: write d3/db/d16/d38/f5f [709265,44898] 0 2024-09-19T09:35:01.978 INFO:tasks.workunit.client.1.smithi191.stdout:0/564: creat d0/d9/fb8 x:0 0 0 2024-09-19T09:35:01.978 INFO:tasks.workunit.client.1.smithi191.stdout:0/565: fdatasync d0/d9/de/f10 0 2024-09-19T09:35:01.983 INFO:tasks.workunit.client.1.smithi191.stdout:7/469: write d2/d2a/d38/f42 [343162,64298] 0 2024-09-19T09:35:01.990 INFO:tasks.workunit.client.1.smithi191.stdout:3/436: sync 2024-09-19T09:35:01.990 INFO:tasks.workunit.client.1.smithi191.stdout:3/437: creat d12/d13/d1a/d1b/d60/f9e x:0 0 0 2024-09-19T09:35:01.990 INFO:tasks.workunit.client.1.smithi191.stdout:3/438: write f11 [2486296,109908] 0 2024-09-19T09:35:01.991 INFO:tasks.workunit.client.1.smithi191.stdout:7/470: dread d2/f23 [0,4194304] 0 2024-09-19T09:35:01.991 INFO:tasks.workunit.client.1.smithi191.stdout:7/471: write d2/d2a/d4f/d59/d81/f9b [808868,479] 0 2024-09-19T09:35:01.991 INFO:tasks.workunit.client.1.smithi191.stdout:7/472: write d2/d39/f4b [7600,105415] 0 2024-09-19T09:35:01.991 INFO:tasks.workunit.client.1.smithi191.stdout:7/473: chown d2/d2a/d38/f83 53942148 1 2024-09-19T09:35:01.992 INFO:tasks.workunit.client.1.smithi191.stdout:7/474: readlink d2/l6c 0 2024-09-19T09:35:01.992 INFO:tasks.workunit.client.1.smithi191.stdout:3/439: symlink d12/d37/l9f 0 2024-09-19T09:35:01.993 INFO:tasks.workunit.client.1.smithi191.stdout:3/440: mkdir d12/d37/d51/d62/d85/da0 0 2024-09-19T09:35:01.994 INFO:tasks.workunit.client.1.smithi191.stdout:3/441: dread d12/d13/d1a/d1b/d60/f8d [0,4194304] 0 2024-09-19T09:35:01.994 INFO:tasks.workunit.client.1.smithi191.stdout:3/442: chown d12/d37/d51/d62/d85 1117902 1 2024-09-19T09:35:01.994 INFO:tasks.workunit.client.1.smithi191.stdout:3/443: stat d12/d13/d1a/d1b/d3c/d3f/f83 0 2024-09-19T09:35:01.994 INFO:tasks.workunit.client.1.smithi191.stdout:3/444: chown d12/d13/c26 27477 1 2024-09-19T09:35:01.995 INFO:tasks.workunit.client.1.smithi191.stdout:3/445: link d12/d37/d51/d62/d86/c8b d12/d37/d51/d62/ca1 0 2024-09-19T09:35:02.000 INFO:tasks.workunit.client.1.smithi191.stdout:1/506: dwrite d3/d9/f5d [4194304,4194304] 0 2024-09-19T09:35:02.001 INFO:tasks.workunit.client.1.smithi191.stdout:1/507: write d3/d9/da/d92/fb1 [117525,109757] 0 2024-09-19T09:35:02.001 INFO:tasks.workunit.client.1.smithi191.stdout:1/508: write d3/d9/da/d8c/f90 [147758,125816] 0 2024-09-19T09:35:02.001 INFO:tasks.workunit.client.1.smithi191.stdout:1/509: mkdir d3/dbd 0 2024-09-19T09:35:02.001 INFO:tasks.workunit.client.1.smithi191.stdout:1/510: getdents d3/d9/da/d1e/d25/d70 0 2024-09-19T09:35:02.001 INFO:tasks.workunit.client.1.smithi191.stdout:1/511: creat d3/d9/fbe x:0 0 0 2024-09-19T09:35:02.001 INFO:tasks.workunit.client.1.smithi191.stdout:1/512: write d3/d9/da/d7e/fac [510926,116448] 0 2024-09-19T09:35:02.002 INFO:tasks.workunit.client.1.smithi191.stdout:1/513: creat d3/d9/da/d1e/d25/d70/da0/fbf x:0 0 0 2024-09-19T09:35:02.002 INFO:tasks.workunit.client.1.smithi191.stdout:1/514: fsync d3/d9/da/db/d48/f61 0 2024-09-19T09:35:02.015 INFO:tasks.workunit.client.1.smithi191.stdout:6/417: dwrite d2/de/d19/d1e/d64/f29 [0,4194304] 0 2024-09-19T09:35:02.027 INFO:tasks.workunit.client.1.smithi191.stdout:8/585: dwrite d1/d16/d2e/f38 [0,4194304] 0 2024-09-19T09:35:02.028 INFO:tasks.workunit.client.1.smithi191.stdout:8/586: mkdir d1/d16/d3c/d17/da1/d84/dbc 0 2024-09-19T09:35:02.029 INFO:tasks.workunit.client.1.smithi191.stdout:6/418: dread d2/de/d2a/f4b [0,4194304] 0 2024-09-19T09:35:02.029 INFO:tasks.workunit.client.1.smithi191.stdout:8/587: creat d1/d4f/d6b/fbd x:0 0 0 2024-09-19T09:35:02.029 INFO:tasks.workunit.client.1.smithi191.stdout:8/588: fdatasync d1/d7/d1a/d6d/fad 0 2024-09-19T09:35:02.030 INFO:tasks.workunit.client.1.smithi191.stdout:6/419: mkdir d2/de/d19/d1e/d64/d76/d88/d65/d89 0 2024-09-19T09:35:02.030 INFO:tasks.workunit.client.1.smithi191.stdout:6/420: stat d2/de/d15/l2b 0 2024-09-19T09:35:02.036 INFO:tasks.workunit.client.1.smithi191.stdout:9/476: dwrite d3/db/d16/d17/d81/f8e [0,4194304] 0 2024-09-19T09:35:02.036 INFO:tasks.workunit.client.1.smithi191.stdout:7/475: dwrite d2/d2a/d38/d63/f97 [0,4194304] 0 2024-09-19T09:35:02.036 INFO:tasks.workunit.client.1.smithi191.stdout:0/566: dwrite d0/d9/d1c/d1f/d24/f4b [0,4194304] 0 2024-09-19T09:35:02.036 INFO:tasks.workunit.client.1.smithi191.stdout:3/446: dwrite d12/d13/d1a/d1b/d2e/f5b [0,4194304] 0 2024-09-19T09:35:02.036 INFO:tasks.workunit.client.1.smithi191.stdout:3/447: chown d12/d37/d51/d62/d86 2581877 1 2024-09-19T09:35:02.036 INFO:tasks.workunit.client.1.smithi191.stdout:5/496: dwrite d0/d4/d9/de/f8f [0,4194304] 0 2024-09-19T09:35:02.039 INFO:tasks.workunit.client.1.smithi191.stdout:9/477: mkdir d3/db/d16/d17/d81/da6 0 2024-09-19T09:35:02.039 INFO:tasks.workunit.client.1.smithi191.stdout:9/478: creat d3/db/d16/fa7 x:0 0 0 2024-09-19T09:35:02.044 INFO:tasks.workunit.client.1.smithi191.stdout:1/515: dwrite d3/d9/da/db/d48/f9a [0,4194304] 0 2024-09-19T09:35:02.044 INFO:tasks.workunit.client.1.smithi191.stdout:8/589: dread d1/d16/d3c/d28/d79/f7f [4194304,4194304] 0 2024-09-19T09:35:02.044 INFO:tasks.workunit.client.1.smithi191.stdout:1/516: creat d3/d9/fc0 x:0 0 0 2024-09-19T09:35:02.044 INFO:tasks.workunit.client.1.smithi191.stdout:0/567: rename d0/d9/d1c/d1f/d24/d39/d58/f40 to d0/d9/de/d81/fb9 0 2024-09-19T09:35:02.045 INFO:tasks.workunit.client.1.smithi191.stdout:9/479: dread d3/d60/d78/f7b [0,4194304] 0 2024-09-19T09:35:02.047 INFO:tasks.workunit.client.1.smithi191.stdout:3/448: getdents d12/d13/d1a 0 2024-09-19T09:35:02.047 INFO:tasks.workunit.client.1.smithi191.stdout:3/449: chown d12/d43 4055846 1 2024-09-19T09:35:02.053 INFO:tasks.workunit.client.1.smithi191.stdout:6/421: dwrite d2/de/f69 [0,4194304] 0 2024-09-19T09:35:02.054 INFO:tasks.workunit.client.1.smithi191.stdout:7/476: dwrite d2/d2a/d4f/d59/d81/f9b [0,4194304] 0 2024-09-19T09:35:02.056 INFO:tasks.workunit.client.1.smithi191.stdout:5/497: mkdir d0/d4/d4a/daf 0 2024-09-19T09:35:02.057 INFO:tasks.workunit.client.1.smithi191.stdout:5/498: read d0/d77/fad [1225,130082] 0 2024-09-19T09:35:02.057 INFO:tasks.workunit.client.1.smithi191.stdout:5/499: dread - d0/d4/d9/d1d/d22/d5c/f8d zero size 2024-09-19T09:35:02.060 INFO:tasks.workunit.client.1.smithi191.stdout:8/590: mkdir d1/d4f/d6b/d83/dab/dbe 0 2024-09-19T09:35:02.061 INFO:tasks.workunit.client.1.smithi191.stdout:1/517: creat d3/d9/da/d8c/fc1 x:0 0 0 2024-09-19T09:35:02.061 INFO:tasks.workunit.client.1.smithi191.stdout:1/518: creat d3/d9/fc2 x:0 0 0 2024-09-19T09:35:02.061 INFO:tasks.workunit.client.1.smithi191.stdout:1/519: chown d3/d9/da/d42/l81 2 1 2024-09-19T09:35:02.062 INFO:tasks.workunit.client.1.smithi191.stdout:1/520: chown d3/d9/da/db/d48/f65 2262423 1 2024-09-19T09:35:02.062 INFO:tasks.workunit.client.1.smithi191.stdout:0/568: creat d0/d9/d1c/d1f/d24/d53/fba x:0 0 0 2024-09-19T09:35:02.063 INFO:tasks.workunit.client.1.smithi191.stdout:9/480: link d3/db/l87 d3/db/d16/d47/d93/la8 0 2024-09-19T09:35:02.063 INFO:tasks.workunit.client.1.smithi191.stdout:9/481: chown d3/db/d16/d47/d55/f6d 603859 1 2024-09-19T09:35:02.065 INFO:tasks.workunit.client.1.smithi191.stdout:7/477: dread d2/f9 [0,4194304] 0 2024-09-19T09:35:02.065 INFO:tasks.workunit.client.1.smithi191.stdout:3/450: symlink d12/d37/d3d/d91/la2 0 2024-09-19T09:35:02.068 INFO:tasks.workunit.client.1.smithi191.stdout:6/422: rename d2/de/d2a/d2d/d30/c4f to d2/de/d2a/d2d/d30/c8a 0 2024-09-19T09:35:02.068 INFO:tasks.workunit.client.1.smithi191.stdout:6/423: dread - d2/de/d19/d1e/d64/f6d zero size 2024-09-19T09:35:02.071 INFO:tasks.workunit.client.1.smithi191.stdout:9/482: dread d3/db/d16/d47/d55/f5e [0,4194304] 0 2024-09-19T09:35:02.071 INFO:tasks.workunit.client.1.smithi191.stdout:5/500: rename d0/d4/d9/d1d/d22/f5d to d0/d4/dae/fb0 0 2024-09-19T09:35:02.073 INFO:tasks.workunit.client.1.smithi191.stdout:1/521: mkdir d3/d9/da/d1e/d32/d6f/db2/dc3 0 2024-09-19T09:35:02.074 INFO:tasks.workunit.client.1.smithi191.stdout:0/569: unlink d0/d9/d1c/d1f/d24/d39/d7a/c84 0 2024-09-19T09:35:02.075 INFO:tasks.workunit.client.1.smithi191.stdout:7/478: mknod d2/d2a/d4f/ca3 0 2024-09-19T09:35:02.075 INFO:tasks.workunit.client.1.smithi191.stdout:7/479: readlink d2/d2a/d4f/d59/d81/l93 0 2024-09-19T09:35:02.076 INFO:tasks.workunit.client.1.smithi191.stdout:4/520: sync 2024-09-19T09:35:02.076 INFO:tasks.workunit.client.1.smithi191.stdout:2/474: sync 2024-09-19T09:35:02.076 INFO:tasks.workunit.client.1.smithi191.stdout:2/475: write d8/d11/f46 [8735446,9507] 0 2024-09-19T09:35:02.076 INFO:tasks.workunit.client.1.smithi191.stdout:3/451: truncate f11 1188005 0 2024-09-19T09:35:02.078 INFO:tasks.workunit.client.1.smithi191.stdout:1/522: write d3/d9/da/d1e/d25/f30 [3096443,82840] 0 2024-09-19T09:35:02.078 INFO:tasks.workunit.client.1.smithi191.stdout:1/523: dread - d3/d9/f9c zero size 2024-09-19T09:35:02.078 INFO:tasks.workunit.client.1.smithi191.stdout:6/424: dread d2/de/d2a/d2d/d30/f3f [4194304,4194304] 0 2024-09-19T09:35:02.078 INFO:tasks.workunit.client.1.smithi191.stdout:5/501: rename d0/da7/fac to d0/d4/d9/d1d/d29/d33/d45/fb1 0 2024-09-19T09:35:02.079 INFO:tasks.workunit.client.1.smithi191.stdout:8/591: dwrite d1/f5e [0,4194304] 0 2024-09-19T09:35:02.079 INFO:tasks.workunit.client.1.smithi191.stdout:8/592: chown d1/d22 8313692 1 2024-09-19T09:35:02.079 INFO:tasks.workunit.client.1.smithi191.stdout:7/480: write d2/d2a/d4f/d59/f88 [124972,93772] 0 2024-09-19T09:35:02.081 INFO:tasks.workunit.client.1.smithi191.stdout:4/521: mknod d5/d1b/d1c/d2f/d37/cb3 0 2024-09-19T09:35:02.082 INFO:tasks.workunit.client.1.smithi191.stdout:2/476: rmdir d8/d11/d56 39 2024-09-19T09:35:02.084 INFO:tasks.workunit.client.1.smithi191.stdout:3/452: symlink d12/d37/d51/d62/d85/da0/la3 0 2024-09-19T09:35:02.084 INFO:tasks.workunit.client.1.smithi191.stdout:3/453: chown d12/d13/f3b 24842432 1 2024-09-19T09:35:02.086 INFO:tasks.workunit.client.1.smithi191.stdout:6/425: dread d2/de/f10 [0,4194304] 0 2024-09-19T09:35:02.086 INFO:tasks.workunit.client.1.smithi191.stdout:1/524: mknod d3/d9/da/d1e/d32/d53/d57/d6d/da1/db5/cc4 0 2024-09-19T09:35:02.089 INFO:tasks.workunit.client.1.smithi191.stdout:7/481: symlink d2/d2a/d4f/d59/la4 0 2024-09-19T09:35:02.090 INFO:tasks.workunit.client.1.smithi191.stdout:0/570: dread d0/d9/d1c/d20/f37 [0,4194304] 0 2024-09-19T09:35:02.092 INFO:tasks.workunit.client.1.smithi191.stdout:2/477: mknod d8/d11/ca0 0 2024-09-19T09:35:02.093 INFO:tasks.workunit.client.1.smithi191.stdout:3/454: symlink d12/d37/d3d/la4 0 2024-09-19T09:35:02.095 INFO:tasks.workunit.client.1.smithi191.stdout:1/525: unlink d3/d9/da/d1e/d25/f30 0 2024-09-19T09:35:02.095 INFO:tasks.workunit.client.1.smithi191.stdout:7/482: write d2/d2a/d79/f98 [360187,34475] 0 2024-09-19T09:35:02.095 INFO:tasks.workunit.client.1.smithi191.stdout:1/526: creat d3/d9/da/d92/fc5 x:0 0 0 2024-09-19T09:35:02.095 INFO:tasks.workunit.client.1.smithi191.stdout:3/455: chown d12/d13/d1a/d1b/c22 1 1 2024-09-19T09:35:02.095 INFO:tasks.workunit.client.1.smithi191.stdout:3/456: write d12/d37/d64/d73/f7d [539819,98739] 0 2024-09-19T09:35:02.097 INFO:tasks.workunit.client.1.smithi191.stdout:6/426: dread d2/de/d19/d1e/d64/f56 [0,4194304] 0 2024-09-19T09:35:02.097 INFO:tasks.workunit.client.1.smithi191.stdout:6/427: write d2/de/d19/d1e/d64/f2c [1483518,46606] 0 2024-09-19T09:35:02.098 INFO:tasks.workunit.client.1.smithi191.stdout:6/428: getdents d2/de 0 2024-09-19T09:35:02.098 INFO:tasks.workunit.client.1.smithi191.stdout:3/457: creat d12/d37/fa5 x:0 0 0 2024-09-19T09:35:02.098 INFO:tasks.workunit.client.1.smithi191.stdout:3/458: write d12/d37/d64/d73/f7d [1279838,19459] 0 2024-09-19T09:35:02.103 INFO:tasks.workunit.client.1.smithi191.stdout:6/429: getdents d2/de/d2a/d39 0 2024-09-19T09:35:02.103 INFO:tasks.workunit.client.1.smithi191.stdout:6/430: chown d2/de/d19/d1e/d64/d76/d88/f68 466165 1 2024-09-19T09:35:02.103 INFO:tasks.workunit.client.1.smithi191.stdout:6/431: dread - d2/de/d15/f74 zero size 2024-09-19T09:35:02.106 INFO:tasks.workunit.client.1.smithi191.stdout:0/571: write d0/f8 [3696541,90472] 0 2024-09-19T09:35:02.106 INFO:tasks.workunit.client.1.smithi191.stdout:0/572: write d0/d9/d1c/d1f/d24/d29/f49 [146459,38930] 0 2024-09-19T09:35:02.107 INFO:tasks.workunit.client.1.smithi191.stdout:7/483: read d2/f23 [606444,119371] 0 2024-09-19T09:35:02.114 INFO:tasks.workunit.client.1.smithi191.stdout:0/573: rename d0/d9/d1c/d1f/da9 to d0/d9/d1c/d20/d73/dbb 0 2024-09-19T09:35:02.114 INFO:tasks.workunit.client.1.smithi191.stdout:0/574: dread - d0/fb4 zero size 2024-09-19T09:35:02.115 INFO:tasks.workunit.client.1.smithi191.stdout:0/575: chown d0/d9/c42 4 1 2024-09-19T09:35:02.120 INFO:tasks.workunit.client.1.smithi191.stdout:0/576: rmdir d0/d9/d1c/d1f/d24 39 2024-09-19T09:35:02.121 INFO:tasks.workunit.client.1.smithi191.stdout:0/577: mkdir d0/d9/d1c/d1f/d24/dbc 0 2024-09-19T09:35:02.122 INFO:tasks.workunit.client.1.smithi191.stdout:0/578: unlink d0/d9/d1c/d1f/d24/c4e 0 2024-09-19T09:35:02.124 INFO:tasks.workunit.client.1.smithi191.stdout:6/432: dread d2/de/f16 [4194304,4194304] 0 2024-09-19T09:35:02.126 INFO:tasks.workunit.client.1.smithi191.stdout:6/433: creat d2/de/d19/f8b x:0 0 0 2024-09-19T09:35:02.136 INFO:tasks.workunit.client.1.smithi191.stdout:9/483: dwrite d3/db/d16/f2a [0,4194304] 0 2024-09-19T09:35:02.136 INFO:tasks.workunit.client.1.smithi191.stdout:9/484: truncate d3/d60/d78/f96 258145 0 2024-09-19T09:35:02.136 INFO:tasks.workunit.client.1.smithi191.stdout:9/485: readlink d3/db/l33 0 2024-09-19T09:35:02.136 INFO:tasks.workunit.client.1.smithi191.stdout:5/502: dwrite d0/d4/d9/f9f [0,4194304] 0 2024-09-19T09:35:02.136 INFO:tasks.workunit.client.1.smithi191.stdout:5/503: fsync d0/d1f/f8e 0 2024-09-19T09:35:02.137 INFO:tasks.workunit.client.1.smithi191.stdout:9/486: truncate d3/db/d16/d17/f70 3527149 0 2024-09-19T09:35:02.139 INFO:tasks.workunit.client.1.smithi191.stdout:2/478: dwrite d8/d11/d56/f92 [0,4194304] 0 2024-09-19T09:35:02.139 INFO:tasks.workunit.client.1.smithi191.stdout:8/593: dwrite d1/d16/d3c/d17/da1/d84/f9b [0,4194304] 0 2024-09-19T09:35:02.139 INFO:tasks.workunit.client.1.smithi191.stdout:7/484: dwrite d2/f34 [4194304,4194304] 0 2024-09-19T09:35:02.141 INFO:tasks.workunit.client.1.smithi191.stdout:9/487: symlink d3/db/d16/d17/d5b/la9 0 2024-09-19T09:35:02.141 INFO:tasks.workunit.client.1.smithi191.stdout:9/488: fsync d3/fe 0 2024-09-19T09:35:02.141 INFO:tasks.workunit.client.1.smithi191.stdout:9/489: fsync d3/db/d16/f43 0 2024-09-19T09:35:02.144 INFO:tasks.workunit.client.1.smithi191.stdout:8/594: symlink d1/d7/d1a/lbf 0 2024-09-19T09:35:02.146 INFO:tasks.workunit.client.1.smithi191.stdout:8/595: creat d1/d16/d3c/d17/da1/fc0 x:0 0 0 2024-09-19T09:35:02.146 INFO:tasks.workunit.client.1.smithi191.stdout:8/596: stat d1/d7/fb8 0 2024-09-19T09:35:02.147 INFO:tasks.workunit.client.1.smithi191.stdout:1/527: dwrite d3/d9/da/d1e/d32/d53/f2c [0,4194304] 0 2024-09-19T09:35:02.150 INFO:tasks.workunit.client.1.smithi191.stdout:4/522: dwrite d5/d1b/d1c/d24/d32/d21/d92/fa8 [0,4194304] 0 2024-09-19T09:35:02.150 INFO:tasks.workunit.client.1.smithi191.stdout:4/523: creat d5/d1b/d1c/d24/d32/d21/d5c/fb4 x:0 0 0 2024-09-19T09:35:02.150 INFO:tasks.workunit.client.1.smithi191.stdout:4/524: write d5/d1b/d1c/d24/d32/d21/d27/f53 [509576,111783] 0 2024-09-19T09:35:02.150 INFO:tasks.workunit.client.1.smithi191.stdout:4/525: dread - d5/d1b/d1c/d2f/d37/d59/fa0 zero size 2024-09-19T09:35:02.150 INFO:tasks.workunit.client.1.smithi191.stdout:4/526: chown d5/d38/l49 4465613 1 2024-09-19T09:35:02.151 INFO:tasks.workunit.client.1.smithi191.stdout:0/579: dwrite d0/d9/d1c/d1f/d24/d29/d30/f91 [4194304,4194304] 0 2024-09-19T09:35:02.151 INFO:tasks.workunit.client.1.smithi191.stdout:6/434: dwrite d2/de/d15/f36 [0,4194304] 0 2024-09-19T09:35:02.156 INFO:tasks.workunit.client.1.smithi191.stdout:4/527: truncate d5/d1b/f67 506150 0 2024-09-19T09:35:02.159 INFO:tasks.workunit.client.1.smithi191.stdout:1/528: creat d3/d9/da/d1e/d32/d53/fc6 x:0 0 0 2024-09-19T09:35:02.162 INFO:tasks.workunit.client.1.smithi191.stdout:0/580: creat d0/d9/d1c/d1f/d24/d39/d58/d6c/fbd x:0 0 0 2024-09-19T09:35:02.163 INFO:tasks.workunit.client.1.smithi191.stdout:6/435: symlink d2/de/d19/l8c 0 2024-09-19T09:35:02.166 INFO:tasks.workunit.client.1.smithi191.stdout:4/528: creat d5/d1b/d8e/fb5 x:0 0 0 2024-09-19T09:35:02.166 INFO:tasks.workunit.client.1.smithi191.stdout:4/529: write d5/d1b/d1c/d24/d32/f1e [2799079,24172] 0 2024-09-19T09:35:02.167 INFO:tasks.workunit.client.1.smithi191.stdout:1/529: mknod d3/d9/da/d7e/cc7 0 2024-09-19T09:35:02.170 INFO:tasks.workunit.client.1.smithi191.stdout:6/436: link d2/de/d2a/d2d/d30/l87 d2/de/d2a/d39/l8d 0 2024-09-19T09:35:02.172 INFO:tasks.workunit.client.1.smithi191.stdout:4/530: rename f0 to d5/d1b/d61/fb6 0 2024-09-19T09:35:02.172 INFO:tasks.workunit.client.1.smithi191.stdout:4/531: chown d5/d1b/d1c/d24/c33 21212 1 2024-09-19T09:35:02.172 INFO:tasks.workunit.client.1.smithi191.stdout:4/532: dread - d5/d1b/d61/d88/faf zero size 2024-09-19T09:35:02.172 INFO:tasks.workunit.client.1.smithi191.stdout:4/533: creat d5/d1b/d1c/d24/d32/d21/d5c/fb7 x:0 0 0 2024-09-19T09:35:02.172 INFO:tasks.workunit.client.1.smithi191.stdout:4/534: truncate d5/d1b/d1c/d2f/d37/d59/fa0 79107 0 2024-09-19T09:35:02.172 INFO:tasks.workunit.client.1.smithi191.stdout:6/437: rmdir d2 39 2024-09-19T09:35:02.172 INFO:tasks.workunit.client.1.smithi191.stdout:6/438: read - d2/de/d19/f6e zero size 2024-09-19T09:35:02.174 INFO:tasks.workunit.client.1.smithi191.stdout:4/535: truncate d5/f6 2250326 0 2024-09-19T09:35:02.175 INFO:tasks.workunit.client.1.smithi191.stdout:4/536: truncate d5/d1b/d1c/d28/f97 1452203 0 2024-09-19T09:35:02.179 INFO:tasks.workunit.client.1.smithi191.stdout:1/530: read d3/d9/da/d1e/f31 [582873,13424] 0 2024-09-19T09:35:02.193 INFO:tasks.workunit.client.1.smithi191.stdout:4/537: write d5/d1b/d1c/d24/d32/d21/d4a/f51 [1303040,38082] 0 2024-09-19T09:35:02.194 INFO:tasks.workunit.client.1.smithi191.stdout:2/479: dwrite d8/db/d4e/f7d [0,4194304] 0 2024-09-19T09:35:02.194 INFO:tasks.workunit.client.1.smithi191.stdout:5/504: dwrite d0/d4/d9/d1d/d29/d33/f40 [0,4194304] 0 2024-09-19T09:35:02.194 INFO:tasks.workunit.client.1.smithi191.stdout:7/485: dwrite d2/d2a/d38/d63/f95 [0,4194304] 0 2024-09-19T09:35:02.195 INFO:tasks.workunit.client.1.smithi191.stdout:4/538: symlink d5/d1b/d61/lb8 0 2024-09-19T09:35:02.195 INFO:tasks.workunit.client.1.smithi191.stdout:4/539: creat d5/d1b/d1c/d24/d32/d21/d56/fb9 x:0 0 0 2024-09-19T09:35:02.195 INFO:tasks.workunit.client.1.smithi191.stdout:4/540: chown d5/d1b/d1c/d24/d32/d8f 2207594 1 2024-09-19T09:35:02.199 INFO:tasks.workunit.client.1.smithi191.stdout:2/480: rename d8/db/d41/l80 to d8/d2a/la1 0 2024-09-19T09:35:02.200 INFO:tasks.workunit.client.1.smithi191.stdout:5/505: rename d0/d4/d9/l7d to d0/d4/d4a/daf/lb2 0 2024-09-19T09:35:02.202 INFO:tasks.workunit.client.1.smithi191.stdout:5/506: creat d0/d4/d9/d1d/fb3 x:0 0 0 2024-09-19T09:35:02.202 INFO:tasks.workunit.client.1.smithi191.stdout:4/541: dread d5/d1b/d1c/d24/d32/d21/f50 [0,4194304] 0 2024-09-19T09:35:02.205 INFO:tasks.workunit.client.1.smithi191.stdout:5/507: rmdir d0/d4/d9/d1d/d29/d7f 39 2024-09-19T09:35:02.205 INFO:tasks.workunit.client.1.smithi191.stdout:5/508: chown d0/d4/d9/d1d/d29 206209592 1 2024-09-19T09:35:02.205 INFO:tasks.workunit.client.1.smithi191.stdout:9/490: dwrite d3/db/d16/f7e [0,4194304] 0 2024-09-19T09:35:02.206 INFO:tasks.workunit.client.1.smithi191.stdout:9/491: creat d3/d60/faa x:0 0 0 2024-09-19T09:35:02.206 INFO:tasks.workunit.client.1.smithi191.stdout:9/492: chown d3/db/l99 14 1 2024-09-19T09:35:02.206 INFO:tasks.workunit.client.1.smithi191.stdout:4/542: unlink d5/d1b/d1c/d28/f58 0 2024-09-19T09:35:02.206 INFO:tasks.workunit.client.1.smithi191.stdout:0/581: dwrite d0/d9/d1c/d1f/d24/f4b [4194304,4194304] 0 2024-09-19T09:35:02.206 INFO:tasks.workunit.client.1.smithi191.stdout:0/582: chown d0/d9/de/l8e 330560 1 2024-09-19T09:35:02.206 INFO:tasks.workunit.client.1.smithi191.stdout:0/583: chown d0/d9/d1c/d1f/d24/d39/d58/d6c/d86/fa5 17066403 1 2024-09-19T09:35:02.206 INFO:tasks.workunit.client.1.smithi191.stdout:0/584: chown d0/d9/de/d81/lb0 108350184 1 2024-09-19T09:35:02.206 INFO:tasks.workunit.client.1.smithi191.stdout:8/597: dwrite d1/d22/d47/f5a [0,4194304] 0 2024-09-19T09:35:02.206 INFO:tasks.workunit.client.1.smithi191.stdout:8/598: readlink d1/d16/d3c/d17/da1/l97 0 2024-09-19T09:35:02.206 INFO:tasks.workunit.client.1.smithi191.stdout:8/599: chown d1/d16/d2e/d32/f77 1 1 2024-09-19T09:35:02.207 INFO:tasks.workunit.client.1.smithi191.stdout:1/531: dwrite d3/d9/f9c [0,4194304] 0 2024-09-19T09:35:02.207 INFO:tasks.workunit.client.1.smithi191.stdout:1/532: creat d3/d9/da/d7e/fc8 x:0 0 0 2024-09-19T09:35:02.207 INFO:tasks.workunit.client.1.smithi191.stdout:5/509: mkdir d0/d4/d4a/db4 0 2024-09-19T09:35:02.209 INFO:tasks.workunit.client.1.smithi191.stdout:6/439: dwrite d2/de/d15/f78 [0,4194304] 0 2024-09-19T09:35:02.210 INFO:tasks.workunit.client.1.smithi191.stdout:7/486: dread d2/d2a/d33/f54 [0,4194304] 0 2024-09-19T09:35:02.210 INFO:tasks.workunit.client.1.smithi191.stdout:6/440: readlink d2/de/d2a/l31 0 2024-09-19T09:35:02.211 INFO:tasks.workunit.client.1.smithi191.stdout:9/493: mknod d3/db/d16/d17/cab 0 2024-09-19T09:35:02.215 INFO:tasks.workunit.client.1.smithi191.stdout:2/481: dwrite d8/d11/d3f/f22 [0,4194304] 0 2024-09-19T09:35:02.215 INFO:tasks.workunit.client.1.smithi191.stdout:2/482: chown d8/d11/d3f/f21 2689520 1 2024-09-19T09:35:02.223 INFO:tasks.workunit.client.1.smithi191.stdout:8/600: mkdir d1/d4f/d6b/da9/dc1 0 2024-09-19T09:35:02.224 INFO:tasks.workunit.client.1.smithi191.stdout:8/601: fdatasync d1/d16/d3c/d28/d79/da2/fa3 0 2024-09-19T09:35:02.226 INFO:tasks.workunit.client.1.smithi191.stdout:1/533: mkdir d3/d9/d73/d94/dc9 0 2024-09-19T09:35:02.226 INFO:tasks.workunit.client.1.smithi191.stdout:1/534: chown d3/d9/da/d1e/l27 87 1 2024-09-19T09:35:02.229 INFO:tasks.workunit.client.1.smithi191.stdout:2/483: dread d8/d11/d3f/f22 [0,4194304] 0 2024-09-19T09:35:02.234 INFO:tasks.workunit.client.1.smithi191.stdout:7/487: rename d2/d2a/f2d to d2/d2a/d4f/d59/fa5 0 2024-09-19T09:35:02.235 INFO:tasks.workunit.client.1.smithi191.stdout:7/488: creat d2/d2a/d4f/d59/fa6 x:0 0 0 2024-09-19T09:35:02.236 INFO:tasks.workunit.client.1.smithi191.stdout:9/494: truncate d3/d60/f54 875673 0 2024-09-19T09:35:02.237 INFO:tasks.workunit.client.1.smithi191.stdout:0/585: mkdir d0/d9/d1c/d1f/d24/dbe 0 2024-09-19T09:35:02.237 INFO:tasks.workunit.client.1.smithi191.stdout:0/586: write d0/d9/d1c/d1f/d24/d29/d30/f5b [133631,120018] 0 2024-09-19T09:35:02.240 INFO:tasks.workunit.client.1.smithi191.stdout:7/489: symlink d2/d2a/d4f/d78/la7 0 2024-09-19T09:35:02.242 INFO:tasks.workunit.client.1.smithi191.stdout:4/543: dwrite d5/d1b/d61/fb6 [0,4194304] 0 2024-09-19T09:35:02.242 INFO:tasks.workunit.client.1.smithi191.stdout:4/544: chown d5/f4e 16370585 1 2024-09-19T09:35:02.242 INFO:tasks.workunit.client.1.smithi191.stdout:4/545: read - d5/d1b/d1c/d24/d32/d21/d56/d86/fa7 zero size 2024-09-19T09:35:02.244 INFO:tasks.workunit.client.1.smithi191.stdout:9/495: symlink d3/db/d16/d38/d92/lac 0 2024-09-19T09:35:02.246 INFO:tasks.workunit.client.1.smithi191.stdout:0/587: unlink d0/d9/de/d81/fb9 0 2024-09-19T09:35:02.248 INFO:tasks.workunit.client.1.smithi191.stdout:4/546: symlink d5/d1b/d1c/d24/d32/d21/d5c/lba 0 2024-09-19T09:35:02.249 INFO:tasks.workunit.client.1.smithi191.stdout:6/441: dwrite d2/de/d19/d1e/f3e [0,4194304] 0 2024-09-19T09:35:02.250 INFO:tasks.workunit.client.1.smithi191.stdout:0/588: mkdir d0/d9/de/d61/dbf 0 2024-09-19T09:35:02.252 INFO:tasks.workunit.client.1.smithi191.stdout:4/547: link d5/d1b/d1c/d24/d32/d21/d56/lae d5/d1b/d1c/d24/d32/d21/d92/lbb 0 2024-09-19T09:35:02.252 INFO:tasks.workunit.client.1.smithi191.stdout:4/548: chown d5/d1b/d1c 1687432 1 2024-09-19T09:35:02.252 INFO:tasks.workunit.client.1.smithi191.stdout:5/510: dwrite d0/d4/d4a/f4b [0,4194304] 0 2024-09-19T09:35:02.254 INFO:tasks.workunit.client.1.smithi191.stdout:4/549: mkdir d5/dbc 0 2024-09-19T09:35:02.258 INFO:tasks.workunit.client.1.smithi191.stdout:4/550: rmdir d5/d1b/d1c/d24/d32/d21/d92/db2 0 2024-09-19T09:35:02.258 INFO:tasks.workunit.client.1.smithi191.stdout:4/551: creat d5/d1b/d1c/d28/fbd x:0 0 0 2024-09-19T09:35:02.261 INFO:tasks.workunit.client.1.smithi191.stdout:4/552: link d5/d1b/d61/fb6 d5/d1b/d1c/d24/d32/d8f/fbe 0 2024-09-19T09:35:02.261 INFO:tasks.workunit.client.1.smithi191.stdout:4/553: write d5/d1b/d1c/d2f/d37/d59/f9b [1187669,128900] 0 2024-09-19T09:35:02.263 INFO:tasks.workunit.client.1.smithi191.stdout:6/442: dread d2/de/d2a/d7d/f6b [0,4194304] 0 2024-09-19T09:35:02.265 INFO:tasks.workunit.client.1.smithi191.stdout:6/443: creat d2/de/d2a/f8e x:0 0 0 2024-09-19T09:35:02.265 INFO:tasks.workunit.client.1.smithi191.stdout:6/444: chown d2/de/d2a/d39/l49 16 1 2024-09-19T09:35:02.265 INFO:tasks.workunit.client.1.smithi191.stdout:6/445: stat d2/de/d15/f36 0 2024-09-19T09:35:02.266 INFO:tasks.workunit.client.1.smithi191.stdout:2/484: dwrite d8/d2a/f61 [0,4194304] 0 2024-09-19T09:35:02.268 INFO:tasks.workunit.client.1.smithi191.stdout:2/485: rename d8/db/d13/d23/c5f to d8/db/d41/ca2 0 2024-09-19T09:35:02.268 INFO:tasks.workunit.client.1.smithi191.stdout:2/486: stat d8/f44 0 2024-09-19T09:35:02.269 INFO:tasks.workunit.client.1.smithi191.stdout:5/511: dread d0/d4/d9/de/f8f [0,4194304] 0 2024-09-19T09:35:02.270 INFO:tasks.workunit.client.1.smithi191.stdout:5/512: fsync d0/d1f/f84 0 2024-09-19T09:35:02.271 INFO:tasks.workunit.client.1.smithi191.stdout:4/554: dread d5/f6 [0,4194304] 0 2024-09-19T09:35:02.271 INFO:tasks.workunit.client.1.smithi191.stdout:4/555: creat d5/d1b/d1c/d2f/d37/d59/fbf x:0 0 0 2024-09-19T09:35:02.272 INFO:tasks.workunit.client.1.smithi191.stdout:5/513: mkdir d0/d4/d4a/db5 0 2024-09-19T09:35:02.272 INFO:tasks.workunit.client.1.smithi191.stdout:8/602: dwrite d1/d7/d1a/d6d/da8/fb4 [0,4194304] 0 2024-09-19T09:35:02.272 INFO:tasks.workunit.client.1.smithi191.stdout:8/603: chown d1/d16/d3c/db0/lb5 6 1 2024-09-19T09:35:02.274 INFO:tasks.workunit.client.1.smithi191.stdout:4/556: truncate d5/d1b/d1c/d24/d32/f36 3255516 0 2024-09-19T09:35:02.276 INFO:tasks.workunit.client.1.smithi191.stdout:3/459: sync 2024-09-19T09:35:02.282 INFO:tasks.workunit.client.1.smithi191.stdout:2/487: dread d8/db/d13/d23/f20 [4194304,4194304] 0 2024-09-19T09:35:02.282 INFO:tasks.workunit.client.1.smithi191.stdout:1/535: dwrite d3/d9/da/db/f86 [0,4194304] 0 2024-09-19T09:35:02.286 INFO:tasks.workunit.client.1.smithi191.stdout:2/488: creat d8/db/d4e/fa3 x:0 0 0 2024-09-19T09:35:02.287 INFO:tasks.workunit.client.1.smithi191.stdout:4/557: dread d5/d1b/d1c/d24/d32/f5d [0,4194304] 0 2024-09-19T09:35:02.288 INFO:tasks.workunit.client.1.smithi191.stdout:6/446: dwrite d2/de/d2a/f8e [0,4194304] 0 2024-09-19T09:35:02.288 INFO:tasks.workunit.client.1.smithi191.stdout:0/589: dwrite d0/d9/d1c/d1f/d24/d39/d58/d6c/d86/fa5 [0,4194304] 0 2024-09-19T09:35:02.288 INFO:tasks.workunit.client.1.smithi191.stdout:0/590: write d0/d9/de/d61/f6a [1396116,57173] 0 2024-09-19T09:35:02.289 INFO:tasks.workunit.client.1.smithi191.stdout:7/490: dwrite d2/d2a/d38/d63/d9a/f8d [0,4194304] 0 2024-09-19T09:35:02.289 INFO:tasks.workunit.client.1.smithi191.stdout:8/604: dread d1/d7/d1a/f63 [0,4194304] 0 2024-09-19T09:35:02.289 INFO:tasks.workunit.client.1.smithi191.stdout:8/605: fsync d1/d22/f2c 0 2024-09-19T09:35:02.289 INFO:tasks.workunit.client.1.smithi191.stdout:4/558: creat d5/d38/d73/d8d/fc0 x:0 0 0 2024-09-19T09:35:02.291 INFO:tasks.workunit.client.1.smithi191.stdout:9/496: dwrite d3/db/d16/f7e [0,4194304] 0 2024-09-19T09:35:02.293 INFO:tasks.workunit.client.1.smithi191.stdout:2/489: dread d8/db/d13/f3a [0,4194304] 0 2024-09-19T09:35:02.297 INFO:tasks.workunit.client.1.smithi191.stdout:6/447: truncate d2/de/d19/d1e/f21 2913954 0 2024-09-19T09:35:02.297 INFO:tasks.workunit.client.1.smithi191.stdout:6/448: chown d2/de/f14 797454 1 2024-09-19T09:35:02.297 INFO:tasks.workunit.client.1.smithi191.stdout:6/449: write d2/de/f14 [4415201,40651] 0 2024-09-19T09:35:02.297 INFO:tasks.workunit.client.1.smithi191.stdout:6/450: chown d2/de/f69 372 1 2024-09-19T09:35:02.305 INFO:tasks.workunit.client.1.smithi191.stdout:2/490: dread d8/db/d13/d23/f1f [4194304,4194304] 0 2024-09-19T09:35:02.305 INFO:tasks.workunit.client.1.smithi191.stdout:2/491: dread - d8/db/f63 zero size 2024-09-19T09:35:02.306 INFO:tasks.workunit.client.1.smithi191.stdout:7/491: truncate d2/f1a 3904170 0 2024-09-19T09:35:02.310 INFO:tasks.workunit.client.1.smithi191.stdout:1/536: dwrite d3/d9/da/d1e/d25/f98 [0,4194304] 0 2024-09-19T09:35:02.310 INFO:tasks.workunit.client.1.smithi191.stdout:1/537: truncate d3/d9/da/f20 4525659 0 2024-09-19T09:35:02.311 INFO:tasks.workunit.client.1.smithi191.stdout:9/497: link d3/db/d16/d17/d3c/c95 d3/db/d16/d17/cad 0 2024-09-19T09:35:02.311 INFO:tasks.workunit.client.1.smithi191.stdout:1/538: dread d3/d9/da/d1e/f44 [0,4194304] 0 2024-09-19T09:35:02.312 INFO:tasks.workunit.client.1.smithi191.stdout:8/606: dwrite d1/d16/d3c/d17/f49 [0,4194304] 0 2024-09-19T09:35:02.312 INFO:tasks.workunit.client.1.smithi191.stdout:8/607: readlink d1/d7/d1a/l99 0 2024-09-19T09:35:02.313 INFO:tasks.workunit.client.1.smithi191.stdout:0/591: dwrite d0/d9/d1c/d1f/d24/d39/fac [0,4194304] 0 2024-09-19T09:35:02.315 INFO:tasks.workunit.client.1.smithi191.stdout:6/451: creat d2/de/d19/d1e/d64/f8f x:0 0 0 2024-09-19T09:35:02.315 INFO:tasks.workunit.client.1.smithi191.stdout:6/452: chown d2/de/d2a/l85 444171029 1 2024-09-19T09:35:02.317 INFO:tasks.workunit.client.1.smithi191.stdout:2/492: rename d8/db/l59 to d8/d11/d3f/d64/la4 0 2024-09-19T09:35:02.318 INFO:tasks.workunit.client.1.smithi191.stdout:7/492: mkdir d2/d2a/d79/da8 0 2024-09-19T09:35:02.318 INFO:tasks.workunit.client.1.smithi191.stdout:4/559: getdents d5/d1b/d8e 0 2024-09-19T09:35:02.322 INFO:tasks.workunit.client.1.smithi191.stdout:9/498: symlink d3/da1/lae 0 2024-09-19T09:35:02.322 INFO:tasks.workunit.client.1.smithi191.stdout:9/499: creat d3/db/d16/d17/d81/faf x:0 0 0 2024-09-19T09:35:02.323 INFO:tasks.workunit.client.1.smithi191.stdout:9/500: dread - d3/db/f63 zero size 2024-09-19T09:35:02.323 INFO:tasks.workunit.client.1.smithi191.stdout:1/539: chown d3/d9/da/d1e/d32/d53/d57/d6d/f77 9571 1 2024-09-19T09:35:02.324 INFO:tasks.workunit.client.1.smithi191.stdout:8/608: mkdir d1/d7/dc2 0 2024-09-19T09:35:02.324 INFO:tasks.workunit.client.1.smithi191.stdout:8/609: chown d1/d4f/d6b/da9/dc1 2726471 1 2024-09-19T09:35:02.325 INFO:tasks.workunit.client.1.smithi191.stdout:6/453: write d2/de/d2a/d2d/d30/f3f [3226008,98291] 0 2024-09-19T09:35:02.325 INFO:tasks.workunit.client.1.smithi191.stdout:6/454: fsync d2/de/d19/d1e/f21 0 2024-09-19T09:35:02.326 INFO:tasks.workunit.client.1.smithi191.stdout:0/592: symlink d0/d9/d1c/d1f/d24/d29/lc0 0 2024-09-19T09:35:02.326 INFO:tasks.workunit.client.1.smithi191.stdout:0/593: chown d0/d9/de/f10 951105 1 2024-09-19T09:35:02.326 INFO:tasks.workunit.client.1.smithi191.stdout:0/594: dread - d0/d9/d1c/d1f/d24/d29/f78 zero size 2024-09-19T09:35:02.328 INFO:tasks.workunit.client.1.smithi191.stdout:2/493: unlink d8/db/d13/d23/f20 0 2024-09-19T09:35:02.329 INFO:tasks.workunit.client.1.smithi191.stdout:9/501: rename d3/db/l33 to d3/da1/lb0 0 2024-09-19T09:35:02.330 INFO:tasks.workunit.client.1.smithi191.stdout:9/502: fdatasync d3/db/f10 0 2024-09-19T09:35:02.331 INFO:tasks.workunit.client.1.smithi191.stdout:1/540: link d3/d9/da/d1e/d32/l58 d3/d9/da/d8c/d97/lca 0 2024-09-19T09:35:02.331 INFO:tasks.workunit.client.1.smithi191.stdout:8/610: rmdir d1/d16/d2e/d7a 39 2024-09-19T09:35:02.331 INFO:tasks.workunit.client.1.smithi191.stdout:2/494: write d8/db/d13/d23/f1f [4815535,61584] 0 2024-09-19T09:35:02.332 INFO:tasks.workunit.client.1.smithi191.stdout:6/455: mknod d2/de/d15/c90 0 2024-09-19T09:35:02.334 INFO:tasks.workunit.client.1.smithi191.stdout:7/493: dwrite d2/d2a/d33/f8c [0,4194304] 0 2024-09-19T09:35:02.334 INFO:tasks.workunit.client.1.smithi191.stdout:7/494: write d2/f9d [656668,46000] 0 2024-09-19T09:35:02.334 INFO:tasks.workunit.client.1.smithi191.stdout:7/495: write d2/d2a/d79/d7f/f90 [541012,122312] 0 2024-09-19T09:35:02.334 INFO:tasks.workunit.client.1.smithi191.stdout:7/496: truncate d2/d39/d3a/d3c/f56 4781242 0 2024-09-19T09:35:02.336 INFO:tasks.workunit.client.1.smithi191.stdout:8/611: link d1/d16/d3c/d28/l9e d1/d16/d2e/d32/lc3 0 2024-09-19T09:35:02.338 INFO:tasks.workunit.client.1.smithi191.stdout:2/495: mknod d8/db/d13/d35/ca5 0 2024-09-19T09:35:02.342 INFO:tasks.workunit.client.1.smithi191.stdout:6/456: symlink d2/de/d19/d1e/d64/l91 0 2024-09-19T09:35:02.342 INFO:tasks.workunit.client.1.smithi191.stdout:0/595: dread d0/d9/d1c/d1f/d24/d39/d58/f16 [0,4194304] 0 2024-09-19T09:35:02.343 INFO:tasks.workunit.client.1.smithi191.stdout:0/596: write d0/d9/de/d81/f94 [682433,119345] 0 2024-09-19T09:35:02.343 INFO:tasks.workunit.client.1.smithi191.stdout:0/597: read - d0/d9/d1c/d1f/d24/d39/d58/d6c/fbd zero size 2024-09-19T09:35:02.345 INFO:tasks.workunit.client.1.smithi191.stdout:7/497: mknod d2/d2a/d38/d63/d9a/ca9 0 2024-09-19T09:35:02.346 INFO:tasks.workunit.client.1.smithi191.stdout:8/612: creat d1/d16/d3c/d28/d79/da2/fc4 x:0 0 0 2024-09-19T09:35:02.347 INFO:tasks.workunit.client.1.smithi191.stdout:6/457: mkdir d2/de/d15/d92 0 2024-09-19T09:35:02.347 INFO:tasks.workunit.client.1.smithi191.stdout:6/458: chown d2/de/d15/f74 20749 1 2024-09-19T09:35:02.349 INFO:tasks.workunit.client.1.smithi191.stdout:0/598: rename d0/d9/d1c/d20/d73/dbb to d0/d9/d1c/d1f/d24/d39/d58/d6c/dc1 0 2024-09-19T09:35:02.350 INFO:tasks.workunit.client.1.smithi191.stdout:7/498: link d2/f9 d2/faa 0 2024-09-19T09:35:02.351 INFO:tasks.workunit.client.1.smithi191.stdout:8/613: mkdir d1/d16/d2e/d32/dc5 0 2024-09-19T09:35:02.352 INFO:tasks.workunit.client.1.smithi191.stdout:2/496: dread d8/db/d13/d23/f78 [0,4194304] 0 2024-09-19T09:35:02.353 INFO:tasks.workunit.client.1.smithi191.stdout:6/459: truncate d2/de/d2a/d84/f86 760109 0 2024-09-19T09:35:02.353 INFO:tasks.workunit.client.1.smithi191.stdout:6/460: creat d2/de/d19/f93 x:0 0 0 2024-09-19T09:35:02.353 INFO:tasks.workunit.client.1.smithi191.stdout:7/499: getdents d2/d39/d3a 0 2024-09-19T09:35:02.355 INFO:tasks.workunit.client.1.smithi191.stdout:8/614: mkdir d1/d4f/d6b/da9/dc1/dc6 0 2024-09-19T09:35:02.361 INFO:tasks.workunit.client.1.smithi191.stdout:1/541: dwrite d3/d9/da/d1e/d32/d53/f51 [0,4194304] 0 2024-09-19T09:35:02.365 INFO:tasks.workunit.client.1.smithi191.stdout:1/542: creat d3/d9/da/d1e/d32/d53/d57/d6d/da1/fcb x:0 0 0 2024-09-19T09:35:02.367 INFO:tasks.workunit.client.1.smithi191.stdout:6/461: read d2/de/d15/f36 [896645,896] 0 2024-09-19T09:35:02.368 INFO:tasks.workunit.client.1.smithi191.stdout:9/503: dwrite d3/db/d16/d38/f83 [0,4194304] 0 2024-09-19T09:35:02.368 INFO:tasks.workunit.client.1.smithi191.stdout:9/504: chown d3/db/d16/d17/d81/da6 9526586 1 2024-09-19T09:35:02.369 INFO:tasks.workunit.client.1.smithi191.stdout:9/505: symlink d3/db/d16/d38/lb1 0 2024-09-19T09:35:02.369 INFO:tasks.workunit.client.1.smithi191.stdout:9/506: stat d3/db/d16/d17/d81/f82 0 2024-09-19T09:35:02.379 INFO:tasks.workunit.client.1.smithi191.stdout:2/497: dwrite d8/db/d4e/f7d [0,4194304] 0 2024-09-19T09:35:02.381 INFO:tasks.workunit.client.1.smithi191.stdout:0/599: dwrite d0/d9/d1c/d1f/d24/d53/f75 [0,4194304] 0 2024-09-19T09:35:02.381 INFO:tasks.workunit.client.1.smithi191.stdout:9/507: write d3/db/d16/f2a [4101830,12077] 0 2024-09-19T09:35:02.382 INFO:tasks.workunit.client.1.smithi191.stdout:0/600: chown d0/d9/d1c/d1f/d24/d39/d58/f16 8737 1 2024-09-19T09:35:02.383 INFO:tasks.workunit.client.1.smithi191.stdout:0/601: rename d0/d9/f1a to d0/d9/d1c/d20/d73/fc2 0 2024-09-19T09:35:02.383 INFO:tasks.workunit.client.1.smithi191.stdout:0/602: dread - d0/d9/d1c/d1f/d24/d53/fba zero size 2024-09-19T09:35:02.385 INFO:tasks.workunit.client.1.smithi191.stdout:0/603: write d0/d9/d1c/d1f/d24/d39/d7a/fae [131457,52464] 0 2024-09-19T09:35:02.388 INFO:tasks.workunit.client.1.smithi191.stdout:9/508: truncate d3/db/d16/f7e 2560458 0 2024-09-19T09:35:02.389 INFO:tasks.workunit.client.1.smithi191.stdout:9/509: unlink d3/db/d16/f37 0 2024-09-19T09:35:02.389 INFO:tasks.workunit.client.1.smithi191.stdout:9/510: chown d3/db/d16/f7e 43866 1 2024-09-19T09:35:02.389 INFO:tasks.workunit.client.1.smithi191.stdout:9/511: write d3/db/d16/d17/d3c/fa4 [69180,102535] 0 2024-09-19T09:35:02.391 INFO:tasks.workunit.client.1.smithi191.stdout:7/500: dwrite d2/d2a/d4f/d59/d81/f9b [0,4194304] 0 2024-09-19T09:35:02.391 INFO:tasks.workunit.client.1.smithi191.stdout:2/498: dread d8/db/d13/d23/f1f [0,4194304] 0 2024-09-19T09:35:02.392 INFO:tasks.workunit.client.1.smithi191.stdout:2/499: fsync d8/d11/d3f/f39 0 2024-09-19T09:35:02.393 INFO:tasks.workunit.client.1.smithi191.stdout:2/500: getdents d8/db/d13/d35 0 2024-09-19T09:35:02.395 INFO:tasks.workunit.client.1.smithi191.stdout:2/501: unlink d8/db/d13/d23/f1f 0 2024-09-19T09:35:02.395 INFO:tasks.workunit.client.1.smithi191.stdout:2/502: stat d8/db/d13/d35/f90 0 2024-09-19T09:35:02.395 INFO:tasks.workunit.client.1.smithi191.stdout:0/604: dread d0/f34 [0,4194304] 0 2024-09-19T09:35:02.395 INFO:tasks.workunit.client.1.smithi191.stdout:0/605: stat d0/d9/d1c/d20/d73/cb6 0 2024-09-19T09:35:02.397 INFO:tasks.workunit.client.1.smithi191.stdout:9/512: dread d3/db/d16/f43 [0,4194304] 0 2024-09-19T09:35:02.397 INFO:tasks.workunit.client.1.smithi191.stdout:9/513: truncate d3/db/d16/fa7 740531 0 2024-09-19T09:35:02.397 INFO:tasks.workunit.client.1.smithi191.stdout:9/514: stat d3/db/d16/d47/d55/f5e 0 2024-09-19T09:35:02.398 INFO:tasks.workunit.client.1.smithi191.stdout:9/515: readlink d3/db/d16/d38/lb1 0 2024-09-19T09:35:02.405 INFO:tasks.workunit.client.1.smithi191.stdout:2/503: dread d8/f42 [0,4194304] 0 2024-09-19T09:35:02.408 INFO:tasks.workunit.client.1.smithi191.stdout:2/504: creat d8/db/d13/fa6 x:0 0 0 2024-09-19T09:35:02.408 INFO:tasks.workunit.client.1.smithi191.stdout:2/505: read d8/db/d13/d40/f52 [1393481,82257] 0 2024-09-19T09:35:02.417 INFO:tasks.workunit.client.1.smithi191.stdout:7/501: dwrite d2/d39/d3a/d3c/f6f [0,4194304] 0 2024-09-19T09:35:02.418 INFO:tasks.workunit.client.1.smithi191.stdout:7/502: write d2/d2a/d79/f98 [1638728,62364] 0 2024-09-19T09:35:02.420 INFO:tasks.workunit.client.1.smithi191.stdout:9/516: dwrite d3/d60/faa [0,4194304] 0 2024-09-19T09:35:02.420 INFO:tasks.workunit.client.1.smithi191.stdout:0/606: dwrite d0/d9/d1c/d1f/f85 [0,4194304] 0 2024-09-19T09:35:02.426 INFO:tasks.workunit.client.1.smithi191.stdout:9/517: dread d3/db/f11 [0,4194304] 0 2024-09-19T09:35:02.426 INFO:tasks.workunit.client.1.smithi191.stdout:9/518: fdatasync d3/db/d16/d47/d55/f5e 0 2024-09-19T09:35:02.429 INFO:tasks.workunit.client.1.smithi191.stdout:9/519: creat d3/d8/fb2 x:0 0 0 2024-09-19T09:35:02.431 INFO:tasks.workunit.client.1.smithi191.stdout:7/503: dread d2/d2a/d33/f54 [0,4194304] 0 2024-09-19T09:35:02.432 INFO:tasks.workunit.client.1.smithi191.stdout:9/520: rmdir d3/d60 39 2024-09-19T09:35:02.432 INFO:tasks.workunit.client.1.smithi191.stdout:9/521: dread - d3/db/d16/d38/f67 zero size 2024-09-19T09:35:02.433 INFO:tasks.workunit.client.1.smithi191.stdout:7/504: creat d2/d2a/d79/da8/fab x:0 0 0 2024-09-19T09:35:02.433 INFO:tasks.workunit.client.1.smithi191.stdout:9/522: getdents d3/d60/d78 0 2024-09-19T09:35:02.434 INFO:tasks.workunit.client.1.smithi191.stdout:9/523: write d3/d60/f58 [4083593,79949] 0 2024-09-19T09:35:02.435 INFO:tasks.workunit.client.1.smithi191.stdout:7/505: unlink d2/ff 0 2024-09-19T09:35:02.435 INFO:tasks.workunit.client.1.smithi191.stdout:7/506: fsync d2/d2a/d4f/d59/f65 0 2024-09-19T09:35:02.435 INFO:tasks.workunit.client.1.smithi191.stdout:9/524: truncate d3/db/d16/d38/f48 2884800 0 2024-09-19T09:35:02.436 INFO:tasks.workunit.client.1.smithi191.stdout:7/507: creat d2/d39/d3a/fac x:0 0 0 2024-09-19T09:35:02.437 INFO:tasks.workunit.client.1.smithi191.stdout:9/525: mkdir d3/db/d53/da2/db3 0 2024-09-19T09:35:02.438 INFO:tasks.workunit.client.1.smithi191.stdout:0/607: dwrite d0/d9/f25 [0,4194304] 0 2024-09-19T09:35:02.438 INFO:tasks.workunit.client.1.smithi191.stdout:0/608: write d0/d9/d1c/d1f/d24/d39/fac [5180610,112392] 0 2024-09-19T09:35:02.438 INFO:tasks.workunit.client.1.smithi191.stdout:0/609: getdents d0/d9/d1c/d1f/d24/dbc 0 2024-09-19T09:35:02.438 INFO:tasks.workunit.client.1.smithi191.stdout:0/610: fdatasync d0/d9/d1c/d20/fa4 0 2024-09-19T09:35:02.445 INFO:tasks.workunit.client.1.smithi191.stdout:0/611: creat d0/d9/d1c/d1f/d24/d29/d30/fc3 x:0 0 0 2024-09-19T09:35:02.446 INFO:tasks.workunit.client.1.smithi191.stdout:9/526: mknod d3/d8/cb4 0 2024-09-19T09:35:02.446 INFO:tasks.workunit.client.1.smithi191.stdout:9/527: fsync d3/db/d16/d17/d81/f8a 0 2024-09-19T09:35:02.447 INFO:tasks.workunit.client.1.smithi191.stdout:0/612: creat d0/d9/de/d61/fc4 x:0 0 0 2024-09-19T09:35:02.447 INFO:tasks.workunit.client.1.smithi191.stdout:0/613: getdents d0/d9/d1c/d1f/d24/dbe 0 2024-09-19T09:35:02.448 INFO:tasks.workunit.client.1.smithi191.stdout:9/528: mkdir d3/db/d16/d17/d81/db5 0 2024-09-19T09:35:02.448 INFO:tasks.workunit.client.1.smithi191.stdout:7/508: write d2/d2a/f2f [1572822,58617] 0 2024-09-19T09:35:02.449 INFO:tasks.workunit.client.1.smithi191.stdout:7/509: mknod d2/d2a/d38/d63/da2/cad 0 2024-09-19T09:35:02.451 INFO:tasks.workunit.client.1.smithi191.stdout:7/510: mknod d2/d2a/d38/d63/da2/cae 0 2024-09-19T09:35:02.453 INFO:tasks.workunit.client.1.smithi191.stdout:0/614: rename d0/d9/d1c/d1f/d24/d39/d58/d6c to d0/dc5 0 2024-09-19T09:35:02.453 INFO:tasks.workunit.client.1.smithi191.stdout:0/615: fdatasync d0/d9/d1c/d1f/d24/d29/f78 0 2024-09-19T09:35:02.454 INFO:tasks.workunit.client.1.smithi191.stdout:7/511: rename d2/d2a/d38/ca0 to d2/d2a/d38/d63/da2/caf 0 2024-09-19T09:35:02.456 INFO:tasks.workunit.client.1.smithi191.stdout:0/616: creat d0/d9/d1c/fc6 x:0 0 0 2024-09-19T09:35:02.458 INFO:tasks.workunit.client.1.smithi191.stdout:7/512: unlink d2/d2a/d4f/l8a 0 2024-09-19T09:35:02.460 INFO:tasks.workunit.client.1.smithi191.stdout:7/513: rename d2/d2a/d38/d63/d9a/c8e to d2/d39/cb0 0 2024-09-19T09:35:02.463 INFO:tasks.workunit.client.1.smithi191.stdout:7/514: getdents d2 0 2024-09-19T09:35:02.465 INFO:tasks.workunit.client.1.smithi191.stdout:7/515: creat d2/fb1 x:0 0 0 2024-09-19T09:35:02.472 INFO:tasks.workunit.client.1.smithi191.stdout:0/617: dwrite d0/d9/d1c/d1f/d24/d53/fba [0,4194304] 0 2024-09-19T09:35:02.474 INFO:tasks.workunit.client.1.smithi191.stdout:9/529: dwrite d3/db/d16/d38/f67 [0,4194304] 0 2024-09-19T09:35:02.475 INFO:tasks.workunit.client.1.smithi191.stdout:9/530: getdents d3/db/d16/d17/d81/db5 0 2024-09-19T09:35:02.475 INFO:tasks.workunit.client.1.smithi191.stdout:0/618: mknod d0/d9/de/d61/cc7 0 2024-09-19T09:35:02.476 INFO:tasks.workunit.client.1.smithi191.stdout:9/531: mkdir d3/db6 0 2024-09-19T09:35:02.480 INFO:tasks.workunit.client.1.smithi191.stdout:5/514: sync 2024-09-19T09:35:02.481 INFO:tasks.workunit.client.1.smithi191.stdout:3/460: sync 2024-09-19T09:35:02.481 INFO:tasks.workunit.client.1.smithi191.stdout:3/461: chown d12 12849452 1 2024-09-19T09:35:02.481 INFO:tasks.workunit.client.1.smithi191.stdout:5/515: getdents d0/d4/d9/d1d/d22/d5c 0 2024-09-19T09:35:02.484 INFO:tasks.workunit.client.1.smithi191.stdout:7/516: dwrite d2/d2a/d4f/f76 [0,4194304] 0 2024-09-19T09:35:02.490 INFO:tasks.workunit.client.1.smithi191.stdout:0/619: dread d0/d9/d1c/f7e [0,4194304] 0 2024-09-19T09:35:02.490 INFO:tasks.workunit.client.1.smithi191.stdout:0/620: chown d0/d9/d1c/d1f/d24/d29/d30/d56 1325 1 2024-09-19T09:35:02.493 INFO:tasks.workunit.client.1.smithi191.stdout:7/517: creat d2/d2a/fb2 x:0 0 0 2024-09-19T09:35:02.497 INFO:tasks.workunit.client.1.smithi191.stdout:9/532: dread d3/db/d16/d38/f83 [0,4194304] 0 2024-09-19T09:35:02.499 INFO:tasks.workunit.client.1.smithi191.stdout:9/533: link d3/db/d16/d47/d55/c72 d3/cb7 0 2024-09-19T09:35:02.501 INFO:tasks.workunit.client.1.smithi191.stdout:7/518: dread d2/d2a/d4f/d59/d81/f9b [0,4194304] 0 2024-09-19T09:35:02.501 INFO:tasks.workunit.client.1.smithi191.stdout:9/534: rename d3/db/d16/d38/f5f to d3/d60/d78/fb8 0 2024-09-19T09:35:02.502 INFO:tasks.workunit.client.1.smithi191.stdout:9/535: mknod d3/db/d16/d47/d89/cb9 0 2024-09-19T09:35:02.504 INFO:tasks.workunit.client.1.smithi191.stdout:9/536: creat d3/db/d16/d47/d55/fba x:0 0 0 2024-09-19T09:35:02.504 INFO:tasks.workunit.client.1.smithi191.stdout:9/537: creat d3/db6/fbb x:0 0 0 2024-09-19T09:35:02.505 INFO:tasks.workunit.client.1.smithi191.stdout:9/538: fdatasync d3/db/d16/f88 0 2024-09-19T09:35:02.505 INFO:tasks.workunit.client.1.smithi191.stdout:9/539: truncate d3/d8/f22 2051536 0 2024-09-19T09:35:02.505 INFO:tasks.workunit.client.1.smithi191.stdout:9/540: stat d3/db/d16/d38/lb1 0 2024-09-19T09:35:02.509 INFO:tasks.workunit.client.1.smithi191.stdout:3/462: dwrite d12/d13/d1a/d28/f58 [0,4194304] 0 2024-09-19T09:35:02.509 INFO:tasks.workunit.client.1.smithi191.stdout:3/463: write d12/d13/d1a/d1b/d3c/d3f/f83 [196879,71910] 0 2024-09-19T09:35:02.509 INFO:tasks.workunit.client.1.smithi191.stdout:5/516: dwrite d0/d1f/f56 [0,4194304] 0 2024-09-19T09:35:02.509 INFO:tasks.workunit.client.1.smithi191.stdout:0/621: dwrite d0/d9/d1c/d1f/d24/f4b [0,4194304] 0 2024-09-19T09:35:02.512 INFO:tasks.workunit.client.1.smithi191.stdout:5/517: creat d0/d77/fb6 x:0 0 0 2024-09-19T09:35:02.513 INFO:tasks.workunit.client.1.smithi191.stdout:0/622: rename d0/d9/de/d61/c62 to d0/d9/d1c/d1f/d24/d53/cc8 0 2024-09-19T09:35:02.514 INFO:tasks.workunit.client.1.smithi191.stdout:0/623: chown d0/d9/d1c/d1f/d24/d39/l59 14 1 2024-09-19T09:35:02.515 INFO:tasks.workunit.client.1.smithi191.stdout:5/518: rename d0/d4/d9/d1d/l21 to d0/d4/d9/d1d/d29/lb7 0 2024-09-19T09:35:02.526 INFO:tasks.workunit.client.1.smithi191.stdout:7/519: dwrite d2/f28 [0,4194304] 0 2024-09-19T09:35:02.535 INFO:tasks.workunit.client.1.smithi191.stdout:3/464: dwrite d12/d13/d1a/d1b/d3c/d3f/f4d [0,4194304] 0 2024-09-19T09:35:02.536 INFO:tasks.workunit.client.1.smithi191.stdout:5/519: dwrite d0/d4/d9/d1d/d29/d33/d52/f71 [0,4194304] 0 2024-09-19T09:35:02.536 INFO:tasks.workunit.client.1.smithi191.stdout:5/520: truncate d0/d4/d9/d1d/f46 4549570 0 2024-09-19T09:35:02.537 INFO:tasks.workunit.client.1.smithi191.stdout:3/465: mkdir d12/d37/da6 0 2024-09-19T09:35:02.538 INFO:tasks.workunit.client.1.smithi191.stdout:3/466: dread - d12/f81 zero size 2024-09-19T09:35:02.539 INFO:tasks.workunit.client.1.smithi191.stdout:5/521: mknod d0/d4/d9/d1d/d29/d33/d52/cb8 0 2024-09-19T09:35:02.540 INFO:tasks.workunit.client.1.smithi191.stdout:5/522: dread - d0/d1f/f96 zero size 2024-09-19T09:35:02.540 INFO:tasks.workunit.client.1.smithi191.stdout:5/523: fdatasync d0/d4/d9/d1d/d29/d33/d52/f86 0 2024-09-19T09:35:02.540 INFO:tasks.workunit.client.1.smithi191.stdout:7/520: dread d2/f9 [0,4194304] 0 2024-09-19T09:35:02.543 INFO:tasks.workunit.client.1.smithi191.stdout:0/624: dwrite d0/d9/de/d61/f6a [0,4194304] 0 2024-09-19T09:35:02.546 INFO:tasks.workunit.client.1.smithi191.stdout:0/625: creat d0/dc5/dc1/fc9 x:0 0 0 2024-09-19T09:35:02.547 INFO:tasks.workunit.client.1.smithi191.stdout:0/626: symlink d0/d9/d1c/d1f/d24/d39/d8b/lca 0 2024-09-19T09:35:02.549 INFO:tasks.workunit.client.1.smithi191.stdout:0/627: write d0/d9/de/d81/f94 [127358,59665] 0 2024-09-19T09:35:02.551 INFO:tasks.workunit.client.1.smithi191.stdout:7/521: write d2/f40 [1378009,39906] 0 2024-09-19T09:35:02.557 INFO:tasks.workunit.client.1.smithi191.stdout:4/560: sync 2024-09-19T09:35:02.558 INFO:tasks.workunit.client.1.smithi191.stdout:4/561: mkdir d5/d1b/d1c/d2f/d19/dc1 0 2024-09-19T09:35:02.559 INFO:tasks.workunit.client.1.smithi191.stdout:4/562: creat d5/d1b/d1c/d28/fc2 x:0 0 0 2024-09-19T09:35:02.559 INFO:tasks.workunit.client.1.smithi191.stdout:4/563: write d5/d38/d73/d8d/fc0 [966592,26108] 0 2024-09-19T09:35:02.561 INFO:tasks.workunit.client.1.smithi191.stdout:5/524: dwrite d0/d4/f78 [0,4194304] 0 2024-09-19T09:35:02.561 INFO:tasks.workunit.client.1.smithi191.stdout:3/467: dwrite d12/d37/d64/d73/f79 [4194304,4194304] 0 2024-09-19T09:35:02.579 INFO:tasks.workunit.client.1.smithi191.stdout:4/564: dwrite d5/f8 [0,4194304] 0 2024-09-19T09:35:02.588 INFO:tasks.workunit.client.1.smithi191.stdout:7/522: dwrite d2/f1e [0,4194304] 0 2024-09-19T09:35:02.588 INFO:tasks.workunit.client.1.smithi191.stdout:5/525: dread d0/d4/d9/d1d/d29/d33/f38 [0,4194304] 0 2024-09-19T09:35:02.588 INFO:tasks.workunit.client.1.smithi191.stdout:7/523: chown d2/d2a/d33 206531 1 2024-09-19T09:35:02.588 INFO:tasks.workunit.client.1.smithi191.stdout:5/526: truncate d0/d4/d9/d1d/d29/d33/d45/d64/f6c 1056233 0 2024-09-19T09:35:02.592 INFO:tasks.workunit.client.1.smithi191.stdout:5/527: mkdir d0/d4/d9/d1d/d22/d3b/db9 0 2024-09-19T09:35:02.596 INFO:tasks.workunit.client.1.smithi191.stdout:3/468: dwrite d12/d37/d64/d73/f7d [0,4194304] 0 2024-09-19T09:35:02.597 INFO:tasks.workunit.client.1.smithi191.stdout:4/565: dwrite d5/d1b/d1c/d24/d32/d21/d92/fa8 [0,4194304] 0 2024-09-19T09:35:02.597 INFO:tasks.workunit.client.1.smithi191.stdout:4/566: chown d5/d1b/d1c/d24/c33 5985 1 2024-09-19T09:35:02.597 INFO:tasks.workunit.client.1.smithi191.stdout:4/567: chown d5/d38/d73 7522 1 2024-09-19T09:35:02.597 INFO:tasks.workunit.client.1.smithi191.stdout:4/568: write d5/d1b/d1c/d24/d32/d21/d56/f72 [177382,69032] 0 2024-09-19T09:35:02.601 INFO:tasks.workunit.client.1.smithi191.stdout:4/569: unlink d5/d1b/d1c/d24/c6c 0 2024-09-19T09:35:02.605 INFO:tasks.workunit.client.1.smithi191.stdout:3/469: dread d12/d43/f52 [0,4194304] 0 2024-09-19T09:35:02.617 INFO:tasks.workunit.client.1.smithi191.stdout:7/524: dwrite d2/f9d [0,4194304] 0 2024-09-19T09:35:02.618 INFO:tasks.workunit.client.1.smithi191.stdout:3/470: write ff [2657424,111862] 0 2024-09-19T09:35:02.618 INFO:tasks.workunit.client.1.smithi191.stdout:3/471: truncate d12/d13/d1a/d1b/d3c/d3f/f75 285309 0 2024-09-19T09:35:02.620 INFO:tasks.workunit.client.1.smithi191.stdout:5/528: dwrite d0/d4/d9/d1d/d29/d33/f38 [0,4194304] 0 2024-09-19T09:35:02.620 INFO:tasks.workunit.client.1.smithi191.stdout:5/529: fdatasync d0/d77/fad 0 2024-09-19T09:35:02.620 INFO:tasks.workunit.client.1.smithi191.stdout:5/530: chown d0/l1c 2198 1 2024-09-19T09:35:02.620 INFO:tasks.workunit.client.1.smithi191.stdout:7/525: mknod d2/d39/d3a/cb3 0 2024-09-19T09:35:02.621 INFO:tasks.workunit.client.1.smithi191.stdout:4/570: dwrite d5/d1b/d1c/d24/d32/d21/d5c/fb1 [0,4194304] 0 2024-09-19T09:35:02.621 INFO:tasks.workunit.client.1.smithi191.stdout:3/472: truncate d12/d13/d1a/d1b/d3c/f4f 83486 0 2024-09-19T09:35:02.621 INFO:tasks.workunit.client.1.smithi191.stdout:3/473: chown d12/d43/f44 53558068 1 2024-09-19T09:35:02.621 INFO:tasks.workunit.client.1.smithi191.stdout:3/474: readlink d12/d13/d1a/l48 0 2024-09-19T09:35:02.621 INFO:tasks.workunit.client.1.smithi191.stdout:3/475: chown d12/d37/d51/d62/d86/f8a 3122 1 2024-09-19T09:35:02.623 INFO:tasks.workunit.client.1.smithi191.stdout:5/531: creat d0/d4/d9/d1d/d22/d3b/fba x:0 0 0 2024-09-19T09:35:02.630 INFO:tasks.workunit.client.1.smithi191.stdout:4/571: truncate d5/d1b/d1c/d2f/d19/f34 2704832 0 2024-09-19T09:35:02.631 INFO:tasks.workunit.client.1.smithi191.stdout:3/476: dread d12/d13/d1a/d1b/d3c/f68 [0,4194304] 0 2024-09-19T09:35:02.631 INFO:tasks.workunit.client.1.smithi191.stdout:7/526: getdents d2/d2a/d79/d7f 0 2024-09-19T09:35:02.631 INFO:tasks.workunit.client.1.smithi191.stdout:7/527: write d2/f60 [570229,37127] 0 2024-09-19T09:35:02.631 INFO:tasks.workunit.client.1.smithi191.stdout:7/528: truncate d2/d2a/d33/f7c 4379028 0 2024-09-19T09:35:02.632 INFO:tasks.workunit.client.1.smithi191.stdout:3/477: mkdir d12/d37/da6/da7 0 2024-09-19T09:35:02.633 INFO:tasks.workunit.client.1.smithi191.stdout:7/529: rename d2/d2a/d4f/d78/la7 to d2/d2a/lb4 0 2024-09-19T09:35:02.634 INFO:tasks.workunit.client.1.smithi191.stdout:3/478: mknod d12/d43/ca8 0 2024-09-19T09:35:02.635 INFO:tasks.workunit.client.1.smithi191.stdout:3/479: mknod d12/d13/d1a/d1b/d3c/d71/ca9 0 2024-09-19T09:35:02.635 INFO:tasks.workunit.client.1.smithi191.stdout:3/480: creat d12/d37/faa x:0 0 0 2024-09-19T09:35:02.636 INFO:tasks.workunit.client.1.smithi191.stdout:3/481: getdents d12/d37/d51/d62/d85 0 2024-09-19T09:35:02.636 INFO:tasks.workunit.client.1.smithi191.stdout:3/482: chown d12/d37/d3d/f40 158814874 1 2024-09-19T09:35:02.638 INFO:tasks.workunit.client.1.smithi191.stdout:1/543: sync 2024-09-19T09:35:02.638 INFO:tasks.workunit.client.1.smithi191.stdout:8/615: sync 2024-09-19T09:35:02.638 INFO:tasks.workunit.client.1.smithi191.stdout:6/462: sync 2024-09-19T09:35:02.638 INFO:tasks.workunit.client.1.smithi191.stdout:2/506: sync 2024-09-19T09:35:02.638 INFO:tasks.workunit.client.1.smithi191.stdout:2/507: creat d8/db/d4e/fa7 x:0 0 0 2024-09-19T09:35:02.638 INFO:tasks.workunit.client.1.smithi191.stdout:2/508: write d8/d11/d3f/d64/f66 [10454,40040] 0 2024-09-19T09:35:02.639 INFO:tasks.workunit.client.1.smithi191.stdout:6/463: mknod d2/de/d2a/d84/c94 0 2024-09-19T09:35:02.639 INFO:tasks.workunit.client.1.smithi191.stdout:6/464: write d2/de/d19/d1e/d64/d76/d88/f68 [807877,128352] 0 2024-09-19T09:35:02.643 INFO:tasks.workunit.client.1.smithi191.stdout:4/572: dread d5/d1b/d1c/d24/d32/d21/d92/fa8 [0,4194304] 0 2024-09-19T09:35:02.643 INFO:tasks.workunit.client.1.smithi191.stdout:8/616: symlink d1/d4f/d6b/d83/lc7 0 2024-09-19T09:35:02.643 INFO:tasks.workunit.client.1.smithi191.stdout:2/509: rmdir d8/d11 39 2024-09-19T09:35:02.646 INFO:tasks.workunit.client.1.smithi191.stdout:5/532: dwrite d0/d4/d9/f59 [0,4194304] 0 2024-09-19T09:35:02.646 INFO:tasks.workunit.client.1.smithi191.stdout:5/533: stat d0/d1f/c2a 0 2024-09-19T09:35:02.649 INFO:tasks.workunit.client.1.smithi191.stdout:8/617: unlink d1/d4f/d6b/d83/fae 0 2024-09-19T09:35:02.652 INFO:tasks.workunit.client.1.smithi191.stdout:2/510: mkdir d8/db/d13/d40/da8 0 2024-09-19T09:35:02.657 INFO:tasks.workunit.client.1.smithi191.stdout:4/573: rmdir d5/d1b/d1c/d24/d32/d21/d5c 39 2024-09-19T09:35:02.657 INFO:tasks.workunit.client.1.smithi191.stdout:4/574: write f1 [1711691,110774] 0 2024-09-19T09:35:02.657 INFO:tasks.workunit.client.1.smithi191.stdout:4/575: write d5/d1b/d1c/d24/d32/d21/d56/d86/fa7 [230531,60701] 0 2024-09-19T09:35:02.658 INFO:tasks.workunit.client.1.smithi191.stdout:3/483: rename d12/d37 to d12/d13/d1a/d1b/d2e/dab 0 2024-09-19T09:35:02.658 INFO:tasks.workunit.client.1.smithi191.stdout:2/511: symlink d8/la9 0 2024-09-19T09:35:02.661 INFO:tasks.workunit.client.1.smithi191.stdout:4/576: mknod d5/d1b/d1c/d2f/d37/cc3 0 2024-09-19T09:35:02.661 INFO:tasks.workunit.client.1.smithi191.stdout:8/618: dread d1/d16/f19 [0,4194304] 0 2024-09-19T09:35:02.661 INFO:tasks.workunit.client.1.smithi191.stdout:2/512: truncate d8/d11/d98/f9a 1023881 0 2024-09-19T09:35:02.661 INFO:tasks.workunit.client.1.smithi191.stdout:4/577: rmdir d5/d1b/d1c/d24/d32/d21/d5c/d8c 39 2024-09-19T09:35:02.662 INFO:tasks.workunit.client.1.smithi191.stdout:2/513: mknod d8/d11/d56/caa 0 2024-09-19T09:35:02.663 INFO:tasks.workunit.client.1.smithi191.stdout:8/619: truncate d1/d16/f4a 797552 0 2024-09-19T09:35:02.663 INFO:tasks.workunit.client.1.smithi191.stdout:8/620: stat d1/d16/d3c/d28/d79/f7f 0 2024-09-19T09:35:02.664 INFO:tasks.workunit.client.1.smithi191.stdout:2/514: mknod d8/cab 0 2024-09-19T09:35:02.664 INFO:tasks.workunit.client.1.smithi191.stdout:7/530: dwrite d2/d2a/fb2 [0,4194304] 0 2024-09-19T09:35:02.664 INFO:tasks.workunit.client.1.smithi191.stdout:7/531: truncate d2/d2a/d33/f73 268464 0 2024-09-19T09:35:02.665 INFO:tasks.workunit.client.1.smithi191.stdout:5/534: dwrite d0/d4/d9/de/ff [4194304,4194304] 0 2024-09-19T09:35:02.667 INFO:tasks.workunit.client.1.smithi191.stdout:8/621: symlink d1/d16/d3c/d17/da1/d84/dbc/lc8 0 2024-09-19T09:35:02.667 INFO:tasks.workunit.client.1.smithi191.stdout:4/578: read d5/d1b/d1c/d24/d32/d21/d78/f7b [10331,69546] 0 2024-09-19T09:35:02.668 INFO:tasks.workunit.client.1.smithi191.stdout:7/532: dread d2/f23 [0,4194304] 0 2024-09-19T09:35:02.669 INFO:tasks.workunit.client.1.smithi191.stdout:7/533: write d2/d2a/d4f/d59/fa6 [1045556,126199] 0 2024-09-19T09:35:02.669 INFO:tasks.workunit.client.1.smithi191.stdout:8/622: mknod d1/d16/d3c/cc9 0 2024-09-19T09:35:02.670 INFO:tasks.workunit.client.1.smithi191.stdout:7/534: creat d2/d2a/d38/d63/da2/fb5 x:0 0 0 2024-09-19T09:35:02.671 INFO:tasks.workunit.client.1.smithi191.stdout:6/465: dwrite d2/de/d2a/f4b [0,4194304] 0 2024-09-19T09:35:02.671 INFO:tasks.workunit.client.1.smithi191.stdout:6/466: chown d2/de/d15/f78 10363 1 2024-09-19T09:35:02.671 INFO:tasks.workunit.client.1.smithi191.stdout:8/623: creat d1/fca x:0 0 0 2024-09-19T09:35:02.672 INFO:tasks.workunit.client.1.smithi191.stdout:6/467: rmdir d2/de/d19/d1e/d64/d76 39 2024-09-19T09:35:02.672 INFO:tasks.workunit.client.1.smithi191.stdout:6/468: dread - d2/de/d19/d1e/d64/f8f zero size 2024-09-19T09:35:02.674 INFO:tasks.workunit.client.1.smithi191.stdout:8/624: mkdir d1/d16/d23/d3e/dcb 0 2024-09-19T09:35:02.676 INFO:tasks.workunit.client.1.smithi191.stdout:6/469: creat d2/de/d2a/d2d/f95 x:0 0 0 2024-09-19T09:35:02.678 INFO:tasks.workunit.client.1.smithi191.stdout:8/625: mkdir d1/d7/dcc 0 2024-09-19T09:35:02.680 INFO:tasks.workunit.client.1.smithi191.stdout:4/579: read d5/d1b/d8e/dad/f8b [473954,39248] 0 2024-09-19T09:35:02.682 INFO:tasks.workunit.client.1.smithi191.stdout:0/628: sync 2024-09-19T09:35:02.682 INFO:tasks.workunit.client.1.smithi191.stdout:9/541: sync 2024-09-19T09:35:02.682 INFO:tasks.workunit.client.1.smithi191.stdout:9/542: chown d3/db/d16/d17/d81/db5 2308689 1 2024-09-19T09:35:02.683 INFO:tasks.workunit.client.1.smithi191.stdout:9/543: readlink d3/db/d16/d17/d5b/l6c 0 2024-09-19T09:35:02.683 INFO:tasks.workunit.client.1.smithi191.stdout:9/544: stat d3/db/d16/d17/d3c/fa4 0 2024-09-19T09:35:02.683 INFO:tasks.workunit.client.1.smithi191.stdout:9/545: read d3/fe [1211767,76349] 0 2024-09-19T09:35:02.684 INFO:tasks.workunit.client.1.smithi191.stdout:3/484: dwrite d12/f81 [0,4194304] 0 2024-09-19T09:35:02.685 INFO:tasks.workunit.client.1.smithi191.stdout:3/485: dread - d12/d13/d1a/d1b/d2e/dab/faa zero size 2024-09-19T09:35:02.685 INFO:tasks.workunit.client.1.smithi191.stdout:9/546: creat d3/da1/fbc x:0 0 0 2024-09-19T09:35:02.687 INFO:tasks.workunit.client.1.smithi191.stdout:3/486: creat d12/d43/fac x:0 0 0 2024-09-19T09:35:02.688 INFO:tasks.workunit.client.1.smithi191.stdout:9/547: truncate d3/d8/f13 2255838 0 2024-09-19T09:35:02.689 INFO:tasks.workunit.client.1.smithi191.stdout:9/548: write d3/d60/f54 [1831697,68957] 0 2024-09-19T09:35:02.690 INFO:tasks.workunit.client.1.smithi191.stdout:3/487: rename d12/d13/d1a/d1b/d2e/dab/d64 to d12/d13/d1a/d1b/d60/d7a/d93/dad 0 2024-09-19T09:35:02.691 INFO:tasks.workunit.client.1.smithi191.stdout:9/549: creat d3/db/d53/fbd x:0 0 0 2024-09-19T09:35:02.694 INFO:tasks.workunit.client.1.smithi191.stdout:3/488: symlink d12/d43/d61/d98/lae 0 2024-09-19T09:35:02.698 INFO:tasks.workunit.client.1.smithi191.stdout:3/489: symlink d12/d13/d1a/d1b/d2e/dab/laf 0 2024-09-19T09:35:02.698 INFO:tasks.workunit.client.1.smithi191.stdout:2/515: dwrite d8/db/f47 [0,4194304] 0 2024-09-19T09:35:02.700 INFO:tasks.workunit.client.1.smithi191.stdout:2/516: creat d8/d11/fac x:0 0 0 2024-09-19T09:35:02.725 INFO:tasks.workunit.client.1.smithi191.stdout:2/517: dread d8/d2a/f61 [0,4194304] 0 2024-09-19T09:35:02.725 INFO:tasks.workunit.client.1.smithi191.stdout:2/518: write d8/db/d13/d40/f5e [614629,21853] 0 2024-09-19T09:35:02.725 INFO:tasks.workunit.client.1.smithi191.stdout:5/535: dwrite d0/d4/d9/d1d/d22/d3b/f3c [0,4194304] 0 2024-09-19T09:35:02.726 INFO:tasks.workunit.client.1.smithi191.stdout:2/519: creat d8/db/d13/d40/fad x:0 0 0 2024-09-19T09:35:02.733 INFO:tasks.workunit.client.1.smithi191.stdout:2/520: rmdir d8/d11/d3f/d8a 39 2024-09-19T09:35:02.733 INFO:tasks.workunit.client.1.smithi191.stdout:2/521: chown d8/db/d13/c95 251 1 2024-09-19T09:35:02.734 INFO:tasks.workunit.client.1.smithi191.stdout:6/470: dwrite d2/de/d19/d1e/d64/f2c [0,4194304] 0 2024-09-19T09:35:02.734 INFO:tasks.workunit.client.1.smithi191.stdout:8/626: dwrite d1/d16/d3c/f29 [0,4194304] 0 2024-09-19T09:35:02.734 INFO:tasks.workunit.client.1.smithi191.stdout:4/580: dwrite d5/d1b/d1c/d24/d32/d21/d56/fb9 [0,4194304] 0 2024-09-19T09:35:02.735 INFO:tasks.workunit.client.1.smithi191.stdout:2/522: link d8/db/d13/d35/f37 d8/d11/d3f/d8a/fae 0 2024-09-19T09:35:02.735 INFO:tasks.workunit.client.1.smithi191.stdout:2/523: write d8/db/f63 [406610,117722] 0 2024-09-19T09:35:02.736 INFO:tasks.workunit.client.1.smithi191.stdout:9/550: dwrite d3/db/d16/f43 [0,4194304] 0 2024-09-19T09:35:02.736 INFO:tasks.workunit.client.1.smithi191.stdout:9/551: fdatasync d3/db/d16/d17/d81/faf 0 2024-09-19T09:35:02.737 INFO:tasks.workunit.client.1.smithi191.stdout:9/552: write d3/db/d16/d47/d55/f6d [233304,32922] 0 2024-09-19T09:35:02.737 INFO:tasks.workunit.client.1.smithi191.stdout:3/490: dwrite d12/d13/d1a/d1b/d2e/f3a [0,4194304] 0 2024-09-19T09:35:02.738 INFO:tasks.workunit.client.1.smithi191.stdout:6/471: unlink d2/de/d19/d1e/l73 0 2024-09-19T09:35:02.740 INFO:tasks.workunit.client.1.smithi191.stdout:7/535: dwrite d2/f34 [4194304,4194304] 0 2024-09-19T09:35:02.740 INFO:tasks.workunit.client.1.smithi191.stdout:7/536: write d2/d2a/d4f/f7b [879200,25786] 0 2024-09-19T09:35:02.740 INFO:tasks.workunit.client.1.smithi191.stdout:7/537: fdatasync d2/f9d 0 2024-09-19T09:35:02.741 INFO:tasks.workunit.client.1.smithi191.stdout:8/627: unlink d1/d4f/d6b/da9/fbb 0 2024-09-19T09:35:02.746 INFO:tasks.workunit.client.1.smithi191.stdout:4/581: rename d5/d1b/l80 to d5/d1b/d1c/lc4 0 2024-09-19T09:35:02.750 INFO:tasks.workunit.client.1.smithi191.stdout:5/536: dwrite d0/d4/d9/d1d/d29/d33/f38 [0,4194304] 0 2024-09-19T09:35:02.752 INFO:tasks.workunit.client.1.smithi191.stdout:6/472: write d2/de/d2a/d2d/f1b [7421348,16539] 0 2024-09-19T09:35:02.752 INFO:tasks.workunit.client.1.smithi191.stdout:3/491: write d12/d13/d1a/d1b/f66 [1534638,108501] 0 2024-09-19T09:35:02.752 INFO:tasks.workunit.client.1.smithi191.stdout:3/492: chown d12/d13/d1a/d1b/d2e/dab/laf 6349 1 2024-09-19T09:35:02.754 INFO:tasks.workunit.client.1.smithi191.stdout:9/553: creat d3/d60/d78/fbe x:0 0 0 2024-09-19T09:35:02.757 INFO:tasks.workunit.client.1.smithi191.stdout:4/582: mkdir d5/d1b/d1c/d24/d32/d21/d4a/dc5 0 2024-09-19T09:35:02.759 INFO:tasks.workunit.client.1.smithi191.stdout:8/628: rename d1/d16/d3c/d17/da1/l97 to d1/d16/d2e/d7a/lcd 0 2024-09-19T09:35:02.759 INFO:tasks.workunit.client.1.smithi191.stdout:7/538: dwrite d2/d2a/d33/f73 [0,4194304] 0 2024-09-19T09:35:02.760 INFO:tasks.workunit.client.1.smithi191.stdout:2/524: dwrite d8/d11/d3f/d8a/fae [0,4194304] 0 2024-09-19T09:35:02.760 INFO:tasks.workunit.client.1.smithi191.stdout:5/537: creat d0/d4/d9/d1d/d29/d33/d45/fbb x:0 0 0 2024-09-19T09:35:02.763 INFO:tasks.workunit.client.1.smithi191.stdout:6/473: rmdir d2/de/d19/d1e/d64/d77 39 2024-09-19T09:35:02.766 INFO:tasks.workunit.client.1.smithi191.stdout:3/493: creat d12/d13/fb0 x:0 0 0 2024-09-19T09:35:02.768 INFO:tasks.workunit.client.1.smithi191.stdout:4/583: creat d5/d1b/d1c/d24/fc6 x:0 0 0 2024-09-19T09:35:02.770 INFO:tasks.workunit.client.1.smithi191.stdout:7/539: write d2/d2a/d38/f83 [2698941,63930] 0 2024-09-19T09:35:02.770 INFO:tasks.workunit.client.1.smithi191.stdout:7/540: dread - d2/f84 zero size 2024-09-19T09:35:02.770 INFO:tasks.workunit.client.1.smithi191.stdout:8/629: mkdir d1/d16/d2e/d32/dc5/dce 0 2024-09-19T09:35:02.770 INFO:tasks.workunit.client.1.smithi191.stdout:8/630: creat d1/d7/d1a/d6d/da8/fcf x:0 0 0 2024-09-19T09:35:02.775 INFO:tasks.workunit.client.1.smithi191.stdout:5/538: creat d0/d4/d9/d1d/d22/fbc x:0 0 0 2024-09-19T09:35:02.777 INFO:tasks.workunit.client.1.smithi191.stdout:9/554: dwrite d3/db/d53/f6f [0,4194304] 0 2024-09-19T09:35:02.777 INFO:tasks.workunit.client.1.smithi191.stdout:3/494: symlink d12/d43/d61/lb1 0 2024-09-19T09:35:02.778 INFO:tasks.workunit.client.1.smithi191.stdout:4/584: link d5/d1b/d1c/d24/d32/d21/d92/lbb d5/d1b/d1c/d24/d82/lc7 0 2024-09-19T09:35:02.778 INFO:tasks.workunit.client.1.smithi191.stdout:4/585: chown d5/f99 3 1 2024-09-19T09:35:02.780 INFO:tasks.workunit.client.1.smithi191.stdout:8/631: mknod d1/d16/d23/d3e/dcb/cd0 0 2024-09-19T09:35:02.782 INFO:tasks.workunit.client.1.smithi191.stdout:7/541: dread d2/d2a/d38/d63/f95 [0,4194304] 0 2024-09-19T09:35:02.783 INFO:tasks.workunit.client.1.smithi191.stdout:5/539: truncate d0/d1f/f43 3288474 0 2024-09-19T09:35:02.784 INFO:tasks.workunit.client.1.smithi191.stdout:6/474: getdents d2/de/d19/d1e 0 2024-09-19T09:35:02.784 INFO:tasks.workunit.client.1.smithi191.stdout:6/475: creat d2/de/d2a/f96 x:0 0 0 2024-09-19T09:35:02.785 INFO:tasks.workunit.client.1.smithi191.stdout:4/586: dread d5/d1b/d1c/d24/d32/d8f/fbe [0,4194304] 0 2024-09-19T09:35:02.785 INFO:tasks.workunit.client.1.smithi191.stdout:4/587: write d5/d1b/d1c/d24/d32/d21/d5c/fb7 [783753,112614] 0 2024-09-19T09:35:02.787 INFO:tasks.workunit.client.1.smithi191.stdout:9/555: creat d3/fbf x:0 0 0 2024-09-19T09:35:02.788 INFO:tasks.workunit.client.1.smithi191.stdout:3/495: mkdir d12/d43/db2 0 2024-09-19T09:35:02.788 INFO:tasks.workunit.client.1.smithi191.stdout:3/496: fdatasync d12/d13/f14 0 2024-09-19T09:35:02.790 INFO:tasks.workunit.client.1.smithi191.stdout:8/632: rename d1/d16/d3c/d17/da1/d84/l87 to d1/d16/d3c/d28/d79/ld1 0 2024-09-19T09:35:02.790 INFO:tasks.workunit.client.1.smithi191.stdout:8/633: chown d1/d4f/d6b 28129676 1 2024-09-19T09:35:02.791 INFO:tasks.workunit.client.1.smithi191.stdout:5/540: stat d0/d4/d4a/daf/lb2 0 2024-09-19T09:35:02.791 INFO:tasks.workunit.client.1.smithi191.stdout:5/541: readlink d0/l1c 0 2024-09-19T09:35:02.794 INFO:tasks.workunit.client.1.smithi191.stdout:4/588: write d5/d1b/d1c/d24/d32/d21/d5c/fb1 [1708135,17901] 0 2024-09-19T09:35:02.794 INFO:tasks.workunit.client.1.smithi191.stdout:9/556: mkdir d3/db/d16/d17/d3c/dc0 0 2024-09-19T09:35:02.796 INFO:tasks.workunit.client.1.smithi191.stdout:7/542: rename d2/d2a/d38/f42 to d2/d39/d3a/fb6 0 2024-09-19T09:35:02.797 INFO:tasks.workunit.client.1.smithi191.stdout:5/542: mkdir d0/d4/dae/dbd 0 2024-09-19T09:35:02.799 INFO:tasks.workunit.client.1.smithi191.stdout:9/557: unlink d3/db/d16/d47/d55/c42 0 2024-09-19T09:35:02.800 INFO:tasks.workunit.client.1.smithi191.stdout:8/634: rename d1/d16/d3c/d28/d79/c90 to d1/d16/d3c/d28/cd2 0 2024-09-19T09:35:02.801 INFO:tasks.workunit.client.1.smithi191.stdout:9/558: mknod d3/db/d16/d47/d89/cc1 0 2024-09-19T09:35:02.801 INFO:tasks.workunit.client.1.smithi191.stdout:1/544: sync 2024-09-19T09:35:02.801 INFO:tasks.workunit.client.1.smithi191.stdout:0/629: sync 2024-09-19T09:35:02.801 INFO:tasks.workunit.client.1.smithi191.stdout:1/545: truncate d3/d9/da/d92/fb1 287318 0 2024-09-19T09:35:02.801 INFO:tasks.workunit.client.1.smithi191.stdout:1/546: fsync d3/d9/da/d1e/d32/f8b 0 2024-09-19T09:35:02.802 INFO:tasks.workunit.client.1.smithi191.stdout:5/543: dread d0/d77/fad [0,4194304] 0 2024-09-19T09:35:02.802 INFO:tasks.workunit.client.1.smithi191.stdout:5/544: dread - d0/d4/d9/d1d/d22/f6d zero size 2024-09-19T09:35:02.802 INFO:tasks.workunit.client.1.smithi191.stdout:5/545: chown d0/d1f/c3f 63 1 2024-09-19T09:35:02.802 INFO:tasks.workunit.client.1.smithi191.stdout:7/543: rename d2/d39/f62 to d2/d2a/d79/fb7 0 2024-09-19T09:35:02.802 INFO:tasks.workunit.client.1.smithi191.stdout:4/589: dread d5/d1b/d1c/f29 [0,4194304] 0 2024-09-19T09:35:02.802 INFO:tasks.workunit.client.1.smithi191.stdout:4/590: readlink d5/d1b/d1c/d24/d32/d21/l42 0 2024-09-19T09:35:02.802 INFO:tasks.workunit.client.1.smithi191.stdout:0/630: symlink d0/d6f/d76/lcb 0 2024-09-19T09:35:02.803 INFO:tasks.workunit.client.1.smithi191.stdout:0/631: fsync d0/d9/de/f19 0 2024-09-19T09:35:02.803 INFO:tasks.workunit.client.1.smithi191.stdout:5/546: creat d0/d4/d9/d1d/d29/d33/d52/fbe x:0 0 0 2024-09-19T09:35:02.805 INFO:tasks.workunit.client.1.smithi191.stdout:8/635: rename d1/d4f/d6b/da9/dc1/dc6 to d1/d16/d3c/d28/d79/dd3 0 2024-09-19T09:35:02.806 INFO:tasks.workunit.client.1.smithi191.stdout:8/636: truncate d1/d16/d3c/d28/d79/da2/fa3 37011 0 2024-09-19T09:35:02.806 INFO:tasks.workunit.client.1.smithi191.stdout:5/547: symlink d0/d4/d9/d1d/d29/d7f/d94/lbf 0 2024-09-19T09:35:02.811 INFO:tasks.workunit.client.1.smithi191.stdout:9/559: rename d3/db/d16/d47/d93 to d3/db/d53/da2/db3/dc2 0 2024-09-19T09:35:02.811 INFO:tasks.workunit.client.1.smithi191.stdout:1/547: rename d3/d9/da/d1e/d32/d6f/db2 to d3/d9/da/d1e/d32/d6f/db2/dc3/dcc 22 2024-09-19T09:35:02.811 INFO:tasks.workunit.client.1.smithi191.stdout:9/560: fsync d3/db/d16/f88 0 2024-09-19T09:35:02.811 INFO:tasks.workunit.client.1.smithi191.stdout:1/548: fsync d3/d9/da/f20 0 2024-09-19T09:35:02.811 INFO:tasks.workunit.client.1.smithi191.stdout:1/549: fsync d3/d9/da/d1e/d32/f8b 0 2024-09-19T09:35:02.811 INFO:tasks.workunit.client.1.smithi191.stdout:9/561: creat d3/da1/fc3 x:0 0 0 2024-09-19T09:35:02.813 INFO:tasks.workunit.client.1.smithi191.stdout:1/550: creat d3/d9/da/d8c/fcd x:0 0 0 2024-09-19T09:35:02.813 INFO:tasks.workunit.client.1.smithi191.stdout:1/551: dread - d3/d9/da/d8c/fc1 zero size 2024-09-19T09:35:02.813 INFO:tasks.workunit.client.1.smithi191.stdout:1/552: dread - d3/d9/fbe zero size 2024-09-19T09:35:02.813 INFO:tasks.workunit.client.1.smithi191.stdout:1/553: chown d3/d9/f4e 253573889 1 2024-09-19T09:35:02.813 INFO:tasks.workunit.client.1.smithi191.stdout:9/562: unlink f2 0 2024-09-19T09:35:02.816 INFO:tasks.workunit.client.1.smithi191.stdout:9/563: unlink d3/c44 0 2024-09-19T09:35:02.817 INFO:tasks.workunit.client.1.smithi191.stdout:4/591: write d5/d1b/d1c/d24/d32/d21/d56/fb9 [2413071,65618] 0 2024-09-19T09:35:02.820 INFO:tasks.workunit.client.1.smithi191.stdout:6/476: dwrite d2/de/d19/d1e/f3e [4194304,4194304] 0 2024-09-19T09:35:02.820 INFO:tasks.workunit.client.1.smithi191.stdout:0/632: dread d0/d9/f4d [0,4194304] 0 2024-09-19T09:35:02.820 INFO:tasks.workunit.client.1.smithi191.stdout:6/477: write d2/de/d19/d1e/f21 [3017025,63257] 0 2024-09-19T09:35:02.823 INFO:tasks.workunit.client.1.smithi191.stdout:6/478: unlink d2/de/d2a/d84/c94 0 2024-09-19T09:35:02.823 INFO:tasks.workunit.client.1.smithi191.stdout:6/479: readlink d2/de/d2a/d2d/l47 0 2024-09-19T09:35:02.823 INFO:tasks.workunit.client.1.smithi191.stdout:6/480: creat d2/de/d19/d1e/d64/f97 x:0 0 0 2024-09-19T09:35:02.824 INFO:tasks.workunit.client.1.smithi191.stdout:5/548: dread d0/d4/d9/de/f47 [0,4194304] 0 2024-09-19T09:35:02.826 INFO:tasks.workunit.client.1.smithi191.stdout:6/481: mkdir d2/de/d2a/d2d/d30/d98 0 2024-09-19T09:35:02.826 INFO:tasks.workunit.client.1.smithi191.stdout:6/482: stat d2/de/d19/f8b 0 2024-09-19T09:35:02.826 INFO:tasks.workunit.client.1.smithi191.stdout:6/483: creat d2/de/d2a/d2d/f99 x:0 0 0 2024-09-19T09:35:02.826 INFO:tasks.workunit.client.1.smithi191.stdout:6/484: write d2/de/f69 [4586286,111166] 0 2024-09-19T09:35:02.826 INFO:tasks.workunit.client.1.smithi191.stdout:5/549: creat d0/d4/d9/d1d/d29/d7f/fc0 x:0 0 0 2024-09-19T09:35:02.826 INFO:tasks.workunit.client.1.smithi191.stdout:5/550: dread - d0/d4/d9/d1d/d29/d7f/fc0 zero size 2024-09-19T09:35:02.829 INFO:tasks.workunit.client.1.smithi191.stdout:6/485: rename d2/de/d2a/f96 to d2/de/d19/d1e/d64/d76/d88/f9a 0 2024-09-19T09:35:02.830 INFO:tasks.workunit.client.1.smithi191.stdout:3/497: dwrite d12/d13/d1a/d1b/f36 [0,4194304] 0 2024-09-19T09:35:02.830 INFO:tasks.workunit.client.1.smithi191.stdout:3/498: fsync d12/d13/d1a/f6d 0 2024-09-19T09:35:02.830 INFO:tasks.workunit.client.1.smithi191.stdout:3/499: chown d12/d13/d1a 2 1 2024-09-19T09:35:02.832 INFO:tasks.workunit.client.1.smithi191.stdout:3/500: getdents d12/d13/d1a/d1b/d2e/dab/d51 0 2024-09-19T09:35:02.834 INFO:tasks.workunit.client.1.smithi191.stdout:3/501: creat d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/fb3 x:0 0 0 2024-09-19T09:35:02.838 INFO:tasks.workunit.client.1.smithi191.stdout:7/544: dwrite d2/f1b [0,4194304] 0 2024-09-19T09:35:02.839 INFO:tasks.workunit.client.1.smithi191.stdout:5/551: dread d0/d4/d9/de/f8f [0,4194304] 0 2024-09-19T09:35:02.839 INFO:tasks.workunit.client.1.smithi191.stdout:7/545: truncate d2/f9d 5107382 0 2024-09-19T09:35:02.840 INFO:tasks.workunit.client.1.smithi191.stdout:7/546: truncate d2/f28 4170838 0 2024-09-19T09:35:02.841 INFO:tasks.workunit.client.1.smithi191.stdout:7/547: creat d2/d39/d3a/fb8 x:0 0 0 2024-09-19T09:35:02.844 INFO:tasks.workunit.client.1.smithi191.stdout:7/548: truncate d2/d39/d3a/d3c/f6f 166524 0 2024-09-19T09:35:02.844 INFO:tasks.workunit.client.1.smithi191.stdout:7/549: chown d2/c19 2973 1 2024-09-19T09:35:02.845 INFO:tasks.workunit.client.1.smithi191.stdout:7/550: mkdir d2/d2a/d79/da8/db9 0 2024-09-19T09:35:02.845 INFO:tasks.workunit.client.1.smithi191.stdout:7/551: write d2/d2a/d38/f83 [1604251,36934] 0 2024-09-19T09:35:02.846 INFO:tasks.workunit.client.1.smithi191.stdout:7/552: fdatasync d2/d39/d3a/d3c/f6f 0 2024-09-19T09:35:02.848 INFO:tasks.workunit.client.1.smithi191.stdout:7/553: rename d2/d2a/d38/c49 to d2/d2a/d4f/d59/d81/cba 0 2024-09-19T09:35:02.849 INFO:tasks.workunit.client.1.smithi191.stdout:7/554: getdents d2/d2a/d4f/d78 0 2024-09-19T09:35:02.850 INFO:tasks.workunit.client.1.smithi191.stdout:8/637: dwrite d1/d16/d3c/fc [4194304,4194304] 0 2024-09-19T09:35:02.853 INFO:tasks.workunit.client.1.smithi191.stdout:8/638: mkdir d1/d16/d2e/d32/dc5/dce/dd4 0 2024-09-19T09:35:02.855 INFO:tasks.workunit.client.1.smithi191.stdout:8/639: rename d1/d16/d2e/d57/f6e to d1/d7/fd5 0 2024-09-19T09:35:02.855 INFO:tasks.workunit.client.1.smithi191.stdout:5/552: read d0/d4/d9/de/f8f [502112,114848] 0 2024-09-19T09:35:02.856 INFO:tasks.workunit.client.1.smithi191.stdout:1/554: dwrite d3/d9/f9c [0,4194304] 0 2024-09-19T09:35:02.856 INFO:tasks.workunit.client.1.smithi191.stdout:0/633: dwrite d0/d9/d1c/d1f/d24/d39/d58/f67 [0,4194304] 0 2024-09-19T09:35:02.856 INFO:tasks.workunit.client.1.smithi191.stdout:0/634: write d0/d9/d1c/d1f/d24/d39/d8b/fb7 [339344,13528] 0 2024-09-19T09:35:02.856 INFO:tasks.workunit.client.1.smithi191.stdout:4/592: dwrite d5/d1b/d1c/d24/d32/d21/d92/f9e [0,4194304] 0 2024-09-19T09:35:02.856 INFO:tasks.workunit.client.1.smithi191.stdout:3/502: dwrite d12/f81 [0,4194304] 0 2024-09-19T09:35:02.856 INFO:tasks.workunit.client.1.smithi191.stdout:8/640: symlink d1/d4f/ld6 0 2024-09-19T09:35:02.858 INFO:tasks.workunit.client.1.smithi191.stdout:5/553: creat d0/d4/d9/d1d/d22/d5c/fc1 x:0 0 0 2024-09-19T09:35:02.859 INFO:tasks.workunit.client.1.smithi191.stdout:4/593: dread d5/d1b/f67 [0,4194304] 0 2024-09-19T09:35:02.860 INFO:tasks.workunit.client.1.smithi191.stdout:9/564: getdents d3/db/d16/d47 0 2024-09-19T09:35:02.862 INFO:tasks.workunit.client.1.smithi191.stdout:1/555: mknod d3/d9/da/d1e/d32/d53/d57/d6d/da1/da7/cce 0 2024-09-19T09:35:02.862 INFO:tasks.workunit.client.1.smithi191.stdout:1/556: creat d3/d9/da/d42/fcf x:0 0 0 2024-09-19T09:35:02.866 INFO:tasks.workunit.client.1.smithi191.stdout:0/635: creat d0/d9/d1c/d1f/d24/d39/fcc x:0 0 0 2024-09-19T09:35:02.866 INFO:tasks.workunit.client.1.smithi191.stdout:0/636: chown d0/d9/d1c/d1f/d24/d29/d30/d56/l9b 5 1 2024-09-19T09:35:02.866 INFO:tasks.workunit.client.1.smithi191.stdout:0/637: write d0/d9/d1c/d1f/d24/d29/f78 [793481,76284] 0 2024-09-19T09:35:02.869 INFO:tasks.workunit.client.1.smithi191.stdout:8/641: mknod d1/d16/d3c/d17/da1/d84/cd7 0 2024-09-19T09:35:02.869 INFO:tasks.workunit.client.1.smithi191.stdout:8/642: creat d1/d4f/d6b/fd8 x:0 0 0 2024-09-19T09:35:02.870 INFO:tasks.workunit.client.1.smithi191.stdout:5/554: dread d0/d4/d9/d1d/d28/f31 [0,4194304] 0 2024-09-19T09:35:02.871 INFO:tasks.workunit.client.1.smithi191.stdout:9/565: creat d3/db/d53/da2/db3/dc2/fc4 x:0 0 0 2024-09-19T09:35:02.871 INFO:tasks.workunit.client.1.smithi191.stdout:9/566: readlink d3/d8/l7c 0 2024-09-19T09:35:02.871 INFO:tasks.workunit.client.1.smithi191.stdout:9/567: fsync d3/db/d16/d17/d81/f8e 0 2024-09-19T09:35:02.872 INFO:tasks.workunit.client.1.smithi191.stdout:7/555: dwrite d2/d2a/d33/f73 [0,4194304] 0 2024-09-19T09:35:02.872 INFO:tasks.workunit.client.1.smithi191.stdout:1/557: unlink d3/d9/da/db/f1b 0 2024-09-19T09:35:02.873 INFO:tasks.workunit.client.1.smithi191.stdout:6/486: rmdir d2/de/d19 39 2024-09-19T09:35:02.874 INFO:tasks.workunit.client.1.smithi191.stdout:4/594: dwrite d5/d1b/d1c/d28/f48 [0,4194304] 0 2024-09-19T09:35:02.874 INFO:tasks.workunit.client.1.smithi191.stdout:7/556: dread d2/d2a/f74 [0,4194304] 0 2024-09-19T09:35:02.875 INFO:tasks.workunit.client.1.smithi191.stdout:0/638: rename d0/c21 to d0/d9/d1c/d1f/d24/dbe/ccd 0 2024-09-19T09:35:02.875 INFO:tasks.workunit.client.1.smithi191.stdout:0/639: chown d0/d9/d1c/d1f/d24/d39/d7a 3 1 2024-09-19T09:35:02.876 INFO:tasks.workunit.client.1.smithi191.stdout:8/643: dread d1/d16/d3c/f62 [0,4194304] 0 2024-09-19T09:35:02.876 INFO:tasks.workunit.client.1.smithi191.stdout:8/644: write d1/d16/d3c/d17/da1/fc0 [975789,71659] 0 2024-09-19T09:35:02.876 INFO:tasks.workunit.client.1.smithi191.stdout:8/645: chown d1/d7/d1a/l88 30235485 1 2024-09-19T09:35:02.877 INFO:tasks.workunit.client.1.smithi191.stdout:8/646: read d1/f36 [215967,45860] 0 2024-09-19T09:35:02.877 INFO:tasks.workunit.client.1.smithi191.stdout:8/647: write d1/d16/f19 [2019306,106062] 0 2024-09-19T09:35:02.879 INFO:tasks.workunit.client.1.smithi191.stdout:3/503: getdents d12/d13/d1a/d1b/d2e/dab/d51/d62/d86 0 2024-09-19T09:35:02.880 INFO:tasks.workunit.client.1.smithi191.stdout:3/504: write d12/d13/fb0 [716068,79198] 0 2024-09-19T09:35:02.882 INFO:tasks.workunit.client.1.smithi191.stdout:5/555: creat d0/d4/d9/fc2 x:0 0 0 2024-09-19T09:35:02.882 INFO:tasks.workunit.client.1.smithi191.stdout:5/556: chown d0/d4/d9/d1d/d22/f2c 115121 1 2024-09-19T09:35:02.882 INFO:tasks.workunit.client.1.smithi191.stdout:5/557: readlink d0/d4/d9/d1d/d29/d33/d45/l79 0 2024-09-19T09:35:02.882 INFO:tasks.workunit.client.1.smithi191.stdout:5/558: creat d0/d4/d9/d1d/d22/d5c/fc3 x:0 0 0 2024-09-19T09:35:02.883 INFO:tasks.workunit.client.1.smithi191.stdout:9/568: mkdir d3/db/d16/d17/d5b/dc5 0 2024-09-19T09:35:02.898 INFO:tasks.workunit.client.1.smithi191.stdout:4/595: symlink d5/d1b/d1c/d24/d32/d21/d56/lc8 0 2024-09-19T09:35:02.900 INFO:tasks.workunit.client.1.smithi191.stdout:7/557: symlink d2/d39/d3a/lbb 0 2024-09-19T09:35:02.902 INFO:tasks.workunit.client.1.smithi191.stdout:3/505: mknod d12/d13/d1a/d1b/d2e/dab/d51/cb4 0 2024-09-19T09:35:02.904 INFO:tasks.workunit.client.1.smithi191.stdout:8/648: dwrite d1/d16/d3c/d17/f49 [4194304,4194304] 0 2024-09-19T09:35:02.904 INFO:tasks.workunit.client.1.smithi191.stdout:8/649: dread - d1/d7/d1a/d6d/da8/fcf zero size 2024-09-19T09:35:02.906 INFO:tasks.workunit.client.1.smithi191.stdout:0/640: dwrite d0/d9/d1c/d1f/d24/d29/f78 [0,4194304] 0 2024-09-19T09:35:02.906 INFO:tasks.workunit.client.1.smithi191.stdout:9/569: dwrite d3/d60/f7a [0,4194304] 0 2024-09-19T09:35:02.906 INFO:tasks.workunit.client.1.smithi191.stdout:9/570: stat d3/db/d16/d38/d92/c9d 0 2024-09-19T09:35:02.906 INFO:tasks.workunit.client.1.smithi191.stdout:5/559: mknod d0/d4/d88/cc4 0 2024-09-19T09:35:02.906 INFO:tasks.workunit.client.1.smithi191.stdout:6/487: dwrite d2/de/d2a/d2d/f99 [0,4194304] 0 2024-09-19T09:35:02.907 INFO:tasks.workunit.client.1.smithi191.stdout:4/596: mkdir d5/d1b/d8e/dc9 0 2024-09-19T09:35:02.907 INFO:tasks.workunit.client.1.smithi191.stdout:4/597: chown d5/d1b/d1c/d2f/c23 1932373 1 2024-09-19T09:35:02.908 INFO:tasks.workunit.client.1.smithi191.stdout:7/558: symlink d2/d2a/d4f/d78/lbc 0 2024-09-19T09:35:02.908 INFO:tasks.workunit.client.1.smithi191.stdout:7/559: chown d2/d5e/c99 32851 1 2024-09-19T09:35:02.910 INFO:tasks.workunit.client.1.smithi191.stdout:1/558: rename d3/d9/da/d42/fcf to d3/d9/da/d1e/d25/d70/da0/fd0 0 2024-09-19T09:35:02.911 INFO:tasks.workunit.client.1.smithi191.stdout:3/506: creat d12/d13/d1a/d1b/d2e/dab/d3d/d91/fb5 x:0 0 0 2024-09-19T09:35:02.915 INFO:tasks.workunit.client.1.smithi191.stdout:8/650: link d1/d16/d2e/f8e d1/d4f/d6b/da9/dc1/fd9 0 2024-09-19T09:35:02.915 INFO:tasks.workunit.client.1.smithi191.stdout:8/651: chown d1/d16/d2e/f38 226 1 2024-09-19T09:35:02.915 INFO:tasks.workunit.client.1.smithi191.stdout:8/652: chown d1/d4f/d6b/d83 13328370 1 2024-09-19T09:35:02.915 INFO:tasks.workunit.client.1.smithi191.stdout:8/653: dread - d1/d16/d3c/d17/f9a zero size 2024-09-19T09:35:02.915 INFO:tasks.workunit.client.1.smithi191.stdout:8/654: readlink d1/d16/d2e/d32/l78 0 2024-09-19T09:35:02.915 INFO:tasks.workunit.client.1.smithi191.stdout:4/598: dread d5/f4e [0,4194304] 0 2024-09-19T09:35:02.916 INFO:tasks.workunit.client.1.smithi191.stdout:4/599: write d5/d1b/d1c/d2f/f9d [2502518,116021] 0 2024-09-19T09:35:02.916 INFO:tasks.workunit.client.1.smithi191.stdout:9/571: mknod d3/db/d16/d17/d81/da6/cc6 0 2024-09-19T09:35:02.918 INFO:tasks.workunit.client.1.smithi191.stdout:5/560: creat d0/d4/d9/d1d/d29/fc5 x:0 0 0 2024-09-19T09:35:02.920 INFO:tasks.workunit.client.1.smithi191.stdout:9/572: dread d3/db/f31 [0,4194304] 0 2024-09-19T09:35:02.922 INFO:tasks.workunit.client.1.smithi191.stdout:8/655: creat d1/d4f/d6b/db9/fda x:0 0 0 2024-09-19T09:35:02.924 INFO:tasks.workunit.client.1.smithi191.stdout:4/600: unlink d5/d1b/d8e/f93 0 2024-09-19T09:35:02.925 INFO:tasks.workunit.client.1.smithi191.stdout:4/601: write d5/d1b/d1c/f5a [4959617,18145] 0 2024-09-19T09:35:02.925 INFO:tasks.workunit.client.1.smithi191.stdout:4/602: creat d5/d1b/d1c/d24/d82/fca x:0 0 0 2024-09-19T09:35:02.925 INFO:tasks.workunit.client.1.smithi191.stdout:5/561: mknod d0/d4/dae/dbd/cc6 0 2024-09-19T09:35:02.926 INFO:tasks.workunit.client.1.smithi191.stdout:5/562: truncate d0/d4/d9/d1d/d22/f6d 830109 0 2024-09-19T09:35:02.926 INFO:tasks.workunit.client.1.smithi191.stdout:4/603: read f1 [1614179,117218] 0 2024-09-19T09:35:02.926 INFO:tasks.workunit.client.1.smithi191.stdout:9/573: symlink d3/db/d16/d38/lc7 0 2024-09-19T09:35:02.929 INFO:tasks.workunit.client.1.smithi191.stdout:8/656: symlink d1/d4f/d6b/da9/ldb 0 2024-09-19T09:35:02.929 INFO:tasks.workunit.client.1.smithi191.stdout:8/657: write d1/f36 [27661,36767] 0 2024-09-19T09:35:02.931 INFO:tasks.workunit.client.1.smithi191.stdout:5/563: rename d0/d4/d9/d1d/d29/d33/l82 to d0/d4/d9/de/lc7 0 2024-09-19T09:35:02.931 INFO:tasks.workunit.client.1.smithi191.stdout:5/564: write d0/d4/d9/d1d/d28/d53/f70 [1354701,121756] 0 2024-09-19T09:35:02.931 INFO:tasks.workunit.client.1.smithi191.stdout:5/565: fdatasync d0/f20 0 2024-09-19T09:35:02.933 INFO:tasks.workunit.client.1.smithi191.stdout:8/658: symlink d1/d4f/d6b/da9/ldc 0 2024-09-19T09:35:02.933 INFO:tasks.workunit.client.1.smithi191.stdout:7/560: rmdir d2/d2a/d4f 39 2024-09-19T09:35:02.933 INFO:tasks.workunit.client.1.smithi191.stdout:7/561: creat d2/d2a/d79/da8/fbd x:0 0 0 2024-09-19T09:35:02.935 INFO:tasks.workunit.client.1.smithi191.stdout:9/574: rename d3/da1/fbc to d3/db/d16/d47/d89/fc8 0 2024-09-19T09:35:02.938 INFO:tasks.workunit.client.1.smithi191.stdout:2/525: sync 2024-09-19T09:35:02.938 INFO:tasks.workunit.client.1.smithi191.stdout:2/526: read - d8/f9c zero size 2024-09-19T09:35:02.939 INFO:tasks.workunit.client.1.smithi191.stdout:5/566: link d0/d4/f37 d0/d4/d88/fc8 0 2024-09-19T09:35:02.939 INFO:tasks.workunit.client.1.smithi191.stdout:5/567: dread - d0/d4/d9/d1d/d29/d33/d45/fbb zero size 2024-09-19T09:35:02.940 INFO:tasks.workunit.client.1.smithi191.stdout:9/575: rmdir d3/db/d53/da2/db3 39 2024-09-19T09:35:02.940 INFO:tasks.workunit.client.1.smithi191.stdout:9/576: chown d3/db/d16/d38/f48 2383 1 2024-09-19T09:35:02.947 INFO:tasks.workunit.client.1.smithi191.stdout:8/659: dread d1/d16/d2e/f38 [4194304,4194304] 0 2024-09-19T09:35:02.947 INFO:tasks.workunit.client.1.smithi191.stdout:8/660: fsync d1/d16/d3c/fc 0 2024-09-19T09:35:02.947 INFO:tasks.workunit.client.1.smithi191.stdout:8/661: read - d1/d16/d2e/f8e zero size 2024-09-19T09:35:02.949 INFO:tasks.workunit.client.1.smithi191.stdout:6/488: dwrite d2/de/f16 [0,4194304] 0 2024-09-19T09:35:02.950 INFO:tasks.workunit.client.1.smithi191.stdout:1/559: dwrite d3/d9/da/d1e/d25/d70/da0/fd0 [0,4194304] 0 2024-09-19T09:35:02.951 INFO:tasks.workunit.client.1.smithi191.stdout:6/489: rename d2/de/d19/d1e/d64/d76/d88 to d2/de/d2a/d2d/d30/d98/d9b 0 2024-09-19T09:35:02.955 INFO:tasks.workunit.client.1.smithi191.stdout:0/641: dwrite d0/d9/d1c/d1f/d24/d29/d30/f5b [0,4194304] 0 2024-09-19T09:35:02.955 INFO:tasks.workunit.client.1.smithi191.stdout:0/642: chown d0/d9/d1c/d1f/d24/dbe/ccd 2 1 2024-09-19T09:35:02.955 INFO:tasks.workunit.client.1.smithi191.stdout:0/643: chown d0/d9/c42 20318 1 2024-09-19T09:35:02.955 INFO:tasks.workunit.client.1.smithi191.stdout:0/644: dread - d0/d9/d1c/d20/fa6 zero size 2024-09-19T09:35:02.955 INFO:tasks.workunit.client.1.smithi191.stdout:1/560: fsync d3/d9/da/d1e/d32/d53/f1c 0 2024-09-19T09:35:02.956 INFO:tasks.workunit.client.1.smithi191.stdout:6/490: symlink d2/de/d19/d1e/l9c 0 2024-09-19T09:35:02.959 INFO:tasks.workunit.client.1.smithi191.stdout:1/561: dread d3/d9/da/d7e/fac [0,4194304] 0 2024-09-19T09:35:02.959 INFO:tasks.workunit.client.1.smithi191.stdout:1/562: read d3/f3f [329104,22266] 0 2024-09-19T09:35:02.960 INFO:tasks.workunit.client.1.smithi191.stdout:8/662: write d1/d16/d3c/d28/d79/f7f [6857279,129072] 0 2024-09-19T09:35:02.960 INFO:tasks.workunit.client.1.smithi191.stdout:8/663: read d1/d16/d3c/d28/f33 [4070102,11982] 0 2024-09-19T09:35:02.961 INFO:tasks.workunit.client.1.smithi191.stdout:6/491: write d2/de/d19/d1e/d64/f4d [1280067,38598] 0 2024-09-19T09:35:02.962 INFO:tasks.workunit.client.1.smithi191.stdout:4/604: dwrite d5/d1b/d1c/d2f/d37/f7a [0,4194304] 0 2024-09-19T09:35:02.962 INFO:tasks.workunit.client.1.smithi191.stdout:0/645: symlink d0/d9/de/lce 0 2024-09-19T09:35:02.962 INFO:tasks.workunit.client.1.smithi191.stdout:0/646: dread - d0/d9/d1c/d1f/d24/d29/d30/fc3 zero size 2024-09-19T09:35:02.962 INFO:tasks.workunit.client.1.smithi191.stdout:0/647: chown d0/d9/l5a 78 1 2024-09-19T09:35:02.963 INFO:tasks.workunit.client.1.smithi191.stdout:1/563: rename d3/d9/da/d1e/d32/d6f/db2/dc3 to d3/d9/da/d1e/d32/d6f/db2/dd1 0 2024-09-19T09:35:02.964 INFO:tasks.workunit.client.1.smithi191.stdout:7/562: dwrite d2/d2a/d33/f54 [0,4194304] 0 2024-09-19T09:35:02.964 INFO:tasks.workunit.client.1.smithi191.stdout:7/563: chown d2/c2b 57333157 1 2024-09-19T09:35:02.965 INFO:tasks.workunit.client.1.smithi191.stdout:8/664: unlink d1/f5e 0 2024-09-19T09:35:02.965 INFO:tasks.workunit.client.1.smithi191.stdout:8/665: stat d1/d16/d3c/d17/f9a 0 2024-09-19T09:35:02.965 INFO:tasks.workunit.client.1.smithi191.stdout:2/527: dwrite d8/d2a/f53 [4194304,4194304] 0 2024-09-19T09:35:02.969 INFO:tasks.workunit.client.1.smithi191.stdout:4/605: rmdir d5/dbc 0 2024-09-19T09:35:02.969 INFO:tasks.workunit.client.1.smithi191.stdout:4/606: creat d5/d1b/d1c/d24/d32/d21/d4a/fcb x:0 0 0 2024-09-19T09:35:02.970 INFO:tasks.workunit.client.1.smithi191.stdout:7/564: dread d2/d2a/f2f [0,4194304] 0 2024-09-19T09:35:02.977 INFO:tasks.workunit.client.1.smithi191.stdout:1/564: creat d3/dbd/fd2 x:0 0 0 2024-09-19T09:35:02.977 INFO:tasks.workunit.client.1.smithi191.stdout:0/648: dwrite d0/d9/de/f10 [0,4194304] 0 2024-09-19T09:35:02.979 INFO:tasks.workunit.client.1.smithi191.stdout:1/565: write d3/d9/da/d1e/d32/d53/d57/d6d/f77 [656708,32852] 0 2024-09-19T09:35:02.979 INFO:tasks.workunit.client.1.smithi191.stdout:1/566: stat d3/d9/da/d42/f55 0 2024-09-19T09:35:02.980 INFO:tasks.workunit.client.1.smithi191.stdout:8/666: mkdir d1/d4f/d6b/d83/d98/ddd 0 2024-09-19T09:35:02.983 INFO:tasks.workunit.client.1.smithi191.stdout:6/492: rmdir d2/de/d15 39 2024-09-19T09:35:02.983 INFO:tasks.workunit.client.1.smithi191.stdout:6/493: dread - d2/de/d19/d1e/d64/f8f zero size 2024-09-19T09:35:02.986 INFO:tasks.workunit.client.1.smithi191.stdout:4/607: rename d5/d1b/d1c/d24/d32/d21/f69 to d5/d1b/d8e/fcc 0 2024-09-19T09:35:02.990 INFO:tasks.workunit.client.1.smithi191.stdout:7/565: symlink d2/d2a/d4f/d59/lbe 0 2024-09-19T09:35:02.991 INFO:tasks.workunit.client.1.smithi191.stdout:0/649: dwrite d0/d6f/d76/f7d [0,4194304] 0 2024-09-19T09:35:02.992 INFO:tasks.workunit.client.1.smithi191.stdout:1/567: symlink d3/d9/da/d8c/d97/ld3 0 2024-09-19T09:35:02.993 INFO:tasks.workunit.client.1.smithi191.stdout:8/667: fsync d1/d16/f46 0 2024-09-19T09:35:02.994 INFO:tasks.workunit.client.1.smithi191.stdout:2/528: rmdir d8/d11/d98 39 2024-09-19T09:35:02.996 INFO:tasks.workunit.client.1.smithi191.stdout:7/566: mkdir d2/d39/d3a/d3c/dbf 0 2024-09-19T09:35:02.999 INFO:tasks.workunit.client.1.smithi191.stdout:0/650: symlink d0/d6f/lcf 0 2024-09-19T09:35:03.000 INFO:tasks.workunit.client.1.smithi191.stdout:1/568: creat d3/d9/d73/fd4 x:0 0 0 2024-09-19T09:35:03.000 INFO:tasks.workunit.client.1.smithi191.stdout:8/668: rmdir d1/d16/d2e/d32/dc5 39 2024-09-19T09:35:03.001 INFO:tasks.workunit.client.1.smithi191.stdout:2/529: write d8/db/d41/f93 [856970,48417] 0 2024-09-19T09:35:03.006 INFO:tasks.workunit.client.1.smithi191.stdout:0/651: mkdir d0/d9/d1c/d1f/d24/d87/dd0 0 2024-09-19T09:35:03.007 INFO:tasks.workunit.client.1.smithi191.stdout:1/569: mknod d3/d9/da/d1e/d32/d6f/cd5 0 2024-09-19T09:35:03.007 INFO:tasks.workunit.client.1.smithi191.stdout:1/570: truncate d3/d9/da/d92/fc5 185371 0 2024-09-19T09:35:03.008 INFO:tasks.workunit.client.1.smithi191.stdout:8/669: link d1/d16/d3c/d17/da1/c66 d1/d16/d2e/d32/cde 0 2024-09-19T09:35:03.008 INFO:tasks.workunit.client.1.smithi191.stdout:8/670: chown d1/d4f/d6b/da9/dc1/fd9 0 1 2024-09-19T09:35:03.011 INFO:tasks.workunit.client.1.smithi191.stdout:1/571: link d3/d9/da/d1e/d32/l59 d3/d9/da/d1e/d32/d6f/db2/ld6 0 2024-09-19T09:35:03.011 INFO:tasks.workunit.client.1.smithi191.stdout:1/572: chown d3/d9/da/d1e/d32/d6f/db2/ld6 23447156 1 2024-09-19T09:35:03.011 INFO:tasks.workunit.client.1.smithi191.stdout:8/671: symlink d1/d16/d3c/d17/ldf 0 2024-09-19T09:35:03.011 INFO:tasks.workunit.client.1.smithi191.stdout:8/672: dread - d1/d22/fb2 zero size 2024-09-19T09:35:03.012 INFO:tasks.workunit.client.1.smithi191.stdout:8/673: stat d1/d7/d1a/d6d/fba 0 2024-09-19T09:35:03.012 INFO:tasks.workunit.client.1.smithi191.stdout:2/530: symlink d8/d11/laf 0 2024-09-19T09:35:03.012 INFO:tasks.workunit.client.1.smithi191.stdout:2/531: stat d8/d11/d98/f9a 0 2024-09-19T09:35:03.012 INFO:tasks.workunit.client.1.smithi191.stdout:2/532: stat d8/db/d13/c95 0 2024-09-19T09:35:03.013 INFO:tasks.workunit.client.1.smithi191.stdout:2/533: creat d8/db/d13/d23/fb0 x:0 0 0 2024-09-19T09:35:03.014 INFO:tasks.workunit.client.1.smithi191.stdout:8/674: mkdir d1/d16/d3c/d28/d79/dd3/de0 0 2024-09-19T09:35:03.014 INFO:tasks.workunit.client.1.smithi191.stdout:8/675: write d1/d16/d3c/d17/f9a [440513,56294] 0 2024-09-19T09:35:03.014 INFO:tasks.workunit.client.1.smithi191.stdout:4/608: dwrite d5/d1b/d1c/d24/d32/d21/d92/f9e [4194304,4194304] 0 2024-09-19T09:35:03.015 INFO:tasks.workunit.client.1.smithi191.stdout:7/567: dwrite d2/f23 [0,4194304] 0 2024-09-19T09:35:03.016 INFO:tasks.workunit.client.1.smithi191.stdout:2/534: symlink d8/db/d13/d35/lb1 0 2024-09-19T09:35:03.016 INFO:tasks.workunit.client.1.smithi191.stdout:2/535: chown d8/d11/d3f/d64/f66 1752 1 2024-09-19T09:35:03.021 INFO:tasks.workunit.client.1.smithi191.stdout:0/652: dread d0/d9/d1c/d1f/d24/d29/f3d [0,4194304] 0 2024-09-19T09:35:03.027 INFO:tasks.workunit.client.1.smithi191.stdout:7/568: mknod d2/d39/d3a/d3c/cc0 0 2024-09-19T09:35:03.030 INFO:tasks.workunit.client.1.smithi191.stdout:1/573: rename d3/d9/da/d92 to d3/dd7 0 2024-09-19T09:35:03.031 INFO:tasks.workunit.client.1.smithi191.stdout:1/574: chown d3/d9/da/d8c/c8e 1250136 1 2024-09-19T09:35:03.032 INFO:tasks.workunit.client.1.smithi191.stdout:2/536: mknod d8/db/d41/cb2 0 2024-09-19T09:35:03.032 INFO:tasks.workunit.client.1.smithi191.stdout:2/537: creat d8/db/d13/d40/fb3 x:0 0 0 2024-09-19T09:35:03.032 INFO:tasks.workunit.client.1.smithi191.stdout:1/575: dread d3/dd7/fb1 [0,4194304] 0 2024-09-19T09:35:03.033 INFO:tasks.workunit.client.1.smithi191.stdout:0/653: unlink d0/d9/c46 0 2024-09-19T09:35:03.034 INFO:tasks.workunit.client.1.smithi191.stdout:2/538: mknod d8/cb4 0 2024-09-19T09:35:03.035 INFO:tasks.workunit.client.1.smithi191.stdout:2/539: creat d8/db/d41/fb5 x:0 0 0 2024-09-19T09:35:03.036 INFO:tasks.workunit.client.1.smithi191.stdout:8/676: dwrite d1/d16/d2e/d57/f7d [4194304,4194304] 0 2024-09-19T09:35:03.037 INFO:tasks.workunit.client.1.smithi191.stdout:4/609: dwrite d5/d1b/d8e/fcc [0,4194304] 0 2024-09-19T09:35:03.037 INFO:tasks.workunit.client.1.smithi191.stdout:0/654: mkdir d0/d9/dd1 0 2024-09-19T09:35:03.068 INFO:tasks.workunit.client.1.smithi191.stdout:0/655: mknod d0/d9/d1c/d1f/d24/d29/d30/d7c/cd2 0 2024-09-19T09:35:03.069 INFO:tasks.workunit.client.1.smithi191.stdout:1/576: dwrite d3/d9/da/d7e/fb6 [0,4194304] 0 2024-09-19T09:35:03.071 INFO:tasks.workunit.client.1.smithi191.stdout:4/610: write d5/d1b/d61/fb6 [580465,130615] 0 2024-09-19T09:35:03.075 INFO:tasks.workunit.client.1.smithi191.stdout:4/611: rmdir d5/d38/d73 39 2024-09-19T09:35:03.075 INFO:tasks.workunit.client.1.smithi191.stdout:4/612: read - d5/d1b/d1c/d24/fc6 zero size 2024-09-19T09:35:03.076 INFO:tasks.workunit.client.1.smithi191.stdout:8/677: rename d1/d4f to d1/d7/d1a/d6d/de1 0 2024-09-19T09:35:03.077 INFO:tasks.workunit.client.1.smithi191.stdout:4/613: truncate d5/fe 474864 0 2024-09-19T09:35:03.078 INFO:tasks.workunit.client.1.smithi191.stdout:0/656: rename d0/d9/de/d61/fc4 to d0/d9/d1c/d1f/d24/dbe/fd3 0 2024-09-19T09:35:03.079 INFO:tasks.workunit.client.1.smithi191.stdout:8/678: creat d1/d7/d1a/fe2 x:0 0 0 2024-09-19T09:35:03.080 INFO:tasks.workunit.client.1.smithi191.stdout:8/679: write d1/d16/d3c/d17/f9a [1332211,38216] 0 2024-09-19T09:35:03.080 INFO:tasks.workunit.client.1.smithi191.stdout:4/614: symlink d5/d1b/d1c/d24/d32/d21/d5c/da9/lcd 0 2024-09-19T09:35:03.081 INFO:tasks.workunit.client.1.smithi191.stdout:0/657: creat d0/d9/de/d61/dbf/fd4 x:0 0 0 2024-09-19T09:35:03.083 INFO:tasks.workunit.client.1.smithi191.stdout:4/615: rename d5/d1b/d1c/d24/d32/fa3 to d5/d1b/d1c/d24/d32/d21/d78/fce 0 2024-09-19T09:35:03.083 INFO:tasks.workunit.client.1.smithi191.stdout:1/577: dwrite d3/d9/da/d1e/d32/d53/d57/d6d/fa5 [0,4194304] 0 2024-09-19T09:35:03.085 INFO:tasks.workunit.client.1.smithi191.stdout:8/680: dread d1/d16/d3c/d17/da1/fc0 [0,4194304] 0 2024-09-19T09:35:03.085 INFO:tasks.workunit.client.1.smithi191.stdout:8/681: chown d1/d7/d1a/d6d/de1/d6b/da9/ldb 51160153 1 2024-09-19T09:35:03.085 INFO:tasks.workunit.client.1.smithi191.stdout:0/658: rename d0/d9/d1c/d1f/d24/d39/d58/c6e to d0/d9/d1c/d1f/d24/d39/cd5 0 2024-09-19T09:35:03.085 INFO:tasks.workunit.client.1.smithi191.stdout:0/659: chown d0/d9/de/l4f 3006504 1 2024-09-19T09:35:03.087 INFO:tasks.workunit.client.1.smithi191.stdout:4/616: dread d5/d1b/f67 [0,4194304] 0 2024-09-19T09:35:03.087 INFO:tasks.workunit.client.1.smithi191.stdout:4/617: fsync d5/d1b/d1c/d24/d32/d21/d92/f9e 0 2024-09-19T09:35:03.088 INFO:tasks.workunit.client.1.smithi191.stdout:1/578: truncate d3/d9/da/d1e/d25/f98 1936959 0 2024-09-19T09:35:03.089 INFO:tasks.workunit.client.1.smithi191.stdout:1/579: chown d3/l16 10 1 2024-09-19T09:35:03.089 INFO:tasks.workunit.client.1.smithi191.stdout:1/580: truncate d3/d9/d73/d94/f96 41319 0 2024-09-19T09:35:03.090 INFO:tasks.workunit.client.1.smithi191.stdout:4/618: rename d5/d1b/d1c/d2f/c6e to d5/ccf 0 2024-09-19T09:35:03.094 INFO:tasks.workunit.client.1.smithi191.stdout:1/581: mkdir d3/d9/da/d1e/d32/d53/dd8 0 2024-09-19T09:35:03.095 INFO:tasks.workunit.client.1.smithi191.stdout:4/619: getdents d5/d1b/d61 0 2024-09-19T09:35:03.097 INFO:tasks.workunit.client.1.smithi191.stdout:4/620: creat d5/d1b/d1c/fd0 x:0 0 0 2024-09-19T09:35:03.098 INFO:tasks.workunit.client.1.smithi191.stdout:4/621: write d5/f4e [1464236,53991] 0 2024-09-19T09:35:03.104 INFO:tasks.workunit.client.1.smithi191.stdout:2/540: fsync d8/db/d41/fb5 0 2024-09-19T09:35:03.104 INFO:tasks.workunit.client.1.smithi191.stdout:2/541: write d8/d11/d56/f8c [861505,83084] 0 2024-09-19T09:35:03.104 INFO:tasks.workunit.client.1.smithi191.stdout:4/622: dread d5/d1b/d1c/d2f/f52 [0,4194304] 0 2024-09-19T09:35:03.105 INFO:tasks.workunit.client.1.smithi191.stdout:4/623: write d5/d1b/d1c/d2f/d37/d59/fbf [882898,35462] 0 2024-09-19T09:35:03.105 INFO:tasks.workunit.client.1.smithi191.stdout:4/624: read - d5/f99 zero size 2024-09-19T09:35:03.106 INFO:tasks.workunit.client.1.smithi191.stdout:3/507: sync 2024-09-19T09:35:03.106 INFO:tasks.workunit.client.1.smithi191.stdout:3/508: chown fe 1460573 1 2024-09-19T09:35:03.106 INFO:tasks.workunit.client.1.smithi191.stdout:3/509: truncate d12/d13/d1a/f5c 407290 0 2024-09-19T09:35:03.106 INFO:tasks.workunit.client.1.smithi191.stdout:3/510: getdents d12/d13/d1a/d1b/d2e/dab/d51/d62/d85 0 2024-09-19T09:35:03.107 INFO:tasks.workunit.client.1.smithi191.stdout:4/625: unlink d5/f18 0 2024-09-19T09:35:03.107 INFO:tasks.workunit.client.1.smithi191.stdout:4/626: dread - d5/d1b/d8e/fb5 zero size 2024-09-19T09:35:03.108 INFO:tasks.workunit.client.1.smithi191.stdout:8/682: dwrite d1/d16/d3c/d28/fa0 [0,4194304] 0 2024-09-19T09:35:03.108 INFO:tasks.workunit.client.1.smithi191.stdout:3/511: symlink d12/d13/d1a/d1b/d60/d7a/d93/dad/d73/lb6 0 2024-09-19T09:35:03.109 INFO:tasks.workunit.client.1.smithi191.stdout:3/512: truncate d12/d13/d1a/d1b/d3c/d3f/f75 935563 0 2024-09-19T09:35:03.111 INFO:tasks.workunit.client.1.smithi191.stdout:1/582: dread d3/d9/da/db/d48/f65 [0,4194304] 0 2024-09-19T09:35:03.113 INFO:tasks.workunit.client.1.smithi191.stdout:3/513: rename d12/d13/d1a/d28/f34 to d12/d13/d1a/d1b/d2e/dab/d3d/d91/fb7 0 2024-09-19T09:35:03.114 INFO:tasks.workunit.client.1.smithi191.stdout:1/583: truncate d3/d9/da/d1e/d25/f29 603088 0 2024-09-19T09:35:03.115 INFO:tasks.workunit.client.1.smithi191.stdout:1/584: creat d3/d9/fd9 x:0 0 0 2024-09-19T09:35:03.115 INFO:tasks.workunit.client.1.smithi191.stdout:3/514: mknod d12/d13/d1a/d1b/d2e/dab/da6/cb8 0 2024-09-19T09:35:03.118 INFO:tasks.workunit.client.1.smithi191.stdout:1/585: mkdir d3/d9/dda 0 2024-09-19T09:35:03.122 INFO:tasks.workunit.client.1.smithi191.stdout:1/586: truncate d3/d9/f9c 1607226 0 2024-09-19T09:35:03.124 INFO:tasks.workunit.client.1.smithi191.stdout:1/587: creat d3/d9/da/d1e/d32/d53/dd8/fdb x:0 0 0 2024-09-19T09:35:03.125 INFO:tasks.workunit.client.1.smithi191.stdout:1/588: truncate d3/d9/fc0 547460 0 2024-09-19T09:35:03.125 INFO:tasks.workunit.client.1.smithi191.stdout:1/589: mkdir d3/d9/da/d1e/d32/ddc 0 2024-09-19T09:35:03.127 INFO:tasks.workunit.client.1.smithi191.stdout:9/577: sync 2024-09-19T09:35:03.127 INFO:tasks.workunit.client.1.smithi191.stdout:6/494: sync 2024-09-19T09:35:03.127 INFO:tasks.workunit.client.1.smithi191.stdout:5/568: sync 2024-09-19T09:35:03.127 INFO:tasks.workunit.client.1.smithi191.stdout:8/683: dread d1/d16/d2e/d57/f7d [4194304,4194304] 0 2024-09-19T09:35:03.127 INFO:tasks.workunit.client.1.smithi191.stdout:5/569: rmdir d0/d4/d9/d1d/d22/d5c/da9 0 2024-09-19T09:35:03.131 INFO:tasks.workunit.client.1.smithi191.stdout:8/684: unlink d1/d16/d3c/d17/da1/c76 0 2024-09-19T09:35:03.131 INFO:tasks.workunit.client.1.smithi191.stdout:8/685: truncate d1/d16/d3c/f29 4559468 0 2024-09-19T09:35:03.132 INFO:tasks.workunit.client.1.smithi191.stdout:8/686: getdents d1/d7/d1a/d6d/de1/d6b/db9 0 2024-09-19T09:35:03.133 INFO:tasks.workunit.client.1.smithi191.stdout:4/627: dwrite d5/d1b/d1c/d24/d32/d21/d56/fb9 [0,4194304] 0 2024-09-19T09:35:03.133 INFO:tasks.workunit.client.1.smithi191.stdout:4/628: chown d5/d1b/d1c/d24/d32/d21/d27 485270127 1 2024-09-19T09:35:03.133 INFO:tasks.workunit.client.1.smithi191.stdout:4/629: dread d5/d1b/d1c/d2f/d37/d59/fa0 [0,4194304] 0 2024-09-19T09:35:03.136 INFO:tasks.workunit.client.1.smithi191.stdout:5/570: rmdir d0/d4/d9/d1d/d29 39 2024-09-19T09:35:03.137 INFO:tasks.workunit.client.1.smithi191.stdout:8/687: rename d1/d16/d2e/d32/cde to d1/d16/d2e/d32/ce3 0 2024-09-19T09:35:03.138 INFO:tasks.workunit.client.1.smithi191.stdout:8/688: stat d1/d22/f81 0 2024-09-19T09:35:03.138 INFO:tasks.workunit.client.1.smithi191.stdout:5/571: symlink d0/d4/d9/d1d/d22/d3b/db9/lc9 0 2024-09-19T09:35:03.140 INFO:tasks.workunit.client.1.smithi191.stdout:8/689: stat d1/d16/c7b 0 2024-09-19T09:35:03.140 INFO:tasks.workunit.client.1.smithi191.stdout:8/690: fsync d1/f36 0 2024-09-19T09:35:03.140 INFO:tasks.workunit.client.1.smithi191.stdout:8/691: read - d1/d16/d3c/f67 zero size 2024-09-19T09:35:03.140 INFO:tasks.workunit.client.1.smithi191.stdout:5/572: mkdir d0/d4/d9/d1d/d29/d33/d52/dca 0 2024-09-19T09:35:03.141 INFO:tasks.workunit.client.1.smithi191.stdout:4/630: dread d5/d1b/d1c/d24/d32/f36 [0,4194304] 0 2024-09-19T09:35:03.142 INFO:tasks.workunit.client.1.smithi191.stdout:8/692: creat d1/d16/d3c/d17/da1/d84/fe4 x:0 0 0 2024-09-19T09:35:03.142 INFO:tasks.workunit.client.1.smithi191.stdout:4/631: dread d5/d1b/d1c/d24/d32/d21/d78/f79 [0,4194304] 0 2024-09-19T09:35:03.142 INFO:tasks.workunit.client.1.smithi191.stdout:4/632: truncate d5/d1b/d1c/d24/d32/d21/d5c/fb4 506723 0 2024-09-19T09:35:03.143 INFO:tasks.workunit.client.1.smithi191.stdout:5/573: mkdir d0/da7/dcb 0 2024-09-19T09:35:03.144 INFO:tasks.workunit.client.1.smithi191.stdout:8/693: mkdir d1/d7/d1a/d6d/de1/d6b/d83/d98/de5 0 2024-09-19T09:35:03.145 INFO:tasks.workunit.client.1.smithi191.stdout:5/574: mknod d0/d4/d4a/daf/ccc 0 2024-09-19T09:35:03.146 INFO:tasks.workunit.client.1.smithi191.stdout:8/694: link d1/d16/d3c/d28/d79/da2/caa d1/d7/d1a/d6d/de1/d6b/d83/dab/ce6 0 2024-09-19T09:35:03.147 INFO:tasks.workunit.client.1.smithi191.stdout:2/542: dwrite d8/d11/d3f/d64/f66 [0,4194304] 0 2024-09-19T09:35:03.147 INFO:tasks.workunit.client.1.smithi191.stdout:2/543: write d8/d11/d3f/f39 [141633,27715] 0 2024-09-19T09:35:03.147 INFO:tasks.workunit.client.1.smithi191.stdout:9/578: dwrite d3/d8/f86 [0,4194304] 0 2024-09-19T09:35:03.148 INFO:tasks.workunit.client.1.smithi191.stdout:9/579: stat d3/db/d53/fbd 0 2024-09-19T09:35:03.149 INFO:tasks.workunit.client.1.smithi191.stdout:5/575: mkdir d0/da7/dcd 0 2024-09-19T09:35:03.150 INFO:tasks.workunit.client.1.smithi191.stdout:8/695: rename d1/d16/d3c/d28/d79/dd3/de0 to d1/d16/d2e/d32/de7 0 2024-09-19T09:35:03.160 INFO:tasks.workunit.client.1.smithi191.stdout:2/544: creat d8/db/fb6 x:0 0 0 2024-09-19T09:35:03.160 INFO:tasks.workunit.client.1.smithi191.stdout:2/545: dread - d8/db/d4e/fa7 zero size 2024-09-19T09:35:03.163 INFO:tasks.workunit.client.1.smithi191.stdout:5/576: mknod d0/d4/d9/d1d/d22/d3b/cce 0 2024-09-19T09:35:03.164 INFO:tasks.workunit.client.1.smithi191.stdout:8/696: rename d1/d22/c75 to d1/d7/ce8 0 2024-09-19T09:35:03.167 INFO:tasks.workunit.client.1.smithi191.stdout:5/577: dread d0/d4/d9/d1d/d28/f31 [4194304,4194304] 0 2024-09-19T09:35:03.170 INFO:tasks.workunit.client.1.smithi191.stdout:5/578: unlink d0/d4/d9/d1d/d29/d33/d52/cb8 0 2024-09-19T09:35:03.172 INFO:tasks.workunit.client.1.smithi191.stdout:5/579: link d0/d4/d9/d1d/d29/d7f/d94/la8 d0/d4/d9/d1d/d29/d33/d52/lcf 0 2024-09-19T09:35:03.174 INFO:tasks.workunit.client.1.smithi191.stdout:5/580: rename d0/d4/d9/d1d/d29/d7f/d94/la8 to d0/d4/d9/d1d/d29/d33/d45/ld0 0 2024-09-19T09:35:03.177 INFO:tasks.workunit.client.1.smithi191.stdout:8/697: dread d1/d16/d3c/d17/f1e [0,4194304] 0 2024-09-19T09:35:03.177 INFO:tasks.workunit.client.1.smithi191.stdout:4/633: dwrite d5/f6 [0,4194304] 0 2024-09-19T09:35:03.180 INFO:tasks.workunit.client.1.smithi191.stdout:4/634: link d5/c7d d5/d1b/d1c/d24/d32/d21/d27/cd1 0 2024-09-19T09:35:03.184 INFO:tasks.workunit.client.1.smithi191.stdout:9/580: dwrite d3/db/d16/d47/d89/fc8 [0,4194304] 0 2024-09-19T09:35:03.185 INFO:tasks.workunit.client.1.smithi191.stdout:9/581: write d3/d60/f7a [5070721,59614] 0 2024-09-19T09:35:03.185 INFO:tasks.workunit.client.1.smithi191.stdout:2/546: dwrite d8/d11/fac [0,4194304] 0 2024-09-19T09:35:03.185 INFO:tasks.workunit.client.1.smithi191.stdout:2/547: chown d8/d11/d3f/d8a/d8f/f96 38 1 2024-09-19T09:35:03.185 INFO:tasks.workunit.client.1.smithi191.stdout:2/548: write d8/d11/d3f/d8a/d8f/f96 [496984,88086] 0 2024-09-19T09:35:03.187 INFO:tasks.workunit.client.1.smithi191.stdout:4/635: dread d5/d38/f45 [0,4194304] 0 2024-09-19T09:35:03.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:02 smithi112 ceph-mon[27605]: pgmap v13: 65 pgs: 65 active+clean; 606 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 48 MiB/s rd, 64 MiB/s wr, 671 op/s 2024-09-19T09:35:03.191 INFO:tasks.workunit.client.1.smithi191.stdout:9/582: rmdir d3/db/d16/d47 39 2024-09-19T09:35:03.193 INFO:tasks.workunit.client.1.smithi191.stdout:4/636: dread f1 [0,4194304] 0 2024-09-19T09:35:03.197 INFO:tasks.workunit.client.1.smithi191.stdout:4/637: dread d5/d1b/d1c/d24/d32/d21/d27/f53 [0,4194304] 0 2024-09-19T09:35:03.197 INFO:tasks.workunit.client.1.smithi191.stdout:4/638: read d5/f4e [1324476,95314] 0 2024-09-19T09:35:03.199 INFO:tasks.workunit.client.1.smithi191.stdout:2/549: dread d8/db/d13/d23/f29 [4194304,4194304] 0 2024-09-19T09:35:03.199 INFO:tasks.workunit.client.1.smithi191.stdout:2/550: chown d8/d11/d3f/d8a/d8f/f96 77210902 1 2024-09-19T09:35:03.200 INFO:tasks.workunit.client.1.smithi191.stdout:2/551: mknod d8/db/d13/d23/cb7 0 2024-09-19T09:35:03.201 INFO:tasks.workunit.client.1.smithi191.stdout:0/660: sync 2024-09-19T09:35:03.201 INFO:tasks.workunit.client.1.smithi191.stdout:0/661: dread - d0/d9/d1c/d1f/f72 zero size 2024-09-19T09:35:03.201 INFO:tasks.workunit.client.1.smithi191.stdout:0/662: readlink d0/d9/d1c/d1f/d24/d29/lb2 0 2024-09-19T09:35:03.201 INFO:tasks.workunit.client.1.smithi191.stdout:7/569: sync 2024-09-19T09:35:03.201 INFO:tasks.workunit.client.1.smithi191.stdout:2/552: getdents d8/db/d13 0 2024-09-19T09:35:03.203 INFO:tasks.workunit.client.1.smithi191.stdout:2/553: symlink d8/d11/d56/lb8 0 2024-09-19T09:35:03.203 INFO:tasks.workunit.client.1.smithi191.stdout:2/554: readlink d8/d11/d3f/d8a/l85 0 2024-09-19T09:35:03.206 INFO:tasks.workunit.client.1.smithi191.stdout:2/555: read d8/db/d41/f93 [130233,11080] 0 2024-09-19T09:35:03.206 INFO:tasks.workunit.client.1.smithi191.stdout:2/556: fsync d8/f44 0 2024-09-19T09:35:03.206 INFO:tasks.workunit.client.1.smithi191.stdout:2/557: read d8/db/d13/d40/f52 [1028275,60747] 0 2024-09-19T09:35:03.208 INFO:tasks.workunit.client.1.smithi191.stdout:9/583: dread d3/db/d16/d47/d55/f6d [0,4194304] 0 2024-09-19T09:35:03.209 INFO:tasks.workunit.client.1.smithi191.stdout:9/584: truncate d3/d60/faa 1900462 0 2024-09-19T09:35:03.209 INFO:tasks.workunit.client.1.smithi191.stdout:2/558: dread d8/db/d13/d23/f43 [0,4194304] 0 2024-09-19T09:35:03.209 INFO:tasks.workunit.client.1.smithi191.stdout:8/698: dwrite d1/d7/fb8 [0,4194304] 0 2024-09-19T09:35:03.210 INFO:tasks.workunit.client.1.smithi191.stdout:9/585: unlink d3/db/d16/d38/lc7 0 2024-09-19T09:35:03.213 INFO:tasks.workunit.client.1.smithi191.stdout:8/699: symlink d1/d7/d1a/d6d/de1/d6b/da9/le9 0 2024-09-19T09:35:03.213 INFO:tasks.workunit.client.1.smithi191.stdout:8/700: chown d1/d22/d47 0 1 2024-09-19T09:35:03.213 INFO:tasks.workunit.client.1.smithi191.stdout:2/559: dread d8/db/d13/f3a [0,4194304] 0 2024-09-19T09:35:03.216 INFO:tasks.workunit.client.1.smithi191.stdout:8/701: mknod d1/d7/d1a/d6d/de1/d6b/db9/cea 0 2024-09-19T09:35:03.217 INFO:tasks.workunit.client.1.smithi191.stdout:9/586: write d3/db/d16/d47/d55/f4e [415871,18488] 0 2024-09-19T09:35:03.217 INFO:tasks.workunit.client.1.smithi191.stdout:9/587: chown d3/db/d16/d47/d55/c8c 102 1 2024-09-19T09:35:03.217 INFO:tasks.workunit.client.1.smithi191.stdout:9/588: stat d3/db/d16/d17 0 2024-09-19T09:35:03.217 INFO:tasks.workunit.client.1.smithi191.stdout:9/589: write d3/d8/fc [673315,36114] 0 2024-09-19T09:35:03.217 INFO:tasks.workunit.client.1.smithi191.stdout:7/570: write d2/d2a/d33/f54 [1616160,24056] 0 2024-09-19T09:35:03.218 INFO:tasks.workunit.client.1.smithi191.stdout:5/581: dwrite d0/d4/d9/d1d/d29/d33/f38 [0,4194304] 0 2024-09-19T09:35:03.218 INFO:tasks.workunit.client.1.smithi191.stdout:5/582: fdatasync d0/d4/d4a/f5f 0 2024-09-19T09:35:03.218 INFO:tasks.workunit.client.1.smithi191.stdout:4/639: dwrite d5/d1b/d61/fb6 [0,4194304] 0 2024-09-19T09:35:03.220 INFO:tasks.workunit.client.1.smithi191.stdout:9/590: link d3/l9f d3/db/d16/d17/d3c/lc9 0 2024-09-19T09:35:03.225 INFO:tasks.workunit.client.1.smithi191.stdout:7/571: mkdir d2/d2a/d38/d63/dc1 0 2024-09-19T09:35:03.226 INFO:tasks.workunit.client.1.smithi191.stdout:7/572: truncate d2/d2a/d4f/f7b 1429607 0 2024-09-19T09:35:03.227 INFO:tasks.workunit.client.1.smithi191.stdout:9/591: mknod d3/db/d53/da2/db3/cca 0 2024-09-19T09:35:03.227 INFO:tasks.workunit.client.1.smithi191.stdout:7/573: creat d2/d39/d3a/d9c/fc2 x:0 0 0 2024-09-19T09:35:03.229 INFO:tasks.workunit.client.1.smithi191.stdout:5/583: dread d0/d4/d9/d1d/d29/d33/d52/f71 [0,4194304] 0 2024-09-19T09:35:03.229 INFO:tasks.workunit.client.1.smithi191.stdout:9/592: unlink d3/db/d16/fa7 0 2024-09-19T09:35:03.229 INFO:tasks.workunit.client.1.smithi191.stdout:9/593: getdents d3/db/d16/d17/d5b/dc5 0 2024-09-19T09:35:03.229 INFO:tasks.workunit.client.1.smithi191.stdout:9/594: dread - d3/d8/f56 zero size 2024-09-19T09:35:03.229 INFO:tasks.workunit.client.1.smithi191.stdout:9/595: chown d3/db/d16/d47/d55 109404621 1 2024-09-19T09:35:03.230 INFO:tasks.workunit.client.1.smithi191.stdout:7/574: link d2/fb1 d2/d2a/d38/d63/da2/fc3 0 2024-09-19T09:35:03.233 INFO:tasks.workunit.client.1.smithi191.stdout:5/584: creat d0/d4/d9/d1d/d29/d33/d52/da4/fd1 x:0 0 0 2024-09-19T09:35:03.233 INFO:tasks.workunit.client.1.smithi191.stdout:5/585: dread - d0/d4/d9/d1d/d29/fc5 zero size 2024-09-19T09:35:03.233 INFO:tasks.workunit.client.1.smithi191.stdout:5/586: fsync d0/d4/d9/de/f47 0 2024-09-19T09:35:03.233 INFO:tasks.workunit.client.1.smithi191.stdout:5/587: chown d0/d4/d9/d1d/d29/lb7 108 1 2024-09-19T09:35:03.233 INFO:tasks.workunit.client.1.smithi191.stdout:5/588: dread - d0/d4/f37 zero size 2024-09-19T09:35:03.233 INFO:tasks.workunit.client.1.smithi191.stdout:5/589: fdatasync d0/d4/d9/d1d/d29/d33/f40 0 2024-09-19T09:35:03.233 INFO:tasks.workunit.client.1.smithi191.stdout:9/596: chown d3/d60/d78/f96 46 1 2024-09-19T09:35:03.240 INFO:tasks.workunit.client.1.smithi191.stdout:7/575: read d2/d2a/d33/f73 [859220,2609] 0 2024-09-19T09:35:03.241 INFO:tasks.workunit.client.1.smithi191.stdout:3/515: sync 2024-09-19T09:35:03.241 INFO:tasks.workunit.client.1.smithi191.stdout:6/495: sync 2024-09-19T09:35:03.241 INFO:tasks.workunit.client.1.smithi191.stdout:1/590: sync 2024-09-19T09:35:03.242 INFO:tasks.workunit.client.1.smithi191.stdout:6/496: chown d2/de/d2a/d2d/d30/d98/d9b/d65/d89 1388 1 2024-09-19T09:35:03.242 INFO:tasks.workunit.client.1.smithi191.stdout:1/591: getdents d3/d9/da/d8c/d97 0 2024-09-19T09:35:03.243 INFO:tasks.workunit.client.1.smithi191.stdout:8/702: dwrite d1/d16/d23/d3e/f4b [0,4194304] 0 2024-09-19T09:35:03.243 INFO:tasks.workunit.client.1.smithi191.stdout:6/497: symlink d2/de/d2a/d2d/d30/d98/d9b/l9d 0 2024-09-19T09:35:03.243 INFO:tasks.workunit.client.1.smithi191.stdout:5/590: dread d0/d4/d9/f9f [0,4194304] 0 2024-09-19T09:35:03.244 INFO:tasks.workunit.client.1.smithi191.stdout:1/592: mkdir d3/d9/da/d1e/d25/d70/ddd 0 2024-09-19T09:35:03.245 INFO:tasks.workunit.client.1.smithi191.stdout:6/498: symlink d2/de/d19/d1e/d64/d76/l9e 0 2024-09-19T09:35:03.247 INFO:tasks.workunit.client.1.smithi191.stdout:5/591: creat d0/d4/d9/d1d/d28/d53/fd2 x:0 0 0 2024-09-19T09:35:03.248 INFO:tasks.workunit.client.1.smithi191.stdout:4/640: dwrite d5/d1b/d1c/d28/f57 [0,4194304] 0 2024-09-19T09:35:03.250 INFO:tasks.workunit.client.1.smithi191.stdout:4/641: rename d5/d1b/d1c/d2f/f9d to d5/fd2 0 2024-09-19T09:35:03.251 INFO:tasks.workunit.client.1.smithi191.stdout:4/642: getdents d5/d1b 0 2024-09-19T09:35:03.256 INFO:tasks.workunit.client.1.smithi191.stdout:4/643: rename d5/d1b/c2a to d5/d1b/d1c/d24/d32/d21/cd3 0 2024-09-19T09:35:03.258 INFO:tasks.workunit.client.1.smithi191.stdout:4/644: creat d5/d1b/d8e/dc9/fd4 x:0 0 0 2024-09-19T09:35:03.260 INFO:tasks.workunit.client.1.smithi191.stdout:4/645: unlink d5/d1b/d1c/d24/d32/f5d 0 2024-09-19T09:35:03.261 INFO:tasks.workunit.client.1.smithi191.stdout:4/646: creat d5/d38/da5/fd5 x:0 0 0 2024-09-19T09:35:03.261 INFO:tasks.workunit.client.1.smithi191.stdout:4/647: write d5/d1b/d1c/d2f/d19/f3a [8600541,94765] 0 2024-09-19T09:35:03.264 INFO:tasks.workunit.client.1.smithi191.stdout:4/648: rename d5/d1b/d1c/f29 to d5/d38/da5/fd6 0 2024-09-19T09:35:03.264 INFO:tasks.workunit.client.1.smithi191.stdout:4/649: write d5/d1b/d1c/d2f/d19/f34 [2151704,68771] 0 2024-09-19T09:35:03.264 INFO:tasks.workunit.client.1.smithi191.stdout:4/650: chown d5/d1b/d1c/d24/d32/d21/d56/c71 130128801 1 2024-09-19T09:35:03.266 INFO:tasks.workunit.client.1.smithi191.stdout:4/651: unlink d5/d1b/d1c/d2f/d19/f34 0 2024-09-19T09:35:03.267 INFO:tasks.workunit.client.1.smithi191.stdout:4/652: write d5/d1b/f4f [911249,94315] 0 2024-09-19T09:35:03.267 INFO:tasks.workunit.client.1.smithi191.stdout:4/653: truncate d5/d1b/d1c/d2f/d37/d59/fa0 950337 0 2024-09-19T09:35:03.273 INFO:tasks.workunit.client.1.smithi191.stdout:4/654: dread d5/d1b/d1c/d24/d32/d21/d5c/fb7 [0,4194304] 0 2024-09-19T09:35:03.273 INFO:tasks.workunit.client.1.smithi191.stdout:4/655: creat d5/d1b/d1c/d24/d32/d21/d4a/fd7 x:0 0 0 2024-09-19T09:35:03.273 INFO:tasks.workunit.client.1.smithi191.stdout:4/656: chown d5/c7d 3 1 2024-09-19T09:35:03.280 INFO:tasks.workunit.client.1.smithi191.stdout:3/516: dwrite d12/d13/d1a/d1b/f66 [0,4194304] 0 2024-09-19T09:35:03.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:02 smithi191 ceph-mon[34834]: pgmap v13: 65 pgs: 65 active+clean; 606 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 48 MiB/s rd, 64 MiB/s wr, 671 op/s 2024-09-19T09:35:03.284 INFO:tasks.workunit.client.1.smithi191.stdout:1/593: dwrite d3/d9/da/d1e/f2d [0,4194304] 0 2024-09-19T09:35:03.285 INFO:tasks.workunit.client.1.smithi191.stdout:5/592: dwrite d0/d1f/f84 [0,4194304] 0 2024-09-19T09:35:03.285 INFO:tasks.workunit.client.1.smithi191.stdout:1/594: mknod d3/d9/da/d7e/cde 0 2024-09-19T09:35:03.286 INFO:tasks.workunit.client.1.smithi191.stdout:1/595: write d3/d9/da/d1e/f31 [1596410,91884] 0 2024-09-19T09:35:03.286 INFO:tasks.workunit.client.1.smithi191.stdout:8/703: dwrite d1/d7/d1a/f63 [0,4194304] 0 2024-09-19T09:35:03.286 INFO:tasks.workunit.client.1.smithi191.stdout:8/704: write d1/d7/d1a/f5b [223950,35768] 0 2024-09-19T09:35:03.287 INFO:tasks.workunit.client.1.smithi191.stdout:5/593: creat d0/d4/d9/d1d/d29/fd3 x:0 0 0 2024-09-19T09:35:03.288 INFO:tasks.workunit.client.1.smithi191.stdout:1/596: chown d3/d9/da/d1e/d32/d53/f2c 113 1 2024-09-19T09:35:03.290 INFO:tasks.workunit.client.1.smithi191.stdout:4/657: getdents d5/d1b/d1c/d24/d32/d21 0 2024-09-19T09:35:03.293 INFO:tasks.workunit.client.1.smithi191.stdout:8/705: rename d1/d16/d23/f73 to d1/d22/feb 0 2024-09-19T09:35:03.293 INFO:tasks.workunit.client.1.smithi191.stdout:8/706: creat d1/d7/d1a/d6d/fec x:0 0 0 2024-09-19T09:35:03.293 INFO:tasks.workunit.client.1.smithi191.stdout:8/707: fsync d1/d16/d2e/d57/f7d 0 2024-09-19T09:35:03.294 INFO:tasks.workunit.client.1.smithi191.stdout:8/708: truncate d1/d7/d1a/d6d/de1/d6b/fbd 226902 0 2024-09-19T09:35:03.294 INFO:tasks.workunit.client.1.smithi191.stdout:8/709: chown d1/d16/d2e/d7a 203962 1 2024-09-19T09:35:03.294 INFO:tasks.workunit.client.1.smithi191.stdout:3/517: dwrite d12/f81 [4194304,4194304] 0 2024-09-19T09:35:03.295 INFO:tasks.workunit.client.1.smithi191.stdout:5/594: link d0/d4/c87 d0/d4/cd4 0 2024-09-19T09:35:03.296 INFO:tasks.workunit.client.1.smithi191.stdout:1/597: mkdir d3/ddf 0 2024-09-19T09:35:03.300 INFO:tasks.workunit.client.1.smithi191.stdout:3/518: rmdir d12/d13/d1a/d1b/d60/d7a/d93/dad 39 2024-09-19T09:35:03.301 INFO:tasks.workunit.client.1.smithi191.stdout:1/598: symlink d3/d9/da/d1e/d25/d70/da0/le0 0 2024-09-19T09:35:03.302 INFO:tasks.workunit.client.1.smithi191.stdout:1/599: chown d3/d9/da/d42/d8a/f9b 465176764 1 2024-09-19T09:35:03.302 INFO:tasks.workunit.client.1.smithi191.stdout:3/519: rename d12/d13/d1a/d1b/d2e/dab/d3d/f7e to d12/d13/d1a/d1b/d2e/dab/d51/fb9 0 2024-09-19T09:35:03.303 INFO:tasks.workunit.client.1.smithi191.stdout:3/520: truncate d12/d13/d1a/d1b/d2e/dab/d3d/f8c 449205 0 2024-09-19T09:35:03.303 INFO:tasks.workunit.client.1.smithi191.stdout:3/521: truncate d12/d13/d1a/d1b/d3c/d3f/f83 1020902 0 2024-09-19T09:35:03.304 INFO:tasks.workunit.client.1.smithi191.stdout:1/600: symlink d3/d9/d73/d94/dc9/le1 0 2024-09-19T09:35:03.316 INFO:tasks.workunit.client.1.smithi191.stdout:4/658: dwrite d5/d1b/d1c/d2f/d37/f7a [0,4194304] 0 2024-09-19T09:35:03.319 INFO:tasks.workunit.client.1.smithi191.stdout:1/601: write d3/d9/da/db/d48/f61 [2287974,101196] 0 2024-09-19T09:35:03.320 INFO:tasks.workunit.client.1.smithi191.stdout:8/710: dwrite d1/d7/d1a/d6d/de1/d6b/db9/fda [0,4194304] 0 2024-09-19T09:35:03.323 INFO:tasks.workunit.client.1.smithi191.stdout:1/602: symlink d3/le2 0 2024-09-19T09:35:03.328 INFO:tasks.workunit.client.1.smithi191.stdout:4/659: link d5/c14 d5/d1b/d1c/d24/d32/cd8 0 2024-09-19T09:35:03.329 INFO:tasks.workunit.client.1.smithi191.stdout:4/660: chown d5/d38/d73/d8d/fc0 109 1 2024-09-19T09:35:03.329 INFO:tasks.workunit.client.1.smithi191.stdout:4/661: write d5/d1b/d1c/fd0 [355963,123535] 0 2024-09-19T09:35:03.330 INFO:tasks.workunit.client.1.smithi191.stdout:8/711: truncate d1/d16/d3c/f31 1904186 0 2024-09-19T09:35:03.331 INFO:tasks.workunit.client.1.smithi191.stdout:3/522: dwrite d12/d43/f44 [0,4194304] 0 2024-09-19T09:35:03.331 INFO:tasks.workunit.client.1.smithi191.stdout:3/523: write d12/d13/d1a/d1b/d2e/dab/d3d/d91/fb5 [555571,37180] 0 2024-09-19T09:35:03.331 INFO:tasks.workunit.client.1.smithi191.stdout:5/595: dwrite d0/d4/d4a/f69 [0,4194304] 0 2024-09-19T09:35:03.331 INFO:tasks.workunit.client.1.smithi191.stdout:5/596: write d0/d4/d9/d1d/d29/d7f/fc0 [1010295,7181] 0 2024-09-19T09:35:03.334 INFO:tasks.workunit.client.1.smithi191.stdout:3/524: mknod d12/d13/d1a/d1b/d2e/dab/da6/cba 0 2024-09-19T09:35:03.337 INFO:tasks.workunit.client.1.smithi191.stdout:4/662: dread d5/d1b/d1c/d2f/d37/f7a [0,4194304] 0 2024-09-19T09:35:03.337 INFO:tasks.workunit.client.1.smithi191.stdout:4/663: chown d5/d38/f45 0 1 2024-09-19T09:35:03.340 INFO:tasks.workunit.client.1.smithi191.stdout:8/712: read d1/d7/fe [3109658,109742] 0 2024-09-19T09:35:03.344 INFO:tasks.workunit.client.1.smithi191.stdout:4/664: dread d5/d38/da5/fd6 [0,4194304] 0 2024-09-19T09:35:03.346 INFO:tasks.workunit.client.1.smithi191.stdout:5/597: symlink d0/d4/d9/d1d/d29/d7f/d94/ld5 0 2024-09-19T09:35:03.346 INFO:tasks.workunit.client.1.smithi191.stdout:5/598: dread - d0/d4/d88/fc8 zero size 2024-09-19T09:35:03.346 INFO:tasks.workunit.client.1.smithi191.stdout:5/599: stat d0/d4/d4a 0 2024-09-19T09:35:03.348 INFO:tasks.workunit.client.1.smithi191.stdout:3/525: creat d12/d13/d1a/d1b/d60/d7a/d93/dad/d73/fbb x:0 0 0 2024-09-19T09:35:03.349 INFO:tasks.workunit.client.1.smithi191.stdout:1/603: dwrite d3/d9/da/db/d48/f61 [0,4194304] 0 2024-09-19T09:35:03.350 INFO:tasks.workunit.client.1.smithi191.stdout:4/665: symlink d5/d1b/d1c/d2f/d95/ld9 0 2024-09-19T09:35:03.352 INFO:tasks.workunit.client.1.smithi191.stdout:3/526: link d12/d13/d1a/d1b/f36 d12/d13/d1a/d1b/d2e/dab/d51/d62/d85/da0/fbc 0 2024-09-19T09:35:03.355 INFO:tasks.workunit.client.1.smithi191.stdout:4/666: truncate d5/d1b/d1c/d24/d82/f90 2633178 0 2024-09-19T09:35:03.357 INFO:tasks.workunit.client.1.smithi191.stdout:3/527: mknod d12/d13/d1a/d1b/d3c/d71/cbd 0 2024-09-19T09:35:03.358 INFO:tasks.workunit.client.1.smithi191.stdout:1/604: getdents d3/d9/d73/d94 0 2024-09-19T09:35:03.359 INFO:tasks.workunit.client.1.smithi191.stdout:4/667: mknod d5/d1b/d1c/d2f/cda 0 2024-09-19T09:35:03.361 INFO:tasks.workunit.client.1.smithi191.stdout:1/605: mkdir d3/d9/da/d1e/d32/d53/d57/d6d/de3 0 2024-09-19T09:35:03.362 INFO:tasks.workunit.client.1.smithi191.stdout:4/668: stat d5/f91 0 2024-09-19T09:35:03.366 INFO:tasks.workunit.client.1.smithi191.stdout:2/560: sync 2024-09-19T09:35:03.366 INFO:tasks.workunit.client.1.smithi191.stdout:0/663: sync 2024-09-19T09:35:03.367 INFO:tasks.workunit.client.1.smithi191.stdout:0/664: mkdir d0/dc5/dc1/dd6 0 2024-09-19T09:35:03.367 INFO:tasks.workunit.client.1.smithi191.stdout:0/665: chown d0/d9/d1c/d1f/d24/l3a 1558196202 1 2024-09-19T09:35:03.369 INFO:tasks.workunit.client.1.smithi191.stdout:8/713: dwrite d1/d16/f2a [0,4194304] 0 2024-09-19T09:35:03.369 INFO:tasks.workunit.client.1.smithi191.stdout:8/714: stat d1/d7/d1a/d6d 0 2024-09-19T09:35:03.370 INFO:tasks.workunit.client.1.smithi191.stdout:0/666: rename d0/d9/d1c/d1f/d24/d53/fba to d0/dc5/fd7 0 2024-09-19T09:35:03.370 INFO:tasks.workunit.client.1.smithi191.stdout:0/667: write d0/fb4 [41376,99993] 0 2024-09-19T09:35:03.370 INFO:tasks.workunit.client.1.smithi191.stdout:0/668: creat d0/d9/d1c/fd8 x:0 0 0 2024-09-19T09:35:03.370 INFO:tasks.workunit.client.1.smithi191.stdout:0/669: readlink d0/d9/d1c/d1f/d24/d39/l59 0 2024-09-19T09:35:03.370 INFO:tasks.workunit.client.1.smithi191.stdout:5/600: dwrite d0/d4/d9/f9b [0,4194304] 0 2024-09-19T09:35:03.374 INFO:tasks.workunit.client.1.smithi191.stdout:2/561: dread d8/db/d13/d23/f29 [0,4194304] 0 2024-09-19T09:35:03.375 INFO:tasks.workunit.client.1.smithi191.stdout:1/606: dread d3/d9/da/d1e/f2d [0,4194304] 0 2024-09-19T09:35:03.376 INFO:tasks.workunit.client.1.smithi191.stdout:4/669: dwrite d5/d1b/f4f [0,4194304] 0 2024-09-19T09:35:03.377 INFO:tasks.workunit.client.1.smithi191.stdout:4/670: read - d5/d1b/d1c/d24/fc6 zero size 2024-09-19T09:35:03.377 INFO:tasks.workunit.client.1.smithi191.stdout:3/528: rmdir d12/d13/d1a/d1b 39 2024-09-19T09:35:03.377 INFO:tasks.workunit.client.1.smithi191.stdout:3/529: fsync d12/d13/d1a/d1b/d3c/d3f/f83 0 2024-09-19T09:35:03.378 INFO:tasks.workunit.client.1.smithi191.stdout:8/715: dread d1/d16/f46 [0,4194304] 0 2024-09-19T09:35:03.381 INFO:tasks.workunit.client.1.smithi191.stdout:0/670: rename d0/d9/d1c/d1f/d24/d29/d30/d7c/cd2 to d0/d9/cd9 0 2024-09-19T09:35:03.381 INFO:tasks.workunit.client.1.smithi191.stdout:0/671: creat d0/d9/de/d61/dbf/fda x:0 0 0 2024-09-19T09:35:03.381 INFO:tasks.workunit.client.1.smithi191.stdout:2/562: symlink d8/db/d13/d35/lb9 0 2024-09-19T09:35:03.383 INFO:tasks.workunit.client.1.smithi191.stdout:1/607: rmdir d3/d9/da/d1e/d32/d53 39 2024-09-19T09:35:03.384 INFO:tasks.workunit.client.1.smithi191.stdout:4/671: write d5/fa [989501,110331] 0 2024-09-19T09:35:03.387 INFO:tasks.workunit.client.1.smithi191.stdout:3/530: symlink d12/d13/d1a/d1b/d60/d7a/lbe 0 2024-09-19T09:35:03.387 INFO:tasks.workunit.client.1.smithi191.stdout:3/531: write d12/d13/d1a/d1b/d3c/f6e [1563715,46213] 0 2024-09-19T09:35:03.387 INFO:tasks.workunit.client.1.smithi191.stdout:3/532: chown d12/d13/d1a/d1b/d60/f72 1819644790 1 2024-09-19T09:35:03.388 INFO:tasks.workunit.client.1.smithi191.stdout:8/716: creat d1/d16/fed x:0 0 0 2024-09-19T09:35:03.389 INFO:tasks.workunit.client.1.smithi191.stdout:5/601: dwrite d0/d4/d9/d1d/d29/f62 [0,4194304] 0 2024-09-19T09:35:03.389 INFO:tasks.workunit.client.1.smithi191.stdout:5/602: chown d0/d4/d9/d1d/d29/d33/d45 836943 1 2024-09-19T09:35:03.390 INFO:tasks.workunit.client.1.smithi191.stdout:9/597: sync 2024-09-19T09:35:03.390 INFO:tasks.workunit.client.1.smithi191.stdout:6/499: sync 2024-09-19T09:35:03.390 INFO:tasks.workunit.client.1.smithi191.stdout:7/576: sync 2024-09-19T09:35:03.390 INFO:tasks.workunit.client.1.smithi191.stdout:6/500: dread - d2/de/d19/f8b zero size 2024-09-19T09:35:03.391 INFO:tasks.workunit.client.1.smithi191.stdout:9/598: truncate d3/db/d16/d47/f69 1631861 0 2024-09-19T09:35:03.391 INFO:tasks.workunit.client.1.smithi191.stdout:6/501: chown d2/de/d2a/d39/l66 94825265 1 2024-09-19T09:35:03.391 INFO:tasks.workunit.client.1.smithi191.stdout:9/599: truncate d3/db6/fbb 53733 0 2024-09-19T09:35:03.391 INFO:tasks.workunit.client.1.smithi191.stdout:7/577: creat d2/d2a/fc4 x:0 0 0 2024-09-19T09:35:03.391 INFO:tasks.workunit.client.1.smithi191.stdout:1/608: symlink d3/d9/da/d1e/d32/d6f/le4 0 2024-09-19T09:35:03.392 INFO:tasks.workunit.client.1.smithi191.stdout:4/672: stat d5/d1b/d1c/d24/d32/d21/d78/f79 0 2024-09-19T09:35:03.394 INFO:tasks.workunit.client.1.smithi191.stdout:3/533: mknod d12/d13/d1a/d1b/d2e/dab/d51/d62/cbf 0 2024-09-19T09:35:03.394 INFO:tasks.workunit.client.1.smithi191.stdout:3/534: write d12/f25 [824851,38392] 0 2024-09-19T09:35:03.394 INFO:tasks.workunit.client.1.smithi191.stdout:5/603: rmdir d0/d4/d88 39 2024-09-19T09:35:03.397 INFO:tasks.workunit.client.1.smithi191.stdout:0/672: unlink d0/d9/f22 0 2024-09-19T09:35:03.399 INFO:tasks.workunit.client.1.smithi191.stdout:5/604: dread d0/d4/d9/d1d/d29/d33/d52/f71 [0,4194304] 0 2024-09-19T09:35:03.400 INFO:tasks.workunit.client.1.smithi191.stdout:5/605: truncate d0/d4/d9/d1d/d22/d5c/fc1 478807 0 2024-09-19T09:35:03.400 INFO:tasks.workunit.client.1.smithi191.stdout:6/502: rmdir d2/de/d2a/d2d/d30/d98/d9b/d65 39 2024-09-19T09:35:03.400 INFO:tasks.workunit.client.1.smithi191.stdout:7/578: mkdir d2/dc5 0 2024-09-19T09:35:03.401 INFO:tasks.workunit.client.1.smithi191.stdout:2/563: mkdir d8/d2a/dba 0 2024-09-19T09:35:03.402 INFO:tasks.workunit.client.1.smithi191.stdout:1/609: dread d3/d9/da/d1e/f31 [0,4194304] 0 2024-09-19T09:35:03.402 INFO:tasks.workunit.client.1.smithi191.stdout:4/673: mknod d5/d1b/d1c/d2f/d19/cdb 0 2024-09-19T09:35:03.403 INFO:tasks.workunit.client.1.smithi191.stdout:4/674: dread d5/d1b/d1c/d24/d32/d21/d5c/fb4 [0,4194304] 0 2024-09-19T09:35:03.403 INFO:tasks.workunit.client.1.smithi191.stdout:3/535: symlink d12/d13/d1a/d1b/d60/lc0 0 2024-09-19T09:35:03.404 INFO:tasks.workunit.client.1.smithi191.stdout:0/673: rmdir d0/dc5/d86 39 2024-09-19T09:35:03.404 INFO:tasks.workunit.client.1.smithi191.stdout:5/606: creat d0/d4/d9/d1d/d29/d7f/d94/fd6 x:0 0 0 2024-09-19T09:35:03.405 INFO:tasks.workunit.client.1.smithi191.stdout:6/503: getdents d2/de/d2a/d2d/d30 0 2024-09-19T09:35:03.405 INFO:tasks.workunit.client.1.smithi191.stdout:6/504: chown d2/de/d15 37507435 1 2024-09-19T09:35:03.405 INFO:tasks.workunit.client.1.smithi191.stdout:6/505: truncate d2/de/d15/f36 4661486 0 2024-09-19T09:35:03.405 INFO:tasks.workunit.client.1.smithi191.stdout:8/717: write d1/d7/d1a/d6d/da8/fb4 [1451449,19684] 0 2024-09-19T09:35:03.406 INFO:tasks.workunit.client.1.smithi191.stdout:8/718: readlink d1/d16/d2e/d7a/lcd 0 2024-09-19T09:35:03.406 INFO:tasks.workunit.client.1.smithi191.stdout:8/719: dread - d1/d7/d1a/d6d/de1/d6b/d83/d98/fac zero size 2024-09-19T09:35:03.406 INFO:tasks.workunit.client.1.smithi191.stdout:2/564: unlink d8/d11/d3f/d64/c7b 0 2024-09-19T09:35:03.406 INFO:tasks.workunit.client.1.smithi191.stdout:2/565: write d8/db/d4e/fa7 [1025323,113439] 0 2024-09-19T09:35:03.406 INFO:tasks.workunit.client.1.smithi191.stdout:1/610: link d3/d9/da/d1e/d32/l58 d3/ddf/le5 0 2024-09-19T09:35:03.407 INFO:tasks.workunit.client.1.smithi191.stdout:0/674: truncate d0/dc5/fd7 1294690 0 2024-09-19T09:35:03.407 INFO:tasks.workunit.client.1.smithi191.stdout:1/611: dread d3/d9/da/d1e/f44 [0,4194304] 0 2024-09-19T09:35:03.408 INFO:tasks.workunit.client.1.smithi191.stdout:5/607: mkdir d0/da7/dcd/dd7 0 2024-09-19T09:35:03.409 INFO:tasks.workunit.client.1.smithi191.stdout:6/506: symlink d2/l9f 0 2024-09-19T09:35:03.409 INFO:tasks.workunit.client.1.smithi191.stdout:6/507: chown d2/de/d19/f6e 13639475 1 2024-09-19T09:35:03.410 INFO:tasks.workunit.client.1.smithi191.stdout:2/566: mknod d8/db/cbb 0 2024-09-19T09:35:03.410 INFO:tasks.workunit.client.1.smithi191.stdout:2/567: truncate d8/d11/d3f/d8a/d8f/f6b 1575112 0 2024-09-19T09:35:03.410 INFO:tasks.workunit.client.1.smithi191.stdout:7/579: write d2/d2a/d79/fb7 [2320953,110801] 0 2024-09-19T09:35:03.411 INFO:tasks.workunit.client.1.smithi191.stdout:4/675: getdents d5/d1b/d8e 0 2024-09-19T09:35:03.411 INFO:tasks.workunit.client.1.smithi191.stdout:4/676: chown d5/d1b/d1c/d24/d32/d21/d5c/c65 23 1 2024-09-19T09:35:03.411 INFO:tasks.workunit.client.1.smithi191.stdout:4/677: chown d5/d1b/d1c/d24/d32/d21/d56/d86 17163 1 2024-09-19T09:35:03.411 INFO:tasks.workunit.client.1.smithi191.stdout:4/678: dread - d5/d1b/d1c/d24/fc6 zero size 2024-09-19T09:35:03.411 INFO:tasks.workunit.client.1.smithi191.stdout:7/580: write d2/d39/d3a/d3c/f87 [1586267,37628] 0 2024-09-19T09:35:03.411 INFO:tasks.workunit.client.1.smithi191.stdout:1/612: mknod d3/d9/da/d1e/d32/d6f/db2/dd1/ce6 0 2024-09-19T09:35:03.412 INFO:tasks.workunit.client.1.smithi191.stdout:5/608: mknod d0/d4/d4a/cd8 0 2024-09-19T09:35:03.414 INFO:tasks.workunit.client.1.smithi191.stdout:8/720: read d1/d16/d23/d3e/f4b [1009871,5576] 0 2024-09-19T09:35:03.414 INFO:tasks.workunit.client.1.smithi191.stdout:8/721: dread - d1/d7/d1a/d6d/fad zero size 2024-09-19T09:35:03.415 INFO:tasks.workunit.client.1.smithi191.stdout:3/536: write d12/d13/d1a/d28/f58 [3021269,56525] 0 2024-09-19T09:35:03.416 INFO:tasks.workunit.client.1.smithi191.stdout:9/600: dwrite d3/d60/d78/f96 [0,4194304] 0 2024-09-19T09:35:03.417 INFO:tasks.workunit.client.1.smithi191.stdout:9/601: write d3/d60/f58 [5854780,73665] 0 2024-09-19T09:35:03.419 INFO:tasks.workunit.client.1.smithi191.stdout:0/675: dread d0/d6f/d76/f7d [0,4194304] 0 2024-09-19T09:35:03.419 INFO:tasks.workunit.client.1.smithi191.stdout:0/676: chown d0/d9/f9f 1 1 2024-09-19T09:35:03.422 INFO:tasks.workunit.client.1.smithi191.stdout:6/508: dread d2/de/f27 [0,4194304] 0 2024-09-19T09:35:03.425 INFO:tasks.workunit.client.1.smithi191.stdout:2/568: write d8/d11/d3f/d8a/fae [3895736,53132] 0 2024-09-19T09:35:03.425 INFO:tasks.workunit.client.1.smithi191.stdout:1/613: rename d3/d9/da/d1e/d32/l7f to d3/d9/da/le7 0 2024-09-19T09:35:03.425 INFO:tasks.workunit.client.1.smithi191.stdout:1/614: dread - d3/d9/da/d8c/fcd zero size 2024-09-19T09:35:03.425 INFO:tasks.workunit.client.1.smithi191.stdout:5/609: creat d0/d4/d9/d1d/d22/d3b/db9/fd9 x:0 0 0 2024-09-19T09:35:03.428 INFO:tasks.workunit.client.1.smithi191.stdout:3/537: symlink d12/d13/d1a/d1b/d2e/lc1 0 2024-09-19T09:35:03.430 INFO:tasks.workunit.client.1.smithi191.stdout:2/569: dread d8/db/d13/d40/f5e [0,4194304] 0 2024-09-19T09:35:03.432 INFO:tasks.workunit.client.1.smithi191.stdout:9/602: symlink d3/db/d16/d38/d92/lcb 0 2024-09-19T09:35:03.434 INFO:tasks.workunit.client.1.smithi191.stdout:1/615: symlink d3/d9/da/d1e/d25/d70/da0/le8 0 2024-09-19T09:35:03.434 INFO:tasks.workunit.client.1.smithi191.stdout:1/616: creat d3/d9/da/d1e/d25/fe9 x:0 0 0 2024-09-19T09:35:03.435 INFO:tasks.workunit.client.1.smithi191.stdout:0/677: rename d0/dc5/dc1/dd6 to d0/d9/d1c/d20/d73/ddb 0 2024-09-19T09:35:03.436 INFO:tasks.workunit.client.1.smithi191.stdout:4/679: rmdir d5/d1b/d61/d88 39 2024-09-19T09:35:03.436 INFO:tasks.workunit.client.1.smithi191.stdout:7/581: dwrite d2/f47 [4194304,4194304] 0 2024-09-19T09:35:03.438 INFO:tasks.workunit.client.1.smithi191.stdout:2/570: fdatasync d8/db/d13/d40/fad 0 2024-09-19T09:35:03.439 INFO:tasks.workunit.client.1.smithi191.stdout:9/603: mkdir d3/db/d53/da2/db3/dc2/dcc 0 2024-09-19T09:35:03.442 INFO:tasks.workunit.client.1.smithi191.stdout:6/509: getdents d2/de/d2a/d2d 0 2024-09-19T09:35:03.442 INFO:tasks.workunit.client.1.smithi191.stdout:6/510: dread - d2/de/d19/d1e/d64/f8f zero size 2024-09-19T09:35:03.445 INFO:tasks.workunit.client.1.smithi191.stdout:0/678: mknod d0/d9/d1c/d1f/d24/d29/d30/d56/cdc 0 2024-09-19T09:35:03.447 INFO:tasks.workunit.client.1.smithi191.stdout:5/610: rename d0/d4/d9/d1d/d29/d33/d52/l9d to d0/d4/d9/lda 0 2024-09-19T09:35:03.447 INFO:tasks.workunit.client.1.smithi191.stdout:4/680: mknod d5/d1b/d1c/cdc 0 2024-09-19T09:35:03.449 INFO:tasks.workunit.client.1.smithi191.stdout:9/604: dread d3/d8/f86 [0,4194304] 0 2024-09-19T09:35:03.449 INFO:tasks.workunit.client.1.smithi191.stdout:9/605: write d3/db/d16/d17/d3c/f79 [892737,7641] 0 2024-09-19T09:35:03.451 INFO:tasks.workunit.client.1.smithi191.stdout:7/582: symlink d2/d2a/d79/da8/db9/lc6 0 2024-09-19T09:35:03.452 INFO:tasks.workunit.client.1.smithi191.stdout:2/571: truncate d8/d11/d56/f69 2159488 0 2024-09-19T09:35:03.452 INFO:tasks.workunit.client.1.smithi191.stdout:2/572: creat d8/fbc x:0 0 0 2024-09-19T09:35:03.453 INFO:tasks.workunit.client.1.smithi191.stdout:2/573: chown d8/d11/d3f/c2c 2 1 2024-09-19T09:35:03.453 INFO:tasks.workunit.client.1.smithi191.stdout:2/574: chown d8/f44 4545 1 2024-09-19T09:35:03.456 INFO:tasks.workunit.client.1.smithi191.stdout:0/679: link d0/d9/d1c/d1f/d24/d87/lb1 d0/d9/d1c/d1f/ldd 0 2024-09-19T09:35:03.456 INFO:tasks.workunit.client.1.smithi191.stdout:0/680: truncate d0/f50 4286724 0 2024-09-19T09:35:03.457 INFO:tasks.workunit.client.1.smithi191.stdout:0/681: write d0/d6f/d76/f88 [1321158,91024] 0 2024-09-19T09:35:03.457 INFO:tasks.workunit.client.1.smithi191.stdout:0/682: creat d0/d9/de/d61/fde x:0 0 0 2024-09-19T09:35:03.457 INFO:tasks.workunit.client.1.smithi191.stdout:0/683: read d0/d9/d1c/d1f/d24/d39/d8b/fb7 [351771,38669] 0 2024-09-19T09:35:03.457 INFO:tasks.workunit.client.1.smithi191.stdout:5/611: rename d0/d4/d9/d1d/d22/d3b/la0 to d0/d1f/ldb 0 2024-09-19T09:35:03.457 INFO:tasks.workunit.client.1.smithi191.stdout:9/606: mkdir d3/db/d16/d17/d81/d8d/dcd 0 2024-09-19T09:35:03.458 INFO:tasks.workunit.client.1.smithi191.stdout:7/583: truncate d2/d2a/d4f/d59/fa6 200102 0 2024-09-19T09:35:03.461 INFO:tasks.workunit.client.1.smithi191.stdout:0/684: mknod d0/d9/d1c/cdf 0 2024-09-19T09:35:03.461 INFO:tasks.workunit.client.1.smithi191.stdout:0/685: chown d0/d9/d1c/d1f/d24/d29/d30/c35 2033695 1 2024-09-19T09:35:03.462 INFO:tasks.workunit.client.1.smithi191.stdout:5/612: mknod d0/d4/d88/cdc 0 2024-09-19T09:35:03.463 INFO:tasks.workunit.client.1.smithi191.stdout:7/584: mkdir d2/d39/dc7 0 2024-09-19T09:35:03.465 INFO:tasks.workunit.client.1.smithi191.stdout:0/686: rmdir d0/d9/dd1 0 2024-09-19T09:35:03.465 INFO:tasks.workunit.client.1.smithi191.stdout:0/687: truncate d0/d9/d1c/fd8 105028 0 2024-09-19T09:35:03.465 INFO:tasks.workunit.client.1.smithi191.stdout:0/688: dread - d0/d9/de/d81/f8a zero size 2024-09-19T09:35:03.465 INFO:tasks.workunit.client.1.smithi191.stdout:0/689: dread - d0/d6f/d76/f9d zero size 2024-09-19T09:35:03.465 INFO:tasks.workunit.client.1.smithi191.stdout:0/690: chown d0/d9/d1c/d1f/d24/d29/d30/d56/c92 238626428 1 2024-09-19T09:35:03.466 INFO:tasks.workunit.client.1.smithi191.stdout:2/575: rename d8/d11/f38 to d8/db/d13/d40/da8/fbd 0 2024-09-19T09:35:03.467 INFO:tasks.workunit.client.1.smithi191.stdout:5/613: mknod d0/d4/d9/d1d/d22/cdd 0 2024-09-19T09:35:03.469 INFO:tasks.workunit.client.1.smithi191.stdout:7/585: link d2/c25 d2/d2a/d38/d63/dc1/cc8 0 2024-09-19T09:35:03.469 INFO:tasks.workunit.client.1.smithi191.stdout:7/586: dread - d2/d2a/d79/da8/fab zero size 2024-09-19T09:35:03.469 INFO:tasks.workunit.client.1.smithi191.stdout:1/617: dwrite d3/d9/da/d1e/d32/d53/d57/d6d/fa5 [0,4194304] 0 2024-09-19T09:35:03.469 INFO:tasks.workunit.client.1.smithi191.stdout:1/618: stat d3/d9/da/d1e/cae 0 2024-09-19T09:35:03.469 INFO:tasks.workunit.client.1.smithi191.stdout:1/619: truncate d3/fb3 897062 0 2024-09-19T09:35:03.470 INFO:tasks.workunit.client.1.smithi191.stdout:4/681: dwrite d5/d1b/d1c/d24/d32/d21/d56/fb9 [4194304,4194304] 0 2024-09-19T09:35:03.470 INFO:tasks.workunit.client.1.smithi191.stdout:3/538: dwrite d12/f1e [0,4194304] 0 2024-09-19T09:35:03.470 INFO:tasks.workunit.client.1.smithi191.stdout:0/691: symlink d0/d9/d1c/le0 0 2024-09-19T09:35:03.470 INFO:tasks.workunit.client.1.smithi191.stdout:0/692: fdatasync d0/d6f/d76/f88 0 2024-09-19T09:35:03.470 INFO:tasks.workunit.client.1.smithi191.stdout:0/693: chown d0/d9/d1c/d1f/d24/l36 2 1 2024-09-19T09:35:03.472 INFO:tasks.workunit.client.1.smithi191.stdout:9/607: dread d3/db/d16/d38/f67 [0,4194304] 0 2024-09-19T09:35:03.472 INFO:tasks.workunit.client.1.smithi191.stdout:5/614: mkdir d0/da7/dcd/dd7/dde 0 2024-09-19T09:35:03.473 INFO:tasks.workunit.client.1.smithi191.stdout:7/587: symlink d2/d2a/d4f/d59/d81/lc9 0 2024-09-19T09:35:03.473 INFO:tasks.workunit.client.1.smithi191.stdout:7/588: stat d2/d2a/d38/d63 0 2024-09-19T09:35:03.478 INFO:tasks.workunit.client.1.smithi191.stdout:1/620: unlink d3/d9/da/d1e/d32/d53/d57/d6d/l88 0 2024-09-19T09:35:03.478 INFO:tasks.workunit.client.1.smithi191.stdout:9/608: dread d3/d8/f13 [0,4194304] 0 2024-09-19T09:35:03.481 INFO:tasks.workunit.client.1.smithi191.stdout:3/539: unlink d12/d13/d1a/d1b/d60/d7a/d93/dad/d73/lb6 0 2024-09-19T09:35:03.481 INFO:tasks.workunit.client.1.smithi191.stdout:3/540: fsync d12/d13/d1a/d1b/d2e/dab/d3d/f8c 0 2024-09-19T09:35:03.482 INFO:tasks.workunit.client.1.smithi191.stdout:0/694: mkdir d0/d9/d1c/d1f/d24/d87/de1 0 2024-09-19T09:35:03.483 INFO:tasks.workunit.client.1.smithi191.stdout:2/576: dwrite d8/db/d13/d40/f5e [0,4194304] 0 2024-09-19T09:35:03.483 INFO:tasks.workunit.client.1.smithi191.stdout:5/615: read d0/d4/d9/d1d/d29/d33/f40 [1499811,101694] 0 2024-09-19T09:35:03.483 INFO:tasks.workunit.client.1.smithi191.stdout:5/616: stat d0/d4/d9/d1d/d29/d7f/d94/lbf 0 2024-09-19T09:35:03.486 INFO:tasks.workunit.client.1.smithi191.stdout:7/589: mknod d2/d39/cca 0 2024-09-19T09:35:03.487 INFO:tasks.workunit.client.1.smithi191.stdout:1/621: rmdir d3/d9/da/d1e/d32/d53/d57/d6d/de3 0 2024-09-19T09:35:03.488 INFO:tasks.workunit.client.1.smithi191.stdout:9/609: symlink d3/db/d16/d17/d81/da6/lce 0 2024-09-19T09:35:03.488 INFO:tasks.workunit.client.1.smithi191.stdout:9/610: truncate d3/db/d53/fbd 842516 0 2024-09-19T09:35:03.489 INFO:tasks.workunit.client.1.smithi191.stdout:4/682: mkdir d5/d1b/d1c/d24/d32/ddd 0 2024-09-19T09:35:03.490 INFO:tasks.workunit.client.1.smithi191.stdout:3/541: creat d12/d13/d1a/d1b/d2e/dab/d51/d62/d85/fc2 x:0 0 0 2024-09-19T09:35:03.491 INFO:tasks.workunit.client.1.smithi191.stdout:0/695: link d0/d9/de/d81/f94 d0/d9/d1c/d1f/d24/dbe/fe2 0 2024-09-19T09:35:03.496 INFO:tasks.workunit.client.1.smithi191.stdout:5/617: mkdir d0/d4/d9/d1d/d29/d33/d45/d97/ddf 0 2024-09-19T09:35:03.496 INFO:tasks.workunit.client.1.smithi191.stdout:5/618: truncate d0/d1f/f96 518563 0 2024-09-19T09:35:03.497 INFO:tasks.workunit.client.1.smithi191.stdout:7/590: link d2/d2a/d79/d7f/f90 d2/d39/d3a/fcb 0 2024-09-19T09:35:03.499 INFO:tasks.workunit.client.1.smithi191.stdout:9/611: creat d3/db/d53/da2/db3/fcf x:0 0 0 2024-09-19T09:35:03.501 INFO:tasks.workunit.client.1.smithi191.stdout:3/542: symlink d12/d13/lc3 0 2024-09-19T09:35:03.504 INFO:tasks.workunit.client.1.smithi191.stdout:0/696: mkdir d0/d9/d1c/d1f/de3 0 2024-09-19T09:35:03.504 INFO:tasks.workunit.client.1.smithi191.stdout:0/697: write d0/fb4 [50584,7534] 0 2024-09-19T09:35:03.504 INFO:tasks.workunit.client.1.smithi191.stdout:0/698: read d0/d6f/d76/f88 [1964416,105954] 0 2024-09-19T09:35:03.504 INFO:tasks.workunit.client.1.smithi191.stdout:0/699: write d0/d9/d1c/d1f/d24/d39/fcc [702231,86150] 0 2024-09-19T09:35:03.504 INFO:tasks.workunit.client.1.smithi191.stdout:7/591: write d2/d2a/d33/f8c [3178090,36516] 0 2024-09-19T09:35:03.505 INFO:tasks.workunit.client.1.smithi191.stdout:2/577: rmdir d8/db/d13/d40 39 2024-09-19T09:35:03.505 INFO:tasks.workunit.client.1.smithi191.stdout:0/700: write d0/d9/f7f [497950,102300] 0 2024-09-19T09:35:03.505 INFO:tasks.workunit.client.1.smithi191.stdout:0/701: write d0/d9/d1c/d1f/f3c [1310011,93520] 0 2024-09-19T09:35:03.507 INFO:tasks.workunit.client.1.smithi191.stdout:1/622: mknod d3/d9/da/d1e/d32/d53/cea 0 2024-09-19T09:35:03.508 INFO:tasks.workunit.client.1.smithi191.stdout:9/612: mkdir d3/db/d16/d17/d3c/dd0 0 2024-09-19T09:35:03.510 INFO:tasks.workunit.client.1.smithi191.stdout:4/683: rename d5/d1b/d1c/d24/d32/cd8 to d5/d1b/d1c/d24/d32/d21/d5c/d8c/cde 0 2024-09-19T09:35:03.510 INFO:tasks.workunit.client.1.smithi191.stdout:4/684: write d5/d1b/d61/d88/faf [577326,124209] 0 2024-09-19T09:35:03.512 INFO:tasks.workunit.client.1.smithi191.stdout:7/592: creat d2/d2a/d4f/d59/d81/fcc x:0 0 0 2024-09-19T09:35:03.512 INFO:tasks.workunit.client.1.smithi191.stdout:7/593: chown d2/d39/d3a/fac 85 1 2024-09-19T09:35:03.513 INFO:tasks.workunit.client.1.smithi191.stdout:2/578: chown d8/db/d4d 0 1 2024-09-19T09:35:03.514 INFO:tasks.workunit.client.1.smithi191.stdout:4/685: readlink d5/d1b/d1c/d24/d32/l3d 0 2024-09-19T09:35:03.516 INFO:tasks.workunit.client.1.smithi191.stdout:3/543: unlink d12/d13/d1a/d1b/l1c 0 2024-09-19T09:35:03.517 INFO:tasks.workunit.client.1.smithi191.stdout:1/623: dread d3/d9/f78 [0,4194304] 0 2024-09-19T09:35:03.517 INFO:tasks.workunit.client.1.smithi191.stdout:1/624: stat d3/d9/da/d8c/lb9 0 2024-09-19T09:35:03.517 INFO:tasks.workunit.client.1.smithi191.stdout:2/579: dread - d8/db/fb6 zero size 2024-09-19T09:35:03.517 INFO:tasks.workunit.client.1.smithi191.stdout:2/580: stat d8/d11/d3f/f22 0 2024-09-19T09:35:03.518 INFO:tasks.workunit.client.1.smithi191.stdout:3/544: dread d12/d13/fb0 [0,4194304] 0 2024-09-19T09:35:03.519 INFO:tasks.workunit.client.1.smithi191.stdout:3/545: fdatasync d12/d13/d1a/d1b/d3c/f4f 0 2024-09-19T09:35:03.519 INFO:tasks.workunit.client.1.smithi191.stdout:9/613: rename d3/da1/fc3 to d3/d60/d78/fd1 0 2024-09-19T09:35:03.521 INFO:tasks.workunit.client.1.smithi191.stdout:4/686: mknod d5/d1b/d1c/d24/d32/d21/d5c/d8c/cdf 0 2024-09-19T09:35:03.525 INFO:tasks.workunit.client.1.smithi191.stdout:1/625: rename d3/d9/da/d7e/c62 to d3/d9/da/d1e/d32/d6f/db2/dd1/ceb 0 2024-09-19T09:35:03.526 INFO:tasks.workunit.client.1.smithi191.stdout:1/626: creat d3/d9/da/d1e/d32/d6f/fec x:0 0 0 2024-09-19T09:35:03.526 INFO:tasks.workunit.client.1.smithi191.stdout:1/627: write d3/d9/da/d1e/d32/d6f/fec [162546,41128] 0 2024-09-19T09:35:03.526 INFO:tasks.workunit.client.1.smithi191.stdout:7/594: dread d2/d2a/d33/f7c [0,4194304] 0 2024-09-19T09:35:03.526 INFO:tasks.workunit.client.1.smithi191.stdout:5/619: dwrite d0/d4/d9/fc2 [0,4194304] 0 2024-09-19T09:35:03.528 INFO:tasks.workunit.client.1.smithi191.stdout:7/595: dread d2/d2a/d4f/d59/fa6 [0,4194304] 0 2024-09-19T09:35:03.528 INFO:tasks.workunit.client.1.smithi191.stdout:2/581: link d8/d11/c1c d8/db/d13/d35/d70/cbe 0 2024-09-19T09:35:03.528 INFO:tasks.workunit.client.1.smithi191.stdout:2/582: read - d8/db/d13/d40/fad zero size 2024-09-19T09:35:03.528 INFO:tasks.workunit.client.1.smithi191.stdout:7/596: creat d2/d2a/d38/fcd x:0 0 0 2024-09-19T09:35:03.532 INFO:tasks.workunit.client.1.smithi191.stdout:1/628: rename d3/d9/da/d1e/d32/f45 to d3/d9/da/d7e/fed 0 2024-09-19T09:35:03.534 INFO:tasks.workunit.client.1.smithi191.stdout:3/546: write d12/d13/d1a/d1b/d2e/f3a [3501144,33549] 0 2024-09-19T09:35:03.534 INFO:tasks.workunit.client.1.smithi191.stdout:2/583: chown d8/db/l6f 1727 1 2024-09-19T09:35:03.535 INFO:tasks.workunit.client.1.smithi191.stdout:2/584: stat d8/db/d13/d35/f37 0 2024-09-19T09:35:03.535 INFO:tasks.workunit.client.1.smithi191.stdout:8/722: sync 2024-09-19T09:35:03.535 INFO:tasks.workunit.client.1.smithi191.stdout:8/723: fdatasync d1/d16/d3c/d17/f3a 0 2024-09-19T09:35:03.535 INFO:tasks.workunit.client.1.smithi191.stdout:8/724: fdatasync d1/d16/f46 0 2024-09-19T09:35:03.538 INFO:tasks.workunit.client.1.smithi191.stdout:7/597: truncate d2/d2a/d38/d63/f95 1852757 0 2024-09-19T09:35:03.541 INFO:tasks.workunit.client.1.smithi191.stdout:4/687: dwrite d5/d1b/d1c/d24/d32/d21/d4a/fd7 [0,4194304] 0 2024-09-19T09:35:03.542 INFO:tasks.workunit.client.1.smithi191.stdout:0/702: dwrite d0/d9/d1c/d1f/f3c [4194304,4194304] 0 2024-09-19T09:35:03.542 INFO:tasks.workunit.client.1.smithi191.stdout:0/703: dread - d0/d9/d1c/d1f/d24/d87/faa zero size 2024-09-19T09:35:03.545 INFO:tasks.workunit.client.1.smithi191.stdout:1/629: getdents d3/d9/da/d1e/d32/d53/d57/d6d/da1/da7 0 2024-09-19T09:35:03.559 INFO:tasks.workunit.client.1.smithi191.stdout:9/614: dwrite d3/db/d53/da2/db3/dc2/fa5 [0,4194304] 0 2024-09-19T09:35:03.560 INFO:tasks.workunit.client.1.smithi191.stdout:5/620: dwrite d0/f20 [0,4194304] 0 2024-09-19T09:35:03.560 INFO:tasks.workunit.client.1.smithi191.stdout:9/615: write d3/db/d16/d17/d81/f8a [321965,111845] 0 2024-09-19T09:35:03.651 INFO:tasks.workunit.client.1.smithi191.stdout:3/547: mkdir d12/d43/d61/d98/dc4 0 2024-09-19T09:35:03.652 INFO:tasks.workunit.client.1.smithi191.stdout:2/585: chown d8/db/d4e/l97 6396687 1 2024-09-19T09:35:03.652 INFO:tasks.workunit.client.1.smithi191.stdout:8/725: creat d1/d7/d1a/d6d/de1/d6b/d83/dab/dbe/fee x:0 0 0 2024-09-19T09:35:03.654 INFO:tasks.workunit.client.1.smithi191.stdout:7/598: unlink d2/d2a/d4f/f76 0 2024-09-19T09:35:03.659 INFO:tasks.workunit.client.1.smithi191.stdout:0/704: symlink d0/d9/d1c/d1f/d24/d29/d30/d7c/le4 0 2024-09-19T09:35:03.659 INFO:tasks.workunit.client.1.smithi191.stdout:0/705: stat d0/d9/l32 0 2024-09-19T09:35:03.659 INFO:tasks.workunit.client.1.smithi191.stdout:1/630: rmdir d3/dd7 39 2024-09-19T09:35:03.659 INFO:tasks.workunit.client.1.smithi191.stdout:1/631: fdatasync d3/d9/da/d1e/d32/d53/d57/d6d/f77 0 2024-09-19T09:35:03.660 INFO:tasks.workunit.client.1.smithi191.stdout:4/688: dread d5/d1b/d1c/d24/d32/f13 [0,4194304] 0 2024-09-19T09:35:03.660 INFO:tasks.workunit.client.1.smithi191.stdout:4/689: chown d5/d38/d73/d8d 16156 1 2024-09-19T09:35:03.661 INFO:tasks.workunit.client.1.smithi191.stdout:4/690: read d5/fa6 [367922,24068] 0 2024-09-19T09:35:03.662 INFO:tasks.workunit.client.1.smithi191.stdout:5/621: rmdir d0/da7/dcd/dd7 39 2024-09-19T09:35:03.663 INFO:tasks.workunit.client.1.smithi191.stdout:9/616: truncate d3/d60/f54 248561 0 2024-09-19T09:35:03.665 INFO:tasks.workunit.client.1.smithi191.stdout:3/548: truncate d12/d13/f3b 3598003 0 2024-09-19T09:35:03.665 INFO:tasks.workunit.client.1.smithi191.stdout:3/549: dread d12/d13/d1a/d1b/d2e/dab/d3d/f8c [0,4194304] 0 2024-09-19T09:35:03.666 INFO:tasks.workunit.client.1.smithi191.stdout:2/586: creat d8/d11/d3f/d64/fbf x:0 0 0 2024-09-19T09:35:03.666 INFO:tasks.workunit.client.1.smithi191.stdout:2/587: creat d8/db/d13/d23/fc0 x:0 0 0 2024-09-19T09:35:03.667 INFO:tasks.workunit.client.1.smithi191.stdout:8/726: dwrite d1/d7/d1a/d6d/de1/d6b/db9/fda [4194304,4194304] 0 2024-09-19T09:35:03.667 INFO:tasks.workunit.client.1.smithi191.stdout:8/727: write d1/d7/d1a/d6d/de1/d6b/d83/dab/dbe/fee [474984,12803] 0 2024-09-19T09:35:03.667 INFO:tasks.workunit.client.1.smithi191.stdout:8/728: write d1/f74 [176968,88766] 0 2024-09-19T09:35:03.667 INFO:tasks.workunit.client.1.smithi191.stdout:8/729: chown d1/d7/d1a/d6d/de1/c8d 52 1 2024-09-19T09:35:03.668 INFO:tasks.workunit.client.1.smithi191.stdout:7/599: mknod d2/d39/d3a/d3c/cce 0 2024-09-19T09:35:03.668 INFO:tasks.workunit.client.1.smithi191.stdout:7/600: write d2/f40 [256359,130617] 0 2024-09-19T09:35:03.668 INFO:tasks.workunit.client.1.smithi191.stdout:0/706: creat d0/d9/d1c/d1f/d24/d87/de1/fe5 x:0 0 0 2024-09-19T09:35:03.668 INFO:tasks.workunit.client.1.smithi191.stdout:9/617: dread d3/db/d16/d17/d3c/fa4 [0,4194304] 0 2024-09-19T09:35:03.669 INFO:tasks.workunit.client.1.smithi191.stdout:4/691: mknod d5/d1b/d1c/d24/d32/d21/d27/ce0 0 2024-09-19T09:35:03.669 INFO:tasks.workunit.client.1.smithi191.stdout:4/692: stat d5/d1b/d1c/d24/d32/d21/d56/d86/fa7 0 2024-09-19T09:35:03.669 INFO:tasks.workunit.client.1.smithi191.stdout:1/632: dread d3/d9/da/d1e/d32/d6f/fec [0,4194304] 0 2024-09-19T09:35:03.670 INFO:tasks.workunit.client.1.smithi191.stdout:5/622: creat d0/da7/dcd/dd7/dde/fe0 x:0 0 0 2024-09-19T09:35:03.671 INFO:tasks.workunit.client.1.smithi191.stdout:4/693: dread d5/d1b/d1c/d24/d32/d21/d56/f72 [0,4194304] 0 2024-09-19T09:35:03.671 INFO:tasks.workunit.client.1.smithi191.stdout:9/618: write d3/d8/f13 [1441101,40645] 0 2024-09-19T09:35:03.671 INFO:tasks.workunit.client.1.smithi191.stdout:3/550: mknod d12/d43/d61/d98/dc4/cc5 0 2024-09-19T09:35:03.671 INFO:tasks.workunit.client.1.smithi191.stdout:6/511: sync 2024-09-19T09:35:03.673 INFO:tasks.workunit.client.1.smithi191.stdout:2/588: rename d8/db/d13/d35/ca5 to d8/db/d13/d23/cc1 0 2024-09-19T09:35:03.674 INFO:tasks.workunit.client.1.smithi191.stdout:3/551: dread f11 [0,4194304] 0 2024-09-19T09:35:03.676 INFO:tasks.workunit.client.1.smithi191.stdout:4/694: dread d5/f4e [0,4194304] 0 2024-09-19T09:35:03.676 INFO:tasks.workunit.client.1.smithi191.stdout:4/695: chown d5/d1b/d1c/d24/d32/l3d 1 1 2024-09-19T09:35:03.676 INFO:tasks.workunit.client.1.smithi191.stdout:4/696: truncate d5/fe 1223106 0 2024-09-19T09:35:03.676 INFO:tasks.workunit.client.1.smithi191.stdout:4/697: creat d5/d38/da5/fe1 x:0 0 0 2024-09-19T09:35:03.676 INFO:tasks.workunit.client.1.smithi191.stdout:4/698: getdents d5/d1b/d1c/d24/d32/d21 0 2024-09-19T09:35:03.676 INFO:tasks.workunit.client.1.smithi191.stdout:4/699: chown d5/d1b/d1c/d24/d32/d21/cd3 4 1 2024-09-19T09:35:03.676 INFO:tasks.workunit.client.1.smithi191.stdout:0/707: truncate d0/d9/d1c/d1f/d24/d29/d30/d56/f66 523825 0 2024-09-19T09:35:03.677 INFO:tasks.workunit.client.1.smithi191.stdout:5/623: creat d0/d4/d9/d1d/d29/d33/d45/d97/fe1 x:0 0 0 2024-09-19T09:35:03.677 INFO:tasks.workunit.client.1.smithi191.stdout:5/624: fdatasync d0/d1f/f56 0 2024-09-19T09:35:03.678 INFO:tasks.workunit.client.1.smithi191.stdout:7/601: write d2/f23 [1288941,75940] 0 2024-09-19T09:35:03.679 INFO:tasks.workunit.client.1.smithi191.stdout:9/619: symlink d3/d60/ld2 0 2024-09-19T09:35:03.679 INFO:tasks.workunit.client.1.smithi191.stdout:9/620: stat d3/db/d16/d38/c91 0 2024-09-19T09:35:03.680 INFO:tasks.workunit.client.1.smithi191.stdout:6/512: creat d2/de/d15/fa0 x:0 0 0 2024-09-19T09:35:03.682 INFO:tasks.workunit.client.1.smithi191.stdout:8/730: rename d1/d22/d47/l96 to d1/d16/d3c/d17/da1/d84/lef 0 2024-09-19T09:35:03.683 INFO:tasks.workunit.client.1.smithi191.stdout:2/589: truncate d8/d11/fac 2945544 0 2024-09-19T09:35:03.685 INFO:tasks.workunit.client.1.smithi191.stdout:3/552: creat d12/d13/d1a/d1b/d2e/dab/da6/fc6 x:0 0 0 2024-09-19T09:35:03.688 INFO:tasks.workunit.client.1.smithi191.stdout:4/700: mknod d5/d1b/d1c/d2f/d95/ce2 0 2024-09-19T09:35:03.690 INFO:tasks.workunit.client.1.smithi191.stdout:7/602: rmdir d2/dc5 0 2024-09-19T09:35:03.690 INFO:tasks.workunit.client.1.smithi191.stdout:7/603: fsync d2/d2a/fc4 0 2024-09-19T09:35:03.691 INFO:tasks.workunit.client.1.smithi191.stdout:6/513: read d2/de/d19/d1e/d64/f2c [1182013,8912] 0 2024-09-19T09:35:03.694 INFO:tasks.workunit.client.1.smithi191.stdout:3/553: unlink fe 0 2024-09-19T09:35:03.694 INFO:tasks.workunit.client.1.smithi191.stdout:3/554: chown d12/d13/d1a/d1b/d60/d7a/lbe 598467780 1 2024-09-19T09:35:03.694 INFO:tasks.workunit.client.1.smithi191.stdout:3/555: read d12/d13/d1a/d1b/d2e/dab/d51/fb9 [601889,3601] 0 2024-09-19T09:35:03.697 INFO:tasks.workunit.client.1.smithi191.stdout:7/604: unlink d2/d2a/d33/f73 0 2024-09-19T09:35:03.698 INFO:tasks.workunit.client.1.smithi191.stdout:9/621: dread d3/db/d16/d17/f4c [0,4194304] 0 2024-09-19T09:35:03.699 INFO:tasks.workunit.client.1.smithi191.stdout:9/622: creat d3/db/d53/fd3 x:0 0 0 2024-09-19T09:35:03.700 INFO:tasks.workunit.client.1.smithi191.stdout:8/731: rmdir d1/d16/d2e 39 2024-09-19T09:35:03.703 INFO:tasks.workunit.client.1.smithi191.stdout:4/701: rmdir d5/d1b/d1c/d24/d32/d21/d4a 39 2024-09-19T09:35:03.703 INFO:tasks.workunit.client.1.smithi191.stdout:4/702: write d5/d1b/d1c/d2f/d37/d59/fa1 [688033,21832] 0 2024-09-19T09:35:03.705 INFO:tasks.workunit.client.1.smithi191.stdout:9/623: mkdir d3/db/d16/d38/dd4 0 2024-09-19T09:35:03.705 INFO:tasks.workunit.client.1.smithi191.stdout:9/624: readlink d3/d8/l76 0 2024-09-19T09:35:03.706 INFO:tasks.workunit.client.1.smithi191.stdout:4/703: mkdir d5/d1b/d1c/d24/d32/d21/d4a/dc5/de3 0 2024-09-19T09:35:03.706 INFO:tasks.workunit.client.1.smithi191.stdout:4/704: readlink d5/d1b/d1c/d2f/d19/lf 0 2024-09-19T09:35:03.707 INFO:tasks.workunit.client.1.smithi191.stdout:9/625: getdents d3/db/d16/d17/d81/d8d 0 2024-09-19T09:35:03.708 INFO:tasks.workunit.client.1.smithi191.stdout:4/705: dread d5/d1b/d1c/d24/d32/d21/d5c/fb7 [0,4194304] 0 2024-09-19T09:35:03.708 INFO:tasks.workunit.client.1.smithi191.stdout:4/706: write d5/d1b/d1c/d2f/d37/d59/fbf [1496979,49345] 0 2024-09-19T09:35:03.709 INFO:tasks.workunit.client.1.smithi191.stdout:9/626: mknod d3/db/cd5 0 2024-09-19T09:35:03.710 INFO:tasks.workunit.client.1.smithi191.stdout:4/707: stat d5/d1b/d1c/d24/d32/f1e 0 2024-09-19T09:35:03.713 INFO:tasks.workunit.client.1.smithi191.stdout:4/708: symlink d5/d38/d73/d8d/le4 0 2024-09-19T09:35:03.713 INFO:tasks.workunit.client.1.smithi191.stdout:4/709: fdatasync d5/d1b/d8e/dad/f8b 0 2024-09-19T09:35:03.713 INFO:tasks.workunit.client.1.smithi191.stdout:9/627: mknod d3/d8/cd6 0 2024-09-19T09:35:03.714 INFO:tasks.workunit.client.1.smithi191.stdout:4/710: truncate d5/d1b/d1c/d24/d32/d21/d78/fce 3230009 0 2024-09-19T09:35:03.715 INFO:tasks.workunit.client.1.smithi191.stdout:4/711: rmdir d5/d1b/d1c/d28/d96 39 2024-09-19T09:35:03.715 INFO:tasks.workunit.client.1.smithi191.stdout:4/712: write d5/d1b/d1c/d28/fbd [406991,17977] 0 2024-09-19T09:35:03.716 INFO:tasks.workunit.client.1.smithi191.stdout:4/713: creat d5/d1b/d1c/d24/d32/d21/d56/fe5 x:0 0 0 2024-09-19T09:35:03.717 INFO:tasks.workunit.client.1.smithi191.stdout:4/714: getdents d5/d1b/d1c/d24/d32/d21/d5c 0 2024-09-19T09:35:03.717 INFO:tasks.workunit.client.1.smithi191.stdout:4/715: readlink d5/d1b/d1c/d24/d32/d21/l55 0 2024-09-19T09:35:03.717 INFO:tasks.workunit.client.1.smithi191.stdout:4/716: readlink d5/d1b/d61/l6a 0 2024-09-19T09:35:03.718 INFO:tasks.workunit.client.1.smithi191.stdout:4/717: link d5/d38/l9f d5/d1b/d1c/d24/d32/d21/d5c/le6 0 2024-09-19T09:35:03.719 INFO:tasks.workunit.client.1.smithi191.stdout:8/732: write d1/d22/d47/f5a [2729422,25496] 0 2024-09-19T09:35:03.720 INFO:tasks.workunit.client.1.smithi191.stdout:8/733: unlink d1/d7/d1a/d6d/de1/d6b/da9/le9 0 2024-09-19T09:35:03.720 INFO:tasks.workunit.client.1.smithi191.stdout:8/734: chown d1/d7/d1a/d6d/de1/d6b/d83/dab 133 1 2024-09-19T09:35:03.726 INFO:tasks.workunit.client.1.smithi191.stdout:9/628: dread d3/db/d53/f6f [0,4194304] 0 2024-09-19T09:35:03.726 INFO:tasks.workunit.client.1.smithi191.stdout:9/629: write d3/d8/f56 [448745,125820] 0 2024-09-19T09:35:03.727 INFO:tasks.workunit.client.1.smithi191.stdout:9/630: dread - d3/d60/d78/fbe zero size 2024-09-19T09:35:03.727 INFO:tasks.workunit.client.1.smithi191.stdout:9/631: stat d3/db/d16/d47/d89 0 2024-09-19T09:35:03.728 INFO:tasks.workunit.client.1.smithi191.stdout:0/708: dwrite d0/d9/d1c/d1f/d24/dbe/fd3 [0,4194304] 0 2024-09-19T09:35:03.730 INFO:tasks.workunit.client.1.smithi191.stdout:1/633: dwrite d3/d9/da/f3b [4194304,4194304] 0 2024-09-19T09:35:03.730 INFO:tasks.workunit.client.1.smithi191.stdout:1/634: readlink d3/d9/d73/d94/dc9/le1 0 2024-09-19T09:35:03.731 INFO:tasks.workunit.client.1.smithi191.stdout:2/590: dwrite d8/db/d13/d40/fad [0,4194304] 0 2024-09-19T09:35:03.731 INFO:tasks.workunit.client.1.smithi191.stdout:2/591: chown d8/d11/d98/f9a 74148 1 2024-09-19T09:35:03.731 INFO:tasks.workunit.client.1.smithi191.stdout:5/625: dwrite d0/d4/d9/d1d/d22/f6d [0,4194304] 0 2024-09-19T09:35:03.731 INFO:tasks.workunit.client.1.smithi191.stdout:7/605: dwrite d2/f9d [0,4194304] 0 2024-09-19T09:35:03.731 INFO:tasks.workunit.client.1.smithi191.stdout:7/606: write d2/d2a/d4f/f80 [728408,67095] 0 2024-09-19T09:35:03.731 INFO:tasks.workunit.client.1.smithi191.stdout:7/607: creat d2/d2a/d38/d63/da2/fcf x:0 0 0 2024-09-19T09:35:03.731 INFO:tasks.workunit.client.1.smithi191.stdout:7/608: fdatasync d2/d39/d3a/fac 0 2024-09-19T09:35:03.733 INFO:tasks.workunit.client.1.smithi191.stdout:1/635: rename d3/d9/d73/d94/f9f to d3/d9/d73/d94/fee 0 2024-09-19T09:35:03.734 INFO:tasks.workunit.client.1.smithi191.stdout:4/718: write d5/d1b/d1c/d24/d32/d21/d56/fb9 [5696178,6605] 0 2024-09-19T09:35:03.738 INFO:tasks.workunit.client.1.smithi191.stdout:3/556: dwrite d12/d43/f44 [0,4194304] 0 2024-09-19T09:35:03.738 INFO:tasks.workunit.client.1.smithi191.stdout:6/514: dwrite d2/de/d2a/d7d/f6b [4194304,4194304] 0 2024-09-19T09:35:03.742 INFO:tasks.workunit.client.1.smithi191.stdout:1/636: mkdir d3/d9/da/d1e/d32/d53/d57/def 0 2024-09-19T09:35:03.743 INFO:tasks.workunit.client.1.smithi191.stdout:4/719: mkdir d5/de7 0 2024-09-19T09:35:03.748 INFO:tasks.workunit.client.1.smithi191.stdout:6/515: rename d2/lc to d2/de/d19/d1e/la1 0 2024-09-19T09:35:03.748 INFO:tasks.workunit.client.1.smithi191.stdout:6/516: write d2/de/d15/f41 [464223,108058] 0 2024-09-19T09:35:03.750 INFO:tasks.workunit.client.1.smithi191.stdout:8/735: dwrite d1/d22/feb [0,4194304] 0 2024-09-19T09:35:03.750 INFO:tasks.workunit.client.1.smithi191.stdout:8/736: creat d1/d22/ff0 x:0 0 0 2024-09-19T09:35:03.752 INFO:tasks.workunit.client.1.smithi191.stdout:7/609: rmdir d2/d39/d3a/d9c 39 2024-09-19T09:35:03.753 INFO:tasks.workunit.client.1.smithi191.stdout:3/557: write d12/d13/d1a/d1b/d2e/dab/d3d/f40 [1449758,112417] 0 2024-09-19T09:35:03.753 INFO:tasks.workunit.client.1.smithi191.stdout:3/558: readlink d12/d43/d61/d98/lae 0 2024-09-19T09:35:03.753 INFO:tasks.workunit.client.1.smithi191.stdout:6/517: truncate d2/de/d15/f78 2995046 0 2024-09-19T09:35:03.753 INFO:tasks.workunit.client.1.smithi191.stdout:6/518: write d2/de/d19/d1e/f21 [2284899,85666] 0 2024-09-19T09:35:03.753 INFO:tasks.workunit.client.1.smithi191.stdout:5/626: write d0/d4/f78 [3881524,64922] 0 2024-09-19T09:35:03.756 INFO:tasks.workunit.client.1.smithi191.stdout:0/709: dwrite d0/d9/d1c/d1f/d24/d39/d58/f67 [4194304,4194304] 0 2024-09-19T09:35:03.756 INFO:tasks.workunit.client.1.smithi191.stdout:4/720: dread d5/f8 [0,4194304] 0 2024-09-19T09:35:03.756 INFO:tasks.workunit.client.1.smithi191.stdout:4/721: write d5/fd2 [1282830,80310] 0 2024-09-19T09:35:03.756 INFO:tasks.workunit.client.1.smithi191.stdout:9/632: getdents d3/db 0 2024-09-19T09:35:03.756 INFO:tasks.workunit.client.1.smithi191.stdout:9/633: chown d3/db 10 1 2024-09-19T09:35:03.756 INFO:tasks.workunit.client.1.smithi191.stdout:9/634: fsync d3/d8/f74 0 2024-09-19T09:35:03.757 INFO:tasks.workunit.client.1.smithi191.stdout:9/635: read d3/db/d16/d38/f3e [4355421,97271] 0 2024-09-19T09:35:03.758 INFO:tasks.workunit.client.1.smithi191.stdout:8/737: mkdir d1/d22/d47/d9d/df1 0 2024-09-19T09:35:03.758 INFO:tasks.workunit.client.1.smithi191.stdout:8/738: creat d1/d7/d1a/d6d/da8/ff2 x:0 0 0 2024-09-19T09:35:03.760 INFO:tasks.workunit.client.1.smithi191.stdout:7/610: rmdir d2/d5e 39 2024-09-19T09:35:03.761 INFO:tasks.workunit.client.1.smithi191.stdout:7/611: chown d2/d5e/c6e 12 1 2024-09-19T09:35:03.765 INFO:tasks.workunit.client.1.smithi191.stdout:3/559: rename d12/d13/d1a/d1b/d2e/dab/da6/cb8 to d12/d13/d1a/d1b/d2e/dab/da6/da7/cc7 0 2024-09-19T09:35:03.765 INFO:tasks.workunit.client.1.smithi191.stdout:3/560: fdatasync d12/d13/d1a/d1b/d3c/d3f/f4d 0 2024-09-19T09:35:03.769 INFO:tasks.workunit.client.1.smithi191.stdout:1/637: dwrite d3/d9/fc0 [0,4194304] 0 2024-09-19T09:35:03.769 INFO:tasks.workunit.client.1.smithi191.stdout:6/519: unlink d2/de/d2a/d2d/f95 0 2024-09-19T09:35:03.773 INFO:tasks.workunit.client.1.smithi191.stdout:5/627: dwrite d0/d4/d9/d1d/d28/f85 [0,4194304] 0 2024-09-19T09:35:03.773 INFO:tasks.workunit.client.1.smithi191.stdout:5/628: write d0/d4/d9/d1d/d29/d33/d45/fb1 [198504,50724] 0 2024-09-19T09:35:03.780 INFO:tasks.workunit.client.1.smithi191.stdout:3/561: dread d12/f1e [0,4194304] 0 2024-09-19T09:35:03.784 INFO:tasks.workunit.client.1.smithi191.stdout:4/722: unlink d5/d1b/d1c/d2f/d19/f3a 0 2024-09-19T09:35:03.785 INFO:tasks.workunit.client.1.smithi191.stdout:9/636: truncate d3/d60/f7a 2227975 0 2024-09-19T09:35:03.786 INFO:tasks.workunit.client.1.smithi191.stdout:8/739: rmdir d1/d7/d1a/d6d/de1/d6b/da9/dc1 39 2024-09-19T09:35:03.787 INFO:tasks.workunit.client.1.smithi191.stdout:8/740: chown d1/d7/d1a/d6d/de1/d6b/l8a 0 1 2024-09-19T09:35:03.787 INFO:tasks.workunit.client.1.smithi191.stdout:8/741: chown d1/d16/d23 3 1 2024-09-19T09:35:03.788 INFO:tasks.workunit.client.1.smithi191.stdout:7/612: symlink d2/d2a/d38/d63/dc1/ld0 0 2024-09-19T09:35:03.791 INFO:tasks.workunit.client.1.smithi191.stdout:1/638: symlink d3/d9/da/d1e/d32/ddc/lf0 0 2024-09-19T09:35:03.791 INFO:tasks.workunit.client.1.smithi191.stdout:1/639: dread - d3/d9/d73/fd4 zero size 2024-09-19T09:35:03.791 INFO:tasks.workunit.client.1.smithi191.stdout:6/520: creat d2/de/d2a/d2d/fa2 x:0 0 0 2024-09-19T09:35:03.792 INFO:tasks.workunit.client.1.smithi191.stdout:0/710: rmdir d0/d9/de/d61 39 2024-09-19T09:35:03.794 INFO:tasks.workunit.client.1.smithi191.stdout:5/629: link d0/d4/d9/de/f47 d0/d4/d9/d1d/d22/d5c/fe2 0 2024-09-19T09:35:03.794 INFO:tasks.workunit.client.1.smithi191.stdout:7/613: dread d2/d2a/d79/fb7 [0,4194304] 0 2024-09-19T09:35:03.795 INFO:tasks.workunit.client.1.smithi191.stdout:4/723: link d5/d1b/d1c/d24/d32/d21/d5c/le6 d5/d1b/d1c/le8 0 2024-09-19T09:35:03.795 INFO:tasks.workunit.client.1.smithi191.stdout:4/724: readlink d5/d1b/d61/lb8 0 2024-09-19T09:35:03.796 INFO:tasks.workunit.client.1.smithi191.stdout:3/562: dwrite d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/f8a [0,4194304] 0 2024-09-19T09:35:03.798 INFO:tasks.workunit.client.1.smithi191.stdout:7/614: dread d2/d2a/d4f/d59/f65 [0,4194304] 0 2024-09-19T09:35:03.798 INFO:tasks.workunit.client.1.smithi191.stdout:1/640: symlink d3/d9/da/d1e/lf1 0 2024-09-19T09:35:03.798 INFO:tasks.workunit.client.1.smithi191.stdout:1/641: chown d3/d9/da/d1e/d25/d70/l76 780323 1 2024-09-19T09:35:03.798 INFO:tasks.workunit.client.1.smithi191.stdout:1/642: read - d3/d9/da/d1e/d25/f84 zero size 2024-09-19T09:35:03.798 INFO:tasks.workunit.client.1.smithi191.stdout:6/521: creat d2/de/d19/d1e/d64/d77/d82/fa3 x:0 0 0 2024-09-19T09:35:03.800 INFO:tasks.workunit.client.1.smithi191.stdout:5/630: unlink d0/l1c 0 2024-09-19T09:35:03.800 INFO:tasks.workunit.client.1.smithi191.stdout:5/631: dread - d0/d4/d9/d1d/d29/d33/d45/f8a zero size 2024-09-19T09:35:03.801 INFO:tasks.workunit.client.1.smithi191.stdout:4/725: mkdir d5/d1b/d1c/d24/d32/d21/d92/de9 0 2024-09-19T09:35:03.801 INFO:tasks.workunit.client.1.smithi191.stdout:9/637: getdents d3/da1 0 2024-09-19T09:35:03.803 INFO:tasks.workunit.client.1.smithi191.stdout:8/742: getdents d1/d16/d3c/d28/d79/da2 0 2024-09-19T09:35:03.803 INFO:tasks.workunit.client.1.smithi191.stdout:8/743: chown d1/d16/fed 2352 1 2024-09-19T09:35:03.803 INFO:tasks.workunit.client.1.smithi191.stdout:8/744: truncate d1/d16/d3c/d17/f49 9241644 0 2024-09-19T09:35:03.804 INFO:tasks.workunit.client.1.smithi191.stdout:1/643: link d3/dd7/fad d3/d9/da/d1e/d32/d53/d57/d6d/ff2 0 2024-09-19T09:35:03.806 INFO:tasks.workunit.client.1.smithi191.stdout:9/638: rmdir d3/db/d53/da2/db3/dc2/dcc 0 2024-09-19T09:35:03.807 INFO:tasks.workunit.client.1.smithi191.stdout:0/711: dread d0/d9/de/f19 [0,4194304] 0 2024-09-19T09:35:03.808 INFO:tasks.workunit.client.1.smithi191.stdout:9/639: truncate d3/d60/faa 1297218 0 2024-09-19T09:35:03.808 INFO:tasks.workunit.client.1.smithi191.stdout:9/640: fsync d3/d8/fb2 0 2024-09-19T09:35:03.810 INFO:tasks.workunit.client.1.smithi191.stdout:3/563: write d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/f8a [3751355,15814] 0 2024-09-19T09:35:03.810 INFO:tasks.workunit.client.1.smithi191.stdout:0/712: mknod d0/d9/d1c/d1f/d24/d87/ce6 0 2024-09-19T09:35:03.810 INFO:tasks.workunit.client.1.smithi191.stdout:0/713: dread - d0/d9/de/d61/dbf/fd4 zero size 2024-09-19T09:35:03.810 INFO:tasks.workunit.client.1.smithi191.stdout:6/522: dread d2/de/d2a/d2d/f99 [0,4194304] 0 2024-09-19T09:35:03.811 INFO:tasks.workunit.client.1.smithi191.stdout:1/644: dread d3/fb3 [0,4194304] 0 2024-09-19T09:35:03.812 INFO:tasks.workunit.client.1.smithi191.stdout:9/641: symlink d3/db/d16/d38/dd4/ld7 0 2024-09-19T09:35:03.812 INFO:tasks.workunit.client.1.smithi191.stdout:9/642: truncate d3/db/d16/d17/d81/d8d/f98 1046258 0 2024-09-19T09:35:03.813 INFO:tasks.workunit.client.1.smithi191.stdout:4/726: dread d5/d1b/d1c/d2f/d37/d59/fbf [0,4194304] 0 2024-09-19T09:35:03.813 INFO:tasks.workunit.client.1.smithi191.stdout:4/727: truncate d5/d1b/d1c/d24/d32/d21/d56/f72 690734 0 2024-09-19T09:35:03.813 INFO:tasks.workunit.client.1.smithi191.stdout:4/728: stat d5/d1b/d1c/d28/fbd 0 2024-09-19T09:35:03.814 INFO:tasks.workunit.client.1.smithi191.stdout:6/523: mkdir d2/de/d2a/d2d/d30/da4 0 2024-09-19T09:35:03.815 INFO:tasks.workunit.client.1.smithi191.stdout:8/745: dread d1/d16/d3c/d28/fa0 [0,4194304] 0 2024-09-19T09:35:03.815 INFO:tasks.workunit.client.1.smithi191.stdout:8/746: write d1/d16/f46 [36343,70125] 0 2024-09-19T09:35:03.815 INFO:tasks.workunit.client.1.smithi191.stdout:8/747: write d1/d7/d1a/d6d/da8/fcf [495049,73361] 0 2024-09-19T09:35:03.816 INFO:tasks.workunit.client.1.smithi191.stdout:1/645: unlink d3/d9/da/d1e/d32/d53/d57/c66 0 2024-09-19T09:35:03.818 INFO:tasks.workunit.client.1.smithi191.stdout:4/729: dread d5/fa6 [0,4194304] 0 2024-09-19T09:35:03.819 INFO:tasks.workunit.client.1.smithi191.stdout:4/730: readlink d5/d1b/d1c/d2f/d37/d59/l66 0 2024-09-19T09:35:03.819 INFO:tasks.workunit.client.1.smithi191.stdout:9/643: rename d3/fe to d3/db/d16/d47/fd8 0 2024-09-19T09:35:03.819 INFO:tasks.workunit.client.1.smithi191.stdout:9/644: creat d3/db/d53/fd9 x:0 0 0 2024-09-19T09:35:03.819 INFO:tasks.workunit.client.1.smithi191.stdout:0/714: mknod d0/d6f/d7b/ce7 0 2024-09-19T09:35:03.819 INFO:tasks.workunit.client.1.smithi191.stdout:0/715: chown d0/d9/de/f8f 0 1 2024-09-19T09:35:03.820 INFO:tasks.workunit.client.1.smithi191.stdout:6/524: symlink d2/de/d2a/d84/la5 0 2024-09-19T09:35:03.820 INFO:tasks.workunit.client.1.smithi191.stdout:6/525: rename d2/de/d19 to d2/de/d19/da6 22 2024-09-19T09:35:03.821 INFO:tasks.workunit.client.1.smithi191.stdout:8/748: creat d1/d16/ff3 x:0 0 0 2024-09-19T09:35:03.821 INFO:tasks.workunit.client.1.smithi191.stdout:8/749: fsync d1/d16/fed 0 2024-09-19T09:35:03.821 INFO:tasks.workunit.client.1.smithi191.stdout:8/750: stat d1/d7/d1a/d6d/de1/d6b/da9 0 2024-09-19T09:35:03.822 INFO:tasks.workunit.client.1.smithi191.stdout:1/646: mkdir d3/d9/da/d1e/d32/d53/d57/d6d/df3 0 2024-09-19T09:35:03.822 INFO:tasks.workunit.client.1.smithi191.stdout:1/647: chown d3/d9/da/d1e/lf1 11964584 1 2024-09-19T09:35:03.823 INFO:tasks.workunit.client.1.smithi191.stdout:7/615: dwrite d2/d2a/fb2 [4194304,4194304] 0 2024-09-19T09:35:03.823 INFO:tasks.workunit.client.1.smithi191.stdout:4/731: mkdir d5/d1b/d1c/dea 0 2024-09-19T09:35:03.823 INFO:tasks.workunit.client.1.smithi191.stdout:4/732: truncate d5/d1b/d1c/d24/d32/d21/d56/d86/fa7 575401 0 2024-09-19T09:35:03.825 INFO:tasks.workunit.client.1.smithi191.stdout:0/716: getdents d0/d9/d1c/d1f/d24/d29 0 2024-09-19T09:35:03.826 INFO:tasks.workunit.client.1.smithi191.stdout:5/632: dwrite d0/d4/d9/d1d/d22/d5c/f8d [0,4194304] 0 2024-09-19T09:35:03.826 INFO:tasks.workunit.client.1.smithi191.stdout:5/633: write d0/d4/d9/d1d/d29/d33/d52/f86 [1736992,58130] 0 2024-09-19T09:35:03.826 INFO:tasks.workunit.client.1.smithi191.stdout:5/634: write d0/d4/d9/d1d/d22/d5c/fc3 [751657,32251] 0 2024-09-19T09:35:03.826 INFO:tasks.workunit.client.1.smithi191.stdout:5/635: chown d0/d4/d4a/db5 0 1 2024-09-19T09:35:03.827 INFO:tasks.workunit.client.1.smithi191.stdout:8/751: rename d1/d16/d3c/d28/d79/ld1 to d1/d16/d3c/d17/da1/d84/lf4 0 2024-09-19T09:35:03.827 INFO:tasks.workunit.client.1.smithi191.stdout:1/648: truncate d3/d9/da/d1e/d32/d53/d57/d6d/f77 208926 0 2024-09-19T09:35:03.827 INFO:tasks.workunit.client.1.smithi191.stdout:1/649: truncate d3/d9/da/d42/f91 277526 0 2024-09-19T09:35:03.830 INFO:tasks.workunit.client.1.smithi191.stdout:3/564: dwrite d12/d13/d1a/d1b/d60/d7a/f92 [0,4194304] 0 2024-09-19T09:35:03.838 INFO:tasks.workunit.client.1.smithi191.stdout:7/616: write d2/f28 [1325400,126470] 0 2024-09-19T09:35:03.843 INFO:tasks.workunit.client.1.smithi191.stdout:0/717: rename d0/d9/d1c/d1f/d24/d29/d30/f5b to d0/dc5/d86/fe8 0 2024-09-19T09:35:03.845 INFO:tasks.workunit.client.1.smithi191.stdout:3/565: mkdir d12/d13/d1a/d5d/dc8 0 2024-09-19T09:35:03.846 INFO:tasks.workunit.client.1.smithi191.stdout:3/566: chown d12/d43/f44 9628 1 2024-09-19T09:35:03.846 INFO:tasks.workunit.client.1.smithi191.stdout:6/526: dwrite d2/de/d2a/d2d/fa2 [0,4194304] 0 2024-09-19T09:35:03.846 INFO:tasks.workunit.client.1.smithi191.stdout:6/527: write d2/de/d19/d1e/d64/f6d [330822,3519] 0 2024-09-19T09:35:03.848 INFO:tasks.workunit.client.1.smithi191.stdout:7/617: mknod d2/d39/d3a/d9c/cd1 0 2024-09-19T09:35:03.854 INFO:tasks.workunit.client.1.smithi191.stdout:9/645: write d3/d60/faa [204091,91246] 0 2024-09-19T09:35:03.854 INFO:tasks.workunit.client.1.smithi191.stdout:1/650: dwrite d3/fb3 [0,4194304] 0 2024-09-19T09:35:03.854 INFO:tasks.workunit.client.1.smithi191.stdout:4/733: dwrite d5/d1b/d1c/d24/d32/d21/d92/fa8 [0,4194304] 0 2024-09-19T09:35:03.854 INFO:tasks.workunit.client.1.smithi191.stdout:1/651: write d3/d9/da/d1e/d32/d53/f1c [1203359,92748] 0 2024-09-19T09:35:03.854 INFO:tasks.workunit.client.1.smithi191.stdout:1/652: fdatasync d3/d9/da/d1e/fba 0 2024-09-19T09:35:03.860 INFO:tasks.workunit.client.1.smithi191.stdout:3/567: dread d12/d43/f44 [0,4194304] 0 2024-09-19T09:35:03.860 INFO:tasks.workunit.client.1.smithi191.stdout:3/568: chown d12/d43/f52 338981 1 2024-09-19T09:35:03.861 INFO:tasks.workunit.client.1.smithi191.stdout:2/592: sync 2024-09-19T09:35:03.864 INFO:tasks.workunit.client.1.smithi191.stdout:6/528: dread d2/f63 [0,4194304] 0 2024-09-19T09:35:03.868 INFO:tasks.workunit.client.1.smithi191.stdout:9/646: dwrite d3/d60/d78/fd1 [0,4194304] 0 2024-09-19T09:35:03.991 INFO:tasks.workunit.client.1.smithi191.stdout:7/618: dwrite d2/d2a/d4f/d59/fa6 [0,4194304] 0 2024-09-19T09:35:03.999 INFO:tasks.workunit.client.1.smithi191.stdout:0/718: rename d0/d9/d1c/d1f/d24/d29/d30/l4c to d0/d9/d1c/d1f/d24/d39/d7a/le9 0 2024-09-19T09:35:04.000 INFO:tasks.workunit.client.1.smithi191.stdout:8/752: symlink d1/d16/d2e/d32/de7/lf5 0 2024-09-19T09:35:04.003 INFO:tasks.workunit.client.1.smithi191.stdout:4/734: truncate d5/f6 2740108 0 2024-09-19T09:35:04.005 INFO:tasks.workunit.client.1.smithi191.stdout:3/569: rmdir d12/d43/d61/d98 39 2024-09-19T09:35:04.009 INFO:tasks.workunit.client.1.smithi191.stdout:4/735: chown d5/d1b/d74 3 1 2024-09-19T09:35:04.014 INFO:tasks.workunit.client.1.smithi191.stdout:1/653: unlink d3/d9/da/d1e/d32/d53/caa 0 2024-09-19T09:35:04.014 INFO:tasks.workunit.client.1.smithi191.stdout:9/647: rename d3/d8/c6a to d3/db/d16/d47/d55/cda 0 2024-09-19T09:35:04.015 INFO:tasks.workunit.client.1.smithi191.stdout:1/654: mknod d3/d9/d73/d94/dc9/cf4 0 2024-09-19T09:35:04.015 INFO:tasks.workunit.client.1.smithi191.stdout:1/655: readlink d3/d9/da/d1e/d25/d70/da0/le0 0 2024-09-19T09:35:04.016 INFO:tasks.workunit.client.1.smithi191.stdout:1/656: mknod d3/d9/da/d1e/d32/d53/d57/d6d/da1/cf5 0 2024-09-19T09:35:04.017 INFO:tasks.workunit.client.1.smithi191.stdout:3/570: dread d12/f81 [4194304,4194304] 0 2024-09-19T09:35:04.017 INFO:tasks.workunit.client.1.smithi191.stdout:2/593: dwrite d8/d11/d3f/d8a/fae [4194304,4194304] 0 2024-09-19T09:35:04.017 INFO:tasks.workunit.client.1.smithi191.stdout:2/594: truncate d8/db/d13/d35/f48 1035332 0 2024-09-19T09:35:04.017 INFO:tasks.workunit.client.1.smithi191.stdout:1/657: truncate d3/d9/da/db/f33 2362809 0 2024-09-19T09:35:04.018 INFO:tasks.workunit.client.1.smithi191.stdout:0/719: read d0/d9/f25 [626379,99943] 0 2024-09-19T09:35:04.018 INFO:tasks.workunit.client.1.smithi191.stdout:0/720: readlink d0/d9/d1c/d20/l41 0 2024-09-19T09:35:04.018 INFO:tasks.workunit.client.1.smithi191.stdout:0/721: fdatasync d0/d9/d1c/d1f/d24/d39/fcc 0 2024-09-19T09:35:04.018 INFO:tasks.workunit.client.1.smithi191.stdout:0/722: chown d0/d9/d1c/d1f/d24/d29/f3d 615186921 1 2024-09-19T09:35:04.019 INFO:tasks.workunit.client.1.smithi191.stdout:0/723: stat d0/dc5/d86/fa5 0 2024-09-19T09:35:04.019 INFO:tasks.workunit.client.1.smithi191.stdout:9/648: dread d3/db/d16/d17/d81/d8d/f98 [0,4194304] 0 2024-09-19T09:35:04.019 INFO:tasks.workunit.client.1.smithi191.stdout:2/595: rmdir d8/db/d13/d35/d70 39 2024-09-19T09:35:04.019 INFO:tasks.workunit.client.1.smithi191.stdout:1/658: creat d3/d9/da/d1e/d32/d53/d57/ff6 x:0 0 0 2024-09-19T09:35:04.020 INFO:tasks.workunit.client.1.smithi191.stdout:3/571: rename d12/d13/d1a/d1b/d60/d7a/d93/dad to d12/d13/dc9 0 2024-09-19T09:35:04.021 INFO:tasks.workunit.client.1.smithi191.stdout:9/649: truncate d3/db/f11 2132957 0 2024-09-19T09:35:04.023 INFO:tasks.workunit.client.1.smithi191.stdout:9/650: creat d3/d60/d78/fdb x:0 0 0 2024-09-19T09:35:04.023 INFO:tasks.workunit.client.1.smithi191.stdout:9/651: rename d3/db/d16 to d3/db/d16/d17/d3c/dd0/ddc 22 2024-09-19T09:35:04.024 INFO:tasks.workunit.client.1.smithi191.stdout:9/652: creat d3/d8/fdd x:0 0 0 2024-09-19T09:35:04.025 INFO:tasks.workunit.client.1.smithi191.stdout:9/653: mknod d3/db/d16/d17/d5b/cde 0 2024-09-19T09:35:04.025 INFO:tasks.workunit.client.1.smithi191.stdout:9/654: stat d3/db/d53 0 2024-09-19T09:35:04.027 INFO:tasks.workunit.client.1.smithi191.stdout:9/655: rename d3/db/d16/d17/d5b/d68 to d3/db/d16/d38/dd4/ddf 0 2024-09-19T09:35:04.030 INFO:tasks.workunit.client.1.smithi191.stdout:9/656: rename d3/db/d16/d17/d81/f82 to d3/db/d53/da2/db3/dc2/fe0 0 2024-09-19T09:35:04.031 INFO:tasks.workunit.client.1.smithi191.stdout:9/657: symlink d3/db/d16/d17/d81/d8d/dcd/le1 0 2024-09-19T09:35:04.032 INFO:tasks.workunit.client.1.smithi191.stdout:9/658: mknod d3/db/d16/d17/d5b/ce2 0 2024-09-19T09:35:04.033 INFO:tasks.workunit.client.1.smithi191.stdout:9/659: creat d3/db/d16/d17/d3c/dd0/fe3 x:0 0 0 2024-09-19T09:35:04.035 INFO:tasks.workunit.client.1.smithi191.stdout:2/596: dread d8/db/d13/d40/f52 [0,4194304] 0 2024-09-19T09:35:04.035 INFO:tasks.workunit.client.1.smithi191.stdout:2/597: dread - d8/db/d13/d23/fc0 zero size 2024-09-19T09:35:04.036 INFO:tasks.workunit.client.1.smithi191.stdout:6/529: dwrite d2/de/d15/f78 [0,4194304] 0 2024-09-19T09:35:04.036 INFO:tasks.workunit.client.1.smithi191.stdout:6/530: write d2/de/f14 [4989784,33197] 0 2024-09-19T09:35:04.039 INFO:tasks.workunit.client.1.smithi191.stdout:7/619: dwrite d2/d39/d3a/d3c/f69 [0,4194304] 0 2024-09-19T09:35:04.039 INFO:tasks.workunit.client.1.smithi191.stdout:1/659: dwrite d3/d9/da/d1e/fba [0,4194304] 0 2024-09-19T09:35:04.040 INFO:tasks.workunit.client.1.smithi191.stdout:0/724: write d0/d9/d1c/d1f/f85 [1251824,128818] 0 2024-09-19T09:35:04.040 INFO:tasks.workunit.client.1.smithi191.stdout:6/531: mkdir d2/de/d19/d1e/d64/d61/d81/da7 0 2024-09-19T09:35:04.040 INFO:tasks.workunit.client.1.smithi191.stdout:6/532: truncate d2/de/d2a/d2d/d30/d98/d9b/f68 1206085 0 2024-09-19T09:35:04.041 INFO:tasks.workunit.client.1.smithi191.stdout:5/636: rmdir d0 39 2024-09-19T09:35:04.041 INFO:tasks.workunit.client.1.smithi191.stdout:3/572: dread d12/d13/f14 [0,4194304] 0 2024-09-19T09:35:04.041 INFO:tasks.workunit.client.1.smithi191.stdout:8/753: dwrite d1/d7/d1a/d6d/fec [0,4194304] 0 2024-09-19T09:35:04.042 INFO:tasks.workunit.client.1.smithi191.stdout:3/573: readlink d12/d13/d1a/d1b/d2e/dab/d3d/la4 0 2024-09-19T09:35:04.042 INFO:tasks.workunit.client.1.smithi191.stdout:3/574: chown d12/d13/d1a/d1b/d3c/d3f/f4e 105 1 2024-09-19T09:35:04.042 INFO:tasks.workunit.client.1.smithi191.stdout:2/598: mkdir d8/d11/dc2 0 2024-09-19T09:35:04.045 INFO:tasks.workunit.client.1.smithi191.stdout:7/620: link d2/c35 d2/d2a/cd2 0 2024-09-19T09:35:04.048 INFO:tasks.workunit.client.1.smithi191.stdout:8/754: dread d1/d7/fe [0,4194304] 0 2024-09-19T09:35:04.048 INFO:tasks.workunit.client.1.smithi191.stdout:8/755: chown d1/d16/d2e/d32/l78 1055 1 2024-09-19T09:35:04.048 INFO:tasks.workunit.client.1.smithi191.stdout:8/756: write d1/d16/d2e/d32/f77 [193321,39626] 0 2024-09-19T09:35:04.051 INFO:tasks.workunit.client.1.smithi191.stdout:1/660: mknod d3/dbd/cf7 0 2024-09-19T09:35:04.056 INFO:tasks.workunit.client.1.smithi191.stdout:0/725: symlink d0/lea 0 2024-09-19T09:35:04.057 INFO:tasks.workunit.client.1.smithi191.stdout:6/533: mkdir d2/de/d19/d1e/d64/d76/da8 0 2024-09-19T09:35:04.058 INFO:tasks.workunit.client.1.smithi191.stdout:5/637: mknod d0/da7/dcd/ce3 0 2024-09-19T09:35:04.058 INFO:tasks.workunit.client.1.smithi191.stdout:0/726: dread d0/d9/d1c/d1f/d24/f3f [4194304,4194304] 0 2024-09-19T09:35:04.059 INFO:tasks.workunit.client.1.smithi191.stdout:7/621: dread d2/faa [0,4194304] 0 2024-09-19T09:35:04.059 INFO:tasks.workunit.client.1.smithi191.stdout:7/622: readlink d2/d2a/d4f/d78/lbc 0 2024-09-19T09:35:04.059 INFO:tasks.workunit.client.1.smithi191.stdout:7/623: chown d2/d2a/d4f/d59/l5a 12 1 2024-09-19T09:35:04.067 INFO:tasks.workunit.client.1.smithi191.stdout:1/661: read d3/d9/da/d1e/d32/f74 [3366498,12942] 0 2024-09-19T09:35:04.067 INFO:tasks.workunit.client.1.smithi191.stdout:1/662: creat d3/d9/ff8 x:0 0 0 2024-09-19T09:35:04.069 INFO:tasks.workunit.client.1.smithi191.stdout:9/660: rename d3/db/d53/da2/db3/dc2/fe0 to d3/db/d16/d38/d92/fe4 0 2024-09-19T09:35:04.071 INFO:tasks.workunit.client.1.smithi191.stdout:3/575: creat d12/d43/db2/fca x:0 0 0 2024-09-19T09:35:04.071 INFO:tasks.workunit.client.1.smithi191.stdout:5/638: dread d0/d4/d9/f5a [0,4194304] 0 2024-09-19T09:35:04.072 INFO:tasks.workunit.client.1.smithi191.stdout:8/757: mknod d1/d7/d1a/d6d/de1/d6b/d83/d98/ddd/cf6 0 2024-09-19T09:35:04.074 INFO:tasks.workunit.client.1.smithi191.stdout:7/624: symlink d2/d39/d3a/d3c/ld3 0 2024-09-19T09:35:04.075 INFO:tasks.workunit.client.1.smithi191.stdout:2/599: dwrite d8/db/d13/d35/d70/f8d [0,4194304] 0 2024-09-19T09:35:04.075 INFO:tasks.workunit.client.1.smithi191.stdout:0/727: dwrite d0/d9/d1c/d1f/d24/d87/de1/fe5 [0,4194304] 0 2024-09-19T09:35:04.076 INFO:tasks.workunit.client.1.smithi191.stdout:1/663: mkdir d3/d9/da/d1e/df9 0 2024-09-19T09:35:04.076 INFO:tasks.workunit.client.1.smithi191.stdout:1/664: creat d3/d9/da/d7e/ffa x:0 0 0 2024-09-19T09:35:04.077 INFO:tasks.workunit.client.1.smithi191.stdout:6/534: rename d2/de/d15/fa0 to d2/de/d2a/d2d/fa9 0 2024-09-19T09:35:04.078 INFO:tasks.workunit.client.1.smithi191.stdout:9/661: mkdir d3/db/d16/d17/d3c/dc0/de5 0 2024-09-19T09:35:04.081 INFO:tasks.workunit.client.1.smithi191.stdout:5/639: symlink d0/d4/d9/d1d/d22/d3b/le4 0 2024-09-19T09:35:04.082 INFO:tasks.workunit.client.1.smithi191.stdout:8/758: mknod d1/d16/d2e/d32/dc5/dce/cf7 0 2024-09-19T09:35:04.084 INFO:tasks.workunit.client.1.smithi191.stdout:6/535: read d2/de/d2a/d2d/d30/f3f [7024853,66124] 0 2024-09-19T09:35:04.084 INFO:tasks.workunit.client.1.smithi191.stdout:7/625: mkdir d2/d2a/d38/dd4 0 2024-09-19T09:35:04.088 INFO:tasks.workunit.client.1.smithi191.stdout:2/600: unlink d8/d11/d3f/d8a/l94 0 2024-09-19T09:35:04.088 INFO:tasks.workunit.client.1.smithi191.stdout:6/536: dread d2/de/d19/d1e/d64/f4d [0,4194304] 0 2024-09-19T09:35:04.090 INFO:tasks.workunit.client.1.smithi191.stdout:1/665: mkdir d3/d9/da/d1e/d32/d6f/db2/dfb 0 2024-09-19T09:35:04.092 INFO:tasks.workunit.client.1.smithi191.stdout:0/728: rename d0/d9/d1c/d20/d73 to d0/d9/d1c/deb 0 2024-09-19T09:35:04.092 INFO:tasks.workunit.client.1.smithi191.stdout:0/729: chown d0/d9/d1c/d1f/d24/d39/d7a/ca1 345709868 1 2024-09-19T09:35:04.093 INFO:tasks.workunit.client.1.smithi191.stdout:3/576: rmdir d12/d13/d1a/d28 39 2024-09-19T09:35:04.094 INFO:tasks.workunit.client.1.smithi191.stdout:5/640: truncate d0/d4/d9/de/f8f 438049 0 2024-09-19T09:35:04.094 INFO:tasks.workunit.client.1.smithi191.stdout:5/641: chown d0/d4/l6e 103440819 1 2024-09-19T09:35:04.095 INFO:tasks.workunit.client.1.smithi191.stdout:8/759: mkdir d1/d22/d47/d9d/df1/df8 0 2024-09-19T09:35:04.096 INFO:tasks.workunit.client.1.smithi191.stdout:9/662: dwrite d3/d8/fdd [0,4194304] 0 2024-09-19T09:35:04.096 INFO:tasks.workunit.client.1.smithi191.stdout:7/626: mkdir d2/d2a/d38/d63/d9a/dd5 0 2024-09-19T09:35:04.098 INFO:tasks.workunit.client.1.smithi191.stdout:6/537: creat d2/de/d2a/d2d/d30/da4/faa x:0 0 0 2024-09-19T09:35:04.100 INFO:tasks.workunit.client.1.smithi191.stdout:2/601: rename d8/db/d13/d35/lb9 to d8/d11/d98/lc3 0 2024-09-19T09:35:04.101 INFO:tasks.workunit.client.1.smithi191.stdout:1/666: read d3/d9/f17 [235669,131011] 0 2024-09-19T09:35:04.101 INFO:tasks.workunit.client.1.smithi191.stdout:0/730: truncate d0/d9/d1c/d1f/d24/f4b 8300853 0 2024-09-19T09:35:04.102 INFO:tasks.workunit.client.1.smithi191.stdout:3/577: mknod d12/d43/ccb 0 2024-09-19T09:35:04.102 INFO:tasks.workunit.client.1.smithi191.stdout:3/578: write d12/d43/f52 [623767,41782] 0 2024-09-19T09:35:04.108 INFO:tasks.workunit.client.1.smithi191.stdout:9/663: unlink d3/db/d16/d47/l51 0 2024-09-19T09:35:04.110 INFO:tasks.workunit.client.1.smithi191.stdout:7/627: link d2/d2a/f31 d2/d2a/d4f/fd6 0 2024-09-19T09:35:04.111 INFO:tasks.workunit.client.1.smithi191.stdout:7/628: creat d2/d2a/d79/fd7 x:0 0 0 2024-09-19T09:35:04.111 INFO:tasks.workunit.client.1.smithi191.stdout:7/629: dread - d2/d2a/fc4 zero size 2024-09-19T09:35:04.112 INFO:tasks.workunit.client.1.smithi191.stdout:2/602: mknod d8/d11/d56/cc4 0 2024-09-19T09:35:04.113 INFO:tasks.workunit.client.1.smithi191.stdout:0/731: link d0/d9/d1c/c57 d0/d9/d1c/d1f/d24/d29/d30/d7c/cec 0 2024-09-19T09:35:04.116 INFO:tasks.workunit.client.1.smithi191.stdout:3/579: unlink d12/d43/ccb 0 2024-09-19T09:35:04.118 INFO:tasks.workunit.client.1.smithi191.stdout:5/642: link d0/d4/d9/d1d/d22/d3b/fba d0/d4/d9/d1d/d29/d33/d45/d64/fe5 0 2024-09-19T09:35:04.118 INFO:tasks.workunit.client.1.smithi191.stdout:5/643: write d0/d4/d9/d1d/d22/d5c/fc3 [847332,22299] 0 2024-09-19T09:35:04.119 INFO:tasks.workunit.client.1.smithi191.stdout:9/664: mkdir d3/db/de6 0 2024-09-19T09:35:04.121 INFO:tasks.workunit.client.1.smithi191.stdout:8/760: dwrite d1/d7/d1a/f25 [0,4194304] 0 2024-09-19T09:35:04.121 INFO:tasks.workunit.client.1.smithi191.stdout:6/538: rmdir d2/de/d2a/d84 39 2024-09-19T09:35:04.121 INFO:tasks.workunit.client.1.smithi191.stdout:6/539: chown d2/de/d19/d1e/d64/d61/d81/da7 10150 1 2024-09-19T09:35:04.122 INFO:tasks.workunit.client.1.smithi191.stdout:6/540: read d2/de/d19/d1e/d64/f4d [244387,4038] 0 2024-09-19T09:35:04.122 INFO:tasks.workunit.client.1.smithi191.stdout:2/603: getdents d8/db 0 2024-09-19T09:35:04.123 INFO:tasks.workunit.client.1.smithi191.stdout:0/732: mkdir d0/d9/d1c/d1f/d24/d39/d8b/ded 0 2024-09-19T09:35:04.124 INFO:tasks.workunit.client.1.smithi191.stdout:3/580: creat d12/d13/d1a/d1b/d2e/fcc x:0 0 0 2024-09-19T09:35:04.125 INFO:tasks.workunit.client.1.smithi191.stdout:5/644: mkdir d0/da7/de6 0 2024-09-19T09:35:04.125 INFO:tasks.workunit.client.1.smithi191.stdout:5/645: truncate d0/d4/d88/fc8 31711 0 2024-09-19T09:35:04.126 INFO:tasks.workunit.client.1.smithi191.stdout:1/667: dwrite d3/d9/da/f3b [4194304,4194304] 0 2024-09-19T09:35:04.126 INFO:tasks.workunit.client.1.smithi191.stdout:7/630: dwrite d2/d2a/d4f/f7b [0,4194304] 0 2024-09-19T09:35:04.126 INFO:tasks.workunit.client.1.smithi191.stdout:7/631: readlink d2/l22 0 2024-09-19T09:35:04.126 INFO:tasks.workunit.client.1.smithi191.stdout:7/632: fsync d2/d39/d3a/d3c/f56 0 2024-09-19T09:35:04.127 INFO:tasks.workunit.client.1.smithi191.stdout:9/665: rename d3/db/d16/d38/d92/lcb to d3/db/d53/da2/le7 0 2024-09-19T09:35:04.129 INFO:tasks.workunit.client.1.smithi191.stdout:8/761: truncate d1/d16/d3c/d17/da1/d84/f9b 3892252 0 2024-09-19T09:35:04.131 INFO:tasks.workunit.client.1.smithi191.stdout:6/541: creat d2/de/d19/d1e/d64/d76/fab x:0 0 0 2024-09-19T09:35:04.131 INFO:tasks.workunit.client.1.smithi191.stdout:6/542: dread - d2/de/d2a/d2d/d30/da4/faa zero size 2024-09-19T09:35:04.131 INFO:tasks.workunit.client.1.smithi191.stdout:6/543: fsync d2/de/d15/f36 0 2024-09-19T09:35:04.132 INFO:tasks.workunit.client.1.smithi191.stdout:7/633: dread d2/f7 [0,4194304] 0 2024-09-19T09:35:04.132 INFO:tasks.workunit.client.1.smithi191.stdout:2/604: creat d8/d11/dc2/fc5 x:0 0 0 2024-09-19T09:35:04.134 INFO:tasks.workunit.client.1.smithi191.stdout:0/733: truncate d0/d9/d1c/d1f/d24/d53/f75 2377368 0 2024-09-19T09:35:04.138 INFO:tasks.workunit.client.1.smithi191.stdout:5/646: mkdir d0/d4/d9/d1d/d29/d33/d45/d64/de7 0 2024-09-19T09:35:04.143 INFO:tasks.workunit.client.1.smithi191.stdout:6/544: symlink d2/de/d19/d1e/d64/d61/d81/lac 0 2024-09-19T09:35:04.144 INFO:tasks.workunit.client.1.smithi191.stdout:7/634: dread d2/f7d [0,4194304] 0 2024-09-19T09:35:04.145 INFO:tasks.workunit.client.1.smithi191.stdout:5/647: creat d0/fe8 x:0 0 0 2024-09-19T09:35:04.146 INFO:tasks.workunit.client.1.smithi191.stdout:8/762: rmdir d1/d7/d1a/d6d/de1/d6b/d83/dab/dbe 39 2024-09-19T09:35:04.146 INFO:tasks.workunit.client.1.smithi191.stdout:8/763: fsync d1/d16/d3c/d28/fa0 0 2024-09-19T09:35:04.147 INFO:tasks.workunit.client.1.smithi191.stdout:6/545: getdents d2/de/d2a/d2d/d30 0 2024-09-19T09:35:04.147 INFO:tasks.workunit.client.1.smithi191.stdout:6/546: write d2/de/d19/f8b [583643,127354] 0 2024-09-19T09:35:04.147 INFO:tasks.workunit.client.1.smithi191.stdout:6/547: chown d2/de/d2a/l31 2814744 1 2024-09-19T09:35:04.148 INFO:tasks.workunit.client.1.smithi191.stdout:4/736: sync 2024-09-19T09:35:04.148 INFO:tasks.workunit.client.1.smithi191.stdout:2/605: unlink d8/db/d41/l60 0 2024-09-19T09:35:04.150 INFO:tasks.workunit.client.1.smithi191.stdout:7/635: rename d2/f1a to d2/d2a/d38/fd8 0 2024-09-19T09:35:04.151 INFO:tasks.workunit.client.1.smithi191.stdout:5/648: creat d0/da7/dcd/dd7/fe9 x:0 0 0 2024-09-19T09:35:04.151 INFO:tasks.workunit.client.1.smithi191.stdout:5/649: chown d0/da7/dcd/ce3 19139 1 2024-09-19T09:35:04.152 INFO:tasks.workunit.client.1.smithi191.stdout:1/668: dwrite d3/d9/da/d1e/d25/d70/da0/fd0 [0,4194304] 0 2024-09-19T09:35:04.152 INFO:tasks.workunit.client.1.smithi191.stdout:1/669: write d3/d9/da/d1e/d32/d6f/fec [1169200,56879] 0 2024-09-19T09:35:04.154 INFO:tasks.workunit.client.1.smithi191.stdout:3/581: dwrite d12/d13/d1a/d1b/d3c/f68 [0,4194304] 0 2024-09-19T09:35:04.154 INFO:tasks.workunit.client.1.smithi191.stdout:6/548: creat d2/de/d2a/d2d/d30/d98/d9b/d65/d89/fad x:0 0 0 2024-09-19T09:35:04.154 INFO:tasks.workunit.client.1.smithi191.stdout:6/549: dread - d2/de/d19/f93 zero size 2024-09-19T09:35:04.154 INFO:tasks.workunit.client.1.smithi191.stdout:8/764: mkdir d1/d16/d23/df9 0 2024-09-19T09:35:04.155 INFO:tasks.workunit.client.1.smithi191.stdout:2/606: symlink d8/d11/d3f/d8a/d8f/lc6 0 2024-09-19T09:35:04.157 INFO:tasks.workunit.client.1.smithi191.stdout:7/636: creat d2/d39/d3a/d9c/fd9 x:0 0 0 2024-09-19T09:35:04.158 INFO:tasks.workunit.client.1.smithi191.stdout:5/650: creat d0/d77/fea x:0 0 0 2024-09-19T09:35:04.158 INFO:tasks.workunit.client.1.smithi191.stdout:5/651: fdatasync d0/da7/dcd/dd7/fe9 0 2024-09-19T09:35:04.165 INFO:tasks.workunit.client.1.smithi191.stdout:8/765: unlink d1/d16/d23/d3e/l6c 0 2024-09-19T09:35:04.167 INFO:tasks.workunit.client.1.smithi191.stdout:0/734: dwrite d0/d9/d1c/f7e [0,4194304] 0 2024-09-19T09:35:04.170 INFO:tasks.workunit.client.1.smithi191.stdout:7/637: truncate d2/f47 1915176 0 2024-09-19T09:35:04.170 INFO:tasks.workunit.client.1.smithi191.stdout:7/638: chown d2/d39/cb0 74 1 2024-09-19T09:35:04.172 INFO:tasks.workunit.client.1.smithi191.stdout:5/652: rename d0/l17 to d0/d4/dae/dbd/leb 0 2024-09-19T09:35:04.174 INFO:tasks.workunit.client.1.smithi191.stdout:2/607: link d8/db/d41/fb5 d8/db/fc7 0 2024-09-19T09:35:04.175 INFO:tasks.workunit.client.1.smithi191.stdout:0/735: symlink d0/d9/d1c/deb/lee 0 2024-09-19T09:35:04.177 INFO:tasks.workunit.client.1.smithi191.stdout:7/639: unlink d2/d2a/f2f 0 2024-09-19T09:35:04.178 INFO:tasks.workunit.client.1.smithi191.stdout:8/766: rename d1/d16/d3c/f62 to d1/d16/d23/d3e/dcb/ffa 0 2024-09-19T09:35:04.179 INFO:tasks.workunit.client.1.smithi191.stdout:6/550: dread d2/de/f14 [0,4194304] 0 2024-09-19T09:35:04.179 INFO:tasks.workunit.client.1.smithi191.stdout:5/653: creat d0/da7/dcb/fec x:0 0 0 2024-09-19T09:35:04.181 INFO:tasks.workunit.client.1.smithi191.stdout:2/608: creat d8/db/d13/d35/d70/fc8 x:0 0 0 2024-09-19T09:35:04.183 INFO:tasks.workunit.client.1.smithi191.stdout:0/736: rename d0/d9/d1c/d1f/f3c to d0/d9/d1c/deb/fef 0 2024-09-19T09:35:04.184 INFO:tasks.workunit.client.1.smithi191.stdout:0/737: chown d0/d6f/d76/f9d 242807 1 2024-09-19T09:35:04.186 INFO:tasks.workunit.client.1.smithi191.stdout:7/640: rmdir d2/d2a/d38/d63 39 2024-09-19T09:35:04.186 INFO:tasks.workunit.client.1.smithi191.stdout:7/641: chown d2/d2a/d79/da8/fbd 103930897 1 2024-09-19T09:35:04.186 INFO:tasks.workunit.client.1.smithi191.stdout:7/642: creat d2/d39/d3a/fda x:0 0 0 2024-09-19T09:35:04.187 INFO:tasks.workunit.client.1.smithi191.stdout:4/737: dwrite d5/d1b/d1c/d28/fc2 [0,4194304] 0 2024-09-19T09:35:04.187 INFO:tasks.workunit.client.1.smithi191.stdout:4/738: creat d5/d1b/d1c/d24/d82/feb x:0 0 0 2024-09-19T09:35:04.187 INFO:tasks.workunit.client.1.smithi191.stdout:4/739: truncate d5/f4e 2993047 0 2024-09-19T09:35:04.188 INFO:tasks.workunit.client.1.smithi191.stdout:1/670: dwrite d3/d9/da/d1e/d32/d53/d57/f6a [0,4194304] 0 2024-09-19T09:35:04.188 INFO:tasks.workunit.client.1.smithi191.stdout:2/609: getdents d8/d11/d3f/d8a 0 2024-09-19T09:35:04.188 INFO:tasks.workunit.client.1.smithi191.stdout:1/671: read - d3/d9/da/db/d48/f71 zero size 2024-09-19T09:35:04.189 INFO:tasks.workunit.client.1.smithi191.stdout:2/610: rename d8/d2a/dba to d8/d2a/dba/dc9 22 2024-09-19T09:35:04.189 INFO:tasks.workunit.client.1.smithi191.stdout:3/582: dwrite d12/d13/f3b [4194304,4194304] 0 2024-09-19T09:35:04.191 INFO:tasks.workunit.client.1.smithi191.stdout:7/643: link d2/d2a/d33/f3e d2/d39/d3a/d3c/fdb 0 2024-09-19T09:35:04.191 INFO:tasks.workunit.client.1.smithi191.stdout:7/644: fsync d2/d2a/d38/f85 0 2024-09-19T09:35:04.195 INFO:tasks.workunit.client.1.smithi191.stdout:4/740: symlink d5/de7/lec 0 2024-09-19T09:35:04.195 INFO:tasks.workunit.client.1.smithi191.stdout:0/738: write d0/dc5/d86/fa5 [1772361,1340] 0 2024-09-19T09:35:04.197 INFO:tasks.workunit.client.1.smithi191.stdout:2/611: symlink d8/d11/d3f/d64/lca 0 2024-09-19T09:35:04.199 INFO:tasks.workunit.client.1.smithi191.stdout:2/612: read d8/db/f63 [361619,124078] 0 2024-09-19T09:35:04.199 INFO:tasks.workunit.client.1.smithi191.stdout:2/613: fdatasync d8/db/d13/d23/fc0 0 2024-09-19T09:35:04.199 INFO:tasks.workunit.client.1.smithi191.stdout:7/645: symlink d2/d2a/d4f/d59/d81/ldc 0 2024-09-19T09:35:04.201 INFO:tasks.workunit.client.1.smithi191.stdout:3/583: dread d12/d13/d1a/d1b/d2e/dab/d51/d62/d85/da0/fbc [0,4194304] 0 2024-09-19T09:35:04.201 INFO:tasks.workunit.client.1.smithi191.stdout:3/584: chown d12/d13/c70 1711444 1 2024-09-19T09:35:04.201 INFO:tasks.workunit.client.1.smithi191.stdout:2/614: link f6 d8/db/d13/d35/d70/fcb 0 2024-09-19T09:35:04.202 INFO:tasks.workunit.client.1.smithi191.stdout:6/551: dread d2/de/d2a/d2d/d30/f3f [0,4194304] 0 2024-09-19T09:35:04.203 INFO:tasks.workunit.client.1.smithi191.stdout:7/646: creat d2/d2a/d79/da8/db9/fdd x:0 0 0 2024-09-19T09:35:04.203 INFO:tasks.workunit.client.1.smithi191.stdout:7/647: truncate d2/fb1 703803 0 2024-09-19T09:35:04.203 INFO:tasks.workunit.client.1.smithi191.stdout:4/741: getdents d5/d1b/d1c/d24/d32/d21/d27 0 2024-09-19T09:35:04.204 INFO:tasks.workunit.client.1.smithi191.stdout:1/672: dread d3/d9/da/d1e/d25/d70/da0/fd0 [0,4194304] 0 2024-09-19T09:35:04.204 INFO:tasks.workunit.client.1.smithi191.stdout:1/673: fdatasync d3/d9/f9c 0 2024-09-19T09:35:04.204 INFO:tasks.workunit.client.1.smithi191.stdout:1/674: dread - d3/d9/da/d1e/d32/d53/d57/d6d/ff2 zero size 2024-09-19T09:35:04.204 INFO:tasks.workunit.client.1.smithi191.stdout:1/675: dread - d3/d9/d73/d94/fbc zero size 2024-09-19T09:35:04.205 INFO:tasks.workunit.client.1.smithi191.stdout:8/767: dwrite d1/d16/d23/d3e/dcb/ffa [0,4194304] 0 2024-09-19T09:35:04.205 INFO:tasks.workunit.client.1.smithi191.stdout:3/585: rename d12/d13/d1a/d1b/d2e/dab/da6/da7 to d12/d13/d1a/d1b/d2e/dab/d51/dcd 0 2024-09-19T09:35:04.206 INFO:tasks.workunit.client.1.smithi191.stdout:2/615: mkdir d8/d2a/dba/dcc 0 2024-09-19T09:35:04.208 INFO:tasks.workunit.client.1.smithi191.stdout:6/552: creat d2/de/d19/d5d/fae x:0 0 0 2024-09-19T09:35:04.209 INFO:tasks.workunit.client.1.smithi191.stdout:4/742: mkdir d5/d1b/d1c/d28/ded 0 2024-09-19T09:35:04.210 INFO:tasks.workunit.client.1.smithi191.stdout:5/654: dwrite d0/d4/d4a/f98 [0,4194304] 0 2024-09-19T09:35:04.210 INFO:tasks.workunit.client.1.smithi191.stdout:5/655: write d0/d77/fea [469092,129302] 0 2024-09-19T09:35:04.212 INFO:tasks.workunit.client.1.smithi191.stdout:1/676: symlink d3/d9/da/d1e/d32/d53/d57/d6d/da1/da7/lfc 0 2024-09-19T09:35:04.215 INFO:tasks.workunit.client.1.smithi191.stdout:0/739: dread d0/d9/d1c/d1f/d24/d29/f49 [0,4194304] 0 2024-09-19T09:35:04.215 INFO:tasks.workunit.client.1.smithi191.stdout:0/740: write d0/d9/d1c/d1f/d24/d87/faa [407079,27605] 0 2024-09-19T09:35:04.215 INFO:tasks.workunit.client.1.smithi191.stdout:0/741: chown d0/lea 1342242 1 2024-09-19T09:35:04.216 INFO:tasks.workunit.client.1.smithi191.stdout:2/616: write d8/d11/d56/f69 [1265346,44360] 0 2024-09-19T09:35:04.217 INFO:tasks.workunit.client.1.smithi191.stdout:8/768: mknod d1/d22/d47/cfb 0 2024-09-19T09:35:04.217 INFO:tasks.workunit.client.1.smithi191.stdout:7/648: dread d2/f1b [0,4194304] 0 2024-09-19T09:35:04.218 INFO:tasks.workunit.client.1.smithi191.stdout:7/649: creat d2/d2a/d79/da8/db9/fde x:0 0 0 2024-09-19T09:35:04.218 INFO:tasks.workunit.client.1.smithi191.stdout:6/553: creat d2/de/d15/d92/faf x:0 0 0 2024-09-19T09:35:04.233 INFO:tasks.workunit.client.1.smithi191.stdout:4/743: dwrite d5/f91 [0,4194304] 0 2024-09-19T09:35:04.234 INFO:tasks.workunit.client.1.smithi191.stdout:8/769: symlink d1/d22/lfc 0 2024-09-19T09:35:04.234 INFO:tasks.workunit.client.1.smithi191.stdout:8/770: fdatasync d1/d7/fb1 0 2024-09-19T09:35:04.234 INFO:tasks.workunit.client.1.smithi191.stdout:8/771: chown d1/d16/d23/df9 7360533 1 2024-09-19T09:35:04.235 INFO:tasks.workunit.client.1.smithi191.stdout:3/586: dwrite d12/d13/d1a/d1b/d2e/dab/d3d/d91/fb5 [0,4194304] 0 2024-09-19T09:35:04.236 INFO:tasks.workunit.client.1.smithi191.stdout:7/650: unlink d2/d39/c4e 0 2024-09-19T09:35:04.238 INFO:tasks.workunit.client.1.smithi191.stdout:5/656: rmdir d0/d4/d9/d1d/d29/d33/d45/d97 39 2024-09-19T09:35:04.239 INFO:tasks.workunit.client.1.smithi191.stdout:5/657: chown d0/d4/d9/d1d/d22/l95 0 1 2024-09-19T09:35:04.239 INFO:tasks.workunit.client.1.smithi191.stdout:5/658: fsync d0/d4/d88/fc8 0 2024-09-19T09:35:04.239 INFO:tasks.workunit.client.1.smithi191.stdout:2/617: symlink d8/d2a/lcd 0 2024-09-19T09:35:04.245 INFO:tasks.workunit.client.1.smithi191.stdout:4/744: dread d5/d1b/d1c/d28/f48 [0,4194304] 0 2024-09-19T09:35:04.246 INFO:tasks.workunit.client.1.smithi191.stdout:3/587: symlink d12/d13/d1a/d1b/d60/d7a/d93/lce 0 2024-09-19T09:35:04.247 INFO:tasks.workunit.client.1.smithi191.stdout:6/554: dwrite d2/de/d19/d1e/d64/f2c [4194304,4194304] 0 2024-09-19T09:35:04.248 INFO:tasks.workunit.client.1.smithi191.stdout:7/651: mknod d2/d2a/d79/cdf 0 2024-09-19T09:35:04.248 INFO:tasks.workunit.client.1.smithi191.stdout:7/652: readlink d2/d39/d3a/d3c/ld3 0 2024-09-19T09:35:04.248 INFO:tasks.workunit.client.1.smithi191.stdout:5/659: mknod d0/d4/d9/d1d/ced 0 2024-09-19T09:35:04.249 INFO:tasks.workunit.client.1.smithi191.stdout:5/660: chown d0/d4/d9/de/lc7 192263 1 2024-09-19T09:35:04.249 INFO:tasks.workunit.client.1.smithi191.stdout:3/588: dread d12/d13/d1a/d1b/d3c/d3f/f83 [0,4194304] 0 2024-09-19T09:35:04.249 INFO:tasks.workunit.client.1.smithi191.stdout:2/618: unlink d8/d11/d56/lb8 0 2024-09-19T09:35:04.251 INFO:tasks.workunit.client.1.smithi191.stdout:6/555: mknod d2/de/d15/d92/cb0 0 2024-09-19T09:35:04.252 INFO:tasks.workunit.client.1.smithi191.stdout:7/653: dread d2/d39/f4b [0,4194304] 0 2024-09-19T09:35:04.254 INFO:tasks.workunit.client.1.smithi191.stdout:9/666: sync 2024-09-19T09:35:04.254 INFO:tasks.workunit.client.1.smithi191.stdout:2/619: creat d8/db/d13/d40/fce x:0 0 0 2024-09-19T09:35:04.254 INFO:tasks.workunit.client.1.smithi191.stdout:2/620: write d8/db/d13/f3a [1613778,10] 0 2024-09-19T09:35:04.254 INFO:tasks.workunit.client.1.smithi191.stdout:0/742: dwrite d0/d9/d1c/d1f/d24/d29/d30/f9a [0,4194304] 0 2024-09-19T09:35:04.254 INFO:tasks.workunit.client.1.smithi191.stdout:6/556: symlink d2/de/d19/d5d/lb1 0 2024-09-19T09:35:04.255 INFO:tasks.workunit.client.1.smithi191.stdout:6/557: dread - d2/de/d19/d5d/f6f zero size 2024-09-19T09:35:04.255 INFO:tasks.workunit.client.1.smithi191.stdout:6/558: dread - d2/de/d19/d1e/d64/f8f zero size 2024-09-19T09:35:04.255 INFO:tasks.workunit.client.1.smithi191.stdout:8/772: dwrite d1/d16/d3c/d28/fa0 [0,4194304] 0 2024-09-19T09:35:04.256 INFO:tasks.workunit.client.1.smithi191.stdout:2/621: rename d8/db/d13/l58 to d8/d2a/dba/dcc/lcf 0 2024-09-19T09:35:04.256 INFO:tasks.workunit.client.1.smithi191.stdout:2/622: dread - d8/fbc zero size 2024-09-19T09:35:04.256 INFO:tasks.workunit.client.1.smithi191.stdout:2/623: fdatasync d8/db/d13/d40/da8/fbd 0 2024-09-19T09:35:04.256 INFO:tasks.workunit.client.1.smithi191.stdout:2/624: chown d8/db/d13/d35/d70/c87 46045 1 2024-09-19T09:35:04.258 INFO:tasks.workunit.client.1.smithi191.stdout:0/743: unlink d0/d9/d1c/le0 0 2024-09-19T09:35:04.259 INFO:tasks.workunit.client.1.smithi191.stdout:6/559: dread d2/de/d15/f41 [0,4194304] 0 2024-09-19T09:35:04.259 INFO:tasks.workunit.client.1.smithi191.stdout:6/560: stat d2/de/d19/d1e/f3e 0 2024-09-19T09:35:04.259 INFO:tasks.workunit.client.1.smithi191.stdout:6/561: chown d2/de/f27 12419569 1 2024-09-19T09:35:04.262 INFO:tasks.workunit.client.1.smithi191.stdout:5/661: dread d0/d4/d9/d1d/d29/d33/d45/f8a [0,4194304] 0 2024-09-19T09:35:04.264 INFO:tasks.workunit.client.1.smithi191.stdout:0/744: unlink d0/d9/d1c/d1f/d24/d39/fcc 0 2024-09-19T09:35:04.265 INFO:tasks.workunit.client.1.smithi191.stdout:6/562: unlink d2/de/f10 0 2024-09-19T09:35:04.265 INFO:tasks.workunit.client.1.smithi191.stdout:6/563: write d2/de/d19/d1e/d64/d77/d82/fa3 [868803,33857] 0 2024-09-19T09:35:04.265 INFO:tasks.workunit.client.1.smithi191.stdout:9/667: dread d3/db/d16/d38/f48 [0,4194304] 0 2024-09-19T09:35:04.265 INFO:tasks.workunit.client.1.smithi191.stdout:9/668: chown d3/db/l28 1 1 2024-09-19T09:35:04.266 INFO:tasks.workunit.client.1.smithi191.stdout:8/773: getdents d1/d22 0 2024-09-19T09:35:04.268 INFO:tasks.workunit.client.1.smithi191.stdout:5/662: rename d0/d4/d9/d1d/d29/d33/d45/d64/la5 to d0/d4/d9/d1d/d22/d3b/db9/lee 0 2024-09-19T09:35:04.268 INFO:tasks.workunit.client.1.smithi191.stdout:5/663: fsync d0/d4/d9/d1d/d22/f6d 0 2024-09-19T09:35:04.273 INFO:tasks.workunit.client.1.smithi191.stdout:4/745: dwrite d5/d1b/d1c/d24/d32/d21/d56/fb9 [4194304,4194304] 0 2024-09-19T09:35:04.277 INFO:tasks.workunit.client.1.smithi191.stdout:7/654: dwrite d2/d2a/d79/fb7 [0,4194304] 0 2024-09-19T09:35:04.277 INFO:tasks.workunit.client.1.smithi191.stdout:7/655: creat d2/d39/d3a/d3c/fe0 x:0 0 0 2024-09-19T09:35:04.277 INFO:tasks.workunit.client.1.smithi191.stdout:3/589: dwrite d12/d13/d1a/d1b/d60/f9e [0,4194304] 0 2024-09-19T09:35:04.368 INFO:tasks.workunit.client.1.smithi191.stdout:0/745: creat d0/d9/d1c/d1f/d24/dbe/ff0 x:0 0 0 2024-09-19T09:35:04.368 INFO:tasks.workunit.client.1.smithi191.stdout:0/746: chown d0/d9/d1c/d20/fa6 216 1 2024-09-19T09:35:04.369 INFO:tasks.workunit.client.1.smithi191.stdout:6/564: truncate d2/de/d15/f41 162974 0 2024-09-19T09:35:04.369 INFO:tasks.workunit.client.1.smithi191.stdout:9/669: unlink d3/d60/c9a 0 2024-09-19T09:35:04.370 INFO:tasks.workunit.client.1.smithi191.stdout:8/774: unlink d1/d16/d3c/d17/da1/d84/dbc/lc8 0 2024-09-19T09:35:04.370 INFO:tasks.workunit.client.1.smithi191.stdout:8/775: truncate d1/d7/d1a/f5d 277776 0 2024-09-19T09:35:04.371 INFO:tasks.workunit.client.1.smithi191.stdout:8/776: chown d1/d7/d1a/d6d/de1 124259 1 2024-09-19T09:35:04.388 INFO:tasks.workunit.client.1.smithi191.stdout:5/664: truncate d0/d4/d4a/f98 464517 0 2024-09-19T09:35:04.388 INFO:tasks.workunit.client.1.smithi191.stdout:4/746: getdents d5/d38/d73 0 2024-09-19T09:35:04.391 INFO:tasks.workunit.client.1.smithi191.stdout:7/656: unlink d2/d2a/d79/da8/fbd 0 2024-09-19T09:35:04.393 INFO:tasks.workunit.client.1.smithi191.stdout:3/590: link d12/d43/db2/fca d12/d13/d1a/d1b/d3c/fcf 0 2024-09-19T09:35:04.396 INFO:tasks.workunit.client.1.smithi191.stdout:3/591: dread d12/f25 [0,4194304] 0 2024-09-19T09:35:04.398 INFO:tasks.workunit.client.1.smithi191.stdout:2/625: truncate d8/db/d13/f3a 807784 0 2024-09-19T09:35:04.398 INFO:tasks.workunit.client.1.smithi191.stdout:2/626: write d8/db/d13/d23/f57 [2662199,8264] 0 2024-09-19T09:35:04.399 INFO:tasks.workunit.client.1.smithi191.stdout:0/747: mknod d0/d9/d1c/d1f/d24/d87/dd0/cf1 0 2024-09-19T09:35:04.401 INFO:tasks.workunit.client.1.smithi191.stdout:6/565: rename d2/de/d19/f72 to d2/de/d19/d5d/fb2 0 2024-09-19T09:35:04.402 INFO:tasks.workunit.client.1.smithi191.stdout:9/670: symlink d3/db/d16/d17/d81/d8d/dcd/le8 0 2024-09-19T09:35:04.404 INFO:tasks.workunit.client.1.smithi191.stdout:8/777: mkdir d1/d16/d2e/d32/d7e/d8b/dfd 0 2024-09-19T09:35:04.406 INFO:tasks.workunit.client.1.smithi191.stdout:5/665: creat d0/d4/d9/d1d/d22/d3b/db9/fef x:0 0 0 2024-09-19T09:35:04.406 INFO:tasks.workunit.client.1.smithi191.stdout:5/666: write d0/d4/d9/d1d/d22/d3b/fba [459140,106968] 0 2024-09-19T09:35:04.410 INFO:tasks.workunit.client.1.smithi191.stdout:3/592: link d12/d13/d1a/d1b/d2e/dab/d3d/f40 d12/d13/d1a/d1b/d2e/dab/d3d/d91/fd0 0 2024-09-19T09:35:04.412 INFO:tasks.workunit.client.1.smithi191.stdout:7/657: rename d2/f34 to d2/d2a/d38/d63/dc1/fe1 0 2024-09-19T09:35:04.413 INFO:tasks.workunit.client.1.smithi191.stdout:6/566: getdents d2/de/d19/d1e 0 2024-09-19T09:35:04.413 INFO:tasks.workunit.client.1.smithi191.stdout:6/567: fsync d2/de/d19/d1e/d64/f29 0 2024-09-19T09:35:04.413 INFO:tasks.workunit.client.1.smithi191.stdout:8/778: dread d1/d7/d1a/f25 [0,4194304] 0 2024-09-19T09:35:04.413 INFO:tasks.workunit.client.1.smithi191.stdout:8/779: readlink d1/d16/d3c/d28/l9e 0 2024-09-19T09:35:04.414 INFO:tasks.workunit.client.1.smithi191.stdout:9/671: getdents d3/db/d53/da2 0 2024-09-19T09:35:04.414 INFO:tasks.workunit.client.1.smithi191.stdout:9/672: fdatasync d3/db6/fbb 0 2024-09-19T09:35:04.415 INFO:tasks.workunit.client.1.smithi191.stdout:5/667: creat d0/d4/d9/d1d/d28/ff0 x:0 0 0 2024-09-19T09:35:04.415 INFO:tasks.workunit.client.1.smithi191.stdout:5/668: write d0/d4/d9/f1e [1349210,44179] 0 2024-09-19T09:35:04.416 INFO:tasks.workunit.client.1.smithi191.stdout:0/748: dread d0/d9/d1c/d1f/d24/d39/d58/fa3 [0,4194304] 0 2024-09-19T09:35:04.416 INFO:tasks.workunit.client.1.smithi191.stdout:3/593: mkdir d12/d13/d1a/d5d/dd1 0 2024-09-19T09:35:04.416 INFO:tasks.workunit.client.1.smithi191.stdout:3/594: write d12/d13/d1a/d1b/d2e/dab/faa [831675,122113] 0 2024-09-19T09:35:04.417 INFO:tasks.workunit.client.1.smithi191.stdout:7/658: symlink d2/d2a/d4f/d78/le2 0 2024-09-19T09:35:04.419 INFO:tasks.workunit.client.1.smithi191.stdout:6/568: link d2/de/d2a/d2d/d30/l87 d2/de/d19/d1e/d64/lb3 0 2024-09-19T09:35:04.420 INFO:tasks.workunit.client.1.smithi191.stdout:8/780: creat d1/d16/d23/d3e/dcb/ffe x:0 0 0 2024-09-19T09:35:04.420 INFO:tasks.workunit.client.1.smithi191.stdout:8/781: readlink d1/d16/d2e/d32/de7/lf5 0 2024-09-19T09:35:04.422 INFO:tasks.workunit.client.1.smithi191.stdout:9/673: symlink d3/db/d16/d17/d3c/dc0/le9 0 2024-09-19T09:35:04.422 INFO:tasks.workunit.client.1.smithi191.stdout:9/674: creat d3/db/d16/d47/d55/fea x:0 0 0 2024-09-19T09:35:04.423 INFO:tasks.workunit.client.1.smithi191.stdout:2/627: dwrite d8/d11/d3f/d64/f66 [0,4194304] 0 2024-09-19T09:35:04.424 INFO:tasks.workunit.client.1.smithi191.stdout:4/747: link d5/d1b/d1c/d24/d32/f16 d5/d1b/fee 0 2024-09-19T09:35:04.424 INFO:tasks.workunit.client.1.smithi191.stdout:0/749: mkdir d0/d9/d1c/d1f/d24/d39/df2 0 2024-09-19T09:35:04.425 INFO:tasks.workunit.client.1.smithi191.stdout:1/677: sync 2024-09-19T09:35:04.425 INFO:tasks.workunit.client.1.smithi191.stdout:1/678: readlink d3/d9/da/d1e/d32/l50 0 2024-09-19T09:35:04.426 INFO:tasks.workunit.client.1.smithi191.stdout:5/669: read d0/f20 [1766016,99385] 0 2024-09-19T09:35:04.427 INFO:tasks.workunit.client.1.smithi191.stdout:7/659: mknod d2/d39/d3a/d3c/ce3 0 2024-09-19T09:35:04.427 INFO:tasks.workunit.client.1.smithi191.stdout:7/660: readlink d2/d2a/l30 0 2024-09-19T09:35:04.427 INFO:tasks.workunit.client.1.smithi191.stdout:7/661: fsync d2/d2a/d79/da8/db9/fdd 0 2024-09-19T09:35:04.427 INFO:tasks.workunit.client.1.smithi191.stdout:7/662: chown d2/d2a/d79/cdf 2674 1 2024-09-19T09:35:04.427 INFO:tasks.workunit.client.1.smithi191.stdout:7/663: creat d2/d39/d3a/fe4 x:0 0 0 2024-09-19T09:35:04.429 INFO:tasks.workunit.client.1.smithi191.stdout:8/782: creat d1/d7/d1a/d6d/de1/d6b/d83/fff x:0 0 0 2024-09-19T09:35:04.432 INFO:tasks.workunit.client.1.smithi191.stdout:9/675: creat d3/db/d16/d17/d81/db5/feb x:0 0 0 2024-09-19T09:35:04.433 INFO:tasks.workunit.client.1.smithi191.stdout:2/628: creat d8/db/d13/d35/fd0 x:0 0 0 2024-09-19T09:35:04.433 INFO:tasks.workunit.client.1.smithi191.stdout:6/569: read d2/de/d15/f78 [2646105,30168] 0 2024-09-19T09:35:04.437 INFO:tasks.workunit.client.1.smithi191.stdout:3/595: rename d12/d13/d1a/d1b/d2e/dab/d3d/d91/fd0 to d12/d13/d1a/d1b/fd2 0 2024-09-19T09:35:04.439 INFO:tasks.workunit.client.1.smithi191.stdout:1/679: link d3/d9/da/d1e/d32/d53/d57/d6d/fa5 d3/d9/da/d1e/d32/d53/d57/d6d/da1/ffd 0 2024-09-19T09:35:04.441 INFO:tasks.workunit.client.1.smithi191.stdout:8/783: write d1/d22/f2c [1948966,121915] 0 2024-09-19T09:35:04.441 INFO:tasks.workunit.client.1.smithi191.stdout:8/784: fdatasync d1/d16/d3c/d17/f4d 0 2024-09-19T09:35:04.441 INFO:tasks.workunit.client.1.smithi191.stdout:8/785: creat d1/d22/d47/f100 x:0 0 0 2024-09-19T09:35:04.441 INFO:tasks.workunit.client.1.smithi191.stdout:7/664: mkdir d2/d2a/d38/de5 0 2024-09-19T09:35:04.442 INFO:tasks.workunit.client.1.smithi191.stdout:9/676: mkdir d3/db/d53/dec 0 2024-09-19T09:35:04.444 INFO:tasks.workunit.client.1.smithi191.stdout:2/629: mknod d8/d11/d3f/cd1 0 2024-09-19T09:35:04.448 INFO:tasks.workunit.client.1.smithi191.stdout:6/570: mknod d2/de/d2a/d39/cb4 0 2024-09-19T09:35:04.448 INFO:tasks.workunit.client.1.smithi191.stdout:6/571: dread - d2/de/d19/d5d/fb2 zero size 2024-09-19T09:35:04.448 INFO:tasks.workunit.client.1.smithi191.stdout:3/596: unlink d12/d13/d1a/d1b/d2e/dab/d3d/c88 0 2024-09-19T09:35:04.453 INFO:tasks.workunit.client.1.smithi191.stdout:8/786: creat d1/d7/dcc/f101 x:0 0 0 2024-09-19T09:35:04.453 INFO:tasks.workunit.client.1.smithi191.stdout:8/787: truncate d1/d16/d3c/d28/d79/da2/fc4 63301 0 2024-09-19T09:35:04.455 INFO:tasks.workunit.client.1.smithi191.stdout:0/750: dwrite d0/d9/d1c/fd8 [0,4194304] 0 2024-09-19T09:35:04.457 INFO:tasks.workunit.client.1.smithi191.stdout:3/597: rename d12/f25 to d12/d13/d1a/d5d/dd1/fd3 0 2024-09-19T09:35:04.457 INFO:tasks.workunit.client.1.smithi191.stdout:5/670: dwrite d0/d4/d9/d1d/d29/d33/d52/fbe [0,4194304] 0 2024-09-19T09:35:04.458 INFO:tasks.workunit.client.1.smithi191.stdout:2/630: mknod d8/db/d41/cd2 0 2024-09-19T09:35:04.460 INFO:tasks.workunit.client.1.smithi191.stdout:0/751: creat d0/d9/d1c/deb/ddb/ff3 x:0 0 0 2024-09-19T09:35:04.460 INFO:tasks.workunit.client.1.smithi191.stdout:0/752: chown d0/dc5/dc1 3 1 2024-09-19T09:35:04.461 INFO:tasks.workunit.client.1.smithi191.stdout:7/665: write d2/d2a/d38/d63/d9a/f8d [2795753,12776] 0 2024-09-19T09:35:04.461 INFO:tasks.workunit.client.1.smithi191.stdout:7/666: creat d2/d39/d3a/d9c/fe6 x:0 0 0 2024-09-19T09:35:04.461 INFO:tasks.workunit.client.1.smithi191.stdout:7/667: write d2/d2a/d4f/d59/f65 [1778120,59736] 0 2024-09-19T09:35:04.461 INFO:tasks.workunit.client.1.smithi191.stdout:7/668: write d2/d2a/d38/d63/d9a/f8d [2433383,85016] 0 2024-09-19T09:35:04.462 INFO:tasks.workunit.client.1.smithi191.stdout:1/680: dread d3/d9/da/db/d48/f9a [0,4194304] 0 2024-09-19T09:35:04.462 INFO:tasks.workunit.client.1.smithi191.stdout:4/748: dwrite d5/d1b/d1c/d24/d82/f90 [0,4194304] 0 2024-09-19T09:35:04.462 INFO:tasks.workunit.client.1.smithi191.stdout:4/749: chown d5/d1b/d1c/d24/d32/d21/d4a/dc5 61244 1 2024-09-19T09:35:04.462 INFO:tasks.workunit.client.1.smithi191.stdout:1/681: truncate d3/d9/d73/d94/fbc 275991 0 2024-09-19T09:35:04.462 INFO:tasks.workunit.client.1.smithi191.stdout:1/682: stat d3/d9/da/d1e/d25/d70/da0 0 2024-09-19T09:35:04.462 INFO:tasks.workunit.client.1.smithi191.stdout:8/788: rename d1/d16/d2e/d32/l78 to d1/d16/d3c/d17/da1/l102 0 2024-09-19T09:35:04.462 INFO:tasks.workunit.client.1.smithi191.stdout:8/789: readlink d1/d16/d3c/d17/da1/l102 0 2024-09-19T09:35:04.464 INFO:tasks.workunit.client.1.smithi191.stdout:5/671: symlink d0/da7/dcd/dd7/lf1 0 2024-09-19T09:35:04.464 INFO:tasks.workunit.client.1.smithi191.stdout:2/631: truncate d8/f2f 468895 0 2024-09-19T09:35:04.465 INFO:tasks.workunit.client.1.smithi191.stdout:0/753: mknod d0/d9/d1c/d1f/d24/d29/d30/d7c/cf4 0 2024-09-19T09:35:04.466 INFO:tasks.workunit.client.1.smithi191.stdout:0/754: write d0/d9/de/d61/dbf/fda [710895,106943] 0 2024-09-19T09:35:04.466 INFO:tasks.workunit.client.1.smithi191.stdout:0/755: truncate d0/d9/d1c/d1f/d24/d29/d30/fc3 44205 0 2024-09-19T09:35:04.466 INFO:tasks.workunit.client.1.smithi191.stdout:0/756: readlink d0/d9/d1c/d1f/d24/d39/d58/l1e 0 2024-09-19T09:35:04.476 INFO:tasks.workunit.client.1.smithi191.stdout:3/598: write d12/d13/d1a/d1b/f66 [930440,41098] 0 2024-09-19T09:35:04.480 INFO:tasks.workunit.client.1.smithi191.stdout:6/572: dwrite d2/de/d2a/d39/f71 [0,4194304] 0 2024-09-19T09:35:04.481 INFO:tasks.workunit.client.1.smithi191.stdout:4/750: truncate d5/d38/f45 1601872 0 2024-09-19T09:35:04.482 INFO:tasks.workunit.client.1.smithi191.stdout:0/757: write d0/d9/d1c/d1f/d24/d39/d58/f16 [787930,4094] 0 2024-09-19T09:35:04.484 INFO:tasks.workunit.client.1.smithi191.stdout:1/683: truncate d3/d9/da/d1e/d25/d70/da0/fd0 2614740 0 2024-09-19T09:35:04.491 INFO:tasks.workunit.client.1.smithi191.stdout:4/751: link d5/fa6 d5/d1b/d1c/d24/d32/d21/d4a/dc5/de3/fef 0 2024-09-19T09:35:04.499 INFO:tasks.workunit.client.1.smithi191.stdout:4/752: getdents d5/d1b/d1c 0 2024-09-19T09:35:04.502 INFO:tasks.workunit.client.1.smithi191.stdout:4/753: rmdir d5/d1b/d1c/d2f/d19/dc1 0 2024-09-19T09:35:04.503 INFO:tasks.workunit.client.1.smithi191.stdout:4/754: creat d5/de7/ff0 x:0 0 0 2024-09-19T09:35:04.503 INFO:tasks.workunit.client.1.smithi191.stdout:4/755: readlink d5/d38/l49 0 2024-09-19T09:35:04.515 INFO:tasks.workunit.client.1.smithi191.stdout:2/632: dwrite d8/db/d13/d40/fce [0,4194304] 0 2024-09-19T09:35:04.515 INFO:tasks.workunit.client.1.smithi191.stdout:2/633: write d8/db/d13/d35/f37 [4167199,12593] 0 2024-09-19T09:35:04.517 INFO:tasks.workunit.client.1.smithi191.stdout:2/634: mknod d8/db/d13/d23/cd3 0 2024-09-19T09:35:04.518 INFO:tasks.workunit.client.1.smithi191.stdout:8/790: dwrite d1/d16/d3c/d28/fb7 [0,4194304] 0 2024-09-19T09:35:04.518 INFO:tasks.workunit.client.1.smithi191.stdout:2/635: rename d8/db/d41/f5c to d8/db/d4d/fd4 0 2024-09-19T09:35:04.519 INFO:tasks.workunit.client.1.smithi191.stdout:2/636: truncate d8/db/d13/d23/fc0 984385 0 2024-09-19T09:35:04.519 INFO:tasks.workunit.client.1.smithi191.stdout:2/637: read d8/f42 [2512021,45982] 0 2024-09-19T09:35:04.522 INFO:tasks.workunit.client.1.smithi191.stdout:5/672: dwrite d0/d4/d9/d1d/d29/d7f/d94/fd6 [0,4194304] 0 2024-09-19T09:35:04.522 INFO:tasks.workunit.client.1.smithi191.stdout:7/669: dwrite d2/d2a/d79/f98 [0,4194304] 0 2024-09-19T09:35:04.523 INFO:tasks.workunit.client.1.smithi191.stdout:8/791: rename d1/d16/d3c/d17/f3a to d1/d16/d2e/d32/de7/f103 0 2024-09-19T09:35:04.524 INFO:tasks.workunit.client.1.smithi191.stdout:3/599: dwrite d12/d13/d1a/d28/f58 [0,4194304] 0 2024-09-19T09:35:04.524 INFO:tasks.workunit.client.1.smithi191.stdout:3/600: creat d12/d43/db2/fd4 x:0 0 0 2024-09-19T09:35:04.524 INFO:tasks.workunit.client.1.smithi191.stdout:2/638: mknod d8/db/d13/cd5 0 2024-09-19T09:35:04.525 INFO:tasks.workunit.client.1.smithi191.stdout:6/573: dwrite d2/de/d19/d1e/d64/f29 [0,4194304] 0 2024-09-19T09:35:04.525 INFO:tasks.workunit.client.1.smithi191.stdout:1/684: dwrite d3/d9/d73/d94/fbc [0,4194304] 0 2024-09-19T09:35:04.525 INFO:tasks.workunit.client.1.smithi191.stdout:4/756: dwrite d5/d1b/d1c/d2f/f39 [4194304,4194304] 0 2024-09-19T09:35:04.527 INFO:tasks.workunit.client.1.smithi191.stdout:8/792: write d1/d22/f54 [95142,84653] 0 2024-09-19T09:35:04.530 INFO:tasks.workunit.client.1.smithi191.stdout:5/673: creat d0/d4/d9/d1d/d29/d33/d45/d64/de7/ff2 x:0 0 0 2024-09-19T09:35:04.536 INFO:tasks.workunit.client.1.smithi191.stdout:6/574: dread d2/de/d2a/d2d/fa2 [0,4194304] 0 2024-09-19T09:35:04.537 INFO:tasks.workunit.client.1.smithi191.stdout:3/601: mkdir d12/d13/d1a/d5d/dc8/dd5 0 2024-09-19T09:35:04.537 INFO:tasks.workunit.client.1.smithi191.stdout:6/575: dread d2/de/d15/f41 [0,4194304] 0 2024-09-19T09:35:04.539 INFO:tasks.workunit.client.1.smithi191.stdout:2/639: symlink d8/ld6 0 2024-09-19T09:35:04.543 INFO:tasks.workunit.client.1.smithi191.stdout:7/670: dwrite d2/d39/d3a/fac [0,4194304] 0 2024-09-19T09:35:04.544 INFO:tasks.workunit.client.1.smithi191.stdout:7/671: chown d2/d2a/d4f/d59/l8b 97 1 2024-09-19T09:35:04.545 INFO:tasks.workunit.client.1.smithi191.stdout:4/757: mknod d5/de7/cf1 0 2024-09-19T09:35:04.547 INFO:tasks.workunit.client.1.smithi191.stdout:1/685: dwrite d3/d9/da/d1e/d32/f80 [0,4194304] 0 2024-09-19T09:35:04.547 INFO:tasks.workunit.client.1.smithi191.stdout:1/686: getdents d3/d9/da/d1e/d32/d53/d57/d6d/df3 0 2024-09-19T09:35:04.547 INFO:tasks.workunit.client.1.smithi191.stdout:3/602: mknod d12/d13/d1a/d1b/d2e/dab/d3d/cd6 0 2024-09-19T09:35:04.549 INFO:tasks.workunit.client.1.smithi191.stdout:6/576: mkdir d2/de/d2a/d60/db5 0 2024-09-19T09:35:04.549 INFO:tasks.workunit.client.1.smithi191.stdout:6/577: write d2/f34 [2751635,105201] 0 2024-09-19T09:35:04.549 INFO:tasks.workunit.client.1.smithi191.stdout:6/578: dread - d2/de/d19/d5d/fb2 zero size 2024-09-19T09:35:04.549 INFO:tasks.workunit.client.1.smithi191.stdout:6/579: write d2/de/d19/d1e/d64/f6d [1358360,83954] 0 2024-09-19T09:35:04.549 INFO:tasks.workunit.client.1.smithi191.stdout:5/674: dwrite d0/d4/d9/d1d/d29/f62 [4194304,4194304] 0 2024-09-19T09:35:04.553 INFO:tasks.workunit.client.1.smithi191.stdout:7/672: creat d2/d2a/d38/dd4/fe7 x:0 0 0 2024-09-19T09:35:04.554 INFO:tasks.workunit.client.1.smithi191.stdout:4/758: rmdir d5/d1b/d8e/dad 39 2024-09-19T09:35:04.555 INFO:tasks.workunit.client.1.smithi191.stdout:4/759: write d5/d1b/d1c/d24/d32/d21/d78/f7b [807046,65470] 0 2024-09-19T09:35:04.555 INFO:tasks.workunit.client.1.smithi191.stdout:7/673: dread d2/d39/d3a/d3c/fdb [0,4194304] 0 2024-09-19T09:35:04.555 INFO:tasks.workunit.client.1.smithi191.stdout:7/674: creat d2/d2a/d33/fe8 x:0 0 0 2024-09-19T09:35:04.555 INFO:tasks.workunit.client.1.smithi191.stdout:7/675: write d2/d2a/d38/d63/da2/fcf [332535,122446] 0 2024-09-19T09:35:04.557 INFO:tasks.workunit.client.1.smithi191.stdout:8/793: getdents d1/d7 0 2024-09-19T09:35:04.559 INFO:tasks.workunit.client.1.smithi191.stdout:3/603: symlink d12/d43/d61/ld7 0 2024-09-19T09:35:04.561 INFO:tasks.workunit.client.1.smithi191.stdout:6/580: link d2/de/d2a/d2d/f1b d2/de/d19/d1e/fb6 0 2024-09-19T09:35:04.562 INFO:tasks.workunit.client.1.smithi191.stdout:8/794: write d1/d16/d3c/f31 [44799,56720] 0 2024-09-19T09:35:04.562 INFO:tasks.workunit.client.1.smithi191.stdout:2/640: mknod d8/db/cd7 0 2024-09-19T09:35:04.568 INFO:tasks.workunit.client.1.smithi191.stdout:7/676: truncate d2/d2a/d79/fb7 526957 0 2024-09-19T09:35:04.568 INFO:tasks.workunit.client.1.smithi191.stdout:7/677: creat d2/fe9 x:0 0 0 2024-09-19T09:35:04.569 INFO:tasks.workunit.client.1.smithi191.stdout:3/604: mkdir d12/d13/d1a/d1b/d3c/dd8 0 2024-09-19T09:35:04.569 INFO:tasks.workunit.client.1.smithi191.stdout:3/605: write d12/d13/d1a/f5c [1060994,68806] 0 2024-09-19T09:35:04.569 INFO:tasks.workunit.client.1.smithi191.stdout:3/606: chown d12/d13/d1a/d1b/d60/d7a/c87 42536 1 2024-09-19T09:35:04.569 INFO:tasks.workunit.client.1.smithi191.stdout:3/607: readlink d12/d13/d1a/d1b/d2e/dab/l95 0 2024-09-19T09:35:04.571 INFO:tasks.workunit.client.1.smithi191.stdout:6/581: link d2/de/d19/d1e/fb6 d2/de/d2a/d2d/d30/d98/d9b/fb7 0 2024-09-19T09:35:04.574 INFO:tasks.workunit.client.1.smithi191.stdout:9/677: sync 2024-09-19T09:35:04.576 INFO:tasks.workunit.client.1.smithi191.stdout:5/675: dwrite d0/d4/d9/f9b [4194304,4194304] 0 2024-09-19T09:35:04.576 INFO:tasks.workunit.client.1.smithi191.stdout:1/687: dwrite d3/d9/da/d1e/d32/faf [0,4194304] 0 2024-09-19T09:35:04.577 INFO:tasks.workunit.client.1.smithi191.stdout:4/760: rename d5/d1b/d1c/d2f to d5/d1b/d1c/d24/d82/df2 0 2024-09-19T09:35:04.579 INFO:tasks.workunit.client.1.smithi191.stdout:7/678: link d2/c2b d2/d2a/d79/d7f/cea 0 2024-09-19T09:35:04.579 INFO:tasks.workunit.client.1.smithi191.stdout:7/679: chown d2/d39/d3a/d9c/fc2 10 1 2024-09-19T09:35:04.581 INFO:tasks.workunit.client.1.smithi191.stdout:6/582: unlink d2/de/d19/d1e/f21 0 2024-09-19T09:35:04.581 INFO:tasks.workunit.client.1.smithi191.stdout:6/583: read - d2/de/d19/d1e/d64/f8f zero size 2024-09-19T09:35:04.581 INFO:tasks.workunit.client.1.smithi191.stdout:6/584: truncate d2/de/d2a/d2d/d30/d98/d9b/f9a 440321 0 2024-09-19T09:35:04.582 INFO:tasks.workunit.client.1.smithi191.stdout:2/641: mkdir d8/d2a/dd8 0 2024-09-19T09:35:04.583 INFO:tasks.workunit.client.1.smithi191.stdout:2/642: creat d8/db/d13/d23/fd9 x:0 0 0 2024-09-19T09:35:04.584 INFO:tasks.workunit.client.1.smithi191.stdout:5/676: symlink d0/d4/lf3 0 2024-09-19T09:35:04.593 INFO:tasks.workunit.client.1.smithi191.stdout:8/795: rename d1/d16/d3c/d28/cd2 to d1/d16/d3c/d28/d79/dd3/c104 0 2024-09-19T09:35:04.593 INFO:tasks.workunit.client.1.smithi191.stdout:8/796: dread - d1/d16/d3c/d17/da1/d84/fe4 zero size 2024-09-19T09:35:04.594 INFO:tasks.workunit.client.1.smithi191.stdout:9/678: dwrite d3/db/d16/d47/d55/f4f [0,4194304] 0 2024-09-19T09:35:04.594 INFO:tasks.workunit.client.1.smithi191.stdout:9/679: chown d3/db/d16/d17/d81/d8d 1398861 1 2024-09-19T09:35:04.594 INFO:tasks.workunit.client.1.smithi191.stdout:9/680: chown d3/db/d16/d47/d55/f4f 6747748 1 2024-09-19T09:35:04.594 INFO:tasks.workunit.client.1.smithi191.stdout:4/761: mknod d5/d1b/d1c/d24/d32/d21/d4a/dc5/cf3 0 2024-09-19T09:35:04.595 INFO:tasks.workunit.client.1.smithi191.stdout:7/680: mkdir d2/d39/dc7/deb 0 2024-09-19T09:35:04.595 INFO:tasks.workunit.client.1.smithi191.stdout:7/681: write d2/d39/d3a/d3c/fdb [1699643,98676] 0 2024-09-19T09:35:04.596 INFO:tasks.workunit.client.1.smithi191.stdout:6/585: mkdir d2/de/d19/d1e/d64/d61/d81/da7/db8 0 2024-09-19T09:35:04.598 INFO:tasks.workunit.client.1.smithi191.stdout:0/758: sync 2024-09-19T09:35:04.599 INFO:tasks.workunit.client.1.smithi191.stdout:8/797: creat d1/d16/d2e/f105 x:0 0 0 2024-09-19T09:35:04.603 INFO:tasks.workunit.client.1.smithi191.stdout:9/681: rmdir d3/db/d16/d17/d81/d8d 39 2024-09-19T09:35:04.604 INFO:tasks.workunit.client.1.smithi191.stdout:9/682: dread d3/d60/f54 [0,4194304] 0 2024-09-19T09:35:04.604 INFO:tasks.workunit.client.1.smithi191.stdout:9/683: write d3/db/d16/f7e [2635432,94412] 0 2024-09-19T09:35:04.605 INFO:tasks.workunit.client.1.smithi191.stdout:1/688: rename d3/d9/da/d1e/d32/d53/fc6 to d3/d9/da/d1e/d25/ffe 0 2024-09-19T09:35:04.605 INFO:tasks.workunit.client.1.smithi191.stdout:1/689: chown d3 1276 1 2024-09-19T09:35:04.605 INFO:tasks.workunit.client.1.smithi191.stdout:1/690: fsync d3/d9/da/d7e/fb6 0 2024-09-19T09:35:04.606 INFO:tasks.workunit.client.1.smithi191.stdout:0/759: creat d0/d9/d1c/d1f/d24/d39/d7a/ff5 x:0 0 0 2024-09-19T09:35:04.607 INFO:tasks.workunit.client.1.smithi191.stdout:6/586: write d2/de/f69 [3683982,22973] 0 2024-09-19T09:35:04.607 INFO:tasks.workunit.client.1.smithi191.stdout:6/587: readlink d2/de/d19/d1e/d64/l53 0 2024-09-19T09:35:04.607 INFO:tasks.workunit.client.1.smithi191.stdout:8/798: mkdir d1/d7/d1a/d6d/de1/d6b/d83/dab/d106 0 2024-09-19T09:35:04.608 INFO:tasks.workunit.client.1.smithi191.stdout:2/643: dwrite d8/d11/d98/f9a [0,4194304] 0 2024-09-19T09:35:04.609 INFO:tasks.workunit.client.1.smithi191.stdout:5/677: dwrite d0/d4/d9/f59 [0,4194304] 0 2024-09-19T09:35:04.610 INFO:tasks.workunit.client.1.smithi191.stdout:9/684: symlink d3/db/d16/d38/d92/led 0 2024-09-19T09:35:04.613 INFO:tasks.workunit.client.1.smithi191.stdout:1/691: symlink d3/d9/da/d1e/d25/lff 0 2024-09-19T09:35:04.613 INFO:tasks.workunit.client.1.smithi191.stdout:1/692: write d3/d9/da/d1e/d32/d53/dd8/fdb [917555,54221] 0 2024-09-19T09:35:04.613 INFO:tasks.workunit.client.1.smithi191.stdout:8/799: mknod d1/d16/d3c/d17/c107 0 2024-09-19T09:35:04.615 INFO:tasks.workunit.client.1.smithi191.stdout:0/760: write d0/d9/d1c/d1f/d24/d29/f78 [1315235,38456] 0 2024-09-19T09:35:04.616 INFO:tasks.workunit.client.1.smithi191.stdout:2/644: write d8/d11/d3f/d8a/d8f/f6b [559719,107080] 0 2024-09-19T09:35:04.619 INFO:tasks.workunit.client.1.smithi191.stdout:4/762: rename d5/d1b/d1c/d24/d32/d21/d5c/fb4 to d5/d1b/d1c/d28/d96/ff4 0 2024-09-19T09:35:04.624 INFO:tasks.workunit.client.1.smithi191.stdout:2/645: unlink d8/d11/d3f/d64/la4 0 2024-09-19T09:35:04.624 INFO:tasks.workunit.client.1.smithi191.stdout:4/763: rmdir d5/d1b/d1c/d24/d32 39 2024-09-19T09:35:04.626 INFO:tasks.workunit.client.1.smithi191.stdout:1/693: write d3/d9/da/d1e/f2d [1351793,121264] 0 2024-09-19T09:35:04.632 INFO:tasks.workunit.client.1.smithi191.stdout:1/694: dread d3/d9/da/d8c/f90 [0,4194304] 0 2024-09-19T09:35:04.634 INFO:tasks.workunit.client.1.smithi191.stdout:1/695: rename d3/d9/l46 to d3/d9/da/d1e/d32/d53/d57/d6d/da1/da7/l100 0 2024-09-19T09:35:04.636 INFO:tasks.workunit.client.1.smithi191.stdout:1/696: creat d3/d9/da/d1e/d32/d6f/db2/dd1/f101 x:0 0 0 2024-09-19T09:35:04.637 INFO:tasks.workunit.client.1.smithi191.stdout:1/697: creat d3/d9/da/f102 x:0 0 0 2024-09-19T09:35:04.638 INFO:tasks.workunit.client.1.smithi191.stdout:1/698: rmdir d3/d9/da/d1e/d25/d70 39 2024-09-19T09:35:04.639 INFO:tasks.workunit.client.1.smithi191.stdout:4/764: dread d5/d1b/d1c/d24/d32/f76 [0,4194304] 0 2024-09-19T09:35:04.640 INFO:tasks.workunit.client.1.smithi191.stdout:4/765: symlink d5/d1b/d1c/d24/d32/d21/d4a/lf5 0 2024-09-19T09:35:04.640 INFO:tasks.workunit.client.1.smithi191.stdout:4/766: write d5/d1b/d1c/d24/d32/d21/d78/fce [3655622,42492] 0 2024-09-19T09:35:04.650 INFO:tasks.workunit.client.1.smithi191.stdout:9/685: dwrite d3/d8/fdd [0,4194304] 0 2024-09-19T09:35:04.651 INFO:tasks.workunit.client.1.smithi191.stdout:6/588: dwrite d2/de/d15/f78 [0,4194304] 0 2024-09-19T09:35:04.651 INFO:tasks.workunit.client.1.smithi191.stdout:9/686: read d3/d8/fc [6266,74312] 0 2024-09-19T09:35:04.651 INFO:tasks.workunit.client.1.smithi191.stdout:6/589: fsync d2/de/d2a/f4b 0 2024-09-19T09:35:04.654 INFO:tasks.workunit.client.1.smithi191.stdout:0/761: dwrite d0/d9/d1c/d1f/f77 [0,4194304] 0 2024-09-19T09:35:04.654 INFO:tasks.workunit.client.1.smithi191.stdout:0/762: dread - d0/d9/d1c/d20/fb5 zero size 2024-09-19T09:35:04.654 INFO:tasks.workunit.client.1.smithi191.stdout:0/763: write d0/dc5/d86/fa5 [3906010,113789] 0 2024-09-19T09:35:04.654 INFO:tasks.workunit.client.1.smithi191.stdout:0/764: read d0/d9/f25 [3379057,6172] 0 2024-09-19T09:35:04.656 INFO:tasks.workunit.client.1.smithi191.stdout:0/765: mkdir d0/d9/d1c/d1f/d24/d39/d58/df6 0 2024-09-19T09:35:04.656 INFO:tasks.workunit.client.1.smithi191.stdout:0/766: chown d0/d9/d1c/d1f/d24/d29/d30/d56 0 1 2024-09-19T09:35:04.656 INFO:tasks.workunit.client.1.smithi191.stdout:0/767: chown d0/d9/c42 24177765 1 2024-09-19T09:35:04.657 INFO:tasks.workunit.client.1.smithi191.stdout:2/646: dwrite d8/db/d13/d23/f57 [0,4194304] 0 2024-09-19T09:35:04.657 INFO:tasks.workunit.client.1.smithi191.stdout:8/800: dwrite d1/d16/d2e/d32/de7/f103 [0,4194304] 0 2024-09-19T09:35:04.657 INFO:tasks.workunit.client.1.smithi191.stdout:8/801: getdents d1/d16/d23/df9 0 2024-09-19T09:35:04.665 INFO:tasks.workunit.client.1.smithi191.stdout:1/699: rmdir d3/d9/da/d1e/d32/d53 39 2024-09-19T09:35:04.667 INFO:tasks.workunit.client.1.smithi191.stdout:2/647: mkdir d8/d11/d3f/d8a/dda 0 2024-09-19T09:35:04.669 INFO:tasks.workunit.client.1.smithi191.stdout:4/767: rmdir d5 39 2024-09-19T09:35:04.669 INFO:tasks.workunit.client.1.smithi191.stdout:4/768: truncate d5/d1b/d1c/d24/d82/df2/f47 4831351 0 2024-09-19T09:35:04.670 INFO:tasks.workunit.client.1.smithi191.stdout:6/590: dwrite d2/de/d19/d1e/d64/f55 [0,4194304] 0 2024-09-19T09:35:04.670 INFO:tasks.workunit.client.1.smithi191.stdout:6/591: readlink d2/de/d19/d1e/d64/d61/d81/lac 0 2024-09-19T09:35:04.671 INFO:tasks.workunit.client.1.smithi191.stdout:2/648: creat d8/db/d41/fdb x:0 0 0 2024-09-19T09:35:04.673 INFO:tasks.workunit.client.1.smithi191.stdout:2/649: truncate d8/db/d13/d23/fc0 127572 0 2024-09-19T09:35:04.674 INFO:tasks.workunit.client.1.smithi191.stdout:1/700: dread d3/d9/f9c [0,4194304] 0 2024-09-19T09:35:04.674 INFO:tasks.workunit.client.1.smithi191.stdout:1/701: fdatasync d3/dd7/fc5 0 2024-09-19T09:35:04.674 INFO:tasks.workunit.client.1.smithi191.stdout:2/650: unlink d8/d11/d3f/d64/fbf 0 2024-09-19T09:35:04.676 INFO:tasks.workunit.client.1.smithi191.stdout:4/769: dread d5/d1b/d1c/d24/d32/f16 [0,4194304] 0 2024-09-19T09:35:04.677 INFO:tasks.workunit.client.1.smithi191.stdout:4/770: creat d5/d1b/d61/d88/ff6 x:0 0 0 2024-09-19T09:35:04.677 INFO:tasks.workunit.client.1.smithi191.stdout:4/771: dread - d5/d38/da5/fe1 zero size 2024-09-19T09:35:04.678 INFO:tasks.workunit.client.1.smithi191.stdout:4/772: rename d5/d1b/d1c/cdc to d5/d1b/d1c/d24/d32/d21/d4a/dc5/cf7 0 2024-09-19T09:35:04.679 INFO:tasks.workunit.client.1.smithi191.stdout:4/773: mknod d5/d1b/d1c/d24/d32/d21/d4a/dc5/cf8 0 2024-09-19T09:35:04.679 INFO:tasks.workunit.client.1.smithi191.stdout:4/774: truncate d5/d1b/d1c/d28/d96/f9a 3314757 0 2024-09-19T09:35:04.685 INFO:tasks.workunit.client.1.smithi191.stdout:6/592: write d2/f63 [2539519,68952] 0 2024-09-19T09:35:04.685 INFO:tasks.workunit.client.1.smithi191.stdout:1/702: dread d3/d9/da/d42/f91 [0,4194304] 0 2024-09-19T09:35:04.685 INFO:tasks.workunit.client.1.smithi191.stdout:1/703: creat d3/d9/f103 x:0 0 0 2024-09-19T09:35:04.686 INFO:tasks.workunit.client.1.smithi191.stdout:6/593: symlink d2/de/d15/d92/lb9 0 2024-09-19T09:35:04.686 INFO:tasks.workunit.client.1.smithi191.stdout:0/768: dwrite d0/d9/d1c/deb/fef [0,4194304] 0 2024-09-19T09:35:04.687 INFO:tasks.workunit.client.1.smithi191.stdout:8/802: dwrite d1/d16/d2e/d32/f64 [4194304,4194304] 0 2024-09-19T09:35:04.688 INFO:tasks.workunit.client.1.smithi191.stdout:0/769: truncate d0/d9/d1c/d1f/d24/d87/de1/fe5 1049624 0 2024-09-19T09:35:04.689 INFO:tasks.workunit.client.1.smithi191.stdout:4/775: read d5/d1b/d1c/d24/d32/d21/d56/fb9 [1957461,92716] 0 2024-09-19T09:35:04.693 INFO:tasks.workunit.client.1.smithi191.stdout:0/770: rename d0/dc5/d86/fa5 to d0/d9/d1c/d1f/d24/d29/d30/ff7 0 2024-09-19T09:35:04.696 INFO:tasks.workunit.client.1.smithi191.stdout:0/771: symlink d0/d9/d1c/d1f/d24/d39/d8b/lf8 0 2024-09-19T09:35:04.696 INFO:tasks.workunit.client.1.smithi191.stdout:0/772: getdents d0/d9/d1c/d1f/d24/d39/d8b/ded 0 2024-09-19T09:35:04.699 INFO:tasks.workunit.client.1.smithi191.stdout:3/608: sync 2024-09-19T09:35:04.699 INFO:tasks.workunit.client.1.smithi191.stdout:3/609: fdatasync d12/d13/d1a/d5d/dd1/fd3 0 2024-09-19T09:35:04.700 INFO:tasks.workunit.client.1.smithi191.stdout:3/610: read d12/d13/d1a/f32 [462386,122630] 0 2024-09-19T09:35:04.700 INFO:tasks.workunit.client.1.smithi191.stdout:6/594: dread d2/de/d2a/f4b [0,4194304] 0 2024-09-19T09:35:04.700 INFO:tasks.workunit.client.1.smithi191.stdout:6/595: dread - d2/de/d15/f74 zero size 2024-09-19T09:35:04.701 INFO:tasks.workunit.client.1.smithi191.stdout:2/651: dread d8/db/d13/d23/fc0 [0,4194304] 0 2024-09-19T09:35:04.701 INFO:tasks.workunit.client.1.smithi191.stdout:2/652: write d8/db/fc7 [578497,130073] 0 2024-09-19T09:35:04.701 INFO:tasks.workunit.client.1.smithi191.stdout:3/611: mkdir d12/d13/d1a/d1b/d2e/dab/d51/dcd/dd9 0 2024-09-19T09:35:04.702 INFO:tasks.workunit.client.1.smithi191.stdout:6/596: creat d2/de/d19/d1e/fba x:0 0 0 2024-09-19T09:35:04.703 INFO:tasks.workunit.client.1.smithi191.stdout:2/653: creat d8/db/d41/fdc x:0 0 0 2024-09-19T09:35:04.705 INFO:tasks.workunit.client.1.smithi191.stdout:4/776: rename d5/d1b/d61 to d5/d1b/d1c/df9 0 2024-09-19T09:35:04.705 INFO:tasks.workunit.client.1.smithi191.stdout:4/777: stat d5/d1b/d1c/d24/d32/d21/d92/fa8 0 2024-09-19T09:35:04.706 INFO:tasks.workunit.client.1.smithi191.stdout:3/612: getdents d12/d13/d1a/d1b/d60/d7a 0 2024-09-19T09:35:04.708 INFO:tasks.workunit.client.1.smithi191.stdout:6/597: rename d2/de/d19/d1e/d64/f55 to d2/de/d2a/d2d/d30/d98/d9b/fbb 0 2024-09-19T09:35:04.708 INFO:tasks.workunit.client.1.smithi191.stdout:0/773: dread d0/d9/d1c/d1f/d24/d39/d8b/f8d [0,4194304] 0 2024-09-19T09:35:04.710 INFO:tasks.workunit.client.1.smithi191.stdout:3/613: mkdir d12/d13/dda 0 2024-09-19T09:35:04.710 INFO:tasks.workunit.client.1.smithi191.stdout:3/614: dread - d12/d43/fac zero size 2024-09-19T09:35:04.711 INFO:tasks.workunit.client.1.smithi191.stdout:6/598: symlink d2/de/d2a/lbc 0 2024-09-19T09:35:04.712 INFO:tasks.workunit.client.1.smithi191.stdout:4/778: mknod d5/d1b/d1c/d24/d32/cfa 0 2024-09-19T09:35:04.712 INFO:tasks.workunit.client.1.smithi191.stdout:4/779: write d5/d1b/d1c/d24/d82/df2/d19/f20 [1366784,95562] 0 2024-09-19T09:35:04.713 INFO:tasks.workunit.client.1.smithi191.stdout:7/682: sync 2024-09-19T09:35:04.714 INFO:tasks.workunit.client.1.smithi191.stdout:6/599: truncate d2/de/f14 3963096 0 2024-09-19T09:35:04.715 INFO:tasks.workunit.client.1.smithi191.stdout:7/683: symlink d2/d2a/d4f/lec 0 2024-09-19T09:35:04.717 INFO:tasks.workunit.client.1.smithi191.stdout:4/780: rename d5/d1b/d1c/d24/d32/d21/d5c/da9 to d5/dfb 0 2024-09-19T09:35:04.718 INFO:tasks.workunit.client.1.smithi191.stdout:7/684: mkdir d2/d2a/d38/de5/ded 0 2024-09-19T09:35:04.720 INFO:tasks.workunit.client.1.smithi191.stdout:4/781: unlink d5/d1b/d1c/d24/c31 0 2024-09-19T09:35:04.720 INFO:tasks.workunit.client.1.smithi191.stdout:4/782: write d5/d38/da5/fd5 [590832,1475] 0 2024-09-19T09:35:04.721 INFO:tasks.workunit.client.1.smithi191.stdout:7/685: creat d2/d2a/d38/de5/ded/fee x:0 0 0 2024-09-19T09:35:04.722 INFO:tasks.workunit.client.1.smithi191.stdout:7/686: truncate d2/d2a/d4f/d59/f65 1014116 0 2024-09-19T09:35:04.722 INFO:tasks.workunit.client.1.smithi191.stdout:3/615: dread d12/f1e [0,4194304] 0 2024-09-19T09:35:04.723 INFO:tasks.workunit.client.1.smithi191.stdout:4/783: write d5/d1b/d1c/d24/d82/df2/d37/d59/f9b [923039,53722] 0 2024-09-19T09:35:04.724 INFO:tasks.workunit.client.1.smithi191.stdout:3/616: rename d12/d13/d1a/d28/f58 to d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/fdb 0 2024-09-19T09:35:04.724 INFO:tasks.workunit.client.1.smithi191.stdout:3/617: fdatasync d12/d13/d1a/d1b/d2e/dab/d3d/f6a 0 2024-09-19T09:35:04.725 INFO:tasks.workunit.client.1.smithi191.stdout:3/618: unlink d12/f81 0 2024-09-19T09:35:04.725 INFO:tasks.workunit.client.1.smithi191.stdout:3/619: creat d12/d43/db2/fdc x:0 0 0 2024-09-19T09:35:04.734 INFO:tasks.workunit.client.1.smithi191.stdout:8/803: dwrite d1/d16/d3c/d17/f9a [0,4194304] 0 2024-09-19T09:35:04.735 INFO:tasks.workunit.client.1.smithi191.stdout:7/687: dread d2/f9 [0,4194304] 0 2024-09-19T09:35:04.735 INFO:tasks.workunit.client.1.smithi191.stdout:7/688: fsync d2/f84 0 2024-09-19T09:35:04.735 INFO:tasks.workunit.client.1.smithi191.stdout:8/804: creat d1/d16/d3c/d28/f108 x:0 0 0 2024-09-19T09:35:04.735 INFO:tasks.workunit.client.1.smithi191.stdout:3/620: read d12/d13/d1a/d1b/d2e/dab/d51/d62/d85/da0/fbc [2659592,44528] 0 2024-09-19T09:35:04.735 INFO:tasks.workunit.client.1.smithi191.stdout:3/621: fsync d12/d13/d1a/d1b/d3c/d3f/f67 0 2024-09-19T09:35:04.738 INFO:tasks.workunit.client.1.smithi191.stdout:0/774: read d0/dc5/fd7 [613968,15039] 0 2024-09-19T09:35:04.738 INFO:tasks.workunit.client.1.smithi191.stdout:0/775: creat d0/ff9 x:0 0 0 2024-09-19T09:35:04.738 INFO:tasks.workunit.client.1.smithi191.stdout:0/776: stat d0/d6f/d76/f7d 0 2024-09-19T09:35:04.739 INFO:tasks.workunit.client.1.smithi191.stdout:0/777: mknod d0/d9/de/d61/cfa 0 2024-09-19T09:35:04.739 INFO:tasks.workunit.client.1.smithi191.stdout:0/778: chown d0/d9/d1c/d1f/f77 5186 1 2024-09-19T09:35:04.740 INFO:tasks.workunit.client.1.smithi191.stdout:0/779: symlink d0/d9/d1c/d1f/d24/d87/de1/lfb 0 2024-09-19T09:35:04.742 INFO:tasks.workunit.client.1.smithi191.stdout:0/780: creat d0/dc5/ffc x:0 0 0 2024-09-19T09:35:04.745 INFO:tasks.workunit.client.1.smithi191.stdout:0/781: mknod d0/d9/d1c/d1f/d24/d29/d30/d7c/cfd 0 2024-09-19T09:35:04.747 INFO:tasks.workunit.client.1.smithi191.stdout:7/689: write d2/f47 [1311951,4883] 0 2024-09-19T09:35:04.748 INFO:tasks.workunit.client.1.smithi191.stdout:7/690: chown d2/d2a/d38/dd4 844090166 1 2024-09-19T09:35:04.757 INFO:tasks.workunit.client.1.smithi191.stdout:0/782: dread d0/d9/f4d [0,4194304] 0 2024-09-19T09:35:04.757 INFO:tasks.workunit.client.1.smithi191.stdout:0/783: chown d0/d9/fb8 139027530 1 2024-09-19T09:35:04.757 INFO:tasks.workunit.client.1.smithi191.stdout:0/784: write d0/d9/d1c/deb/ddb/ff3 [139291,84614] 0 2024-09-19T09:35:04.758 INFO:tasks.workunit.client.1.smithi191.stdout:0/785: rmdir d0/d9/d1c/d1f/d24/d53 39 2024-09-19T09:35:04.759 INFO:tasks.workunit.client.1.smithi191.stdout:0/786: unlink d0/d9/d1c/d1f/d24/d39/d8b/lf8 0 2024-09-19T09:35:04.759 INFO:tasks.workunit.client.1.smithi191.stdout:0/787: chown d0/d9/d1c/d1f/d24/d87/dd0/cf1 13 1 2024-09-19T09:35:04.759 INFO:tasks.workunit.client.1.smithi191.stdout:0/788: creat d0/d9/d1c/d1f/d24/d39/ffe x:0 0 0 2024-09-19T09:35:04.760 INFO:tasks.workunit.client.1.smithi191.stdout:7/691: dread d2/f17 [0,4194304] 0 2024-09-19T09:35:04.760 INFO:tasks.workunit.client.1.smithi191.stdout:7/692: readlink d2/l55 0 2024-09-19T09:35:04.760 INFO:tasks.workunit.client.1.smithi191.stdout:0/789: creat d0/d9/d1c/d1f/d24/d39/d8b/fff x:0 0 0 2024-09-19T09:35:04.761 INFO:tasks.workunit.client.1.smithi191.stdout:0/790: creat d0/d9/d1c/d1f/d24/dbe/f100 x:0 0 0 2024-09-19T09:35:04.763 INFO:tasks.workunit.client.1.smithi191.stdout:0/791: rename d0/d9/d1c/c57 to d0/d9/d1c/d1f/d24/d39/d8b/c101 0 2024-09-19T09:35:04.763 INFO:tasks.workunit.client.1.smithi191.stdout:7/693: read d2/f1b [1707354,88956] 0 2024-09-19T09:35:04.763 INFO:tasks.workunit.client.1.smithi191.stdout:6/600: dwrite d2/de/d19/f93 [0,4194304] 0 2024-09-19T09:35:04.763 INFO:tasks.workunit.client.1.smithi191.stdout:6/601: stat d2/de/d19/d1e/la1 0 2024-09-19T09:35:04.763 INFO:tasks.workunit.client.1.smithi191.stdout:6/602: dread - d2/de/d15/d92/faf zero size 2024-09-19T09:35:04.763 INFO:tasks.workunit.client.1.smithi191.stdout:6/603: fsync d2/de/d2a/d2d/f99 0 2024-09-19T09:35:04.763 INFO:tasks.workunit.client.1.smithi191.stdout:6/604: truncate d2/de/d19/d1e/d64/f97 928745 0 2024-09-19T09:35:04.764 INFO:tasks.workunit.client.1.smithi191.stdout:6/605: fdatasync d2/de/d15/d92/faf 0 2024-09-19T09:35:04.764 INFO:tasks.workunit.client.1.smithi191.stdout:6/606: readlink d2/de/d2a/d2d/d30/d98/d9b/l9d 0 2024-09-19T09:35:04.764 INFO:tasks.workunit.client.1.smithi191.stdout:0/792: mknod d0/c102 0 2024-09-19T09:35:04.764 INFO:tasks.workunit.client.1.smithi191.stdout:7/694: mkdir d2/d2a/d38/def 0 2024-09-19T09:35:04.764 INFO:tasks.workunit.client.1.smithi191.stdout:7/695: chown d2/d2a/d79/da8/db9/lc6 305 1 2024-09-19T09:35:04.765 INFO:tasks.workunit.client.1.smithi191.stdout:6/607: creat d2/de/d2a/d2d/d30/d98/d9b/d65/fbd x:0 0 0 2024-09-19T09:35:04.766 INFO:tasks.workunit.client.1.smithi191.stdout:0/793: unlink d0/d9/d1c/d1f/ldd 0 2024-09-19T09:35:04.767 INFO:tasks.workunit.client.1.smithi191.stdout:0/794: chown d0/d9/de/l4f 1030 1 2024-09-19T09:35:04.770 INFO:tasks.workunit.client.1.smithi191.stdout:7/696: creat d2/d39/ff0 x:0 0 0 2024-09-19T09:35:04.770 INFO:tasks.workunit.client.1.smithi191.stdout:7/697: write d2/d2a/d33/fe8 [435619,6992] 0 2024-09-19T09:35:04.770 INFO:tasks.workunit.client.1.smithi191.stdout:7/698: readlink d2/d2a/d4f/d59/d81/ldc 0 2024-09-19T09:35:04.771 INFO:tasks.workunit.client.1.smithi191.stdout:0/795: mkdir d0/d9/d1c/d1f/d24/d29/d30/d56/d103 0 2024-09-19T09:35:04.771 INFO:tasks.workunit.client.1.smithi191.stdout:0/796: chown d0/f34 16082330 1 2024-09-19T09:35:04.774 INFO:tasks.workunit.client.1.smithi191.stdout:3/622: dwrite d12/d13/f14 [0,4194304] 0 2024-09-19T09:35:04.774 INFO:tasks.workunit.client.1.smithi191.stdout:3/623: write d12/d13/dc9/d73/f7d [4497478,67747] 0 2024-09-19T09:35:04.774 INFO:tasks.workunit.client.1.smithi191.stdout:3/624: chown d12/d13/d1a/d1b/d2e/lc1 7813 1 2024-09-19T09:35:04.774 INFO:tasks.workunit.client.1.smithi191.stdout:8/805: dwrite d1/d16/d23/d3e/dcb/ffe [0,4194304] 0 2024-09-19T09:35:04.774 INFO:tasks.workunit.client.1.smithi191.stdout:3/625: creat d12/d13/d1a/d5d/fdd x:0 0 0 2024-09-19T09:35:04.774 INFO:tasks.workunit.client.1.smithi191.stdout:3/626: dread - d12/d13/d1a/d1b/d3c/d3f/f4e zero size 2024-09-19T09:35:04.774 INFO:tasks.workunit.client.1.smithi191.stdout:3/627: write d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/f8a [1689691,42941] 0 2024-09-19T09:35:04.774 INFO:tasks.workunit.client.1.smithi191.stdout:3/628: fsync d12/d13/d1a/d1b/d60/d7a/f92 0 2024-09-19T09:35:04.774 INFO:tasks.workunit.client.1.smithi191.stdout:3/629: write d12/d43/f52 [730524,117460] 0 2024-09-19T09:35:04.774 INFO:tasks.workunit.client.1.smithi191.stdout:3/630: fsync d12/d13/d1a/d1b/d2e/dab/faa 0 2024-09-19T09:35:04.774 INFO:tasks.workunit.client.1.smithi191.stdout:3/631: readlink d12/d13/d1a/d1b/d2e/l30 0 2024-09-19T09:35:04.774 INFO:tasks.workunit.client.1.smithi191.stdout:3/632: chown d12/d13/d1a/d1b/d2e/f3a 678 1 2024-09-19T09:35:04.774 INFO:tasks.workunit.client.1.smithi191.stdout:3/633: chown d12/d13/d1a 4812 1 2024-09-19T09:35:04.775 INFO:tasks.workunit.client.1.smithi191.stdout:3/634: stat d12/d13/d1a/d1b/d2e/dab/d3d/d91/fb7 0 2024-09-19T09:35:04.775 INFO:tasks.workunit.client.1.smithi191.stdout:3/635: getdents d12/d13/d1a/d1b/d3c/dd8 0 2024-09-19T09:35:04.775 INFO:tasks.workunit.client.1.smithi191.stdout:3/636: creat d12/d13/d1a/d1b/d2e/dab/d51/d62/d85/fde x:0 0 0 2024-09-19T09:35:04.775 INFO:tasks.workunit.client.1.smithi191.stdout:0/797: truncate d0/d9/d1c/d1f/d24/dbe/fe2 286656 0 2024-09-19T09:35:04.775 INFO:tasks.workunit.client.1.smithi191.stdout:7/699: dread d2/d2a/d33/f3e [0,4194304] 0 2024-09-19T09:35:04.775 INFO:tasks.workunit.client.1.smithi191.stdout:4/784: dwrite d5/de7/ff0 [0,4194304] 0 2024-09-19T09:35:04.775 INFO:tasks.workunit.client.1.smithi191.stdout:4/785: write d5/d1b/d1c/d24/d32/d21/d4a/f7f [1239815,24829] 0 2024-09-19T09:35:04.777 INFO:tasks.workunit.client.1.smithi191.stdout:0/798: dread d0/d9/de/d61/dbf/fda [0,4194304] 0 2024-09-19T09:35:04.779 INFO:tasks.workunit.client.1.smithi191.stdout:0/799: dread d0/d9/d1c/d1f/d24/d39/d8b/fb7 [0,4194304] 0 2024-09-19T09:35:04.786 INFO:tasks.workunit.client.1.smithi191.stdout:4/786: mknod d5/d1b/d8e/dc9/cfc 0 2024-09-19T09:35:04.787 INFO:tasks.workunit.client.1.smithi191.stdout:4/787: read d5/d1b/d1c/d24/d82/df2/d19/f20 [1417757,47938] 0 2024-09-19T09:35:04.787 INFO:tasks.workunit.client.1.smithi191.stdout:4/788: fsync d5/d1b/d1c/d24/d82/fca 0 2024-09-19T09:35:04.787 INFO:tasks.workunit.client.1.smithi191.stdout:8/806: mknod d1/d16/c109 0 2024-09-19T09:35:04.787 INFO:tasks.workunit.client.1.smithi191.stdout:0/800: rmdir d0/d9/de/d61 39 2024-09-19T09:35:04.787 INFO:tasks.workunit.client.1.smithi191.stdout:0/801: dread - d0/dc5/fbd zero size 2024-09-19T09:35:04.789 INFO:tasks.workunit.client.1.smithi191.stdout:6/608: dwrite d2/de/d2a/d2d/d30/d98/d9b/fb7 [4194304,4194304] 0 2024-09-19T09:35:04.792 INFO:tasks.workunit.client.1.smithi191.stdout:8/807: rename d1/d16/d3c/f68 to d1/d16/d3c/d28/d79/da2/f10a 0 2024-09-19T09:35:04.792 INFO:tasks.workunit.client.1.smithi191.stdout:8/808: write d1/d7/fd5 [4270897,40203] 0 2024-09-19T09:35:04.792 INFO:tasks.workunit.client.1.smithi191.stdout:8/809: chown d1/d7/d1a/d6d/de1/d6b/db9/fda 235095100 1 2024-09-19T09:35:04.792 INFO:tasks.workunit.client.1.smithi191.stdout:8/810: creat d1/d22/d47/f10b x:0 0 0 2024-09-19T09:35:04.792 INFO:tasks.workunit.client.1.smithi191.stdout:0/802: truncate d0/d9/d1c/d1f/f77 745403 0 2024-09-19T09:35:04.796 INFO:tasks.workunit.client.1.smithi191.stdout:8/811: rmdir d1/d16/d2e/d7a 39 2024-09-19T09:35:04.797 INFO:tasks.workunit.client.1.smithi191.stdout:8/812: chown d1/d16/d3c/d17/da1/d84/fe4 88681006 1 2024-09-19T09:35:04.799 INFO:tasks.workunit.client.1.smithi191.stdout:8/813: symlink d1/d7/d1a/d6d/de1/d6b/da9/dc1/l10c 0 2024-09-19T09:35:04.802 INFO:tasks.workunit.client.1.smithi191.stdout:8/814: mkdir d1/d7/d1a/d6d/de1/d6b/db9/d10d 0 2024-09-19T09:35:04.803 INFO:tasks.workunit.client.1.smithi191.stdout:5/678: sync 2024-09-19T09:35:04.803 INFO:tasks.workunit.client.1.smithi191.stdout:9/687: sync 2024-09-19T09:35:04.803 INFO:tasks.workunit.client.1.smithi191.stdout:5/679: creat d0/da7/dcd/dd7/ff4 x:0 0 0 2024-09-19T09:35:04.803 INFO:tasks.workunit.client.1.smithi191.stdout:5/680: dread - d0/d4/d4a/f60 zero size 2024-09-19T09:35:04.812 INFO:tasks.workunit.client.1.smithi191.stdout:5/681: read d0/d4/d9/d1d/f46 [1305952,74040] 0 2024-09-19T09:35:04.868 INFO:tasks.workunit.client.1.smithi191.stdout:5/682: creat d0/da7/ff5 x:0 0 0 2024-09-19T09:35:04.868 INFO:tasks.workunit.client.1.smithi191.stdout:5/683: dread - d0/d4/d9/d1d/d28/ff0 zero size 2024-09-19T09:35:04.869 INFO:tasks.workunit.client.1.smithi191.stdout:9/688: getdents d3/db/d16/d17/d81 0 2024-09-19T09:35:04.871 INFO:tasks.workunit.client.1.smithi191.stdout:6/609: dwrite d2/de/f14 [0,4194304] 0 2024-09-19T09:35:04.884 INFO:tasks.workunit.client.1.smithi191.stdout:4/789: dwrite d5/d1b/d1c/d24/d32/d21/d5c/d8c/fa2 [0,4194304] 0 2024-09-19T09:35:04.884 INFO:tasks.workunit.client.1.smithi191.stdout:4/790: chown d5/d1b/d1c/d24/d32/d21/d92/lbb 6128802 1 2024-09-19T09:35:04.884 INFO:tasks.workunit.client.1.smithi191.stdout:5/684: symlink d0/d77/lf6 0 2024-09-19T09:35:04.884 INFO:tasks.workunit.client.1.smithi191.stdout:5/685: truncate d0/d4/d9/d1d/d28/d53/f70 1494788 0 2024-09-19T09:35:04.885 INFO:tasks.workunit.client.1.smithi191.stdout:9/689: mkdir d3/db/d53/dee 0 2024-09-19T09:35:04.887 INFO:tasks.workunit.client.1.smithi191.stdout:6/610: rename d2/de/d15/f58 to d2/de/fbe 0 2024-09-19T09:35:04.890 INFO:tasks.workunit.client.1.smithi191.stdout:8/815: dwrite d1/d16/d2e/f93 [0,4194304] 0 2024-09-19T09:35:04.891 INFO:tasks.workunit.client.1.smithi191.stdout:5/686: symlink d0/d4/d9/d1d/d29/lf7 0 2024-09-19T09:35:04.894 INFO:tasks.workunit.client.1.smithi191.stdout:6/611: rmdir d2/de/d19/d1e/d64/d76/da8 0 2024-09-19T09:35:04.897 INFO:tasks.workunit.client.1.smithi191.stdout:8/816: mkdir d1/d7/d1a/d6d/de1/d6b/d83/dab/d10e 0 2024-09-19T09:35:04.897 INFO:tasks.workunit.client.1.smithi191.stdout:8/817: write d1/d22/d47/f100 [384605,34651] 0 2024-09-19T09:35:04.897 INFO:tasks.workunit.client.1.smithi191.stdout:9/690: getdents d3/d60/d78 0 2024-09-19T09:35:04.898 INFO:tasks.workunit.client.1.smithi191.stdout:1/704: sync 2024-09-19T09:35:04.898 INFO:tasks.workunit.client.1.smithi191.stdout:2/654: sync 2024-09-19T09:35:04.899 INFO:tasks.workunit.client.1.smithi191.stdout:4/791: rename d5/d1b/d1c to d5/dfb/dfd 0 2024-09-19T09:35:04.899 INFO:tasks.workunit.client.1.smithi191.stdout:4/792: chown d5/d38/da5/fd6 2 1 2024-09-19T09:35:04.899 INFO:tasks.workunit.client.1.smithi191.stdout:6/612: rmdir d2/de/d2a/d39 39 2024-09-19T09:35:04.900 INFO:tasks.workunit.client.1.smithi191.stdout:6/613: fdatasync d2/de/d19/f6e 0 2024-09-19T09:35:04.900 INFO:tasks.workunit.client.1.smithi191.stdout:6/614: chown d2/de/fbe 42412 1 2024-09-19T09:35:04.900 INFO:tasks.workunit.client.1.smithi191.stdout:6/615: creat d2/de/d19/d1e/fbf x:0 0 0 2024-09-19T09:35:04.900 INFO:tasks.workunit.client.1.smithi191.stdout:8/818: truncate d1/d16/d3c/d28/f33 2042367 0 2024-09-19T09:35:04.902 INFO:tasks.workunit.client.1.smithi191.stdout:9/691: mknod d3/db/de6/cef 0 2024-09-19T09:35:04.902 INFO:tasks.workunit.client.1.smithi191.stdout:1/705: mknod d3/d9/da/d1e/d25/c104 0 2024-09-19T09:35:04.905 INFO:tasks.workunit.client.1.smithi191.stdout:5/687: rename d0/d4/d9/d1d/d29/c54 to d0/da7/dcd/dd7/cf8 0 2024-09-19T09:35:04.905 INFO:tasks.workunit.client.1.smithi191.stdout:5/688: dread - d0/d4/d9/d1d/d28/ff0 zero size 2024-09-19T09:35:04.905 INFO:tasks.workunit.client.1.smithi191.stdout:7/700: sync 2024-09-19T09:35:04.906 INFO:tasks.workunit.client.1.smithi191.stdout:0/803: sync 2024-09-19T09:35:04.906 INFO:tasks.workunit.client.1.smithi191.stdout:3/637: sync 2024-09-19T09:35:04.907 INFO:tasks.workunit.client.1.smithi191.stdout:4/793: creat d5/ffe x:0 0 0 2024-09-19T09:35:04.909 INFO:tasks.workunit.client.1.smithi191.stdout:6/616: mknod d2/de/d19/d1e/cc0 0 2024-09-19T09:35:04.910 INFO:tasks.workunit.client.1.smithi191.stdout:8/819: symlink d1/d7/d1a/d6d/de1/d6b/d83/dab/l10f 0 2024-09-19T09:35:04.912 INFO:tasks.workunit.client.1.smithi191.stdout:9/692: creat d3/db/ff0 x:0 0 0 2024-09-19T09:35:04.912 INFO:tasks.workunit.client.1.smithi191.stdout:9/693: fsync d3/db/d16/d47/d89/fc8 0 2024-09-19T09:35:04.913 INFO:tasks.workunit.client.1.smithi191.stdout:1/706: mkdir d3/d9/da/d8c/d97/d105 0 2024-09-19T09:35:04.914 INFO:tasks.workunit.client.1.smithi191.stdout:5/689: creat d0/d4/d9/ff9 x:0 0 0 2024-09-19T09:35:04.914 INFO:tasks.workunit.client.1.smithi191.stdout:7/701: rmdir d2/d2a/d38/d63/d9a 39 2024-09-19T09:35:04.917 INFO:tasks.workunit.client.1.smithi191.stdout:0/804: creat d0/d9/d1c/d1f/d24/d87/f104 x:0 0 0 2024-09-19T09:35:04.917 INFO:tasks.workunit.client.1.smithi191.stdout:0/805: truncate d0/d9/d1c/d1f/d24/d39/d8b/fff 803832 0 2024-09-19T09:35:04.917 INFO:tasks.workunit.client.1.smithi191.stdout:0/806: truncate d0/d9/d1c/d1f/d24/d87/de1/fe5 1819835 0 2024-09-19T09:35:04.917 INFO:tasks.workunit.client.1.smithi191.stdout:4/794: fsync d5/dfb/dfd/d24/d32/d21/d5c/fb7 0 2024-09-19T09:35:04.919 INFO:tasks.workunit.client.1.smithi191.stdout:1/707: unlink d3/d9/da/d1e/d25/l4f 0 2024-09-19T09:35:04.920 INFO:tasks.workunit.client.1.smithi191.stdout:6/617: write d2/de/d2a/d2d/f99 [979699,3865] 0 2024-09-19T09:35:04.921 INFO:tasks.workunit.client.1.smithi191.stdout:2/655: dwrite d8/d11/d3f/d8a/d8f/f6b [0,4194304] 0 2024-09-19T09:35:04.921 INFO:tasks.workunit.client.1.smithi191.stdout:6/618: dread - d2/de/d2a/d2d/d30/d98/d9b/d65/d89/fad zero size 2024-09-19T09:35:04.921 INFO:tasks.workunit.client.1.smithi191.stdout:2/656: write d8/db/d4e/fa7 [2019985,102593] 0 2024-09-19T09:35:04.921 INFO:tasks.workunit.client.1.smithi191.stdout:5/690: creat d0/d4/d9/d1d/d29/d33/d45/d97/ddf/ffa x:0 0 0 2024-09-19T09:35:04.921 INFO:tasks.workunit.client.1.smithi191.stdout:3/638: getdents d12/d13/d1a/d5d 0 2024-09-19T09:35:04.924 INFO:tasks.workunit.client.1.smithi191.stdout:4/795: rename d5/dfb/dfd/d24/d82/df2/d37/d59/l66 to d5/dfb/lff 0 2024-09-19T09:35:04.924 INFO:tasks.workunit.client.1.smithi191.stdout:4/796: fdatasync d5/f4e 0 2024-09-19T09:35:04.925 INFO:tasks.workunit.client.1.smithi191.stdout:7/702: write d2/d2a/d38/d63/dc1/fe1 [2778295,101451] 0 2024-09-19T09:35:04.927 INFO:tasks.workunit.client.1.smithi191.stdout:9/694: dread d3/d60/d78/f7b [0,4194304] 0 2024-09-19T09:35:04.928 INFO:tasks.workunit.client.1.smithi191.stdout:6/619: creat d2/de/d2a/d60/fc1 x:0 0 0 2024-09-19T09:35:04.929 INFO:tasks.workunit.client.1.smithi191.stdout:2/657: creat d8/db/d41/fdd x:0 0 0 2024-09-19T09:35:04.929 INFO:tasks.workunit.client.1.smithi191.stdout:2/658: fdatasync d8/f9e 0 2024-09-19T09:35:04.931 INFO:tasks.workunit.client.1.smithi191.stdout:1/708: rename d3/d9/da/d1e/l5a to d3/dd7/l106 0 2024-09-19T09:35:04.932 INFO:tasks.workunit.client.1.smithi191.stdout:4/797: mkdir d5/dfb/dfd/d24/d32/d21/d56/d86/d100 0 2024-09-19T09:35:04.932 INFO:tasks.workunit.client.1.smithi191.stdout:0/807: read d0/d9/d1c/d1f/d24/d39/d8b/f8d [3398327,24092] 0 2024-09-19T09:35:04.932 INFO:tasks.workunit.client.1.smithi191.stdout:0/808: write d0/d9/d1c/d1f/d24/dbe/fe2 [147017,74991] 0 2024-09-19T09:35:04.933 INFO:tasks.workunit.client.1.smithi191.stdout:7/703: link d2/f67 d2/d2a/d38/def/ff1 0 2024-09-19T09:35:04.933 INFO:tasks.workunit.client.1.smithi191.stdout:6/620: mknod d2/de/d2a/d2d/d30/d98/d9b/cc2 0 2024-09-19T09:35:04.935 INFO:tasks.workunit.client.1.smithi191.stdout:2/659: mkdir d8/db/d13/d23/dde 0 2024-09-19T09:35:04.935 INFO:tasks.workunit.client.1.smithi191.stdout:2/660: chown d8/db/d4e/fa7 183 1 2024-09-19T09:35:04.935 INFO:tasks.workunit.client.1.smithi191.stdout:2/661: fdatasync d8/f9e 0 2024-09-19T09:35:04.935 INFO:tasks.workunit.client.1.smithi191.stdout:2/662: fdatasync d8/db/d13/d35/d70/fc8 0 2024-09-19T09:35:04.935 INFO:tasks.workunit.client.1.smithi191.stdout:2/663: fsync d8/db/d13/d40/fb3 0 2024-09-19T09:35:04.936 INFO:tasks.workunit.client.1.smithi191.stdout:4/798: mknod d5/dfb/dfd/d24/d82/c101 0 2024-09-19T09:35:04.937 INFO:tasks.workunit.client.1.smithi191.stdout:0/809: mknod d0/d9/d1c/d20/c105 0 2024-09-19T09:35:04.939 INFO:tasks.workunit.client.1.smithi191.stdout:6/621: creat d2/de/d19/d1e/d64/d61/d81/da7/fc3 x:0 0 0 2024-09-19T09:35:04.940 INFO:tasks.workunit.client.1.smithi191.stdout:2/664: creat d8/db/d13/fdf x:0 0 0 2024-09-19T09:35:04.941 INFO:tasks.workunit.client.1.smithi191.stdout:9/695: rename d3/d8/l26 to d3/db/d16/d17/d3c/dc0/lf1 0 2024-09-19T09:35:04.943 INFO:tasks.workunit.client.1.smithi191.stdout:1/709: link d3/d9/da/d1e/d32/d53/l68 d3/d9/da/d1e/d25/l107 0 2024-09-19T09:35:04.943 INFO:tasks.workunit.client.1.smithi191.stdout:4/799: truncate d5/dfb/dfd/d24/d82/df2/d19/f20 1269335 0 2024-09-19T09:35:04.943 INFO:tasks.workunit.client.1.smithi191.stdout:4/800: readlink d5/d38/l49 0 2024-09-19T09:35:04.944 INFO:tasks.workunit.client.1.smithi191.stdout:2/665: mknod d8/db/d13/d23/dde/ce0 0 2024-09-19T09:35:04.945 INFO:tasks.workunit.client.1.smithi191.stdout:9/696: mknod d3/db/d53/dee/cf2 0 2024-09-19T09:35:04.946 INFO:tasks.workunit.client.1.smithi191.stdout:4/801: link d5/dfb/dfd/d24/d82/df2/d37/d59/fbf d5/dfb/dfd/d24/d32/d21/d56/f102 0 2024-09-19T09:35:04.947 INFO:tasks.workunit.client.1.smithi191.stdout:6/622: getdents d2/de/d19/d1e 0 2024-09-19T09:35:04.947 INFO:tasks.workunit.client.1.smithi191.stdout:3/639: dwrite d12/d13/d1a/d1b/d3c/f4f [0,4194304] 0 2024-09-19T09:35:04.948 INFO:tasks.workunit.client.1.smithi191.stdout:8/820: dwrite d1/d16/d23/d3e/dcb/ffa [0,4194304] 0 2024-09-19T09:35:04.949 INFO:tasks.workunit.client.1.smithi191.stdout:9/697: link d3/d60/d78/fbe d3/db6/ff3 0 2024-09-19T09:35:04.949 INFO:tasks.workunit.client.1.smithi191.stdout:2/666: dread d8/db/d4d/fd4 [0,4194304] 0 2024-09-19T09:35:04.950 INFO:tasks.workunit.client.1.smithi191.stdout:5/691: dwrite d0/d77/fea [0,4194304] 0 2024-09-19T09:35:04.950 INFO:tasks.workunit.client.1.smithi191.stdout:5/692: write d0/fa2 [290285,52634] 0 2024-09-19T09:35:04.950 INFO:tasks.workunit.client.1.smithi191.stdout:2/667: creat d8/db/d13/d35/d70/fe1 x:0 0 0 2024-09-19T09:35:04.950 INFO:tasks.workunit.client.1.smithi191.stdout:2/668: chown d8/db/d13/d23/fb0 72196 1 2024-09-19T09:35:04.950 INFO:tasks.workunit.client.1.smithi191.stdout:2/669: dread - d8/f9e zero size 2024-09-19T09:35:04.950 INFO:tasks.workunit.client.1.smithi191.stdout:0/810: dread d0/dc5/d86/fe8 [0,4194304] 0 2024-09-19T09:35:04.951 INFO:tasks.workunit.client.1.smithi191.stdout:4/802: rmdir d5/d1b/d8e/dad 39 2024-09-19T09:35:04.951 INFO:tasks.workunit.client.1.smithi191.stdout:4/803: write f1 [368816,85840] 0 2024-09-19T09:35:04.951 INFO:tasks.workunit.client.1.smithi191.stdout:4/804: write d5/dfb/dfd/d24/d32/f1e [3252782,60162] 0 2024-09-19T09:35:04.953 INFO:tasks.workunit.client.1.smithi191.stdout:6/623: symlink d2/de/d19/d1e/d64/d76/lc4 0 2024-09-19T09:35:04.954 INFO:tasks.workunit.client.1.smithi191.stdout:3/640: unlink d12/d13/d1a/d1b/d2e/dab/l9f 0 2024-09-19T09:35:04.957 INFO:tasks.workunit.client.1.smithi191.stdout:8/821: creat d1/d7/d1a/d6d/de1/d6b/db9/f110 x:0 0 0 2024-09-19T09:35:04.957 INFO:tasks.workunit.client.1.smithi191.stdout:8/822: chown d1/d16/d3c/d28/d79/f7f 4 1 2024-09-19T09:35:04.957 INFO:tasks.workunit.client.1.smithi191.stdout:8/823: write d1/d16/d2e/d32/d7e/d8b/f91 [183877,94045] 0 2024-09-19T09:35:04.961 INFO:tasks.workunit.client.1.smithi191.stdout:1/710: dwrite d3/d9/da/f20 [0,4194304] 0 2024-09-19T09:35:04.962 INFO:tasks.workunit.client.1.smithi191.stdout:5/693: link d0/d4/d9/d1d/d29/d33/f38 d0/d4/d4a/db4/ffb 0 2024-09-19T09:35:04.962 INFO:tasks.workunit.client.1.smithi191.stdout:5/694: dread d0/d1f/f96 [0,4194304] 0 2024-09-19T09:35:04.966 INFO:tasks.workunit.client.1.smithi191.stdout:4/805: getdents d5/dfb/dfd/d24/d82/df2/d37 0 2024-09-19T09:35:04.967 INFO:tasks.workunit.client.1.smithi191.stdout:3/641: creat d12/d13/d1a/d1b/d2e/dab/d51/d62/fdf x:0 0 0 2024-09-19T09:35:04.968 INFO:tasks.workunit.client.1.smithi191.stdout:3/642: write d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/f8a [3231932,82187] 0 2024-09-19T09:35:04.968 INFO:tasks.workunit.client.1.smithi191.stdout:3/643: chown d12/d13/d1a/d1b/d60/f72 52 1 2024-09-19T09:35:04.969 INFO:tasks.workunit.client.1.smithi191.stdout:8/824: mknod d1/d16/d2e/d7a/d95/c111 0 2024-09-19T09:35:04.969 INFO:tasks.workunit.client.1.smithi191.stdout:9/698: getdents d3/db/d16/d17/d3c 0 2024-09-19T09:35:04.973 INFO:tasks.workunit.client.1.smithi191.stdout:2/670: rename d8/db/d41/f93 to d8/d11/fe2 0 2024-09-19T09:35:04.976 INFO:tasks.workunit.client.1.smithi191.stdout:5/695: link d0/d4/d9/c91 d0/d4/d9/d1d/d29/d33/d45/d64/de7/cfc 0 2024-09-19T09:35:04.976 INFO:tasks.workunit.client.1.smithi191.stdout:5/696: fsync d0/d4/d9/d1d/d22/d3b/db9/fd9 0 2024-09-19T09:35:04.976 INFO:tasks.workunit.client.1.smithi191.stdout:5/697: dread - d0/d4/d4a/f60 zero size 2024-09-19T09:35:04.977 INFO:tasks.workunit.client.1.smithi191.stdout:4/806: write d5/dfb/dfd/d24/d32/d8f/fbe [4979539,103454] 0 2024-09-19T09:35:04.979 INFO:tasks.workunit.client.1.smithi191.stdout:9/699: link d3/db/l14 d3/db/lf4 0 2024-09-19T09:35:04.979 INFO:tasks.workunit.client.1.smithi191.stdout:9/700: creat d3/db/d53/da2/db3/ff5 x:0 0 0 2024-09-19T09:35:04.981 INFO:tasks.workunit.client.1.smithi191.stdout:0/811: rename d0/d9/d1c/d1f/d24/d29/d30/d56/l9b to d0/d9/de/d81/l106 0 2024-09-19T09:35:04.982 INFO:tasks.workunit.client.1.smithi191.stdout:5/698: mkdir d0/d4/d9/d1d/d22/d3b/db9/dfd 0 2024-09-19T09:35:04.983 INFO:tasks.workunit.client.1.smithi191.stdout:4/807: creat d5/d38/f103 x:0 0 0 2024-09-19T09:35:04.986 INFO:tasks.workunit.client.1.smithi191.stdout:8/825: dwrite d1/d16/f46 [0,4194304] 0 2024-09-19T09:35:04.986 INFO:tasks.workunit.client.1.smithi191.stdout:8/826: write d1/d7/d1a/f25 [4568154,66953] 0 2024-09-19T09:35:04.987 INFO:tasks.workunit.client.1.smithi191.stdout:6/624: rename d2/de/d19/d5d/fae to d2/de/d19/d1e/d64/d77/d82/fc5 0 2024-09-19T09:35:04.988 INFO:tasks.workunit.client.1.smithi191.stdout:0/812: chown d0/d6f/d7b/l5c 2 1 2024-09-19T09:35:04.991 INFO:tasks.workunit.client.1.smithi191.stdout:8/827: link d1/d16/d2e/d32/f77 d1/d7/d1a/d6d/de1/d6b/db9/f112 0 2024-09-19T09:35:04.993 INFO:tasks.workunit.client.1.smithi191.stdout:2/671: rename d8/db/d13/d35/d70/c83 to d8/d11/d3f/d64/ce3 0 2024-09-19T09:35:04.995 INFO:tasks.workunit.client.1.smithi191.stdout:6/625: symlink d2/de/d2a/lc6 0 2024-09-19T09:35:04.998 INFO:tasks.workunit.client.1.smithi191.stdout:8/828: mkdir d1/d22/d113 0 2024-09-19T09:35:04.998 INFO:tasks.workunit.client.1.smithi191.stdout:8/829: write d1/d16/d3c/d17/da1/fc0 [1975750,88775] 0 2024-09-19T09:35:05.002 INFO:tasks.workunit.client.1.smithi191.stdout:5/699: rename d0/d4/f78 to d0/d4/d9/d1d/d22/d3b/db9/dfd/ffe 0 2024-09-19T09:35:05.002 INFO:tasks.workunit.client.1.smithi191.stdout:5/700: stat d0/d4/d88/cdc 0 2024-09-19T09:35:05.002 INFO:tasks.workunit.client.1.smithi191.stdout:5/701: chown d0 28110 1 2024-09-19T09:35:05.003 INFO:tasks.workunit.client.1.smithi191.stdout:3/644: dwrite d12/d13/f14 [4194304,4194304] 0 2024-09-19T09:35:05.003 INFO:tasks.workunit.client.1.smithi191.stdout:3/645: chown l6 1508 1 2024-09-19T09:35:05.005 INFO:tasks.workunit.client.1.smithi191.stdout:8/830: truncate d1/d7/d1a/d6d/de1/d6b/da9/dc1/fd9 1623965 0 2024-09-19T09:35:05.009 INFO:tasks.workunit.client.1.smithi191.stdout:2/672: rename d8/db/d13/d23/cc1 to d8/d11/d3f/d8a/ce4 0 2024-09-19T09:35:05.011 INFO:tasks.workunit.client.1.smithi191.stdout:5/702: rmdir d0/d4/d4a/db5 0 2024-09-19T09:35:05.011 INFO:tasks.workunit.client.1.smithi191.stdout:5/703: fsync d0/d4/d9/d1d/d22/d5c/fe2 0 2024-09-19T09:35:05.013 INFO:tasks.workunit.client.1.smithi191.stdout:2/673: write d8/d11/f46 [2505117,33606] 0 2024-09-19T09:35:05.013 INFO:tasks.workunit.client.1.smithi191.stdout:5/704: symlink d0/d4/d9/d1d/d29/lff 0 2024-09-19T09:35:05.013 INFO:tasks.workunit.client.1.smithi191.stdout:5/705: chown d0/d4/d9/d1d/d22/d5c/l63 514884 1 2024-09-19T09:35:05.013 INFO:tasks.workunit.client.1.smithi191.stdout:5/706: chown d0/d4/d9/d1d/d29/d33/d45/d97/ddf 804 1 2024-09-19T09:35:05.014 INFO:tasks.workunit.client.1.smithi191.stdout:2/674: creat d8/d11/d56/fe5 x:0 0 0 2024-09-19T09:35:05.026 INFO:tasks.workunit.client.1.smithi191.stdout:9/701: dwrite d3/d60/f54 [0,4194304] 0 2024-09-19T09:35:05.026 INFO:tasks.workunit.client.1.smithi191.stdout:9/702: readlink d3/db/d53/da2/le7 0 2024-09-19T09:35:05.028 INFO:tasks.workunit.client.1.smithi191.stdout:2/675: dread d8/db/d13/d23/f78 [0,4194304] 0 2024-09-19T09:35:05.035 INFO:tasks.workunit.client.1.smithi191.stdout:0/813: dwrite d0/d9/d1c/d1f/d24/f90 [4194304,4194304] 0 2024-09-19T09:35:05.035 INFO:tasks.workunit.client.1.smithi191.stdout:0/814: stat d0/d9/d1c/d1f/d24/d39/d8b/fb7 0 2024-09-19T09:35:05.042 INFO:tasks.workunit.client.1.smithi191.stdout:6/626: dwrite d2/de/d15/f78 [0,4194304] 0 2024-09-19T09:35:05.042 INFO:tasks.workunit.client.1.smithi191.stdout:6/627: chown d2/lb 20537 1 2024-09-19T09:35:05.043 INFO:tasks.workunit.client.1.smithi191.stdout:4/808: dwrite d5/dfb/dfd/d24/d32/f1e [0,4194304] 0 2024-09-19T09:35:05.046 INFO:tasks.workunit.client.1.smithi191.stdout:2/676: rename d8/db/d13/d35 to d8/db/d4d/de6 0 2024-09-19T09:35:05.047 INFO:tasks.workunit.client.1.smithi191.stdout:2/677: fdatasync d8/db/d41/fb5 0 2024-09-19T09:35:05.047 INFO:tasks.workunit.client.1.smithi191.stdout:4/809: dread d5/dfb/dfd/d24/d82/df2/d37/d59/fbf [0,4194304] 0 2024-09-19T09:35:05.048 INFO:tasks.workunit.client.1.smithi191.stdout:2/678: symlink d8/d11/dc2/le7 0 2024-09-19T09:35:05.050 INFO:tasks.workunit.client.1.smithi191.stdout:1/711: dwrite d3/d9/da/d1e/d25/ffe [0,4194304] 0 2024-09-19T09:35:05.050 INFO:tasks.workunit.client.1.smithi191.stdout:1/712: readlink d3/d9/l6c 0 2024-09-19T09:35:05.050 INFO:tasks.workunit.client.1.smithi191.stdout:1/713: dread - d3/d9/da/d1e/d32/d6f/db2/dd1/f101 zero size 2024-09-19T09:35:05.050 INFO:tasks.workunit.client.1.smithi191.stdout:1/714: chown d3/d9/da/d1e/d32/d53/d57/d6d/da1/ffd 0 1 2024-09-19T09:35:05.050 INFO:tasks.workunit.client.1.smithi191.stdout:4/810: link d5/d1b/d8e/dad/f8b d5/dfb/dfd/d24/f104 0 2024-09-19T09:35:05.050 INFO:tasks.workunit.client.1.smithi191.stdout:4/811: stat d5/dfb/dfd/df9 0 2024-09-19T09:35:05.051 INFO:tasks.workunit.client.1.smithi191.stdout:8/831: dwrite d1/d16/f46 [0,4194304] 0 2024-09-19T09:35:05.051 INFO:tasks.workunit.client.1.smithi191.stdout:2/679: write d8/d11/f8e [412503,42373] 0 2024-09-19T09:35:05.051 INFO:tasks.workunit.client.1.smithi191.stdout:5/707: dwrite d0/d4/d9/d1d/d28/ff0 [0,4194304] 0 2024-09-19T09:35:05.054 INFO:tasks.workunit.client.1.smithi191.stdout:1/715: mkdir d3/dbd/d108 0 2024-09-19T09:35:05.055 INFO:tasks.workunit.client.1.smithi191.stdout:9/703: dwrite d3/d8/f3b [4194304,4194304] 0 2024-09-19T09:35:05.055 INFO:tasks.workunit.client.1.smithi191.stdout:4/812: creat d5/dfb/dfd/d24/d82/df2/d37/f105 x:0 0 0 2024-09-19T09:35:05.055 INFO:tasks.workunit.client.1.smithi191.stdout:4/813: write d5/dfb/dfd/d28/f83 [2356231,30627] 0 2024-09-19T09:35:05.056 INFO:tasks.workunit.client.1.smithi191.stdout:8/832: mknod d1/d22/d47/c114 0 2024-09-19T09:35:05.057 INFO:tasks.workunit.client.1.smithi191.stdout:8/833: chown d1/d7/d1a/d6d/de1/ld6 0 1 2024-09-19T09:35:05.060 INFO:tasks.workunit.client.1.smithi191.stdout:2/680: mkdir d8/db/d4d/de6/d70/de8 0 2024-09-19T09:35:05.060 INFO:tasks.workunit.client.1.smithi191.stdout:5/708: link d0/d1f/c2a d0/d4/d4a/db4/c100 0 2024-09-19T09:35:05.061 INFO:tasks.workunit.client.1.smithi191.stdout:1/716: symlink d3/d9/da/d1e/d32/d6f/db2/l109 0 2024-09-19T09:35:05.061 INFO:tasks.workunit.client.1.smithi191.stdout:1/717: fdatasync d3/d9/da/db/f4d 0 2024-09-19T09:35:05.061 INFO:tasks.workunit.client.1.smithi191.stdout:1/718: chown d3/d9/da/d8c/d97/ld3 252 1 2024-09-19T09:35:05.061 INFO:tasks.workunit.client.1.smithi191.stdout:0/815: dwrite d0/f34 [0,4194304] 0 2024-09-19T09:35:05.062 INFO:tasks.workunit.client.1.smithi191.stdout:6/628: dwrite d2/de/d19/f93 [0,4194304] 0 2024-09-19T09:35:05.063 INFO:tasks.workunit.client.1.smithi191.stdout:9/704: unlink d3/db/d16/d47/d89/c9e 0 2024-09-19T09:35:05.063 INFO:tasks.workunit.client.1.smithi191.stdout:9/705: creat d3/ff6 x:0 0 0 2024-09-19T09:35:05.063 INFO:tasks.workunit.client.1.smithi191.stdout:9/706: chown d3/db/d16/d17/d81/d8d/f98 4569788 1 2024-09-19T09:35:05.063 INFO:tasks.workunit.client.1.smithi191.stdout:4/814: unlink d5/dfb/dfd/d24/d82/fca 0 2024-09-19T09:35:05.065 INFO:tasks.workunit.client.1.smithi191.stdout:5/709: rmdir d0/da7/dcd 39 2024-09-19T09:35:05.066 INFO:tasks.workunit.client.1.smithi191.stdout:8/834: dread d1/d16/d3c/d17/f51 [0,4194304] 0 2024-09-19T09:35:05.066 INFO:tasks.workunit.client.1.smithi191.stdout:1/719: mknod d3/d9/da/d1e/d32/d53/d57/d6d/da1/db5/c10a 0 2024-09-19T09:35:05.067 INFO:tasks.workunit.client.1.smithi191.stdout:0/816: creat d0/d9/d1c/d1f/d24/dbc/f107 x:0 0 0 2024-09-19T09:35:05.067 INFO:tasks.workunit.client.1.smithi191.stdout:0/817: getdents d0/d9/d1c/d1f/de3 0 2024-09-19T09:35:05.068 INFO:tasks.workunit.client.1.smithi191.stdout:6/629: mkdir d2/de/d2a/d2d/dc7 0 2024-09-19T09:35:05.069 INFO:tasks.workunit.client.1.smithi191.stdout:7/704: sync 2024-09-19T09:35:05.070 INFO:tasks.workunit.client.1.smithi191.stdout:9/707: unlink d3/db/d16/f2a 0 2024-09-19T09:35:05.073 INFO:tasks.workunit.client.1.smithi191.stdout:4/815: mkdir d5/d106 0 2024-09-19T09:35:05.073 INFO:tasks.workunit.client.1.smithi191.stdout:4/816: getdents d5/dfb/dfd/df9 0 2024-09-19T09:35:05.073 INFO:tasks.workunit.client.1.smithi191.stdout:4/817: truncate d5/d38/da5/fe1 640355 0 2024-09-19T09:35:05.075 INFO:tasks.workunit.client.1.smithi191.stdout:2/681: rmdir d8/db/d13/d23 39 2024-09-19T09:35:05.076 INFO:tasks.workunit.client.1.smithi191.stdout:8/835: mknod d1/d16/d2e/d32/de7/c115 0 2024-09-19T09:35:05.076 INFO:tasks.workunit.client.1.smithi191.stdout:8/836: chown d1/d16/d2e/d32/f77 4399 1 2024-09-19T09:35:05.076 INFO:tasks.workunit.client.1.smithi191.stdout:8/837: write d1/d7/d1a/d6d/de1/d6b/d83/d98/fac [35639,106397] 0 2024-09-19T09:35:05.076 INFO:tasks.workunit.client.1.smithi191.stdout:8/838: chown d1/d7/d1a/d6d/de1/d6b/db9/fda 332630494 1 2024-09-19T09:35:05.077 INFO:tasks.workunit.client.1.smithi191.stdout:1/720: symlink d3/d9/da/d42/l10b 0 2024-09-19T09:35:05.077 INFO:tasks.workunit.client.1.smithi191.stdout:1/721: chown d3/d9/da/d1e/d25/d70/da0/fd0 0 1 2024-09-19T09:35:05.079 INFO:tasks.workunit.client.1.smithi191.stdout:0/818: read d0/d6f/d76/f8c [2253891,50255] 0 2024-09-19T09:35:05.079 INFO:tasks.workunit.client.1.smithi191.stdout:7/705: mknod d2/d2a/d79/d7f/cf2 0 2024-09-19T09:35:05.079 INFO:tasks.workunit.client.1.smithi191.stdout:0/819: creat d0/d9/d1c/d1f/d24/dbc/f108 x:0 0 0 2024-09-19T09:35:05.079 INFO:tasks.workunit.client.1.smithi191.stdout:9/708: unlink d3/d60/f54 0 2024-09-19T09:35:05.079 INFO:tasks.workunit.client.1.smithi191.stdout:7/706: write d2/d2a/d33/f5d [403912,46121] 0 2024-09-19T09:35:05.079 INFO:tasks.workunit.client.1.smithi191.stdout:9/709: write d3/d60/d78/fd1 [4590567,68971] 0 2024-09-19T09:35:05.081 INFO:tasks.workunit.client.1.smithi191.stdout:4/818: truncate d5/dfb/dfd/d24/d32/d21/d5c/d8c/fa2 313613 0 2024-09-19T09:35:05.082 INFO:tasks.workunit.client.1.smithi191.stdout:8/839: mknod d1/d22/d47/d9d/df1/df8/c116 0 2024-09-19T09:35:05.087 INFO:tasks.workunit.client.1.smithi191.stdout:7/707: rmdir d2/d39/dc7 39 2024-09-19T09:35:05.089 INFO:tasks.workunit.client.1.smithi191.stdout:6/630: dwrite d2/de/d2a/d2d/d30/d98/d9b/fbb [0,4194304] 0 2024-09-19T09:35:05.089 INFO:tasks.workunit.client.1.smithi191.stdout:6/631: dread - d2/de/d2a/d2d/d30/d98/d9b/d65/fbd zero size 2024-09-19T09:35:05.092 INFO:tasks.workunit.client.1.smithi191.stdout:4/819: stat d5/dfb/dfd/d24/d82/df2/d19/c87 0 2024-09-19T09:35:05.092 INFO:tasks.workunit.client.1.smithi191.stdout:5/710: dwrite d0/d4/d9/d1d/d29/d33/d45/f8a [0,4194304] 0 2024-09-19T09:35:05.092 INFO:tasks.workunit.client.1.smithi191.stdout:8/840: creat d1/d16/d2e/d32/f117 x:0 0 0 2024-09-19T09:35:05.092 INFO:tasks.workunit.client.1.smithi191.stdout:5/711: chown d0/d4/d9/de/f8f 13813 1 2024-09-19T09:35:05.092 INFO:tasks.workunit.client.1.smithi191.stdout:2/682: getdents d8/d11/d56 0 2024-09-19T09:35:05.099 INFO:tasks.workunit.client.1.smithi191.stdout:4/820: dread d5/d1b/faa [0,4194304] 0 2024-09-19T09:35:05.100 INFO:tasks.workunit.client.1.smithi191.stdout:0/820: dread d0/d6f/d7b/f6b [0,4194304] 0 2024-09-19T09:35:05.100 INFO:tasks.workunit.client.1.smithi191.stdout:2/683: creat d8/d11/d3f/d8a/dda/fe9 x:0 0 0 2024-09-19T09:35:05.100 INFO:tasks.workunit.client.1.smithi191.stdout:5/712: mknod d0/d4/d9/c101 0 2024-09-19T09:35:05.100 INFO:tasks.workunit.client.1.smithi191.stdout:5/713: chown d0/d4/d9/d1d/d22/f6d 45396 1 2024-09-19T09:35:05.102 INFO:tasks.workunit.client.1.smithi191.stdout:4/821: dread d5/fa6 [0,4194304] 0 2024-09-19T09:35:05.102 INFO:tasks.workunit.client.1.smithi191.stdout:8/841: mkdir d1/d22/d118 0 2024-09-19T09:35:05.108 INFO:tasks.workunit.client.1.smithi191.stdout:0/821: creat d0/d9/f109 x:0 0 0 2024-09-19T09:35:05.108 INFO:tasks.workunit.client.1.smithi191.stdout:0/822: chown d0/d9/de/d61/dbf 28040 1 2024-09-19T09:35:05.109 INFO:tasks.workunit.client.1.smithi191.stdout:8/842: creat d1/d22/d113/f119 x:0 0 0 2024-09-19T09:35:05.111 INFO:tasks.workunit.client.1.smithi191.stdout:8/843: creat d1/d16/d3c/d17/da1/d84/dbc/f11a x:0 0 0 2024-09-19T09:35:05.111 INFO:tasks.workunit.client.1.smithi191.stdout:8/844: readlink d1/d7/d1a/lbf 0 2024-09-19T09:35:05.112 INFO:tasks.workunit.client.1.smithi191.stdout:8/845: chown d1/d16/d3c/d28/d79/dd3 336385 1 2024-09-19T09:35:05.112 INFO:tasks.workunit.client.1.smithi191.stdout:5/714: rename d0/da7/dcb to d0/da7/dcd/d102 0 2024-09-19T09:35:05.112 INFO:tasks.workunit.client.1.smithi191.stdout:5/715: chown d0/da7/dcd/ce3 6679675 1 2024-09-19T09:35:05.112 INFO:tasks.workunit.client.1.smithi191.stdout:5/716: fsync d0/da7/ff5 0 2024-09-19T09:35:05.113 INFO:tasks.workunit.client.1.smithi191.stdout:8/846: unlink d1/d16/d2e/f8e 0 2024-09-19T09:35:05.114 INFO:tasks.workunit.client.1.smithi191.stdout:4/822: rename d5/d1b/f4f to d5/dfb/dfd/d24/d32/d8f/f107 0 2024-09-19T09:35:05.115 INFO:tasks.workunit.client.1.smithi191.stdout:4/823: dread - d5/dfb/dfd/d24/d82/df2/d19/fa4 zero size 2024-09-19T09:35:05.115 INFO:tasks.workunit.client.1.smithi191.stdout:8/847: unlink d1/d22/c61 0 2024-09-19T09:35:05.116 INFO:tasks.workunit.client.1.smithi191.stdout:4/824: symlink d5/dfb/dfd/d24/d82/df2/l108 0 2024-09-19T09:35:05.117 INFO:tasks.workunit.client.1.smithi191.stdout:8/848: write d1/d16/d2e/d32/f77 [142765,21808] 0 2024-09-19T09:35:05.117 INFO:tasks.workunit.client.1.smithi191.stdout:4/825: write d5/dfb/dfd/d24/d32/d21/d56/fe5 [734880,129718] 0 2024-09-19T09:35:05.117 INFO:tasks.workunit.client.1.smithi191.stdout:4/826: chown d5/dfb/lcd 8 1 2024-09-19T09:35:05.117 INFO:tasks.workunit.client.1.smithi191.stdout:8/849: rmdir d1/d16/d2e/d7a/d95 39 2024-09-19T09:35:05.118 INFO:tasks.workunit.client.1.smithi191.stdout:2/684: dread d8/db/d4d/de6/f37 [4194304,4194304] 0 2024-09-19T09:35:05.118 INFO:tasks.workunit.client.1.smithi191.stdout:4/827: symlink d5/dfb/dfd/d28/l109 0 2024-09-19T09:35:05.119 INFO:tasks.workunit.client.1.smithi191.stdout:8/850: mkdir d1/d16/d3c/d17/da1/d84/dbc/d11b 0 2024-09-19T09:35:05.120 INFO:tasks.workunit.client.1.smithi191.stdout:2/685: truncate d8/d11/d3f/f22 638879 0 2024-09-19T09:35:05.121 INFO:tasks.workunit.client.1.smithi191.stdout:4/828: creat d5/d1b/f10a x:0 0 0 2024-09-19T09:35:05.122 INFO:tasks.workunit.client.1.smithi191.stdout:8/851: link d1/d16/d3c/d17/f51 d1/d7/d1a/f11c 0 2024-09-19T09:35:05.123 INFO:tasks.workunit.client.1.smithi191.stdout:2/686: rename d8/db/f14 to d8/d11/dc2/fea 0 2024-09-19T09:35:05.127 INFO:tasks.workunit.client.1.smithi191.stdout:7/708: dwrite d2/d2a/d4f/f7b [0,4194304] 0 2024-09-19T09:35:05.127 INFO:tasks.workunit.client.1.smithi191.stdout:7/709: write d2/d2a/d38/d63/da2/fb5 [1039523,56908] 0 2024-09-19T09:35:05.129 INFO:tasks.workunit.client.1.smithi191.stdout:7/710: unlink d2/d5e/c6e 0 2024-09-19T09:35:05.129 INFO:tasks.workunit.client.1.smithi191.stdout:7/711: mknod d2/d2a/d79/d7f/cf3 0 2024-09-19T09:35:05.129 INFO:tasks.workunit.client.1.smithi191.stdout:7/712: chown d2/d39/d3a/fe4 159103343 1 2024-09-19T09:35:05.130 INFO:tasks.workunit.client.1.smithi191.stdout:7/713: getdents d2/d2a/d4f/d59 0 2024-09-19T09:35:05.136 INFO:tasks.workunit.client.1.smithi191.stdout:6/632: dwrite d2/de/d19/d1e/d64/d77/d82/fa3 [0,4194304] 0 2024-09-19T09:35:05.136 INFO:tasks.workunit.client.1.smithi191.stdout:8/852: write d1/d16/d3c/d17/da1/f80 [2753285,9956] 0 2024-09-19T09:35:05.136 INFO:tasks.workunit.client.1.smithi191.stdout:8/853: chown d1/d16/ff3 169977 1 2024-09-19T09:35:05.136 INFO:tasks.workunit.client.1.smithi191.stdout:8/854: chown d1/d7/d1a 167086999 1 2024-09-19T09:35:05.136 INFO:tasks.workunit.client.1.smithi191.stdout:9/710: dwrite d3/d8/fc [0,4194304] 0 2024-09-19T09:35:05.138 INFO:tasks.workunit.client.1.smithi191.stdout:6/633: mknod d2/de/d19/d1e/d64/d61/d81/da7/db8/cc8 0 2024-09-19T09:35:05.138 INFO:tasks.workunit.client.1.smithi191.stdout:6/634: chown d2/de/d15 360332 1 2024-09-19T09:35:05.138 INFO:tasks.workunit.client.1.smithi191.stdout:6/635: chown d2/de/d2a/d7d/c59 13 1 2024-09-19T09:35:05.138 INFO:tasks.workunit.client.1.smithi191.stdout:7/714: dread d2/f75 [0,4194304] 0 2024-09-19T09:35:05.139 INFO:tasks.workunit.client.1.smithi191.stdout:8/855: creat d1/d22/d47/d9d/f11d x:0 0 0 2024-09-19T09:35:05.140 INFO:tasks.workunit.client.1.smithi191.stdout:1/722: dwrite d3/d9/da/db/d48/f71 [0,4194304] 0 2024-09-19T09:35:05.141 INFO:tasks.workunit.client.1.smithi191.stdout:1/723: stat d3/d9/da/d1e/d25/d70/l76 0 2024-09-19T09:35:05.141 INFO:tasks.workunit.client.1.smithi191.stdout:9/711: unlink d3/d8/f13 0 2024-09-19T09:35:05.142 INFO:tasks.workunit.client.1.smithi191.stdout:6/636: unlink d2/de/d19/l8c 0 2024-09-19T09:35:05.143 INFO:tasks.workunit.client.1.smithi191.stdout:8/856: dread d1/d22/f54 [0,4194304] 0 2024-09-19T09:35:05.145 INFO:tasks.workunit.client.1.smithi191.stdout:1/724: symlink d3/ddf/l10c 0 2024-09-19T09:35:05.145 INFO:tasks.workunit.client.1.smithi191.stdout:1/725: chown d3/d9/da/d7e/cde 962 1 2024-09-19T09:35:05.147 INFO:tasks.workunit.client.1.smithi191.stdout:9/712: creat d3/db/d16/d47/d89/ff7 x:0 0 0 2024-09-19T09:35:05.148 INFO:tasks.workunit.client.1.smithi191.stdout:1/726: creat d3/d9/da/d1e/d32/d53/d57/def/f10d x:0 0 0 2024-09-19T09:35:05.150 INFO:tasks.workunit.client.1.smithi191.stdout:9/713: mknod d3/db/d53/da2/db3/cf8 0 2024-09-19T09:35:05.150 INFO:tasks.workunit.client.1.smithi191.stdout:7/715: read d2/d2a/d33/f7c [1651442,73419] 0 2024-09-19T09:35:05.153 INFO:tasks.workunit.client.1.smithi191.stdout:7/716: creat d2/d2a/d38/d63/d9a/dd5/ff4 x:0 0 0 2024-09-19T09:35:05.154 INFO:tasks.workunit.client.1.smithi191.stdout:9/714: getdents d3/db/d53/da2/db3/dc2 0 2024-09-19T09:35:05.155 INFO:tasks.workunit.client.1.smithi191.stdout:7/717: rmdir d2/d2a/d4f/d78 39 2024-09-19T09:35:05.155 INFO:tasks.workunit.client.1.smithi191.stdout:7/718: creat d2/d2a/d4f/d59/d81/ff5 x:0 0 0 2024-09-19T09:35:05.157 INFO:tasks.workunit.client.1.smithi191.stdout:9/715: symlink d3/db/d53/da2/db3/dc2/lf9 0 2024-09-19T09:35:05.157 INFO:tasks.workunit.client.1.smithi191.stdout:9/716: write d3/d60/d78/fdb [375995,36499] 0 2024-09-19T09:35:05.157 INFO:tasks.workunit.client.1.smithi191.stdout:9/717: chown d3/db/l14 3 1 2024-09-19T09:35:05.157 INFO:tasks.workunit.client.1.smithi191.stdout:5/717: dwrite d0/d4/d9/d1d/d29/d33/d45/d97/ddf/ffa [0,4194304] 0 2024-09-19T09:35:05.158 INFO:tasks.workunit.client.1.smithi191.stdout:2/687: dwrite d8/d11/d56/f79 [0,4194304] 0 2024-09-19T09:35:05.158 INFO:tasks.workunit.client.1.smithi191.stdout:2/688: write d8/d11/fe2 [1905206,52089] 0 2024-09-19T09:35:05.159 INFO:tasks.workunit.client.1.smithi191.stdout:2/689: write d8/db/d13/d40/fb3 [880337,29457] 0 2024-09-19T09:35:05.159 INFO:tasks.workunit.client.1.smithi191.stdout:0/823: dwrite d0/d9/d1c/f7e [0,4194304] 0 2024-09-19T09:35:05.159 INFO:tasks.workunit.client.1.smithi191.stdout:0/824: dread - d0/d9/d1c/d20/fb5 zero size 2024-09-19T09:35:05.160 INFO:tasks.workunit.client.1.smithi191.stdout:7/719: rename d2/d2a/d38/f85 to d2/d39/dc7/ff6 0 2024-09-19T09:35:05.160 INFO:tasks.workunit.client.1.smithi191.stdout:7/720: creat d2/d2a/d79/ff7 x:0 0 0 2024-09-19T09:35:05.161 INFO:tasks.workunit.client.1.smithi191.stdout:7/721: stat d2/d39/d3a/fda 0 2024-09-19T09:35:05.163 INFO:tasks.workunit.client.1.smithi191.stdout:5/718: unlink d0/d4/d9/d1d/d22/f2c 0 2024-09-19T09:35:05.163 INFO:tasks.workunit.client.1.smithi191.stdout:1/727: write d3/d9/da/d1e/d32/d53/f51 [524580,408] 0 2024-09-19T09:35:05.163 INFO:tasks.workunit.client.1.smithi191.stdout:1/728: stat d3/d9/da/d8c/d97/ld3 0 2024-09-19T09:35:05.163 INFO:tasks.workunit.client.1.smithi191.stdout:3/646: sync 2024-09-19T09:35:05.170 INFO:tasks.workunit.client.1.smithi191.stdout:2/690: truncate d8/db/d13/d23/f29 7435629 0 2024-09-19T09:35:05.173 INFO:tasks.workunit.client.1.smithi191.stdout:6/637: dwrite d2/de/d19/d1e/d64/f56 [0,4194304] 0 2024-09-19T09:35:05.175 INFO:tasks.workunit.client.1.smithi191.stdout:7/722: link d2/d5e/c9e d2/d39/d3a/d3c/dbf/cf8 0 2024-09-19T09:35:05.176 INFO:tasks.workunit.client.1.smithi191.stdout:1/729: mkdir d3/d9/da/d1e/d32/d53/d57/d10e 0 2024-09-19T09:35:05.177 INFO:tasks.workunit.client.1.smithi191.stdout:2/691: mknod d8/d2a/dd8/ceb 0 2024-09-19T09:35:05.181 INFO:tasks.workunit.client.1.smithi191.stdout:8/857: dwrite d1/d16/d23/f43 [0,4194304] 0 2024-09-19T09:35:05.181 INFO:tasks.workunit.client.1.smithi191.stdout:8/858: chown d1/d16/d2e/d7a/l89 1017908023 1 2024-09-19T09:35:05.181 INFO:tasks.workunit.client.1.smithi191.stdout:6/638: mkdir d2/de/d2a/dc9 0 2024-09-19T09:35:05.182 INFO:tasks.workunit.client.1.smithi191.stdout:4/829: rmdir d5 39 2024-09-19T09:35:05.183 INFO:tasks.workunit.client.1.smithi191.stdout:5/719: read d0/d1f/f84 [7757525,49231] 0 2024-09-19T09:35:05.183 INFO:tasks.workunit.client.1.smithi191.stdout:5/720: fdatasync d0/d4/d4a/f69 0 2024-09-19T09:35:05.184 INFO:tasks.workunit.client.1.smithi191.stdout:5/721: creat d0/d4/d9/f103 x:0 0 0 2024-09-19T09:35:05.185 INFO:tasks.workunit.client.1.smithi191.stdout:1/730: mkdir d3/d9/da/d1e/d10f 0 2024-09-19T09:35:05.185 INFO:tasks.workunit.client.1.smithi191.stdout:1/731: chown d3/d9/da/d8c/d97/ld3 10157623 1 2024-09-19T09:35:05.185 INFO:tasks.workunit.client.1.smithi191.stdout:3/647: write d12/d13/d1a/d1b/d60/f9e [2859492,2267] 0 2024-09-19T09:35:05.186 INFO:tasks.workunit.client.1.smithi191.stdout:2/692: link d8/db/d13/d23/l67 d8/db/d13/d23/lec 0 2024-09-19T09:35:05.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:04 smithi112 ceph-mon[27605]: pgmap v14: 65 pgs: 65 active+clean; 1.6 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 158 MiB/s rd, 210 MiB/s wr, 868 op/s 2024-09-19T09:35:05.190 INFO:tasks.workunit.client.1.smithi191.stdout:4/830: rename d5/d38/l49 to d5/d1b/d8e/l10b 0 2024-09-19T09:35:05.191 INFO:tasks.workunit.client.1.smithi191.stdout:5/722: truncate d0/d4/d9/de/ff 4593213 0 2024-09-19T09:35:05.192 INFO:tasks.workunit.client.1.smithi191.stdout:1/732: creat d3/d9/da/d1e/d32/ddc/f110 x:0 0 0 2024-09-19T09:35:05.194 INFO:tasks.workunit.client.1.smithi191.stdout:3/648: creat d12/d13/d1a/d1b/d2e/dab/d51/dcd/fe0 x:0 0 0 2024-09-19T09:35:05.194 INFO:tasks.workunit.client.1.smithi191.stdout:3/649: truncate d12/d13/d1a/d5d/fdd 906388 0 2024-09-19T09:35:05.195 INFO:tasks.workunit.client.1.smithi191.stdout:8/859: getdents d1/d22/d113 0 2024-09-19T09:35:05.196 INFO:tasks.workunit.client.1.smithi191.stdout:4/831: mkdir d5/dfb/dfd/df9/d88/d10c 0 2024-09-19T09:35:05.196 INFO:tasks.workunit.client.1.smithi191.stdout:4/832: chown d5/d38/f45 94 1 2024-09-19T09:35:05.199 INFO:tasks.workunit.client.1.smithi191.stdout:6/639: dread d2/de/d19/d1e/fb6 [0,4194304] 0 2024-09-19T09:35:05.200 INFO:tasks.workunit.client.1.smithi191.stdout:9/718: dwrite d3/db/d16/d38/f83 [0,4194304] 0 2024-09-19T09:35:05.200 INFO:tasks.workunit.client.1.smithi191.stdout:0/825: dwrite d0/d9/d1c/d1f/d24/d39/d8b/fb7 [0,4194304] 0 2024-09-19T09:35:05.200 INFO:tasks.workunit.client.1.smithi191.stdout:0/826: fsync d0/d9/d1c/d1f/d24/d29/f44 0 2024-09-19T09:35:05.200 INFO:tasks.workunit.client.1.smithi191.stdout:0/827: write d0/d9/d1c/d1f/d24/d29/d30/d56/f66 [737821,2434] 0 2024-09-19T09:35:05.201 INFO:tasks.workunit.client.1.smithi191.stdout:1/733: mkdir d3/d9/da/d1e/d32/d53/d57/d111 0 2024-09-19T09:35:05.201 INFO:tasks.workunit.client.1.smithi191.stdout:3/650: link c8 d12/d13/d1a/d1b/d60/d7a/ce1 0 2024-09-19T09:35:05.202 INFO:tasks.workunit.client.1.smithi191.stdout:8/860: creat d1/d7/d1a/d6d/de1/d6b/d83/d98/ddd/f11e x:0 0 0 2024-09-19T09:35:05.204 INFO:tasks.workunit.client.1.smithi191.stdout:4/833: creat d5/d1b/d74/f10d x:0 0 0 2024-09-19T09:35:05.204 INFO:tasks.workunit.client.1.smithi191.stdout:4/834: write d5/dfb/dfd/d24/d32/d21/d4a/f51 [4402885,107266] 0 2024-09-19T09:35:05.204 INFO:tasks.workunit.client.1.smithi191.stdout:4/835: fdatasync d5/d38/f103 0 2024-09-19T09:35:05.204 INFO:tasks.workunit.client.1.smithi191.stdout:4/836: chown d5/dfb/dfd/d24/d32/d21/d4a/dc5/cf3 2 1 2024-09-19T09:35:05.204 INFO:tasks.workunit.client.1.smithi191.stdout:4/837: creat d5/d1b/d74/f10e x:0 0 0 2024-09-19T09:35:05.206 INFO:tasks.workunit.client.1.smithi191.stdout:6/640: unlink d2/de/d15/f41 0 2024-09-19T09:35:05.209 INFO:tasks.workunit.client.1.smithi191.stdout:9/719: link d3/db/d16/d17/d81/f8e d3/db6/ffa 0 2024-09-19T09:35:05.211 INFO:tasks.workunit.client.1.smithi191.stdout:1/734: symlink d3/d9/da/d1e/d32/d6f/db2/l112 0 2024-09-19T09:35:05.212 INFO:tasks.workunit.client.1.smithi191.stdout:3/651: link d12/d13/d1a/d1b/d2e/dab/d51/d62/fdf d12/d13/d1a/d1b/d60/d7a/d93/fe2 0 2024-09-19T09:35:05.213 INFO:tasks.workunit.client.1.smithi191.stdout:8/861: creat d1/d7/d1a/d6d/de1/f11f x:0 0 0 2024-09-19T09:35:05.215 INFO:tasks.workunit.client.1.smithi191.stdout:8/862: write d1/d7/d1a/d6d/fba [397287,49036] 0 2024-09-19T09:35:05.215 INFO:tasks.workunit.client.1.smithi191.stdout:8/863: chown d1/d16/d23/f43 802 1 2024-09-19T09:35:05.215 INFO:tasks.workunit.client.1.smithi191.stdout:4/838: write d5/dfb/dfd/df9/fb6 [1520361,67855] 0 2024-09-19T09:35:05.215 INFO:tasks.workunit.client.1.smithi191.stdout:4/839: read d5/dfb/dfd/df9/f64 [1297333,1203] 0 2024-09-19T09:35:05.218 INFO:tasks.workunit.client.1.smithi191.stdout:6/641: rename d2/de/d2a/d84 to d2/de/d19/d1e/d64/d77/d82/dca 0 2024-09-19T09:35:05.219 INFO:tasks.workunit.client.1.smithi191.stdout:9/720: write d3/d60/f50 [1898540,61268] 0 2024-09-19T09:35:05.225 INFO:tasks.workunit.client.1.smithi191.stdout:7/723: dwrite d2/d2a/d33/f7c [0,4194304] 0 2024-09-19T09:35:05.225 INFO:tasks.workunit.client.1.smithi191.stdout:7/724: stat d2/l37 0 2024-09-19T09:35:05.225 INFO:tasks.workunit.client.1.smithi191.stdout:7/725: write d2/d2a/d38/d63/d9a/dd5/ff4 [418066,48832] 0 2024-09-19T09:35:05.225 INFO:tasks.workunit.client.1.smithi191.stdout:2/693: dwrite d8/f2f [0,4194304] 0 2024-09-19T09:35:05.227 INFO:tasks.workunit.client.1.smithi191.stdout:0/828: dwrite d0/dc5/dc1/fc9 [0,4194304] 0 2024-09-19T09:35:05.227 INFO:tasks.workunit.client.1.smithi191.stdout:0/829: fdatasync d0/d9/de/d61/dbf/fda 0 2024-09-19T09:35:05.227 INFO:tasks.workunit.client.1.smithi191.stdout:0/830: fdatasync d0/d6f/d7b/f6b 0 2024-09-19T09:35:05.228 INFO:tasks.workunit.client.1.smithi191.stdout:1/735: mkdir d3/d9/da/d1e/d32/d53/dd8/d113 0 2024-09-19T09:35:05.228 INFO:tasks.workunit.client.1.smithi191.stdout:1/736: truncate d3/d9/da/d1e/d25/f84 998543 0 2024-09-19T09:35:05.228 INFO:tasks.workunit.client.1.smithi191.stdout:1/737: chown d3/d9/da/f3b 2689 1 2024-09-19T09:35:05.228 INFO:tasks.workunit.client.1.smithi191.stdout:1/738: readlink d3/d9/da/d1e/d32/d6f/db2/ld6 0 2024-09-19T09:35:05.228 INFO:tasks.workunit.client.1.smithi191.stdout:3/652: mkdir d12/d13/dda/de3 0 2024-09-19T09:35:05.230 INFO:tasks.workunit.client.1.smithi191.stdout:8/864: creat d1/d22/f120 x:0 0 0 2024-09-19T09:35:05.231 INFO:tasks.workunit.client.1.smithi191.stdout:4/840: chown d5/dfb/dfd/d24/d32/d21/d5c/lba 3310250 1 2024-09-19T09:35:05.231 INFO:tasks.workunit.client.1.smithi191.stdout:4/841: write d5/d1b/d74/f10d [809310,4236] 0 2024-09-19T09:35:05.231 INFO:tasks.workunit.client.1.smithi191.stdout:4/842: fsync d5/dfb/dfd/df9/f64 0 2024-09-19T09:35:05.231 INFO:tasks.workunit.client.1.smithi191.stdout:4/843: chown d5/dfb/dfd/d24/d32/d21/d56/lae 8779 1 2024-09-19T09:35:05.231 INFO:tasks.workunit.client.1.smithi191.stdout:4/844: stat d5/d1b/faa 0 2024-09-19T09:35:05.233 INFO:tasks.workunit.client.1.smithi191.stdout:6/642: mknod d2/de/d19/d1e/d64/d61/d81/da7/ccb 0 2024-09-19T09:35:05.235 INFO:tasks.workunit.client.1.smithi191.stdout:7/726: mkdir d2/d39/dc7/deb/df9 0 2024-09-19T09:35:05.237 INFO:tasks.workunit.client.1.smithi191.stdout:2/694: creat d8/d2a/fed x:0 0 0 2024-09-19T09:35:05.237 INFO:tasks.workunit.client.1.smithi191.stdout:0/831: dread d0/d9/f25 [0,4194304] 0 2024-09-19T09:35:05.237 INFO:tasks.workunit.client.1.smithi191.stdout:0/832: truncate d0/dc5/dc1/fad 498793 0 2024-09-19T09:35:05.240 INFO:tasks.workunit.client.1.smithi191.stdout:1/739: getdents d3/d9/da/d1e/d32/d53/d57 0 2024-09-19T09:35:05.240 INFO:tasks.workunit.client.1.smithi191.stdout:1/740: getdents d3/d9/da/d1e/d32/d53/d57/d10e 0 2024-09-19T09:35:05.240 INFO:tasks.workunit.client.1.smithi191.stdout:1/741: creat d3/d9/da/d1e/d32/ddc/f114 x:0 0 0 2024-09-19T09:35:05.241 INFO:tasks.workunit.client.1.smithi191.stdout:1/742: fsync d3/d9/da/d1e/d25/ffe 0 2024-09-19T09:35:05.241 INFO:tasks.workunit.client.1.smithi191.stdout:1/743: fdatasync d3/d9/da/d1e/d25/d70/fa4 0 2024-09-19T09:35:05.241 INFO:tasks.workunit.client.1.smithi191.stdout:1/744: readlink d3/dd7/l106 0 2024-09-19T09:35:05.241 INFO:tasks.workunit.client.1.smithi191.stdout:1/745: fdatasync d3/d9/da/d1e/d32/d53/d57/d6d/da1/ffd 0 2024-09-19T09:35:05.241 INFO:tasks.workunit.client.1.smithi191.stdout:3/653: rmdir d12/d43/d61 39 2024-09-19T09:35:05.241 INFO:tasks.workunit.client.1.smithi191.stdout:6/643: truncate d2/de/d2a/f8e 3948644 0 2024-09-19T09:35:05.242 INFO:tasks.workunit.client.1.smithi191.stdout:6/644: readlink d2/de/d19/d1e/d64/lb3 0 2024-09-19T09:35:05.244 INFO:tasks.workunit.client.1.smithi191.stdout:9/721: rename d3/d8/c39 to d3/db/d53/dec/cfb 0 2024-09-19T09:35:05.244 INFO:tasks.workunit.client.1.smithi191.stdout:9/722: chown d3/db/d16/d38/d92 56331 1 2024-09-19T09:35:05.245 INFO:tasks.workunit.client.1.smithi191.stdout:9/723: readlink d3/db/l87 0 2024-09-19T09:35:05.246 INFO:tasks.workunit.client.1.smithi191.stdout:7/727: mknod d2/d39/d3a/cfa 0 2024-09-19T09:35:05.246 INFO:tasks.workunit.client.1.smithi191.stdout:4/845: dwrite d5/fd2 [0,4194304] 0 2024-09-19T09:35:05.247 INFO:tasks.workunit.client.1.smithi191.stdout:2/695: creat d8/d11/d98/fee x:0 0 0 2024-09-19T09:35:05.248 INFO:tasks.workunit.client.1.smithi191.stdout:0/833: write d0/d9/d1c/d1f/d24/d39/d58/f67 [2383815,6597] 0 2024-09-19T09:35:05.248 INFO:tasks.workunit.client.1.smithi191.stdout:0/834: fdatasync d0/d9/f4d 0 2024-09-19T09:35:05.250 INFO:tasks.workunit.client.1.smithi191.stdout:3/654: symlink d12/d13/d1a/d1b/d2e/dab/le4 0 2024-09-19T09:35:05.254 INFO:tasks.workunit.client.1.smithi191.stdout:8/865: rename d1/d7/d1a/f25 to d1/d16/d2e/d32/dc5/f121 0 2024-09-19T09:35:05.254 INFO:tasks.workunit.client.1.smithi191.stdout:7/728: dread d2/d39/d3a/d3c/f56 [0,4194304] 0 2024-09-19T09:35:05.259 INFO:tasks.workunit.client.1.smithi191.stdout:9/724: link d3/db/d53/da2/db3/fcf d3/db/d16/d17/ffc 0 2024-09-19T09:35:05.259 INFO:tasks.workunit.client.1.smithi191.stdout:9/725: creat d3/db/d16/d38/ffd x:0 0 0 2024-09-19T09:35:05.265 INFO:tasks.workunit.client.1.smithi191.stdout:9/726: dread d3/db/d16/d17/f85 [0,4194304] 0 2024-09-19T09:35:05.266 INFO:tasks.workunit.client.1.smithi191.stdout:9/727: getdents d3/db/d16/d17/d81 0 2024-09-19T09:35:05.266 INFO:tasks.workunit.client.1.smithi191.stdout:9/728: write d3/db/d16/d38/ffd [973238,57788] 0 2024-09-19T09:35:05.266 INFO:tasks.workunit.client.1.smithi191.stdout:0/835: link d0/d6f/d76/f88 d0/d9/d1c/d1f/d24/d39/d7a/f10a 0 2024-09-19T09:35:05.267 INFO:tasks.workunit.client.1.smithi191.stdout:1/746: rename d3/d9/da/fa3 to d3/d9/da/d1e/d32/d53/d57/d6d/df3/f115 0 2024-09-19T09:35:05.270 INFO:tasks.workunit.client.1.smithi191.stdout:0/836: mkdir d0/d9/d1c/d1f/d24/d39/d8b/ded/d10b 0 2024-09-19T09:35:05.271 INFO:tasks.workunit.client.1.smithi191.stdout:1/747: unlink d3/d9/da/d1e/d32/d53/d57/d6d/ff2 0 2024-09-19T09:35:05.272 INFO:tasks.workunit.client.1.smithi191.stdout:1/748: fdatasync d3/dd7/fb1 0 2024-09-19T09:35:05.274 INFO:tasks.workunit.client.1.smithi191.stdout:0/837: rename d0/d9/d1c/d1f/d24/d29/d30/c35 to d0/d9/d1c/d1f/d24/d29/d30/d56/c10c 0 2024-09-19T09:35:05.275 INFO:tasks.workunit.client.1.smithi191.stdout:1/749: creat d3/d9/da/d1e/d32/d53/f116 x:0 0 0 2024-09-19T09:35:05.276 INFO:tasks.workunit.client.1.smithi191.stdout:1/750: truncate d3/d9/da/f3b 4625292 0 2024-09-19T09:35:05.276 INFO:tasks.workunit.client.1.smithi191.stdout:1/751: chown d3/d9/da/d42/l10b 298447 1 2024-09-19T09:35:05.277 INFO:tasks.workunit.client.1.smithi191.stdout:1/752: mkdir d3/d9/da/d1e/d32/d53/d57/d111/d117 0 2024-09-19T09:35:05.278 INFO:tasks.workunit.client.1.smithi191.stdout:1/753: creat d3/d9/da/d1e/d32/d6f/db2/dd1/f118 x:0 0 0 2024-09-19T09:35:05.278 INFO:tasks.workunit.client.1.smithi191.stdout:1/754: dread - d3/d9/da/d7e/fc8 zero size 2024-09-19T09:35:05.279 INFO:tasks.workunit.client.1.smithi191.stdout:1/755: unlink d3/d9/da/d8c/d97/lca 0 2024-09-19T09:35:05.282 INFO:tasks.workunit.client.1.smithi191.stdout:1/756: rename d3/d9/da/d1e/d25/f29 to d3/d9/da/d1e/d32/d6f/db2/dfb/f119 0 2024-09-19T09:35:05.282 INFO:tasks.workunit.client.1.smithi191.stdout:1/757: truncate d3/d9/da/d8c/fcd 47560 0 2024-09-19T09:35:05.282 INFO:tasks.workunit.client.1.smithi191.stdout:1/758: creat d3/d9/da/d1e/d32/f11a x:0 0 0 2024-09-19T09:35:05.282 INFO:tasks.workunit.client.1.smithi191.stdout:1/759: fdatasync d3/d9/da/d1e/d25/f64 0 2024-09-19T09:35:05.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:04 smithi191 ceph-mon[34834]: pgmap v14: 65 pgs: 65 active+clean; 1.6 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 158 MiB/s rd, 210 MiB/s wr, 868 op/s 2024-09-19T09:35:05.287 INFO:tasks.workunit.client.1.smithi191.stdout:0/838: read d0/f34 [1804073,20515] 0 2024-09-19T09:35:05.290 INFO:tasks.workunit.client.1.smithi191.stdout:7/729: dwrite d2/d2a/d79/ff7 [0,4194304] 0 2024-09-19T09:35:05.291 INFO:tasks.workunit.client.1.smithi191.stdout:7/730: readlink d2/l41 0 2024-09-19T09:35:05.291 INFO:tasks.workunit.client.1.smithi191.stdout:7/731: chown d2/c26 23625 1 2024-09-19T09:35:05.291 INFO:tasks.workunit.client.1.smithi191.stdout:4/846: dwrite d5/dfb/dfd/d24/d32/d21/d56/f72 [0,4194304] 0 2024-09-19T09:35:05.291 INFO:tasks.workunit.client.1.smithi191.stdout:9/729: dwrite d3/db/d16/d17/d81/d8d/f98 [4194304,4194304] 0 2024-09-19T09:35:05.293 INFO:tasks.workunit.client.1.smithi191.stdout:2/696: dwrite d8/d11/d3f/d8a/d8f/f96 [0,4194304] 0 2024-09-19T09:35:05.293 INFO:tasks.workunit.client.1.smithi191.stdout:1/760: dread d3/d9/da/d1e/d25/ffe [0,4194304] 0 2024-09-19T09:35:05.294 INFO:tasks.workunit.client.1.smithi191.stdout:9/730: dread d3/db/d16/d17/d81/f8a [0,4194304] 0 2024-09-19T09:35:05.296 INFO:tasks.workunit.client.1.smithi191.stdout:7/732: rename d2/d39/dc7 to d2/d2a/d4f/d59/dfb 0 2024-09-19T09:35:05.297 INFO:tasks.workunit.client.1.smithi191.stdout:0/839: write d0/d9/d1c/d1f/d24/f90 [6353290,30219] 0 2024-09-19T09:35:05.299 INFO:tasks.workunit.client.1.smithi191.stdout:0/840: write d0/d9/d1c/deb/fc2 [4881822,19539] 0 2024-09-19T09:35:05.299 INFO:tasks.workunit.client.1.smithi191.stdout:0/841: read - d0/d6f/d76/f9d zero size 2024-09-19T09:35:05.305 INFO:tasks.workunit.client.1.smithi191.stdout:4/847: dwrite d5/dfb/dfd/d24/d32/d21/d56/fe5 [0,4194304] 0 2024-09-19T09:35:05.307 INFO:tasks.workunit.client.1.smithi191.stdout:2/697: chown d8/d11/ca0 2039871 1 2024-09-19T09:35:05.309 INFO:tasks.workunit.client.1.smithi191.stdout:1/761: mkdir d3/d9/d73/d11b 0 2024-09-19T09:35:05.309 INFO:tasks.workunit.client.1.smithi191.stdout:1/762: fsync d3/d9/f9c 0 2024-09-19T09:35:05.309 INFO:tasks.workunit.client.1.smithi191.stdout:9/731: write d3/db6/ffa [1590725,22883] 0 2024-09-19T09:35:05.310 INFO:tasks.workunit.client.1.smithi191.stdout:4/848: symlink d5/dfb/l10f 0 2024-09-19T09:35:05.312 INFO:tasks.workunit.client.1.smithi191.stdout:2/698: rename d8/d11/d3f/l6a to d8/db/d4d/lef 0 2024-09-19T09:35:05.313 INFO:tasks.workunit.client.1.smithi191.stdout:7/733: rmdir d2/d2a/d79/da8/db9 39 2024-09-19T09:35:05.314 INFO:tasks.workunit.client.1.smithi191.stdout:4/849: rename d5/d1b/d8e/dc9/cfc to d5/dfb/dfd/d24/d32/d8f/c110 0 2024-09-19T09:35:05.316 INFO:tasks.workunit.client.1.smithi191.stdout:2/699: mknod d8/db/d13/d23/cf0 0 2024-09-19T09:35:05.317 INFO:tasks.workunit.client.1.smithi191.stdout:7/734: mkdir d2/d5e/dfc 0 2024-09-19T09:35:05.319 INFO:tasks.workunit.client.1.smithi191.stdout:7/735: mknod d2/d2a/d4f/d78/cfd 0 2024-09-19T09:35:05.319 INFO:tasks.workunit.client.1.smithi191.stdout:7/736: write d2/d2a/d79/da8/fab [811812,87294] 0 2024-09-19T09:35:05.320 INFO:tasks.workunit.client.1.smithi191.stdout:7/737: chown d2/c25 359526079 1 2024-09-19T09:35:05.320 INFO:tasks.workunit.client.1.smithi191.stdout:7/738: truncate d2/d39/d3a/fe4 947187 0 2024-09-19T09:35:05.326 INFO:tasks.workunit.client.1.smithi191.stdout:4/850: write d5/dfb/dfd/d24/d32/d21/d92/fa8 [1962646,76759] 0 2024-09-19T09:35:05.330 INFO:tasks.workunit.client.1.smithi191.stdout:5/723: sync 2024-09-19T09:35:05.330 INFO:tasks.workunit.client.1.smithi191.stdout:5/724: fsync d0/d4/d9/d1d/d22/fbc 0 2024-09-19T09:35:05.330 INFO:tasks.workunit.client.1.smithi191.stdout:5/725: chown d0/d4/d9/d1d/d22/d3b/fba 20500 1 2024-09-19T09:35:05.333 INFO:tasks.workunit.client.1.smithi191.stdout:2/700: write d8/db/d13/f15 [2215082,53993] 0 2024-09-19T09:35:05.334 INFO:tasks.workunit.client.1.smithi191.stdout:2/701: getdents d8/d11/d3f/d8a/d8f 0 2024-09-19T09:35:05.335 INFO:tasks.workunit.client.1.smithi191.stdout:2/702: creat d8/d2a/dba/ff1 x:0 0 0 2024-09-19T09:35:05.335 INFO:tasks.workunit.client.1.smithi191.stdout:2/703: dread - d8/db/d41/fdb zero size 2024-09-19T09:35:05.336 INFO:tasks.workunit.client.1.smithi191.stdout:0/842: dwrite d0/d9/f9f [0,4194304] 0 2024-09-19T09:35:05.336 INFO:tasks.workunit.client.1.smithi191.stdout:2/704: creat d8/d11/ff2 x:0 0 0 2024-09-19T09:35:05.340 INFO:tasks.workunit.client.1.smithi191.stdout:0/843: creat d0/d9/d1c/d1f/d24/d39/d58/f10d x:0 0 0 2024-09-19T09:35:05.343 INFO:tasks.workunit.client.1.smithi191.stdout:0/844: link d0/d9/d1c/d1f/d24/d39/d7a/f10a d0/d9/de/d61/f10e 0 2024-09-19T09:35:05.347 INFO:tasks.workunit.client.1.smithi191.stdout:5/726: dread d0/d4/d9/de/ff [0,4194304] 0 2024-09-19T09:35:05.347 INFO:tasks.workunit.client.1.smithi191.stdout:0/845: write d0/d9/d1c/d1f/d24/f89 [806991,14690] 0 2024-09-19T09:35:05.347 INFO:tasks.workunit.client.1.smithi191.stdout:0/846: write d0/d9/d1c/d20/fa6 [740744,31479] 0 2024-09-19T09:35:05.348 INFO:tasks.workunit.client.1.smithi191.stdout:5/727: rename d0/d1f/f96 to d0/d4/d9/d1d/d29/d33/d45/d97/f104 0 2024-09-19T09:35:05.349 INFO:tasks.workunit.client.1.smithi191.stdout:5/728: dread - d0/da7/dcd/d102/fec zero size 2024-09-19T09:35:05.351 INFO:tasks.workunit.client.1.smithi191.stdout:1/763: dwrite d3/d9/da/d1e/d32/d53/f116 [0,4194304] 0 2024-09-19T09:35:05.351 INFO:tasks.workunit.client.1.smithi191.stdout:1/764: truncate d3/d9/da/d1e/d25/d70/fa4 367522 0 2024-09-19T09:35:05.351 INFO:tasks.workunit.client.1.smithi191.stdout:1/765: write d3/d9/da/d1e/d32/ddc/f114 [87573,16362] 0 2024-09-19T09:35:05.352 INFO:tasks.workunit.client.1.smithi191.stdout:1/766: readlink d3/d9/da/d1e/d32/d53/d57/d6d/da1/da7/lfc 0 2024-09-19T09:35:05.352 INFO:tasks.workunit.client.1.smithi191.stdout:9/732: dwrite d3/d8/fb2 [0,4194304] 0 2024-09-19T09:35:05.353 INFO:tasks.workunit.client.1.smithi191.stdout:9/733: read d3/d60/d78/fb8 [512042,57394] 0 2024-09-19T09:35:05.355 INFO:tasks.workunit.client.1.smithi191.stdout:7/739: dwrite d2/d39/d3a/d3c/fdb [0,4194304] 0 2024-09-19T09:35:05.356 INFO:tasks.workunit.client.1.smithi191.stdout:4/851: dwrite d5/dfb/dfd/d28/f48 [0,4194304] 0 2024-09-19T09:35:05.373 INFO:tasks.workunit.client.1.smithi191.stdout:5/729: dwrite d0/d4/d9/d1d/d29/d33/d45/d64/f6c [0,4194304] 0 2024-09-19T09:35:05.377 INFO:tasks.workunit.client.1.smithi191.stdout:5/730: dread d0/fa2 [0,4194304] 0 2024-09-19T09:35:05.406 INFO:tasks.workunit.client.1.smithi191.stdout:0/847: mkdir d0/d9/d1c/d1f/d24/d10f 0 2024-09-19T09:35:05.408 INFO:tasks.workunit.client.1.smithi191.stdout:1/767: symlink d3/d9/l11c 0 2024-09-19T09:35:05.411 INFO:tasks.workunit.client.1.smithi191.stdout:2/705: dwrite d8/d11/d3f/d8a/fae [4194304,4194304] 0 2024-09-19T09:35:05.429 INFO:tasks.workunit.client.1.smithi191.stdout:4/852: dwrite d5/dfb/dfd/d24/d32/d21/d4a/f51 [0,4194304] 0 2024-09-19T09:35:05.430 INFO:tasks.workunit.client.1.smithi191.stdout:1/768: dwrite d3/dd7/fc5 [0,4194304] 0 2024-09-19T09:35:05.454 INFO:tasks.workunit.client.1.smithi191.stdout:9/734: mkdir d3/db/d16/d17/d3c/dd0/dfe 0 2024-09-19T09:35:05.455 INFO:tasks.workunit.client.1.smithi191.stdout:9/735: write d3/db/d16/d47/f69 [792512,33094] 0 2024-09-19T09:35:05.455 INFO:tasks.workunit.client.1.smithi191.stdout:9/736: stat d3/db/d16/d47/d55/c8c 0 2024-09-19T09:35:05.457 INFO:tasks.workunit.client.1.smithi191.stdout:7/740: creat d2/d2a/d38/de5/ffe x:0 0 0 2024-09-19T09:35:05.457 INFO:tasks.workunit.client.1.smithi191.stdout:7/741: creat d2/d2a/d38/d63/d9a/dd5/fff x:0 0 0 2024-09-19T09:35:05.461 INFO:tasks.workunit.client.1.smithi191.stdout:5/731: mkdir d0/d4/d9/d1d/d22/d3b/db9/d105 0 2024-09-19T09:35:05.462 INFO:tasks.workunit.client.1.smithi191.stdout:0/848: creat d0/d9/de/d81/f110 x:0 0 0 2024-09-19T09:35:05.464 INFO:tasks.workunit.client.1.smithi191.stdout:9/737: write d3/d60/f58 [6076600,77146] 0 2024-09-19T09:35:05.464 INFO:tasks.workunit.client.1.smithi191.stdout:9/738: truncate d3/db/d53/da2/db3/fcf 79940 0 2024-09-19T09:35:05.464 INFO:tasks.workunit.client.1.smithi191.stdout:9/739: write d3/db/d16/d38/f48 [2018052,120742] 0 2024-09-19T09:35:05.464 INFO:tasks.workunit.client.1.smithi191.stdout:2/706: mknod d8/d11/d3f/d8a/d8f/cf3 0 2024-09-19T09:35:05.464 INFO:tasks.workunit.client.1.smithi191.stdout:2/707: chown d8/f2f 30 1 2024-09-19T09:35:05.468 INFO:tasks.workunit.client.1.smithi191.stdout:5/732: dread d0/d4/d9/d1d/d28/d53/f70 [0,4194304] 0 2024-09-19T09:35:05.468 INFO:tasks.workunit.client.1.smithi191.stdout:4/853: mknod d5/dfb/dfd/d24/d82/df2/d19/c111 0 2024-09-19T09:35:05.470 INFO:tasks.workunit.client.1.smithi191.stdout:5/733: dread d0/d4/d4a/f98 [0,4194304] 0 2024-09-19T09:35:05.470 INFO:tasks.workunit.client.1.smithi191.stdout:5/734: write d0/d4/d9/d1d/d28/f31 [6186670,128891] 0 2024-09-19T09:35:05.473 INFO:tasks.workunit.client.1.smithi191.stdout:6/645: sync 2024-09-19T09:35:05.474 INFO:tasks.workunit.client.1.smithi191.stdout:9/740: rmdir d3/db/d53/dee 39 2024-09-19T09:35:05.476 INFO:tasks.workunit.client.1.smithi191.stdout:2/708: creat d8/db/ff4 x:0 0 0 2024-09-19T09:35:05.476 INFO:tasks.workunit.client.1.smithi191.stdout:3/655: sync 2024-09-19T09:35:05.477 INFO:tasks.workunit.client.1.smithi191.stdout:1/769: getdents d3 0 2024-09-19T09:35:05.478 INFO:tasks.workunit.client.1.smithi191.stdout:8/866: sync 2024-09-19T09:35:05.478 INFO:tasks.workunit.client.1.smithi191.stdout:8/867: chown d1/d16/d3c/l50 8 1 2024-09-19T09:35:05.480 INFO:tasks.workunit.client.1.smithi191.stdout:9/741: creat d3/db/d16/d17/d81/fff x:0 0 0 2024-09-19T09:35:05.483 INFO:tasks.workunit.client.1.smithi191.stdout:0/849: rename d0/d9/d1c/d1f/d24/d39/d58 to d0/d9/d1c/d111 0 2024-09-19T09:35:05.487 INFO:tasks.workunit.client.1.smithi191.stdout:4/854: dwrite d5/dfb/dfd/d24/d82/df2/f47 [0,4194304] 0 2024-09-19T09:35:05.487 INFO:tasks.workunit.client.1.smithi191.stdout:4/855: write d5/dfb/dfd/d24/d32/f13 [1585933,130050] 0 2024-09-19T09:35:05.487 INFO:tasks.workunit.client.1.smithi191.stdout:4/856: write d5/dfb/dfd/df9/f64 [3080138,58071] 0 2024-09-19T09:35:05.487 INFO:tasks.workunit.client.1.smithi191.stdout:8/868: creat d1/d7/dc2/f122 x:0 0 0 2024-09-19T09:35:05.488 INFO:tasks.workunit.client.1.smithi191.stdout:4/857: truncate d5/dfb/dfd/d24/d32/d21/d5c/fb1 5042264 0 2024-09-19T09:35:05.489 INFO:tasks.workunit.client.1.smithi191.stdout:3/656: read d12/d13/d1a/d1b/d60/f8d [301005,57939] 0 2024-09-19T09:35:05.489 INFO:tasks.workunit.client.1.smithi191.stdout:5/735: dread d0/d4/d4a/f4b [0,4194304] 0 2024-09-19T09:35:05.489 INFO:tasks.workunit.client.1.smithi191.stdout:3/657: fdatasync d12/d13/d1a/d1b/d2e/dab/d51/dcd/fe0 0 2024-09-19T09:35:05.492 INFO:tasks.workunit.client.1.smithi191.stdout:7/742: dwrite d2/d2a/d33/f5d [0,4194304] 0 2024-09-19T09:35:05.492 INFO:tasks.workunit.client.1.smithi191.stdout:4/858: truncate d5/f4e 2232182 0 2024-09-19T09:35:05.494 INFO:tasks.workunit.client.1.smithi191.stdout:0/850: dread d0/d9/d1c/fd8 [0,4194304] 0 2024-09-19T09:35:05.494 INFO:tasks.workunit.client.1.smithi191.stdout:4/859: write d5/dfb/dfd/d28/fbd [268372,101157] 0 2024-09-19T09:35:05.494 INFO:tasks.workunit.client.1.smithi191.stdout:5/736: creat d0/d4/d4a/f106 x:0 0 0 2024-09-19T09:35:05.495 INFO:tasks.workunit.client.1.smithi191.stdout:3/658: creat d12/d43/d61/d98/dc4/fe5 x:0 0 0 2024-09-19T09:35:05.497 INFO:tasks.workunit.client.1.smithi191.stdout:4/860: dread d5/d38/d73/d8d/fc0 [0,4194304] 0 2024-09-19T09:35:05.500 INFO:tasks.workunit.client.1.smithi191.stdout:7/743: link d2/d2a/d33/f54 d2/d2a/d38/f100 0 2024-09-19T09:35:05.500 INFO:tasks.workunit.client.1.smithi191.stdout:0/851: mkdir d0/d9/d1c/d1f/d24/d29/d30/d112 0 2024-09-19T09:35:05.500 INFO:tasks.workunit.client.1.smithi191.stdout:5/737: creat d0/d4/f107 x:0 0 0 2024-09-19T09:35:05.500 INFO:tasks.workunit.client.1.smithi191.stdout:0/852: creat d0/d9/d1c/d20/f113 x:0 0 0 2024-09-19T09:35:05.500 INFO:tasks.workunit.client.1.smithi191.stdout:4/861: symlink d5/dfb/dfd/d24/d32/d21/d5c/d8c/l112 0 2024-09-19T09:35:05.500 INFO:tasks.workunit.client.1.smithi191.stdout:4/862: fsync d5/d1b/fee 0 2024-09-19T09:35:05.503 INFO:tasks.workunit.client.1.smithi191.stdout:7/744: rename d2/d39/d3a/d9c/cd1 to d2/d2a/d38/d63/d9a/c101 0 2024-09-19T09:35:05.503 INFO:tasks.workunit.client.1.smithi191.stdout:7/745: chown d2/d2a/d38/d63/d9a/f8d 1860 1 2024-09-19T09:35:05.506 INFO:tasks.workunit.client.1.smithi191.stdout:7/746: unlink d2/d2a/d38/d63/da2/fc3 0 2024-09-19T09:35:05.512 INFO:tasks.workunit.client.1.smithi191.stdout:7/747: dread d2/d2a/f74 [0,4194304] 0 2024-09-19T09:35:05.513 INFO:tasks.workunit.client.1.smithi191.stdout:7/748: write d2/f40 [2587706,119594] 0 2024-09-19T09:35:05.514 INFO:tasks.workunit.client.1.smithi191.stdout:7/749: creat d2/d5e/dfc/f102 x:0 0 0 2024-09-19T09:35:05.515 INFO:tasks.workunit.client.1.smithi191.stdout:7/750: link d2/faa d2/d2a/d38/d63/dc1/f103 0 2024-09-19T09:35:05.526 INFO:tasks.workunit.client.1.smithi191.stdout:7/751: write d2/f1d [4077470,66765] 0 2024-09-19T09:35:05.527 INFO:tasks.workunit.client.1.smithi191.stdout:7/752: creat d2/d2a/d38/d63/dc1/f104 x:0 0 0 2024-09-19T09:35:05.527 INFO:tasks.workunit.client.1.smithi191.stdout:7/753: fdatasync d2/fe9 0 2024-09-19T09:35:05.528 INFO:tasks.workunit.client.1.smithi191.stdout:7/754: mkdir d2/d2a/d38/de5/d105 0 2024-09-19T09:35:05.530 INFO:tasks.workunit.client.1.smithi191.stdout:7/755: creat d2/d2a/d4f/d59/dfb/f106 x:0 0 0 2024-09-19T09:35:05.530 INFO:tasks.workunit.client.1.smithi191.stdout:7/756: write d2/d39/d3a/fe4 [1651437,66094] 0 2024-09-19T09:35:05.530 INFO:tasks.workunit.client.1.smithi191.stdout:7/757: stat d2/d2a/d4f/d59/dfb/deb/df9 0 2024-09-19T09:35:05.530 INFO:tasks.workunit.client.1.smithi191.stdout:2/709: dwrite d8/d11/fac [0,4194304] 0 2024-09-19T09:35:05.531 INFO:tasks.workunit.client.1.smithi191.stdout:2/710: write d8/db/d13/fdf [57566,2166] 0 2024-09-19T09:35:05.532 INFO:tasks.workunit.client.1.smithi191.stdout:7/758: rename d2/l14 to d2/d2a/d4f/d59/dfb/l107 0 2024-09-19T09:35:05.532 INFO:tasks.workunit.client.1.smithi191.stdout:7/759: readlink d2/d2a/d4f/d59/l8b 0 2024-09-19T09:35:05.533 INFO:tasks.workunit.client.1.smithi191.stdout:2/711: rename d8/db/d41/cb2 to d8/db/d4d/de6/d70/de8/cf5 0 2024-09-19T09:35:05.534 INFO:tasks.workunit.client.1.smithi191.stdout:2/712: creat d8/d2a/dba/dcc/ff6 x:0 0 0 2024-09-19T09:35:05.535 INFO:tasks.workunit.client.1.smithi191.stdout:5/738: dwrite d0/d4/d9/d1d/d29/d33/d45/d97/ddf/ffa [0,4194304] 0 2024-09-19T09:35:05.535 INFO:tasks.workunit.client.1.smithi191.stdout:9/742: dwrite d3/d8/f86 [0,4194304] 0 2024-09-19T09:35:05.535 INFO:tasks.workunit.client.1.smithi191.stdout:9/743: stat d3/db/d53/da2/db3/cca 0 2024-09-19T09:35:05.535 INFO:tasks.workunit.client.1.smithi191.stdout:2/713: mknod d8/db/d4d/de6/cf7 0 2024-09-19T09:35:05.536 INFO:tasks.workunit.client.1.smithi191.stdout:0/853: dwrite d0/d9/f109 [0,4194304] 0 2024-09-19T09:35:05.536 INFO:tasks.workunit.client.1.smithi191.stdout:0/854: truncate d0/d9/fb8 175753 0 2024-09-19T09:35:05.536 INFO:tasks.workunit.client.1.smithi191.stdout:6/646: dwrite d2/de/d19/d1e/d64/f8f [0,4194304] 0 2024-09-19T09:35:05.536 INFO:tasks.workunit.client.1.smithi191.stdout:1/770: dwrite d3/d9/da/d1e/d32/d53/f9d [0,4194304] 0 2024-09-19T09:35:05.539 INFO:tasks.workunit.client.1.smithi191.stdout:9/744: creat d3/db/d16/d17/d81/da6/f100 x:0 0 0 2024-09-19T09:35:05.539 INFO:tasks.workunit.client.1.smithi191.stdout:9/745: read - d3/db/d53/da2/db3/ff5 zero size 2024-09-19T09:35:05.540 INFO:tasks.workunit.client.1.smithi191.stdout:7/760: write d2/d2a/d4f/d59/d81/f9b [1982532,104666] 0 2024-09-19T09:35:05.540 INFO:tasks.workunit.client.1.smithi191.stdout:7/761: write d2/d2a/d79/da8/db9/fdd [403851,15715] 0 2024-09-19T09:35:05.540 INFO:tasks.workunit.client.1.smithi191.stdout:7/762: chown d2/d2a/d33/l4c 630740 1 2024-09-19T09:35:05.540 INFO:tasks.workunit.client.1.smithi191.stdout:8/869: rmdir d1/d7/dc2 39 2024-09-19T09:35:05.542 INFO:tasks.workunit.client.1.smithi191.stdout:9/746: dread d3/d60/faa [0,4194304] 0 2024-09-19T09:35:05.543 INFO:tasks.workunit.client.1.smithi191.stdout:0/855: mkdir d0/d9/d1c/d1f/d24/d53/d114 0 2024-09-19T09:35:05.544 INFO:tasks.workunit.client.1.smithi191.stdout:6/647: dread d2/de/d15/f36 [0,4194304] 0 2024-09-19T09:35:05.544 INFO:tasks.workunit.client.1.smithi191.stdout:6/648: dread - d2/de/d2a/d39/f62 zero size 2024-09-19T09:35:05.544 INFO:tasks.workunit.client.1.smithi191.stdout:6/649: truncate d2/de/d19/d1e/d64/d76/fab 402102 0 2024-09-19T09:35:05.549 INFO:tasks.workunit.client.1.smithi191.stdout:2/714: write d8/db/d13/d23/f78 [3888963,120302] 0 2024-09-19T09:35:05.550 INFO:tasks.workunit.client.1.smithi191.stdout:0/856: dread d0/d9/d1c/d1f/d24/d39/d7a/fae [0,4194304] 0 2024-09-19T09:35:05.557 INFO:tasks.workunit.client.1.smithi191.stdout:5/739: link d0/d4/d9/d1d/d29/d33/d45/l49 d0/d4/d9/d1d/d29/d33/d45/d97/l108 0 2024-09-19T09:35:05.560 INFO:tasks.workunit.client.1.smithi191.stdout:9/747: dwrite d3/db/d16/f7e [0,4194304] 0 2024-09-19T09:35:05.579 INFO:tasks.workunit.client.1.smithi191.stdout:9/748: dwrite d3/db/d16/d17/d3c/dd0/fe3 [0,4194304] 0 2024-09-19T09:35:05.580 INFO:tasks.workunit.client.1.smithi191.stdout:9/749: stat d3/db/d16/d17/d3c/dd0/fe3 0 2024-09-19T09:35:05.580 INFO:tasks.workunit.client.1.smithi191.stdout:9/750: write d3/d8/f22 [964855,4876] 0 2024-09-19T09:35:05.589 INFO:tasks.workunit.client.1.smithi191.stdout:7/763: symlink d2/d2a/d79/d7f/l108 0 2024-09-19T09:35:05.590 INFO:tasks.workunit.client.1.smithi191.stdout:7/764: write d2/d39/f4b [886335,98955] 0 2024-09-19T09:35:05.594 INFO:tasks.workunit.client.1.smithi191.stdout:6/650: mkdir d2/de/d2a/d2d/d30/d98/d9b/d65/dcc 0 2024-09-19T09:35:05.595 INFO:tasks.workunit.client.1.smithi191.stdout:9/751: dwrite d3/db/f9b [0,4194304] 0 2024-09-19T09:35:05.596 INFO:tasks.workunit.client.1.smithi191.stdout:8/870: write d1/d16/d3c/d28/fb7 [1388340,33647] 0 2024-09-19T09:35:05.598 INFO:tasks.workunit.client.1.smithi191.stdout:0/857: rename d0/dc5/dc1/fc9 to d0/d9/d1c/d1f/d24/d87/de1/f115 0 2024-09-19T09:35:05.598 INFO:tasks.workunit.client.1.smithi191.stdout:0/858: chown d0/d9/d1c/d1f/d24/f89 232489956 1 2024-09-19T09:35:05.601 INFO:tasks.workunit.client.1.smithi191.stdout:5/740: mkdir d0/d4/d9/d1d/d29/d33/d45/d97/d109 0 2024-09-19T09:35:05.618 INFO:tasks.workunit.client.1.smithi191.stdout:0/859: dwrite d0/d9/d1c/d1f/d24/d39/fac [0,4194304] 0 2024-09-19T09:35:05.618 INFO:tasks.workunit.client.1.smithi191.stdout:0/860: stat d0/d9/d1c/d20/l41 0 2024-09-19T09:35:05.618 INFO:tasks.workunit.client.1.smithi191.stdout:0/861: fdatasync d0/d9/d1c/d1f/d24/d39/fac 0 2024-09-19T09:35:05.667 INFO:tasks.workunit.client.1.smithi191.stdout:7/765: creat d2/d2a/d38/def/f109 x:0 0 0 2024-09-19T09:35:05.668 INFO:tasks.workunit.client.1.smithi191.stdout:6/651: getdents d2/de/d19/d1e/d64 0 2024-09-19T09:35:05.672 INFO:tasks.workunit.client.1.smithi191.stdout:2/715: rmdir d8/d11/d98 39 2024-09-19T09:35:05.674 INFO:tasks.workunit.client.1.smithi191.stdout:8/871: mknod d1/d7/d1a/d6d/de1/d6b/d83/d98/de5/c123 0 2024-09-19T09:35:05.676 INFO:tasks.workunit.client.1.smithi191.stdout:5/741: truncate d0/d4/d9/d1d/d29/d33/d45/fbb 211241 0 2024-09-19T09:35:05.678 INFO:tasks.workunit.client.1.smithi191.stdout:0/862: creat d0/d9/d1c/d1f/d24/d29/d30/d56/d103/f116 x:0 0 0 2024-09-19T09:35:05.679 INFO:tasks.workunit.client.1.smithi191.stdout:7/766: symlink d2/d39/d3a/d3c/l10a 0 2024-09-19T09:35:05.679 INFO:tasks.workunit.client.1.smithi191.stdout:7/767: fdatasync d2/d2a/f74 0 2024-09-19T09:35:05.681 INFO:tasks.workunit.client.1.smithi191.stdout:6/652: symlink d2/de/d19/d1e/d64/d77/lcd 0 2024-09-19T09:35:05.683 INFO:tasks.workunit.client.1.smithi191.stdout:2/716: link d8/d11/d3f/d64/ce3 d8/db/d13/d40/da8/cf8 0 2024-09-19T09:35:05.683 INFO:tasks.workunit.client.1.smithi191.stdout:2/717: write d8/d2a/f61 [4384768,2961] 0 2024-09-19T09:35:05.684 INFO:tasks.workunit.client.1.smithi191.stdout:2/718: read d8/db/d13/fdf [10689,79398] 0 2024-09-19T09:35:05.685 INFO:tasks.workunit.client.1.smithi191.stdout:8/872: rename d1/d16/d3c/d17/da1/d84/lf4 to d1/d16/d2e/d32/d7e/d8b/l124 0 2024-09-19T09:35:05.686 INFO:tasks.workunit.client.1.smithi191.stdout:8/873: creat d1/d7/d1a/d6d/de1/d6b/d83/f125 x:0 0 0 2024-09-19T09:35:05.686 INFO:tasks.workunit.client.1.smithi191.stdout:8/874: dread - d1/d16/d3c/d17/da1/d84/fe4 zero size 2024-09-19T09:35:05.687 INFO:tasks.workunit.client.1.smithi191.stdout:0/863: mkdir d0/d9/d1c/d1f/d24/d87/dd0/d117 0 2024-09-19T09:35:05.692 INFO:tasks.workunit.client.1.smithi191.stdout:2/719: rename d8/db/fb6 to d8/d2a/dba/dcc/ff9 0 2024-09-19T09:35:05.697 INFO:tasks.workunit.client.1.smithi191.stdout:2/720: unlink d8/db/d41/ca2 0 2024-09-19T09:35:05.699 INFO:tasks.workunit.client.1.smithi191.stdout:2/721: mkdir d8/d11/d3f/dfa 0 2024-09-19T09:35:05.699 INFO:tasks.workunit.client.1.smithi191.stdout:2/722: write d8/db/d13/d23/f78 [4644630,66351] 0 2024-09-19T09:35:05.699 INFO:tasks.workunit.client.1.smithi191.stdout:2/723: chown d8/db/d13/d23/cf0 18 1 2024-09-19T09:35:05.703 INFO:tasks.workunit.client.1.smithi191.stdout:4/863: sync 2024-09-19T09:35:05.703 INFO:tasks.workunit.client.1.smithi191.stdout:3/659: sync 2024-09-19T09:35:05.703 INFO:tasks.workunit.client.1.smithi191.stdout:3/660: write d12/d13/d1a/f57 [1201878,76263] 0 2024-09-19T09:35:05.705 INFO:tasks.workunit.client.1.smithi191.stdout:4/864: creat d5/dfb/dfd/d24/d32/d21/d56/d86/d100/f113 x:0 0 0 2024-09-19T09:35:05.706 INFO:tasks.workunit.client.1.smithi191.stdout:4/865: truncate d5/d1b/f10a 735077 0 2024-09-19T09:35:05.706 INFO:tasks.workunit.client.1.smithi191.stdout:4/866: stat d5/d38/c68 0 2024-09-19T09:35:05.706 INFO:tasks.workunit.client.1.smithi191.stdout:4/867: symlink d5/dfb/dfd/d24/d32/d8f/l114 0 2024-09-19T09:35:05.706 INFO:tasks.workunit.client.1.smithi191.stdout:4/868: fsync d5/fa 0 2024-09-19T09:35:05.710 INFO:tasks.workunit.client.1.smithi191.stdout:4/869: dread d5/dfb/dfd/d24/d32/d21/d4a/dc5/de3/fef [0,4194304] 0 2024-09-19T09:35:05.710 INFO:tasks.workunit.client.1.smithi191.stdout:4/870: chown d5/d38/da5/fd5 0 1 2024-09-19T09:35:05.711 INFO:tasks.workunit.client.1.smithi191.stdout:4/871: readlink d5/dfb/dfd/d24/d82/df2/d19/lf 0 2024-09-19T09:35:05.712 INFO:tasks.workunit.client.1.smithi191.stdout:6/653: dwrite d2/f34 [4194304,4194304] 0 2024-09-19T09:35:05.712 INFO:tasks.workunit.client.1.smithi191.stdout:6/654: read - d2/de/d19/d1e/fbf zero size 2024-09-19T09:35:05.712 INFO:tasks.workunit.client.1.smithi191.stdout:6/655: fdatasync d2/de/d19/d1e/fb6 0 2024-09-19T09:35:05.712 INFO:tasks.workunit.client.1.smithi191.stdout:6/656: getdents d2/de/d2a/d2d/d30 0 2024-09-19T09:35:05.713 INFO:tasks.workunit.client.1.smithi191.stdout:4/872: rename d5/dfb/dfd/d24/d32/f13 to d5/dfb/dfd/df9/d88/f115 0 2024-09-19T09:35:05.713 INFO:tasks.workunit.client.1.smithi191.stdout:4/873: chown d5/dfb/dfd/d28/ded 1 1 2024-09-19T09:35:05.715 INFO:tasks.workunit.client.1.smithi191.stdout:8/875: dwrite d1/d7/dc2/f122 [0,4194304] 0 2024-09-19T09:35:05.715 INFO:tasks.workunit.client.1.smithi191.stdout:3/661: write d12/d13/d1a/d1b/d3c/d3f/f4d [869814,93251] 0 2024-09-19T09:35:05.715 INFO:tasks.workunit.client.1.smithi191.stdout:5/742: dwrite d0/d4/d9/d1d/d22/d3b/f7a [0,4194304] 0 2024-09-19T09:35:05.716 INFO:tasks.workunit.client.1.smithi191.stdout:3/662: write d12/d13/d1a/d1b/d2e/dab/d3d/f6a [475100,55885] 0 2024-09-19T09:35:05.717 INFO:tasks.workunit.client.1.smithi191.stdout:4/874: mkdir d5/dfb/dfd/d24/d32/d21/d56/d116 0 2024-09-19T09:35:05.724 INFO:tasks.workunit.client.1.smithi191.stdout:6/657: read d2/de/d2a/f8e [28703,20350] 0 2024-09-19T09:35:05.727 INFO:tasks.workunit.client.1.smithi191.stdout:8/876: truncate d1/d16/d3c/d17/da1/d84/f9b 97622 0 2024-09-19T09:35:05.727 INFO:tasks.workunit.client.1.smithi191.stdout:5/743: dread d0/d4/d9/f59 [0,4194304] 0 2024-09-19T09:35:05.729 INFO:tasks.workunit.client.1.smithi191.stdout:4/875: rmdir d5/dfb/dfd/d28/ded 0 2024-09-19T09:35:05.730 INFO:tasks.workunit.client.1.smithi191.stdout:6/658: creat d2/de/d2a/dc9/fce x:0 0 0 2024-09-19T09:35:05.730 INFO:tasks.workunit.client.1.smithi191.stdout:6/659: chown d2/de/d19/d1e/c38 3 1 2024-09-19T09:35:05.730 INFO:tasks.workunit.client.1.smithi191.stdout:6/660: write d2/de/d19/d1e/fba [553006,57610] 0 2024-09-19T09:35:05.731 INFO:tasks.workunit.client.1.smithi191.stdout:8/877: symlink d1/d7/dcc/l126 0 2024-09-19T09:35:05.733 INFO:tasks.workunit.client.1.smithi191.stdout:5/744: mknod d0/da7/dcd/d102/c10a 0 2024-09-19T09:35:05.734 INFO:tasks.workunit.client.1.smithi191.stdout:4/876: symlink d5/dfb/dfd/d24/d32/d21/d92/l117 0 2024-09-19T09:35:05.735 INFO:tasks.workunit.client.1.smithi191.stdout:8/878: creat d1/d7/d1a/d6d/de1/d6b/da9/f127 x:0 0 0 2024-09-19T09:35:05.736 INFO:tasks.workunit.client.1.smithi191.stdout:5/745: mkdir d0/d4/d9/d1d/d22/d3b/db9/d105/d10b 0 2024-09-19T09:35:05.737 INFO:tasks.workunit.client.1.smithi191.stdout:4/877: mkdir d5/dfb/dfd/df9/d88/d118 0 2024-09-19T09:35:05.737 INFO:tasks.workunit.client.1.smithi191.stdout:4/878: chown d5/dfb/dfd/d24/d82/df2/d19/c43 0 1 2024-09-19T09:35:05.738 INFO:tasks.workunit.client.1.smithi191.stdout:4/879: chown d5/d1b/f10a 1 1 2024-09-19T09:35:05.739 INFO:tasks.workunit.client.1.smithi191.stdout:8/879: symlink d1/d22/d47/l128 0 2024-09-19T09:35:05.739 INFO:tasks.workunit.client.1.smithi191.stdout:8/880: fsync d1/d16/d3c/d28/fb7 0 2024-09-19T09:35:05.739 INFO:tasks.workunit.client.1.smithi191.stdout:3/663: dread d12/d13/f14 [4194304,4194304] 0 2024-09-19T09:35:05.739 INFO:tasks.workunit.client.1.smithi191.stdout:2/724: dwrite f6 [0,4194304] 0 2024-09-19T09:35:05.739 INFO:tasks.workunit.client.1.smithi191.stdout:2/725: readlink d8/db/d13/d23/l1a 0 2024-09-19T09:35:05.739 INFO:tasks.workunit.client.1.smithi191.stdout:2/726: write d8/d11/f8e [859623,107198] 0 2024-09-19T09:35:05.740 INFO:tasks.workunit.client.1.smithi191.stdout:8/881: symlink d1/d22/d47/d9d/df1/df8/l129 0 2024-09-19T09:35:05.742 INFO:tasks.workunit.client.1.smithi191.stdout:5/746: rmdir d0/d4/d9/d1d/d29 39 2024-09-19T09:35:05.744 INFO:tasks.workunit.client.1.smithi191.stdout:2/727: symlink d8/db/d4e/lfb 0 2024-09-19T09:35:05.744 INFO:tasks.workunit.client.1.smithi191.stdout:2/728: fsync d8/db/d13/d23/f43 0 2024-09-19T09:35:05.744 INFO:tasks.workunit.client.1.smithi191.stdout:2/729: chown d8/db/d41/fdd 2934910 1 2024-09-19T09:35:05.745 INFO:tasks.workunit.client.1.smithi191.stdout:9/752: link d3/l12 d3/db/l101 0 2024-09-19T09:35:05.745 INFO:tasks.workunit.client.1.smithi191.stdout:8/882: chown d1/d16/d3c/d28/f33 3666756 1 2024-09-19T09:35:05.747 INFO:tasks.workunit.client.1.smithi191.stdout:5/747: link d0/d4/d9/d1d/d28/d53/f70 d0/d4/dae/f10c 0 2024-09-19T09:35:05.748 INFO:tasks.workunit.client.1.smithi191.stdout:9/753: mkdir d3/d60/d78/d102 0 2024-09-19T09:35:05.749 INFO:tasks.workunit.client.1.smithi191.stdout:8/883: mkdir d1/d7/d1a/d6d/d12a 0 2024-09-19T09:35:05.750 INFO:tasks.workunit.client.1.smithi191.stdout:5/748: getdents d0/d4/d4a/db4 0 2024-09-19T09:35:05.750 INFO:tasks.workunit.client.1.smithi191.stdout:5/749: write d0/d4/f37 [4994912,5163] 0 2024-09-19T09:35:05.750 INFO:tasks.workunit.client.1.smithi191.stdout:5/750: truncate d0/d4/d9/f7b 1035709 0 2024-09-19T09:35:05.752 INFO:tasks.workunit.client.1.smithi191.stdout:9/754: creat d3/db/de6/f103 x:0 0 0 2024-09-19T09:35:05.752 INFO:tasks.workunit.client.1.smithi191.stdout:4/880: dwrite d5/dfb/dfd/d24/d32/d21/d56/d86/d100/f113 [0,4194304] 0 2024-09-19T09:35:05.752 INFO:tasks.workunit.client.1.smithi191.stdout:9/755: write d3/db/d53/fd3 [1005500,106354] 0 2024-09-19T09:35:05.752 INFO:tasks.workunit.client.1.smithi191.stdout:4/881: write d5/dfb/dfd/d24/d32/d8f/fbe [1181215,64530] 0 2024-09-19T09:35:05.753 INFO:tasks.workunit.client.1.smithi191.stdout:5/751: unlink d0/d4/d9/d1d/d29/lab 0 2024-09-19T09:35:05.754 INFO:tasks.workunit.client.1.smithi191.stdout:2/730: dread d8/db/d13/d40/f52 [0,4194304] 0 2024-09-19T09:35:05.757 INFO:tasks.workunit.client.1.smithi191.stdout:9/756: creat d3/db/d16/d17/d81/d8d/f104 x:0 0 0 2024-09-19T09:35:05.757 INFO:tasks.workunit.client.1.smithi191.stdout:3/664: creat d12/d13/d1a/d1b/fe6 x:0 0 0 2024-09-19T09:35:05.757 INFO:tasks.workunit.client.1.smithi191.stdout:3/665: dread - d12/d43/db2/fd4 zero size 2024-09-19T09:35:05.757 INFO:tasks.workunit.client.1.smithi191.stdout:3/666: readlink d12/d13/d1a/d1b/d2e/dab/d3d/la4 0 2024-09-19T09:35:05.758 INFO:tasks.workunit.client.1.smithi191.stdout:5/752: symlink d0/d4/l10d 0 2024-09-19T09:35:05.758 INFO:tasks.workunit.client.1.smithi191.stdout:5/753: fsync d0/d4/d4a/f5f 0 2024-09-19T09:35:05.759 INFO:tasks.workunit.client.1.smithi191.stdout:2/731: mkdir d8/d11/d3f/dfa/dfc 0 2024-09-19T09:35:05.762 INFO:tasks.workunit.client.1.smithi191.stdout:5/754: dread d0/d4/d9/f59 [0,4194304] 0 2024-09-19T09:35:05.766 INFO:tasks.workunit.client.1.smithi191.stdout:8/884: dwrite d1/d22/d47/f10b [0,4194304] 0 2024-09-19T09:35:05.766 INFO:tasks.workunit.client.1.smithi191.stdout:4/882: dread d5/dfb/dfd/d24/d32/f1e [0,4194304] 0 2024-09-19T09:35:05.766 INFO:tasks.workunit.client.1.smithi191.stdout:8/885: chown d1/d7/dc2/f122 40 1 2024-09-19T09:35:05.767 INFO:tasks.workunit.client.1.smithi191.stdout:8/886: chown d1/d7/ce8 626614812 1 2024-09-19T09:35:05.767 INFO:tasks.workunit.client.1.smithi191.stdout:8/887: chown d1/d16/d2e/d32/d7e/d8b/l124 5278 1 2024-09-19T09:35:05.767 INFO:tasks.workunit.client.1.smithi191.stdout:3/667: mkdir d12/d13/de7 0 2024-09-19T09:35:05.767 INFO:tasks.workunit.client.1.smithi191.stdout:3/668: fsync d12/d13/d1a/d5d/dd1/fd3 0 2024-09-19T09:35:05.767 INFO:tasks.workunit.client.1.smithi191.stdout:3/669: stat d12/d43/ca8 0 2024-09-19T09:35:05.768 INFO:tasks.workunit.client.1.smithi191.stdout:3/670: readlink d12/d13/d1a/d1b/d2e/dab/d51/d62/d85/da0/la3 0 2024-09-19T09:35:05.768 INFO:tasks.workunit.client.1.smithi191.stdout:5/755: mkdir d0/da7/de6/d10e 0 2024-09-19T09:35:05.770 INFO:tasks.workunit.client.1.smithi191.stdout:8/888: mknod d1/d22/d47/d9d/df1/df8/c12b 0 2024-09-19T09:35:05.771 INFO:tasks.workunit.client.1.smithi191.stdout:3/671: creat d12/d13/dda/de3/fe8 x:0 0 0 2024-09-19T09:35:05.771 INFO:tasks.workunit.client.1.smithi191.stdout:3/672: write d12/d13/d1a/d1b/f36 [202077,113537] 0 2024-09-19T09:35:05.774 INFO:tasks.workunit.client.1.smithi191.stdout:8/889: mkdir d1/d16/d3c/d28/d79/d12c 0 2024-09-19T09:35:05.774 INFO:tasks.workunit.client.1.smithi191.stdout:8/890: dread - d1/d22/d47/d9d/f11d zero size 2024-09-19T09:35:05.774 INFO:tasks.workunit.client.1.smithi191.stdout:8/891: write d1/f14 [549881,127289] 0 2024-09-19T09:35:05.774 INFO:tasks.workunit.client.1.smithi191.stdout:8/892: chown d1/d16/d23/d3e/f71 401741025 1 2024-09-19T09:35:05.775 INFO:tasks.workunit.client.1.smithi191.stdout:9/757: dwrite d3/db/d16/d38/d92/fe4 [0,4194304] 0 2024-09-19T09:35:05.777 INFO:tasks.workunit.client.1.smithi191.stdout:5/756: read d0/d4/d9/d1d/d29/d33/d45/d64/f6c [3676038,108281] 0 2024-09-19T09:35:05.781 INFO:tasks.workunit.client.1.smithi191.stdout:7/768: rmdir d2/d2a/d33 39 2024-09-19T09:35:05.783 INFO:tasks.workunit.client.1.smithi191.stdout:1/771: link d3/dbd/fd2 d3/d9/da/d1e/d32/d53/f11d 0 2024-09-19T09:35:05.783 INFO:tasks.workunit.client.1.smithi191.stdout:8/893: dread d1/d16/d2e/f38 [4194304,4194304] 0 2024-09-19T09:35:05.783 INFO:tasks.workunit.client.1.smithi191.stdout:8/894: write d1/d16/d3c/d28/d79/da2/fa3 [241880,84170] 0 2024-09-19T09:35:05.784 INFO:tasks.workunit.client.1.smithi191.stdout:9/758: dread d3/db/d16/d17/d3c/dd0/fe3 [0,4194304] 0 2024-09-19T09:35:05.784 INFO:tasks.workunit.client.1.smithi191.stdout:9/759: fsync d3/db/d53/f6f 0 2024-09-19T09:35:05.788 INFO:tasks.workunit.client.1.smithi191.stdout:5/757: write d0/d4/d9/d1d/d29/d33/d52/fbe [993060,68029] 0 2024-09-19T09:35:05.788 INFO:tasks.workunit.client.1.smithi191.stdout:5/758: creat d0/d4/f10f x:0 0 0 2024-09-19T09:35:05.793 INFO:tasks.workunit.client.1.smithi191.stdout:5/759: mkdir d0/d4/d9/d1d/d29/d7f/d110 0 2024-09-19T09:35:05.795 INFO:tasks.workunit.client.1.smithi191.stdout:5/760: rmdir d0/d4/d9/d1d/d29/d33/d52/da4 39 2024-09-19T09:35:05.795 INFO:tasks.workunit.client.1.smithi191.stdout:5/761: chown d0/d4/d9/d1d/d29/d33/d45/d64/fe5 11 1 2024-09-19T09:35:05.795 INFO:tasks.workunit.client.1.smithi191.stdout:5/762: write d0/d4/f10f [140748,1744] 0 2024-09-19T09:35:05.795 INFO:tasks.workunit.client.1.smithi191.stdout:8/895: write d1/d7/d1a/d6d/fec [3651527,113732] 0 2024-09-19T09:35:05.807 INFO:tasks.workunit.client.1.smithi191.stdout:3/673: rename d12/d13/dda/de3 to d12/d13/d1a/d5d/dd1/de9 0 2024-09-19T09:35:05.807 INFO:tasks.workunit.client.1.smithi191.stdout:3/674: chown d12/d13/d1a/d1b/d3c/d3f/f83 16176465 1 2024-09-19T09:35:05.809 INFO:tasks.workunit.client.1.smithi191.stdout:1/772: dwrite d3/d9/da/d1e/d32/d6f/db2/dd1/f118 [0,4194304] 0 2024-09-19T09:35:05.809 INFO:tasks.workunit.client.1.smithi191.stdout:1/773: write d3/d9/da/d1e/d32/ddc/f110 [157496,57170] 0 2024-09-19T09:35:05.809 INFO:tasks.workunit.client.1.smithi191.stdout:9/760: dwrite d3/ff6 [0,4194304] 0 2024-09-19T09:35:05.809 INFO:tasks.workunit.client.1.smithi191.stdout:9/761: readlink d3/db/d53/da2/db3/dc2/la8 0 2024-09-19T09:35:05.809 INFO:tasks.workunit.client.1.smithi191.stdout:9/762: chown d3/l12 30 1 2024-09-19T09:35:05.809 INFO:tasks.workunit.client.1.smithi191.stdout:9/763: read d3/db/d16/d47/d55/f4e [741828,81174] 0 2024-09-19T09:35:05.809 INFO:tasks.workunit.client.1.smithi191.stdout:9/764: fdatasync d3/db/f31 0 2024-09-19T09:35:05.809 INFO:tasks.workunit.client.1.smithi191.stdout:3/675: dread d12/d13/d1a/d1b/d2e/dab/d3d/d91/fb7 [0,4194304] 0 2024-09-19T09:35:05.809 INFO:tasks.workunit.client.1.smithi191.stdout:7/769: rename d2/l41 to d2/d2a/d38/de5/l10b 0 2024-09-19T09:35:05.810 INFO:tasks.workunit.client.1.smithi191.stdout:7/770: chown d2/d39/d3a/c51 30677 1 2024-09-19T09:35:05.810 INFO:tasks.workunit.client.1.smithi191.stdout:1/774: dread d3/dd7/fb1 [0,4194304] 0 2024-09-19T09:35:05.814 INFO:tasks.workunit.client.1.smithi191.stdout:9/765: truncate d3/d8/f3b 1809762 0 2024-09-19T09:35:05.815 INFO:tasks.workunit.client.1.smithi191.stdout:7/771: mkdir d2/d10c 0 2024-09-19T09:35:05.815 INFO:tasks.workunit.client.1.smithi191.stdout:7/772: chown d2/d39/l44 108 1 2024-09-19T09:35:05.816 INFO:tasks.workunit.client.1.smithi191.stdout:1/775: creat d3/d9/da/d1e/df9/f11e x:0 0 0 2024-09-19T09:35:05.818 INFO:tasks.workunit.client.1.smithi191.stdout:9/766: unlink d3/db/l99 0 2024-09-19T09:35:05.818 INFO:tasks.workunit.client.1.smithi191.stdout:1/776: mknod d3/d9/da/d1e/d25/d70/c11f 0 2024-09-19T09:35:05.820 INFO:tasks.workunit.client.1.smithi191.stdout:9/767: mkdir d3/d60/d78/d102/d105 0 2024-09-19T09:35:05.820 INFO:tasks.workunit.client.1.smithi191.stdout:1/777: dread d3/dd7/fb1 [0,4194304] 0 2024-09-19T09:35:05.820 INFO:tasks.workunit.client.1.smithi191.stdout:1/778: dread - d3/d9/da/d1e/d32/d6f/db2/dd1/f101 zero size 2024-09-19T09:35:05.821 INFO:tasks.workunit.client.1.smithi191.stdout:1/779: creat d3/dbd/f120 x:0 0 0 2024-09-19T09:35:05.821 INFO:tasks.workunit.client.1.smithi191.stdout:8/896: dwrite d1/d16/d3c/d28/f33 [0,4194304] 0 2024-09-19T09:35:05.821 INFO:tasks.workunit.client.1.smithi191.stdout:8/897: read d1/d7/d1a/d6d/de1/d6b/db9/f112 [130156,119273] 0 2024-09-19T09:35:05.822 INFO:tasks.workunit.client.1.smithi191.stdout:8/898: fsync d1/d22/d47/f10b 0 2024-09-19T09:35:05.822 INFO:tasks.workunit.client.1.smithi191.stdout:8/899: dread - d1/d16/d3c/d17/da1/d84/dbc/f11a zero size 2024-09-19T09:35:05.822 INFO:tasks.workunit.client.1.smithi191.stdout:8/900: dread - d1/d7/d1a/fe2 zero size 2024-09-19T09:35:05.822 INFO:tasks.workunit.client.1.smithi191.stdout:9/768: creat d3/db/d16/d17/d3c/f106 x:0 0 0 2024-09-19T09:35:05.822 INFO:tasks.workunit.client.1.smithi191.stdout:9/769: readlink d3/db/d53/da2/le7 0 2024-09-19T09:35:05.822 INFO:tasks.workunit.client.1.smithi191.stdout:0/864: sync 2024-09-19T09:35:05.824 INFO:tasks.workunit.client.1.smithi191.stdout:8/901: mknod d1/d16/d2e/d57/c12d 0 2024-09-19T09:35:05.824 INFO:tasks.workunit.client.1.smithi191.stdout:8/902: creat d1/d7/d1a/d6d/da8/f12e x:0 0 0 2024-09-19T09:35:05.824 INFO:tasks.workunit.client.1.smithi191.stdout:8/903: chown d1/d16/d3c/f29 1999240 1 2024-09-19T09:35:05.828 INFO:tasks.workunit.client.1.smithi191.stdout:9/770: creat d3/db/d16/d38/dd4/f107 x:0 0 0 2024-09-19T09:35:05.829 INFO:tasks.workunit.client.1.smithi191.stdout:9/771: fsync d3/db/d16/d17/d3c/fa4 0 2024-09-19T09:35:05.829 INFO:tasks.workunit.client.1.smithi191.stdout:0/865: rmdir d0/d9/d1c/d1f/d24/d87/dd0 39 2024-09-19T09:35:05.829 INFO:tasks.workunit.client.1.smithi191.stdout:0/866: write d0/d9/d1c/d1f/f77 [1105693,33196] 0 2024-09-19T09:35:05.832 INFO:tasks.workunit.client.1.smithi191.stdout:9/772: creat d3/db/d16/d47/f108 x:0 0 0 2024-09-19T09:35:05.833 INFO:tasks.workunit.client.1.smithi191.stdout:0/867: symlink d0/d9/d1c/d1f/d24/d87/l118 0 2024-09-19T09:35:05.833 INFO:tasks.workunit.client.1.smithi191.stdout:0/868: dread - d0/d9/d1c/d1f/d24/d29/faf zero size 2024-09-19T09:35:05.834 INFO:tasks.workunit.client.1.smithi191.stdout:8/904: mkdir d1/d16/d3c/d28/d12f 0 2024-09-19T09:35:05.835 INFO:tasks.workunit.client.1.smithi191.stdout:7/773: dwrite d2/d2a/d79/d7f/f90 [0,4194304] 0 2024-09-19T09:35:05.835 INFO:tasks.workunit.client.1.smithi191.stdout:7/774: fsync d2/f17 0 2024-09-19T09:35:05.835 INFO:tasks.workunit.client.1.smithi191.stdout:7/775: creat d2/d2a/d38/de5/f10d x:0 0 0 2024-09-19T09:35:05.837 INFO:tasks.workunit.client.1.smithi191.stdout:9/773: unlink d3/db/d16/d17/f4c 0 2024-09-19T09:35:05.837 INFO:tasks.workunit.client.1.smithi191.stdout:9/774: write d3/db/d16/d38/dd4/f107 [455210,42688] 0 2024-09-19T09:35:05.837 INFO:tasks.workunit.client.1.smithi191.stdout:9/775: chown d3/db/l101 3267 1 2024-09-19T09:35:05.837 INFO:tasks.workunit.client.1.smithi191.stdout:8/905: dread d1/d22/f54 [0,4194304] 0 2024-09-19T09:35:05.839 INFO:tasks.workunit.client.1.smithi191.stdout:3/676: dwrite d12/d13/d1a/d1b/d2e/f53 [0,4194304] 0 2024-09-19T09:35:05.839 INFO:tasks.workunit.client.1.smithi191.stdout:3/677: write d12/d13/d1a/d1b/fe6 [200522,56368] 0 2024-09-19T09:35:05.839 INFO:tasks.workunit.client.1.smithi191.stdout:3/678: chown d12/d13/d1a/d28/l2c 39 1 2024-09-19T09:35:05.841 INFO:tasks.workunit.client.1.smithi191.stdout:9/776: write d3/d8/f21 [45954,69558] 0 2024-09-19T09:35:05.842 INFO:tasks.workunit.client.1.smithi191.stdout:3/679: dread d12/d13/d1a/d1b/d2e/dab/d3d/f6a [0,4194304] 0 2024-09-19T09:35:05.844 INFO:tasks.workunit.client.1.smithi191.stdout:9/777: mknod d3/db/d16/d17/d81/c109 0 2024-09-19T09:35:05.845 INFO:tasks.workunit.client.1.smithi191.stdout:3/680: symlink d12/d13/d1a/d1b/d3c/d71/lea 0 2024-09-19T09:35:05.847 INFO:tasks.workunit.client.1.smithi191.stdout:8/906: link d1/d16/d3c/d28/fa0 d1/f130 0 2024-09-19T09:35:05.848 INFO:tasks.workunit.client.1.smithi191.stdout:9/778: mknod d3/db/d53/da2/db3/dc2/c10a 0 2024-09-19T09:35:05.849 INFO:tasks.workunit.client.1.smithi191.stdout:3/681: symlink d12/d13/d1a/d1b/d3c/dd8/leb 0 2024-09-19T09:35:05.849 INFO:tasks.workunit.client.1.smithi191.stdout:3/682: creat d12/d43/db2/fec x:0 0 0 2024-09-19T09:35:05.849 INFO:tasks.workunit.client.1.smithi191.stdout:8/907: rmdir d1/d7/d1a/d6d/de1/d6b/d83/d98 39 2024-09-19T09:35:05.851 INFO:tasks.workunit.client.1.smithi191.stdout:3/683: rmdir d12/d13/de7 0 2024-09-19T09:35:05.852 INFO:tasks.workunit.client.1.smithi191.stdout:8/908: symlink d1/d16/d3c/d17/da1/d84/l131 0 2024-09-19T09:35:05.852 INFO:tasks.workunit.client.1.smithi191.stdout:8/909: creat d1/d16/d3c/d17/da1/d84/f132 x:0 0 0 2024-09-19T09:35:05.853 INFO:tasks.workunit.client.1.smithi191.stdout:3/684: mkdir d12/d13/d1a/d1b/d3c/dd8/ded 0 2024-09-19T09:35:05.853 INFO:tasks.workunit.client.1.smithi191.stdout:3/685: chown d12/d13/d1a/d1b/d2e/dab 363127073 1 2024-09-19T09:35:05.855 INFO:tasks.workunit.client.1.smithi191.stdout:3/686: creat d12/d13/d1a/d1b/d2e/dab/d51/d62/d85/da0/fee x:0 0 0 2024-09-19T09:35:05.856 INFO:tasks.workunit.client.1.smithi191.stdout:3/687: mkdir d12/d13/d1a/d1b/d60/d7a/d93/def 0 2024-09-19T09:35:05.857 INFO:tasks.workunit.client.1.smithi191.stdout:3/688: unlink d12/d13/d1a/d1b/d2e/dab/d51/dcd/fe0 0 2024-09-19T09:35:05.857 INFO:tasks.workunit.client.1.smithi191.stdout:9/779: dread d3/db/d16/d47/d55/f4f [4194304,4194304] 0 2024-09-19T09:35:05.859 INFO:tasks.workunit.client.1.smithi191.stdout:1/780: dwrite d3/d9/da/d1e/d32/d6f/db2/dd1/f118 [4194304,4194304] 0 2024-09-19T09:35:05.861 INFO:tasks.workunit.client.1.smithi191.stdout:3/689: rename d12/d13/d1a/d1b/d2e/dab/d3d to d12/d13/d1a/d5d/dd1/df0 0 2024-09-19T09:35:05.861 INFO:tasks.workunit.client.1.smithi191.stdout:3/690: chown d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/f8a 328392519 1 2024-09-19T09:35:05.861 INFO:tasks.workunit.client.1.smithi191.stdout:3/691: chown d12/d43/d61/lb1 113 1 2024-09-19T09:35:05.861 INFO:tasks.workunit.client.1.smithi191.stdout:3/692: truncate d12/d13/d1a/f57 5099629 0 2024-09-19T09:35:05.861 INFO:tasks.workunit.client.1.smithi191.stdout:3/693: chown d12/d13/d1a/d1b/d2e/dab/d51/d62/ca1 8 1 2024-09-19T09:35:05.861 INFO:tasks.workunit.client.1.smithi191.stdout:8/910: dread d1/d16/d3c/d28/d79/f7f [0,4194304] 0 2024-09-19T09:35:05.861 INFO:tasks.workunit.client.1.smithi191.stdout:7/776: dwrite d2/fe9 [0,4194304] 0 2024-09-19T09:35:05.861 INFO:tasks.workunit.client.1.smithi191.stdout:7/777: chown d2/d2a/d33/f7c 69 1 2024-09-19T09:35:05.862 INFO:tasks.workunit.client.1.smithi191.stdout:0/869: dwrite d0/d9/d1c/d20/f113 [0,4194304] 0 2024-09-19T09:35:05.863 INFO:tasks.workunit.client.1.smithi191.stdout:3/694: creat d12/d43/d61/d98/ff1 x:0 0 0 2024-09-19T09:35:05.864 INFO:tasks.workunit.client.1.smithi191.stdout:3/695: creat d12/d43/d61/d98/ff2 x:0 0 0 2024-09-19T09:35:05.867 INFO:tasks.workunit.client.1.smithi191.stdout:7/778: mkdir d2/d2a/d38/de5/ded/d10e 0 2024-09-19T09:35:05.868 INFO:tasks.workunit.client.1.smithi191.stdout:7/779: dread - d2/d2a/d38/fcd zero size 2024-09-19T09:35:05.868 INFO:tasks.workunit.client.1.smithi191.stdout:7/780: truncate d2/d2a/d38/dd4/fe7 154455 0 2024-09-19T09:35:05.875 INFO:tasks.workunit.client.1.smithi191.stdout:3/696: creat d12/d13/d1a/d5d/dd1/ff3 x:0 0 0 2024-09-19T09:35:05.877 INFO:tasks.workunit.client.1.smithi191.stdout:7/781: creat d2/d2a/d4f/f10f x:0 0 0 2024-09-19T09:35:05.877 INFO:tasks.workunit.client.1.smithi191.stdout:1/781: dwrite d3/d9/da/db/f4d [0,4194304] 0 2024-09-19T09:35:05.877 INFO:tasks.workunit.client.1.smithi191.stdout:0/870: getdents d0/d9/d1c/d20 0 2024-09-19T09:35:05.879 INFO:tasks.workunit.client.1.smithi191.stdout:1/782: mkdir d3/d9/da/d1e/d32/d53/d57/d121 0 2024-09-19T09:35:05.880 INFO:tasks.workunit.client.1.smithi191.stdout:0/871: mknod d0/d9/d1c/d1f/d24/d29/d30/d7c/c119 0 2024-09-19T09:35:05.881 INFO:tasks.workunit.client.1.smithi191.stdout:3/697: getdents d12/d13/d1a/d1b/d2e/dab/da6 0 2024-09-19T09:35:05.881 INFO:tasks.workunit.client.1.smithi191.stdout:3/698: chown d12/d13/d1a/f5c 156 1 2024-09-19T09:35:05.889 INFO:tasks.workunit.client.1.smithi191.stdout:7/782: dwrite d2/d39/d3a/fda [0,4194304] 0 2024-09-19T09:35:05.889 INFO:tasks.workunit.client.1.smithi191.stdout:0/872: read d0/d9/d1c/d1f/d24/d39/d7a/f10a [982281,10115] 0 2024-09-19T09:35:05.897 INFO:tasks.workunit.client.1.smithi191.stdout:0/873: dread d0/d9/d1c/d111/fa3 [0,4194304] 0 2024-09-19T09:35:05.914 INFO:tasks.workunit.client.1.smithi191.stdout:1/783: truncate d3/d9/da/db/d48/f9a 1041566 0 2024-09-19T09:35:05.914 INFO:tasks.workunit.client.1.smithi191.stdout:1/784: creat d3/d9/f122 x:0 0 0 2024-09-19T09:35:05.916 INFO:tasks.workunit.client.1.smithi191.stdout:3/699: rename d12/d13/d1a/d1b/d2e/dab/d51/d62/c6b to d12/d13/d1a/d1b/d2e/dab/da6/cf4 0 2024-09-19T09:35:05.918 INFO:tasks.workunit.client.1.smithi191.stdout:7/783: truncate d2/d2a/d4f/d59/f65 230004 0 2024-09-19T09:35:05.919 INFO:tasks.workunit.client.1.smithi191.stdout:6/661: sync 2024-09-19T09:35:05.921 INFO:tasks.workunit.client.1.smithi191.stdout:0/874: unlink d0/d9/d1c/d1f/d24/d87/l118 0 2024-09-19T09:35:05.921 INFO:tasks.workunit.client.1.smithi191.stdout:0/875: chown d0/d9/d1c/d1f/d24/d29/d30/d112 5537 1 2024-09-19T09:35:05.921 INFO:tasks.workunit.client.1.smithi191.stdout:0/876: dread - d0/ff9 zero size 2024-09-19T09:35:05.923 INFO:tasks.workunit.client.1.smithi191.stdout:1/785: rename d3/d9/da/d42/d8a/lbb to d3/d9/da/d1e/l123 0 2024-09-19T09:35:05.927 INFO:tasks.workunit.client.1.smithi191.stdout:1/786: symlink d3/d9/da/d8c/d97/l124 0 2024-09-19T09:35:05.929 INFO:tasks.workunit.client.1.smithi191.stdout:7/784: rename d2/d2a/d33/c48 to d2/d2a/d38/de5/ded/c110 0 2024-09-19T09:35:05.929 INFO:tasks.workunit.client.1.smithi191.stdout:4/883: sync 2024-09-19T09:35:05.929 INFO:tasks.workunit.client.1.smithi191.stdout:2/732: sync 2024-09-19T09:35:05.929 INFO:tasks.workunit.client.1.smithi191.stdout:5/763: sync 2024-09-19T09:35:05.929 INFO:tasks.workunit.client.1.smithi191.stdout:0/877: getdents d0/d9/d1c 0 2024-09-19T09:35:05.930 INFO:tasks.workunit.client.1.smithi191.stdout:7/785: symlink d2/d2a/d38/dd4/l111 0 2024-09-19T09:35:05.932 INFO:tasks.workunit.client.1.smithi191.stdout:0/878: link d0/d9/d1c/d1f/d24/d39/d8b/lca d0/d9/d1c/d1f/d24/dbe/l11a 0 2024-09-19T09:35:05.934 INFO:tasks.workunit.client.1.smithi191.stdout:4/884: dread d5/d38/f45 [0,4194304] 0 2024-09-19T09:35:05.936 INFO:tasks.workunit.client.1.smithi191.stdout:3/700: link d12/d13/d1a/d1b/d2e/dab/da6/cf4 d12/d13/cf5 0 2024-09-19T09:35:05.940 INFO:tasks.workunit.client.1.smithi191.stdout:2/733: write d8/d2a/f53 [1187421,81210] 0 2024-09-19T09:35:05.942 INFO:tasks.workunit.client.1.smithi191.stdout:2/734: link d8/d11/d3f/d64/c84 d8/d11/d3f/d8a/cfd 0 2024-09-19T09:35:05.942 INFO:tasks.workunit.client.1.smithi191.stdout:2/735: creat d8/db/d4e/ffe x:0 0 0 2024-09-19T09:35:05.944 INFO:tasks.workunit.client.1.smithi191.stdout:7/786: dread d2/f1b [0,4194304] 0 2024-09-19T09:35:05.945 INFO:tasks.workunit.client.1.smithi191.stdout:5/764: dread d0/d77/fea [0,4194304] 0 2024-09-19T09:35:05.945 INFO:tasks.workunit.client.1.smithi191.stdout:2/736: mknod d8/d11/d56/cff 0 2024-09-19T09:35:05.945 INFO:tasks.workunit.client.1.smithi191.stdout:5/765: creat d0/da7/dcd/dd7/f111 x:0 0 0 2024-09-19T09:35:05.945 INFO:tasks.workunit.client.1.smithi191.stdout:2/737: getdents d8/d11/d3f/dfa/dfc 0 2024-09-19T09:35:05.945 INFO:tasks.workunit.client.1.smithi191.stdout:2/738: write d8/d2a/dba/dcc/ff9 [504105,111913] 0 2024-09-19T09:35:05.946 INFO:tasks.workunit.client.1.smithi191.stdout:7/787: link d2/d2a/d4f/d59/l5c d2/d2a/d79/da8/db9/l112 0 2024-09-19T09:35:05.946 INFO:tasks.workunit.client.1.smithi191.stdout:6/662: dwrite d2/de/d2a/d60/fc1 [0,4194304] 0 2024-09-19T09:35:05.946 INFO:tasks.workunit.client.1.smithi191.stdout:6/663: chown d2/de/d2a/d7d/l5a 4 1 2024-09-19T09:35:05.947 INFO:tasks.workunit.client.1.smithi191.stdout:1/787: dwrite d3/d9/da/d1e/d32/f11a [0,4194304] 0 2024-09-19T09:35:05.947 INFO:tasks.workunit.client.1.smithi191.stdout:1/788: creat d3/d9/da/d42/f125 x:0 0 0 2024-09-19T09:35:05.947 INFO:tasks.workunit.client.1.smithi191.stdout:1/789: write d3/d9/da/d1e/d32/d53/f51 [3625634,103612] 0 2024-09-19T09:35:05.947 INFO:tasks.workunit.client.1.smithi191.stdout:0/879: write d0/d9/d1c/d1f/d24/f3f [4168052,112522] 0 2024-09-19T09:35:05.948 INFO:tasks.workunit.client.1.smithi191.stdout:2/739: rmdir d8/d11/d3f/d8a/d8f 39 2024-09-19T09:35:05.948 INFO:tasks.workunit.client.1.smithi191.stdout:2/740: dread - d8/db/d41/fdc zero size 2024-09-19T09:35:05.948 INFO:tasks.workunit.client.1.smithi191.stdout:2/741: write d8/d11/d56/f8c [1720810,102823] 0 2024-09-19T09:35:05.948 INFO:tasks.workunit.client.1.smithi191.stdout:2/742: stat d8/db/d13/d40/f5e 0 2024-09-19T09:35:05.950 INFO:tasks.workunit.client.1.smithi191.stdout:7/788: link d2/c35 d2/d2a/d38/def/c113 0 2024-09-19T09:35:05.951 INFO:tasks.workunit.client.1.smithi191.stdout:4/885: dread d5/dfb/dfd/d24/d82/df2/f39 [0,4194304] 0 2024-09-19T09:35:05.951 INFO:tasks.workunit.client.1.smithi191.stdout:4/886: fdatasync d5/de7/ff0 0 2024-09-19T09:35:05.960 INFO:tasks.workunit.client.1.smithi191.stdout:3/701: dwrite d12/d13/f19 [0,4194304] 0 2024-09-19T09:35:05.961 INFO:tasks.workunit.client.1.smithi191.stdout:0/880: mkdir d0/d9/de/d61/d11b 0 2024-09-19T09:35:05.961 INFO:tasks.workunit.client.1.smithi191.stdout:0/881: write d0/f8 [1220144,126013] 0 2024-09-19T09:35:05.963 INFO:tasks.workunit.client.1.smithi191.stdout:2/743: rmdir d8/db/d13 39 2024-09-19T09:35:05.965 INFO:tasks.workunit.client.1.smithi191.stdout:1/790: rename d3/d9/da/d1e/d32/d53/lb7 to d3/d9/da/d1e/d32/d6f/db2/dd1/l126 0 2024-09-19T09:35:05.967 INFO:tasks.workunit.client.1.smithi191.stdout:2/744: symlink d8/d11/d3f/dfa/dfc/l100 0 2024-09-19T09:35:05.967 INFO:tasks.workunit.client.1.smithi191.stdout:2/745: fsync f6 0 2024-09-19T09:35:05.967 INFO:tasks.workunit.client.1.smithi191.stdout:2/746: fsync d8/d11/d56/fe5 0 2024-09-19T09:35:05.967 INFO:tasks.workunit.client.1.smithi191.stdout:2/747: dread - d8/d2a/dba/ff1 zero size 2024-09-19T09:35:05.967 INFO:tasks.workunit.client.1.smithi191.stdout:1/791: stat d3/l38 0 2024-09-19T09:35:05.967 INFO:tasks.workunit.client.1.smithi191.stdout:1/792: chown d3/d9/da/d1e/d32/d6f/db2/dd1/f118 591440 1 2024-09-19T09:35:05.971 INFO:tasks.workunit.client.1.smithi191.stdout:4/887: dread d5/dfb/dfd/d28/d96/f9a [0,4194304] 0 2024-09-19T09:35:05.973 INFO:tasks.workunit.client.1.smithi191.stdout:4/888: link d5/dfb/dfd/d24/d82/df2/d19/cdb d5/dfb/dfd/d24/d32/d21/d56/d86/c119 0 2024-09-19T09:35:05.974 INFO:tasks.workunit.client.1.smithi191.stdout:3/702: dread f9 [0,4194304] 0 2024-09-19T09:35:05.975 INFO:tasks.workunit.client.1.smithi191.stdout:4/889: creat d5/dfb/dfd/df9/d88/f11a x:0 0 0 2024-09-19T09:35:05.975 INFO:tasks.workunit.client.1.smithi191.stdout:4/890: chown d5/dfb/dfd/d24/d82/df2/d37/d59/fbf 29 1 2024-09-19T09:35:05.976 INFO:tasks.workunit.client.1.smithi191.stdout:3/703: unlink d12/d13/f19 0 2024-09-19T09:35:05.976 INFO:tasks.workunit.client.1.smithi191.stdout:3/704: write d12/d13/d1a/d5d/dd1/de9/fe8 [68892,120743] 0 2024-09-19T09:35:05.978 INFO:tasks.workunit.client.1.smithi191.stdout:5/766: dwrite d0/d4/d9/de/ff [4194304,4194304] 0 2024-09-19T09:35:05.979 INFO:tasks.workunit.client.1.smithi191.stdout:6/664: dwrite d2/de/d2a/d2d/d30/d98/d9b/f68 [0,4194304] 0 2024-09-19T09:35:05.980 INFO:tasks.workunit.client.1.smithi191.stdout:5/767: creat d0/d4/d9/d1d/d29/d7f/f112 x:0 0 0 2024-09-19T09:35:05.983 INFO:tasks.workunit.client.1.smithi191.stdout:1/793: dread d3/d9/da/d42/f55 [0,4194304] 0 2024-09-19T09:35:05.984 INFO:tasks.workunit.client.1.smithi191.stdout:1/794: creat d3/f127 x:0 0 0 2024-09-19T09:35:05.986 INFO:tasks.workunit.client.1.smithi191.stdout:1/795: creat d3/d9/dda/f128 x:0 0 0 2024-09-19T09:35:05.986 INFO:tasks.workunit.client.1.smithi191.stdout:1/796: write d3/d9/da/d1e/d32/d53/d57/d6d/f77 [185860,2387] 0 2024-09-19T09:35:05.987 INFO:tasks.workunit.client.1.smithi191.stdout:2/748: dread d8/db/d4d/de6/d70/fcb [0,4194304] 0 2024-09-19T09:35:05.987 INFO:tasks.workunit.client.1.smithi191.stdout:2/749: write d8/d2a/dba/dcc/ff9 [1083435,124231] 0 2024-09-19T09:35:05.987 INFO:tasks.workunit.client.1.smithi191.stdout:2/750: creat d8/d11/dc2/f101 x:0 0 0 2024-09-19T09:35:05.990 INFO:tasks.workunit.client.1.smithi191.stdout:3/705: dread d12/d13/d1a/d1b/d2e/f53 [0,4194304] 0 2024-09-19T09:35:05.993 INFO:tasks.workunit.client.1.smithi191.stdout:5/768: dread d0/d4/d9/d1d/d29/d33/d45/d64/f6c [0,4194304] 0 2024-09-19T09:35:05.993 INFO:tasks.workunit.client.1.smithi191.stdout:5/769: fsync d0/d4/d9/d1d/d22/d3b/f74 0 2024-09-19T09:35:05.993 INFO:tasks.workunit.client.1.smithi191.stdout:3/706: link d12/d13/d1a/d1b/d2e/dab/d51/dcd/cc7 d12/d13/d1a/d28/cf6 0 2024-09-19T09:35:05.995 INFO:tasks.workunit.client.1.smithi191.stdout:3/707: unlink d12/d13/d1a/d1b/d3c/f6e 0 2024-09-19T09:35:05.997 INFO:tasks.workunit.client.1.smithi191.stdout:3/708: mkdir d12/d13/d1a/df7 0 2024-09-19T09:35:05.997 INFO:tasks.workunit.client.1.smithi191.stdout:3/709: chown d12/c20 277769 1 2024-09-19T09:35:05.999 INFO:tasks.workunit.client.1.smithi191.stdout:3/710: mknod d12/d13/d1a/d5d/dc8/dd5/cf8 0 2024-09-19T09:35:05.999 INFO:tasks.workunit.client.1.smithi191.stdout:3/711: chown d12/d13/c70 529880 1 2024-09-19T09:35:05.999 INFO:tasks.workunit.client.1.smithi191.stdout:3/712: write d12/d43/fac [835545,15649] 0 2024-09-19T09:35:06.002 INFO:tasks.workunit.client.1.smithi191.stdout:7/789: dwrite d2/d2a/d38/f83 [0,4194304] 0 2024-09-19T09:35:06.002 INFO:tasks.workunit.client.1.smithi191.stdout:7/790: readlink d2/d2a/d79/d7f/l91 0 2024-09-19T09:35:06.003 INFO:tasks.workunit.client.1.smithi191.stdout:0/882: dwrite d0/d9/d1c/d1f/d24/d29/d30/d56/f66 [0,4194304] 0 2024-09-19T09:35:06.003 INFO:tasks.workunit.client.1.smithi191.stdout:4/891: dwrite d5/d1b/d8e/fb5 [0,4194304] 0 2024-09-19T09:35:06.003 INFO:tasks.workunit.client.1.smithi191.stdout:4/892: dread d5/dfb/dfd/d28/d96/ff4 [0,4194304] 0 2024-09-19T09:35:06.007 INFO:tasks.workunit.client.1.smithi191.stdout:5/770: write d0/d4/d9/d1d/d22/d5c/f8d [3539279,83806] 0 2024-09-19T09:35:06.007 INFO:tasks.workunit.client.1.smithi191.stdout:3/713: write d12/d13/d1a/f57 [4267832,67198] 0 2024-09-19T09:35:06.007 INFO:tasks.workunit.client.1.smithi191.stdout:3/714: chown d12/d13/d1a/d1b/d2e/dab/d51/d62 116 1 2024-09-19T09:35:06.007 INFO:tasks.workunit.client.1.smithi191.stdout:4/893: write d5/dfb/dfd/d24/d32/d21/d5c/fb7 [200380,54785] 0 2024-09-19T09:35:06.009 INFO:tasks.workunit.client.1.smithi191.stdout:7/791: unlink d2/d2a/d79/d7f/cf3 0 2024-09-19T09:35:06.012 INFO:tasks.workunit.client.1.smithi191.stdout:0/883: creat d0/d9/d1c/d1f/d24/d39/f11c x:0 0 0 2024-09-19T09:35:06.015 INFO:tasks.workunit.client.1.smithi191.stdout:3/715: mknod d12/d13/d1a/d1b/d3c/cf9 0 2024-09-19T09:35:06.015 INFO:tasks.workunit.client.1.smithi191.stdout:2/751: dwrite d8/db/d4d/de6/d70/fcb [0,4194304] 0 2024-09-19T09:35:06.016 INFO:tasks.workunit.client.1.smithi191.stdout:7/792: write d2/f75 [1776725,118579] 0 2024-09-19T09:35:06.016 INFO:tasks.workunit.client.1.smithi191.stdout:4/894: creat d5/dfb/dfd/d24/d32/d21/d5c/d8c/f11b x:0 0 0 2024-09-19T09:35:06.017 INFO:tasks.workunit.client.1.smithi191.stdout:4/895: dread - d5/dfb/dfd/d24/d82/df2/d37/f105 zero size 2024-09-19T09:35:06.018 INFO:tasks.workunit.client.1.smithi191.stdout:2/752: dread d8/db/d13/fdf [0,4194304] 0 2024-09-19T09:35:06.018 INFO:tasks.workunit.client.1.smithi191.stdout:2/753: creat d8/d11/d3f/d8a/dda/f102 x:0 0 0 2024-09-19T09:35:06.018 INFO:tasks.workunit.client.1.smithi191.stdout:2/754: fsync d8/d11/d56/f92 0 2024-09-19T09:35:06.018 INFO:tasks.workunit.client.1.smithi191.stdout:0/884: unlink d0/d9/d1c/d1f/d24/d87/dd0/cf1 0 2024-09-19T09:35:06.018 INFO:tasks.workunit.client.1.smithi191.stdout:0/885: write d0/f8 [1169720,111249] 0 2024-09-19T09:35:06.021 INFO:tasks.workunit.client.1.smithi191.stdout:3/716: creat d12/d13/d1a/d5d/dc8/dd5/ffa x:0 0 0 2024-09-19T09:35:06.021 INFO:tasks.workunit.client.1.smithi191.stdout:3/717: dread - d12/d13/d1a/d1b/d3c/d3f/f67 zero size 2024-09-19T09:35:06.021 INFO:tasks.workunit.client.1.smithi191.stdout:3/718: dread - d12/d43/d61/d98/dc4/fe5 zero size 2024-09-19T09:35:06.021 INFO:tasks.workunit.client.1.smithi191.stdout:3/719: readlink d12/d13/d1a/d1b/d2e/dab/l95 0 2024-09-19T09:35:06.023 INFO:tasks.workunit.client.1.smithi191.stdout:2/755: mkdir d8/d11/d3f/dfa/dfc/d103 0 2024-09-19T09:35:06.023 INFO:tasks.workunit.client.1.smithi191.stdout:2/756: dread - d8/db/d13/d23/fd9 zero size 2024-09-19T09:35:06.024 INFO:tasks.workunit.client.1.smithi191.stdout:0/886: mknod d0/d9/d1c/d1f/d24/d29/d30/d56/d103/c11d 0 2024-09-19T09:35:06.026 INFO:tasks.workunit.client.1.smithi191.stdout:5/771: truncate d0/d4/d9/de/ff 4535413 0 2024-09-19T09:35:06.026 INFO:tasks.workunit.client.1.smithi191.stdout:5/772: write d0/d4/d9/d1d/d22/d5c/f8d [2100770,694] 0 2024-09-19T09:35:06.026 INFO:tasks.workunit.client.1.smithi191.stdout:5/773: readlink d0/d4/l65 0 2024-09-19T09:35:06.030 INFO:tasks.workunit.client.1.smithi191.stdout:4/896: write d5/fe [651070,24422] 0 2024-09-19T09:35:06.030 INFO:tasks.workunit.client.1.smithi191.stdout:9/780: sync 2024-09-19T09:35:06.030 INFO:tasks.workunit.client.1.smithi191.stdout:8/911: sync 2024-09-19T09:35:06.030 INFO:tasks.workunit.client.1.smithi191.stdout:4/897: stat d5/d1b/d74/f10e 0 2024-09-19T09:35:06.032 INFO:tasks.workunit.client.1.smithi191.stdout:4/898: stat d5/d38/c3e 0 2024-09-19T09:35:06.032 INFO:tasks.workunit.client.1.smithi191.stdout:4/899: write d5/dfb/dfd/d24/d32/d21/d5c/fb7 [1181296,83519] 0 2024-09-19T09:35:06.034 INFO:tasks.workunit.client.1.smithi191.stdout:8/912: rename d1/d16/d3c/d17/da1/d84/fe4 to d1/d16/d2e/f133 0 2024-09-19T09:35:06.034 INFO:tasks.workunit.client.1.smithi191.stdout:8/913: fsync d1/d16/d3c/d28/fb7 0 2024-09-19T09:35:06.034 INFO:tasks.workunit.client.1.smithi191.stdout:8/914: creat d1/d16/d3c/d17/da1/d84/dbc/f134 x:0 0 0 2024-09-19T09:35:06.038 INFO:tasks.workunit.client.1.smithi191.stdout:8/915: mknod d1/d16/d2e/d32/c135 0 2024-09-19T09:35:06.039 INFO:tasks.workunit.client.1.smithi191.stdout:8/916: readlink d1/d7/d1a/d6d/de1/d6b/da9/dc1/l10c 0 2024-09-19T09:35:06.039 INFO:tasks.workunit.client.1.smithi191.stdout:8/917: write d1/f74 [1090030,111104] 0 2024-09-19T09:35:06.040 INFO:tasks.workunit.client.1.smithi191.stdout:0/887: write d0/d6f/d7b/f6b [1515309,118590] 0 2024-09-19T09:35:06.040 INFO:tasks.workunit.client.1.smithi191.stdout:8/918: dread - d1/d16/d3c/d28/f108 zero size 2024-09-19T09:35:06.043 INFO:tasks.workunit.client.1.smithi191.stdout:0/888: creat d0/d9/d1c/d1f/d24/d87/dd0/f11e x:0 0 0 2024-09-19T09:35:06.046 INFO:tasks.workunit.client.1.smithi191.stdout:0/889: unlink d0/d9/d1c/d1f/d24/dbe/l11a 0 2024-09-19T09:35:06.048 INFO:tasks.workunit.client.1.smithi191.stdout:3/720: dwrite ff [0,4194304] 0 2024-09-19T09:35:06.049 INFO:tasks.workunit.client.1.smithi191.stdout:3/721: symlink d12/d13/d1a/d1b/d2e/dab/d51/lfb 0 2024-09-19T09:35:06.049 INFO:tasks.workunit.client.1.smithi191.stdout:3/722: write d12/d13/d1a/d5d/dd1/fd3 [1769974,41000] 0 2024-09-19T09:35:06.051 INFO:tasks.workunit.client.1.smithi191.stdout:3/723: link d12/d13/d1a/d5d/dd1/df0/d91/fb7 d12/d13/ffc 0 2024-09-19T09:35:06.052 INFO:tasks.workunit.client.1.smithi191.stdout:3/724: fsync d12/d13/d1a/d1b/d2e/fcc 0 2024-09-19T09:35:06.053 INFO:tasks.workunit.client.1.smithi191.stdout:3/725: link d12/d13/d1a/d5d/dd1/df0/d91/fb7 d12/d13/d1a/d1b/d60/d7a/d93/def/ffd 0 2024-09-19T09:35:06.053 INFO:tasks.workunit.client.1.smithi191.stdout:3/726: chown d12/d13/c47 4537583 1 2024-09-19T09:35:06.053 INFO:tasks.workunit.client.1.smithi191.stdout:3/727: stat d12/d43/c90 0 2024-09-19T09:35:06.054 INFO:tasks.workunit.client.1.smithi191.stdout:3/728: creat d12/d13/d1a/d5d/dc8/ffe x:0 0 0 2024-09-19T09:35:06.054 INFO:tasks.workunit.client.1.smithi191.stdout:8/919: dread d1/d7/d1a/d6d/de1/d6b/db9/fda [4194304,4194304] 0 2024-09-19T09:35:06.055 INFO:tasks.workunit.client.1.smithi191.stdout:3/729: read d12/d13/d1a/d5d/fdd [785623,58901] 0 2024-09-19T09:35:06.064 INFO:tasks.workunit.client.1.smithi191.stdout:5/774: dwrite d0/d4/d9/fc2 [0,4194304] 0 2024-09-19T09:35:06.064 INFO:tasks.workunit.client.1.smithi191.stdout:9/781: dwrite d3/d8/fc [4194304,4194304] 0 2024-09-19T09:35:06.065 INFO:tasks.workunit.client.1.smithi191.stdout:9/782: creat d3/f10b x:0 0 0 2024-09-19T09:35:06.065 INFO:tasks.workunit.client.1.smithi191.stdout:8/920: write d1/d16/d3c/d17/f9a [3724071,69654] 0 2024-09-19T09:35:06.065 INFO:tasks.workunit.client.1.smithi191.stdout:2/757: dwrite d8/db/d4d/de6/fd0 [0,4194304] 0 2024-09-19T09:35:06.068 INFO:tasks.workunit.client.1.smithi191.stdout:5/775: symlink d0/d4/d9/d1d/d29/d7f/l113 0 2024-09-19T09:35:06.068 INFO:tasks.workunit.client.1.smithi191.stdout:5/776: chown d0/d4/d4a/c66 10 1 2024-09-19T09:35:06.068 INFO:tasks.workunit.client.1.smithi191.stdout:5/777: stat d0/l25 0 2024-09-19T09:35:06.080 INFO:tasks.workunit.client.1.smithi191.stdout:0/890: dwrite d0/d9/fb8 [0,4194304] 0 2024-09-19T09:35:06.080 INFO:tasks.workunit.client.1.smithi191.stdout:0/891: write d0/f50 [2694884,80846] 0 2024-09-19T09:35:06.084 INFO:tasks.workunit.client.1.smithi191.stdout:8/921: dread d1/d7/fd5 [0,4194304] 0 2024-09-19T09:35:06.093 INFO:tasks.workunit.client.1.smithi191.stdout:2/758: dwrite d8/d11/d3f/f22 [0,4194304] 0 2024-09-19T09:35:06.093 INFO:tasks.workunit.client.1.smithi191.stdout:2/759: chown d8/db/c7e 514 1 2024-09-19T09:35:06.093 INFO:tasks.workunit.client.1.smithi191.stdout:2/760: fdatasync d8/d11/d3f/f39 0 2024-09-19T09:35:06.093 INFO:tasks.workunit.client.1.smithi191.stdout:2/761: write d8/db/d13/fdf [366995,72298] 0 2024-09-19T09:35:06.094 INFO:tasks.workunit.client.1.smithi191.stdout:2/762: link d8/db/d4d/de6/fd0 d8/db/d13/d23/f104 0 2024-09-19T09:35:06.094 INFO:tasks.workunit.client.1.smithi191.stdout:2/763: write d8/d11/d98/fee [1025658,95145] 0 2024-09-19T09:35:06.094 INFO:tasks.workunit.client.1.smithi191.stdout:5/778: dwrite d0/d4/d9/f9f [4194304,4194304] 0 2024-09-19T09:35:06.096 INFO:tasks.workunit.client.1.smithi191.stdout:2/764: mknod d8/db/d41/c105 0 2024-09-19T09:35:06.096 INFO:tasks.workunit.client.1.smithi191.stdout:2/765: fsync d8/db/d4d/de6/d70/fe1 0 2024-09-19T09:35:06.099 INFO:tasks.workunit.client.1.smithi191.stdout:8/922: dread d1/d16/d3c/d17/f49 [4194304,4194304] 0 2024-09-19T09:35:06.100 INFO:tasks.workunit.client.1.smithi191.stdout:8/923: getdents d1/d7/d1a/d6d/de1/d6b/da9/dc1 0 2024-09-19T09:35:06.100 INFO:tasks.workunit.client.1.smithi191.stdout:9/783: dwrite d3/d60/d78/fdb [0,4194304] 0 2024-09-19T09:35:06.101 INFO:tasks.workunit.client.1.smithi191.stdout:8/924: symlink d1/d16/d2e/d32/d7e/d8b/dfd/l136 0 2024-09-19T09:35:06.101 INFO:tasks.workunit.client.1.smithi191.stdout:0/892: dwrite d0/d9/d1c/d111/f1b [0,4194304] 0 2024-09-19T09:35:06.102 INFO:tasks.workunit.client.1.smithi191.stdout:0/893: write d0/d9/d1c/d1f/d24/d53/f75 [2385686,7375] 0 2024-09-19T09:35:06.104 INFO:tasks.workunit.client.1.smithi191.stdout:5/779: read d0/d4/d9/de/f47 [2352781,34355] 0 2024-09-19T09:35:06.106 INFO:tasks.workunit.client.1.smithi191.stdout:9/784: dread d3/d60/d78/f7b [0,4194304] 0 2024-09-19T09:35:06.106 INFO:tasks.workunit.client.1.smithi191.stdout:8/925: mknod d1/d16/d2e/d32/d7e/d8b/dfd/c137 0 2024-09-19T09:35:06.107 INFO:tasks.workunit.client.1.smithi191.stdout:0/894: unlink d0/d9/d1c/d1f/d24/d39/d7a/f10a 0 2024-09-19T09:35:06.108 INFO:tasks.workunit.client.1.smithi191.stdout:0/895: write d0/d6f/d7b/f6b [4083715,74983] 0 2024-09-19T09:35:06.108 INFO:tasks.workunit.client.1.smithi191.stdout:9/785: dread d3/d60/d78/fb8 [0,4194304] 0 2024-09-19T09:35:06.110 INFO:tasks.workunit.client.1.smithi191.stdout:2/766: write d8/db/d13/d40/f5e [1868472,25811] 0 2024-09-19T09:35:06.112 INFO:tasks.workunit.client.1.smithi191.stdout:8/926: link d1/d16/d23/d3e/dcb/ffe d1/d16/d23/df9/f138 0 2024-09-19T09:35:06.112 INFO:tasks.workunit.client.1.smithi191.stdout:8/927: chown d1/d16/d2e/d32/d7e/d8b/dfd/l136 0 1 2024-09-19T09:35:06.114 INFO:tasks.workunit.client.1.smithi191.stdout:6/665: sync 2024-09-19T09:35:06.114 INFO:tasks.workunit.client.1.smithi191.stdout:1/797: sync 2024-09-19T09:35:06.114 INFO:tasks.workunit.client.1.smithi191.stdout:1/798: creat d3/d9/da/d42/f129 x:0 0 0 2024-09-19T09:35:06.114 INFO:tasks.workunit.client.1.smithi191.stdout:0/896: mknod d0/dc5/d86/c11f 0 2024-09-19T09:35:06.117 INFO:tasks.workunit.client.1.smithi191.stdout:9/786: rmdir d3/db/d16/d17/d3c/dc0/de5 0 2024-09-19T09:35:06.121 INFO:tasks.workunit.client.1.smithi191.stdout:5/780: rmdir d0/d4/d9/d1d/d29 39 2024-09-19T09:35:06.121 INFO:tasks.workunit.client.1.smithi191.stdout:7/793: sync 2024-09-19T09:35:06.121 INFO:tasks.workunit.client.1.smithi191.stdout:5/781: chown d0/d4/d4a/daf 323422 1 2024-09-19T09:35:06.121 INFO:tasks.workunit.client.1.smithi191.stdout:7/794: readlink d2/d2a/d79/d7f/l108 0 2024-09-19T09:35:06.121 INFO:tasks.workunit.client.1.smithi191.stdout:5/782: getdents d0/d4/d9/d1d/d29/d33/d45/d97/d109 0 2024-09-19T09:35:06.121 INFO:tasks.workunit.client.1.smithi191.stdout:5/783: readlink d0/d4/d9/d1d/d22/d5c/l63 0 2024-09-19T09:35:06.121 INFO:tasks.workunit.client.1.smithi191.stdout:7/795: truncate d2/d2a/d38/dd4/fe7 794692 0 2024-09-19T09:35:06.121 INFO:tasks.workunit.client.1.smithi191.stdout:5/784: stat d0/d4/d9/d1d/d29/d33/d45/d97/fe1 0 2024-09-19T09:35:06.123 INFO:tasks.workunit.client.1.smithi191.stdout:2/767: unlink d8/db/d4d/de6/f37 0 2024-09-19T09:35:06.123 INFO:tasks.workunit.client.1.smithi191.stdout:1/799: write d3/d9/da/f3b [3618520,93719] 0 2024-09-19T09:35:06.124 INFO:tasks.workunit.client.1.smithi191.stdout:8/928: symlink d1/d22/d47/d9d/l139 0 2024-09-19T09:35:06.124 INFO:tasks.workunit.client.1.smithi191.stdout:8/929: stat d1/d7/d1a/d6d/de1/d6b/db9/fda 0 2024-09-19T09:35:06.126 INFO:tasks.workunit.client.1.smithi191.stdout:9/787: creat d3/db/d53/dee/f10c x:0 0 0 2024-09-19T09:35:06.128 INFO:tasks.workunit.client.1.smithi191.stdout:5/785: write d0/d4/d9/d1d/d28/f31 [4555224,55105] 0 2024-09-19T09:35:06.128 INFO:tasks.workunit.client.1.smithi191.stdout:1/800: link d3/d9/da/d1e/d32/c37 d3/d9/da/d8c/d97/c12a 0 2024-09-19T09:35:06.128 INFO:tasks.workunit.client.1.smithi191.stdout:1/801: chown d3/d9/d73 0 1 2024-09-19T09:35:06.129 INFO:tasks.workunit.client.1.smithi191.stdout:5/786: creat d0/d4/d9/d1d/d29/d33/d45/d97/ddf/f114 x:0 0 0 2024-09-19T09:35:06.129 INFO:tasks.workunit.client.1.smithi191.stdout:5/787: read - d0/d4/f107 zero size 2024-09-19T09:35:06.131 INFO:tasks.workunit.client.1.smithi191.stdout:9/788: dread d3/db/d16/d17/d81/f8a [0,4194304] 0 2024-09-19T09:35:06.131 INFO:tasks.workunit.client.1.smithi191.stdout:9/789: chown d3/db/d16/d17/d3c/c95 28 1 2024-09-19T09:35:06.131 INFO:tasks.workunit.client.1.smithi191.stdout:1/802: getdents d3/d9/da/d1e/d32/d53/d57/def 0 2024-09-19T09:35:06.132 INFO:tasks.workunit.client.1.smithi191.stdout:1/803: creat d3/d9/da/d1e/d32/d53/d57/d6d/f12b x:0 0 0 2024-09-19T09:35:06.132 INFO:tasks.workunit.client.1.smithi191.stdout:8/930: dread d1/d16/f4a [0,4194304] 0 2024-09-19T09:35:06.132 INFO:tasks.workunit.client.1.smithi191.stdout:1/804: creat d3/d9/da/f12c x:0 0 0 2024-09-19T09:35:06.134 INFO:tasks.workunit.client.1.smithi191.stdout:8/931: link d1/d22/c30 d1/d16/d2e/d32/d7e/c13a 0 2024-09-19T09:35:06.135 INFO:tasks.workunit.client.1.smithi191.stdout:8/932: dread d1/d16/d3c/d28/d79/da2/fc4 [0,4194304] 0 2024-09-19T09:35:06.137 INFO:tasks.workunit.client.1.smithi191.stdout:1/805: symlink d3/d9/da/d42/l12d 0 2024-09-19T09:35:06.139 INFO:tasks.workunit.client.1.smithi191.stdout:1/806: rename d3/d9/da/d1e/d32/d53/d57/d6d/da1/cf5 to d3/d9/dda/c12e 0 2024-09-19T09:35:06.139 INFO:tasks.workunit.client.1.smithi191.stdout:1/807: chown d3/dd7/fad 1037281 1 2024-09-19T09:35:06.139 INFO:tasks.workunit.client.1.smithi191.stdout:1/808: fdatasync d3/d9/da/d1e/d25/fe9 0 2024-09-19T09:35:06.139 INFO:tasks.workunit.client.1.smithi191.stdout:1/809: chown d3/d9/da/d1e/l27 1020 1 2024-09-19T09:35:06.152 INFO:tasks.workunit.client.1.smithi191.stdout:9/790: dread d3/d8/fdd [0,4194304] 0 2024-09-19T09:35:06.154 INFO:tasks.workunit.client.1.smithi191.stdout:9/791: mknod d3/db/d16/d38/dd4/c10d 0 2024-09-19T09:35:06.154 INFO:tasks.workunit.client.1.smithi191.stdout:7/796: dwrite d2/d2a/d38/d63/dc1/f104 [0,4194304] 0 2024-09-19T09:35:06.154 INFO:tasks.workunit.client.1.smithi191.stdout:7/797: truncate d2/d39/d3a/d9c/fc2 850908 0 2024-09-19T09:35:06.154 INFO:tasks.workunit.client.1.smithi191.stdout:7/798: chown d2/d2a/c68 34 1 2024-09-19T09:35:06.155 INFO:tasks.workunit.client.1.smithi191.stdout:9/792: symlink d3/da1/l10e 0 2024-09-19T09:35:06.155 INFO:tasks.workunit.client.1.smithi191.stdout:9/793: chown d3/d8/f3b 84338 1 2024-09-19T09:35:06.155 INFO:tasks.workunit.client.1.smithi191.stdout:9/794: fdatasync d3/d60/d78/fbe 0 2024-09-19T09:35:06.156 INFO:tasks.workunit.client.1.smithi191.stdout:8/933: dread d1/d16/d3c/d17/f4d [0,4194304] 0 2024-09-19T09:35:06.156 INFO:tasks.workunit.client.1.smithi191.stdout:8/934: chown d1/d7/f53 12 1 2024-09-19T09:35:06.156 INFO:tasks.workunit.client.1.smithi191.stdout:8/935: chown d1/d16/d3c/d17/f51 61048095 1 2024-09-19T09:35:06.156 INFO:tasks.workunit.client.1.smithi191.stdout:6/666: dwrite d2/de/d19/d1e/d64/f8f [0,4194304] 0 2024-09-19T09:35:06.157 INFO:tasks.workunit.client.1.smithi191.stdout:7/799: unlink d2/d2a/d4f/d59/d81/f9b 0 2024-09-19T09:35:06.157 INFO:tasks.workunit.client.1.smithi191.stdout:9/795: symlink d3/d60/d78/d102/l10f 0 2024-09-19T09:35:06.158 INFO:tasks.workunit.client.1.smithi191.stdout:2/768: dwrite d8/db/d13/d40/fce [0,4194304] 0 2024-09-19T09:35:06.159 INFO:tasks.workunit.client.1.smithi191.stdout:2/769: write d8/db/d4d/de6/d70/fcb [4256664,109141] 0 2024-09-19T09:35:06.160 INFO:tasks.workunit.client.1.smithi191.stdout:8/936: rmdir d1/d7/d1a/d6d/de1/d6b/d83/dab/d10e 0 2024-09-19T09:35:06.160 INFO:tasks.workunit.client.1.smithi191.stdout:7/800: link d2/f28 d2/d2a/d4f/d59/dfb/deb/f114 0 2024-09-19T09:35:06.160 INFO:tasks.workunit.client.1.smithi191.stdout:7/801: creat d2/d2a/d4f/d59/dfb/f115 x:0 0 0 2024-09-19T09:35:06.161 INFO:tasks.workunit.client.1.smithi191.stdout:5/788: dwrite d0/d4/d9/d1d/d29/d33/d52/f71 [0,4194304] 0 2024-09-19T09:35:06.161 INFO:tasks.workunit.client.1.smithi191.stdout:5/789: fdatasync d0/d4/d4a/f4b 0 2024-09-19T09:35:06.167 INFO:tasks.workunit.client.1.smithi191.stdout:6/667: read d2/de/d2a/d2d/d30/d98/d9b/fbb [151390,47735] 0 2024-09-19T09:35:06.167 INFO:tasks.workunit.client.1.smithi191.stdout:7/802: rename d2/d39/d3a/c77 to d2/d2a/d38/def/c116 0 2024-09-19T09:35:06.168 INFO:tasks.workunit.client.1.smithi191.stdout:7/803: getdents d2/d2a/d38/de5/d105 0 2024-09-19T09:35:06.168 INFO:tasks.workunit.client.1.smithi191.stdout:5/790: mknod d0/d4/dae/c115 0 2024-09-19T09:35:06.170 INFO:tasks.workunit.client.1.smithi191.stdout:6/668: symlink d2/de/d2a/d2d/dc7/lcf 0 2024-09-19T09:35:06.172 INFO:tasks.workunit.client.1.smithi191.stdout:7/804: rmdir d2/d2a/d38/d63 39 2024-09-19T09:35:06.172 INFO:tasks.workunit.client.1.smithi191.stdout:7/805: dread - d2/d39/d3a/d3c/fe0 zero size 2024-09-19T09:35:06.174 INFO:tasks.workunit.client.1.smithi191.stdout:5/791: mkdir d0/da7/d116 0 2024-09-19T09:35:06.174 INFO:tasks.workunit.client.1.smithi191.stdout:1/810: dwrite d3/d9/da/d1e/d25/fe9 [0,4194304] 0 2024-09-19T09:35:06.176 INFO:tasks.workunit.client.1.smithi191.stdout:7/806: getdents d2/d2a/d79/da8/db9 0 2024-09-19T09:35:06.179 INFO:tasks.workunit.client.1.smithi191.stdout:2/770: dread d8/d11/d3f/d8a/fae [0,4194304] 0 2024-09-19T09:35:06.182 INFO:tasks.workunit.client.1.smithi191.stdout:1/811: truncate d3/d9/da/d1e/d32/d53/dd8/fdb 767373 0 2024-09-19T09:35:06.182 INFO:tasks.workunit.client.1.smithi191.stdout:3/730: sync 2024-09-19T09:35:06.183 INFO:tasks.workunit.client.1.smithi191.stdout:3/731: chown d12/d13/d1a/d1b/d2e/dab/d51/d62/c9b 339 1 2024-09-19T09:35:06.183 INFO:tasks.workunit.client.1.smithi191.stdout:3/732: stat d12/d13/d1a/df7 0 2024-09-19T09:35:06.183 INFO:tasks.workunit.client.1.smithi191.stdout:3/733: dread - d12/d13/dc9/f8e zero size 2024-09-19T09:35:06.183 INFO:tasks.workunit.client.1.smithi191.stdout:3/734: write d12/d13/d1a/f57 [119063,108080] 0 2024-09-19T09:35:06.183 INFO:tasks.workunit.client.1.smithi191.stdout:1/812: symlink d3/d9/da/d1e/d32/d53/d57/d6d/l12f 0 2024-09-19T09:35:06.183 INFO:tasks.workunit.client.1.smithi191.stdout:4/900: sync 2024-09-19T09:35:06.184 INFO:tasks.workunit.client.1.smithi191.stdout:3/735: fdatasync d12/d13/d1a/d1b/d2e/dab/da6/fc6 0 2024-09-19T09:35:06.185 INFO:tasks.workunit.client.1.smithi191.stdout:7/807: dread d2/d2a/d38/def/ff1 [0,4194304] 0 2024-09-19T09:35:06.186 INFO:tasks.workunit.client.1.smithi191.stdout:3/736: mkdir d12/dff 0 2024-09-19T09:35:06.187 INFO:tasks.workunit.client.1.smithi191.stdout:9/796: dwrite d3/db/d16/d38/f3e [0,4194304] 0 2024-09-19T09:35:06.187 INFO:tasks.workunit.client.1.smithi191.stdout:1/813: getdents d3/d9/da/d1e/d25/d70/da0 0 2024-09-19T09:35:06.187 INFO:tasks.workunit.client.1.smithi191.stdout:1/814: write d3/d9/da/d1e/d32/d53/f1c [233600,128745] 0 2024-09-19T09:35:06.189 INFO:tasks.workunit.client.1.smithi191.stdout:3/737: truncate d12/d13/d1a/d5d/dd1/df0/d91/fb5 144176 0 2024-09-19T09:35:06.189 INFO:tasks.workunit.client.1.smithi191.stdout:3/738: truncate d12/d13/d1a/d1b/d2e/dab/faa 1852002 0 2024-09-19T09:35:06.189 INFO:tasks.workunit.client.1.smithi191.stdout:3/739: fsync d12/d13/dc9/f8e 0 2024-09-19T09:35:06.191 INFO:tasks.workunit.client.1.smithi191.stdout:7/808: getdents d2/d5e/dfc 0 2024-09-19T09:35:06.192 INFO:tasks.workunit.client.1.smithi191.stdout:9/797: rename d3/db/d16/d17/cad to d3/db/d53/da2/db3/dc2/c110 0 2024-09-19T09:35:06.192 INFO:tasks.workunit.client.1.smithi191.stdout:9/798: stat d3/db/d16/d17/d81/da6 0 2024-09-19T09:35:06.193 INFO:tasks.workunit.client.1.smithi191.stdout:7/809: truncate d2/d2a/d38/d63/da2/fcf 119546 0 2024-09-19T09:35:06.193 INFO:tasks.workunit.client.1.smithi191.stdout:2/771: write d8/d11/dc2/fea [3293287,36572] 0 2024-09-19T09:35:06.194 INFO:tasks.workunit.client.1.smithi191.stdout:9/799: link d3/d60/d78/d102/l10f d3/db/d16/d17/d3c/dd0/l111 0 2024-09-19T09:35:06.195 INFO:tasks.workunit.client.1.smithi191.stdout:7/810: link d2/d2a/d38/fcd d2/d2a/d4f/d78/f117 0 2024-09-19T09:35:06.196 INFO:tasks.workunit.client.1.smithi191.stdout:1/815: dread d3/d9/da/db/d48/f9a [0,4194304] 0 2024-09-19T09:35:06.196 INFO:tasks.workunit.client.1.smithi191.stdout:1/816: write d3/d9/da/d1e/d25/d70/da0/fbf [536133,131044] 0 2024-09-19T09:35:06.196 INFO:tasks.workunit.client.1.smithi191.stdout:1/817: creat d3/d9/d73/f130 x:0 0 0 2024-09-19T09:35:06.197 INFO:tasks.workunit.client.1.smithi191.stdout:9/800: mkdir d3/d60/d112 0 2024-09-19T09:35:06.197 INFO:tasks.workunit.client.1.smithi191.stdout:9/801: fsync d3/db6/fbb 0 2024-09-19T09:35:06.199 INFO:tasks.workunit.client.1.smithi191.stdout:9/802: mknod d3/db/d16/d17/d3c/c113 0 2024-09-19T09:35:06.200 INFO:tasks.workunit.client.1.smithi191.stdout:8/937: dwrite d1/d22/f58 [4194304,4194304] 0 2024-09-19T09:35:06.200 INFO:tasks.workunit.client.1.smithi191.stdout:8/938: truncate d1/d7/d1a/d6d/de1/d6b/d83/f125 380426 0 2024-09-19T09:35:06.200 INFO:tasks.workunit.client.1.smithi191.stdout:8/939: stat d1/d7/d1a/d6d/de1/d6b/d83/dab/l10f 0 2024-09-19T09:35:06.200 INFO:tasks.workunit.client.1.smithi191.stdout:9/803: creat d3/db/d16/d17/d5b/f114 x:0 0 0 2024-09-19T09:35:06.205 INFO:tasks.workunit.client.1.smithi191.stdout:6/669: dwrite d2/de/d19/d1e/fba [0,4194304] 0 2024-09-19T09:35:06.208 INFO:tasks.workunit.client.1.smithi191.stdout:7/811: write d2/d2a/d33/f3e [2749810,86108] 0 2024-09-19T09:35:06.208 INFO:tasks.workunit.client.1.smithi191.stdout:7/812: creat d2/d2a/d38/dd4/f118 x:0 0 0 2024-09-19T09:35:06.209 INFO:tasks.workunit.client.1.smithi191.stdout:5/792: dwrite d0/d4/d4a/f60 [0,4194304] 0 2024-09-19T09:35:06.209 INFO:tasks.workunit.client.1.smithi191.stdout:5/793: write d0/d4/d9/f1e [1284231,85617] 0 2024-09-19T09:35:06.209 INFO:tasks.workunit.client.1.smithi191.stdout:9/804: dread d3/db/d16/d38/ffd [0,4194304] 0 2024-09-19T09:35:06.212 INFO:tasks.workunit.client.1.smithi191.stdout:7/813: link d2/c82 d2/d2a/d4f/d59/dfb/c119 0 2024-09-19T09:35:06.214 INFO:tasks.workunit.client.1.smithi191.stdout:8/940: dread d1/d16/d2e/f93 [0,4194304] 0 2024-09-19T09:35:06.224 INFO:tasks.workunit.client.1.smithi191.stdout:3/740: dwrite d12/d43/d61/d98/dc4/fe5 [0,4194304] 0 2024-09-19T09:35:06.224 INFO:tasks.workunit.client.1.smithi191.stdout:3/741: dread - d12/d13/d1a/d1b/d3c/d3f/f67 zero size 2024-09-19T09:35:06.225 INFO:tasks.workunit.client.1.smithi191.stdout:2/772: dwrite d8/d2a/f61 [0,4194304] 0 2024-09-19T09:35:06.225 INFO:tasks.workunit.client.1.smithi191.stdout:1/818: dwrite d3/d9/da/d1e/d25/d70/da0/fd0 [0,4194304] 0 2024-09-19T09:35:06.226 INFO:tasks.workunit.client.1.smithi191.stdout:6/670: dread d2/de/d19/d1e/d64/f2c [4194304,4194304] 0 2024-09-19T09:35:06.228 INFO:tasks.workunit.client.1.smithi191.stdout:7/814: truncate d2/f40 197357 0 2024-09-19T09:35:06.230 INFO:tasks.workunit.client.1.smithi191.stdout:8/941: creat d1/d16/d3c/f13b x:0 0 0 2024-09-19T09:35:06.230 INFO:tasks.workunit.client.1.smithi191.stdout:8/942: fsync d1/d7/d1a/d6d/da8/fcf 0 2024-09-19T09:35:06.231 INFO:tasks.workunit.client.1.smithi191.stdout:9/805: rmdir d3/db/d16/d17/d81/db5 39 2024-09-19T09:35:06.233 INFO:tasks.workunit.client.1.smithi191.stdout:3/742: unlink d12/d13/d1a/d1b/d60/lc0 0 2024-09-19T09:35:06.233 INFO:tasks.workunit.client.1.smithi191.stdout:3/743: dread - d12/d13/dc9/d73/fbb zero size 2024-09-19T09:35:06.233 INFO:tasks.workunit.client.1.smithi191.stdout:3/744: dread - d12/d13/dc9/f8e zero size 2024-09-19T09:35:06.234 INFO:tasks.workunit.client.1.smithi191.stdout:5/794: dwrite d0/d77/fea [0,4194304] 0 2024-09-19T09:35:06.234 INFO:tasks.workunit.client.1.smithi191.stdout:5/795: fdatasync d0/d4/d9/d1d/d29/d7f/d94/fa1 0 2024-09-19T09:35:06.236 INFO:tasks.workunit.client.1.smithi191.stdout:2/773: symlink d8/db/d4d/de6/d70/de8/l106 0 2024-09-19T09:35:06.240 INFO:tasks.workunit.client.1.smithi191.stdout:3/745: symlink d12/d43/d61/d98/l100 0 2024-09-19T09:35:06.247 INFO:tasks.workunit.client.1.smithi191.stdout:1/819: write d3/d9/da/db/f86 [3246084,19693] 0 2024-09-19T09:35:06.254 INFO:tasks.workunit.client.1.smithi191.stdout:6/671: dwrite d2/de/d19/d1e/fb6 [0,4194304] 0 2024-09-19T09:35:06.254 INFO:tasks.workunit.client.1.smithi191.stdout:6/672: creat d2/de/d2a/d2d/d30/d98/d9b/d65/d89/fd0 x:0 0 0 2024-09-19T09:35:06.254 INFO:tasks.workunit.client.1.smithi191.stdout:9/806: rmdir d3/db 39 2024-09-19T09:35:06.254 INFO:tasks.workunit.client.1.smithi191.stdout:3/746: mkdir d12/d13/d1a/d5d/dd1/de9/d101 0 2024-09-19T09:35:06.255 INFO:tasks.workunit.client.1.smithi191.stdout:2/774: mkdir d8/d11/d3f/d8a/d107 0 2024-09-19T09:35:06.258 INFO:tasks.workunit.client.1.smithi191.stdout:1/820: rename d3/d9/da/d8c to d3/d9/da/d1e/d32/d53/d57/d121/d131 0 2024-09-19T09:35:06.258 INFO:tasks.workunit.client.1.smithi191.stdout:5/796: dwrite d0/d4/f107 [0,4194304] 0 2024-09-19T09:35:06.259 INFO:tasks.workunit.client.1.smithi191.stdout:8/943: dwrite d1/d22/d47/f100 [0,4194304] 0 2024-09-19T09:35:06.259 INFO:tasks.workunit.client.1.smithi191.stdout:8/944: write d1/d16/d3c/d17/da1/d84/dbc/f134 [184355,64986] 0 2024-09-19T09:35:06.260 INFO:tasks.workunit.client.1.smithi191.stdout:8/945: dread d1/d16/d3c/d28/d79/da2/fc4 [0,4194304] 0 2024-09-19T09:35:06.260 INFO:tasks.workunit.client.1.smithi191.stdout:6/673: creat d2/de/d2a/d2d/dc7/fd1 x:0 0 0 2024-09-19T09:35:06.261 INFO:tasks.workunit.client.1.smithi191.stdout:6/674: read d2/de/f1d [1959085,116046] 0 2024-09-19T09:35:06.261 INFO:tasks.workunit.client.1.smithi191.stdout:3/747: link d12/d13/d1a/d1b/fd2 d12/d13/d1a/d5d/dd1/df0/d91/f102 0 2024-09-19T09:35:06.261 INFO:tasks.workunit.client.1.smithi191.stdout:3/748: chown d12/d13/d1a/d5d/dd1/df0 0 1 2024-09-19T09:35:06.262 INFO:tasks.workunit.client.1.smithi191.stdout:2/775: mknod d8/d11/d3f/dfa/c108 0 2024-09-19T09:35:06.267 INFO:tasks.workunit.client.1.smithi191.stdout:8/946: link d1/d7/d1a/f63 d1/d7/f13c 0 2024-09-19T09:35:06.267 INFO:tasks.workunit.client.1.smithi191.stdout:8/947: dread - d1/d7/d1a/d6d/de1/d6b/fd8 zero size 2024-09-19T09:35:06.269 INFO:tasks.workunit.client.1.smithi191.stdout:3/749: creat d12/d13/d1a/d1b/d60/d7a/f103 x:0 0 0 2024-09-19T09:35:06.271 INFO:tasks.workunit.client.1.smithi191.stdout:2/776: mkdir d8/d11/d56/d109 0 2024-09-19T09:35:06.272 INFO:tasks.workunit.client.1.smithi191.stdout:9/807: dwrite d3/db/f11 [0,4194304] 0 2024-09-19T09:35:06.273 INFO:tasks.workunit.client.1.smithi191.stdout:2/777: read d8/db/d4d/de6/f48 [72961,36147] 0 2024-09-19T09:35:06.273 INFO:tasks.workunit.client.1.smithi191.stdout:6/675: getdents d2/de/d19/d1e/d64/d76 0 2024-09-19T09:35:06.274 INFO:tasks.workunit.client.1.smithi191.stdout:9/808: symlink d3/db/d16/d47/d55/l115 0 2024-09-19T09:35:06.274 INFO:tasks.workunit.client.1.smithi191.stdout:9/809: chown d3/d8/cd6 6083654 1 2024-09-19T09:35:06.274 INFO:tasks.workunit.client.1.smithi191.stdout:9/810: write d3/d60/d78/fbe [612843,87385] 0 2024-09-19T09:35:06.276 INFO:tasks.workunit.client.1.smithi191.stdout:9/811: creat d3/db/d16/d17/f116 x:0 0 0 2024-09-19T09:35:06.280 INFO:tasks.workunit.client.1.smithi191.stdout:6/676: rename d2/de/d2a/dc9 to d2/de/d19/d1e/dd2 0 2024-09-19T09:35:06.280 INFO:tasks.workunit.client.1.smithi191.stdout:6/677: chown d2/de/f27 1868381 1 2024-09-19T09:35:06.282 INFO:tasks.workunit.client.1.smithi191.stdout:0/897: sync 2024-09-19T09:35:06.293 INFO:tasks.workunit.client.1.smithi191.stdout:8/948: dwrite d1/d7/d1a/d6d/de1/d6b/fbd [0,4194304] 0 2024-09-19T09:35:06.294 INFO:tasks.workunit.client.1.smithi191.stdout:6/678: write d2/de/d2a/d39/f71 [3182248,124350] 0 2024-09-19T09:35:06.295 INFO:tasks.workunit.client.1.smithi191.stdout:2/778: dwrite d8/d11/f46 [4194304,4194304] 0 2024-09-19T09:35:06.296 INFO:tasks.workunit.client.1.smithi191.stdout:8/949: symlink d1/d16/d3c/l13d 0 2024-09-19T09:35:06.296 INFO:tasks.workunit.client.1.smithi191.stdout:8/950: write d1/d16/d2e/d32/f117 [735961,45854] 0 2024-09-19T09:35:06.297 INFO:tasks.workunit.client.1.smithi191.stdout:6/679: symlink d2/de/d2a/d2d/d30/d98/d9b/ld3 0 2024-09-19T09:35:06.298 INFO:tasks.workunit.client.1.smithi191.stdout:6/680: symlink d2/de/d19/d1e/ld4 0 2024-09-19T09:35:06.300 INFO:tasks.workunit.client.1.smithi191.stdout:0/898: dread d0/d9/d1c/d1f/f85 [0,4194304] 0 2024-09-19T09:35:06.300 INFO:tasks.workunit.client.1.smithi191.stdout:0/899: dread - d0/d9/de/d61/fde zero size 2024-09-19T09:35:06.301 INFO:tasks.workunit.client.1.smithi191.stdout:0/900: truncate d0/d6f/d76/f88 4487735 0 2024-09-19T09:35:06.301 INFO:tasks.workunit.client.1.smithi191.stdout:3/750: dwrite d12/d13/d1a/d5d/dc8/dd5/ffa [0,4194304] 0 2024-09-19T09:35:06.301 INFO:tasks.workunit.client.1.smithi191.stdout:3/751: fsync d12/d13/d1a/d1b/d3c/f80 0 2024-09-19T09:35:06.301 INFO:tasks.workunit.client.1.smithi191.stdout:3/752: readlink d12/d13/l6c 0 2024-09-19T09:35:06.301 INFO:tasks.workunit.client.1.smithi191.stdout:3/753: truncate d12/d13/d1a/d1b/d2e/dab/d51/d62/d85/fde 545281 0 2024-09-19T09:35:06.303 INFO:tasks.workunit.client.1.smithi191.stdout:3/754: creat d12/d13/d1a/d1b/d3c/dd8/f104 x:0 0 0 2024-09-19T09:35:06.305 INFO:tasks.workunit.client.1.smithi191.stdout:8/951: dread d1/d22/d47/f10b [0,4194304] 0 2024-09-19T09:35:06.305 INFO:tasks.workunit.client.1.smithi191.stdout:8/952: write d1/d16/d2e/f93 [4232696,116882] 0 2024-09-19T09:35:06.306 INFO:tasks.workunit.client.1.smithi191.stdout:8/953: fdatasync d1/d16/d3c/d28/fa0 0 2024-09-19T09:35:06.306 INFO:tasks.workunit.client.1.smithi191.stdout:8/954: chown d1/d7/d1a/d6d/de1/d6b/da9/f127 2662624 1 2024-09-19T09:35:06.306 INFO:tasks.workunit.client.1.smithi191.stdout:3/755: link d12/d13/f14 d12/d13/dc9/d73/f105 0 2024-09-19T09:35:06.306 INFO:tasks.workunit.client.1.smithi191.stdout:3/756: readlink d12/d13/d1a/d1b/d60/d7a/d93/lce 0 2024-09-19T09:35:06.307 INFO:tasks.workunit.client.1.smithi191.stdout:8/955: truncate d1/f36 78471 0 2024-09-19T09:35:06.309 INFO:tasks.workunit.client.1.smithi191.stdout:8/956: mknod d1/d7/d1a/d6d/de1/d6b/da9/dc1/c13e 0 2024-09-19T09:35:06.309 INFO:tasks.workunit.client.1.smithi191.stdout:8/957: write d1/d22/d47/f5a [374576,45854] 0 2024-09-19T09:35:06.309 INFO:tasks.workunit.client.1.smithi191.stdout:8/958: chown d1/d16/d2e/d32/de7 5631478 1 2024-09-19T09:35:06.311 INFO:tasks.workunit.client.1.smithi191.stdout:8/959: mknod d1/d7/d1a/d6d/de1/d6b/c13f 0 2024-09-19T09:35:06.314 INFO:tasks.workunit.client.1.smithi191.stdout:8/960: rename d1/d16/d3c/d28/d12f to d1/d7/d1a/d6d/d140 0 2024-09-19T09:35:06.316 INFO:tasks.workunit.client.1.smithi191.stdout:6/681: dread d2/de/d2a/d2d/d30/d98/d9b/f68 [0,4194304] 0 2024-09-19T09:35:06.321 INFO:tasks.workunit.client.1.smithi191.stdout:6/682: creat d2/de/d19/d1e/d64/d61/d81/da7/db8/fd5 x:0 0 0 2024-09-19T09:35:06.322 INFO:tasks.workunit.client.1.smithi191.stdout:8/961: rename d1/d22/d47 to d1/d16/d3c/d141 0 2024-09-19T09:35:06.324 INFO:tasks.workunit.client.1.smithi191.stdout:6/683: mkdir d2/de/d19/d1e/dd6 0 2024-09-19T09:35:06.324 INFO:tasks.workunit.client.1.smithi191.stdout:6/684: dread - d2/de/d15/f74 zero size 2024-09-19T09:35:06.324 INFO:tasks.workunit.client.1.smithi191.stdout:8/962: mknod d1/d7/d1a/d6d/de1/d6b/da9/dc1/c142 0 2024-09-19T09:35:06.325 INFO:tasks.workunit.client.1.smithi191.stdout:6/685: mknod d2/de/d2a/d2d/d30/da4/cd7 0 2024-09-19T09:35:06.326 INFO:tasks.workunit.client.1.smithi191.stdout:8/963: creat d1/d16/d2e/d32/d7e/f143 x:0 0 0 2024-09-19T09:35:06.327 INFO:tasks.workunit.client.1.smithi191.stdout:6/686: rmdir d2/de/d2a/d2d/d30/d98/d9b/d65/dcc 0 2024-09-19T09:35:06.328 INFO:tasks.workunit.client.1.smithi191.stdout:8/964: mknod d1/d16/d3c/db0/c144 0 2024-09-19T09:35:06.329 INFO:tasks.workunit.client.1.smithi191.stdout:6/687: rename d2/de/d19/d1e/d64/d61/d81/da7/fc3 to d2/de/d2a/d2d/dc7/fd8 0 2024-09-19T09:35:06.329 INFO:tasks.workunit.client.1.smithi191.stdout:6/688: write d2/de/d2a/d2d/d30/da4/faa [970088,17038] 0 2024-09-19T09:35:06.329 INFO:tasks.workunit.client.1.smithi191.stdout:6/689: chown d2/de/d19/d1e/d64/d77/d82/fc5 52147864 1 2024-09-19T09:35:06.329 INFO:tasks.workunit.client.1.smithi191.stdout:6/690: readlink d2/de/d19/l43 0 2024-09-19T09:35:06.330 INFO:tasks.workunit.client.1.smithi191.stdout:8/965: creat d1/d16/d2e/d32/d7e/d8b/dfd/f145 x:0 0 0 2024-09-19T09:35:06.330 INFO:tasks.workunit.client.1.smithi191.stdout:8/966: write d1/d22/d113/f119 [420489,49688] 0 2024-09-19T09:35:06.330 INFO:tasks.workunit.client.1.smithi191.stdout:8/967: fsync d1/d16/d2e/d32/dc5/f121 0 2024-09-19T09:35:06.331 INFO:tasks.workunit.client.1.smithi191.stdout:8/968: creat d1/d7/d1a/d6d/de1/d6b/d83/dab/d106/f146 x:0 0 0 2024-09-19T09:35:06.332 INFO:tasks.workunit.client.1.smithi191.stdout:3/757: dwrite d12/d13/dc9/d73/f105 [0,4194304] 0 2024-09-19T09:35:06.334 INFO:tasks.workunit.client.1.smithi191.stdout:0/901: dwrite d0/d9/d1c/d1f/d24/d39/d8b/fb7 [0,4194304] 0 2024-09-19T09:35:06.337 INFO:tasks.workunit.client.1.smithi191.stdout:0/902: mknod d0/d9/d1c/d1f/d24/d39/c120 0 2024-09-19T09:35:06.337 INFO:tasks.workunit.client.1.smithi191.stdout:0/903: write d0/dc5/dc1/fad [917785,113641] 0 2024-09-19T09:35:06.337 INFO:tasks.workunit.client.1.smithi191.stdout:0/904: read - d0/d9/d1c/d1f/d24/d39/f95 zero size 2024-09-19T09:35:06.337 INFO:tasks.workunit.client.1.smithi191.stdout:0/905: read d0/d9/d1c/d1f/d24/f3f [4061457,35691] 0 2024-09-19T09:35:06.337 INFO:tasks.workunit.client.1.smithi191.stdout:0/906: creat d0/d9/de/d61/f121 x:0 0 0 2024-09-19T09:35:06.344 INFO:tasks.workunit.client.1.smithi191.stdout:8/969: dread d1/d7/d1a/d6d/de1/d6b/fbd [0,4194304] 0 2024-09-19T09:35:06.344 INFO:tasks.workunit.client.1.smithi191.stdout:8/970: chown d1/d16/d2e/d32/de7 965851 1 2024-09-19T09:35:06.353 INFO:tasks.workunit.client.1.smithi191.stdout:6/691: dwrite d2/de/d2a/d2d/dc7/fd8 [0,4194304] 0 2024-09-19T09:35:06.362 INFO:tasks.workunit.client.1.smithi191.stdout:3/758: dwrite d12/d13/d1a/d1b/d60/d7a/d93/f94 [0,4194304] 0 2024-09-19T09:35:06.362 INFO:tasks.workunit.client.1.smithi191.stdout:3/759: write d12/d13/d1a/d1b/d3c/d3f/f67 [817964,15935] 0 2024-09-19T09:35:06.364 INFO:tasks.workunit.client.1.smithi191.stdout:3/760: creat d12/d13/d1a/d1b/d2e/dab/da6/f106 x:0 0 0 2024-09-19T09:35:06.364 INFO:tasks.workunit.client.1.smithi191.stdout:3/761: fdatasync d12/d13/d1a/d1b/d2e/f53 0 2024-09-19T09:35:06.367 INFO:tasks.workunit.client.1.smithi191.stdout:3/762: rename d12/d13/d1a/d1b/d2e/dab/d51/d62/d85 to d12/d107 0 2024-09-19T09:35:06.368 INFO:tasks.workunit.client.1.smithi191.stdout:3/763: creat d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/f108 x:0 0 0 2024-09-19T09:35:06.369 INFO:tasks.workunit.client.1.smithi191.stdout:3/764: rmdir d12/d43/d61/d98 39 2024-09-19T09:35:06.371 INFO:tasks.workunit.client.1.smithi191.stdout:3/765: rename d12/d43/d61/ld7 to d12/d13/d1a/d5d/dd1/df0/l109 0 2024-09-19T09:35:06.371 INFO:tasks.workunit.client.1.smithi191.stdout:3/766: chown d12/d107 5072468 1 2024-09-19T09:35:06.371 INFO:tasks.workunit.client.1.smithi191.stdout:3/767: fdatasync d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/fb3 0 2024-09-19T09:35:06.371 INFO:tasks.workunit.client.1.smithi191.stdout:3/768: rmdir d12/d13/d1a/d5d/dd1/df0 39 2024-09-19T09:35:06.372 INFO:tasks.workunit.client.1.smithi191.stdout:3/769: symlink d12/d43/d61/d98/l10a 0 2024-09-19T09:35:06.372 INFO:tasks.workunit.client.1.smithi191.stdout:3/770: write f9 [4269225,70023] 0 2024-09-19T09:35:06.372 INFO:tasks.workunit.client.1.smithi191.stdout:3/771: chown d12/d107/da0 6576 1 2024-09-19T09:35:06.373 INFO:tasks.workunit.client.1.smithi191.stdout:3/772: creat d12/d43/f10b x:0 0 0 2024-09-19T09:35:06.373 INFO:tasks.workunit.client.1.smithi191.stdout:3/773: creat d12/d13/d1a/d1b/d2e/dab/d51/d62/f10c x:0 0 0 2024-09-19T09:35:06.374 INFO:tasks.workunit.client.1.smithi191.stdout:3/774: mkdir d12/d13/d1a/d1b/d3c/d3f/d10d 0 2024-09-19T09:35:06.374 INFO:tasks.workunit.client.1.smithi191.stdout:3/775: creat d12/d13/d1a/df7/f10e x:0 0 0 2024-09-19T09:35:06.375 INFO:tasks.workunit.client.1.smithi191.stdout:3/776: rmdir d12/d13/dc9 39 2024-09-19T09:35:06.376 INFO:tasks.workunit.client.1.smithi191.stdout:3/777: truncate d12/d13/d1a/f32 198918 0 2024-09-19T09:35:06.378 INFO:tasks.workunit.client.1.smithi191.stdout:6/692: dwrite d2/de/d2a/d39/f62 [0,4194304] 0 2024-09-19T09:35:06.378 INFO:tasks.workunit.client.1.smithi191.stdout:8/971: dwrite d1/d7/dc2/f122 [0,4194304] 0 2024-09-19T09:35:06.378 INFO:tasks.workunit.client.1.smithi191.stdout:0/907: dwrite d0/d9/d1c/d111/f1b [0,4194304] 0 2024-09-19T09:35:06.379 INFO:tasks.workunit.client.1.smithi191.stdout:0/908: chown d0/d9/de 1520099 1 2024-09-19T09:35:06.379 INFO:tasks.workunit.client.1.smithi191.stdout:0/909: dread - d0/d6f/d76/f9d zero size 2024-09-19T09:35:06.379 INFO:tasks.workunit.client.1.smithi191.stdout:0/910: dread - d0/d9/d1c/d1f/d24/d39/ffe zero size 2024-09-19T09:35:06.384 INFO:tasks.workunit.client.1.smithi191.stdout:8/972: rename d1/d16/d2e/d32/d7e/d8b/dfd/l136 to d1/d16/d3c/d28/d79/d12c/l147 0 2024-09-19T09:35:06.384 INFO:tasks.workunit.client.1.smithi191.stdout:8/973: creat d1/d7/dcc/f148 x:0 0 0 2024-09-19T09:35:06.385 INFO:tasks.workunit.client.1.smithi191.stdout:6/693: mknod d2/de/d19/d1e/d64/d77/d82/cd9 0 2024-09-19T09:35:06.388 INFO:tasks.workunit.client.1.smithi191.stdout:0/911: rename d0/dc5/fbd to d0/d9/d1c/d111/f122 0 2024-09-19T09:35:06.390 INFO:tasks.workunit.client.1.smithi191.stdout:8/974: mknod d1/d16/d2e/d57/c149 0 2024-09-19T09:35:06.390 INFO:tasks.workunit.client.1.smithi191.stdout:6/694: stat d2/de/d19/d1e/d64/lb3 0 2024-09-19T09:35:06.390 INFO:tasks.workunit.client.1.smithi191.stdout:6/695: read - d2/de/d19/d5d/f6f zero size 2024-09-19T09:35:06.391 INFO:tasks.workunit.client.1.smithi191.stdout:3/778: dwrite d12/d13/d1a/d1b/d60/d7a/d93/fe2 [0,4194304] 0 2024-09-19T09:35:06.392 INFO:tasks.workunit.client.1.smithi191.stdout:0/912: mknod d0/d9/d1c/deb/c123 0 2024-09-19T09:35:06.392 INFO:tasks.workunit.client.1.smithi191.stdout:0/913: chown d0/d9/de/d61/f10e 138 1 2024-09-19T09:35:06.392 INFO:tasks.workunit.client.1.smithi191.stdout:8/975: getdents d1/d16/d2e/d32/dc5/dce 0 2024-09-19T09:35:06.396 INFO:tasks.workunit.client.1.smithi191.stdout:0/914: rename d0/d6f/d76/f9d to d0/d9/d1c/d1f/de3/f124 0 2024-09-19T09:35:06.397 INFO:tasks.workunit.client.1.smithi191.stdout:6/696: dread d2/de/d2a/d2d/f1b [0,4194304] 0 2024-09-19T09:35:06.398 INFO:tasks.workunit.client.1.smithi191.stdout:8/976: creat d1/d7/d1a/d6d/d12a/f14a x:0 0 0 2024-09-19T09:35:06.398 INFO:tasks.workunit.client.1.smithi191.stdout:8/977: readlink d1/d7/l18 0 2024-09-19T09:35:06.398 INFO:tasks.workunit.client.1.smithi191.stdout:8/978: write d1/d16/d3c/d28/d79/da2/fa3 [558627,123037] 0 2024-09-19T09:35:06.398 INFO:tasks.workunit.client.1.smithi191.stdout:4/901: sync 2024-09-19T09:35:06.401 INFO:tasks.workunit.client.1.smithi191.stdout:6/697: rename d2/de/d2a/d2d/d30/l5c to d2/de/d2a/d2d/d30/da4/lda 0 2024-09-19T09:35:06.401 INFO:tasks.workunit.client.1.smithi191.stdout:6/698: dread - d2/de/d2a/d2d/d30/d98/d9b/d65/d89/fad zero size 2024-09-19T09:35:06.406 INFO:tasks.workunit.client.1.smithi191.stdout:8/979: dread d1/d16/d3c/d17/f9a [0,4194304] 0 2024-09-19T09:35:06.406 INFO:tasks.workunit.client.1.smithi191.stdout:8/980: stat d1/d16/d3c/d141/d9d/f11d 0 2024-09-19T09:35:06.406 INFO:tasks.workunit.client.1.smithi191.stdout:8/981: truncate d1/d16/d3c/f31 2668619 0 2024-09-19T09:35:06.406 INFO:tasks.workunit.client.1.smithi191.stdout:8/982: chown d1/d16/d3c/d17/ldf 21932 1 2024-09-19T09:35:06.406 INFO:tasks.workunit.client.1.smithi191.stdout:4/902: rename d5/dfb/dfd/d24/d82/df2/l108 to d5/dfb/dfd/d24/d32/d21/d4a/dc5/l11c 0 2024-09-19T09:35:06.406 INFO:tasks.workunit.client.1.smithi191.stdout:0/915: dread d0/d9/d1c/f7e [0,4194304] 0 2024-09-19T09:35:06.407 INFO:tasks.workunit.client.1.smithi191.stdout:6/699: mkdir d2/de/d19/d1e/d64/d61/d81/da7/db8/ddb 0 2024-09-19T09:35:06.408 INFO:tasks.workunit.client.1.smithi191.stdout:4/903: symlink d5/dfb/dfd/dea/l11d 0 2024-09-19T09:35:06.409 INFO:tasks.workunit.client.1.smithi191.stdout:6/700: mknod d2/de/cdc 0 2024-09-19T09:35:06.409 INFO:tasks.workunit.client.1.smithi191.stdout:4/904: getdents d5/dfb/dfd/d24/d32 0 2024-09-19T09:35:06.410 INFO:tasks.workunit.client.1.smithi191.stdout:6/701: symlink d2/de/d19/d1e/d64/d61/d81/da7/ldd 0 2024-09-19T09:35:06.413 INFO:tasks.workunit.client.1.smithi191.stdout:3/779: dwrite d12/d13/d1a/d1b/fe6 [0,4194304] 0 2024-09-19T09:35:06.413 INFO:tasks.workunit.client.1.smithi191.stdout:3/780: write d12/d13/d1a/d1b/d60/f8d [419261,58806] 0 2024-09-19T09:35:06.413 INFO:tasks.workunit.client.1.smithi191.stdout:4/905: link f1 d5/d106/f11e 0 2024-09-19T09:35:06.413 INFO:tasks.workunit.client.1.smithi191.stdout:4/906: fsync d5/dfb/dfd/d24/d32/d21/d4a/dc5/de3/fef 0 2024-09-19T09:35:06.420 INFO:tasks.workunit.client.1.smithi191.stdout:3/781: truncate d12/d13/d1a/d1b/d2e/dab/d51/fb9 184647 0 2024-09-19T09:35:06.420 INFO:tasks.workunit.client.1.smithi191.stdout:8/983: write d1/d22/f58 [5950192,107173] 0 2024-09-19T09:35:06.421 INFO:tasks.workunit.client.1.smithi191.stdout:4/907: creat d5/dfb/dfd/df9/f11f x:0 0 0 2024-09-19T09:35:06.424 INFO:tasks.workunit.client.1.smithi191.stdout:4/908: mkdir d5/dfb/dfd/df9/d88/d10c/d120 0 2024-09-19T09:35:06.426 INFO:tasks.workunit.client.1.smithi191.stdout:4/909: symlink d5/dfb/dfd/d28/d96/l121 0 2024-09-19T09:35:06.427 INFO:tasks.workunit.client.1.smithi191.stdout:1/821: sync 2024-09-19T09:35:06.427 INFO:tasks.workunit.client.1.smithi191.stdout:7/815: sync 2024-09-19T09:35:06.427 INFO:tasks.workunit.client.1.smithi191.stdout:7/816: write d2/d39/ff0 [755267,34344] 0 2024-09-19T09:35:06.427 INFO:tasks.workunit.client.1.smithi191.stdout:7/817: fdatasync d2/d2a/f31 0 2024-09-19T09:35:06.428 INFO:tasks.workunit.client.1.smithi191.stdout:0/916: dwrite d0/d9/d1c/d1f/d24/d29/f49 [0,4194304] 0 2024-09-19T09:35:06.428 INFO:tasks.workunit.client.1.smithi191.stdout:0/917: chown d0/d9/d1c/d1f/d24/d29/f78 181574504 1 2024-09-19T09:35:06.428 INFO:tasks.workunit.client.1.smithi191.stdout:0/918: readlink d0/d6f/d76/lcb 0 2024-09-19T09:35:06.428 INFO:tasks.workunit.client.1.smithi191.stdout:0/919: write d0/d9/d1c/d1f/d24/d29/faf [1004555,546] 0 2024-09-19T09:35:06.428 INFO:tasks.workunit.client.1.smithi191.stdout:1/822: mkdir d3/d9/d73/d132 0 2024-09-19T09:35:06.429 INFO:tasks.workunit.client.1.smithi191.stdout:1/823: dread - d3/d9/d73/fd4 zero size 2024-09-19T09:35:06.429 INFO:tasks.workunit.client.1.smithi191.stdout:1/824: write d3/d9/ff8 [751133,44812] 0 2024-09-19T09:35:06.429 INFO:tasks.workunit.client.1.smithi191.stdout:7/818: rename d2/d39/d3a/d3c/fe0 to d2/d2a/d38/d63/dc1/f11a 0 2024-09-19T09:35:06.430 INFO:tasks.workunit.client.1.smithi191.stdout:7/819: truncate d2/d2a/d4f/d59/d81/fcc 422315 0 2024-09-19T09:35:06.433 INFO:tasks.workunit.client.1.smithi191.stdout:3/782: write d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/f8a [7478307,30334] 0 2024-09-19T09:35:06.434 INFO:tasks.workunit.client.1.smithi191.stdout:4/910: dread d5/fa [0,4194304] 0 2024-09-19T09:35:06.434 INFO:tasks.workunit.client.1.smithi191.stdout:0/920: mknod d0/d9/d1c/d1f/d24/d29/c125 0 2024-09-19T09:35:06.435 INFO:tasks.workunit.client.1.smithi191.stdout:1/825: unlink d3/d9/da/d1e/d32/d53/d57/d6d/da1/db5/c10a 0 2024-09-19T09:35:06.436 INFO:tasks.workunit.client.1.smithi191.stdout:1/826: fsync d3/d9/da/d1e/d25/d70/da0/fbf 0 2024-09-19T09:35:06.437 INFO:tasks.workunit.client.1.smithi191.stdout:7/820: unlink d2/d39/d3a/d3c/f56 0 2024-09-19T09:35:06.437 INFO:tasks.workunit.client.1.smithi191.stdout:8/984: dwrite d1/d16/fed [0,4194304] 0 2024-09-19T09:35:06.439 INFO:tasks.workunit.client.1.smithi191.stdout:3/783: rename l6 to d12/d13/d1a/d1b/d60/d7a/l10f 0 2024-09-19T09:35:06.440 INFO:tasks.workunit.client.1.smithi191.stdout:4/911: mkdir d5/dfb/dfd/d24/d32/d21/d56/d116/d122 0 2024-09-19T09:35:06.440 INFO:tasks.workunit.client.1.smithi191.stdout:4/912: stat d5/dfb/dfd/d24/c33 0 2024-09-19T09:35:06.441 INFO:tasks.workunit.client.1.smithi191.stdout:4/913: chown d5/d38/c68 37 1 2024-09-19T09:35:06.441 INFO:tasks.workunit.client.1.smithi191.stdout:4/914: chown d5/dfb/dfd/d24/d32/d21/d4a/lf5 421027340 1 2024-09-19T09:35:06.441 INFO:tasks.workunit.client.1.smithi191.stdout:3/784: dread d12/d13/d1a/d5d/dd1/df0/d91/fb7 [0,4194304] 0 2024-09-19T09:35:06.442 INFO:tasks.workunit.client.1.smithi191.stdout:0/921: unlink d0/fb4 0 2024-09-19T09:35:06.442 INFO:tasks.workunit.client.1.smithi191.stdout:4/915: write d5/dfb/dfd/d24/d32/d21/d4a/f7f [823764,43356] 0 2024-09-19T09:35:06.442 INFO:tasks.workunit.client.1.smithi191.stdout:0/922: write d0/d9/d1c/d20/f31 [3827117,81957] 0 2024-09-19T09:35:06.442 INFO:tasks.workunit.client.1.smithi191.stdout:5/797: sync 2024-09-19T09:35:06.442 INFO:tasks.workunit.client.1.smithi191.stdout:2/779: sync 2024-09-19T09:35:06.442 INFO:tasks.workunit.client.1.smithi191.stdout:9/812: sync 2024-09-19T09:35:06.443 INFO:tasks.workunit.client.1.smithi191.stdout:9/813: write d3/db/d16/d17/d3c/fa4 [60640,49549] 0 2024-09-19T09:35:06.443 INFO:tasks.workunit.client.1.smithi191.stdout:1/827: symlink d3/d9/da/d1e/df9/l133 0 2024-09-19T09:35:06.444 INFO:tasks.workunit.client.1.smithi191.stdout:7/821: symlink d2/d2a/d38/l11b 0 2024-09-19T09:35:06.447 INFO:tasks.workunit.client.1.smithi191.stdout:3/785: creat d12/d13/d1a/d1b/d3c/f110 x:0 0 0 2024-09-19T09:35:06.450 INFO:tasks.workunit.client.1.smithi191.stdout:0/923: rename d0/d9/d1c/d1f/d24/d39/f11c to d0/d9/d1c/d1f/d24/d29/d30/d7c/f126 0 2024-09-19T09:35:06.451 INFO:tasks.workunit.client.1.smithi191.stdout:2/780: creat d8/d11/d56/f10a x:0 0 0 2024-09-19T09:35:06.452 INFO:tasks.workunit.client.1.smithi191.stdout:5/798: mkdir d0/d4/d9/d1d/d29/d33/d45/d64/de7/d117 0 2024-09-19T09:35:06.453 INFO:tasks.workunit.client.1.smithi191.stdout:9/814: creat d3/db/d53/dec/f117 x:0 0 0 2024-09-19T09:35:06.454 INFO:tasks.workunit.client.1.smithi191.stdout:1/828: unlink d3/d9/da/d1e/d32/ca9 0 2024-09-19T09:35:06.454 INFO:tasks.workunit.client.1.smithi191.stdout:1/829: truncate d3/f87 626697 0 2024-09-19T09:35:06.455 INFO:tasks.workunit.client.1.smithi191.stdout:1/830: write d3/d9/da/d1e/d25/d70/da0/fbf [867317,30324] 0 2024-09-19T09:35:06.455 INFO:tasks.workunit.client.1.smithi191.stdout:7/822: creat d2/d2a/d38/d63/d9a/f11c x:0 0 0 2024-09-19T09:35:06.455 INFO:tasks.workunit.client.1.smithi191.stdout:7/823: dread - d2/d2a/d38/dd4/f118 zero size 2024-09-19T09:35:06.456 INFO:tasks.workunit.client.1.smithi191.stdout:3/786: write d12/d43/d61/d98/dc4/fe5 [1952277,81081] 0 2024-09-19T09:35:06.456 INFO:tasks.workunit.client.1.smithi191.stdout:3/787: dread - d12/d13/dc9/d73/fbb zero size 2024-09-19T09:35:06.457 INFO:tasks.workunit.client.1.smithi191.stdout:5/799: link d0/d4/c81 d0/d4/d9/d1d/d29/d33/d45/d97/c118 0 2024-09-19T09:35:06.458 INFO:tasks.workunit.client.1.smithi191.stdout:5/800: write d0/da7/dcd/dd7/dde/fe0 [455724,100006] 0 2024-09-19T09:35:06.459 INFO:tasks.workunit.client.1.smithi191.stdout:9/815: symlink d3/db/d53/da2/db3/l118 0 2024-09-19T09:35:06.462 INFO:tasks.workunit.client.1.smithi191.stdout:7/824: dread d2/d39/d3a/fe4 [0,4194304] 0 2024-09-19T09:35:06.462 INFO:tasks.workunit.client.1.smithi191.stdout:1/831: rename d3/d9/da/d1e/fba to d3/d9/da/d1e/d32/d53/dd8/d113/f134 0 2024-09-19T09:35:06.462 INFO:tasks.workunit.client.1.smithi191.stdout:1/832: stat d3/d9/da/d1e/df9 0 2024-09-19T09:35:06.462 INFO:tasks.workunit.client.1.smithi191.stdout:1/833: truncate d3/d9/da/d1e/d32/ddc/f114 322184 0 2024-09-19T09:35:06.463 INFO:tasks.workunit.client.1.smithi191.stdout:0/924: mkdir d0/d9/d127 0 2024-09-19T09:35:06.466 INFO:tasks.workunit.client.1.smithi191.stdout:9/816: creat d3/db/d16/d38/dd4/ddf/f119 x:0 0 0 2024-09-19T09:35:06.469 INFO:tasks.workunit.client.1.smithi191.stdout:3/788: rename d12/d13/d1a/d1b/d60/d7a/l10f to d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/l111 0 2024-09-19T09:35:06.470 INFO:tasks.workunit.client.1.smithi191.stdout:2/781: dread d8/d11/d3f/f21 [0,4194304] 0 2024-09-19T09:35:06.470 INFO:tasks.workunit.client.1.smithi191.stdout:1/834: rmdir d3/d9/da/d1e/d32/d53/d57/d121/d131 39 2024-09-19T09:35:06.470 INFO:tasks.workunit.client.1.smithi191.stdout:9/817: mkdir d3/db/d53/d11a 0 2024-09-19T09:35:06.472 INFO:tasks.workunit.client.1.smithi191.stdout:8/985: dwrite d1/d7/fb8 [4194304,4194304] 0 2024-09-19T09:35:06.472 INFO:tasks.workunit.client.1.smithi191.stdout:3/789: rename d12/d13/dc9 to d12/d13/d1a/d1b/d3c/d71/d112 0 2024-09-19T09:35:06.472 INFO:tasks.workunit.client.1.smithi191.stdout:2/782: symlink d8/d11/d3f/dfa/dfc/l10b 0 2024-09-19T09:35:06.473 INFO:tasks.workunit.client.1.smithi191.stdout:1/835: link d3/d9/f4e d3/d9/da/d1e/d32/d53/d57/d121/f135 0 2024-09-19T09:35:06.476 INFO:tasks.workunit.client.1.smithi191.stdout:8/986: link d1/d7/d1a/d6d/fad d1/d7/d1a/d6d/de1/d6b/f14b 0 2024-09-19T09:35:06.477 INFO:tasks.workunit.client.1.smithi191.stdout:4/916: dwrite f1 [0,4194304] 0 2024-09-19T09:35:06.478 INFO:tasks.workunit.client.1.smithi191.stdout:3/790: mkdir d12/d13/d1a/d1b/d3c/d71/d112/d73/d113 0 2024-09-19T09:35:06.480 INFO:tasks.workunit.client.1.smithi191.stdout:2/783: mkdir d8/d2a/dba/dcc/d10c 0 2024-09-19T09:35:06.480 INFO:tasks.workunit.client.1.smithi191.stdout:2/784: chown d8/db/d41 18 1 2024-09-19T09:35:06.481 INFO:tasks.workunit.client.1.smithi191.stdout:3/791: dread d12/d13/d1a/d1b/d2e/dab/d51/fb9 [0,4194304] 0 2024-09-19T09:35:06.482 INFO:tasks.workunit.client.1.smithi191.stdout:1/836: creat d3/d9/da/d1e/d25/f136 x:0 0 0 2024-09-19T09:35:06.482 INFO:tasks.workunit.client.1.smithi191.stdout:1/837: read d3/d9/da/d1e/d32/d53/f51 [3907938,79918] 0 2024-09-19T09:35:06.484 INFO:tasks.workunit.client.1.smithi191.stdout:8/987: creat d1/d16/d2e/d32/dc5/dce/f14c x:0 0 0 2024-09-19T09:35:06.487 INFO:tasks.workunit.client.1.smithi191.stdout:2/785: mkdir d8/d11/d3f/d8a/d107/d10d 0 2024-09-19T09:35:06.488 INFO:tasks.workunit.client.1.smithi191.stdout:3/792: mkdir d12/d13/d1a/d28/d114 0 2024-09-19T09:35:06.490 INFO:tasks.workunit.client.1.smithi191.stdout:5/801: dwrite d0/d4/d88/f89 [0,4194304] 0 2024-09-19T09:35:06.490 INFO:tasks.workunit.client.1.smithi191.stdout:8/988: rename d1/d7/d1a/d6d/de1/d6b/da9/dc1/fd9 to d1/d7/d1a/d6d/de1/d6b/d83/f14d 0 2024-09-19T09:35:06.490 INFO:tasks.workunit.client.1.smithi191.stdout:8/989: dread - d1/fca zero size 2024-09-19T09:35:06.493 INFO:tasks.workunit.client.1.smithi191.stdout:2/786: getdents d8/d2a 0 2024-09-19T09:35:06.493 INFO:tasks.workunit.client.1.smithi191.stdout:7/825: dwrite d2/f7 [0,4194304] 0 2024-09-19T09:35:06.494 INFO:tasks.workunit.client.1.smithi191.stdout:0/925: dwrite d0/d9/d1c/d111/f52 [0,4194304] 0 2024-09-19T09:35:06.494 INFO:tasks.workunit.client.1.smithi191.stdout:0/926: write d0/dc5/fd7 [1066449,22455] 0 2024-09-19T09:35:06.494 INFO:tasks.workunit.client.1.smithi191.stdout:3/793: mknod d12/d13/d1a/d5d/dd1/df0/d91/c115 0 2024-09-19T09:35:06.496 INFO:tasks.workunit.client.1.smithi191.stdout:9/818: dwrite d3/d60/d78/fb8 [0,4194304] 0 2024-09-19T09:35:06.496 INFO:tasks.workunit.client.1.smithi191.stdout:1/838: unlink d3/d9/da/d1e/d32/d53/l6e 0 2024-09-19T09:35:06.496 INFO:tasks.workunit.client.1.smithi191.stdout:1/839: chown d3/d9/da/d1e/d32/d6f/db2/dd1/l126 254 1 2024-09-19T09:35:06.499 INFO:tasks.workunit.client.1.smithi191.stdout:7/826: dread d2/d39/d3a/d3c/f6f [0,4194304] 0 2024-09-19T09:35:06.499 INFO:tasks.workunit.client.1.smithi191.stdout:7/827: dread - d2/d2a/d38/def/f109 zero size 2024-09-19T09:35:06.499 INFO:tasks.workunit.client.1.smithi191.stdout:2/787: truncate d8/d11/d56/f92 4081395 0 2024-09-19T09:35:06.501 INFO:tasks.workunit.client.1.smithi191.stdout:8/990: dread d1/d16/d3c/d17/f1e [0,4194304] 0 2024-09-19T09:35:06.503 INFO:tasks.workunit.client.1.smithi191.stdout:0/927: symlink d0/l128 0 2024-09-19T09:35:06.505 INFO:tasks.workunit.client.1.smithi191.stdout:3/794: read d12/d13/d1a/d1b/d2e/dab/d51/d62/fdf [2880095,62323] 0 2024-09-19T09:35:06.505 INFO:tasks.workunit.client.1.smithi191.stdout:3/795: fdatasync d12/d13/d1a/d1b/d3c/d71/d112/d73/f79 0 2024-09-19T09:35:06.521 INFO:tasks.workunit.client.1.smithi191.stdout:9/819: rmdir d3/db/d16/d47 39 2024-09-19T09:35:06.521 INFO:tasks.workunit.client.1.smithi191.stdout:4/917: dwrite d5/dfb/dfd/d24/d32/d21/d4a/f7f [0,4194304] 0 2024-09-19T09:35:06.522 INFO:tasks.workunit.client.1.smithi191.stdout:1/840: symlink d3/d9/da/d42/d8a/l137 0 2024-09-19T09:35:06.522 INFO:tasks.workunit.client.1.smithi191.stdout:1/841: chown d3/d9/da/d7e/fac 162566081 1 2024-09-19T09:35:06.523 INFO:tasks.workunit.client.1.smithi191.stdout:7/828: symlink d2/d2a/d4f/d59/l11d 0 2024-09-19T09:35:06.524 INFO:tasks.workunit.client.1.smithi191.stdout:9/820: creat d3/d60/d78/d102/f11b x:0 0 0 2024-09-19T09:35:06.524 INFO:tasks.workunit.client.1.smithi191.stdout:9/821: truncate d3/db/d53/da2/db3/fcf 686327 0 2024-09-19T09:35:06.524 INFO:tasks.workunit.client.1.smithi191.stdout:9/822: write d3/db/d16/d47/d89/ff7 [968079,108698] 0 2024-09-19T09:35:06.525 INFO:tasks.workunit.client.1.smithi191.stdout:4/918: link d5/dfb/dfd/d24/d32/l1a d5/d38/da5/l123 0 2024-09-19T09:35:06.525 INFO:tasks.workunit.client.1.smithi191.stdout:4/919: fdatasync d5/dfb/dfd/d24/d32/d8f/fbe 0 2024-09-19T09:35:06.525 INFO:tasks.workunit.client.1.smithi191.stdout:1/842: rmdir d3/d9/da/d1e/d32/d53/d57 39 2024-09-19T09:35:06.526 INFO:tasks.workunit.client.1.smithi191.stdout:9/823: creat d3/db/d16/d38/f11c x:0 0 0 2024-09-19T09:35:06.526 INFO:tasks.workunit.client.1.smithi191.stdout:4/920: creat d5/d1b/d8e/dc9/f124 x:0 0 0 2024-09-19T09:35:06.527 INFO:tasks.workunit.client.1.smithi191.stdout:1/843: getdents d3/d9/da/d1e 0 2024-09-19T09:35:06.527 INFO:tasks.workunit.client.1.smithi191.stdout:9/824: truncate d3/d8/fdd 2636364 0 2024-09-19T09:35:06.528 INFO:tasks.workunit.client.1.smithi191.stdout:8/991: write d1/f130 [444526,100184] 0 2024-09-19T09:35:06.529 INFO:tasks.workunit.client.1.smithi191.stdout:1/844: rename d3/d9/d73/c79 to d3/d9/da/d1e/d32/d6f/c138 0 2024-09-19T09:35:06.529 INFO:tasks.workunit.client.1.smithi191.stdout:1/845: creat d3/f139 x:0 0 0 2024-09-19T09:35:06.530 INFO:tasks.workunit.client.1.smithi191.stdout:4/921: symlink d5/d1b/l125 0 2024-09-19T09:35:06.531 INFO:tasks.workunit.client.1.smithi191.stdout:4/922: mknod d5/d1b/d74/c126 0 2024-09-19T09:35:06.534 INFO:tasks.workunit.client.1.smithi191.stdout:4/923: creat d5/dfb/dfd/d24/d32/d21/d92/de9/f127 x:0 0 0 2024-09-19T09:35:06.534 INFO:tasks.workunit.client.1.smithi191.stdout:4/924: write d5/dfb/dfd/d24/d32/d21/d4a/dc5/de3/fef [801298,37554] 0 2024-09-19T09:35:06.535 INFO:tasks.workunit.client.1.smithi191.stdout:4/925: rmdir d5/dfb/dfd/d24 39 2024-09-19T09:35:06.535 INFO:tasks.workunit.client.1.smithi191.stdout:4/926: readlink d5/dfb/dfd/d24/d32/d21/d4a/lf5 0 2024-09-19T09:35:06.535 INFO:tasks.workunit.client.1.smithi191.stdout:7/829: dread d2/d2a/d79/d7f/f90 [0,4194304] 0 2024-09-19T09:35:06.535 INFO:tasks.workunit.client.1.smithi191.stdout:2/788: dwrite d8/f2f [0,4194304] 0 2024-09-19T09:35:06.537 INFO:tasks.workunit.client.1.smithi191.stdout:4/927: link d5/dfb/lcd d5/d1b/d8e/dc9/l128 0 2024-09-19T09:35:06.538 INFO:tasks.workunit.client.1.smithi191.stdout:7/830: creat d2/d2a/d4f/d59/f11e x:0 0 0 2024-09-19T09:35:06.539 INFO:tasks.workunit.client.1.smithi191.stdout:2/789: symlink d8/d11/d3f/dfa/dfc/l10e 0 2024-09-19T09:35:06.540 INFO:tasks.workunit.client.1.smithi191.stdout:9/825: write d3/db/f9b [2119899,59669] 0 2024-09-19T09:35:06.540 INFO:tasks.workunit.client.1.smithi191.stdout:9/826: getdents d3/db/d53/da2 0 2024-09-19T09:35:06.540 INFO:tasks.workunit.client.1.smithi191.stdout:9/827: fdatasync d3/db/d16/d47/f108 0 2024-09-19T09:35:06.540 INFO:tasks.workunit.client.1.smithi191.stdout:9/828: creat d3/f11d x:0 0 0 2024-09-19T09:35:06.541 INFO:tasks.workunit.client.1.smithi191.stdout:4/928: mknod d5/d1b/d74/c129 0 2024-09-19T09:35:06.543 INFO:tasks.workunit.client.1.smithi191.stdout:7/831: rename d2/d2a/d38/fd8 to d2/d2a/d79/da8/f11f 0 2024-09-19T09:35:06.543 INFO:tasks.workunit.client.1.smithi191.stdout:7/832: write d2/d2a/d4f/d59/dfb/f106 [737432,6826] 0 2024-09-19T09:35:06.546 INFO:tasks.workunit.client.1.smithi191.stdout:4/929: rmdir d5/dfb/dfd/df9/d88/d10c/d120 0 2024-09-19T09:35:06.546 INFO:tasks.workunit.client.1.smithi191.stdout:8/992: dread d1/d16/d3c/d17/f4d [0,4194304] 0 2024-09-19T09:35:06.547 INFO:tasks.workunit.client.1.smithi191.stdout:8/993: chown d1/d16/d23/l59 17 1 2024-09-19T09:35:06.547 INFO:tasks.workunit.client.1.smithi191.stdout:8/994: fsync d1/d22/d113/f119 0 2024-09-19T09:35:06.549 INFO:tasks.workunit.client.1.smithi191.stdout:0/928: dwrite d0/d9/d1c/d20/f37 [0,4194304] 0 2024-09-19T09:35:06.549 INFO:tasks.workunit.client.1.smithi191.stdout:0/929: fsync d0/d9/d1c/d1f/d24/dbc/f107 0 2024-09-19T09:35:06.549 INFO:tasks.workunit.client.1.smithi191.stdout:0/930: stat d0/d9/f25 0 2024-09-19T09:35:06.550 INFO:tasks.workunit.client.1.smithi191.stdout:7/833: symlink d2/d2a/d38/d63/dc1/l120 0 2024-09-19T09:35:06.550 INFO:tasks.workunit.client.1.smithi191.stdout:4/930: creat d5/dfb/dfd/d24/d32/d21/d56/d86/f12a x:0 0 0 2024-09-19T09:35:06.550 INFO:tasks.workunit.client.1.smithi191.stdout:7/834: creat d2/d2a/d4f/d59/d81/f121 x:0 0 0 2024-09-19T09:35:06.550 INFO:tasks.workunit.client.1.smithi191.stdout:7/835: creat d2/d2a/d38/dd4/f122 x:0 0 0 2024-09-19T09:35:06.553 INFO:tasks.workunit.client.1.smithi191.stdout:6/702: sync 2024-09-19T09:35:06.554 INFO:tasks.workunit.client.1.smithi191.stdout:0/931: dread d0/d9/d1c/deb/ddb/ff3 [0,4194304] 0 2024-09-19T09:35:06.555 INFO:tasks.workunit.client.1.smithi191.stdout:0/932: creat d0/dc5/f129 x:0 0 0 2024-09-19T09:35:06.555 INFO:tasks.workunit.client.1.smithi191.stdout:0/933: readlink d0/d9/d1c/d1f/d24/d29/lc0 0 2024-09-19T09:35:06.555 INFO:tasks.workunit.client.1.smithi191.stdout:0/934: stat d0/d9/d1c/f74 0 2024-09-19T09:35:06.555 INFO:tasks.workunit.client.1.smithi191.stdout:0/935: readlink d0/d9/d1c/d1f/d24/d53/l71 0 2024-09-19T09:35:06.556 INFO:tasks.workunit.client.1.smithi191.stdout:7/836: creat d2/d10c/f123 x:0 0 0 2024-09-19T09:35:06.556 INFO:tasks.workunit.client.1.smithi191.stdout:3/796: dwrite d12/f1e [0,4194304] 0 2024-09-19T09:35:06.556 INFO:tasks.workunit.client.1.smithi191.stdout:3/797: write d12/d13/d1a/d1b/d3c/d3f/f4d [2157481,99706] 0 2024-09-19T09:35:06.559 INFO:tasks.workunit.client.1.smithi191.stdout:6/703: rename d2/de/d19/d1e/d64/d76 to d2/de/d19/d1e/d64/d61/d81/da7/dde 0 2024-09-19T09:35:06.565 INFO:tasks.workunit.client.1.smithi191.stdout:0/936: mkdir d0/d9/d1c/d1f/d24/d39/df2/d12a 0 2024-09-19T09:35:06.567 INFO:tasks.workunit.client.1.smithi191.stdout:6/704: symlink d2/de/d2a/d2d/d30/d98/d9b/ldf 0 2024-09-19T09:35:06.569 INFO:tasks.workunit.client.1.smithi191.stdout:0/937: rename d0/d9/d1c/d1f/d24/d39/d8b/lca to d0/d9/d1c/d1f/de3/l12b 0 2024-09-19T09:35:06.569 INFO:tasks.workunit.client.1.smithi191.stdout:1/846: dwrite d3/dbd/f120 [0,4194304] 0 2024-09-19T09:35:06.570 INFO:tasks.workunit.client.1.smithi191.stdout:0/938: rmdir d0/d9/d1c/d111/df6 0 2024-09-19T09:35:06.573 INFO:tasks.workunit.client.1.smithi191.stdout:1/847: rename d3/d9/da/d42/d8a/l137 to d3/d9/da/d1e/d25/l13a 0 2024-09-19T09:35:06.574 INFO:tasks.workunit.client.1.smithi191.stdout:1/848: dread d3/d9/da/d1e/d32/d53/d57/d121/d131/fcd [0,4194304] 0 2024-09-19T09:35:06.576 INFO:tasks.workunit.client.1.smithi191.stdout:0/939: link d0/d9/de/lce d0/d9/de/d61/d11b/l12c 0 2024-09-19T09:35:06.576 INFO:tasks.workunit.client.1.smithi191.stdout:0/940: write d0/d9/d1c/d1f/de3/f124 [811058,35835] 0 2024-09-19T09:35:06.576 INFO:tasks.workunit.client.1.smithi191.stdout:0/941: fsync d0/d9/d1c/d1f/d24/d87/f104 0 2024-09-19T09:35:06.578 INFO:tasks.workunit.client.1.smithi191.stdout:0/942: rmdir d0/d9/d1c 39 2024-09-19T09:35:06.578 INFO:tasks.workunit.client.1.smithi191.stdout:0/943: truncate d0/d9/d1c/fc6 813927 0 2024-09-19T09:35:06.581 INFO:tasks.workunit.client.1.smithi191.stdout:0/944: creat d0/d9/d1c/d1f/d24/d39/d8b/ded/d10b/f12d x:0 0 0 2024-09-19T09:35:06.582 INFO:tasks.workunit.client.1.smithi191.stdout:2/790: dwrite d8/f9c [0,4194304] 0 2024-09-19T09:35:06.587 INFO:tasks.workunit.client.1.smithi191.stdout:2/791: rename d8/db/d41/cd2 to d8/d11/d3f/d64/c10f 0 2024-09-19T09:35:06.587 INFO:tasks.workunit.client.1.smithi191.stdout:2/792: truncate d8/d11/d98/fee 1268498 0 2024-09-19T09:35:06.589 INFO:tasks.workunit.client.1.smithi191.stdout:2/793: mkdir d8/db/d41/d110 0 2024-09-19T09:35:06.589 INFO:tasks.workunit.client.1.smithi191.stdout:2/794: fsync d8/db/d4d/de6/fd0 0 2024-09-19T09:35:06.589 INFO:tasks.workunit.client.1.smithi191.stdout:2/795: write d8/db/ff4 [792031,70319] 0 2024-09-19T09:35:06.589 INFO:tasks.workunit.client.1.smithi191.stdout:7/837: dwrite d2/d2a/d79/fb7 [0,4194304] 0 2024-09-19T09:35:06.590 INFO:tasks.workunit.client.1.smithi191.stdout:2/796: creat d8/db/d13/d23/dde/f111 x:0 0 0 2024-09-19T09:35:06.591 INFO:tasks.workunit.client.1.smithi191.stdout:7/838: link d2/d2a/d4f/d59/d81/lc9 d2/d2a/d4f/d59/d81/l124 0 2024-09-19T09:35:06.592 INFO:tasks.workunit.client.1.smithi191.stdout:2/797: unlink d8/db/d13/d23/cb7 0 2024-09-19T09:35:06.592 INFO:tasks.workunit.client.1.smithi191.stdout:7/839: mkdir d2/d2a/d38/d63/d9a/dd5/d125 0 2024-09-19T09:35:06.597 INFO:tasks.workunit.client.1.smithi191.stdout:2/798: dread d8/db/fc7 [0,4194304] 0 2024-09-19T09:35:06.598 INFO:tasks.workunit.client.1.smithi191.stdout:2/799: truncate d8/d11/d56/f92 269918 0 2024-09-19T09:35:06.598 INFO:tasks.workunit.client.1.smithi191.stdout:2/800: readlink d8/db/d13/d23/l51 0 2024-09-19T09:35:06.598 INFO:tasks.workunit.client.1.smithi191.stdout:2/801: chown d8/db/d4d/de6/cf7 5 1 2024-09-19T09:35:06.598 INFO:tasks.workunit.client.1.smithi191.stdout:2/802: fsync d8/db/d4d/de6/d70/fe1 0 2024-09-19T09:35:06.599 INFO:tasks.workunit.client.1.smithi191.stdout:7/840: dread d2/f47 [0,4194304] 0 2024-09-19T09:35:06.599 INFO:tasks.workunit.client.1.smithi191.stdout:7/841: creat d2/d10c/f126 x:0 0 0 2024-09-19T09:35:06.599 INFO:tasks.workunit.client.1.smithi191.stdout:7/842: chown d2/d2a/d38/d63/dc1/ld0 56486522 1 2024-09-19T09:35:06.599 INFO:tasks.workunit.client.1.smithi191.stdout:7/843: readlink d2/d2a/d38/l11b 0 2024-09-19T09:35:06.599 INFO:tasks.workunit.client.1.smithi191.stdout:7/844: read d2/f23 [156273,89030] 0 2024-09-19T09:35:06.600 INFO:tasks.workunit.client.1.smithi191.stdout:2/803: rename d8/db/d13/d40/f5e to d8/d11/d3f/d8a/d107/d10d/f112 0 2024-09-19T09:35:06.601 INFO:tasks.workunit.client.1.smithi191.stdout:7/845: rename d2/f40 to d2/d2a/d38/de5/d105/f127 0 2024-09-19T09:35:06.601 INFO:tasks.workunit.client.1.smithi191.stdout:7/846: chown d2/d2a/d38/d63/dc1/f104 22 1 2024-09-19T09:35:06.602 INFO:tasks.workunit.client.1.smithi191.stdout:2/804: symlink d8/db/d13/l113 0 2024-09-19T09:35:06.602 INFO:tasks.workunit.client.1.smithi191.stdout:7/847: creat d2/d2a/d4f/d59/dfb/deb/df9/f128 x:0 0 0 2024-09-19T09:35:06.604 INFO:tasks.workunit.client.1.smithi191.stdout:7/848: rename d2/d2a/d38/dd4/l111 to d2/d2a/d4f/l129 0 2024-09-19T09:35:06.606 INFO:tasks.workunit.client.1.smithi191.stdout:9/829: dwrite d3/db6/ffa [4194304,4194304] 0 2024-09-19T09:35:06.609 INFO:tasks.workunit.client.1.smithi191.stdout:7/849: unlink d2/d2a/d38/d63/f95 0 2024-09-19T09:35:06.610 INFO:tasks.workunit.client.1.smithi191.stdout:9/830: truncate d3/db/d16/d38/f67 3495123 0 2024-09-19T09:35:06.611 INFO:tasks.workunit.client.1.smithi191.stdout:9/831: symlink d3/d60/d78/d102/l11e 0 2024-09-19T09:35:06.612 INFO:tasks.workunit.client.1.smithi191.stdout:4/931: dwrite d5/d106/f11e [4194304,4194304] 0 2024-09-19T09:35:06.612 INFO:tasks.workunit.client.1.smithi191.stdout:4/932: fsync f1 0 2024-09-19T09:35:06.613 INFO:tasks.workunit.client.1.smithi191.stdout:0/945: dwrite d0/d9/d1c/d1f/d24/d29/d30/d56/d103/f116 [0,4194304] 0 2024-09-19T09:35:06.613 INFO:tasks.workunit.client.1.smithi191.stdout:9/832: rmdir d3/db6 39 2024-09-19T09:35:06.614 INFO:tasks.workunit.client.1.smithi191.stdout:6/705: dwrite d2/de/d2a/d2d/f99 [0,4194304] 0 2024-09-19T09:35:06.614 INFO:tasks.workunit.client.1.smithi191.stdout:8/995: dwrite d1/d16/d3c/d28/f33 [4194304,4194304] 0 2024-09-19T09:35:06.614 INFO:tasks.workunit.client.1.smithi191.stdout:6/706: write d2/de/d2a/f8e [2799519,3459] 0 2024-09-19T09:35:06.614 INFO:tasks.workunit.client.1.smithi191.stdout:6/707: stat d2/de/d19/d1e/d64/d77/lcd 0 2024-09-19T09:35:06.614 INFO:tasks.workunit.client.1.smithi191.stdout:6/708: chown d2/de/d2a/d2d/d30/d98 376259977 1 2024-09-19T09:35:06.614 INFO:tasks.workunit.client.1.smithi191.stdout:6/709: write d2/de/d19/f6e [745322,115609] 0 2024-09-19T09:35:06.616 INFO:tasks.workunit.client.1.smithi191.stdout:4/933: symlink d5/dfb/dfd/d24/d32/d21/d92/de9/l12b 0 2024-09-19T09:35:06.617 INFO:tasks.workunit.client.1.smithi191.stdout:1/849: dwrite d3/d9/da/f5f [0,4194304] 0 2024-09-19T09:35:06.617 INFO:tasks.workunit.client.1.smithi191.stdout:1/850: chown d3/d9/da/d1e/d32/d53/d57/d121/d131/d97/ld3 209094115 1 2024-09-19T09:35:06.629 INFO:tasks.workunit.client.1.smithi191.stdout:6/710: rmdir d2/de/d19/d1e/dd6 0 2024-09-19T09:35:06.631 INFO:tasks.workunit.client.1.smithi191.stdout:4/934: write d5/d1b/d8e/fb5 [60520,77377] 0 2024-09-19T09:35:06.631 INFO:tasks.workunit.client.1.smithi191.stdout:4/935: readlink d5/d38/d73/d8d/le4 0 2024-09-19T09:35:06.631 INFO:tasks.workunit.client.1.smithi191.stdout:4/936: fdatasync d5/d38/d73/d8d/fc0 0 2024-09-19T09:35:06.631 INFO:tasks.workunit.client.1.smithi191.stdout:4/937: chown d5/dfb/dfd/d24/d32/d21/d5c/d8c/cde 129333 1 2024-09-19T09:35:06.631 INFO:tasks.workunit.client.1.smithi191.stdout:4/938: fdatasync d5/dfb/dfd/d24/d32/d21/d56/d86/fa7 0 2024-09-19T09:35:06.634 INFO:tasks.workunit.client.1.smithi191.stdout:0/946: mkdir d0/d9/de/d12e 0 2024-09-19T09:35:06.634 INFO:tasks.workunit.client.1.smithi191.stdout:2/805: dwrite d8/f2f [4194304,4194304] 0 2024-09-19T09:35:06.634 INFO:tasks.workunit.client.1.smithi191.stdout:2/806: dread - d8/db/d4d/de6/d70/fe1 zero size 2024-09-19T09:35:06.636 INFO:tasks.workunit.client.1.smithi191.stdout:6/711: unlink d2/de/d2a/d39/cb4 0 2024-09-19T09:35:06.638 INFO:tasks.workunit.client.1.smithi191.stdout:1/851: rename d3/f127 to d3/d9/da/d1e/d32/d53/f13b 0 2024-09-19T09:35:06.640 INFO:tasks.workunit.client.1.smithi191.stdout:6/712: mknod d2/de/d19/d1e/d64/d77/d82/ce0 0 2024-09-19T09:35:06.641 INFO:tasks.workunit.client.1.smithi191.stdout:6/713: fdatasync d2/de/d15/f74 0 2024-09-19T09:35:06.641 INFO:tasks.workunit.client.1.smithi191.stdout:6/714: chown d2/de/d2a/d2d/d30/d98/d9b/l9d 13379 1 2024-09-19T09:35:06.642 INFO:tasks.workunit.client.1.smithi191.stdout:7/850: dwrite d2/d39/d3a/d3c/f87 [0,4194304] 0 2024-09-19T09:35:06.642 INFO:tasks.workunit.client.1.smithi191.stdout:7/851: creat d2/d2a/d4f/d59/d81/f12a x:0 0 0 2024-09-19T09:35:06.643 INFO:tasks.workunit.client.1.smithi191.stdout:9/833: dwrite d3/db/d53/f6f [0,4194304] 0 2024-09-19T09:35:06.643 INFO:tasks.workunit.client.1.smithi191.stdout:9/834: fdatasync d3/d8/f22 0 2024-09-19T09:35:06.644 INFO:tasks.workunit.client.1.smithi191.stdout:2/807: rename d8/db/d13/fdf to d8/d2a/f114 0 2024-09-19T09:35:06.644 INFO:tasks.workunit.client.1.smithi191.stdout:8/996: dwrite d1/d7/d1a/d6d/de1/d6b/db9/f110 [0,4194304] 0 2024-09-19T09:35:06.645 INFO:tasks.workunit.client.1.smithi191.stdout:1/852: symlink d3/d9/da/d1e/d10f/l13c 0 2024-09-19T09:35:06.646 INFO:tasks.workunit.client.1.smithi191.stdout:6/715: link d2/de/d19/d1e/la1 d2/de/d2a/d2d/d30/d98/d9b/le1 0 2024-09-19T09:35:06.647 INFO:tasks.workunit.client.1.smithi191.stdout:0/947: dread d0/d9/d1c/d111/f16 [0,4194304] 0 2024-09-19T09:35:06.651 INFO:tasks.workunit.client.1.smithi191.stdout:7/852: truncate d2/d2a/d33/f3e 1757445 0 2024-09-19T09:35:06.651 INFO:tasks.workunit.client.1.smithi191.stdout:7/853: creat d2/d2a/d38/d63/d9a/dd5/f12b x:0 0 0 2024-09-19T09:35:06.653 INFO:tasks.workunit.client.1.smithi191.stdout:7/854: dread d2/d2a/d38/def/ff1 [0,4194304] 0 2024-09-19T09:35:06.656 INFO:tasks.workunit.client.1.smithi191.stdout:9/835: mknod d3/db/d16/d17/d5b/c11f 0 2024-09-19T09:35:06.662 INFO:tasks.workunit.client.1.smithi191.stdout:8/997: getdents d1/d7 0 2024-09-19T09:35:06.664 INFO:tasks.workunit.client.1.smithi191.stdout:0/948: rename d0/d9/d1c/d1f/d24/f3f to d0/d9/d1c/d1f/d24/d29/d30/f12f 0 2024-09-19T09:35:06.667 INFO:tasks.workunit.client.1.smithi191.stdout:7/855: mknod d2/d39/d3a/d3c/c12c 0 2024-09-19T09:35:06.668 INFO:tasks.workunit.client.1.smithi191.stdout:9/836: truncate d3/db/f31 90706 0 2024-09-19T09:35:06.669 INFO:tasks.workunit.client.1.smithi191.stdout:0/949: symlink d0/d9/d1c/d1f/d24/d29/d30/d56/l130 0 2024-09-19T09:35:06.671 INFO:tasks.workunit.client.1.smithi191.stdout:7/856: rename d2/d39/d3a/d3c/c52 to d2/d2a/d38/c12d 0 2024-09-19T09:35:06.671 INFO:tasks.workunit.client.1.smithi191.stdout:7/857: chown d2/d2a/c68 2138832175 1 2024-09-19T09:35:06.671 INFO:tasks.workunit.client.1.smithi191.stdout:7/858: chown d2/d2a/d4f/d59/l5c 1813017 1 2024-09-19T09:35:06.671 INFO:tasks.workunit.client.1.smithi191.stdout:9/837: symlink d3/db/d16/d47/d89/l120 0 2024-09-19T09:35:06.673 INFO:tasks.workunit.client.1.smithi191.stdout:9/838: mknod d3/db/d53/c121 0 2024-09-19T09:35:06.675 INFO:tasks.workunit.client.1.smithi191.stdout:9/839: link d3/db/de6/f103 d3/db/d16/d47/d55/f122 0 2024-09-19T09:35:06.679 INFO:tasks.workunit.client.1.smithi191.stdout:5/802: sync 2024-09-19T09:35:06.679 INFO:tasks.workunit.client.1.smithi191.stdout:6/716: dwrite d2/de/d2a/d2d/d30/d98/d9b/f9a [0,4194304] 0 2024-09-19T09:35:06.682 INFO:tasks.workunit.client.1.smithi191.stdout:5/803: unlink d0/fe8 0 2024-09-19T09:35:06.685 INFO:tasks.workunit.client.1.smithi191.stdout:5/804: read d0/d4/d9/d1d/d28/d53/f70 [363900,96645] 0 2024-09-19T09:35:06.686 INFO:tasks.workunit.client.1.smithi191.stdout:6/717: mkdir d2/de/d2a/d2d/d30/d98/de2 0 2024-09-19T09:35:06.688 INFO:tasks.workunit.client.1.smithi191.stdout:0/950: read d0/d9/d1c/d1f/d24/d29/d30/d56/f66 [2903891,90961] 0 2024-09-19T09:35:06.688 INFO:tasks.workunit.client.1.smithi191.stdout:0/951: write d0/dc5/f129 [368265,102021] 0 2024-09-19T09:35:06.688 INFO:tasks.workunit.client.1.smithi191.stdout:0/952: chown d0/d9/d1c/f74 513725 1 2024-09-19T09:35:06.689 INFO:tasks.workunit.client.1.smithi191.stdout:2/808: dwrite d8/d11/d56/f92 [0,4194304] 0 2024-09-19T09:35:06.689 INFO:tasks.workunit.client.1.smithi191.stdout:6/718: unlink d2/f63 0 2024-09-19T09:35:06.689 INFO:tasks.workunit.client.1.smithi191.stdout:6/719: creat d2/de/d2a/d2d/dc7/fe3 x:0 0 0 2024-09-19T09:35:06.691 INFO:tasks.workunit.client.1.smithi191.stdout:0/953: creat d0/d9/d1c/d1f/d24/d29/d30/f131 x:0 0 0 2024-09-19T09:35:06.691 INFO:tasks.workunit.client.1.smithi191.stdout:0/954: read d0/d9/d1c/deb/fc2 [949732,7625] 0 2024-09-19T09:35:06.691 INFO:tasks.workunit.client.1.smithi191.stdout:2/809: creat d8/d2a/dd8/f115 x:0 0 0 2024-09-19T09:35:06.696 INFO:tasks.workunit.client.1.smithi191.stdout:6/720: rename d2/de/d19/d1e/d64/f4d to d2/de/d19/d1e/fe4 0 2024-09-19T09:35:06.699 INFO:tasks.workunit.client.1.smithi191.stdout:6/721: link d2/de/d15/l79 d2/de/d2a/d2d/le5 0 2024-09-19T09:35:06.699 INFO:tasks.workunit.client.1.smithi191.stdout:6/722: fdatasync d2/de/d2a/d2d/d30/d98/d9b/f9a 0 2024-09-19T09:35:06.702 INFO:tasks.workunit.client.1.smithi191.stdout:6/723: fsync d2/de/d15/f36 0 2024-09-19T09:35:06.702 INFO:tasks.workunit.client.1.smithi191.stdout:7/859: dwrite d2/d2a/d38/d63/dc1/f104 [0,4194304] 0 2024-09-19T09:35:06.702 INFO:tasks.workunit.client.1.smithi191.stdout:7/860: creat d2/d2a/d4f/d59/d81/f12e x:0 0 0 2024-09-19T09:35:06.704 INFO:tasks.workunit.client.1.smithi191.stdout:3/798: sync 2024-09-19T09:35:06.704 INFO:tasks.workunit.client.1.smithi191.stdout:5/805: dread d0/d4/d9/fc2 [0,4194304] 0 2024-09-19T09:35:06.704 INFO:tasks.workunit.client.1.smithi191.stdout:9/840: dwrite d3/d8/fc [0,4194304] 0 2024-09-19T09:35:06.704 INFO:tasks.workunit.client.1.smithi191.stdout:0/955: write d0/d9/d1c/d1f/f77 [2600776,9231] 0 2024-09-19T09:35:06.704 INFO:tasks.workunit.client.1.smithi191.stdout:7/861: truncate d2/d39/d3a/fe4 1607792 0 2024-09-19T09:35:06.704 INFO:tasks.workunit.client.1.smithi191.stdout:7/862: read - d2/d5e/dfc/f102 zero size 2024-09-19T09:35:06.704 INFO:tasks.workunit.client.1.smithi191.stdout:7/863: chown d2/d2a/f31 878794 1 2024-09-19T09:35:06.704 INFO:tasks.workunit.client.1.smithi191.stdout:0/956: truncate d0/d9/d1c/d1f/d24/d39/d7a/ff5 427472 0 2024-09-19T09:35:06.705 INFO:tasks.workunit.client.1.smithi191.stdout:0/957: creat d0/d9/d1c/d1f/d24/d87/f132 x:0 0 0 2024-09-19T09:35:06.705 INFO:tasks.workunit.client.1.smithi191.stdout:0/958: chown d0/d9/de/d81/lb0 77792820 1 2024-09-19T09:35:06.707 INFO:tasks.workunit.client.1.smithi191.stdout:3/799: creat d12/d13/d1a/d1b/d2e/f116 x:0 0 0 2024-09-19T09:35:06.707 INFO:tasks.workunit.client.1.smithi191.stdout:3/800: fdatasync d12/d13/d1a/d1b/d2e/f3a 0 2024-09-19T09:35:06.709 INFO:tasks.workunit.client.1.smithi191.stdout:9/841: creat d3/d60/d78/f123 x:0 0 0 2024-09-19T09:35:06.711 INFO:tasks.workunit.client.1.smithi191.stdout:5/806: truncate d0/d4/dae/f10c 707119 0 2024-09-19T09:35:06.711 INFO:tasks.workunit.client.1.smithi191.stdout:5/807: fdatasync d0/d4/d9/d1d/d28/f31 0 2024-09-19T09:35:06.711 INFO:tasks.workunit.client.1.smithi191.stdout:5/808: fsync d0/d4/d9/d1d/d22/d3b/f7a 0 2024-09-19T09:35:06.711 INFO:tasks.workunit.client.1.smithi191.stdout:5/809: write d0/d4/d9/d1d/d29/d33/f34 [4409281,51795] 0 2024-09-19T09:35:06.713 INFO:tasks.workunit.client.1.smithi191.stdout:2/810: dwrite d8/d11/dc2/fc5 [0,4194304] 0 2024-09-19T09:35:06.715 INFO:tasks.workunit.client.1.smithi191.stdout:7/864: link d2/d2a/d33/f8c d2/d5e/dfc/f12f 0 2024-09-19T09:35:06.715 INFO:tasks.workunit.client.1.smithi191.stdout:7/865: creat d2/d39/d3a/d9c/f130 x:0 0 0 2024-09-19T09:35:06.716 INFO:tasks.workunit.client.1.smithi191.stdout:6/724: dwrite d2/de/d19/d1e/d64/f56 [4194304,4194304] 0 2024-09-19T09:35:06.717 INFO:tasks.workunit.client.1.smithi191.stdout:0/959: creat d0/d9/de/d61/dbf/f133 x:0 0 0 2024-09-19T09:35:06.723 INFO:tasks.workunit.client.1.smithi191.stdout:3/801: creat d12/d13/d1a/d28/f117 x:0 0 0 2024-09-19T09:35:06.723 INFO:tasks.workunit.client.1.smithi191.stdout:3/802: write d12/d13/d1a/d1b/d3c/dd8/f104 [220057,72869] 0 2024-09-19T09:35:06.724 INFO:tasks.workunit.client.1.smithi191.stdout:5/810: dwrite d0/d4/d4a/f106 [0,4194304] 0 2024-09-19T09:35:06.724 INFO:tasks.workunit.client.1.smithi191.stdout:5/811: creat d0/f119 x:0 0 0 2024-09-19T09:35:06.726 INFO:tasks.workunit.client.1.smithi191.stdout:9/842: creat d3/d60/d112/f124 x:0 0 0 2024-09-19T09:35:06.729 INFO:tasks.workunit.client.1.smithi191.stdout:2/811: symlink d8/d11/d56/l116 0 2024-09-19T09:35:06.737 INFO:tasks.workunit.client.1.smithi191.stdout:5/812: write d0/d4/d9/d1d/d28/ff0 [1224242,9017] 0 2024-09-19T09:35:06.739 INFO:tasks.workunit.client.1.smithi191.stdout:9/843: symlink d3/db/d16/d17/d3c/l125 0 2024-09-19T09:35:06.739 INFO:tasks.workunit.client.1.smithi191.stdout:9/844: write d3/db/d16/d17/d5b/f114 [777324,122728] 0 2024-09-19T09:35:06.741 INFO:tasks.workunit.client.1.smithi191.stdout:2/812: creat d8/d11/d3f/dfa/f117 x:0 0 0 2024-09-19T09:35:06.741 INFO:tasks.workunit.client.1.smithi191.stdout:2/813: dread - d8/d11/d3f/dfa/f117 zero size 2024-09-19T09:35:06.742 INFO:tasks.workunit.client.1.smithi191.stdout:7/866: rmdir d2/d2a/d79/da8 39 2024-09-19T09:35:06.742 INFO:tasks.workunit.client.1.smithi191.stdout:7/867: chown d2/f1b 110193 1 2024-09-19T09:35:06.742 INFO:tasks.workunit.client.1.smithi191.stdout:7/868: creat d2/d2a/d38/de5/ded/f131 x:0 0 0 2024-09-19T09:35:06.743 INFO:tasks.workunit.client.1.smithi191.stdout:5/813: mkdir d0/da7/de6/d10e/d11a 0 2024-09-19T09:35:06.746 INFO:tasks.workunit.client.1.smithi191.stdout:5/814: dread d0/d4/d4a/f98 [0,4194304] 0 2024-09-19T09:35:06.746 INFO:tasks.workunit.client.1.smithi191.stdout:7/869: unlink d2/d2a/d38/d63/dc1/f103 0 2024-09-19T09:35:06.747 INFO:tasks.workunit.client.1.smithi191.stdout:6/725: dwrite d2/de/d2a/d2d/d30/d98/d9b/fb7 [4194304,4194304] 0 2024-09-19T09:35:06.748 INFO:tasks.workunit.client.1.smithi191.stdout:0/960: dwrite d0/d9/d1c/d111/f67 [4194304,4194304] 0 2024-09-19T09:35:06.748 INFO:tasks.workunit.client.1.smithi191.stdout:0/961: chown d0 126 1 2024-09-19T09:35:06.748 INFO:tasks.workunit.client.1.smithi191.stdout:0/962: chown d0/d9/d1c/d1f/d24/d29/d30/f131 1699740022 1 2024-09-19T09:35:06.748 INFO:tasks.workunit.client.1.smithi191.stdout:9/845: getdents d3/d60/d78 0 2024-09-19T09:35:06.748 INFO:tasks.workunit.client.1.smithi191.stdout:9/846: write d3/db/d16/d47/d55/fea [180827,60992] 0 2024-09-19T09:35:06.748 INFO:tasks.workunit.client.1.smithi191.stdout:9/847: write d3/db/d16/d38/dd4/ddf/f8b [163400,29739] 0 2024-09-19T09:35:06.749 INFO:tasks.workunit.client.1.smithi191.stdout:7/870: symlink d2/d39/l132 0 2024-09-19T09:35:06.752 INFO:tasks.workunit.client.1.smithi191.stdout:9/848: truncate d3/db/d16/d17/f85 223585 0 2024-09-19T09:35:06.754 INFO:tasks.workunit.client.1.smithi191.stdout:7/871: symlink d2/d2a/d4f/d59/l133 0 2024-09-19T09:35:06.758 INFO:tasks.workunit.client.1.smithi191.stdout:4/939: sync 2024-09-19T09:35:06.764 INFO:tasks.workunit.client.1.smithi191.stdout:5/815: dwrite d0/d4/d4a/f4b [4194304,4194304] 0 2024-09-19T09:35:06.765 INFO:tasks.workunit.client.1.smithi191.stdout:5/816: chown d0/da7/dcd/d102/c10a 98 1 2024-09-19T09:35:06.767 INFO:tasks.workunit.client.1.smithi191.stdout:4/940: write d5/dfb/dfd/d28/f48 [503755,116479] 0 2024-09-19T09:35:06.768 INFO:tasks.workunit.client.1.smithi191.stdout:5/817: mknod d0/da7/dcd/dd7/c11b 0 2024-09-19T09:35:06.770 INFO:tasks.workunit.client.1.smithi191.stdout:4/941: creat d5/dfb/dfd/d24/d82/df2/d37/f12c x:0 0 0 2024-09-19T09:35:06.772 INFO:tasks.workunit.client.1.smithi191.stdout:5/818: truncate d0/d4/d9/d1d/d22/d3b/f74 98343 0 2024-09-19T09:35:06.772 INFO:tasks.workunit.client.1.smithi191.stdout:5/819: fsync d0/d4/d9/f59 0 2024-09-19T09:35:06.779 INFO:tasks.workunit.client.1.smithi191.stdout:4/942: dread f4 [0,4194304] 0 2024-09-19T09:35:06.779 INFO:tasks.workunit.client.1.smithi191.stdout:4/943: chown d5/dfb/dfd/d24/d32/d8f 0 1 2024-09-19T09:35:06.780 INFO:tasks.workunit.client.1.smithi191.stdout:4/944: mkdir d5/d38/d73/d12d 0 2024-09-19T09:35:06.781 INFO:tasks.workunit.client.1.smithi191.stdout:4/945: getdents d5/dfb/dfd/d24/d82/df2 0 2024-09-19T09:35:06.782 INFO:tasks.workunit.client.1.smithi191.stdout:4/946: unlink d5/dfb/dfd/d24/d32/d21/d5c/d8c/l112 0 2024-09-19T09:35:06.782 INFO:tasks.workunit.client.1.smithi191.stdout:4/947: readlink d5/d38/l94 0 2024-09-19T09:35:06.784 INFO:tasks.workunit.client.1.smithi191.stdout:0/963: dwrite d0/d9/f4d [0,4194304] 0 2024-09-19T09:35:06.789 INFO:tasks.workunit.client.1.smithi191.stdout:9/849: dwrite d3/db/d16/d17/f116 [0,4194304] 0 2024-09-19T09:35:06.792 INFO:tasks.workunit.client.1.smithi191.stdout:7/872: dwrite d2/d2a/d79/da8/db9/fdd [0,4194304] 0 2024-09-19T09:35:06.879 INFO:tasks.workunit.client.1.smithi191.stdout:0/964: rename d0/d9/d1c/d1f/d24/d39/c9e to d0/d9/c134 0 2024-09-19T09:35:06.879 INFO:tasks.workunit.client.1.smithi191.stdout:0/965: chown d0/d6f/d7b/f6b 644 1 2024-09-19T09:35:06.882 INFO:tasks.workunit.client.1.smithi191.stdout:9/850: mkdir d3/db/d16/d17/d81/d8d/d126 0 2024-09-19T09:35:06.884 INFO:tasks.workunit.client.1.smithi191.stdout:4/948: dwrite d5/dfb/dfd/d24/d82/df2/d37/d59/fbf [0,4194304] 0 2024-09-19T09:35:06.884 INFO:tasks.workunit.client.1.smithi191.stdout:4/949: fsync d5/dfb/dfd/d24/d32/d21/f50 0 2024-09-19T09:35:06.897 INFO:tasks.workunit.client.1.smithi191.stdout:4/950: dwrite d5/dfb/dfd/d28/fc2 [0,4194304] 0 2024-09-19T09:35:06.923 INFO:tasks.workunit.client.1.smithi191.stdout:7/873: mknod d2/d2a/d4f/c134 0 2024-09-19T09:35:06.925 INFO:tasks.workunit.client.1.smithi191.stdout:0/966: creat d0/d9/d1c/d1f/d24/d87/dd0/d117/f135 x:0 0 0 2024-09-19T09:35:06.926 INFO:tasks.workunit.client.1.smithi191.stdout:9/851: creat d3/db/d16/d17/d81/d8d/d126/f127 x:0 0 0 2024-09-19T09:35:06.931 INFO:tasks.workunit.client.1.smithi191.stdout:4/951: symlink d5/dfb/dfd/d24/d32/d21/l12e 0 2024-09-19T09:35:06.932 INFO:tasks.workunit.client.1.smithi191.stdout:7/874: truncate d2/d2a/d79/fb7 2387082 0 2024-09-19T09:35:06.933 INFO:tasks.workunit.client.1.smithi191.stdout:1/853: sync 2024-09-19T09:35:06.933 INFO:tasks.workunit.client.1.smithi191.stdout:1/854: readlink d3/l15 0 2024-09-19T09:35:06.933 INFO:tasks.workunit.client.1.smithi191.stdout:0/967: mknod d0/d9/d1c/d1f/d24/d29/c136 0 2024-09-19T09:35:06.934 INFO:tasks.workunit.client.1.smithi191.stdout:0/968: write d0/d9/d1c/d1f/f85 [958980,32007] 0 2024-09-19T09:35:06.934 INFO:tasks.workunit.client.1.smithi191.stdout:4/952: stat d5/dfb/dfd/d24/d32/d21/d92/lbb 0 2024-09-19T09:35:06.934 INFO:tasks.workunit.client.1.smithi191.stdout:4/953: fsync d5/dfb/dfd/d28/d96/ff4 0 2024-09-19T09:35:06.936 INFO:tasks.workunit.client.1.smithi191.stdout:4/954: creat d5/dfb/dfd/d24/d32/f12f x:0 0 0 2024-09-19T09:35:06.937 INFO:tasks.workunit.client.1.smithi191.stdout:0/969: mknod d0/d9/d1c/d1f/d24/c137 0 2024-09-19T09:35:06.937 INFO:tasks.workunit.client.1.smithi191.stdout:4/955: truncate d5/dfb/dfd/d24/d32/d8f/fbe 4451625 0 2024-09-19T09:35:06.938 INFO:tasks.workunit.client.1.smithi191.stdout:2/814: sync 2024-09-19T09:35:06.938 INFO:tasks.workunit.client.1.smithi191.stdout:3/803: sync 2024-09-19T09:35:06.938 INFO:tasks.workunit.client.1.smithi191.stdout:8/998: sync 2024-09-19T09:35:06.938 INFO:tasks.workunit.client.1.smithi191.stdout:5/820: sync 2024-09-19T09:35:06.938 INFO:tasks.workunit.client.1.smithi191.stdout:6/726: sync 2024-09-19T09:35:06.938 INFO:tasks.workunit.client.1.smithi191.stdout:2/815: dread - d8/db/d13/fa6 zero size 2024-09-19T09:35:06.938 INFO:tasks.workunit.client.1.smithi191.stdout:2/816: truncate d8/d2a/dba/dcc/ff6 769927 0 2024-09-19T09:35:06.939 INFO:tasks.workunit.client.1.smithi191.stdout:3/804: write d12/d43/fac [676279,72137] 0 2024-09-19T09:35:06.939 INFO:tasks.workunit.client.1.smithi191.stdout:3/805: write d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/f8a [6353773,38113] 0 2024-09-19T09:35:06.939 INFO:tasks.workunit.client.1.smithi191.stdout:4/956: mknod d5/dfb/dfd/d24/d82/df2/d37/d59/c130 0 2024-09-19T09:35:06.939 INFO:tasks.workunit.client.1.smithi191.stdout:4/957: write d5/dfb/dfd/d24/d82/df2/d37/d59/fa0 [84150,24063] 0 2024-09-19T09:35:06.940 INFO:tasks.workunit.client.1.smithi191.stdout:8/999: rmdir d1/d16/d3c/db0 39 2024-09-19T09:35:06.941 INFO:tasks.workunit.client.1.smithi191.stdout:2/817: mkdir d8/d2a/dba/dcc/d118 0 2024-09-19T09:35:06.945 INFO:tasks.workunit.client.1.smithi191.stdout:3/806: rename d12/d13/d1a/d1b/d60/d7a/c9a to d12/d13/d1a/d1b/d3c/d3f/c118 0 2024-09-19T09:35:06.945 INFO:tasks.workunit.client.1.smithi191.stdout:3/807: truncate d12/d13/d1a/d1b/d2e/f3a 4832521 0 2024-09-19T09:35:06.945 INFO:tasks.workunit.client.1.smithi191.stdout:3/808: creat d12/d13/d1a/df7/f119 x:0 0 0 2024-09-19T09:35:06.945 INFO:tasks.workunit.client.1.smithi191.stdout:3/809: readlink d12/d13/d1a/d1b/d3c/d71/lea 0 2024-09-19T09:35:06.945 INFO:tasks.workunit.client.1.smithi191.stdout:3/810: read - d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/fb3 zero size 2024-09-19T09:35:06.948 INFO:tasks.workunit.client.1.smithi191.stdout:1/855: dread d3/d9/da/d1e/d32/d53/f9d [0,4194304] 0 2024-09-19T09:35:06.950 INFO:tasks.workunit.client.1.smithi191.stdout:2/818: dread d8/d2a/dba/dcc/ff9 [0,4194304] 0 2024-09-19T09:35:06.951 INFO:tasks.workunit.client.1.smithi191.stdout:5/821: write d0/d4/d9/d1d/d29/d7f/d94/fd6 [2080127,120948] 0 2024-09-19T09:35:06.951 INFO:tasks.workunit.client.1.smithi191.stdout:5/822: write d0/d4/d9/d1d/d29/d33/d45/d64/de7/ff2 [584584,39089] 0 2024-09-19T09:35:06.953 INFO:tasks.workunit.client.1.smithi191.stdout:2/819: rename d8/d11/d3f/d8a/ce4 to d8/d2a/dba/dcc/c119 0 2024-09-19T09:35:06.954 INFO:tasks.workunit.client.1.smithi191.stdout:4/958: write d5/dfb/dfd/d24/d32/d21/d56/d86/d100/f113 [429393,80787] 0 2024-09-19T09:35:06.955 INFO:tasks.workunit.client.1.smithi191.stdout:2/820: unlink d8/d11/d98/f9a 0 2024-09-19T09:35:06.958 INFO:tasks.workunit.client.1.smithi191.stdout:4/959: rename d5/dfb/dfd/d24/d32/d21/d5c/le6 to d5/dfb/dfd/d24/d82/df2/d19/l131 0 2024-09-19T09:35:06.960 INFO:tasks.workunit.client.1.smithi191.stdout:2/821: mkdir d8/d2a/dba/dcc/d11a 0 2024-09-19T09:35:06.960 INFO:tasks.workunit.client.1.smithi191.stdout:3/811: write d12/d43/f52 [2173952,108000] 0 2024-09-19T09:35:06.960 INFO:tasks.workunit.client.1.smithi191.stdout:3/812: readlink l5 0 2024-09-19T09:35:06.962 INFO:tasks.workunit.client.1.smithi191.stdout:3/813: creat d12/d43/d61/f11a x:0 0 0 2024-09-19T09:35:06.962 INFO:tasks.workunit.client.1.smithi191.stdout:3/814: fdatasync f9 0 2024-09-19T09:35:06.962 INFO:tasks.workunit.client.1.smithi191.stdout:3/815: read d12/d13/d1a/f32 [37647,105431] 0 2024-09-19T09:35:06.963 INFO:tasks.workunit.client.1.smithi191.stdout:3/816: mknod d12/d13/d1a/d1b/d3c/dd8/c11b 0 2024-09-19T09:35:06.963 INFO:tasks.workunit.client.1.smithi191.stdout:3/817: write d12/d13/d1a/d1b/d2e/dab/d51/fb9 [819072,66449] 0 2024-09-19T09:35:06.963 INFO:tasks.workunit.client.1.smithi191.stdout:3/818: fsync d12/d13/d1a/d5d/dd1/df0/f6a 0 2024-09-19T09:35:06.963 INFO:tasks.workunit.client.1.smithi191.stdout:3/819: chown d12/d13/d1a/d5d/dd1/df0/la4 87101 1 2024-09-19T09:35:06.963 INFO:tasks.workunit.client.1.smithi191.stdout:1/856: dread d3/fb3 [0,4194304] 0 2024-09-19T09:35:06.964 INFO:tasks.workunit.client.1.smithi191.stdout:1/857: write d3/d9/da/db/d48/f95 [386594,116962] 0 2024-09-19T09:35:06.965 INFO:tasks.workunit.client.1.smithi191.stdout:3/820: read d12/d13/d1a/d1b/d3c/d3f/f67 [455888,32394] 0 2024-09-19T09:35:06.965 INFO:tasks.workunit.client.1.smithi191.stdout:3/821: fdatasync f11 0 2024-09-19T09:35:06.965 INFO:tasks.workunit.client.1.smithi191.stdout:3/822: read d12/d107/da0/fbc [4148346,80328] 0 2024-09-19T09:35:06.965 INFO:tasks.workunit.client.1.smithi191.stdout:1/858: symlink d3/d9/da/db/d48/l13d 0 2024-09-19T09:35:06.965 INFO:tasks.workunit.client.1.smithi191.stdout:1/859: stat d3/d9/da/d1e/d25/fe9 0 2024-09-19T09:35:06.966 INFO:tasks.workunit.client.1.smithi191.stdout:3/823: creat d12/dff/f11c x:0 0 0 2024-09-19T09:35:06.966 INFO:tasks.workunit.client.1.smithi191.stdout:3/824: fsync d12/f1e 0 2024-09-19T09:35:06.967 INFO:tasks.workunit.client.1.smithi191.stdout:1/860: creat d3/d9/da/d1e/d32/d53/d57/d6d/da1/f13e x:0 0 0 2024-09-19T09:35:06.969 INFO:tasks.workunit.client.1.smithi191.stdout:3/825: rename d12/d43/f44 to d12/d13/d1a/d28/f11d 0 2024-09-19T09:35:06.969 INFO:tasks.workunit.client.1.smithi191.stdout:3/826: fdatasync d12/d13/d1a/d1b/d60/d7a/f92 0 2024-09-19T09:35:06.970 INFO:tasks.workunit.client.1.smithi191.stdout:3/827: mknod d12/d43/d61/d98/dc4/c11e 0 2024-09-19T09:35:06.972 INFO:tasks.workunit.client.1.smithi191.stdout:3/828: creat d12/d13/d1a/d1b/d2e/dab/da6/f11f x:0 0 0 2024-09-19T09:35:06.974 INFO:tasks.workunit.client.1.smithi191.stdout:1/861: getdents d3/d9/da/d1e/d32/d53/d57/d6d/da1 0 2024-09-19T09:35:06.977 INFO:tasks.workunit.client.1.smithi191.stdout:1/862: truncate d3/d9/da/d7e/fed 4962426 0 2024-09-19T09:35:06.977 INFO:tasks.workunit.client.1.smithi191.stdout:6/727: dwrite d2/de/d19/d5d/fb2 [0,4194304] 0 2024-09-19T09:35:06.977 INFO:tasks.workunit.client.1.smithi191.stdout:6/728: write d2/de/d2a/d39/f71 [42928,50797] 0 2024-09-19T09:35:06.977 INFO:tasks.workunit.client.1.smithi191.stdout:6/729: write d2/de/d2a/d7d/f6b [3282033,25533] 0 2024-09-19T09:35:06.977 INFO:tasks.workunit.client.1.smithi191.stdout:6/730: fdatasync d2/de/d19/d1e/d64/d77/d82/fa3 0 2024-09-19T09:35:06.977 INFO:tasks.workunit.client.1.smithi191.stdout:6/731: write d2/de/d19/d1e/d64/f54 [1271477,51259] 0 2024-09-19T09:35:06.977 INFO:tasks.workunit.client.1.smithi191.stdout:6/732: fdatasync d2/de/d19/d1e/d64/f56 0 2024-09-19T09:35:06.979 INFO:tasks.workunit.client.1.smithi191.stdout:1/863: rename d3/d9/da/db/d48/f95 to d3/d9/da/d1e/d25/f13f 0 2024-09-19T09:35:06.979 INFO:tasks.workunit.client.1.smithi191.stdout:1/864: readlink d3/d9/da/d1e/d32/l82 0 2024-09-19T09:35:06.979 INFO:tasks.workunit.client.1.smithi191.stdout:1/865: fdatasync d3/d9/da/d42/f91 0 2024-09-19T09:35:06.979 INFO:tasks.workunit.client.1.smithi191.stdout:1/866: fdatasync d3/d9/f9c 0 2024-09-19T09:35:06.979 INFO:tasks.workunit.client.1.smithi191.stdout:1/867: fsync d3/d9/da/d1e/d32/ddc/f110 0 2024-09-19T09:35:06.979 INFO:tasks.workunit.client.1.smithi191.stdout:1/868: truncate d3/d9/da/f12c 398275 0 2024-09-19T09:35:06.979 INFO:tasks.workunit.client.1.smithi191.stdout:1/869: readlink d3/d9/da/d1e/l27 0 2024-09-19T09:35:06.979 INFO:tasks.workunit.client.1.smithi191.stdout:1/870: readlink d3/d9/da/l2a 0 2024-09-19T09:35:06.979 INFO:tasks.workunit.client.1.smithi191.stdout:1/871: fdatasync d3/d9/da/d1e/d32/d53/f116 0 2024-09-19T09:35:06.979 INFO:tasks.workunit.client.1.smithi191.stdout:1/872: truncate d3/d9/da/d7e/fac 1481244 0 2024-09-19T09:35:06.980 INFO:tasks.workunit.client.1.smithi191.stdout:6/733: creat d2/de/d19/d1e/d64/d61/fe6 x:0 0 0 2024-09-19T09:35:06.982 INFO:tasks.workunit.client.1.smithi191.stdout:6/734: creat d2/de/d2a/d2d/d30/fe7 x:0 0 0 2024-09-19T09:35:06.982 INFO:tasks.workunit.client.1.smithi191.stdout:3/829: dread d12/d13/d1a/d5d/dc8/dd5/ffa [0,4194304] 0 2024-09-19T09:35:06.982 INFO:tasks.workunit.client.1.smithi191.stdout:3/830: dread - d12/d13/d1a/df7/f119 zero size 2024-09-19T09:35:06.982 INFO:tasks.workunit.client.1.smithi191.stdout:3/831: chown d12/d13/d1a/d1b/d2e/f5b 1 1 2024-09-19T09:35:06.984 INFO:tasks.workunit.client.1.smithi191.stdout:6/735: unlink d2/de/d19/d1e/d64/d77/d82/ce0 0 2024-09-19T09:35:06.985 INFO:tasks.workunit.client.1.smithi191.stdout:7/875: dwrite d2/d2a/f74 [0,4194304] 0 2024-09-19T09:35:06.985 INFO:tasks.workunit.client.1.smithi191.stdout:7/876: chown d2/d2a/d4f/d59/l11d 478726909 1 2024-09-19T09:35:06.985 INFO:tasks.workunit.client.1.smithi191.stdout:0/970: dwrite d0/d9/de/d61/dbf/fd4 [0,4194304] 0 2024-09-19T09:35:06.986 INFO:tasks.workunit.client.1.smithi191.stdout:5/823: dwrite d0/d1f/f43 [0,4194304] 0 2024-09-19T09:35:06.986 INFO:tasks.workunit.client.1.smithi191.stdout:5/824: write d0/da7/ff5 [568104,39110] 0 2024-09-19T09:35:06.986 INFO:tasks.workunit.client.1.smithi191.stdout:5/825: stat d0/d4/d9/d1d/d29/lff 0 2024-09-19T09:35:06.987 INFO:tasks.workunit.client.1.smithi191.stdout:3/832: rename d12/d13/d1a/d5d/dc8/ffe to d12/d13/d1a/d1b/d60/d7a/f120 0 2024-09-19T09:35:06.989 INFO:tasks.workunit.client.1.smithi191.stdout:2/822: dwrite d8/d11/d56/f79 [0,4194304] 0 2024-09-19T09:35:06.992 INFO:tasks.workunit.client.1.smithi191.stdout:0/971: truncate d0/d9/d1c/d111/f16 3264088 0 2024-09-19T09:35:06.992 INFO:tasks.workunit.client.1.smithi191.stdout:5/826: stat d0/d4/d9/d1d/d29/d33/d45/laa 0 2024-09-19T09:35:06.995 INFO:tasks.workunit.client.1.smithi191.stdout:2/823: rmdir d8/d2a/dba/dcc/d118 0 2024-09-19T09:35:06.995 INFO:tasks.workunit.client.1.smithi191.stdout:2/824: fsync d8/db/d41/fdd 0 2024-09-19T09:35:06.998 INFO:tasks.workunit.client.1.smithi191.stdout:0/972: truncate d0/d9/d1c/d1f/d24/d29/f3d 238609 0 2024-09-19T09:35:06.998 INFO:tasks.workunit.client.1.smithi191.stdout:0/973: chown d0/d9/d1c/d1f/d24/d29/d30/d7c/cfd 681 1 2024-09-19T09:35:06.998 INFO:tasks.workunit.client.1.smithi191.stdout:0/974: dread - d0/d9/d1c/d1f/d24/d29/d30/d7c/f126 zero size 2024-09-19T09:35:06.998 INFO:tasks.workunit.client.1.smithi191.stdout:5/827: creat d0/d4/d9/d1d/d28/f11c x:0 0 0 2024-09-19T09:35:06.999 INFO:tasks.workunit.client.1.smithi191.stdout:6/736: read d2/de/d2a/d2d/d30/d98/d9b/f9a [3302914,21523] 0 2024-09-19T09:35:07.001 INFO:tasks.workunit.client.1.smithi191.stdout:0/975: dread d0/d9/d1c/deb/fc2 [4194304,4194304] 0 2024-09-19T09:35:07.001 INFO:tasks.workunit.client.1.smithi191.stdout:2/825: chown d8/d11/d3f/d8a/d8f/cf3 23966812 1 2024-09-19T09:35:07.003 INFO:tasks.workunit.client.1.smithi191.stdout:5/828: dread d0/d4/d9/d1d/d22/d3b/f74 [0,4194304] 0 2024-09-19T09:35:07.007 INFO:tasks.workunit.client.1.smithi191.stdout:2/826: unlink d8/db/d13/f15 0 2024-09-19T09:35:07.007 INFO:tasks.workunit.client.1.smithi191.stdout:2/827: fsync d8/d2a/fed 0 2024-09-19T09:35:07.007 INFO:tasks.workunit.client.1.smithi191.stdout:2/828: stat d8/d11/d3f/cd1 0 2024-09-19T09:35:07.009 INFO:tasks.workunit.client.1.smithi191.stdout:2/829: rename d8/d11/l7a to d8/db/d13/d40/l11b 0 2024-09-19T09:35:07.010 INFO:tasks.workunit.client.1.smithi191.stdout:2/830: mknod d8/d11/d3f/dfa/dfc/d103/c11c 0 2024-09-19T09:35:07.011 INFO:tasks.workunit.client.1.smithi191.stdout:2/831: symlink d8/db/d13/d40/da8/l11d 0 2024-09-19T09:35:07.038 INFO:tasks.workunit.client.1.smithi191.stdout:4/960: dwrite d5/dfb/dfd/d24/d32/d21/d56/d86/d100/f113 [0,4194304] 0 2024-09-19T09:35:07.039 INFO:tasks.workunit.client.1.smithi191.stdout:4/961: rename d5/d1b/d74 to d5/d1b/d74/d132 22 2024-09-19T09:35:07.039 INFO:tasks.workunit.client.1.smithi191.stdout:1/873: dwrite d3/d9/da/d42/f91 [0,4194304] 0 2024-09-19T09:35:07.039 INFO:tasks.workunit.client.1.smithi191.stdout:3/833: dwrite d12/d13/d1a/d5d/dd1/df0/d91/f102 [4194304,4194304] 0 2024-09-19T09:35:07.039 INFO:tasks.workunit.client.1.smithi191.stdout:3/834: chown d12/d13/d1a/d5d/dc8/dd5/ffa 434 1 2024-09-19T09:35:07.039 INFO:tasks.workunit.client.1.smithi191.stdout:0/976: dwrite d0/d9/d1c/fd8 [0,4194304] 0 2024-09-19T09:35:07.039 INFO:tasks.workunit.client.1.smithi191.stdout:3/835: dread - d12/d43/d61/d98/ff2 zero size 2024-09-19T09:35:07.039 INFO:tasks.workunit.client.1.smithi191.stdout:3/836: truncate d12/d13/d1a/d1b/d2e/dab/fa5 365313 0 2024-09-19T09:35:07.039 INFO:tasks.workunit.client.1.smithi191.stdout:2/832: dwrite d8/db/f47 [0,4194304] 0 2024-09-19T09:35:07.039 INFO:tasks.workunit.client.1.smithi191.stdout:4/962: truncate d5/dfb/dfd/d24/d32/d8f/fbe 1270514 0 2024-09-19T09:35:07.042 INFO:tasks.workunit.client.1.smithi191.stdout:1/874: truncate d3/d9/da/db/f86 2229038 0 2024-09-19T09:35:07.048 INFO:tasks.workunit.client.1.smithi191.stdout:2/833: symlink d8/d2a/dba/dcc/d10c/l11e 0 2024-09-19T09:35:07.048 INFO:tasks.workunit.client.1.smithi191.stdout:2/834: write d8/db/d13/d23/dde/f111 [344807,91315] 0 2024-09-19T09:35:07.049 INFO:tasks.workunit.client.1.smithi191.stdout:4/963: mkdir d5/dfb/dfd/d24/d32/d21/d4a/dc5/de3/d133 0 2024-09-19T09:35:07.049 INFO:tasks.workunit.client.1.smithi191.stdout:4/964: dread - d5/dfb/dfd/d24/d32/d21/d92/de9/f127 zero size 2024-09-19T09:35:07.051 INFO:tasks.workunit.client.1.smithi191.stdout:4/965: read d5/dfb/dfd/d24/d32/f36 [2246455,38998] 0 2024-09-19T09:35:07.057 INFO:tasks.workunit.client.1.smithi191.stdout:0/977: rename d0/d9/d1c/d1f to d0/d6f/d7b/d138 0 2024-09-19T09:35:07.058 INFO:tasks.workunit.client.1.smithi191.stdout:4/966: mknod d5/dfb/c134 0 2024-09-19T09:35:07.059 INFO:tasks.workunit.client.1.smithi191.stdout:0/978: creat d0/d6f/d7b/d138/d24/d39/df2/f139 x:0 0 0 2024-09-19T09:35:07.059 INFO:tasks.workunit.client.1.smithi191.stdout:0/979: stat d0/d6f/d7b/d138/d24/d29/d30/d7c 0 2024-09-19T09:35:07.059 INFO:tasks.workunit.client.1.smithi191.stdout:0/980: fdatasync d0/d6f/d7b/d138/d24/d29/d30/fc3 0 2024-09-19T09:35:07.059 INFO:tasks.workunit.client.1.smithi191.stdout:0/981: creat d0/dc5/f13a x:0 0 0 2024-09-19T09:35:07.061 INFO:tasks.workunit.client.1.smithi191.stdout:9/852: sync 2024-09-19T09:35:07.062 INFO:tasks.workunit.client.1.smithi191.stdout:3/837: dwrite d12/d13/d1a/d5d/dd1/ff3 [0,4194304] 0 2024-09-19T09:35:07.065 INFO:tasks.workunit.client.1.smithi191.stdout:2/835: dread d8/d2a/f32 [0,4194304] 0 2024-09-19T09:35:07.066 INFO:tasks.workunit.client.1.smithi191.stdout:0/982: dread d0/d9/de/d81/f94 [0,4194304] 0 2024-09-19T09:35:07.066 INFO:tasks.workunit.client.1.smithi191.stdout:3/838: getdents d12/d107/da0 0 2024-09-19T09:35:07.068 INFO:tasks.workunit.client.1.smithi191.stdout:9/853: rmdir d3/db/d16/d17/d5b/dc5 0 2024-09-19T09:35:07.068 INFO:tasks.workunit.client.1.smithi191.stdout:9/854: dread - d3/db/d53/dec/f117 zero size 2024-09-19T09:35:07.072 INFO:tasks.workunit.client.1.smithi191.stdout:0/983: rename d0/dc5/d86 to d0/d6f/d7b/d138/d24/d29/d30/d56/d103/d13b 0 2024-09-19T09:35:07.074 INFO:tasks.workunit.client.1.smithi191.stdout:9/855: creat d3/db/d16/d17/d3c/f128 x:0 0 0 2024-09-19T09:35:07.075 INFO:tasks.workunit.client.1.smithi191.stdout:2/836: rmdir d8/db/d13/d40 39 2024-09-19T09:35:07.077 INFO:tasks.workunit.client.1.smithi191.stdout:0/984: unlink d0/d9/c42 0 2024-09-19T09:35:07.078 INFO:tasks.workunit.client.1.smithi191.stdout:0/985: dread - d0/d6f/d7b/d138/d24/d87/f132 zero size 2024-09-19T09:35:07.078 INFO:tasks.workunit.client.1.smithi191.stdout:0/986: fsync d0/d6f/d7b/d138/d24/f89 0 2024-09-19T09:35:07.078 INFO:tasks.workunit.client.1.smithi191.stdout:9/856: rmdir d3/db/d16/d17/d81/d8d/dcd 39 2024-09-19T09:35:07.080 INFO:tasks.workunit.client.1.smithi191.stdout:2/837: rename f6 to d8/db/d13/d40/f11f 0 2024-09-19T09:35:07.080 INFO:tasks.workunit.client.1.smithi191.stdout:2/838: chown d8/db/d13/d40/fad 620 1 2024-09-19T09:35:07.080 INFO:tasks.workunit.client.1.smithi191.stdout:2/839: write d8/f9e [1032941,54541] 0 2024-09-19T09:35:07.082 INFO:tasks.workunit.client.1.smithi191.stdout:0/987: rename d0/d6f/d7b/d138/d24/d29/d30/fc3 to d0/d9/d1c/deb/ddb/f13c 0 2024-09-19T09:35:07.082 INFO:tasks.workunit.client.1.smithi191.stdout:2/840: rename d8 to d8/d11/d56/d120 22 2024-09-19T09:35:07.084 INFO:tasks.workunit.client.1.smithi191.stdout:2/841: mkdir d8/d11/dc2/d121 0 2024-09-19T09:35:07.084 INFO:tasks.workunit.client.1.smithi191.stdout:2/842: chown d8/db/d41/l68 33 1 2024-09-19T09:35:07.094 INFO:tasks.workunit.client.1.smithi191.stdout:3/839: dwrite d12/d13/d1a/d1b/d3c/d71/d112/d73/f105 [8388608,4194304] 0 2024-09-19T09:35:07.094 INFO:tasks.workunit.client.1.smithi191.stdout:3/840: readlink d12/d43/d61/l82 0 2024-09-19T09:35:07.095 INFO:tasks.workunit.client.1.smithi191.stdout:3/841: symlink d12/d13/d1a/d1b/d3c/d3f/l121 0 2024-09-19T09:35:07.096 INFO:tasks.workunit.client.1.smithi191.stdout:4/967: dwrite d5/dfb/dfd/d24/d82/df2/d37/f105 [0,4194304] 0 2024-09-19T09:35:07.096 INFO:tasks.workunit.client.1.smithi191.stdout:3/842: getdents d12/d13/d1a/d1b/d2e 0 2024-09-19T09:35:07.097 INFO:tasks.workunit.client.1.smithi191.stdout:3/843: fdatasync d12/d43/d61/d98/ff2 0 2024-09-19T09:35:07.099 INFO:tasks.workunit.client.1.smithi191.stdout:9/857: dwrite d3/db/d16/d17/d81/f8a [0,4194304] 0 2024-09-19T09:35:07.108 INFO:tasks.workunit.client.1.smithi191.stdout:4/968: dread d5/dfb/dfd/d24/d32/d21/d92/fa8 [0,4194304] 0 2024-09-19T09:35:07.112 INFO:tasks.workunit.client.1.smithi191.stdout:3/844: read d12/d13/d1a/d5d/dd1/df0/d91/f102 [7927203,88574] 0 2024-09-19T09:35:07.113 INFO:tasks.workunit.client.1.smithi191.stdout:3/845: fsync d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/fb3 0 2024-09-19T09:35:07.113 INFO:tasks.workunit.client.1.smithi191.stdout:3/846: creat d12/dff/f122 x:0 0 0 2024-09-19T09:35:07.174 INFO:tasks.workunit.client.1.smithi191.stdout:2/843: dwrite d8/db/d41/fdc [0,4194304] 0 2024-09-19T09:35:07.176 INFO:tasks.workunit.client.1.smithi191.stdout:4/969: rename d5/dfb/dfd/d24/d32/d21/d4a/f51 to d5/dfb/dfd/df9/d88/d10c/f135 0 2024-09-19T09:35:07.176 INFO:tasks.workunit.client.1.smithi191.stdout:4/970: creat d5/dfb/dfd/d24/d32/d21/d56/d86/d100/f136 x:0 0 0 2024-09-19T09:35:07.183 INFO:tasks.workunit.client.1.smithi191.stdout:3/847: rename d12/d107/da0/fee to d12/d13/d1a/d1b/d2e/dab/d51/dcd/f123 0 2024-09-19T09:35:07.183 INFO:tasks.workunit.client.1.smithi191.stdout:3/848: dread - d12/d43/d61/d98/ff1 zero size 2024-09-19T09:35:07.184 INFO:tasks.workunit.client.1.smithi191.stdout:4/971: truncate d5/dfb/dfd/d24/d32/d21/d56/fb9 5317250 0 2024-09-19T09:35:07.185 INFO:tasks.workunit.client.1.smithi191.stdout:2/844: getdents d8/d11/d3f/d64 0 2024-09-19T09:35:07.187 INFO:tasks.workunit.client.1.smithi191.stdout:3/849: mkdir d12/d13/d1a/d1b/d2e/dab/d124 0 2024-09-19T09:35:07.187 INFO:tasks.workunit.client.1.smithi191.stdout:3/850: dread - d12/dff/f11c zero size 2024-09-19T09:35:07.187 INFO:tasks.workunit.client.1.smithi191.stdout:3/851: stat d12/d43/c90 0 2024-09-19T09:35:07.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:06 smithi112 ceph-mon[27605]: pgmap v15: 65 pgs: 65 active+clean; 1.6 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 156 MiB/s rd, 204 MiB/s wr, 648 op/s 2024-09-19T09:35:07.188 INFO:tasks.workunit.client.1.smithi191.stdout:4/972: mkdir d5/d1b/d8e/dc9/d137 0 2024-09-19T09:35:07.189 INFO:tasks.workunit.client.1.smithi191.stdout:2/845: mknod d8/db/d4d/c122 0 2024-09-19T09:35:07.189 INFO:tasks.workunit.client.1.smithi191.stdout:2/846: fdatasync d8/fbc 0 2024-09-19T09:35:07.191 INFO:tasks.workunit.client.1.smithi191.stdout:2/847: symlink d8/d11/d3f/dfa/dfc/l123 0 2024-09-19T09:35:07.191 INFO:tasks.workunit.client.1.smithi191.stdout:2/848: read - d8/d11/d3f/dfa/f117 zero size 2024-09-19T09:35:07.191 INFO:tasks.workunit.client.1.smithi191.stdout:0/988: sync 2024-09-19T09:35:07.191 INFO:tasks.workunit.client.1.smithi191.stdout:9/858: sync 2024-09-19T09:35:07.191 INFO:tasks.workunit.client.1.smithi191.stdout:7/877: sync 2024-09-19T09:35:07.191 INFO:tasks.workunit.client.1.smithi191.stdout:5/829: sync 2024-09-19T09:35:07.191 INFO:tasks.workunit.client.1.smithi191.stdout:1/875: sync 2024-09-19T09:35:07.191 INFO:tasks.workunit.client.1.smithi191.stdout:6/737: sync 2024-09-19T09:35:07.192 INFO:tasks.workunit.client.1.smithi191.stdout:6/738: dread - d2/de/d19/d5d/f6f zero size 2024-09-19T09:35:07.192 INFO:tasks.workunit.client.1.smithi191.stdout:1/876: dread - d3/d9/da/d1e/d32/d53/f13b zero size 2024-09-19T09:35:07.193 INFO:tasks.workunit.client.1.smithi191.stdout:2/849: mknod d8/d2a/dba/dcc/d10c/c124 0 2024-09-19T09:35:07.193 INFO:tasks.workunit.client.1.smithi191.stdout:1/877: dread d3/d9/da/d1e/f44 [0,4194304] 0 2024-09-19T09:35:07.193 INFO:tasks.workunit.client.1.smithi191.stdout:9/859: mkdir d3/db/d16/d38/d92/d129 0 2024-09-19T09:35:07.193 INFO:tasks.workunit.client.1.smithi191.stdout:9/860: creat d3/f12a x:0 0 0 2024-09-19T09:35:07.193 INFO:tasks.workunit.client.1.smithi191.stdout:9/861: chown d3/db/d16/d47/d89/cb9 292 1 2024-09-19T09:35:07.194 INFO:tasks.workunit.client.1.smithi191.stdout:7/878: mknod d2/d2a/d38/def/c135 0 2024-09-19T09:35:07.195 INFO:tasks.workunit.client.1.smithi191.stdout:0/989: rename d0/d6f/d7b/d138/d24/d29/d30/d56/c97 to d0/d6f/d7b/d138/d24/d29/c13d 0 2024-09-19T09:35:07.195 INFO:tasks.workunit.client.1.smithi191.stdout:0/990: write d0/d6f/d7b/d138/d24/d87/f104 [401338,127471] 0 2024-09-19T09:35:07.195 INFO:tasks.workunit.client.1.smithi191.stdout:0/991: stat d0/dc5/fd7 0 2024-09-19T09:35:07.197 INFO:tasks.workunit.client.1.smithi191.stdout:5/830: symlink d0/d4/d9/d1d/d22/d3b/db9/dfd/l11d 0 2024-09-19T09:35:07.197 INFO:tasks.workunit.client.1.smithi191.stdout:1/878: link d3/le2 d3/d9/da/d42/d8a/l140 0 2024-09-19T09:35:07.200 INFO:tasks.workunit.client.1.smithi191.stdout:1/879: creat d3/d9/da/d1e/d25/d70/da0/f141 x:0 0 0 2024-09-19T09:35:07.200 INFO:tasks.workunit.client.1.smithi191.stdout:1/880: chown d3/l16 0 1 2024-09-19T09:35:07.200 INFO:tasks.workunit.client.1.smithi191.stdout:1/881: chown d3/d9/da/d1e/d32/ddc/lf0 101 1 2024-09-19T09:35:07.200 INFO:tasks.workunit.client.1.smithi191.stdout:1/882: fdatasync d3/d9/da/d1e/d32/d53/dd8/fdb 0 2024-09-19T09:35:07.201 INFO:tasks.workunit.client.1.smithi191.stdout:2/850: write d8/db/d13/d40/fad [3767449,106100] 0 2024-09-19T09:35:07.202 INFO:tasks.workunit.client.1.smithi191.stdout:5/831: rename d0/d4/d9/d1d/d29/d33/d45/c4e to d0/d4/d4a/c11e 0 2024-09-19T09:35:07.203 INFO:tasks.workunit.client.1.smithi191.stdout:4/973: dread d5/dfb/dfd/d24/d32/d21/d56/fb9 [0,4194304] 0 2024-09-19T09:35:07.205 INFO:tasks.workunit.client.1.smithi191.stdout:1/883: creat d3/d9/d73/d11b/f142 x:0 0 0 2024-09-19T09:35:07.205 INFO:tasks.workunit.client.1.smithi191.stdout:2/851: fdatasync d8/d11/d3f/d8a/dda/f102 0 2024-09-19T09:35:07.205 INFO:tasks.workunit.client.1.smithi191.stdout:1/884: truncate d3/d9/da/d1e/d32/d53/d57/d6d/da1/f13e 619184 0 2024-09-19T09:35:07.206 INFO:tasks.workunit.client.1.smithi191.stdout:5/832: mknod d0/d4/c11f 0 2024-09-19T09:35:07.207 INFO:tasks.workunit.client.1.smithi191.stdout:4/974: truncate d5/dfb/dfd/d24/d32/d21/d56/fe5 2282539 0 2024-09-19T09:35:07.209 INFO:tasks.workunit.client.1.smithi191.stdout:1/885: mkdir d3/d9/da/d1e/d32/d53/d57/def/d143 0 2024-09-19T09:35:07.211 INFO:tasks.workunit.client.1.smithi191.stdout:1/886: mkdir d3/d9/da/db/d48/d144 0 2024-09-19T09:35:07.213 INFO:tasks.workunit.client.1.smithi191.stdout:2/852: dread d8/db/d13/d23/dde/f111 [0,4194304] 0 2024-09-19T09:35:07.214 INFO:tasks.workunit.client.1.smithi191.stdout:1/887: creat d3/d9/da/d1e/d32/d53/d57/d111/f145 x:0 0 0 2024-09-19T09:35:07.216 INFO:tasks.workunit.client.1.smithi191.stdout:2/853: creat d8/db/d4d/de6/d70/de8/f125 x:0 0 0 2024-09-19T09:35:07.216 INFO:tasks.workunit.client.1.smithi191.stdout:2/854: chown d8/d11/d3f/dfa/c108 4310 1 2024-09-19T09:35:07.217 INFO:tasks.workunit.client.1.smithi191.stdout:2/855: write d8/db/d4d/de6/f48 [1540512,80413] 0 2024-09-19T09:35:07.217 INFO:tasks.workunit.client.1.smithi191.stdout:7/879: dread d2/f1e [0,4194304] 0 2024-09-19T09:35:07.219 INFO:tasks.workunit.client.1.smithi191.stdout:2/856: symlink d8/d11/d3f/l126 0 2024-09-19T09:35:07.219 INFO:tasks.workunit.client.1.smithi191.stdout:2/857: fsync d8/db/d4d/de6/f90 0 2024-09-19T09:35:07.220 INFO:tasks.workunit.client.1.smithi191.stdout:7/880: getdents d2/d2a/d79/d7f 0 2024-09-19T09:35:07.220 INFO:tasks.workunit.client.1.smithi191.stdout:7/881: dread - d2/d2a/d4f/d59/d81/f12e zero size 2024-09-19T09:35:07.222 INFO:tasks.workunit.client.1.smithi191.stdout:7/882: unlink d2/d2a/d38/d63/d9a/ca9 0 2024-09-19T09:35:07.223 INFO:tasks.workunit.client.1.smithi191.stdout:2/858: dread d8/f9e [0,4194304] 0 2024-09-19T09:35:07.225 INFO:tasks.workunit.client.1.smithi191.stdout:2/859: link d8/f2f d8/d2a/dba/dcc/d10c/f127 0 2024-09-19T09:35:07.226 INFO:tasks.workunit.client.1.smithi191.stdout:2/860: truncate d8/db/d13/d40/f52 239537 0 2024-09-19T09:35:07.228 INFO:tasks.workunit.client.1.smithi191.stdout:2/861: mknod d8/d11/d3f/dfa/c128 0 2024-09-19T09:35:07.230 INFO:tasks.workunit.client.1.smithi191.stdout:1/888: dread d3/d9/da/d1e/d32/f74 [0,4194304] 0 2024-09-19T09:35:07.243 INFO:tasks.workunit.client.1.smithi191.stdout:2/862: write d8/db/d13/d23/f29 [6576692,122650] 0 2024-09-19T09:35:07.243 INFO:tasks.workunit.client.1.smithi191.stdout:6/739: dwrite d2/de/d19/d1e/fba [0,4194304] 0 2024-09-19T09:35:07.246 INFO:tasks.workunit.client.1.smithi191.stdout:1/889: dread d3/d9/da/d42/f91 [0,4194304] 0 2024-09-19T09:35:07.247 INFO:tasks.workunit.client.1.smithi191.stdout:9/862: dwrite d3/d8/f22 [0,4194304] 0 2024-09-19T09:35:07.247 INFO:tasks.workunit.client.1.smithi191.stdout:9/863: read - d3/db/d16/d17/d81/d8d/d126/f127 zero size 2024-09-19T09:35:07.252 INFO:tasks.workunit.client.1.smithi191.stdout:0/992: dwrite d0/d9/d1c/fc6 [0,4194304] 0 2024-09-19T09:35:07.252 INFO:tasks.workunit.client.1.smithi191.stdout:5/833: dwrite d0/d4/d9/d1d/d22/d3b/f74 [0,4194304] 0 2024-09-19T09:35:07.252 INFO:tasks.workunit.client.1.smithi191.stdout:4/975: dwrite d5/dfb/dfd/d24/d32/d21/d92/fa8 [0,4194304] 0 2024-09-19T09:35:07.258 INFO:tasks.workunit.client.1.smithi191.stdout:1/890: dread d3/d9/da/db/f86 [0,4194304] 0 2024-09-19T09:35:07.258 INFO:tasks.workunit.client.1.smithi191.stdout:1/891: write d3/d9/da/d7e/fc8 [995842,75806] 0 2024-09-19T09:35:07.258 INFO:tasks.workunit.client.1.smithi191.stdout:1/892: dread - d3/d9/da/d7e/ffa zero size 2024-09-19T09:35:07.261 INFO:tasks.workunit.client.1.smithi191.stdout:5/834: write d0/d4/d9/d1d/d29/d33/d45/d97/ddf/ffa [1433399,85329] 0 2024-09-19T09:35:07.261 INFO:tasks.workunit.client.1.smithi191.stdout:2/863: read d8/d11/d56/f92 [2603690,10480] 0 2024-09-19T09:35:07.267 INFO:tasks.workunit.client.1.smithi191.stdout:0/993: rename d0/d9/de/d81/f94 to d0/d6f/d7b/f13e 0 2024-09-19T09:35:07.268 INFO:tasks.workunit.client.1.smithi191.stdout:5/835: truncate d0/d4/d9/d1d/d29/d33/f38 1034238 0 2024-09-19T09:35:07.269 INFO:tasks.workunit.client.1.smithi191.stdout:0/994: symlink d0/d9/d1c/l13f 0 2024-09-19T09:35:07.271 INFO:tasks.workunit.client.1.smithi191.stdout:5/836: link d0/d4/d9/d1d/d28/f85 d0/d4/d9/d1d/d29/d33/d52/da4/f120 0 2024-09-19T09:35:07.271 INFO:tasks.workunit.client.1.smithi191.stdout:5/837: chown d0/d4/d9/d1d/f46 45 1 2024-09-19T09:35:07.271 INFO:tasks.workunit.client.1.smithi191.stdout:5/838: write d0/da7/dcd/dd7/fe9 [963942,20648] 0 2024-09-19T09:35:07.271 INFO:tasks.workunit.client.1.smithi191.stdout:6/740: write d2/de/d19/d1e/d64/f8f [264417,113537] 0 2024-09-19T09:35:07.272 INFO:tasks.workunit.client.1.smithi191.stdout:0/995: unlink d0/d6f/d7b/d138/d24/d39/ca0 0 2024-09-19T09:35:07.273 INFO:tasks.workunit.client.1.smithi191.stdout:0/996: mkdir d0/d6f/d140 0 2024-09-19T09:35:07.274 INFO:tasks.workunit.client.1.smithi191.stdout:0/997: creat d0/d6f/d7b/d138/d24/d87/f141 x:0 0 0 2024-09-19T09:35:07.275 INFO:tasks.workunit.client.1.smithi191.stdout:1/893: dread d3/d9/da/d1e/d25/ffe [0,4194304] 0 2024-09-19T09:35:07.275 INFO:tasks.workunit.client.1.smithi191.stdout:1/894: fsync d3/d9/da/f102 0 2024-09-19T09:35:07.275 INFO:tasks.workunit.client.1.smithi191.stdout:0/998: symlink d0/l142 0 2024-09-19T09:35:07.280 INFO:tasks.workunit.client.1.smithi191.stdout:5/839: dread d0/d4/d9/de/f18 [0,4194304] 0 2024-09-19T09:35:07.281 INFO:tasks.workunit.client.1.smithi191.stdout:5/840: mknod d0/d4/d9/d1d/d29/d33/d45/d64/de7/c121 0 2024-09-19T09:35:07.281 INFO:tasks.workunit.client.1.smithi191.stdout:5/841: creat d0/d4/d9/d1d/d29/d33/d45/d97/ddf/f122 x:0 0 0 2024-09-19T09:35:07.283 INFO:tasks.workunit.client.1.smithi191.stdout:1/895: dread d3/d9/da/db/f49 [0,4194304] 0 2024-09-19T09:35:07.283 INFO:tasks.workunit.client.1.smithi191.stdout:4/976: dwrite d5/dfb/dfd/d24/f104 [0,4194304] 0 2024-09-19T09:35:07.284 INFO:tasks.workunit.client.1.smithi191.stdout:9/864: dwrite d3/db/d16/d47/d89/fc8 [0,4194304] 0 2024-09-19T09:35:07.284 INFO:tasks.workunit.client.1.smithi191.stdout:4/977: stat d5/dfb/dfd/d24/d82/df2/d37/d59/cb0 0 2024-09-19T09:35:07.284 INFO:tasks.workunit.client.1.smithi191.stdout:9/865: chown d3/db/d53/da2/db3/dc2/lf9 31069965 1 2024-09-19T09:35:07.284 INFO:tasks.workunit.client.1.smithi191.stdout:4/978: creat d5/dfb/dfd/df9/d88/f138 x:0 0 0 2024-09-19T09:35:07.284 INFO:tasks.workunit.client.1.smithi191.stdout:4/979: fsync d5/d1b/d8e/dc9/f124 0 2024-09-19T09:35:07.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:06 smithi191 ceph-mon[34834]: pgmap v15: 65 pgs: 65 active+clean; 1.6 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 156 MiB/s rd, 204 MiB/s wr, 648 op/s 2024-09-19T09:35:07.287 INFO:tasks.workunit.client.1.smithi191.stdout:6/741: dread d2/de/fbe [0,4194304] 0 2024-09-19T09:35:07.292 INFO:tasks.workunit.client.1.smithi191.stdout:9/866: link d3/l4b d3/db/d16/d17/d81/db5/l12b 0 2024-09-19T09:35:07.292 INFO:tasks.workunit.client.1.smithi191.stdout:4/980: chown d5/dfb/dfd/d24/d32/d21/d5c/c65 113038 1 2024-09-19T09:35:07.294 INFO:tasks.workunit.client.1.smithi191.stdout:0/999: dwrite d0/d9/d1c/d20/fb5 [0,4194304] 0 2024-09-19T09:35:07.294 INFO:tasks.workunit.client.1.smithi191.stdout:2/864: rename d8/db/d13 to d8/d11/d3f/d8a/d107/d129 0 2024-09-19T09:35:07.294 INFO:tasks.workunit.client.1.smithi191.stdout:2/865: write d8/d11/d3f/d8a/dda/f102 [1007466,8074] 0 2024-09-19T09:35:07.295 INFO:tasks.workunit.client.1.smithi191.stdout:6/742: mkdir d2/de/d15/de8 0 2024-09-19T09:35:07.295 INFO:tasks.workunit.client.1.smithi191.stdout:9/867: stat d3/db/d16/d17/d3c/dc0/lf1 0 2024-09-19T09:35:07.295 INFO:tasks.workunit.client.1.smithi191.stdout:9/868: fsync d3/d8/fb2 0 2024-09-19T09:35:07.296 INFO:tasks.workunit.client.1.smithi191.stdout:9/869: dread - d3/db/d53/da2/db3/ff5 zero size 2024-09-19T09:35:07.296 INFO:tasks.workunit.client.1.smithi191.stdout:3/852: sync 2024-09-19T09:35:07.296 INFO:tasks.workunit.client.1.smithi191.stdout:3/853: fsync d12/d13/d1a/d1b/d2e/f53 0 2024-09-19T09:35:07.296 INFO:tasks.workunit.client.1.smithi191.stdout:4/981: dread d5/dfb/dfd/d24/d32/f16 [0,4194304] 0 2024-09-19T09:35:07.298 INFO:tasks.workunit.client.1.smithi191.stdout:2/866: dread d8/d11/d3f/f39 [0,4194304] 0 2024-09-19T09:35:07.299 INFO:tasks.workunit.client.1.smithi191.stdout:9/870: rename d3/db/d16/d17/d81/db5/l12b to d3/db/d53/l12c 0 2024-09-19T09:35:07.300 INFO:tasks.workunit.client.1.smithi191.stdout:3/854: symlink d12/d13/d1a/d28/l125 0 2024-09-19T09:35:07.301 INFO:tasks.workunit.client.1.smithi191.stdout:3/855: dread d12/d107/fde [0,4194304] 0 2024-09-19T09:35:07.301 INFO:tasks.workunit.client.1.smithi191.stdout:3/856: dread - d12/d43/db2/fd4 zero size 2024-09-19T09:35:07.301 INFO:tasks.workunit.client.1.smithi191.stdout:3/857: chown d12/d13/d1a/d1b/d3c/d3f/c118 15056 1 2024-09-19T09:35:07.301 INFO:tasks.workunit.client.1.smithi191.stdout:4/982: symlink d5/d1b/d74/l139 0 2024-09-19T09:35:07.303 INFO:tasks.workunit.client.1.smithi191.stdout:2/867: link d8/d2a/dba/dcc/lcf d8/d11/d3f/d8a/d107/d129/d23/l12a 0 2024-09-19T09:35:07.304 INFO:tasks.workunit.client.1.smithi191.stdout:4/983: getdents d5/d1b/d8e/dad 0 2024-09-19T09:35:07.306 INFO:tasks.workunit.client.1.smithi191.stdout:6/743: read d2/de/d19/d1e/f3e [8308767,105906] 0 2024-09-19T09:35:07.308 INFO:tasks.workunit.client.1.smithi191.stdout:2/868: symlink d8/d11/dc2/d121/l12b 0 2024-09-19T09:35:07.308 INFO:tasks.workunit.client.1.smithi191.stdout:3/858: write d12/d13/d1a/d1b/d2e/f5b [4029187,41037] 0 2024-09-19T09:35:07.308 INFO:tasks.workunit.client.1.smithi191.stdout:4/984: mkdir d5/dfb/dfd/df9/d88/d10c/d13a 0 2024-09-19T09:35:07.308 INFO:tasks.workunit.client.1.smithi191.stdout:2/869: chown d8/d11/d3f/d8a/d107/d129/d23/fb0 296 1 2024-09-19T09:35:07.309 INFO:tasks.workunit.client.1.smithi191.stdout:6/744: creat d2/de/d2a/d2d/d30/d98/fe9 x:0 0 0 2024-09-19T09:35:07.313 INFO:tasks.workunit.client.1.smithi191.stdout:6/745: chown d2/de/d19/d1e/d64/d61/d81/da7/dde 0 1 2024-09-19T09:35:07.313 INFO:tasks.workunit.client.1.smithi191.stdout:4/985: stat d5/d1b/d8e/dc9/l128 0 2024-09-19T09:35:07.313 INFO:tasks.workunit.client.1.smithi191.stdout:6/746: link d2/de/d2a/d2d/dc7/fd8 d2/de/d2a/d2d/dc7/fea 0 2024-09-19T09:35:07.313 INFO:tasks.workunit.client.1.smithi191.stdout:3/859: read d12/d13/d1a/d5d/dd1/df0/d91/fb5 [58697,120973] 0 2024-09-19T09:35:07.314 INFO:tasks.workunit.client.1.smithi191.stdout:3/860: fsync d12/d13/d1a/d5d/dd1/fd3 0 2024-09-19T09:35:07.314 INFO:tasks.workunit.client.1.smithi191.stdout:6/747: symlink d2/de/d19/d1e/dd2/leb 0 2024-09-19T09:35:07.314 INFO:tasks.workunit.client.1.smithi191.stdout:3/861: mknod d12/d13/d1a/d5d/dc8/dd5/c126 0 2024-09-19T09:35:07.316 INFO:tasks.workunit.client.1.smithi191.stdout:6/748: creat d2/de/d2a/d2d/d30/d98/de2/fec x:0 0 0 2024-09-19T09:35:07.320 INFO:tasks.workunit.client.1.smithi191.stdout:7/883: sync 2024-09-19T09:35:07.331 INFO:tasks.workunit.client.1.smithi191.stdout:6/749: write d2/de/d19/d1e/d64/d77/d82/fa3 [4161243,33200] 0 2024-09-19T09:35:07.331 INFO:tasks.workunit.client.1.smithi191.stdout:6/750: creat d2/de/d2a/d2d/d30/d98/d9b/d65/fed x:0 0 0 2024-09-19T09:35:07.332 INFO:tasks.workunit.client.1.smithi191.stdout:6/751: creat d2/de/d2a/d2d/fee x:0 0 0 2024-09-19T09:35:07.332 INFO:tasks.workunit.client.1.smithi191.stdout:6/752: dread - d2/de/d2a/d2d/fa9 zero size 2024-09-19T09:35:07.333 INFO:tasks.workunit.client.1.smithi191.stdout:6/753: write d2/de/f1d [2910997,25906] 0 2024-09-19T09:35:07.333 INFO:tasks.workunit.client.1.smithi191.stdout:6/754: symlink d2/de/d19/d1e/d64/lef 0 2024-09-19T09:35:07.333 INFO:tasks.workunit.client.1.smithi191.stdout:6/755: mkdir d2/de/df0 0 2024-09-19T09:35:07.342 INFO:tasks.workunit.client.1.smithi191.stdout:2/870: dwrite d8/f9e [0,4194304] 0 2024-09-19T09:35:07.344 INFO:tasks.workunit.client.1.smithi191.stdout:2/871: unlink d8/d2a/dd8/f115 0 2024-09-19T09:35:07.344 INFO:tasks.workunit.client.1.smithi191.stdout:2/872: truncate d8/d11/d3f/d8a/d107/d129/d23/fb0 889365 0 2024-09-19T09:35:07.348 INFO:tasks.workunit.client.1.smithi191.stdout:4/986: dwrite d5/f8 [0,4194304] 0 2024-09-19T09:35:07.349 INFO:tasks.workunit.client.1.smithi191.stdout:4/987: rmdir d5/dfb/dfd/df9 39 2024-09-19T09:35:07.351 INFO:tasks.workunit.client.1.smithi191.stdout:7/884: dwrite d2/d39/d3a/d9c/fd9 [0,4194304] 0 2024-09-19T09:35:07.354 INFO:tasks.workunit.client.1.smithi191.stdout:7/885: mkdir d2/d2a/d4f/d59/d81/d136 0 2024-09-19T09:35:07.355 INFO:tasks.workunit.client.1.smithi191.stdout:7/886: chown d2/d2a/d4f 1394 1 2024-09-19T09:35:07.355 INFO:tasks.workunit.client.1.smithi191.stdout:6/756: dwrite d2/de/d19/d1e/d64/f54 [0,4194304] 0 2024-09-19T09:35:07.356 INFO:tasks.workunit.client.1.smithi191.stdout:7/887: truncate d2/d2a/d4f/d59/fa5 758832 0 2024-09-19T09:35:07.356 INFO:tasks.workunit.client.1.smithi191.stdout:3/862: dwrite d12/d43/d61/d98/ff2 [0,4194304] 0 2024-09-19T09:35:07.357 INFO:tasks.workunit.client.1.smithi191.stdout:6/757: dread d2/de/d19/d1e/fe4 [0,4194304] 0 2024-09-19T09:35:07.358 INFO:tasks.workunit.client.1.smithi191.stdout:6/758: write d2/de/f69 [2008939,83652] 0 2024-09-19T09:35:07.358 INFO:tasks.workunit.client.1.smithi191.stdout:6/759: chown d2/de/d2a/d2d/d30/d98/d9b 521535 1 2024-09-19T09:35:07.359 INFO:tasks.workunit.client.1.smithi191.stdout:2/873: dread d8/d11/d3f/d8a/d107/d10d/f112 [0,4194304] 0 2024-09-19T09:35:07.359 INFO:tasks.workunit.client.1.smithi191.stdout:3/863: unlink d12/d43/d61/d98/dc4/fe5 0 2024-09-19T09:35:07.359 INFO:tasks.workunit.client.1.smithi191.stdout:6/760: mkdir d2/de/d2a/d2d/d30/d98/de2/df1 0 2024-09-19T09:35:07.361 INFO:tasks.workunit.client.1.smithi191.stdout:6/761: mkdir d2/de/d19/d1e/d64/df2 0 2024-09-19T09:35:07.361 INFO:tasks.workunit.client.1.smithi191.stdout:6/762: creat d2/de/d2a/d2d/d30/ff3 x:0 0 0 2024-09-19T09:35:07.361 INFO:tasks.workunit.client.1.smithi191.stdout:2/874: mkdir d8/db/d41/d12c 0 2024-09-19T09:35:07.363 INFO:tasks.workunit.client.1.smithi191.stdout:6/763: link d2/de/d19/d1e/d64/c80 d2/de/d2a/d2d/dc7/cf4 0 2024-09-19T09:35:07.365 INFO:tasks.workunit.client.1.smithi191.stdout:4/988: dwrite d5/dfb/dfd/d24/d82/feb [0,4194304] 0 2024-09-19T09:35:07.366 INFO:tasks.workunit.client.1.smithi191.stdout:6/764: rename d2/de/d19/d1e/d64/d77/d82/dca/la5 to d2/de/d19/lf5 0 2024-09-19T09:35:07.366 INFO:tasks.workunit.client.1.smithi191.stdout:6/765: chown d2/de/d19/d1e/d64/c80 139962178 1 2024-09-19T09:35:07.372 INFO:tasks.workunit.client.1.smithi191.stdout:4/989: mknod d5/d1b/d8e/dc9/d137/c13b 0 2024-09-19T09:35:07.375 INFO:tasks.workunit.client.1.smithi191.stdout:7/888: write d2/d2a/d79/f98 [2618350,77120] 0 2024-09-19T09:35:07.375 INFO:tasks.workunit.client.1.smithi191.stdout:4/990: dread d5/dfb/dfd/d24/d32/d21/d27/f53 [0,4194304] 0 2024-09-19T09:35:07.376 INFO:tasks.workunit.client.1.smithi191.stdout:7/889: mkdir d2/d2a/d38/de5/d137 0 2024-09-19T09:35:07.377 INFO:tasks.workunit.client.1.smithi191.stdout:4/991: symlink d5/d106/l13c 0 2024-09-19T09:35:07.377 INFO:tasks.workunit.client.1.smithi191.stdout:4/992: dread - d5/dfb/dfd/df9/d88/f11a zero size 2024-09-19T09:35:07.389 INFO:tasks.workunit.client.1.smithi191.stdout:4/993: dread d5/dfb/dfd/d24/d82/df2/d37/f7a [0,4194304] 0 2024-09-19T09:35:07.392 INFO:tasks.workunit.client.1.smithi191.stdout:3/864: dwrite d12/d43/d61/f11a [0,4194304] 0 2024-09-19T09:35:07.395 INFO:tasks.workunit.client.1.smithi191.stdout:3/865: symlink d12/d43/l127 0 2024-09-19T09:35:07.396 INFO:tasks.workunit.client.1.smithi191.stdout:3/866: creat d12/d13/d1a/d5d/dd1/df0/f128 x:0 0 0 2024-09-19T09:35:07.396 INFO:tasks.workunit.client.1.smithi191.stdout:3/867: symlink d12/d13/d1a/d1b/d3c/dd8/ded/l129 0 2024-09-19T09:35:07.397 INFO:tasks.workunit.client.1.smithi191.stdout:3/868: rename d12/d43/l127 to d12/d43/l12a 0 2024-09-19T09:35:07.398 INFO:tasks.workunit.client.1.smithi191.stdout:3/869: mkdir d12/d43/d61/d12b 0 2024-09-19T09:35:07.398 INFO:tasks.workunit.client.1.smithi191.stdout:3/870: chown l3 1 1 2024-09-19T09:35:07.399 INFO:tasks.workunit.client.1.smithi191.stdout:3/871: mknod d12/d13/d1a/d5d/dd1/de9/d101/c12c 0 2024-09-19T09:35:07.399 INFO:tasks.workunit.client.1.smithi191.stdout:3/872: dread - d12/d13/d1a/d1b/d60/f72 zero size 2024-09-19T09:35:07.401 INFO:tasks.workunit.client.1.smithi191.stdout:3/873: read d12/d13/d1a/f5c [1002407,56624] 0 2024-09-19T09:35:07.403 INFO:tasks.workunit.client.1.smithi191.stdout:4/994: dread d5/dfb/dfd/d24/d32/d21/d92/fa8 [0,4194304] 0 2024-09-19T09:35:07.403 INFO:tasks.workunit.client.1.smithi191.stdout:4/995: chown d5/dfb/dfd/d24/d32/d21/d4a/dc5/cf8 50889125 1 2024-09-19T09:35:07.404 INFO:tasks.workunit.client.1.smithi191.stdout:4/996: mkdir d5/dfb/dfd/df9/d88/d10c/d13a/d13d 0 2024-09-19T09:35:07.404 INFO:tasks.workunit.client.1.smithi191.stdout:2/875: dwrite d8/d11/d3f/d8a/d107/d129/d23/f57 [0,4194304] 0 2024-09-19T09:35:07.405 INFO:tasks.workunit.client.1.smithi191.stdout:7/890: dwrite d2/f67 [0,4194304] 0 2024-09-19T09:35:07.407 INFO:tasks.workunit.client.1.smithi191.stdout:3/874: rmdir d12/d43 39 2024-09-19T09:35:07.408 INFO:tasks.workunit.client.1.smithi191.stdout:7/891: mkdir d2/d2a/d4f/d59/d81/d138 0 2024-09-19T09:35:07.411 INFO:tasks.workunit.client.1.smithi191.stdout:3/875: dread d12/d13/d1a/d5d/dd1/fd3 [0,4194304] 0 2024-09-19T09:35:07.413 INFO:tasks.workunit.client.1.smithi191.stdout:3/876: mkdir d12/d13/d1a/d1b/d3c/dd8/ded/d12d 0 2024-09-19T09:35:07.415 INFO:tasks.workunit.client.1.smithi191.stdout:3/877: chown d12/d13/d1a/d1b/l2d 21 1 2024-09-19T09:35:07.415 INFO:tasks.workunit.client.1.smithi191.stdout:3/878: write d12/d13/d1a/d5d/dd1/df0/f8c [1135083,31436] 0 2024-09-19T09:35:07.415 INFO:tasks.workunit.client.1.smithi191.stdout:3/879: read d12/d13/d1a/d1b/d3c/f4f [2220823,87474] 0 2024-09-19T09:35:07.417 INFO:tasks.workunit.client.1.smithi191.stdout:3/880: link d12/d13/d1a/d1b/d2e/dab/da6/f106 d12/d13/d1a/d28/f12e 0 2024-09-19T09:35:07.419 INFO:tasks.workunit.client.1.smithi191.stdout:2/876: dread d8/d11/d3f/d64/f66 [0,4194304] 0 2024-09-19T09:35:07.419 INFO:tasks.workunit.client.1.smithi191.stdout:6/766: dwrite d2/de/d19/d1e/d64/d61/d81/da7/db8/fd5 [0,4194304] 0 2024-09-19T09:35:07.421 INFO:tasks.workunit.client.1.smithi191.stdout:7/892: dwrite d2/f60 [0,4194304] 0 2024-09-19T09:35:07.421 INFO:tasks.workunit.client.1.smithi191.stdout:7/893: write d2/d2a/d4f/d59/f88 [459608,62324] 0 2024-09-19T09:35:07.423 INFO:tasks.workunit.client.1.smithi191.stdout:7/894: creat d2/d2a/d38/de5/d137/f139 x:0 0 0 2024-09-19T09:35:07.433 INFO:tasks.workunit.client.1.smithi191.stdout:6/767: read d2/de/d19/d1e/d64/f54 [747298,63900] 0 2024-09-19T09:35:07.433 INFO:tasks.workunit.client.1.smithi191.stdout:6/768: write d2/de/d2a/d2d/d30/ff3 [113839,55373] 0 2024-09-19T09:35:07.433 INFO:tasks.workunit.client.1.smithi191.stdout:6/769: fdatasync d2/de/d2a/d2d/dc7/fd1 0 2024-09-19T09:35:07.433 INFO:tasks.workunit.client.1.smithi191.stdout:6/770: chown d2/de/d2a/d2d/d30/da4/lda 49 1 2024-09-19T09:35:07.438 INFO:tasks.workunit.client.1.smithi191.stdout:5/842: sync 2024-09-19T09:35:07.438 INFO:tasks.workunit.client.1.smithi191.stdout:1/896: sync 2024-09-19T09:35:07.438 INFO:tasks.workunit.client.1.smithi191.stdout:5/843: chown d0/d4/d9/d1d/d28/ff0 51081568 1 2024-09-19T09:35:07.438 INFO:tasks.workunit.client.1.smithi191.stdout:5/844: creat d0/d4/d9/d1d/d22/d3b/db9/f123 x:0 0 0 2024-09-19T09:35:07.439 INFO:tasks.workunit.client.1.smithi191.stdout:1/897: rename d3/d9/da/d1e/d25/d70/fa4 to d3/d9/d73/d94/f146 0 2024-09-19T09:35:07.441 INFO:tasks.workunit.client.1.smithi191.stdout:5/845: link d0/d4/d9/de/l44 d0/d4/dae/l124 0 2024-09-19T09:35:07.441 INFO:tasks.workunit.client.1.smithi191.stdout:5/846: write d0/da7/dcd/dd7/f111 [714617,1997] 0 2024-09-19T09:35:07.442 INFO:tasks.workunit.client.1.smithi191.stdout:5/847: write d0/d4/d9/d1d/d29/d33/d45/d97/ddf/ffa [4069276,115550] 0 2024-09-19T09:35:07.442 INFO:tasks.workunit.client.1.smithi191.stdout:2/877: dwrite d8/d11/d3f/d8a/d107/d129/d23/f43 [0,4194304] 0 2024-09-19T09:35:07.442 INFO:tasks.workunit.client.1.smithi191.stdout:2/878: chown d8/d11/d3f/dfa/c108 13 1 2024-09-19T09:35:07.442 INFO:tasks.workunit.client.1.smithi191.stdout:2/879: chown d8/d11/d3f/cd1 18249 1 2024-09-19T09:35:07.442 INFO:tasks.workunit.client.1.smithi191.stdout:2/880: chown d8/db/d4d/de6/d70/fe1 36 1 2024-09-19T09:35:07.443 INFO:tasks.workunit.client.1.smithi191.stdout:1/898: link d3/d9/c47 d3/d9/d73/d94/c147 0 2024-09-19T09:35:07.443 INFO:tasks.workunit.client.1.smithi191.stdout:1/899: dread - d3/d9/da/d1e/d32/d53/d57/def/f10d zero size 2024-09-19T09:35:07.443 INFO:tasks.workunit.client.1.smithi191.stdout:1/900: fdatasync d3/d9/da/d1e/f44 0 2024-09-19T09:35:07.443 INFO:tasks.workunit.client.1.smithi191.stdout:1/901: dread - d3/d9/da/d1e/d32/d53/d57/ff6 zero size 2024-09-19T09:35:07.443 INFO:tasks.workunit.client.1.smithi191.stdout:1/902: readlink d3/d9/da/d1e/d25/d70/da0/le0 0 2024-09-19T09:35:07.443 INFO:tasks.workunit.client.1.smithi191.stdout:5/848: creat d0/d4/d9/d1d/f125 x:0 0 0 2024-09-19T09:35:07.446 INFO:tasks.workunit.client.1.smithi191.stdout:6/771: dwrite d2/de/d2a/d7d/f6a [0,4194304] 0 2024-09-19T09:35:07.447 INFO:tasks.workunit.client.1.smithi191.stdout:2/881: symlink d8/d11/d3f/l12d 0 2024-09-19T09:35:07.447 INFO:tasks.workunit.client.1.smithi191.stdout:2/882: chown d8/db/l9b 220 1 2024-09-19T09:35:07.448 INFO:tasks.workunit.client.1.smithi191.stdout:6/772: creat d2/de/d19/d1e/d64/d77/ff6 x:0 0 0 2024-09-19T09:35:07.450 INFO:tasks.workunit.client.1.smithi191.stdout:2/883: rmdir d8/db/d41/d110 0 2024-09-19T09:35:07.452 INFO:tasks.workunit.client.1.smithi191.stdout:6/773: rmdir d2/de/d19/d1e 39 2024-09-19T09:35:07.452 INFO:tasks.workunit.client.1.smithi191.stdout:6/774: write d2/de/d2a/d2d/dc7/fea [5056707,106858] 0 2024-09-19T09:35:07.457 INFO:tasks.workunit.client.1.smithi191.stdout:2/884: rename d8/d11/c54 to d8/db/d4d/de6/d70/de8/c12e 0 2024-09-19T09:35:07.459 INFO:tasks.workunit.client.1.smithi191.stdout:2/885: rename d8/db/fc7 to d8/d11/dc2/f12f 0 2024-09-19T09:35:07.459 INFO:tasks.workunit.client.1.smithi191.stdout:2/886: stat d8/d11/d3f/d8a/d8f 0 2024-09-19T09:35:07.476 INFO:tasks.workunit.client.1.smithi191.stdout:5/849: dwrite d0/d4/d9/de/f36 [0,4194304] 0 2024-09-19T09:35:07.476 INFO:tasks.workunit.client.1.smithi191.stdout:5/850: chown d0/d4/d9/de/f47 184163678 1 2024-09-19T09:35:07.476 INFO:tasks.workunit.client.1.smithi191.stdout:5/851: chown d0 9147 1 2024-09-19T09:35:07.477 INFO:tasks.workunit.client.1.smithi191.stdout:1/903: dwrite d3/d9/da/d7e/ffa [0,4194304] 0 2024-09-19T09:35:07.479 INFO:tasks.workunit.client.1.smithi191.stdout:5/852: truncate d0/d4/d9/d1d/d22/d5c/f5e 1113259 0 2024-09-19T09:35:07.480 INFO:tasks.workunit.client.1.smithi191.stdout:5/853: readlink d0/d4/d9/d1d/d29/d33/d45/l5b 0 2024-09-19T09:35:07.481 INFO:tasks.workunit.client.1.smithi191.stdout:5/854: chown d0/d4/d4a/daf/lb2 33 1 2024-09-19T09:35:07.481 INFO:tasks.workunit.client.1.smithi191.stdout:5/855: dread - d0/da7/dcd/d102/fec zero size 2024-09-19T09:35:07.482 INFO:tasks.workunit.client.1.smithi191.stdout:5/856: dread d0/d4/d9/d1d/d29/d33/d45/d64/de7/ff2 [0,4194304] 0 2024-09-19T09:35:07.483 INFO:tasks.workunit.client.1.smithi191.stdout:6/775: dwrite d2/de/d2a/d2d/d30/d98/d9b/f68 [0,4194304] 0 2024-09-19T09:35:07.483 INFO:tasks.workunit.client.1.smithi191.stdout:6/776: read d2/de/f22 [296453,23697] 0 2024-09-19T09:35:07.483 INFO:tasks.workunit.client.1.smithi191.stdout:5/857: mkdir d0/d4/d9/d1d/d29/d33/d52/da4/d126 0 2024-09-19T09:35:07.483 INFO:tasks.workunit.client.1.smithi191.stdout:5/858: dread - d0/d4/d9/d1d/d29/fc5 zero size 2024-09-19T09:35:07.484 INFO:tasks.workunit.client.1.smithi191.stdout:2/887: dwrite d8/db/d4d/de6/d70/fcb [0,4194304] 0 2024-09-19T09:35:07.484 INFO:tasks.workunit.client.1.smithi191.stdout:2/888: chown d8 3 1 2024-09-19T09:35:07.486 INFO:tasks.workunit.client.1.smithi191.stdout:6/777: link d2/de/d2a/d2d/d30/d98/fe9 d2/de/d19/d1e/d64/d61/d81/da7/dde/ff7 0 2024-09-19T09:35:07.488 INFO:tasks.workunit.client.1.smithi191.stdout:1/904: write d3/d9/da/d1e/d25/f64 [3877513,38660] 0 2024-09-19T09:35:07.489 INFO:tasks.workunit.client.1.smithi191.stdout:5/859: creat d0/d4/d9/d1d/d29/d33/d45/d97/f127 x:0 0 0 2024-09-19T09:35:07.491 INFO:tasks.workunit.client.1.smithi191.stdout:2/889: unlink d8/d11/d3f/d8a/d107/d129/d40/da8/fbd 0 2024-09-19T09:35:07.492 INFO:tasks.workunit.client.1.smithi191.stdout:6/778: mkdir d2/de/d19/d1e/d64/d61/d81/da7/df8 0 2024-09-19T09:35:07.494 INFO:tasks.workunit.client.1.smithi191.stdout:1/905: mknod d3/d9/da/d1e/d32/d53/d57/def/d143/c148 0 2024-09-19T09:35:07.496 INFO:tasks.workunit.client.1.smithi191.stdout:2/890: mknod d8/d11/d3f/dfa/c130 0 2024-09-19T09:35:07.498 INFO:tasks.workunit.client.1.smithi191.stdout:6/779: truncate d2/de/d19/d1e/d64/d61/d81/da7/db8/fd5 1797391 0 2024-09-19T09:35:07.500 INFO:tasks.workunit.client.1.smithi191.stdout:1/906: symlink d3/d9/da/db/d48/d144/l149 0 2024-09-19T09:35:07.503 INFO:tasks.workunit.client.1.smithi191.stdout:2/891: rmdir d8/db/d4e 39 2024-09-19T09:35:07.504 INFO:tasks.workunit.client.1.smithi191.stdout:2/892: write d8/d2a/f32 [8083086,57305] 0 2024-09-19T09:35:07.505 INFO:tasks.workunit.client.1.smithi191.stdout:2/893: mkdir d8/d131 0 2024-09-19T09:35:07.506 INFO:tasks.workunit.client.1.smithi191.stdout:2/894: rename d8/d11/d56/cff to d8/d2a/c132 0 2024-09-19T09:35:07.512 INFO:tasks.workunit.client.1.smithi191.stdout:9/871: sync 2024-09-19T09:35:07.513 INFO:tasks.workunit.client.1.smithi191.stdout:9/872: dread d3/db/d16/d17/ffc [0,4194304] 0 2024-09-19T09:35:07.513 INFO:tasks.workunit.client.1.smithi191.stdout:9/873: write d3/d60/d112/f124 [3167,15084] 0 2024-09-19T09:35:07.518 INFO:tasks.workunit.client.1.smithi191.stdout:5/860: dwrite d0/d4/d9/d1d/d29/d33/d52/f86 [4194304,4194304] 0 2024-09-19T09:35:07.518 INFO:tasks.workunit.client.1.smithi191.stdout:5/861: truncate d0/d4/d9/d1d/d22/d3b/db9/dfd/ffe 4229291 0 2024-09-19T09:35:07.522 INFO:tasks.workunit.client.1.smithi191.stdout:5/862: link d0/d4/d4a/c66 d0/d4/d9/d1d/d28/d53/c128 0 2024-09-19T09:35:07.532 INFO:tasks.workunit.client.1.smithi191.stdout:9/874: dread d3/d8/fc [0,4194304] 0 2024-09-19T09:35:07.533 INFO:tasks.workunit.client.1.smithi191.stdout:6/780: dwrite d2/de/d2a/d2d/dc7/fd1 [0,4194304] 0 2024-09-19T09:35:07.533 INFO:tasks.workunit.client.1.smithi191.stdout:9/875: fsync d3/db/d16/d47/d89/ff7 0 2024-09-19T09:35:07.535 INFO:tasks.workunit.client.1.smithi191.stdout:6/781: unlink d2/de/d2a/d39/l75 0 2024-09-19T09:35:07.536 INFO:tasks.workunit.client.1.smithi191.stdout:9/876: creat d3/d8/f12d x:0 0 0 2024-09-19T09:35:07.537 INFO:tasks.workunit.client.1.smithi191.stdout:3/881: sync 2024-09-19T09:35:07.537 INFO:tasks.workunit.client.1.smithi191.stdout:4/997: sync 2024-09-19T09:35:07.537 INFO:tasks.workunit.client.1.smithi191.stdout:4/998: chown d5/dfb/dfd/d24/d32/d21/d92/fa8 61523 1 2024-09-19T09:35:07.538 INFO:tasks.workunit.client.1.smithi191.stdout:4/999: truncate d5/dfb/dfd/d24/d32/f76 5719414 0 2024-09-19T09:35:07.538 INFO:tasks.workunit.client.1.smithi191.stdout:1/907: dwrite d3/d9/f5d [0,4194304] 0 2024-09-19T09:35:07.538 INFO:tasks.workunit.client.1.smithi191.stdout:2/895: dwrite d8/db/d41/fdd [0,4194304] 0 2024-09-19T09:35:07.539 INFO:tasks.workunit.client.1.smithi191.stdout:6/782: creat d2/de/d19/d1e/d64/d61/d81/da7/dde/ff9 x:0 0 0 2024-09-19T09:35:07.539 INFO:tasks.workunit.client.1.smithi191.stdout:6/783: fdatasync d2/de/d15/f36 0 2024-09-19T09:35:07.539 INFO:tasks.workunit.client.1.smithi191.stdout:6/784: readlink d2/l4 0 2024-09-19T09:35:07.546 INFO:tasks.workunit.client.1.smithi191.stdout:9/877: getdents d3/db/d53/dec 0 2024-09-19T09:35:07.548 INFO:tasks.workunit.client.1.smithi191.stdout:9/878: symlink d3/db/d53/da2/db3/l12e 0 2024-09-19T09:35:07.548 INFO:tasks.workunit.client.1.smithi191.stdout:3/882: dread d12/d13/d1a/d5d/dd1/df0/d91/f102 [4194304,4194304] 0 2024-09-19T09:35:07.551 INFO:tasks.workunit.client.1.smithi191.stdout:9/879: rename d3/db/d53/da2/db3/cca to d3/db/d16/c12f 0 2024-09-19T09:35:07.551 INFO:tasks.workunit.client.1.smithi191.stdout:9/880: write d3/d8/f3b [2306983,23287] 0 2024-09-19T09:35:07.551 INFO:tasks.workunit.client.1.smithi191.stdout:9/881: fsync d3/db/d16/d17/d3c/f106 0 2024-09-19T09:35:07.551 INFO:tasks.workunit.client.1.smithi191.stdout:9/882: readlink d3/db/d16/d17/d3c/l125 0 2024-09-19T09:35:07.551 INFO:tasks.workunit.client.1.smithi191.stdout:6/785: write d2/de/d2a/d7d/f6a [39037,74014] 0 2024-09-19T09:35:07.552 INFO:tasks.workunit.client.1.smithi191.stdout:7/895: sync 2024-09-19T09:35:07.552 INFO:tasks.workunit.client.1.smithi191.stdout:7/896: chown d2/d2a/d4f/d59/d81/l93 30 1 2024-09-19T09:35:07.552 INFO:tasks.workunit.client.1.smithi191.stdout:7/897: write d2/d2a/d4f/d59/dfb/ff6 [698370,81972] 0 2024-09-19T09:35:07.553 INFO:tasks.workunit.client.1.smithi191.stdout:6/786: creat d2/de/df0/ffa x:0 0 0 2024-09-19T09:35:07.553 INFO:tasks.workunit.client.1.smithi191.stdout:6/787: stat d2/de/d19/d1e/d64/f29 0 2024-09-19T09:35:07.553 INFO:tasks.workunit.client.1.smithi191.stdout:2/896: dread d8/d11/d3f/d8a/d107/d129/d40/f11f [0,4194304] 0 2024-09-19T09:35:07.554 INFO:tasks.workunit.client.1.smithi191.stdout:6/788: unlink d2/de/d19/d1e/l40 0 2024-09-19T09:35:07.554 INFO:tasks.workunit.client.1.smithi191.stdout:6/789: chown d2/de/d19/d1e/c32 581 1 2024-09-19T09:35:07.554 INFO:tasks.workunit.client.1.smithi191.stdout:6/790: stat d2/de/d19/d1e/d64/f8f 0 2024-09-19T09:35:07.555 INFO:tasks.workunit.client.1.smithi191.stdout:6/791: rmdir d2/de/d2a/d2d/d30/d98/d9b/d65/d89 39 2024-09-19T09:35:07.558 INFO:tasks.workunit.client.1.smithi191.stdout:3/883: dread d12/d13/d1a/d1b/d2e/dab/d51/d62/fdf [0,4194304] 0 2024-09-19T09:35:07.558 INFO:tasks.workunit.client.1.smithi191.stdout:9/883: dread d3/db/d16/d47/fd8 [0,4194304] 0 2024-09-19T09:35:07.559 INFO:tasks.workunit.client.1.smithi191.stdout:3/884: creat d12/d13/d1a/d5d/dd1/df0/d91/f12f x:0 0 0 2024-09-19T09:35:07.559 INFO:tasks.workunit.client.1.smithi191.stdout:3/885: readlink d12/d43/d61/d98/l10a 0 2024-09-19T09:35:07.560 INFO:tasks.workunit.client.1.smithi191.stdout:7/898: write d2/d2a/d33/f5d [32186,47488] 0 2024-09-19T09:35:07.560 INFO:tasks.workunit.client.1.smithi191.stdout:9/884: creat d3/db/d16/d47/d89/f130 x:0 0 0 2024-09-19T09:35:07.562 INFO:tasks.workunit.client.1.smithi191.stdout:3/886: truncate d12/d13/d1a/d1b/d2e/f5b 3502274 0 2024-09-19T09:35:07.562 INFO:tasks.workunit.client.1.smithi191.stdout:3/887: dread - d12/d13/d1a/d1b/d3c/d71/d112/d73/fbb zero size 2024-09-19T09:35:07.562 INFO:tasks.workunit.client.1.smithi191.stdout:3/888: read d12/d13/d1a/d1b/d3c/d3f/f67 [490728,43087] 0 2024-09-19T09:35:07.562 INFO:tasks.workunit.client.1.smithi191.stdout:7/899: getdents d2/d2a/d38/d63/da2 0 2024-09-19T09:35:07.563 INFO:tasks.workunit.client.1.smithi191.stdout:1/908: dwrite d3/d9/da/d1e/d32/d6f/fec [0,4194304] 0 2024-09-19T09:35:07.564 INFO:tasks.workunit.client.1.smithi191.stdout:9/885: link d3/db/d53/da2/db3/cf8 d3/db/c131 0 2024-09-19T09:35:07.565 INFO:tasks.workunit.client.1.smithi191.stdout:3/889: rename d12/d13/c70 to d12/d13/d1a/d5d/dd1/df0/c130 0 2024-09-19T09:35:07.565 INFO:tasks.workunit.client.1.smithi191.stdout:7/900: mknod d2/d39/d3a/d3c/c13a 0 2024-09-19T09:35:07.565 INFO:tasks.workunit.client.1.smithi191.stdout:7/901: stat d2/d5e/dfc 0 2024-09-19T09:35:07.566 INFO:tasks.workunit.client.1.smithi191.stdout:6/792: dread d2/f34 [4194304,4194304] 0 2024-09-19T09:35:07.567 INFO:tasks.workunit.client.1.smithi191.stdout:9/886: unlink d3/db/d16/d17/d81/f8e 0 2024-09-19T09:35:07.568 INFO:tasks.workunit.client.1.smithi191.stdout:3/890: mknod d12/d13/d1a/d1b/d3c/d71/d112/d73/c131 0 2024-09-19T09:35:07.569 INFO:tasks.workunit.client.1.smithi191.stdout:7/902: truncate d2/d2a/d33/f3e 653982 0 2024-09-19T09:35:07.571 INFO:tasks.workunit.client.1.smithi191.stdout:6/793: creat d2/de/d2a/d2d/d30/d98/d9b/d65/d89/ffb x:0 0 0 2024-09-19T09:35:07.571 INFO:tasks.workunit.client.1.smithi191.stdout:6/794: chown d2/de/d15/c3d 1857233858 1 2024-09-19T09:35:07.571 INFO:tasks.workunit.client.1.smithi191.stdout:6/795: write d2/de/d2a/d2d/d30/ff3 [336162,32622] 0 2024-09-19T09:35:07.571 INFO:tasks.workunit.client.1.smithi191.stdout:1/909: dread d3/d9/f78 [0,4194304] 0 2024-09-19T09:35:07.572 INFO:tasks.workunit.client.1.smithi191.stdout:2/897: dwrite d8/d11/dc2/fea [0,4194304] 0 2024-09-19T09:35:07.572 INFO:tasks.workunit.client.1.smithi191.stdout:9/887: creat d3/db/d53/da2/db3/dc2/f132 x:0 0 0 2024-09-19T09:35:07.573 INFO:tasks.workunit.client.1.smithi191.stdout:9/888: chown d3/db/d16/d17/d3c/c95 5363484 1 2024-09-19T09:35:07.575 INFO:tasks.workunit.client.1.smithi191.stdout:3/891: rename d12/d13/d1a/d1b/f36 to d12/d43/d61/f132 0 2024-09-19T09:35:07.575 INFO:tasks.workunit.client.1.smithi191.stdout:3/892: stat d12/d43 0 2024-09-19T09:35:07.575 INFO:tasks.workunit.client.1.smithi191.stdout:3/893: readlink d12/d13/d1a/d1b/d2e/dab/d51/lfb 0 2024-09-19T09:35:07.576 INFO:tasks.workunit.client.1.smithi191.stdout:6/796: mknod d2/de/d19/d1e/d64/d61/d81/da7/df8/cfc 0 2024-09-19T09:35:07.579 INFO:tasks.workunit.client.1.smithi191.stdout:9/889: creat d3/d60/d78/d102/d105/f133 x:0 0 0 2024-09-19T09:35:07.580 INFO:tasks.workunit.client.1.smithi191.stdout:9/890: dread d3/db6/fbb [0,4194304] 0 2024-09-19T09:35:07.584 INFO:tasks.workunit.client.1.smithi191.stdout:9/891: dread d3/db/d16/d47/d89/ff7 [0,4194304] 0 2024-09-19T09:35:07.584 INFO:tasks.workunit.client.1.smithi191.stdout:9/892: readlink d3/db/d16/d17/d5b/la9 0 2024-09-19T09:35:07.585 INFO:tasks.workunit.client.1.smithi191.stdout:3/894: rename d12/d13/d1a/d5d/dc8/dd5/ffa to d12/d13/d1a/d1b/d60/d7a/d93/f133 0 2024-09-19T09:35:07.588 INFO:tasks.workunit.client.1.smithi191.stdout:6/797: symlink d2/de/d2a/d7d/lfd 0 2024-09-19T09:35:07.588 INFO:tasks.workunit.client.1.smithi191.stdout:6/798: readlink d2/de/l2e 0 2024-09-19T09:35:07.588 INFO:tasks.workunit.client.1.smithi191.stdout:6/799: fsync d2/de/f69 0 2024-09-19T09:35:07.602 INFO:tasks.workunit.client.1.smithi191.stdout:1/910: rename d3/d9 to d3/d14a 0 2024-09-19T09:35:07.603 INFO:tasks.workunit.client.1.smithi191.stdout:1/911: link d3/d14a/da/l2a d3/d14a/da/d1e/d32/d53/d57/d6d/da1/db5/l14b 0 2024-09-19T09:35:07.616 INFO:tasks.workunit.client.1.smithi191.stdout:1/912: dread d3/dbd/f120 [0,4194304] 0 2024-09-19T09:35:07.616 INFO:tasks.workunit.client.1.smithi191.stdout:1/913: fsync d3/d14a/da/d1e/d32/d53/f11d 0 2024-09-19T09:35:07.617 INFO:tasks.workunit.client.1.smithi191.stdout:1/914: creat d3/d14a/da/d1e/d32/f14c x:0 0 0 2024-09-19T09:35:07.618 INFO:tasks.workunit.client.1.smithi191.stdout:1/915: mkdir d3/d14a/da/d1e/d32/d6f/d14d 0 2024-09-19T09:35:07.619 INFO:tasks.workunit.client.1.smithi191.stdout:1/916: chown d3/d14a/da/d1e/cae 3520607 1 2024-09-19T09:35:07.619 INFO:tasks.workunit.client.1.smithi191.stdout:2/898: dwrite d8/d11/d3f/d8a/d107/d129/d23/f78 [0,4194304] 0 2024-09-19T09:35:07.619 INFO:tasks.workunit.client.1.smithi191.stdout:3/895: dwrite d12/d13/d1a/d1b/d2e/dab/fa5 [0,4194304] 0 2024-09-19T09:35:07.619 INFO:tasks.workunit.client.1.smithi191.stdout:9/893: dwrite d3/db/d16/d38/d92/fe4 [0,4194304] 0 2024-09-19T09:35:07.620 INFO:tasks.workunit.client.1.smithi191.stdout:9/894: fsync d3/db/d16/d17/f116 0 2024-09-19T09:35:07.620 INFO:tasks.workunit.client.1.smithi191.stdout:6/800: dwrite d2/de/d19/d1e/d64/d61/fe6 [0,4194304] 0 2024-09-19T09:35:07.620 INFO:tasks.workunit.client.1.smithi191.stdout:1/917: rename d3/dd7/fad to d3/d14a/da/d1e/d32/d53/d57/d6d/da1/f14e 0 2024-09-19T09:35:07.621 INFO:tasks.workunit.client.1.smithi191.stdout:1/918: write d3/d14a/da/d1e/d25/f84 [180593,76652] 0 2024-09-19T09:35:07.622 INFO:tasks.workunit.client.1.smithi191.stdout:2/899: mkdir d8/db/d41/d12c/d133 0 2024-09-19T09:35:07.623 INFO:tasks.workunit.client.1.smithi191.stdout:3/896: stat d12/d13/d1a/l48 0 2024-09-19T09:35:07.629 INFO:tasks.workunit.client.1.smithi191.stdout:6/801: dread d2/de/d19/d1e/d64/d61/fe6 [0,4194304] 0 2024-09-19T09:35:07.631 INFO:tasks.workunit.client.1.smithi191.stdout:5/863: sync 2024-09-19T09:35:07.631 INFO:tasks.workunit.client.1.smithi191.stdout:1/919: truncate d3/d14a/da/d1e/d32/d6f/fec 846575 0 2024-09-19T09:35:07.633 INFO:tasks.workunit.client.1.smithi191.stdout:2/900: symlink d8/d11/d3f/dfa/dfc/l134 0 2024-09-19T09:35:07.633 INFO:tasks.workunit.client.1.smithi191.stdout:2/901: dread - d8/d11/d3f/dfa/f117 zero size 2024-09-19T09:35:07.633 INFO:tasks.workunit.client.1.smithi191.stdout:9/895: getdents d3/db/d16/d17/d3c 0 2024-09-19T09:35:07.635 INFO:tasks.workunit.client.1.smithi191.stdout:5/864: rmdir d0/d4/d9/d1d/d29/d7f/d110 0 2024-09-19T09:35:07.635 INFO:tasks.workunit.client.1.smithi191.stdout:3/897: dread d12/d13/d1a/d1b/d3c/f80 [0,4194304] 0 2024-09-19T09:35:07.635 INFO:tasks.workunit.client.1.smithi191.stdout:7/903: sync 2024-09-19T09:35:07.635 INFO:tasks.workunit.client.1.smithi191.stdout:3/898: write d12/d43/db2/fca [221637,119249] 0 2024-09-19T09:35:07.636 INFO:tasks.workunit.client.1.smithi191.stdout:1/920: mknod d3/d14a/da/d1e/d32/d6f/c14f 0 2024-09-19T09:35:07.636 INFO:tasks.workunit.client.1.smithi191.stdout:2/902: chown d8/d11/d3f/d8a/cfd 3640336 1 2024-09-19T09:35:07.638 INFO:tasks.workunit.client.1.smithi191.stdout:9/896: unlink d3/db/d16/d47/f69 0 2024-09-19T09:35:07.640 INFO:tasks.workunit.client.1.smithi191.stdout:5/865: mknod d0/d4/dae/c129 0 2024-09-19T09:35:07.640 INFO:tasks.workunit.client.1.smithi191.stdout:2/903: dread d8/d11/d3f/d8a/d107/d129/d40/fb3 [0,4194304] 0 2024-09-19T09:35:07.641 INFO:tasks.workunit.client.1.smithi191.stdout:7/904: creat d2/d2a/d38/d63/f13b x:0 0 0 2024-09-19T09:35:07.642 INFO:tasks.workunit.client.1.smithi191.stdout:6/802: dread d2/de/d19/d1e/fba [0,4194304] 0 2024-09-19T09:35:07.643 INFO:tasks.workunit.client.1.smithi191.stdout:1/921: unlink d3/d14a/d73/d94/fbc 0 2024-09-19T09:35:07.644 INFO:tasks.workunit.client.1.smithi191.stdout:9/897: creat d3/db/d16/d17/d5b/f134 x:0 0 0 2024-09-19T09:35:07.644 INFO:tasks.workunit.client.1.smithi191.stdout:9/898: chown d3/db/d53/da2/db3/l12e 565615 1 2024-09-19T09:35:07.644 INFO:tasks.workunit.client.1.smithi191.stdout:2/904: getdents d8/d11/d3f/d8a/d107/d129/d40 0 2024-09-19T09:35:07.796 INFO:tasks.workunit.client.1.smithi191.stdout:3/899: dwrite d12/d13/d1a/d1b/d3c/f80 [4194304,4194304] 0 2024-09-19T09:35:07.799 INFO:tasks.workunit.client.1.smithi191.stdout:3/900: dread d12/d13/d1a/d1b/d3c/fcf [0,4194304] 0 2024-09-19T09:35:07.799 INFO:tasks.workunit.client.1.smithi191.stdout:3/901: chown d12/d107/fc2 30643009 1 2024-09-19T09:35:07.799 INFO:tasks.workunit.client.1.smithi191.stdout:3/902: chown d12/d13/d1a/d5d/dc8/dd5 7704 1 2024-09-19T09:35:07.802 INFO:tasks.workunit.client.1.smithi191.stdout:7/905: symlink d2/d2a/d38/dd4/l13c 0 2024-09-19T09:35:07.804 INFO:tasks.workunit.client.1.smithi191.stdout:1/922: link d3/d14a/da/d1e/d32/d53/f2c d3/d14a/da/d1e/d32/d6f/db2/dd1/f150 0 2024-09-19T09:35:07.805 INFO:tasks.workunit.client.1.smithi191.stdout:2/905: dwrite d8/d11/f8e [0,4194304] 0 2024-09-19T09:35:07.805 INFO:tasks.workunit.client.1.smithi191.stdout:5/866: dwrite d0/d1f/f43 [0,4194304] 0 2024-09-19T09:35:07.807 INFO:tasks.workunit.client.1.smithi191.stdout:9/899: rename d3/db/d16/d47/d89/f130 to d3/db/d16/d17/d81/da6/f135 0 2024-09-19T09:35:07.811 INFO:tasks.workunit.client.1.smithi191.stdout:3/903: write d12/d13/d1a/d28/f11d [3392974,97426] 0 2024-09-19T09:35:07.811 INFO:tasks.workunit.client.1.smithi191.stdout:3/904: truncate d12/d13/d1a/f32 633080 0 2024-09-19T09:35:07.811 INFO:tasks.workunit.client.1.smithi191.stdout:3/905: chown ff 5537 1 2024-09-19T09:35:07.813 INFO:tasks.workunit.client.1.smithi191.stdout:7/906: symlink d2/d2a/d38/d63/d9a/dd5/l13d 0 2024-09-19T09:35:07.813 INFO:tasks.workunit.client.1.smithi191.stdout:7/907: fdatasync d2/d2a/d38/de5/d137/f139 0 2024-09-19T09:35:07.813 INFO:tasks.workunit.client.1.smithi191.stdout:7/908: fsync d2/f9d 0 2024-09-19T09:35:07.814 INFO:tasks.workunit.client.1.smithi191.stdout:7/909: chown d2/d2a/d33/fe8 990 1 2024-09-19T09:35:07.814 INFO:tasks.workunit.client.1.smithi191.stdout:1/923: link d3/ddf/l10c d3/d14a/da/d1e/l151 0 2024-09-19T09:35:07.818 INFO:tasks.workunit.client.1.smithi191.stdout:5/867: symlink d0/d4/d4a/l12a 0 2024-09-19T09:35:07.818 INFO:tasks.workunit.client.1.smithi191.stdout:5/868: fdatasync d0/d4/d88/f89 0 2024-09-19T09:35:07.818 INFO:tasks.workunit.client.1.smithi191.stdout:9/900: mknod d3/db/d16/d17/d5b/c136 0 2024-09-19T09:35:07.820 INFO:tasks.workunit.client.1.smithi191.stdout:7/910: rename d2/d5e/dfc/f102 to d2/d2a/d79/da8/f13e 0 2024-09-19T09:35:07.820 INFO:tasks.workunit.client.1.smithi191.stdout:1/924: symlink d3/d14a/d73/d132/l152 0 2024-09-19T09:35:07.824 INFO:tasks.workunit.client.1.smithi191.stdout:5/869: mkdir d0/d4/d9/d1d/d22/d12b 0 2024-09-19T09:35:07.826 INFO:tasks.workunit.client.1.smithi191.stdout:5/870: dread d0/d4/d9/d1d/d29/d7f/fc0 [0,4194304] 0 2024-09-19T09:35:07.827 INFO:tasks.workunit.client.1.smithi191.stdout:2/906: dwrite d8/db/d41/fdc [0,4194304] 0 2024-09-19T09:35:07.828 INFO:tasks.workunit.client.1.smithi191.stdout:5/871: link d0/d1f/f84 d0/d4/d9/d1d/d22/d3b/db9/d105/f12c 0 2024-09-19T09:35:07.830 INFO:tasks.workunit.client.1.smithi191.stdout:9/901: write d3/db/d16/d17/d3c/dd0/fe3 [2474036,80064] 0 2024-09-19T09:35:07.832 INFO:tasks.workunit.client.1.smithi191.stdout:1/925: write d3/d14a/f5d [3072508,117965] 0 2024-09-19T09:35:07.832 INFO:tasks.workunit.client.1.smithi191.stdout:2/907: creat d8/d11/d3f/d8a/d107/d10d/f135 x:0 0 0 2024-09-19T09:35:07.832 INFO:tasks.workunit.client.1.smithi191.stdout:2/908: chown d8/d11/d3f/d8a/d107/d129/d23/f57 125858 1 2024-09-19T09:35:07.834 INFO:tasks.workunit.client.1.smithi191.stdout:2/909: unlink d8/db/d4e/f7d 0 2024-09-19T09:35:07.835 INFO:tasks.workunit.client.1.smithi191.stdout:2/910: symlink d8/d11/d3f/d8a/d107/d129/d40/da8/l136 0 2024-09-19T09:35:07.835 INFO:tasks.workunit.client.1.smithi191.stdout:2/911: fdatasync d8/d11/d56/f8c 0 2024-09-19T09:35:07.836 INFO:tasks.workunit.client.1.smithi191.stdout:6/803: sync 2024-09-19T09:35:07.838 INFO:tasks.workunit.client.1.smithi191.stdout:5/872: dread d0/d4/d9/d1d/d22/d3b/db9/dfd/ffe [0,4194304] 0 2024-09-19T09:35:07.840 INFO:tasks.workunit.client.1.smithi191.stdout:5/873: mkdir d0/da7/d116/d12d 0 2024-09-19T09:35:07.841 INFO:tasks.workunit.client.1.smithi191.stdout:1/926: dread d3/d14a/da/d1e/f2d [0,4194304] 0 2024-09-19T09:35:07.842 INFO:tasks.workunit.client.1.smithi191.stdout:5/874: symlink d0/d4/d9/d1d/d22/d5c/l12e 0 2024-09-19T09:35:07.845 INFO:tasks.workunit.client.1.smithi191.stdout:2/912: dread d8/d11/dc2/fc5 [0,4194304] 0 2024-09-19T09:35:07.845 INFO:tasks.workunit.client.1.smithi191.stdout:2/913: write d8/d11/d3f/d8a/fae [1708799,51856] 0 2024-09-19T09:35:07.846 INFO:tasks.workunit.client.1.smithi191.stdout:2/914: stat d8/d11/d3f/d8a/dda 0 2024-09-19T09:35:07.846 INFO:tasks.workunit.client.1.smithi191.stdout:2/915: truncate d8/d2a/f61 3190994 0 2024-09-19T09:35:07.847 INFO:tasks.workunit.client.1.smithi191.stdout:2/916: write d8/d11/d3f/d8a/d107/d129/d40/fad [2052479,30585] 0 2024-09-19T09:35:07.847 INFO:tasks.workunit.client.1.smithi191.stdout:9/902: read d3/db/d16/d47/d89/fc8 [1171752,107686] 0 2024-09-19T09:35:07.849 INFO:tasks.workunit.client.1.smithi191.stdout:2/917: rmdir d8/d2a/dba/dcc/d10c 39 2024-09-19T09:35:07.849 INFO:tasks.workunit.client.1.smithi191.stdout:2/918: write d8/d11/d3f/d8a/d107/d10d/f135 [422325,20378] 0 2024-09-19T09:35:07.851 INFO:tasks.workunit.client.1.smithi191.stdout:9/903: link d3/db/cd5 d3/db/d16/d38/dd4/c137 0 2024-09-19T09:35:07.854 INFO:tasks.workunit.client.1.smithi191.stdout:9/904: unlink d3/db/d16/d38/dd4/ddf/f119 0 2024-09-19T09:35:07.855 INFO:tasks.workunit.client.1.smithi191.stdout:9/905: rmdir d3/db 39 2024-09-19T09:35:07.856 INFO:tasks.workunit.client.1.smithi191.stdout:9/906: fsync d3/db6/ff3 0 2024-09-19T09:35:07.858 INFO:tasks.workunit.client.1.smithi191.stdout:9/907: creat d3/da1/f138 x:0 0 0 2024-09-19T09:35:07.859 INFO:tasks.workunit.client.1.smithi191.stdout:9/908: mknod d3/db/d16/d17/c139 0 2024-09-19T09:35:07.874 INFO:tasks.workunit.client.1.smithi191.stdout:1/927: dwrite d3/d14a/ff8 [0,4194304] 0 2024-09-19T09:35:07.874 INFO:tasks.workunit.client.1.smithi191.stdout:5/875: dwrite d0/d4/d9/f103 [0,4194304] 0 2024-09-19T09:35:07.877 INFO:tasks.workunit.client.1.smithi191.stdout:5/876: truncate d0/d1f/f56 3219681 0 2024-09-19T09:35:07.882 INFO:tasks.workunit.client.1.smithi191.stdout:6/804: dwrite d2/de/f22 [0,4194304] 0 2024-09-19T09:35:07.882 INFO:tasks.workunit.client.1.smithi191.stdout:9/909: dwrite d3/d8/fdd [0,4194304] 0 2024-09-19T09:35:07.882 INFO:tasks.workunit.client.1.smithi191.stdout:2/919: dwrite d8/d2a/dba/dcc/ff6 [0,4194304] 0 2024-09-19T09:35:07.892 INFO:tasks.workunit.client.1.smithi191.stdout:5/877: write d0/d4/d4a/f4b [2283139,53775] 0 2024-09-19T09:35:07.895 INFO:tasks.workunit.client.1.smithi191.stdout:5/878: link d0/d4/lf3 d0/d4/d9/d1d/d22/d3b/db9/d105/l12f 0 2024-09-19T09:35:07.898 INFO:tasks.workunit.client.1.smithi191.stdout:5/879: write d0/d4/d9/de/ff [4512163,98504] 0 2024-09-19T09:35:07.901 INFO:tasks.workunit.client.1.smithi191.stdout:5/880: rename d0/d4/d88/c9a to d0/d4/d9/d1d/d22/d3b/db9/c130 0 2024-09-19T09:35:07.901 INFO:tasks.workunit.client.1.smithi191.stdout:5/881: stat d0/d4/d4a/f60 0 2024-09-19T09:35:07.902 INFO:tasks.workunit.client.1.smithi191.stdout:5/882: symlink d0/d4/d9/d1d/d28/d53/l131 0 2024-09-19T09:35:07.903 INFO:tasks.workunit.client.1.smithi191.stdout:5/883: mknod d0/d4/d9/d1d/d29/d33/d45/d97/ddf/c132 0 2024-09-19T09:35:07.904 INFO:tasks.workunit.client.1.smithi191.stdout:5/884: creat d0/d4/d9/d1d/d28/d53/f133 x:0 0 0 2024-09-19T09:35:07.904 INFO:tasks.workunit.client.1.smithi191.stdout:5/885: chown d0/d4/d9/d1d/d28/d53/c128 0 1 2024-09-19T09:35:07.905 INFO:tasks.workunit.client.1.smithi191.stdout:5/886: truncate d0/d4/d9/d1d/d22/d5c/fc1 244870 0 2024-09-19T09:35:07.917 INFO:tasks.workunit.client.1.smithi191.stdout:6/805: dwrite d2/de/d2a/d2d/d30/d98/fe9 [0,4194304] 0 2024-09-19T09:35:07.921 INFO:tasks.workunit.client.1.smithi191.stdout:2/920: dwrite d8/d11/d3f/f39 [0,4194304] 0 2024-09-19T09:35:07.921 INFO:tasks.workunit.client.1.smithi191.stdout:9/910: dwrite d3/db/d16/d17/f70 [0,4194304] 0 2024-09-19T09:35:07.924 INFO:tasks.workunit.client.1.smithi191.stdout:5/887: dwrite d0/d4/d9/ff9 [0,4194304] 0 2024-09-19T09:35:07.924 INFO:tasks.workunit.client.1.smithi191.stdout:5/888: dread - d0/d4/d9/d1d/d22/d3b/db9/fd9 zero size 2024-09-19T09:35:07.924 INFO:tasks.workunit.client.1.smithi191.stdout:5/889: stat d0/d77/fb6 0 2024-09-19T09:35:07.924 INFO:tasks.workunit.client.1.smithi191.stdout:5/890: read d0/d4/d9/de/f8f [155161,46883] 0 2024-09-19T09:35:07.924 INFO:tasks.workunit.client.1.smithi191.stdout:5/891: read - d0/d4/d9/d1d/d29/d33/d45/d97/fe1 zero size 2024-09-19T09:35:07.925 INFO:tasks.workunit.client.1.smithi191.stdout:2/921: dread d8/db/d4e/fa7 [0,4194304] 0 2024-09-19T09:35:07.925 INFO:tasks.workunit.client.1.smithi191.stdout:2/922: chown d8/d2a/f114 233849 1 2024-09-19T09:35:07.925 INFO:tasks.workunit.client.1.smithi191.stdout:9/911: creat d3/db/d16/d17/d3c/dd0/dfe/f13a x:0 0 0 2024-09-19T09:35:07.929 INFO:tasks.workunit.client.1.smithi191.stdout:5/892: stat d0/d4/d9/de/lc7 0 2024-09-19T09:35:07.930 INFO:tasks.workunit.client.1.smithi191.stdout:2/923: creat d8/d11/f137 x:0 0 0 2024-09-19T09:35:07.932 INFO:tasks.workunit.client.1.smithi191.stdout:5/893: link d0/d4/f10f d0/d4/d9/d1d/d22/d3b/f134 0 2024-09-19T09:35:07.932 INFO:tasks.workunit.client.1.smithi191.stdout:6/806: truncate d2/de/d19/d1e/d64/d61/d81/da7/dde/ff7 3027228 0 2024-09-19T09:35:07.934 INFO:tasks.workunit.client.1.smithi191.stdout:5/894: mknod d0/d4/d9/d1d/d29/d33/d52/da4/c135 0 2024-09-19T09:35:07.934 INFO:tasks.workunit.client.1.smithi191.stdout:5/895: creat d0/d4/d9/d1d/d28/d53/f136 x:0 0 0 2024-09-19T09:35:07.934 INFO:tasks.workunit.client.1.smithi191.stdout:5/896: readlink d0/d4/l6 0 2024-09-19T09:35:07.938 INFO:tasks.workunit.client.1.smithi191.stdout:9/912: dwrite d3/db/d16/d47/d55/f5e [4194304,4194304] 0 2024-09-19T09:35:07.954 INFO:tasks.workunit.client.1.smithi191.stdout:9/913: write d3/d60/d78/f96 [464140,57675] 0 2024-09-19T09:35:07.955 INFO:tasks.workunit.client.1.smithi191.stdout:9/914: creat d3/d8/f13b x:0 0 0 2024-09-19T09:35:07.957 INFO:tasks.workunit.client.1.smithi191.stdout:2/924: dwrite d8/d11/d3f/d64/f66 [0,4194304] 0 2024-09-19T09:35:07.964 INFO:tasks.workunit.client.1.smithi191.stdout:5/897: dwrite d0/d4/d9/de/f8f [0,4194304] 0 2024-09-19T09:35:07.965 INFO:tasks.workunit.client.1.smithi191.stdout:6/807: dwrite d2/de/d15/f36 [0,4194304] 0 2024-09-19T09:35:07.966 INFO:tasks.workunit.client.1.smithi191.stdout:5/898: symlink d0/d77/l137 0 2024-09-19T09:35:07.970 INFO:tasks.workunit.client.1.smithi191.stdout:5/899: truncate d0/d4/d9/d1d/d29/d7f/d94/fd6 131086 0 2024-09-19T09:35:07.971 INFO:tasks.workunit.client.1.smithi191.stdout:5/900: symlink d0/d4/d4a/db4/l138 0 2024-09-19T09:35:07.971 INFO:tasks.workunit.client.1.smithi191.stdout:5/901: write d0/da7/dcd/dd7/dde/fe0 [1181372,91776] 0 2024-09-19T09:35:07.971 INFO:tasks.workunit.client.1.smithi191.stdout:5/902: chown d0/d77/l137 3641464 1 2024-09-19T09:35:07.971 INFO:tasks.workunit.client.1.smithi191.stdout:5/903: creat d0/d4/d9/d1d/d28/f139 x:0 0 0 2024-09-19T09:35:07.975 INFO:tasks.workunit.client.1.smithi191.stdout:2/925: dwrite d8/fbc [0,4194304] 0 2024-09-19T09:35:07.978 INFO:tasks.workunit.client.1.smithi191.stdout:2/926: creat d8/d11/d3f/d8a/d107/d129/d23/f138 x:0 0 0 2024-09-19T09:35:07.979 INFO:tasks.workunit.client.1.smithi191.stdout:2/927: getdents d8/d11/d3f/d8a/d107/d129/d23/dde 0 2024-09-19T09:35:07.979 INFO:tasks.workunit.client.1.smithi191.stdout:2/928: chown d8/d11/d3f/dfa/c130 14 1 2024-09-19T09:35:07.979 INFO:tasks.workunit.client.1.smithi191.stdout:2/929: stat d8/d11/d3f/d8a/d107/d129/d23/dde/f111 0 2024-09-19T09:35:07.980 INFO:tasks.workunit.client.1.smithi191.stdout:2/930: mknod d8/db/d41/c139 0 2024-09-19T09:35:07.980 INFO:tasks.workunit.client.1.smithi191.stdout:2/931: fdatasync d8/db/d4d/fd4 0 2024-09-19T09:35:07.981 INFO:tasks.workunit.client.1.smithi191.stdout:3/906: sync 2024-09-19T09:35:07.981 INFO:tasks.workunit.client.1.smithi191.stdout:2/932: mknod d8/d11/d3f/d8a/d8f/c13a 0 2024-09-19T09:35:07.981 INFO:tasks.workunit.client.1.smithi191.stdout:2/933: creat d8/d11/d3f/dfa/f13b x:0 0 0 2024-09-19T09:35:07.981 INFO:tasks.workunit.client.1.smithi191.stdout:2/934: fdatasync d8/d2a/f53 0 2024-09-19T09:35:07.982 INFO:tasks.workunit.client.1.smithi191.stdout:3/907: unlink d12/d13/d1a/d1b/d3c/f80 0 2024-09-19T09:35:07.983 INFO:tasks.workunit.client.1.smithi191.stdout:3/908: symlink d12/d13/d1a/d1b/d2e/dab/l134 0 2024-09-19T09:35:07.984 INFO:tasks.workunit.client.1.smithi191.stdout:3/909: truncate d12/d43/db2/fec 1025395 0 2024-09-19T09:35:07.984 INFO:tasks.workunit.client.1.smithi191.stdout:3/910: write d12/d13/d1a/d5d/dd1/df0/f6a [629644,82415] 0 2024-09-19T09:35:07.984 INFO:tasks.workunit.client.1.smithi191.stdout:3/911: truncate d12/d13/d1a/d5d/dd1/df0/d91/fb5 577721 0 2024-09-19T09:35:07.989 INFO:tasks.workunit.client.1.smithi191.stdout:9/915: dwrite d3/db/d53/dee/f10c [0,4194304] 0 2024-09-19T09:35:07.989 INFO:tasks.workunit.client.1.smithi191.stdout:9/916: readlink d3/db/d16/d38/dd4/ld7 0 2024-09-19T09:35:07.989 INFO:tasks.workunit.client.1.smithi191.stdout:6/808: dwrite d2/de/d19/d1e/d64/d77/d82/fa3 [0,4194304] 0 2024-09-19T09:35:07.994 INFO:tasks.workunit.client.1.smithi191.stdout:6/809: mknod d2/de/d15/cfe 0 2024-09-19T09:35:07.995 INFO:tasks.workunit.client.1.smithi191.stdout:6/810: unlink d2/de/d15/f74 0 2024-09-19T09:35:07.997 INFO:tasks.workunit.client.1.smithi191.stdout:6/811: unlink d2/de/d2a/d2d/l47 0 2024-09-19T09:35:07.999 INFO:tasks.workunit.client.1.smithi191.stdout:7/911: sync 2024-09-19T09:35:08.000 INFO:tasks.workunit.client.1.smithi191.stdout:7/912: truncate d2/f17 402395 0 2024-09-19T09:35:08.000 INFO:tasks.workunit.client.1.smithi191.stdout:7/913: truncate d2/d39/d3a/fda 4347709 0 2024-09-19T09:35:08.001 INFO:tasks.workunit.client.1.smithi191.stdout:9/917: write d3/db/d16/d38/f3e [3633296,61212] 0 2024-09-19T09:35:08.006 INFO:tasks.workunit.client.1.smithi191.stdout:6/812: write d2/de/d19/d1e/d64/f2c [5197548,53754] 0 2024-09-19T09:35:08.009 INFO:tasks.workunit.client.1.smithi191.stdout:7/914: write d2/d39/d3a/d3c/f87 [482451,36024] 0 2024-09-19T09:35:08.010 INFO:tasks.workunit.client.1.smithi191.stdout:9/918: dread d3/d60/d78/fd1 [0,4194304] 0 2024-09-19T09:35:08.012 INFO:tasks.workunit.client.1.smithi191.stdout:7/915: mknod d2/d39/d3a/c13f 0 2024-09-19T09:35:08.012 INFO:tasks.workunit.client.1.smithi191.stdout:7/916: fsync d2/d2a/d38/de5/ffe 0 2024-09-19T09:35:08.012 INFO:tasks.workunit.client.1.smithi191.stdout:7/917: read - d2/d2a/d4f/d59/dfb/f115 zero size 2024-09-19T09:35:08.017 INFO:tasks.workunit.client.1.smithi191.stdout:9/919: dread d3/db/d16/d17/d81/f8a [0,4194304] 0 2024-09-19T09:35:08.018 INFO:tasks.workunit.client.1.smithi191.stdout:9/920: mknod d3/db/d16/d17/d3c/c13c 0 2024-09-19T09:35:08.019 INFO:tasks.workunit.client.1.smithi191.stdout:9/921: dread - d3/d60/d78/d102/f11b zero size 2024-09-19T09:35:08.019 INFO:tasks.workunit.client.1.smithi191.stdout:9/922: symlink d3/db/d16/d17/d81/da6/l13d 0 2024-09-19T09:35:08.019 INFO:tasks.workunit.client.1.smithi191.stdout:9/923: truncate d3/d60/d112/f124 592561 0 2024-09-19T09:35:08.020 INFO:tasks.workunit.client.1.smithi191.stdout:7/918: dread d2/d2a/d4f/f7b [0,4194304] 0 2024-09-19T09:35:08.020 INFO:tasks.workunit.client.1.smithi191.stdout:7/919: write d2/d2a/d33/f54 [1648619,50252] 0 2024-09-19T09:35:08.020 INFO:tasks.workunit.client.1.smithi191.stdout:7/920: read - d2/d2a/d38/de5/ded/fee zero size 2024-09-19T09:35:08.021 INFO:tasks.workunit.client.1.smithi191.stdout:9/924: rename d3/d60/d78/f7b to d3/d8/f13e 0 2024-09-19T09:35:08.021 INFO:tasks.workunit.client.1.smithi191.stdout:9/925: write d3/db/d53/fd9 [699416,26633] 0 2024-09-19T09:35:08.022 INFO:tasks.workunit.client.1.smithi191.stdout:7/921: truncate d2/d2a/d33/f5d 1345119 0 2024-09-19T09:35:08.023 INFO:tasks.workunit.client.1.smithi191.stdout:7/922: creat d2/d5e/f140 x:0 0 0 2024-09-19T09:35:08.023 INFO:tasks.workunit.client.1.smithi191.stdout:7/923: creat d2/d2a/d38/de5/d137/f141 x:0 0 0 2024-09-19T09:35:08.028 INFO:tasks.workunit.client.1.smithi191.stdout:6/813: dwrite d2/de/d19/d1e/fba [0,4194304] 0 2024-09-19T09:35:08.030 INFO:tasks.workunit.client.1.smithi191.stdout:6/814: creat d2/fff x:0 0 0 2024-09-19T09:35:08.034 INFO:tasks.workunit.client.1.smithi191.stdout:7/924: write d2/d2a/d38/d63/f97 [2385264,54478] 0 2024-09-19T09:35:08.035 INFO:tasks.workunit.client.1.smithi191.stdout:7/925: dread d2/d2a/d4f/d59/d81/fcc [0,4194304] 0 2024-09-19T09:35:08.035 INFO:tasks.workunit.client.1.smithi191.stdout:7/926: chown d2/d2a/d38/f83 283785 1 2024-09-19T09:35:08.035 INFO:tasks.workunit.client.1.smithi191.stdout:7/927: stat d2/d2a/d38/de5/ded/f131 0 2024-09-19T09:35:08.035 INFO:tasks.workunit.client.1.smithi191.stdout:7/928: fsync d2/f75 0 2024-09-19T09:35:08.036 INFO:tasks.workunit.client.1.smithi191.stdout:7/929: creat d2/d2a/d38/d63/d9a/dd5/d125/f142 x:0 0 0 2024-09-19T09:35:08.036 INFO:tasks.workunit.client.1.smithi191.stdout:9/926: dwrite d3/db/d16/f88 [0,4194304] 0 2024-09-19T09:35:08.037 INFO:tasks.workunit.client.1.smithi191.stdout:7/930: creat d2/f143 x:0 0 0 2024-09-19T09:35:08.038 INFO:tasks.workunit.client.1.smithi191.stdout:7/931: symlink d2/d2a/d38/de5/l144 0 2024-09-19T09:35:08.039 INFO:tasks.workunit.client.1.smithi191.stdout:7/932: stat d2/d2a/d38/d63/dc1/ld0 0 2024-09-19T09:35:08.039 INFO:tasks.workunit.client.1.smithi191.stdout:7/933: truncate d2/fb1 734040 0 2024-09-19T09:35:08.040 INFO:tasks.workunit.client.1.smithi191.stdout:7/934: symlink d2/d2a/d4f/d59/d81/l145 0 2024-09-19T09:35:08.041 INFO:tasks.workunit.client.1.smithi191.stdout:6/815: write d2/de/d19/d5d/fb2 [1703154,84765] 0 2024-09-19T09:35:08.045 INFO:tasks.workunit.client.1.smithi191.stdout:6/816: mknod d2/de/d19/d1e/d64/d61/d81/da7/db8/ddb/c100 0 2024-09-19T09:35:08.046 INFO:tasks.workunit.client.1.smithi191.stdout:7/935: rmdir d2/d2a/d4f/d59 39 2024-09-19T09:35:08.047 INFO:tasks.workunit.client.1.smithi191.stdout:6/817: getdents d2/de/d19/d1e/d64 0 2024-09-19T09:35:08.048 INFO:tasks.workunit.client.1.smithi191.stdout:7/936: rename d2/d2a/d38/d63/dc1/l120 to d2/d2a/d79/d7f/l146 0 2024-09-19T09:35:08.049 INFO:tasks.workunit.client.1.smithi191.stdout:9/927: dwrite d3/db/d16/d17/f116 [4194304,4194304] 0 2024-09-19T09:35:08.049 INFO:tasks.workunit.client.1.smithi191.stdout:9/928: fdatasync d3/db/d16/d17/d81/db5/feb 0 2024-09-19T09:35:08.050 INFO:tasks.workunit.client.1.smithi191.stdout:6/818: read d2/de/d19/d1e/d64/d61/fe6 [916736,123365] 0 2024-09-19T09:35:08.054 INFO:tasks.workunit.client.1.smithi191.stdout:9/929: unlink d3/da1/lb0 0 2024-09-19T09:35:08.055 INFO:tasks.workunit.client.1.smithi191.stdout:6/819: mkdir d2/de/d2a/d2d/d30/d98/d9b/d65/d89/d101 0 2024-09-19T09:35:08.057 INFO:tasks.workunit.client.1.smithi191.stdout:9/930: rename d3/db/d16/d47/d55 to d3/d60/d78/d102/d105/d13f 0 2024-09-19T09:35:08.058 INFO:tasks.workunit.client.1.smithi191.stdout:9/931: dread - d3/f11d zero size 2024-09-19T09:35:08.058 INFO:tasks.workunit.client.1.smithi191.stdout:9/932: readlink d3/d8/l7c 0 2024-09-19T09:35:08.058 INFO:tasks.workunit.client.1.smithi191.stdout:9/933: write d3/db/d16/d17/d3c/dd0/fe3 [1919217,112966] 0 2024-09-19T09:35:08.058 INFO:tasks.workunit.client.1.smithi191.stdout:7/937: dread d2/faa [0,4194304] 0 2024-09-19T09:35:08.059 INFO:tasks.workunit.client.1.smithi191.stdout:9/934: truncate d3/db6/ff3 388210 0 2024-09-19T09:35:08.059 INFO:tasks.workunit.client.1.smithi191.stdout:9/935: write d3/db/d53/da2/db3/fcf [695717,18854] 0 2024-09-19T09:35:08.061 INFO:tasks.workunit.client.1.smithi191.stdout:7/938: mkdir d2/d10c/d147 0 2024-09-19T09:35:08.061 INFO:tasks.workunit.client.1.smithi191.stdout:7/939: creat d2/d2a/d38/de5/d137/f148 x:0 0 0 2024-09-19T09:35:08.064 INFO:tasks.workunit.client.1.smithi191.stdout:9/936: creat d3/d60/d78/f140 x:0 0 0 2024-09-19T09:35:08.064 INFO:tasks.workunit.client.1.smithi191.stdout:9/937: chown d3/db/d16/d17/d3c/l125 418227 1 2024-09-19T09:35:08.066 INFO:tasks.workunit.client.1.smithi191.stdout:1/928: sync 2024-09-19T09:35:08.067 INFO:tasks.workunit.client.1.smithi191.stdout:1/929: write d3/d14a/d73/d94/f146 [497512,15417] 0 2024-09-19T09:35:08.067 INFO:tasks.workunit.client.1.smithi191.stdout:1/930: write d3/d14a/da/d1e/d25/f13f [567740,54839] 0 2024-09-19T09:35:08.067 INFO:tasks.workunit.client.1.smithi191.stdout:1/931: truncate d3/d14a/f9c 2479363 0 2024-09-19T09:35:08.067 INFO:tasks.workunit.client.1.smithi191.stdout:1/932: write d3/d14a/da/d42/f125 [167430,76620] 0 2024-09-19T09:35:08.067 INFO:tasks.workunit.client.1.smithi191.stdout:1/933: readlink d3/d14a/da/le7 0 2024-09-19T09:35:08.068 INFO:tasks.workunit.client.1.smithi191.stdout:1/934: creat d3/d14a/da/d1e/d32/d6f/db2/dd1/f153 x:0 0 0 2024-09-19T09:35:08.068 INFO:tasks.workunit.client.1.smithi191.stdout:1/935: fsync d3/d14a/fd9 0 2024-09-19T09:35:08.068 INFO:tasks.workunit.client.1.smithi191.stdout:1/936: write d3/d14a/da/d1e/d32/f74 [104838,91575] 0 2024-09-19T09:35:08.068 INFO:tasks.workunit.client.1.smithi191.stdout:7/940: write d2/f60 [988878,8127] 0 2024-09-19T09:35:08.078 INFO:tasks.workunit.client.1.smithi191.stdout:9/938: write d3/d60/d78/d102/d105/d13f/f4f [582556,60396] 0 2024-09-19T09:35:08.079 INFO:tasks.workunit.client.1.smithi191.stdout:6/820: dwrite d2/de/d19/f8b [0,4194304] 0 2024-09-19T09:35:08.079 INFO:tasks.workunit.client.1.smithi191.stdout:6/821: write d2/de/f52 [4498804,92989] 0 2024-09-19T09:35:08.080 INFO:tasks.workunit.client.1.smithi191.stdout:6/822: fsync d2/de/d2a/d2d/fa2 0 2024-09-19T09:35:08.080 INFO:tasks.workunit.client.1.smithi191.stdout:9/939: symlink d3/d60/d78/d102/d105/d13f/l141 0 2024-09-19T09:35:08.081 INFO:tasks.workunit.client.1.smithi191.stdout:9/940: truncate d3/d60/faa 1872230 0 2024-09-19T09:35:08.081 INFO:tasks.workunit.client.1.smithi191.stdout:9/941: stat d3/db/d16/d38/dd4/ddf 0 2024-09-19T09:35:08.081 INFO:tasks.workunit.client.1.smithi191.stdout:9/942: chown d3/db/d16/d17/d81/da6/lce 166050 1 2024-09-19T09:35:08.081 INFO:tasks.workunit.client.1.smithi191.stdout:9/943: stat d3/db/d16/d17/d81 0 2024-09-19T09:35:08.085 INFO:tasks.workunit.client.1.smithi191.stdout:6/823: unlink d2/de/d15/d92/cb0 0 2024-09-19T09:35:08.085 INFO:tasks.workunit.client.1.smithi191.stdout:9/944: fsync d3/db/d53/da2/db3/dc2/fc4 0 2024-09-19T09:35:08.086 INFO:tasks.workunit.client.1.smithi191.stdout:9/945: read - d3/db/d16/d17/d3c/f106 zero size 2024-09-19T09:35:08.086 INFO:tasks.workunit.client.1.smithi191.stdout:9/946: dread - d3/db/d16/d38/f11c zero size 2024-09-19T09:35:08.086 INFO:tasks.workunit.client.1.smithi191.stdout:6/824: rmdir d2/de/d2a 39 2024-09-19T09:35:08.086 INFO:tasks.workunit.client.1.smithi191.stdout:6/825: write d2/de/d2a/d2d/fee [174850,5585] 0 2024-09-19T09:35:08.087 INFO:tasks.workunit.client.1.smithi191.stdout:9/947: symlink d3/d60/l142 0 2024-09-19T09:35:08.089 INFO:tasks.workunit.client.1.smithi191.stdout:9/948: write d3/db6/ff3 [210757,90249] 0 2024-09-19T09:35:08.089 INFO:tasks.workunit.client.1.smithi191.stdout:9/949: stat d3/db/d16/d17/d81/d8d/dcd/le8 0 2024-09-19T09:35:08.089 INFO:tasks.workunit.client.1.smithi191.stdout:9/950: stat d3/db/d16/d17/d81/d8d/d126/f127 0 2024-09-19T09:35:08.089 INFO:tasks.workunit.client.1.smithi191.stdout:9/951: write d3/db/d16/d17/d3c/f106 [1020181,19186] 0 2024-09-19T09:35:08.089 INFO:tasks.workunit.client.1.smithi191.stdout:9/952: write d3/db/d16/d38/ffd [1401198,37216] 0 2024-09-19T09:35:08.089 INFO:tasks.workunit.client.1.smithi191.stdout:6/826: getdents d2/de/d2a/d2d/d30 0 2024-09-19T09:35:08.089 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:07 smithi112 ceph-mon[27605]: pgmap v16: 65 pgs: 65 active+clean; 1.6 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 156 MiB/s rd, 204 MiB/s wr, 648 op/s 2024-09-19T09:35:08.093 INFO:tasks.workunit.client.1.smithi191.stdout:6/827: dread d2/de/d19/d1e/d64/d61/fe6 [0,4194304] 0 2024-09-19T09:35:08.093 INFO:tasks.workunit.client.1.smithi191.stdout:1/937: dwrite d3/d14a/da/d1e/d32/d6f/db2/dd1/f101 [0,4194304] 0 2024-09-19T09:35:08.096 INFO:tasks.workunit.client.1.smithi191.stdout:6/828: mknod d2/de/d19/d1e/d64/d61/d81/da7/c102 0 2024-09-19T09:35:08.100 INFO:tasks.workunit.client.1.smithi191.stdout:1/938: rename d3/d14a/da/d1e/d32/d53/d57/d10e to d3/d14a/da/d1e/d32/d6f/d14d/d154 0 2024-09-19T09:35:08.100 INFO:tasks.workunit.client.1.smithi191.stdout:6/829: mkdir d2/de/d19/d1e/d64/d77/d82/d103 0 2024-09-19T09:35:08.102 INFO:tasks.workunit.client.1.smithi191.stdout:1/939: creat d3/d14a/da/d1e/d32/d53/d57/d6d/f155 x:0 0 0 2024-09-19T09:35:08.105 INFO:tasks.workunit.client.1.smithi191.stdout:6/830: rename d2/de/d2a/d60 to d2/d104 0 2024-09-19T09:35:08.105 INFO:tasks.workunit.client.1.smithi191.stdout:6/831: write d2/de/d2a/d2d/d30/d98/d9b/d65/fed [149440,2570] 0 2024-09-19T09:35:08.109 INFO:tasks.workunit.client.1.smithi191.stdout:1/940: dread d3/d14a/da/d1e/f2d [0,4194304] 0 2024-09-19T09:35:08.110 INFO:tasks.workunit.client.1.smithi191.stdout:9/953: dwrite d3/db/d16/d38/f83 [0,4194304] 0 2024-09-19T09:35:08.117 INFO:tasks.workunit.client.1.smithi191.stdout:5/904: sync 2024-09-19T09:35:08.117 INFO:tasks.workunit.client.1.smithi191.stdout:3/912: sync 2024-09-19T09:35:08.117 INFO:tasks.workunit.client.1.smithi191.stdout:2/935: sync 2024-09-19T09:35:08.118 INFO:tasks.workunit.client.1.smithi191.stdout:3/913: truncate d12/d43/d61/f11a 3794406 0 2024-09-19T09:35:08.119 INFO:tasks.workunit.client.1.smithi191.stdout:2/936: symlink d8/d2a/dba/dcc/d11a/l13c 0 2024-09-19T09:35:08.121 INFO:tasks.workunit.client.1.smithi191.stdout:5/905: rename d0/d4/f37 to d0/d4/d9/d1d/d29/d33/d52/da4/f13a 0 2024-09-19T09:35:08.121 INFO:tasks.workunit.client.1.smithi191.stdout:5/906: write d0/d4/d9/f1e [990580,87934] 0 2024-09-19T09:35:08.121 INFO:tasks.workunit.client.1.smithi191.stdout:5/907: fdatasync d0/d4/d9/d1d/d29/d33/d52/f71 0 2024-09-19T09:35:08.122 INFO:tasks.workunit.client.1.smithi191.stdout:5/908: dread - d0/d4/d9/d1d/d29/d33/d45/d97/ddf/f122 zero size 2024-09-19T09:35:08.122 INFO:tasks.workunit.client.1.smithi191.stdout:3/914: creat d12/d13/d1a/d5d/dd1/de9/d101/f135 x:0 0 0 2024-09-19T09:35:08.123 INFO:tasks.workunit.client.1.smithi191.stdout:3/915: truncate d12/d43/db2/fca 856566 0 2024-09-19T09:35:08.123 INFO:tasks.workunit.client.1.smithi191.stdout:3/916: stat d12/d13/d1a/d1b/d3c/d71/cbd 0 2024-09-19T09:35:08.123 INFO:tasks.workunit.client.1.smithi191.stdout:3/917: truncate d12/d13/d1a/d1b/d3c/d3f/f4e 847405 0 2024-09-19T09:35:08.123 INFO:tasks.workunit.client.1.smithi191.stdout:3/918: chown d12/d13/d1a/d1b/d2e/dab/d51/dcd/cc7 534771410 1 2024-09-19T09:35:08.123 INFO:tasks.workunit.client.1.smithi191.stdout:3/919: write d12/d13/d1a/d5d/dd1/de9/fe8 [784527,119976] 0 2024-09-19T09:35:08.123 INFO:tasks.workunit.client.1.smithi191.stdout:3/920: dread - d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/fb3 zero size 2024-09-19T09:35:08.123 INFO:tasks.workunit.client.1.smithi191.stdout:2/937: mknod d8/d11/d3f/d8a/dda/c13d 0 2024-09-19T09:35:08.125 INFO:tasks.workunit.client.1.smithi191.stdout:5/909: creat d0/d4/d9/d1d/d29/f13b x:0 0 0 2024-09-19T09:35:08.126 INFO:tasks.workunit.client.1.smithi191.stdout:5/910: mknod d0/d4/d88/c13c 0 2024-09-19T09:35:08.126 INFO:tasks.workunit.client.1.smithi191.stdout:5/911: creat d0/d4/d9/de/f13d x:0 0 0 2024-09-19T09:35:08.127 INFO:tasks.workunit.client.1.smithi191.stdout:5/912: mkdir d0/d4/d9/d1d/d29/d33/d52/dca/d13e 0 2024-09-19T09:35:08.127 INFO:tasks.workunit.client.1.smithi191.stdout:5/913: write d0/d4/d9/d1d/d22/d3b/db9/dfd/ffe [3349418,351] 0 2024-09-19T09:35:08.128 INFO:tasks.workunit.client.1.smithi191.stdout:5/914: dread - d0/d4/d9/d1d/d29/d33/d45/d97/f127 zero size 2024-09-19T09:35:08.133 INFO:tasks.workunit.client.1.smithi191.stdout:1/941: dwrite d3/d14a/da/d1e/d32/d53/d57/d121/d131/fc1 [0,4194304] 0 2024-09-19T09:35:08.134 INFO:tasks.workunit.client.1.smithi191.stdout:6/832: dwrite d2/de/d2a/d2d/d30/d98/d9b/d65/fed [0,4194304] 0 2024-09-19T09:35:08.134 INFO:tasks.workunit.client.1.smithi191.stdout:5/915: read d0/d4/d88/f89 [2088314,23299] 0 2024-09-19T09:35:08.135 INFO:tasks.workunit.client.1.smithi191.stdout:5/916: creat d0/d4/d9/d1d/d28/d53/f13f x:0 0 0 2024-09-19T09:35:08.135 INFO:tasks.workunit.client.1.smithi191.stdout:5/917: chown d0/d4/d9/d1d/d22/d3b/db9/c130 3 1 2024-09-19T09:35:08.135 INFO:tasks.workunit.client.1.smithi191.stdout:5/918: stat d0/d4/d9/d1d/d29/d33/d45/d97/ddf/f122 0 2024-09-19T09:35:08.135 INFO:tasks.workunit.client.1.smithi191.stdout:5/919: write d0/d4/d9/d1d/d29/d33/f38 [1039692,15719] 0 2024-09-19T09:35:08.135 INFO:tasks.workunit.client.1.smithi191.stdout:5/920: fdatasync d0/d4/d9/d1d/d29/d33/d52/da4/f120 0 2024-09-19T09:35:08.136 INFO:tasks.workunit.client.1.smithi191.stdout:1/942: mknod d3/d14a/da/d1e/d32/d6f/d14d/c156 0 2024-09-19T09:35:08.138 INFO:tasks.workunit.client.1.smithi191.stdout:2/938: dread d8/db/d4d/de6/fd0 [0,4194304] 0 2024-09-19T09:35:08.139 INFO:tasks.workunit.client.1.smithi191.stdout:6/833: symlink d2/de/d19/d1e/d64/d61/l105 0 2024-09-19T09:35:08.139 INFO:tasks.workunit.client.1.smithi191.stdout:6/834: readlink d2/de/d2a/d7d/lfd 0 2024-09-19T09:35:08.139 INFO:tasks.workunit.client.1.smithi191.stdout:6/835: chown d2/de/d2a/d2d/d30/d98/d9b/d65 1 1 2024-09-19T09:35:08.139 INFO:tasks.workunit.client.1.smithi191.stdout:6/836: chown d2/de/d2a/d2d/d30/d98/d9b/ldf 316153 1 2024-09-19T09:35:08.144 INFO:tasks.workunit.client.1.smithi191.stdout:6/837: mknod d2/de/d2a/d2d/d30/d98/de2/c106 0 2024-09-19T09:35:08.145 INFO:tasks.workunit.client.1.smithi191.stdout:1/943: rmdir d3/d14a/da/d1e/d32/d53/d57/d6d 39 2024-09-19T09:35:08.147 INFO:tasks.workunit.client.1.smithi191.stdout:1/944: link d3/d14a/f9c d3/d14a/da/d1e/d25/d70/da0/f157 0 2024-09-19T09:35:08.147 INFO:tasks.workunit.client.1.smithi191.stdout:1/945: chown d3/d14a/d73/d94 0 1 2024-09-19T09:35:08.148 INFO:tasks.workunit.client.1.smithi191.stdout:6/838: read d2/de/d19/d1e/fe4 [610968,117461] 0 2024-09-19T09:35:08.152 INFO:tasks.workunit.client.1.smithi191.stdout:6/839: mkdir d2/de/d19/d1e/d64/d61/d81/da7/df8/d107 0 2024-09-19T09:35:08.152 INFO:tasks.workunit.client.1.smithi191.stdout:6/840: write d2/de/d19/d1e/d64/d77/d82/fc5 [997746,124350] 0 2024-09-19T09:35:08.165 INFO:tasks.workunit.client.1.smithi191.stdout:5/921: dwrite d0/d4/d9/d1d/d22/d5c/f8d [0,4194304] 0 2024-09-19T09:35:08.167 INFO:tasks.workunit.client.1.smithi191.stdout:2/939: dwrite d8/d11/d3f/d8a/d107/d129/fa6 [0,4194304] 0 2024-09-19T09:35:08.167 INFO:tasks.workunit.client.1.smithi191.stdout:6/841: write d2/de/d2a/d7d/f6a [4288209,75367] 0 2024-09-19T09:35:08.167 INFO:tasks.workunit.client.1.smithi191.stdout:6/842: readlink d2/de/d2a/d2d/l4e 0 2024-09-19T09:35:08.171 INFO:tasks.workunit.client.1.smithi191.stdout:2/940: mknod d8/db/c13e 0 2024-09-19T09:35:08.171 INFO:tasks.workunit.client.1.smithi191.stdout:2/941: chown d8/d11/d3f/d8a/d107/d10d/f112 46153015 1 2024-09-19T09:35:08.172 INFO:tasks.workunit.client.1.smithi191.stdout:2/942: creat d8/d2a/dba/dcc/d11a/f13f x:0 0 0 2024-09-19T09:35:08.172 INFO:tasks.workunit.client.1.smithi191.stdout:2/943: chown d8/d11/d3f/d8a/d107/d129/d23/l33 12813 1 2024-09-19T09:35:08.173 INFO:tasks.workunit.client.1.smithi191.stdout:2/944: rmdir d8/d11/d3f/dfa/dfc/d103 39 2024-09-19T09:35:08.173 INFO:tasks.workunit.client.1.smithi191.stdout:2/945: write d8/d11/d56/f8c [2505003,86767] 0 2024-09-19T09:35:08.174 INFO:tasks.workunit.client.1.smithi191.stdout:7/941: sync 2024-09-19T09:35:08.174 INFO:tasks.workunit.client.1.smithi191.stdout:7/942: write d2/faa [3775328,19954] 0 2024-09-19T09:35:08.174 INFO:tasks.workunit.client.1.smithi191.stdout:7/943: write d2/d2a/d4f/f10f [611022,2080] 0 2024-09-19T09:35:08.176 INFO:tasks.workunit.client.1.smithi191.stdout:7/944: symlink d2/d2a/d38/def/l149 0 2024-09-19T09:35:08.176 INFO:tasks.workunit.client.1.smithi191.stdout:7/945: chown d2/d2a/d79/da8/fab 330746 1 2024-09-19T09:35:08.176 INFO:tasks.workunit.client.1.smithi191.stdout:5/922: write d0/d4/d9/f9f [1112675,122717] 0 2024-09-19T09:35:08.176 INFO:tasks.workunit.client.1.smithi191.stdout:5/923: chown d0/d77/fb6 2 1 2024-09-19T09:35:08.177 INFO:tasks.workunit.client.1.smithi191.stdout:5/924: mknod d0/d4/d9/d1d/d22/d3b/db9/d105/d10b/c140 0 2024-09-19T09:35:08.183 INFO:tasks.workunit.client.1.smithi191.stdout:6/843: dwrite d2/de/d2a/d2d/fa2 [4194304,4194304] 0 2024-09-19T09:35:08.188 INFO:tasks.workunit.client.1.smithi191.stdout:5/925: write d0/d1f/f43 [3322093,125047] 0 2024-09-19T09:35:08.188 INFO:tasks.workunit.client.1.smithi191.stdout:5/926: creat d0/da7/f141 x:0 0 0 2024-09-19T09:35:08.189 INFO:tasks.workunit.client.1.smithi191.stdout:7/946: write d2/f9d [3202651,113728] 0 2024-09-19T09:35:08.189 INFO:tasks.workunit.client.1.smithi191.stdout:7/947: chown d2/d2a/d4f/d59/dfb/deb 1543 1 2024-09-19T09:35:08.189 INFO:tasks.workunit.client.1.smithi191.stdout:7/948: creat d2/d2a/d38/de5/ded/f14a x:0 0 0 2024-09-19T09:35:08.190 INFO:tasks.workunit.client.1.smithi191.stdout:5/927: write d0/d4/d9/d1d/d22/d5c/fc3 [413958,61354] 0 2024-09-19T09:35:08.202 INFO:tasks.workunit.client.1.smithi191.stdout:7/949: dread d2/d2a/d38/f83 [0,4194304] 0 2024-09-19T09:35:08.203 INFO:tasks.workunit.client.1.smithi191.stdout:7/950: truncate d2/f23 3465961 0 2024-09-19T09:35:08.203 INFO:tasks.workunit.client.1.smithi191.stdout:9/954: sync 2024-09-19T09:35:08.211 INFO:tasks.workunit.client.1.smithi191.stdout:6/844: dwrite d2/de/d2a/d2d/dc7/fe3 [0,4194304] 0 2024-09-19T09:35:08.218 INFO:tasks.workunit.client.1.smithi191.stdout:6/845: dread d2/de/d19/d1e/fe4 [0,4194304] 0 2024-09-19T09:35:08.218 INFO:tasks.workunit.client.1.smithi191.stdout:6/846: fsync d2/de/f1d 0 2024-09-19T09:35:08.218 INFO:tasks.workunit.client.1.smithi191.stdout:5/928: dwrite d0/d4/d9/d1d/d29/d33/f38 [0,4194304] 0 2024-09-19T09:35:08.218 INFO:tasks.workunit.client.1.smithi191.stdout:6/847: chown d2/de/d19/d1e/d64/d61 508 1 2024-09-19T09:35:08.218 INFO:tasks.workunit.client.1.smithi191.stdout:5/929: dread - d0/d4/d9/d1d/d22/d3b/db9/fef zero size 2024-09-19T09:35:08.221 INFO:tasks.workunit.client.1.smithi191.stdout:6/848: creat d2/de/d2a/d2d/d30/d98/d9b/f108 x:0 0 0 2024-09-19T09:35:08.226 INFO:tasks.workunit.client.1.smithi191.stdout:9/955: dwrite d3/d60/faa [0,4194304] 0 2024-09-19T09:35:08.233 INFO:tasks.workunit.client.1.smithi191.stdout:6/849: dread d2/de/fbe [0,4194304] 0 2024-09-19T09:35:08.233 INFO:tasks.workunit.client.1.smithi191.stdout:7/951: dwrite d2/d2a/d38/fcd [0,4194304] 0 2024-09-19T09:35:08.233 INFO:tasks.workunit.client.1.smithi191.stdout:5/930: dwrite d0/d4/d9/d1d/d29/d7f/d94/fd6 [0,4194304] 0 2024-09-19T09:35:08.236 INFO:tasks.workunit.client.1.smithi191.stdout:6/850: mknod d2/de/d2a/d2d/d30/d98/c109 0 2024-09-19T09:35:08.236 INFO:tasks.workunit.client.1.smithi191.stdout:6/851: chown d2/de/d19/d1e/d64/d77/d82/d103 2238 1 2024-09-19T09:35:08.236 INFO:tasks.workunit.client.1.smithi191.stdout:6/852: stat d2/de/d19/c7c 0 2024-09-19T09:35:08.236 INFO:tasks.workunit.client.1.smithi191.stdout:6/853: write d2/de/d19/d1e/d64/f6d [1875692,102521] 0 2024-09-19T09:35:08.245 INFO:tasks.workunit.client.1.smithi191.stdout:3/921: sync 2024-09-19T09:35:08.245 INFO:tasks.workunit.client.1.smithi191.stdout:1/946: sync 2024-09-19T09:35:08.247 INFO:tasks.workunit.client.1.smithi191.stdout:9/956: dwrite d3/db/d16/d17/d81/d8d/f104 [0,4194304] 0 2024-09-19T09:35:08.247 INFO:tasks.workunit.client.1.smithi191.stdout:9/957: fsync d3/d8/fc 0 2024-09-19T09:35:08.247 INFO:tasks.workunit.client.1.smithi191.stdout:9/958: fdatasync d3/db/d53/da2/db3/ff5 0 2024-09-19T09:35:08.248 INFO:tasks.workunit.client.1.smithi191.stdout:6/854: write d2/de/d2a/d2d/dc7/fea [504596,24221] 0 2024-09-19T09:35:08.249 INFO:tasks.workunit.client.1.smithi191.stdout:2/946: sync 2024-09-19T09:35:08.250 INFO:tasks.workunit.client.1.smithi191.stdout:6/855: mknod d2/de/d2a/d2d/d30/d98/d9b/d65/c10a 0 2024-09-19T09:35:08.251 INFO:tasks.workunit.client.1.smithi191.stdout:9/959: getdents d3/db/d16/d17/d81/d8d/d126 0 2024-09-19T09:35:08.251 INFO:tasks.workunit.client.1.smithi191.stdout:9/960: chown d3/d8/fdd 1625 1 2024-09-19T09:35:08.253 INFO:tasks.workunit.client.1.smithi191.stdout:6/856: unlink d2/de/d19/d1e/d64/l53 0 2024-09-19T09:35:08.253 INFO:tasks.workunit.client.1.smithi191.stdout:6/857: fdatasync d2/de/f16 0 2024-09-19T09:35:08.253 INFO:tasks.workunit.client.1.smithi191.stdout:6/858: chown d2/de/d19/d1e/d64/d61/fe6 31817 1 2024-09-19T09:35:08.254 INFO:tasks.workunit.client.1.smithi191.stdout:9/961: getdents d3/d60/d78/d102/d105/d13f 0 2024-09-19T09:35:08.255 INFO:tasks.workunit.client.1.smithi191.stdout:6/859: mkdir d2/de/d19/d1e/d64/d77/d82/dca/d10b 0 2024-09-19T09:35:08.255 INFO:tasks.workunit.client.1.smithi191.stdout:9/962: fdatasync d3/db/d53/f6f 0 2024-09-19T09:35:08.257 INFO:tasks.workunit.client.1.smithi191.stdout:6/860: dread d2/de/d2a/d2d/d30/ff3 [0,4194304] 0 2024-09-19T09:35:08.258 INFO:tasks.workunit.client.1.smithi191.stdout:6/861: chown d2 64675 1 2024-09-19T09:35:08.258 INFO:tasks.workunit.client.1.smithi191.stdout:6/862: mkdir d2/de/d2a/d2d/d30/d98/de2/d10c 0 2024-09-19T09:35:08.258 INFO:tasks.workunit.client.1.smithi191.stdout:6/863: creat d2/de/d2a/d2d/d30/d98/de2/f10d x:0 0 0 2024-09-19T09:35:08.260 INFO:tasks.workunit.client.1.smithi191.stdout:6/864: creat d2/de/d2a/d7d/f10e x:0 0 0 2024-09-19T09:35:08.260 INFO:tasks.workunit.client.1.smithi191.stdout:6/865: chown d2/de/d19/d1e/d64/d77/ff6 300 1 2024-09-19T09:35:08.261 INFO:tasks.workunit.client.1.smithi191.stdout:3/922: dread d12/d13/d1a/d5d/dd1/df0/d91/f102 [4194304,4194304] 0 2024-09-19T09:35:08.261 INFO:tasks.workunit.client.1.smithi191.stdout:6/866: mkdir d2/de/d2a/d7d/d10f 0 2024-09-19T09:35:08.261 INFO:tasks.workunit.client.1.smithi191.stdout:6/867: write d2/de/d19/d1e/dd2/fce [135494,129942] 0 2024-09-19T09:35:08.261 INFO:tasks.workunit.client.1.smithi191.stdout:1/947: dread d3/d14a/fe [0,4194304] 0 2024-09-19T09:35:08.262 INFO:tasks.workunit.client.1.smithi191.stdout:2/947: write d8/f9c [3408359,62647] 0 2024-09-19T09:35:08.263 INFO:tasks.workunit.client.1.smithi191.stdout:1/948: creat d3/dd7/f158 x:0 0 0 2024-09-19T09:35:08.264 INFO:tasks.workunit.client.1.smithi191.stdout:3/923: getdents d12/d13/d1a/d1b/d2e/dab/d51/d62/d86 0 2024-09-19T09:35:08.267 INFO:tasks.workunit.client.1.smithi191.stdout:1/949: stat d3/d14a/da/d7e/c7d 0 2024-09-19T09:35:08.269 INFO:tasks.workunit.client.1.smithi191.stdout:3/924: rename d12/d13/d1a/d1b/d3c/d3f/d10d to d12/d13/d1a/d1b/d60/d136 0 2024-09-19T09:35:08.269 INFO:tasks.workunit.client.1.smithi191.stdout:3/925: fsync d12/d13/d1a/d1b/d2e/dab/d51/dcd/f123 0 2024-09-19T09:35:08.270 INFO:tasks.workunit.client.1.smithi191.stdout:1/950: link d3/d14a/da/f20 d3/d14a/d73/f159 0 2024-09-19T09:35:08.271 INFO:tasks.workunit.client.1.smithi191.stdout:6/868: getdents d2/de/d2a/d2d/d30/d98/de2 0 2024-09-19T09:35:08.271 INFO:tasks.workunit.client.1.smithi191.stdout:6/869: rename d2/de/d2a/d2d to d2/de/d2a/d2d/d30/da4/d110 22 2024-09-19T09:35:08.272 INFO:tasks.workunit.client.1.smithi191.stdout:2/948: write d8/d11/d3f/d8a/d8f/f96 [2410233,68700] 0 2024-09-19T09:35:08.272 INFO:tasks.workunit.client.1.smithi191.stdout:2/949: creat d8/db/d4d/de6/d70/de8/f140 x:0 0 0 2024-09-19T09:35:08.272 INFO:tasks.workunit.client.1.smithi191.stdout:6/870: mknod d2/de/d19/d1e/d64/d77/d82/dca/c111 0 2024-09-19T09:35:08.273 INFO:tasks.workunit.client.1.smithi191.stdout:3/926: getdents d12/d13/d1a/d28 0 2024-09-19T09:35:08.273 INFO:tasks.workunit.client.1.smithi191.stdout:3/927: getdents d12/d13/d1a/d5d 0 2024-09-19T09:35:08.273 INFO:tasks.workunit.client.1.smithi191.stdout:3/928: write d12/d13/d1a/df7/f10e [830009,74103] 0 2024-09-19T09:35:08.273 INFO:tasks.workunit.client.1.smithi191.stdout:3/929: chown d12/d13/d1a/d1b/d3c/d3f 13358 1 2024-09-19T09:35:08.275 INFO:tasks.workunit.client.1.smithi191.stdout:2/950: creat d8/d11/d98/f141 x:0 0 0 2024-09-19T09:35:08.276 INFO:tasks.workunit.client.1.smithi191.stdout:6/871: rename d2/de/d2a/d2d/d30/d98/d9b/d65/c10a to d2/de/d19/d1e/d64/d77/d82/c112 0 2024-09-19T09:35:08.277 INFO:tasks.workunit.client.1.smithi191.stdout:9/963: dwrite d3/d8/f56 [0,4194304] 0 2024-09-19T09:35:08.277 INFO:tasks.workunit.client.1.smithi191.stdout:3/930: mknod d12/d13/d1a/d5d/dd1/de9/d101/c137 0 2024-09-19T09:35:08.278 INFO:tasks.workunit.client.1.smithi191.stdout:2/951: symlink d8/d11/d56/l142 0 2024-09-19T09:35:08.278 INFO:tasks.workunit.client.1.smithi191.stdout:6/872: getdents d2/de 0 2024-09-19T09:35:08.279 INFO:tasks.workunit.client.1.smithi191.stdout:9/964: dread d3/d60/d78/d102/d105/d13f/f4e [0,4194304] 0 2024-09-19T09:35:08.279 INFO:tasks.workunit.client.1.smithi191.stdout:9/965: fsync d3/db/d16/d38/dd4/f107 0 2024-09-19T09:35:08.281 INFO:tasks.workunit.client.1.smithi191.stdout:1/951: write d3/d14a/da/d1e/d32/d6f/db2/dd1/f118 [4943526,64301] 0 2024-09-19T09:35:08.281 INFO:tasks.workunit.client.1.smithi191.stdout:1/952: write d3/d14a/da/d1e/d32/d53/d57/d6d/da1/fcb [590007,120282] 0 2024-09-19T09:35:08.281 INFO:tasks.workunit.client.1.smithi191.stdout:1/953: chown d3/d14a/da/d1e/d32/d53/d57/d121/d131/d97/c12a 419137 1 2024-09-19T09:35:08.282 INFO:tasks.workunit.client.1.smithi191.stdout:3/931: rename d12/d13/d1a/d1b/d3c/d3f/l76 to d12/d43/db2/l138 0 2024-09-19T09:35:08.282 INFO:tasks.workunit.client.1.smithi191.stdout:2/952: mkdir d8/d11/d3f/d143 0 2024-09-19T09:35:08.283 INFO:tasks.workunit.client.1.smithi191.stdout:6/873: creat d2/de/d2a/d2d/d30/d98/de2/df1/f113 x:0 0 0 2024-09-19T09:35:08.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:07 smithi191 ceph-mon[34834]: pgmap v16: 65 pgs: 65 active+clean; 1.6 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 156 MiB/s rd, 204 MiB/s wr, 648 op/s 2024-09-19T09:35:08.285 INFO:tasks.workunit.client.1.smithi191.stdout:9/966: link d3/db/d16/d17/d81/da6/f100 d3/db/d16/d17/d81/d8d/d126/f143 0 2024-09-19T09:35:08.287 INFO:tasks.workunit.client.1.smithi191.stdout:9/967: dread d3/d60/d78/d102/d105/d13f/fea [0,4194304] 0 2024-09-19T09:35:08.287 INFO:tasks.workunit.client.1.smithi191.stdout:9/968: chown d3/db/d16/d17/d3c/c113 19243 1 2024-09-19T09:35:08.287 INFO:tasks.workunit.client.1.smithi191.stdout:2/953: creat d8/db/f144 x:0 0 0 2024-09-19T09:35:08.288 INFO:tasks.workunit.client.1.smithi191.stdout:2/954: chown d8/d11/d3f/dfa/c130 7 1 2024-09-19T09:35:08.288 INFO:tasks.workunit.client.1.smithi191.stdout:2/955: truncate d8/d2a/dba/ff1 457883 0 2024-09-19T09:35:08.289 INFO:tasks.workunit.client.1.smithi191.stdout:1/954: rmdir d3/dbd 39 2024-09-19T09:35:08.290 INFO:tasks.workunit.client.1.smithi191.stdout:1/955: mknod d3/d14a/da/d1e/d32/d6f/c15a 0 2024-09-19T09:35:08.292 INFO:tasks.workunit.client.1.smithi191.stdout:9/969: getdents d3/db/d16/d17/d3c/dd0/dfe 0 2024-09-19T09:35:08.292 INFO:tasks.workunit.client.1.smithi191.stdout:3/932: dread d12/d13/d1a/d1b/d3c/f68 [0,4194304] 0 2024-09-19T09:35:08.292 INFO:tasks.workunit.client.1.smithi191.stdout:3/933: write d12/d13/d1a/d5d/dd1/df0/f6a [1138160,94516] 0 2024-09-19T09:35:08.292 INFO:tasks.workunit.client.1.smithi191.stdout:3/934: creat d12/d13/d1a/d5d/dd1/de9/d101/f139 x:0 0 0 2024-09-19T09:35:08.293 INFO:tasks.workunit.client.1.smithi191.stdout:2/956: dread d8/d11/d56/f69 [0,4194304] 0 2024-09-19T09:35:08.293 INFO:tasks.workunit.client.1.smithi191.stdout:9/970: rmdir d3/db/d16/d17/d81/db5 39 2024-09-19T09:35:08.296 INFO:tasks.workunit.client.1.smithi191.stdout:2/957: mkdir d8/d11/d3f/d8a/d107/d129/d23/d145 0 2024-09-19T09:35:08.296 INFO:tasks.workunit.client.1.smithi191.stdout:9/971: truncate d3/db/d16/f7e 3679981 0 2024-09-19T09:35:08.298 INFO:tasks.workunit.client.1.smithi191.stdout:6/874: dwrite d2/de/d19/d1e/d64/d77/d82/fa3 [4194304,4194304] 0 2024-09-19T09:35:08.298 INFO:tasks.workunit.client.1.smithi191.stdout:2/958: mknod d8/d11/d56/c146 0 2024-09-19T09:35:08.298 INFO:tasks.workunit.client.1.smithi191.stdout:2/959: getdents d8/d11/d3f/d143 0 2024-09-19T09:35:08.299 INFO:tasks.workunit.client.1.smithi191.stdout:1/956: rename d3/d14a/da/d1e/d32/d6f to d3/d14a/da/db/d15b 0 2024-09-19T09:35:08.304 INFO:tasks.workunit.client.1.smithi191.stdout:6/875: truncate d2/de/f69 1084815 0 2024-09-19T09:35:08.304 INFO:tasks.workunit.client.1.smithi191.stdout:6/876: write d2/de/d2a/d2d/fee [840948,124815] 0 2024-09-19T09:35:08.305 INFO:tasks.workunit.client.1.smithi191.stdout:9/972: rename d3/da1/l10e to d3/db/d16/d17/d81/d8d/dcd/l144 0 2024-09-19T09:35:08.306 INFO:tasks.workunit.client.1.smithi191.stdout:3/935: dwrite d12/d13/d1a/d5d/dd1/df0/f8c [0,4194304] 0 2024-09-19T09:35:08.307 INFO:tasks.workunit.client.1.smithi191.stdout:1/957: unlink d3/d14a/dda/c12e 0 2024-09-19T09:35:08.308 INFO:tasks.workunit.client.1.smithi191.stdout:1/958: readlink d3/l15 0 2024-09-19T09:35:08.308 INFO:tasks.workunit.client.1.smithi191.stdout:1/959: stat d3/d14a/da/d42 0 2024-09-19T09:35:08.308 INFO:tasks.workunit.client.1.smithi191.stdout:1/960: chown d3/d14a/da/d1e/d32/d53/d57/d121/f135 660362101 1 2024-09-19T09:35:08.308 INFO:tasks.workunit.client.1.smithi191.stdout:6/877: fsync d2/de/d19/d1e/dd2/fce 0 2024-09-19T09:35:08.308 INFO:tasks.workunit.client.1.smithi191.stdout:2/960: rename d8/d2a/c132 to d8/d11/d3f/d8a/d107/d129/d23/c147 0 2024-09-19T09:35:08.309 INFO:tasks.workunit.client.1.smithi191.stdout:2/961: stat d8/d11/d56/l142 0 2024-09-19T09:35:08.312 INFO:tasks.workunit.client.1.smithi191.stdout:1/961: mknod d3/d14a/c15c 0 2024-09-19T09:35:08.313 INFO:tasks.workunit.client.1.smithi191.stdout:1/962: write d3/d14a/da/d1e/d32/d53/d57/d6d/da1/fcb [111721,22428] 0 2024-09-19T09:35:08.313 INFO:tasks.workunit.client.1.smithi191.stdout:2/962: creat d8/d11/f148 x:0 0 0 2024-09-19T09:35:08.314 INFO:tasks.workunit.client.1.smithi191.stdout:2/963: stat d8/db/f63 0 2024-09-19T09:35:08.314 INFO:tasks.workunit.client.1.smithi191.stdout:1/963: truncate d3/dbd/f120 2968244 0 2024-09-19T09:35:08.315 INFO:tasks.workunit.client.1.smithi191.stdout:1/964: chown d3/d14a/da/d1e/d25/f84 82402730 1 2024-09-19T09:35:08.315 INFO:tasks.workunit.client.1.smithi191.stdout:1/965: write d3/d14a/dda/f128 [396244,87847] 0 2024-09-19T09:35:08.316 INFO:tasks.workunit.client.1.smithi191.stdout:2/964: dread d8/db/d4d/de6/f90 [0,4194304] 0 2024-09-19T09:35:08.317 INFO:tasks.workunit.client.1.smithi191.stdout:7/952: sync 2024-09-19T09:35:08.317 INFO:tasks.workunit.client.1.smithi191.stdout:5/931: sync 2024-09-19T09:35:08.321 INFO:tasks.workunit.client.1.smithi191.stdout:2/965: creat d8/d11/f149 x:0 0 0 2024-09-19T09:35:08.321 INFO:tasks.workunit.client.1.smithi191.stdout:5/932: mkdir d0/d4/dae/dbd/d142 0 2024-09-19T09:35:08.321 INFO:tasks.workunit.client.1.smithi191.stdout:7/953: creat d2/d2a/d79/da8/f14b x:0 0 0 2024-09-19T09:35:08.322 INFO:tasks.workunit.client.1.smithi191.stdout:2/966: unlink d8/db/d4d/de6/f48 0 2024-09-19T09:35:08.322 INFO:tasks.workunit.client.1.smithi191.stdout:2/967: fdatasync d8/d11/d3f/d8a/d107/d129/d23/fb0 0 2024-09-19T09:35:08.325 INFO:tasks.workunit.client.1.smithi191.stdout:3/936: dread d12/d13/d1a/d28/f11d [0,4194304] 0 2024-09-19T09:35:08.325 INFO:tasks.workunit.client.1.smithi191.stdout:2/968: creat d8/db/d4d/f14a x:0 0 0 2024-09-19T09:35:08.325 INFO:tasks.workunit.client.1.smithi191.stdout:2/969: write d8/f44 [3196463,106246] 0 2024-09-19T09:35:08.327 INFO:tasks.workunit.client.1.smithi191.stdout:2/970: mkdir d8/db/d4e/d14b 0 2024-09-19T09:35:08.329 INFO:tasks.workunit.client.1.smithi191.stdout:6/878: write d2/de/fbe [1981032,129703] 0 2024-09-19T09:35:08.329 INFO:tasks.workunit.client.1.smithi191.stdout:9/973: dwrite d3/d8/fdd [0,4194304] 0 2024-09-19T09:35:08.329 INFO:tasks.workunit.client.1.smithi191.stdout:3/937: dread d12/d13/d1a/d1b/d3c/d3f/f83 [0,4194304] 0 2024-09-19T09:35:08.332 INFO:tasks.workunit.client.1.smithi191.stdout:3/938: link d12/dff/f122 d12/d43/d61/d98/dc4/f13a 0 2024-09-19T09:35:08.333 INFO:tasks.workunit.client.1.smithi191.stdout:3/939: mkdir d12/d107/da0/d13b 0 2024-09-19T09:35:08.342 INFO:tasks.workunit.client.1.smithi191.stdout:3/940: dread d12/d13/d1a/d1b/d60/d7a/d93/f94 [0,4194304] 0 2024-09-19T09:35:08.342 INFO:tasks.workunit.client.1.smithi191.stdout:6/879: read d2/de/d2a/d2d/f1b [4583740,102796] 0 2024-09-19T09:35:08.343 INFO:tasks.workunit.client.1.smithi191.stdout:6/880: write d2/f34 [3380435,126158] 0 2024-09-19T09:35:08.343 INFO:tasks.workunit.client.1.smithi191.stdout:3/941: creat d12/d13/d1a/d1b/d2e/dab/da6/f13c x:0 0 0 2024-09-19T09:35:08.343 INFO:tasks.workunit.client.1.smithi191.stdout:3/942: read - d12/d13/d1a/d5d/dd1/df0/d91/f12f zero size 2024-09-19T09:35:08.345 INFO:tasks.workunit.client.1.smithi191.stdout:6/881: mknod d2/de/d2a/d2d/d30/c114 0 2024-09-19T09:35:08.347 INFO:tasks.workunit.client.1.smithi191.stdout:6/882: mknod d2/de/d2a/d2d/d30/d98/d9b/d65/d89/c115 0 2024-09-19T09:35:08.347 INFO:tasks.workunit.client.1.smithi191.stdout:6/883: chown d2/de/d19/d1e/d64/d61/d81/da7/db8 0 1 2024-09-19T09:35:08.354 INFO:tasks.workunit.client.1.smithi191.stdout:1/966: dwrite d3/d14a/da/d42/f129 [0,4194304] 0 2024-09-19T09:35:08.355 INFO:tasks.workunit.client.1.smithi191.stdout:5/933: dwrite d0/d4/d9/d1d/d29/d33/d45/d97/ddf/ffa [0,4194304] 0 2024-09-19T09:35:08.357 INFO:tasks.workunit.client.1.smithi191.stdout:1/967: creat d3/d14a/da/d1e/d32/d53/d57/d6d/da1/f15d x:0 0 0 2024-09-19T09:35:08.362 INFO:tasks.workunit.client.1.smithi191.stdout:9/974: dwrite d3/db/d16/f88 [0,4194304] 0 2024-09-19T09:35:08.362 INFO:tasks.workunit.client.1.smithi191.stdout:9/975: fsync d3/d60/f7a 0 2024-09-19T09:35:08.364 INFO:tasks.workunit.client.1.smithi191.stdout:6/884: dwrite d2/de/d19/f93 [0,4194304] 0 2024-09-19T09:35:08.364 INFO:tasks.workunit.client.1.smithi191.stdout:6/885: write d2/de/d19/d1e/d64/d77/ff6 [325206,31269] 0 2024-09-19T09:35:08.365 INFO:tasks.workunit.client.1.smithi191.stdout:2/971: dread d8/d11/d3f/d8a/d8f/f96 [0,4194304] 0 2024-09-19T09:35:08.365 INFO:tasks.workunit.client.1.smithi191.stdout:7/954: dwrite d2/f23 [0,4194304] 0 2024-09-19T09:35:08.367 INFO:tasks.workunit.client.1.smithi191.stdout:5/934: rename d0/d4/d9/d1d/d28/d53 to d0/d4/dae/dbd/d142/d143 0 2024-09-19T09:35:08.368 INFO:tasks.workunit.client.1.smithi191.stdout:6/886: symlink d2/de/d2a/d2d/d30/l116 0 2024-09-19T09:35:08.368 INFO:tasks.workunit.client.1.smithi191.stdout:6/887: chown d2/de/d19/d1e/d64/d61/d81/da7/db8/ddb/c100 6042 1 2024-09-19T09:35:08.373 INFO:tasks.workunit.client.1.smithi191.stdout:2/972: truncate d8/db/d4d/de6/d70/fcb 1734292 0 2024-09-19T09:35:08.373 INFO:tasks.workunit.client.1.smithi191.stdout:2/973: write d8/d11/d3f/d8a/d107/d10d/f112 [5139808,62641] 0 2024-09-19T09:35:08.373 INFO:tasks.workunit.client.1.smithi191.stdout:2/974: chown d8/d11/d3f/d8a/d107/d129/d40/da8/l136 754923800 1 2024-09-19T09:35:08.375 INFO:tasks.workunit.client.1.smithi191.stdout:7/955: rename d2/d2a/d38/d63/d9a/dd5/l13d to d2/d2a/d38/de5/ded/d10e/l14c 0 2024-09-19T09:35:08.375 INFO:tasks.workunit.client.1.smithi191.stdout:7/956: truncate d2/d2a/d38/dd4/f118 208539 0 2024-09-19T09:35:08.376 INFO:tasks.workunit.client.1.smithi191.stdout:5/935: mkdir d0/d4/d9/d1d/d22/d3b/db9/d144 0 2024-09-19T09:35:08.377 INFO:tasks.workunit.client.1.smithi191.stdout:5/936: write d0/d4/d9/d1d/d29/d33/d52/da4/fd1 [844833,102338] 0 2024-09-19T09:35:08.377 INFO:tasks.workunit.client.1.smithi191.stdout:6/888: getdents d2/de/d19/d1e/dd2 0 2024-09-19T09:35:08.378 INFO:tasks.workunit.client.1.smithi191.stdout:9/976: dwrite d3/db/d16/d17/d3c/dd0/fe3 [0,4194304] 0 2024-09-19T09:35:08.379 INFO:tasks.workunit.client.1.smithi191.stdout:7/957: creat d2/d2a/d38/de5/d105/f14d x:0 0 0 2024-09-19T09:35:08.379 INFO:tasks.workunit.client.1.smithi191.stdout:5/937: mkdir d0/da7/d116/d12d/d145 0 2024-09-19T09:35:08.383 INFO:tasks.workunit.client.1.smithi191.stdout:7/958: rename d2/f60 to d2/d5e/dfc/f14e 0 2024-09-19T09:35:08.387 INFO:tasks.workunit.client.1.smithi191.stdout:7/959: unlink d2/d2a/d4f/d78/ca1 0 2024-09-19T09:35:08.388 INFO:tasks.workunit.client.1.smithi191.stdout:7/960: read - d2/d2a/d38/d63/f13b zero size 2024-09-19T09:35:08.388 INFO:tasks.workunit.client.1.smithi191.stdout:7/961: write d2/d2a/d38/d63/d9a/dd5/f12b [226025,118581] 0 2024-09-19T09:35:08.388 INFO:tasks.workunit.client.1.smithi191.stdout:7/962: truncate d2/f1e 5170197 0 2024-09-19T09:35:08.389 INFO:tasks.workunit.client.1.smithi191.stdout:7/963: symlink d2/d2a/d4f/d59/dfb/l14f 0 2024-09-19T09:35:08.389 INFO:tasks.workunit.client.1.smithi191.stdout:7/964: write d2/d2a/d38/de5/f10d [117119,27494] 0 2024-09-19T09:35:08.389 INFO:tasks.workunit.client.1.smithi191.stdout:7/965: read - d2/d2a/d4f/f72 zero size 2024-09-19T09:35:08.390 INFO:tasks.workunit.client.1.smithi191.stdout:9/977: getdents d3/d8 0 2024-09-19T09:35:08.390 INFO:tasks.workunit.client.1.smithi191.stdout:6/889: write d2/de/d19/d1e/f3e [1347418,41922] 0 2024-09-19T09:35:08.391 INFO:tasks.workunit.client.1.smithi191.stdout:7/966: mkdir d2/d39/d3a/d150 0 2024-09-19T09:35:08.391 INFO:tasks.workunit.client.1.smithi191.stdout:7/967: truncate d2/d2a/d38/de5/ffe 655680 0 2024-09-19T09:35:08.391 INFO:tasks.workunit.client.1.smithi191.stdout:9/978: symlink d3/db/d16/d17/d81/db5/l145 0 2024-09-19T09:35:08.392 INFO:tasks.workunit.client.1.smithi191.stdout:1/968: write d3/d14a/da/d1e/d32/d53/f2c [717690,33557] 0 2024-09-19T09:35:08.393 INFO:tasks.workunit.client.1.smithi191.stdout:9/979: mkdir d3/db/d16/d17/d3c/d146 0 2024-09-19T09:35:08.394 INFO:tasks.workunit.client.1.smithi191.stdout:1/969: symlink d3/d14a/d73/d11b/l15e 0 2024-09-19T09:35:08.396 INFO:tasks.workunit.client.1.smithi191.stdout:9/980: link d3/d8/fb2 d3/db/de6/f147 0 2024-09-19T09:35:08.396 INFO:tasks.workunit.client.1.smithi191.stdout:9/981: fdatasync d3/db6/ff3 0 2024-09-19T09:35:08.397 INFO:tasks.workunit.client.1.smithi191.stdout:1/970: rmdir d3/d14a/da/d1e/d32/d53/d57/d6d/da1/da7 39 2024-09-19T09:35:08.400 INFO:tasks.workunit.client.1.smithi191.stdout:9/982: rename d3/db/d16/d17/d3c/c13c to d3/db/d16/d17/d81/db5/c148 0 2024-09-19T09:35:08.401 INFO:tasks.workunit.client.1.smithi191.stdout:6/890: write d2/de/d19/d1e/d64/d61/d81/da7/dde/ff7 [2315625,46352] 0 2024-09-19T09:35:08.401 INFO:tasks.workunit.client.1.smithi191.stdout:2/975: dwrite d8/d2a/dba/ff1 [0,4194304] 0 2024-09-19T09:35:08.401 INFO:tasks.workunit.client.1.smithi191.stdout:2/976: dread - d8/d11/d98/f141 zero size 2024-09-19T09:35:08.401 INFO:tasks.workunit.client.1.smithi191.stdout:2/977: readlink d8/d2a/dba/dcc/d10c/l11e 0 2024-09-19T09:35:08.401 INFO:tasks.workunit.client.1.smithi191.stdout:5/938: dwrite d0/d4/d9/d1d/d22/d5c/fe2 [0,4194304] 0 2024-09-19T09:35:08.402 INFO:tasks.workunit.client.1.smithi191.stdout:6/891: symlink d2/de/df0/l117 0 2024-09-19T09:35:08.403 INFO:tasks.workunit.client.1.smithi191.stdout:6/892: mkdir d2/d104/d118 0 2024-09-19T09:35:08.404 INFO:tasks.workunit.client.1.smithi191.stdout:6/893: symlink d2/d104/d118/l119 0 2024-09-19T09:35:08.405 INFO:tasks.workunit.client.1.smithi191.stdout:2/978: rename d8/d11/d98 to d8/d131/d14c 0 2024-09-19T09:35:08.405 INFO:tasks.workunit.client.1.smithi191.stdout:2/979: fdatasync d8/d11/d3f/d8a/d107/d129/d23/f43 0 2024-09-19T09:35:08.406 INFO:tasks.workunit.client.1.smithi191.stdout:6/894: mknod d2/de/d19/d1e/d64/d77/c11a 0 2024-09-19T09:35:08.408 INFO:tasks.workunit.client.1.smithi191.stdout:6/895: link d2/de/d19/c35 d2/de/d19/d1e/d64/d61/d81/da7/db8/ddb/c11b 0 2024-09-19T09:35:08.408 INFO:tasks.workunit.client.1.smithi191.stdout:6/896: fdatasync d2/de/d2a/d2d/d30/d98/d9b/f68 0 2024-09-19T09:35:08.413 INFO:tasks.workunit.client.1.smithi191.stdout:7/968: dwrite d2/d2a/d79/fd7 [0,4194304] 0 2024-09-19T09:35:08.418 INFO:tasks.workunit.client.1.smithi191.stdout:9/983: read d3/db/d16/d17/d81/d8d/f104 [1933533,51183] 0 2024-09-19T09:35:08.418 INFO:tasks.workunit.client.1.smithi191.stdout:7/969: mkdir d2/d2a/d4f/d151 0 2024-09-19T09:35:08.419 INFO:tasks.workunit.client.1.smithi191.stdout:6/897: dread d2/de/d2a/d2d/d30/d98/fe9 [0,4194304] 0 2024-09-19T09:35:08.419 INFO:tasks.workunit.client.1.smithi191.stdout:6/898: truncate d2/de/df0/ffa 4724 0 2024-09-19T09:35:08.421 INFO:tasks.workunit.client.1.smithi191.stdout:9/984: dread d3/db/d16/d47/fd8 [0,4194304] 0 2024-09-19T09:35:08.423 INFO:tasks.workunit.client.1.smithi191.stdout:7/970: rename d2/d2a/d79/cdf to d2/d2a/c152 0 2024-09-19T09:35:08.424 INFO:tasks.workunit.client.1.smithi191.stdout:5/939: dwrite d0/d4/d9/d1d/d29/d33/d45/d97/ddf/f122 [0,4194304] 0 2024-09-19T09:35:08.425 INFO:tasks.workunit.client.1.smithi191.stdout:9/985: mkdir d3/db/d53/da2/d149 0 2024-09-19T09:35:08.425 INFO:tasks.workunit.client.1.smithi191.stdout:9/986: creat d3/f14a x:0 0 0 2024-09-19T09:35:08.426 INFO:tasks.workunit.client.1.smithi191.stdout:7/971: mknod d2/d2a/d38/d63/c153 0 2024-09-19T09:35:08.426 INFO:tasks.workunit.client.1.smithi191.stdout:7/972: dread - d2/d2a/d4f/f72 zero size 2024-09-19T09:35:08.426 INFO:tasks.workunit.client.1.smithi191.stdout:6/899: dread d2/de/fbe [0,4194304] 0 2024-09-19T09:35:08.427 INFO:tasks.workunit.client.1.smithi191.stdout:6/900: dread d2/de/d19/d1e/d64/d77/ff6 [0,4194304] 0 2024-09-19T09:35:08.430 INFO:tasks.workunit.client.1.smithi191.stdout:9/987: rename d3/d60/d78/fdb to d3/d60/f14b 0 2024-09-19T09:35:08.431 INFO:tasks.workunit.client.1.smithi191.stdout:2/980: truncate d8/db/d4d/de6/d70/fcb 1000766 0 2024-09-19T09:35:08.432 INFO:tasks.workunit.client.1.smithi191.stdout:7/973: dread d2/d5e/dfc/f12f [0,4194304] 0 2024-09-19T09:35:08.433 INFO:tasks.workunit.client.1.smithi191.stdout:6/901: mknod d2/de/d2a/d2d/d30/d98/d9b/d65/c11c 0 2024-09-19T09:35:08.433 INFO:tasks.workunit.client.1.smithi191.stdout:6/902: getdents d2/d104/db5 0 2024-09-19T09:35:08.433 INFO:tasks.workunit.client.1.smithi191.stdout:5/940: rmdir d0/d77 39 2024-09-19T09:35:08.436 INFO:tasks.workunit.client.1.smithi191.stdout:7/974: creat d2/d2a/d4f/d151/f154 x:0 0 0 2024-09-19T09:35:08.436 INFO:tasks.workunit.client.1.smithi191.stdout:7/975: dread - d2/d2a/d38/def/f109 zero size 2024-09-19T09:35:08.436 INFO:tasks.workunit.client.1.smithi191.stdout:6/903: creat d2/de/d2a/d2d/d30/d98/de2/f11d x:0 0 0 2024-09-19T09:35:08.438 INFO:tasks.workunit.client.1.smithi191.stdout:5/941: mkdir d0/d4/d9/d1d/d22/d3b/db9/dfd/d146 0 2024-09-19T09:35:08.439 INFO:tasks.workunit.client.1.smithi191.stdout:9/988: rmdir d3/d60/d78/d102/d105 39 2024-09-19T09:35:08.441 INFO:tasks.workunit.client.1.smithi191.stdout:7/976: mknod d2/d2a/d79/da8/c155 0 2024-09-19T09:35:08.441 INFO:tasks.workunit.client.1.smithi191.stdout:7/977: stat d2/d39/d3a/d3c/ce3 0 2024-09-19T09:35:08.441 INFO:tasks.workunit.client.1.smithi191.stdout:7/978: write d2/d5e/dfc/f12f [2947434,58140] 0 2024-09-19T09:35:08.442 INFO:tasks.workunit.client.1.smithi191.stdout:6/904: unlink d2/de/d15/c90 0 2024-09-19T09:35:08.442 INFO:tasks.workunit.client.1.smithi191.stdout:6/905: write d2/de/d19/d1e/d64/d61/d81/da7/dde/ff7 [1347036,56013] 0 2024-09-19T09:35:08.442 INFO:tasks.workunit.client.1.smithi191.stdout:6/906: write d2/de/d2a/d2d/fee [1748894,105117] 0 2024-09-19T09:35:08.443 INFO:tasks.workunit.client.1.smithi191.stdout:5/942: creat d0/d4/d9/d1d/d29/d33/d45/d64/f147 x:0 0 0 2024-09-19T09:35:08.443 INFO:tasks.workunit.client.1.smithi191.stdout:5/943: chown d0/d4/c11f 33 1 2024-09-19T09:35:08.443 INFO:tasks.workunit.client.1.smithi191.stdout:5/944: fsync d0/d4/d9/f5a 0 2024-09-19T09:35:08.443 INFO:tasks.workunit.client.1.smithi191.stdout:9/989: mknod d3/d60/d78/d102/d105/c14c 0 2024-09-19T09:35:08.444 INFO:tasks.workunit.client.1.smithi191.stdout:9/990: creat d3/db/de6/f14d x:0 0 0 2024-09-19T09:35:08.445 INFO:tasks.workunit.client.1.smithi191.stdout:3/943: sync 2024-09-19T09:35:08.445 INFO:tasks.workunit.client.1.smithi191.stdout:3/944: write d12/d13/d1a/d1b/d2e/f3a [303276,5753] 0 2024-09-19T09:35:08.447 INFO:tasks.workunit.client.1.smithi191.stdout:9/991: symlink d3/db6/l14e 0 2024-09-19T09:35:08.448 INFO:tasks.workunit.client.1.smithi191.stdout:3/945: rmdir d12/d13/d1a/d1b/d2e/dab/da6 39 2024-09-19T09:35:08.451 INFO:tasks.workunit.client.1.smithi191.stdout:9/992: creat d3/db/d16/d17/d81/d8d/f14f x:0 0 0 2024-09-19T09:35:08.451 INFO:tasks.workunit.client.1.smithi191.stdout:9/993: creat d3/d60/d112/f150 x:0 0 0 2024-09-19T09:35:08.452 INFO:tasks.workunit.client.1.smithi191.stdout:5/945: write d0/d4/d9/de/f47 [4112782,7315] 0 2024-09-19T09:35:08.452 INFO:tasks.workunit.client.1.smithi191.stdout:3/946: getdents d12/d13/d1a/df7 0 2024-09-19T09:35:08.452 INFO:tasks.workunit.client.1.smithi191.stdout:3/947: creat d12/d13/d1a/d1b/d60/d7a/f13d x:0 0 0 2024-09-19T09:35:08.453 INFO:tasks.workunit.client.1.smithi191.stdout:3/948: stat d12/d13/d1a/d1b/d60/d7a/d93/lce 0 2024-09-19T09:35:08.453 INFO:tasks.workunit.client.1.smithi191.stdout:5/946: symlink d0/d4/d9/d1d/d22/d3b/db9/d105/l148 0 2024-09-19T09:35:08.455 INFO:tasks.workunit.client.1.smithi191.stdout:3/949: creat d12/d13/d1a/d1b/d60/f13e x:0 0 0 2024-09-19T09:35:08.455 INFO:tasks.workunit.client.1.smithi191.stdout:3/950: creat d12/d13/f13f x:0 0 0 2024-09-19T09:35:08.456 INFO:tasks.workunit.client.1.smithi191.stdout:5/947: mknod d0/d4/d9/d1d/d22/d3b/db9/dfd/d146/c149 0 2024-09-19T09:35:08.456 INFO:tasks.workunit.client.1.smithi191.stdout:3/951: dread d12/d43/db2/fec [0,4194304] 0 2024-09-19T09:35:08.457 INFO:tasks.workunit.client.1.smithi191.stdout:2/981: dwrite d8/f9e [0,4194304] 0 2024-09-19T09:35:08.458 INFO:tasks.workunit.client.1.smithi191.stdout:2/982: symlink d8/db/d41/d12c/l14d 0 2024-09-19T09:35:08.458 INFO:tasks.workunit.client.1.smithi191.stdout:2/983: fsync d8/db/d4d/fd4 0 2024-09-19T09:35:08.462 INFO:tasks.workunit.client.1.smithi191.stdout:6/907: dwrite d2/de/d2a/d2d/d30/d98/d9b/fb7 [0,4194304] 0 2024-09-19T09:35:08.462 INFO:tasks.workunit.client.1.smithi191.stdout:6/908: write d2/de/d19/d1e/d64/f54 [2550747,79354] 0 2024-09-19T09:35:08.463 INFO:tasks.workunit.client.1.smithi191.stdout:6/909: truncate d2/de/d2a/d39/f62 4522645 0 2024-09-19T09:35:08.463 INFO:tasks.workunit.client.1.smithi191.stdout:6/910: write d2/de/d2a/d2d/d30/d98/d9b/d65/d89/fad [9945,47070] 0 2024-09-19T09:35:08.466 INFO:tasks.workunit.client.1.smithi191.stdout:9/994: write d3/db/de6/f147 [206005,66920] 0 2024-09-19T09:35:08.466 INFO:tasks.workunit.client.1.smithi191.stdout:6/911: link d2/de/f14 d2/de/d15/de8/f11e 0 2024-09-19T09:35:08.469 INFO:tasks.workunit.client.1.smithi191.stdout:9/995: link d3/db/d16/d17/d81/da6/lce d3/db/d53/dee/l151 0 2024-09-19T09:35:08.470 INFO:tasks.workunit.client.1.smithi191.stdout:5/948: write d0/d4/d9/d1d/d22/d5c/fc1 [574223,79418] 0 2024-09-19T09:35:08.470 INFO:tasks.workunit.client.1.smithi191.stdout:5/949: write d0/d4/d9/d1d/d22/fbc [11529,86824] 0 2024-09-19T09:35:08.470 INFO:tasks.workunit.client.1.smithi191.stdout:5/950: fdatasync d0/d4/d9/d1d/d22/d3b/f74 0 2024-09-19T09:35:08.470 INFO:tasks.workunit.client.1.smithi191.stdout:5/951: chown d0/d4/d88/cc4 7149801 1 2024-09-19T09:35:08.478 INFO:tasks.workunit.client.1.smithi191.stdout:2/984: dwrite d8/d11/d3f/d8a/d107/d129/d23/f138 [0,4194304] 0 2024-09-19T09:35:08.478 INFO:tasks.workunit.client.1.smithi191.stdout:2/985: dread - d8/d11/f149 zero size 2024-09-19T09:35:08.478 INFO:tasks.workunit.client.1.smithi191.stdout:2/986: truncate d8/d11/d3f/d8a/dda/fe9 258674 0 2024-09-19T09:35:08.478 INFO:tasks.workunit.client.1.smithi191.stdout:2/987: dread - d8/d11/f149 zero size 2024-09-19T09:35:08.478 INFO:tasks.workunit.client.1.smithi191.stdout:2/988: readlink d8/d11/d56/l142 0 2024-09-19T09:35:08.481 INFO:tasks.workunit.client.1.smithi191.stdout:6/912: dread d2/de/d19/f93 [0,4194304] 0 2024-09-19T09:35:08.483 INFO:tasks.workunit.client.1.smithi191.stdout:2/989: mknod d8/d11/d3f/d8a/d107/d129/d23/c14e 0 2024-09-19T09:35:08.483 INFO:tasks.workunit.client.1.smithi191.stdout:9/996: write d3/d60/d78/d102/d105/d13f/f5e [745979,125617] 0 2024-09-19T09:35:08.486 INFO:tasks.workunit.client.1.smithi191.stdout:5/952: dwrite d0/d4/d9/d1d/d22/d3b/db9/dfd/ffe [4194304,4194304] 0 2024-09-19T09:35:08.486 INFO:tasks.workunit.client.1.smithi191.stdout:2/990: link d8/d2a/fed d8/d11/f14f 0 2024-09-19T09:35:08.489 INFO:tasks.workunit.client.1.smithi191.stdout:5/953: unlink d0/d4/d9/f1e 0 2024-09-19T09:35:08.489 INFO:tasks.workunit.client.1.smithi191.stdout:9/997: dread d3/db/d16/d47/fd8 [0,4194304] 0 2024-09-19T09:35:08.489 INFO:tasks.workunit.client.1.smithi191.stdout:9/998: truncate d3/d8/f74 578366 0 2024-09-19T09:35:08.489 INFO:tasks.workunit.client.1.smithi191.stdout:5/954: write d0/d4/d9/d1d/d22/d3b/f134 [616168,48375] 0 2024-09-19T09:35:08.497 INFO:tasks.workunit.client.1.smithi191.stdout:9/999: dread d3/db/d53/f6f [0,4194304] 0 2024-09-19T09:35:08.504 INFO:tasks.workunit.client.1.smithi191.stdout:2/991: dwrite d8/db/d4e/fa3 [0,4194304] 0 2024-09-19T09:35:08.504 INFO:tasks.workunit.client.1.smithi191.stdout:2/992: fdatasync d8/db/f144 0 2024-09-19T09:35:08.504 INFO:tasks.workunit.client.1.smithi191.stdout:6/913: dwrite d2/de/df0/ffa [0,4194304] 0 2024-09-19T09:35:08.507 INFO:tasks.workunit.client.1.smithi191.stdout:2/993: unlink d8/d11/d3f/d8a/d8f/lc6 0 2024-09-19T09:35:08.517 INFO:tasks.workunit.client.1.smithi191.stdout:6/914: dread d2/de/d15/f78 [0,4194304] 0 2024-09-19T09:35:08.521 INFO:tasks.workunit.client.1.smithi191.stdout:1/971: sync 2024-09-19T09:35:08.522 INFO:tasks.workunit.client.1.smithi191.stdout:2/994: dwrite d8/d11/d3f/dfa/f13b [0,4194304] 0 2024-09-19T09:35:08.522 INFO:tasks.workunit.client.1.smithi191.stdout:5/955: dwrite d0/d4/d9/d1d/d22/d5c/fc1 [0,4194304] 0 2024-09-19T09:35:08.522 INFO:tasks.workunit.client.1.smithi191.stdout:5/956: chown d0/da7/dcd/d102/c10a 84023 1 2024-09-19T09:35:08.522 INFO:tasks.workunit.client.1.smithi191.stdout:5/957: dread - d0/d77/fb6 zero size 2024-09-19T09:35:08.525 INFO:tasks.workunit.client.1.smithi191.stdout:2/995: mknod d8/d2a/dba/c150 0 2024-09-19T09:35:08.525 INFO:tasks.workunit.client.1.smithi191.stdout:2/996: getdents d8/d11/d3f/d8a/d107/d129/d23/d145 0 2024-09-19T09:35:08.527 INFO:tasks.workunit.client.1.smithi191.stdout:5/958: unlink d0/d4/d9/d1d/d29/d33/d45/d97/l108 0 2024-09-19T09:35:08.528 INFO:tasks.workunit.client.1.smithi191.stdout:2/997: symlink d8/d11/d3f/d8a/d107/l151 0 2024-09-19T09:35:08.529 INFO:tasks.workunit.client.1.smithi191.stdout:2/998: write d8/d2a/dba/dcc/ff9 [38111,127261] 0 2024-09-19T09:35:08.529 INFO:tasks.workunit.client.1.smithi191.stdout:2/999: chown d8/d11/d3f/d8a/d107/d129 19 1 2024-09-19T09:35:08.530 INFO:tasks.workunit.client.1.smithi191.stdout:5/959: link d0/d4/d9/f9b d0/d4/d88/f14a 0 2024-09-19T09:35:08.533 INFO:tasks.workunit.client.1.smithi191.stdout:5/960: rmdir d0/d4/d9/d1d/d29/d33/d45/d64 39 2024-09-19T09:35:08.533 INFO:tasks.workunit.client.1.smithi191.stdout:5/961: fdatasync d0/d4/d9/d1d/d29/d33/d45/d64/fe5 0 2024-09-19T09:35:08.533 INFO:tasks.workunit.client.1.smithi191.stdout:5/962: dread - d0/d4/d9/d1d/d28/f139 zero size 2024-09-19T09:35:08.533 INFO:tasks.workunit.client.1.smithi191.stdout:1/972: dread d3/d14a/da/d1e/d32/f74 [0,4194304] 0 2024-09-19T09:35:08.534 INFO:tasks.workunit.client.1.smithi191.stdout:5/963: mknod d0/d4/d4a/daf/c14b 0 2024-09-19T09:35:08.534 INFO:tasks.workunit.client.1.smithi191.stdout:5/964: write d0/d4/d9/d1d/d29/d33/d45/fbb [694291,93811] 0 2024-09-19T09:35:08.534 INFO:tasks.workunit.client.1.smithi191.stdout:1/973: creat d3/d14a/da/d1e/d25/d70/ddd/f15f x:0 0 0 2024-09-19T09:35:08.535 INFO:tasks.workunit.client.1.smithi191.stdout:1/974: creat d3/d14a/d73/d94/dc9/f160 x:0 0 0 2024-09-19T09:35:08.536 INFO:tasks.workunit.client.1.smithi191.stdout:1/975: creat d3/d14a/da/db/d15b/db2/dd1/f161 x:0 0 0 2024-09-19T09:35:08.540 INFO:tasks.workunit.client.1.smithi191.stdout:1/976: write d3/d14a/fe [4147677,39650] 0 2024-09-19T09:35:08.541 INFO:tasks.workunit.client.1.smithi191.stdout:1/977: creat d3/d14a/da/d1e/d25/d70/da0/f162 x:0 0 0 2024-09-19T09:35:08.542 INFO:tasks.workunit.client.1.smithi191.stdout:5/965: dread d0/d4/d9/d1d/d29/d33/d45/d97/ddf/f122 [0,4194304] 0 2024-09-19T09:35:08.542 INFO:tasks.workunit.client.1.smithi191.stdout:1/978: unlink d3/d14a/da/d1e/d32/ddc/f114 0 2024-09-19T09:35:08.543 INFO:tasks.workunit.client.1.smithi191.stdout:5/966: unlink d0/d4/d4a/f106 0 2024-09-19T09:35:08.543 INFO:tasks.workunit.client.1.smithi191.stdout:5/967: write d0/d4/d9/fc2 [4601339,81751] 0 2024-09-19T09:35:08.543 INFO:tasks.workunit.client.1.smithi191.stdout:5/968: chown d0/d4/c87 402 1 2024-09-19T09:35:08.544 INFO:tasks.workunit.client.1.smithi191.stdout:1/979: mkdir d3/dbd/d163 0 2024-09-19T09:35:08.548 INFO:tasks.workunit.client.1.smithi191.stdout:1/980: rename d3/d14a/f78 to d3/dbd/f164 0 2024-09-19T09:35:08.549 INFO:tasks.workunit.client.1.smithi191.stdout:1/981: getdents d3/d14a/d73/d94 0 2024-09-19T09:35:08.551 INFO:tasks.workunit.client.1.smithi191.stdout:5/969: dread d0/d1f/f56 [0,4194304] 0 2024-09-19T09:35:08.552 INFO:tasks.workunit.client.1.smithi191.stdout:5/970: rmdir d0/d77 39 2024-09-19T09:35:08.552 INFO:tasks.workunit.client.1.smithi191.stdout:5/971: chown d0/d4/d9/d1d/d22/d3b/c8c 487098716 1 2024-09-19T09:35:08.553 INFO:tasks.workunit.client.1.smithi191.stdout:5/972: creat d0/d4/d9/d1d/d29/d33/f14c x:0 0 0 2024-09-19T09:35:08.553 INFO:tasks.workunit.client.1.smithi191.stdout:5/973: truncate d0/d4/d9/d1d/d29/d33/d45/d97/f127 492545 0 2024-09-19T09:35:08.553 INFO:tasks.workunit.client.1.smithi191.stdout:5/974: creat d0/d4/d9/d1d/d22/f14d x:0 0 0 2024-09-19T09:35:08.555 INFO:tasks.workunit.client.1.smithi191.stdout:5/975: write d0/d4/d9/d1d/d29/d33/d52/da4/fd1 [547587,91258] 0 2024-09-19T09:35:08.556 INFO:tasks.workunit.client.1.smithi191.stdout:5/976: rmdir d0/d4/d9/d1d/d22/d3b/db9/d105 39 2024-09-19T09:35:08.562 INFO:tasks.workunit.client.1.smithi191.stdout:6/915: dwrite d2/de/d19/d1e/fba [0,4194304] 0 2024-09-19T09:35:08.562 INFO:tasks.workunit.client.1.smithi191.stdout:6/916: creat d2/de/d2a/d2d/d30/d98/d9b/d65/f11f x:0 0 0 2024-09-19T09:35:08.562 INFO:tasks.workunit.client.1.smithi191.stdout:6/917: write d2/de/d19/d1e/fbf [739331,64080] 0 2024-09-19T09:35:08.563 INFO:tasks.workunit.client.1.smithi191.stdout:6/918: dread - d2/de/d2a/d2d/d30/d98/d9b/d65/fbd zero size 2024-09-19T09:35:08.563 INFO:tasks.workunit.client.1.smithi191.stdout:6/919: chown d2/de/d15/f78 163794498 1 2024-09-19T09:35:08.565 INFO:tasks.workunit.client.1.smithi191.stdout:1/982: dwrite d3/d14a/da/d1e/d32/d53/d57/def/f10d [0,4194304] 0 2024-09-19T09:35:08.565 INFO:tasks.workunit.client.1.smithi191.stdout:6/920: mkdir d2/de/d15/d92/d120 0 2024-09-19T09:35:08.569 INFO:tasks.workunit.client.1.smithi191.stdout:3/952: sync 2024-09-19T09:35:08.569 INFO:tasks.workunit.client.1.smithi191.stdout:7/979: sync 2024-09-19T09:35:08.571 INFO:tasks.workunit.client.1.smithi191.stdout:3/953: mkdir d12/d13/d1a/d1b/d2e/dab/d51/dcd/dd9/d140 0 2024-09-19T09:35:08.572 INFO:tasks.workunit.client.1.smithi191.stdout:3/954: symlink d12/d13/d1a/d5d/dd1/df0/l141 0 2024-09-19T09:35:08.573 INFO:tasks.workunit.client.1.smithi191.stdout:1/983: dread d3/d14a/da/f5f [0,4194304] 0 2024-09-19T09:35:08.573 INFO:tasks.workunit.client.1.smithi191.stdout:1/984: write d3/d14a/da/f102 [53412,28088] 0 2024-09-19T09:35:08.577 INFO:tasks.workunit.client.1.smithi191.stdout:1/985: symlink d3/d14a/da/d1e/d32/d53/d57/d6d/da1/da7/l165 0 2024-09-19T09:35:08.578 INFO:tasks.workunit.client.1.smithi191.stdout:1/986: creat d3/d14a/da/db/d48/f166 x:0 0 0 2024-09-19T09:35:08.599 INFO:tasks.workunit.client.1.smithi191.stdout:3/955: dwrite d12/d13/d1a/d1b/d2e/dab/da6/f106 [0,4194304] 0 2024-09-19T09:35:08.600 INFO:tasks.workunit.client.1.smithi191.stdout:7/980: dwrite d2/d5e/dfc/f14e [0,4194304] 0 2024-09-19T09:35:08.600 INFO:tasks.workunit.client.1.smithi191.stdout:7/981: fsync d2/d2a/d38/de5/d137/f141 0 2024-09-19T09:35:08.600 INFO:tasks.workunit.client.1.smithi191.stdout:3/956: chown d12/d13/d1a/d1b/d60/d7a/f92 1818399661 1 2024-09-19T09:35:08.600 INFO:tasks.workunit.client.1.smithi191.stdout:1/987: dwrite d3/d14a/d73/f159 [0,4194304] 0 2024-09-19T09:35:08.600 INFO:tasks.workunit.client.1.smithi191.stdout:3/957: write d12/d43/db2/fec [838580,37167] 0 2024-09-19T09:35:08.600 INFO:tasks.workunit.client.1.smithi191.stdout:3/958: stat d12/d13/d1a/d5d/dd1/de9/d101/f135 0 2024-09-19T09:35:08.601 INFO:tasks.workunit.client.1.smithi191.stdout:7/982: truncate d2/f28 1787824 0 2024-09-19T09:35:08.602 INFO:tasks.workunit.client.1.smithi191.stdout:3/959: mknod d12/d13/d1a/d5d/dd1/de9/c142 0 2024-09-19T09:35:08.602 INFO:tasks.workunit.client.1.smithi191.stdout:7/983: creat d2/d39/d3a/f156 x:0 0 0 2024-09-19T09:35:08.606 INFO:tasks.workunit.client.1.smithi191.stdout:1/988: write d3/d14a/da/d1e/d25/f98 [1153208,127752] 0 2024-09-19T09:35:08.606 INFO:tasks.workunit.client.1.smithi191.stdout:1/989: write d3/d14a/da/d1e/d25/d70/da0/f162 [309732,5283] 0 2024-09-19T09:35:08.607 INFO:tasks.workunit.client.1.smithi191.stdout:1/990: dread d3/d14a/da/d1e/d32/d53/d57/d121/d131/fcd [0,4194304] 0 2024-09-19T09:35:08.608 INFO:tasks.workunit.client.1.smithi191.stdout:1/991: rmdir d3/d14a/da/d1e/d25/d70 39 2024-09-19T09:35:08.608 INFO:tasks.workunit.client.1.smithi191.stdout:1/992: chown d3/d14a/da/db/d15b/c138 124 1 2024-09-19T09:35:08.609 INFO:tasks.workunit.client.1.smithi191.stdout:1/993: dread - d3/d14a/d73/d11b/f142 zero size 2024-09-19T09:35:08.624 INFO:tasks.workunit.client.1.smithi191.stdout:3/960: dwrite d12/d13/d1a/d1b/d3c/fcf [0,4194304] 0 2024-09-19T09:35:08.624 INFO:tasks.workunit.client.1.smithi191.stdout:3/961: chown d12/d43/l12a 380 1 2024-09-19T09:35:08.644 INFO:tasks.workunit.client.1.smithi191.stdout:7/984: dwrite d2/d2a/d33/f5d [0,4194304] 0 2024-09-19T09:35:08.644 INFO:tasks.workunit.client.1.smithi191.stdout:7/985: readlink d2/l10 0 2024-09-19T09:35:08.644 INFO:tasks.workunit.client.1.smithi191.stdout:7/986: truncate d2/d2a/d4f/d59/d81/f12e 615062 0 2024-09-19T09:35:08.644 INFO:tasks.workunit.client.1.smithi191.stdout:7/987: read - d2/d2a/d38/d63/d9a/dd5/fff zero size 2024-09-19T09:35:08.644 INFO:tasks.workunit.client.1.smithi191.stdout:3/962: dwrite d12/d13/d1a/d1b/d2e/fcc [0,4194304] 0 2024-09-19T09:35:08.644 INFO:tasks.workunit.client.1.smithi191.stdout:3/963: dread - d12/d13/d1a/d1b/d60/d7a/f120 zero size 2024-09-19T09:35:08.644 INFO:tasks.workunit.client.1.smithi191.stdout:1/994: dwrite d3/d14a/da/d42/f55 [0,4194304] 0 2024-09-19T09:35:08.654 INFO:tasks.workunit.client.1.smithi191.stdout:1/995: write d3/d14a/ff8 [2433199,122047] 0 2024-09-19T09:35:08.654 INFO:tasks.workunit.client.1.smithi191.stdout:1/996: creat d3/d14a/da/d1e/d25/d70/da0/f167 x:0 0 0 2024-09-19T09:35:08.656 INFO:tasks.workunit.client.1.smithi191.stdout:1/997: unlink d3/d14a/da/d1e/d25/d70/ddd/f15f 0 2024-09-19T09:35:08.657 INFO:tasks.workunit.client.1.smithi191.stdout:7/988: dwrite d2/d2a/d33/fe8 [0,4194304] 0 2024-09-19T09:35:08.657 INFO:tasks.workunit.client.1.smithi191.stdout:1/998: mkdir d3/d14a/d73/d132/d168 0 2024-09-19T09:35:08.658 INFO:tasks.workunit.client.1.smithi191.stdout:1/999: write d3/d14a/f5d [336886,100184] 0 2024-09-19T09:35:08.661 INFO:tasks.workunit.client.1.smithi191.stdout:7/989: symlink d2/d2a/d38/de5/d105/l157 0 2024-09-19T09:35:08.661 INFO:tasks.workunit.client.1.smithi191.stdout:7/990: chown d2/d2a/d38/d63/f97 437 1 2024-09-19T09:35:08.661 INFO:tasks.workunit.client.1.smithi191.stdout:5/977: sync 2024-09-19T09:35:08.661 INFO:tasks.workunit.client.1.smithi191.stdout:5/978: stat d0/d4/d9/fc2 0 2024-09-19T09:35:08.662 INFO:tasks.workunit.client.1.smithi191.stdout:7/991: dread d2/d39/ff0 [0,4194304] 0 2024-09-19T09:35:08.664 INFO:tasks.workunit.client.1.smithi191.stdout:6/921: sync 2024-09-19T09:35:08.665 INFO:tasks.workunit.client.1.smithi191.stdout:5/979: rmdir d0/d4/d9/d1d/d29 39 2024-09-19T09:35:08.666 INFO:tasks.workunit.client.1.smithi191.stdout:7/992: truncate d2/f17 350527 0 2024-09-19T09:35:08.666 INFO:tasks.workunit.client.1.smithi191.stdout:7/993: chown d2/d2a/d4f/d78 22276126 1 2024-09-19T09:35:08.667 INFO:tasks.workunit.client.1.smithi191.stdout:5/980: mkdir d0/da7/dcd/d14e 0 2024-09-19T09:35:08.669 INFO:tasks.workunit.client.1.smithi191.stdout:5/981: mkdir d0/d4/dae/dbd/d142/d14f 0 2024-09-19T09:35:08.670 INFO:tasks.workunit.client.1.smithi191.stdout:5/982: symlink d0/d4/d9/d1d/d29/d33/d52/l150 0 2024-09-19T09:35:08.671 INFO:tasks.workunit.client.1.smithi191.stdout:5/983: rmdir d0/d4/d9/d1d/d22/d3b/db9 39 2024-09-19T09:35:08.678 INFO:tasks.workunit.client.1.smithi191.stdout:6/922: dwrite d2/de/d2a/d2d/d30/d98/d9b/f108 [0,4194304] 0 2024-09-19T09:35:08.678 INFO:tasks.workunit.client.1.smithi191.stdout:6/923: write d2/de/d15/f36 [5342969,83049] 0 2024-09-19T09:35:08.679 INFO:tasks.workunit.client.1.smithi191.stdout:6/924: dread d2/de/d19/d1e/d64/d77/ff6 [0,4194304] 0 2024-09-19T09:35:08.681 INFO:tasks.workunit.client.1.smithi191.stdout:6/925: creat d2/de/d2a/f121 x:0 0 0 2024-09-19T09:35:08.682 INFO:tasks.workunit.client.1.smithi191.stdout:6/926: mkdir d2/d104/db5/d122 0 2024-09-19T09:35:08.690 INFO:tasks.workunit.client.1.smithi191.stdout:5/984: dwrite d0/d1f/f56 [0,4194304] 0 2024-09-19T09:35:08.696 INFO:tasks.workunit.client.1.smithi191.stdout:6/927: dread d2/de/d2a/d2d/f99 [0,4194304] 0 2024-09-19T09:35:08.705 INFO:tasks.workunit.client.1.smithi191.stdout:6/928: dread d2/f34 [0,4194304] 0 2024-09-19T09:35:08.705 INFO:tasks.workunit.client.1.smithi191.stdout:6/929: creat d2/de/d19/d1e/d64/d61/d81/da7/f123 x:0 0 0 2024-09-19T09:35:08.706 INFO:tasks.workunit.client.1.smithi191.stdout:6/930: symlink d2/de/d19/d1e/d64/d61/d81/l124 0 2024-09-19T09:35:08.706 INFO:tasks.workunit.client.1.smithi191.stdout:5/985: dwrite d0/d4/d9/d1d/d22/f6d [4194304,4194304] 0 2024-09-19T09:35:08.707 INFO:tasks.workunit.client.1.smithi191.stdout:5/986: readlink d0/d4/d9/d1d/d29/d33/d45/laa 0 2024-09-19T09:35:08.707 INFO:tasks.workunit.client.1.smithi191.stdout:5/987: mknod d0/d4/d4a/c151 0 2024-09-19T09:35:08.707 INFO:tasks.workunit.client.1.smithi191.stdout:5/988: fdatasync d0/d4/d9/d1d/d29/d33/d52/fbe 0 2024-09-19T09:35:08.708 INFO:tasks.workunit.client.1.smithi191.stdout:5/989: getdents d0/d4/d9/d1d/d22/d3b/db9 0 2024-09-19T09:35:08.710 INFO:tasks.workunit.client.1.smithi191.stdout:5/990: dread d0/d4/d9/d1d/d29/d33/d45/fbb [0,4194304] 0 2024-09-19T09:35:08.710 INFO:tasks.workunit.client.1.smithi191.stdout:5/991: readlink d0/d4/dae/l124 0 2024-09-19T09:35:08.712 INFO:tasks.workunit.client.1.smithi191.stdout:5/992: getdents d0/d4/d4a 0 2024-09-19T09:35:08.712 INFO:tasks.workunit.client.1.smithi191.stdout:5/993: fsync d0/d4/d9/d1d/d22/d5c/fe2 0 2024-09-19T09:35:08.713 INFO:tasks.workunit.client.1.smithi191.stdout:5/994: mkdir d0/d4/dae/d152 0 2024-09-19T09:35:08.713 INFO:tasks.workunit.client.1.smithi191.stdout:5/995: stat d0/d4/d4a/f98 0 2024-09-19T09:35:08.713 INFO:tasks.workunit.client.1.smithi191.stdout:3/964: sync 2024-09-19T09:35:08.713 INFO:tasks.workunit.client.1.smithi191.stdout:3/965: mkdir d12/d107/da0/d143 0 2024-09-19T09:35:08.715 INFO:tasks.workunit.client.1.smithi191.stdout:3/966: unlink d12/d13/d1a/d1b/d2e/dab/da6/f106 0 2024-09-19T09:35:08.715 INFO:tasks.workunit.client.1.smithi191.stdout:3/967: write d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/fb3 [473750,21573] 0 2024-09-19T09:35:08.715 INFO:tasks.workunit.client.1.smithi191.stdout:6/931: dread d2/de/f16 [0,4194304] 0 2024-09-19T09:35:08.716 INFO:tasks.workunit.client.1.smithi191.stdout:6/932: creat d2/de/d2a/d2d/d30/d98/de2/df1/f125 x:0 0 0 2024-09-19T09:35:08.716 INFO:tasks.workunit.client.1.smithi191.stdout:6/933: write d2/de/d2a/d2d/d30/d98/d9b/d65/d89/fd0 [807524,117353] 0 2024-09-19T09:35:08.716 INFO:tasks.workunit.client.1.smithi191.stdout:6/934: mknod d2/de/d19/d1e/d64/d61/d81/da7/dde/c126 0 2024-09-19T09:35:08.722 INFO:tasks.workunit.client.1.smithi191.stdout:5/996: dread d0/d4/d9/d1d/d22/d5c/fc1 [0,4194304] 0 2024-09-19T09:35:08.723 INFO:tasks.workunit.client.1.smithi191.stdout:5/997: rmdir d0/d4/d9/d1d/d22/d3b/db9/dfd 39 2024-09-19T09:35:08.723 INFO:tasks.workunit.client.1.smithi191.stdout:3/968: write d12/d43/db2/fca [340347,100840] 0 2024-09-19T09:35:08.724 INFO:tasks.workunit.client.1.smithi191.stdout:5/998: truncate d0/d4/d9/d1d/d22/d3b/f74 1230660 0 2024-09-19T09:35:08.724 INFO:tasks.workunit.client.1.smithi191.stdout:5/999: rename d0/d4 to d0/d4/d9/d1d/d22/d3b/db9/dfd/d146/d153 22 2024-09-19T09:35:08.730 INFO:tasks.workunit.client.1.smithi191.stdout:6/935: dwrite d2/de/d19/d1e/d64/d77/ff6 [0,4194304] 0 2024-09-19T09:35:08.735 INFO:tasks.workunit.client.1.smithi191.stdout:3/969: dread d12/d13/d1a/d1b/d3c/d3f/f4d [0,4194304] 0 2024-09-19T09:35:08.737 INFO:tasks.workunit.client.1.smithi191.stdout:6/936: link d2/de/f16 d2/f127 0 2024-09-19T09:35:08.738 INFO:tasks.workunit.client.1.smithi191.stdout:7/994: sync 2024-09-19T09:35:08.738 INFO:tasks.workunit.client.1.smithi191.stdout:7/995: write d2/d39/d3a/fb6 [5182223,12066] 0 2024-09-19T09:35:08.739 INFO:tasks.workunit.client.1.smithi191.stdout:3/970: symlink d12/d13/d1a/d5d/dd1/de9/l144 0 2024-09-19T09:35:08.741 INFO:tasks.workunit.client.1.smithi191.stdout:7/996: unlink d2/d2a/d38/d63/d9a/dd5/d125/f142 0 2024-09-19T09:35:08.743 INFO:tasks.workunit.client.1.smithi191.stdout:3/971: creat d12/d13/d1a/d1b/d3c/d71/f145 x:0 0 0 2024-09-19T09:35:08.744 INFO:tasks.workunit.client.1.smithi191.stdout:7/997: rename d2/d2a/d4f/l129 to d2/d2a/d33/l158 0 2024-09-19T09:35:08.744 INFO:tasks.workunit.client.1.smithi191.stdout:7/998: chown d2/d39/d3a/d3c/fdb 10529 1 2024-09-19T09:35:08.746 INFO:tasks.workunit.client.1.smithi191.stdout:3/972: unlink d12/d13/d1a/df7/f119 0 2024-09-19T09:35:08.746 INFO:tasks.workunit.client.1.smithi191.stdout:3/973: creat d12/d13/d1a/d5d/dd1/df0/f146 x:0 0 0 2024-09-19T09:35:08.752 INFO:tasks.workunit.client.1.smithi191.stdout:6/937: dwrite d2/de/d2a/d2d/fa9 [0,4194304] 0 2024-09-19T09:35:08.756 INFO:tasks.workunit.client.1.smithi191.stdout:6/938: dread d2/de/d19/d1e/d64/d77/d82/fc5 [0,4194304] 0 2024-09-19T09:35:08.758 INFO:tasks.workunit.client.1.smithi191.stdout:7/999: truncate d2/d39/d3a/fb6 4487149 0 2024-09-19T09:35:08.766 INFO:tasks.workunit.client.1.smithi191.stdout:3/974: dwrite d12/d13/d1a/d1b/d3c/d71/d112/d73/f7d [0,4194304] 0 2024-09-19T09:35:08.771 INFO:tasks.workunit.client.1.smithi191.stdout:6/939: write d2/de/f22 [2555732,46426] 0 2024-09-19T09:35:08.771 INFO:tasks.workunit.client.1.smithi191.stdout:6/940: write d2/de/d2a/d7d/f6b [2910644,104434] 0 2024-09-19T09:35:08.775 INFO:tasks.workunit.client.1.smithi191.stdout:3/975: dread d12/d13/d1a/d1b/d3c/d71/d112/d73/f79 [4194304,4194304] 0 2024-09-19T09:35:08.775 INFO:tasks.workunit.client.1.smithi191.stdout:3/976: fdatasync d12/d13/d1a/d1b/d2e/f53 0 2024-09-19T09:35:08.778 INFO:tasks.workunit.client.1.smithi191.stdout:3/977: dread d12/d13/d1a/d1b/d60/d7a/d93/f94 [0,4194304] 0 2024-09-19T09:35:08.779 INFO:tasks.workunit.client.1.smithi191.stdout:3/978: creat d12/d43/db2/f147 x:0 0 0 2024-09-19T09:35:08.779 INFO:tasks.workunit.client.1.smithi191.stdout:3/979: write d12/d13/d1a/d1b/d3c/d3f/f83 [1566019,51363] 0 2024-09-19T09:35:08.791 INFO:tasks.workunit.client.1.smithi191.stdout:6/941: dwrite d2/f127 [0,4194304] 0 2024-09-19T09:35:08.793 INFO:tasks.workunit.client.1.smithi191.stdout:3/980: dwrite d12/d13/d1a/d5d/dd1/df0/f6a [0,4194304] 0 2024-09-19T09:35:08.795 INFO:tasks.workunit.client.1.smithi191.stdout:3/981: mkdir d12/d13/d1a/d1b/d60/d7a/d93/d148 0 2024-09-19T09:35:08.795 INFO:tasks.workunit.client.1.smithi191.stdout:3/982: stat d12/d13/d1a/d1b/d3c/d71/d112/d73/c131 0 2024-09-19T09:35:08.801 INFO:tasks.workunit.client.1.smithi191.stdout:6/942: dread d2/de/f22 [0,4194304] 0 2024-09-19T09:35:08.802 INFO:tasks.workunit.client.1.smithi191.stdout:6/943: mkdir d2/de/d19/d1e/d64/df2/d128 0 2024-09-19T09:35:08.808 INFO:tasks.workunit.client.1.smithi191.stdout:3/983: dwrite d12/d43/f52 [4194304,4194304] 0 2024-09-19T09:35:08.809 INFO:tasks.workunit.client.1.smithi191.stdout:3/984: creat d12/d13/d1a/d5d/f149 x:0 0 0 2024-09-19T09:35:08.817 INFO:tasks.workunit.client.1.smithi191.stdout:6/944: dwrite d2/de/d2a/d2d/d30/fe7 [0,4194304] 0 2024-09-19T09:35:08.822 INFO:tasks.workunit.client.1.smithi191.stdout:3/985: dread d12/d13/d1a/d1b/d60/d7a/d93/fe2 [0,4194304] 0 2024-09-19T09:35:08.826 INFO:tasks.workunit.client.1.smithi191.stdout:6/945: write d2/de/d2a/d2d/d30/d98/d9b/f108 [1343214,10971] 0 2024-09-19T09:35:08.826 INFO:tasks.workunit.client.1.smithi191.stdout:6/946: truncate d2/de/d2a/d2d/d30/f3f 9113574 0 2024-09-19T09:35:08.828 INFO:tasks.workunit.client.1.smithi191.stdout:6/947: creat d2/d104/db5/d122/f129 x:0 0 0 2024-09-19T09:35:08.828 INFO:tasks.workunit.client.1.smithi191.stdout:6/948: truncate d2/de/d2a/d2d/d30/d98/d9b/d65/fbd 334076 0 2024-09-19T09:35:08.828 INFO:tasks.workunit.client.1.smithi191.stdout:6/949: fsync d2/de/f16 0 2024-09-19T09:35:08.829 INFO:tasks.workunit.client.1.smithi191.stdout:6/950: fsync d2/de/d2a/d2d/d30/d98/d9b/d65/fbd 0 2024-09-19T09:35:08.847 INFO:tasks.workunit.client.1.smithi191.stdout:3/986: dwrite d12/d13/d1a/d1b/d3c/f4f [0,4194304] 0 2024-09-19T09:35:08.847 INFO:tasks.workunit.client.1.smithi191.stdout:6/951: dwrite d2/de/d19/d1e/d64/d77/ff6 [0,4194304] 0 2024-09-19T09:35:08.849 INFO:tasks.workunit.client.1.smithi191.stdout:6/952: symlink d2/de/d19/d1e/d64/d61/l12a 0 2024-09-19T09:35:08.849 INFO:tasks.workunit.client.1.smithi191.stdout:6/953: creat d2/de/d19/d1e/d64/d61/f12b x:0 0 0 2024-09-19T09:35:08.850 INFO:tasks.workunit.client.1.smithi191.stdout:6/954: unlink d2/de/d19/d1e/d64/d61/d81/da7/db8/cc8 0 2024-09-19T09:35:08.851 INFO:tasks.workunit.client.1.smithi191.stdout:6/955: fsync d2/d104/fc1 0 2024-09-19T09:35:08.851 INFO:tasks.workunit.client.1.smithi191.stdout:3/987: rename d12/d43/db2 to d12/d13/d1a/d1b/d2e/d14a 0 2024-09-19T09:35:08.852 INFO:tasks.workunit.client.1.smithi191.stdout:6/956: mknod d2/de/df0/c12c 0 2024-09-19T09:35:08.852 INFO:tasks.workunit.client.1.smithi191.stdout:6/957: truncate d2/de/d19/d1e/d64/d77/d82/dca/f86 1590886 0 2024-09-19T09:35:08.853 INFO:tasks.workunit.client.1.smithi191.stdout:3/988: getdents d12/d13/d1a/d5d/dd1/df0 0 2024-09-19T09:35:08.853 INFO:tasks.workunit.client.1.smithi191.stdout:3/989: dread - d12/d13/d1a/d1b/d3c/d71/d112/d73/fbb zero size 2024-09-19T09:35:08.871 INFO:tasks.workunit.client.1.smithi191.stdout:3/990: dwrite d12/d13/d1a/d1b/d60/f9e [0,4194304] 0 2024-09-19T09:35:08.871 INFO:tasks.workunit.client.1.smithi191.stdout:3/991: dread - d12/d13/d1a/d5d/dd1/df0/d91/f12f zero size 2024-09-19T09:35:08.872 INFO:tasks.workunit.client.1.smithi191.stdout:3/992: creat d12/d43/d61/d12b/f14b x:0 0 0 2024-09-19T09:35:08.874 INFO:tasks.workunit.client.1.smithi191.stdout:3/993: link d12/d13/d1a/d5d/f149 d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/f14c 0 2024-09-19T09:35:08.874 INFO:tasks.workunit.client.1.smithi191.stdout:3/994: readlink d12/d13/d1a/d1b/d2e/dab/d51/d62/d86/l111 0 2024-09-19T09:35:08.874 INFO:tasks.workunit.client.1.smithi191.stdout:3/995: truncate d12/d13/d1a/d1b/d60/f13e 706826 0 2024-09-19T09:35:08.875 INFO:tasks.workunit.client.1.smithi191.stdout:3/996: rmdir d12/d13/d1a/d1b/d2e/dab/d51/dcd/dd9/d140 0 2024-09-19T09:35:08.876 INFO:tasks.workunit.client.1.smithi191.stdout:3/997: symlink d12/d107/l14d 0 2024-09-19T09:35:08.877 INFO:tasks.workunit.client.1.smithi191.stdout:3/998: creat d12/d13/d1a/d1b/d3c/dd8/ded/f14e x:0 0 0 2024-09-19T09:35:08.877 INFO:tasks.workunit.client.1.smithi191.stdout:3/999: chown d12/d13/d1a/d1b/d3c/d71/d112/d73/f79 306113359 1 2024-09-19T09:35:08.922 INFO:tasks.workunit.client.1.smithi191.stdout:6/958: sync 2024-09-19T09:35:08.929 INFO:tasks.workunit.client.1.smithi191.stdout:6/959: dread d2/de/d19/d1e/d64/d77/ff6 [0,4194304] 0 2024-09-19T09:35:08.929 INFO:tasks.workunit.client.1.smithi191.stdout:6/960: creat d2/de/d2a/d2d/d30/d98/d9b/d65/f12d x:0 0 0 2024-09-19T09:35:08.929 INFO:tasks.workunit.client.1.smithi191.stdout:6/961: readlink d2/de/d19/d1e/d64/d77/lcd 0 2024-09-19T09:35:08.929 INFO:tasks.workunit.client.1.smithi191.stdout:6/962: fsync d2/de/d2a/d2d/d30/d98/d9b/fb7 0 2024-09-19T09:35:08.943 INFO:tasks.workunit.client.1.smithi191.stdout:6/963: dwrite d2/fff [0,4194304] 0 2024-09-19T09:35:08.946 INFO:tasks.workunit.client.1.smithi191.stdout:6/964: symlink d2/de/d2a/d7d/l12e 0 2024-09-19T09:35:08.949 INFO:tasks.workunit.client.1.smithi191.stdout:6/965: rename d2/de/d19/d1e/d64/f97 to d2/de/d19/d1e/d64/d61/d81/da7/db8/ddb/f12f 0 2024-09-19T09:35:08.951 INFO:tasks.workunit.client.1.smithi191.stdout:6/966: unlink d2/de/d15/l50 0 2024-09-19T09:35:08.953 INFO:tasks.workunit.client.1.smithi191.stdout:6/967: truncate d2/fa 3210330 0 2024-09-19T09:35:08.953 INFO:tasks.workunit.client.1.smithi191.stdout:6/968: chown d2/de/d19/d1e/d64/c33 7606132 1 2024-09-19T09:35:08.956 INFO:tasks.workunit.client.1.smithi191.stdout:6/969: mknod d2/de/d15/d92/c130 0 2024-09-19T09:35:08.956 INFO:tasks.workunit.client.1.smithi191.stdout:6/970: chown d2/de/d2a/d39 40574006 1 2024-09-19T09:35:08.956 INFO:tasks.workunit.client.1.smithi191.stdout:6/971: fsync d2/de/d2a/d2d/fee 0 2024-09-19T09:35:08.957 INFO:tasks.workunit.client.1.smithi191.stdout:6/972: mknod d2/de/d19/d1e/d64/d77/d82/dca/c131 0 2024-09-19T09:35:08.957 INFO:tasks.workunit.client.1.smithi191.stdout:6/973: stat d2/de/d2a/d7d/d10f 0 2024-09-19T09:35:08.960 INFO:tasks.workunit.client.1.smithi191.stdout:6/974: rename d2/de/d2a/d2d/d30/da4/lda to d2/de/d2a/d7d/d10f/l132 0 2024-09-19T09:35:08.960 INFO:tasks.workunit.client.1.smithi191.stdout:6/975: creat d2/f133 x:0 0 0 2024-09-19T09:35:08.960 INFO:tasks.workunit.client.1.smithi191.stdout:6/976: stat d2/de/d2a/d2d/f1b 0 2024-09-19T09:35:08.963 INFO:tasks.workunit.client.1.smithi191.stdout:6/977: rename d2/de/d19/d1e/d64/d77/d82/fc5 to d2/de/d2a/d2d/d30/da4/f134 0 2024-09-19T09:35:08.965 INFO:tasks.workunit.client.1.smithi191.stdout:6/978: rename d2/de/d19/d1e/fbf to d2/de/d19/d1e/d64/d61/d81/da7/f135 0 2024-09-19T09:35:08.965 INFO:tasks.workunit.client.1.smithi191.stdout:6/979: truncate d2/de/d2a/d2d/d30/d98/de2/f11d 1035500 0 2024-09-19T09:35:08.982 INFO:tasks.workunit.client.1.smithi191.stdout:6/980: rename d2/de/d2a/d7d/d10f/l132 to d2/de/d15/de8/l136 0 2024-09-19T09:35:08.984 INFO:tasks.workunit.client.1.smithi191.stdout:6/981: creat d2/d104/db5/f137 x:0 0 0 2024-09-19T09:35:08.984 INFO:tasks.workunit.client.1.smithi191.stdout:6/982: creat d2/de/d2a/d2d/f138 x:0 0 0 2024-09-19T09:35:08.988 INFO:tasks.workunit.client.1.smithi191.stdout:6/983: rename d2/de/d2a/d2d/d30/d98/d9b/f9a to d2/de/d15/f139 0 2024-09-19T09:35:08.988 INFO:tasks.workunit.client.1.smithi191.stdout:6/984: write d2/de/d2a/f121 [665107,8459] 0 2024-09-19T09:35:08.990 INFO:tasks.workunit.client.1.smithi191.stdout:6/985: mkdir d2/de/d2a/d39/d13a 0 2024-09-19T09:35:08.990 INFO:tasks.workunit.client.1.smithi191.stdout:6/986: readlink d2/de/d2a/d2d/d30/l87 0 2024-09-19T09:35:08.991 INFO:tasks.workunit.client.1.smithi191.stdout:6/987: mknod d2/de/d19/d5d/c13b 0 2024-09-19T09:35:08.998 INFO:tasks.workunit.client.1.smithi191.stdout:6/988: dread d2/de/d15/f139 [0,4194304] 0 2024-09-19T09:35:08.998 INFO:tasks.workunit.client.1.smithi191.stdout:6/989: fsync d2/de/d2a/d2d/d30/da4/faa 0 2024-09-19T09:35:09.004 INFO:tasks.workunit.client.1.smithi191.stdout:6/990: write d2/de/d2a/d2d/dc7/fe3 [1143156,123284] 0 2024-09-19T09:35:09.007 INFO:tasks.workunit.client.1.smithi191.stdout:6/991: mkdir d2/de/d2a/d2d/d13c 0 2024-09-19T09:35:09.007 INFO:tasks.workunit.client.1.smithi191.stdout:6/992: chown d2/d104/d118/l119 11279696 1 2024-09-19T09:35:09.009 INFO:tasks.workunit.client.1.smithi191.stdout:6/993: mknod d2/de/df0/c13d 0 2024-09-19T09:35:09.009 INFO:tasks.workunit.client.1.smithi191.stdout:6/994: creat d2/de/d2a/f13e x:0 0 0 2024-09-19T09:35:09.017 INFO:tasks.workunit.client.1.smithi191.stdout:6/995: dread d2/de/d2a/d7d/f6b [4194304,4194304] 0 2024-09-19T09:35:09.017 INFO:tasks.workunit.client.1.smithi191.stdout:6/996: write d2/de/d19/d5d/fb2 [4863035,5159] 0 2024-09-19T09:35:09.017 INFO:tasks.workunit.client.1.smithi191.stdout:6/997: write d2/de/d19/d1e/f3e [8269257,62212] 0 2024-09-19T09:35:09.017 INFO:tasks.workunit.client.1.smithi191.stdout:6/998: creat d2/de/d2a/d2d/d30/da4/f13f x:0 0 0 2024-09-19T09:35:09.020 INFO:tasks.workunit.client.1.smithi191.stdout:6/999: mkdir d2/de/d19/d1e/d64/d61/d81/d140 0 2024-09-19T09:35:09.023 INFO:tasks.workunit.client.1.smithi191.stderr:+ rm -rf -- ./tmp.vDzb4eMtOX 2024-09-19T09:35:09.858 INFO:tasks.workunit.client.0.smithi112.stdout:2/14: sync 2024-09-19T09:35:09.858 INFO:tasks.workunit.client.0.smithi112.stdout:7/6: sync 2024-09-19T09:35:09.858 INFO:tasks.workunit.client.0.smithi112.stdout:7/7: dread - no filename 2024-09-19T09:35:09.858 INFO:tasks.workunit.client.0.smithi112.stdout:5/4: sync 2024-09-19T09:35:09.858 INFO:tasks.workunit.client.0.smithi112.stdout:5/5: truncate - no filename 2024-09-19T09:35:09.858 INFO:tasks.workunit.client.0.smithi112.stdout:0/46: sync 2024-09-19T09:35:09.858 INFO:tasks.workunit.client.0.smithi112.stdout:2/15: fdatasync d0/f5 0 2024-09-19T09:35:09.858 INFO:tasks.workunit.client.0.smithi112.stdout:0/47: chown c0 6163 1 2024-09-19T09:35:09.858 INFO:tasks.workunit.client.0.smithi112.stdout:9/3: sync 2024-09-19T09:35:09.859 INFO:tasks.workunit.client.0.smithi112.stdout:1/16: sync 2024-09-19T09:35:09.859 INFO:tasks.workunit.client.0.smithi112.stdout:8/57: sync 2024-09-19T09:35:09.859 INFO:tasks.workunit.client.0.smithi112.stdout:4/163: sync 2024-09-19T09:35:09.859 INFO:tasks.workunit.client.0.smithi112.stdout:6/42: sync 2024-09-19T09:35:09.859 INFO:tasks.workunit.client.0.smithi112.stdout:3/16: sync 2024-09-19T09:35:09.861 INFO:tasks.workunit.client.0.smithi112.stdout:7/8: mkdir d2 0 2024-09-19T09:35:09.861 INFO:tasks.workunit.client.0.smithi112.stdout:7/9: dread - no filename 2024-09-19T09:35:09.863 INFO:tasks.workunit.client.0.smithi112.stdout:5/6: unlink c3 0 2024-09-19T09:35:09.863 INFO:tasks.workunit.client.0.smithi112.stdout:5/7: dread - no filename 2024-09-19T09:35:09.867 INFO:tasks.workunit.client.0.smithi112.stdout:2/16: mkdir d0/d6 0 2024-09-19T09:35:09.867 INFO:tasks.workunit.client.0.smithi112.stdout:9/4: mknod c2 0 2024-09-19T09:35:09.867 INFO:tasks.workunit.client.0.smithi112.stdout:9/5: chown f0 398691 1 2024-09-19T09:35:09.867 INFO:tasks.workunit.client.0.smithi112.stdout:9/6: dread - f0 zero size 2024-09-19T09:35:09.871 INFO:tasks.workunit.client.0.smithi112.stdout:0/48: read d2/f4 [463047,28560] 0 2024-09-19T09:35:09.871 INFO:tasks.workunit.client.0.smithi112.stdout:0/49: dread - d2/f7 zero size 2024-09-19T09:35:09.871 INFO:tasks.workunit.client.0.smithi112.stdout:0/50: creat d2/f10 x:0 0 0 2024-09-19T09:35:09.874 INFO:tasks.workunit.client.0.smithi112.stdout:8/58: mkdir d7/d13 0 2024-09-19T09:35:09.875 INFO:tasks.workunit.client.0.smithi112.stdout:3/17: symlink l3 0 2024-09-19T09:35:09.875 INFO:tasks.workunit.client.0.smithi112.stdout:3/18: stat l3 0 2024-09-19T09:35:09.875 INFO:tasks.workunit.client.0.smithi112.stdout:7/10: link l1 d2/l3 0 2024-09-19T09:35:09.875 INFO:tasks.workunit.client.0.smithi112.stdout:7/11: chown d2 1 1 2024-09-19T09:35:09.875 INFO:tasks.workunit.client.0.smithi112.stdout:5/8: mkdir d4 0 2024-09-19T09:35:09.876 INFO:tasks.workunit.client.0.smithi112.stdout:9/7: creat f3 x:0 0 0 2024-09-19T09:35:09.876 INFO:tasks.workunit.client.0.smithi112.stdout:6/43: dwrite f5 [0,4194304] 0 2024-09-19T09:35:09.879 INFO:tasks.workunit.client.0.smithi112.stdout:0/51: mkdir d2/d11 0 2024-09-19T09:35:09.880 INFO:tasks.workunit.client.0.smithi112.stdout:4/164: getdents d1/d4/d3a/d18/d37 0 2024-09-19T09:35:09.884 INFO:tasks.workunit.client.0.smithi112.stdout:3/19: symlink l4 0 2024-09-19T09:35:09.884 INFO:tasks.workunit.client.0.smithi112.stdout:3/20: fsync - no filename 2024-09-19T09:35:09.885 INFO:tasks.workunit.client.0.smithi112.stdout:3/21: dread - no filename 2024-09-19T09:35:09.885 INFO:tasks.workunit.client.0.smithi112.stdout:0/52: dread d2/f4 [0,4194304] 0 2024-09-19T09:35:09.885 INFO:tasks.workunit.client.0.smithi112.stdout:0/53: creat d2/f12 x:0 0 0 2024-09-19T09:35:09.885 INFO:tasks.workunit.client.0.smithi112.stdout:0/54: chown d2/l6 151 1 2024-09-19T09:35:09.885 INFO:tasks.workunit.client.0.smithi112.stdout:4/165: dread d1/d4/d1a/f27 [0,4194304] 0 2024-09-19T09:35:09.887 INFO:tasks.workunit.client.0.smithi112.stdout:8/59: mknod d7/d10/d11/c14 0 2024-09-19T09:35:09.887 INFO:tasks.workunit.client.0.smithi112.stdout:5/9: creat d4/f5 x:0 0 0 2024-09-19T09:35:09.888 INFO:tasks.workunit.client.0.smithi112.stdout:6/44: mknod d8/cc 0 2024-09-19T09:35:09.889 INFO:tasks.workunit.client.0.smithi112.stdout:6/45: readlink l7 0 2024-09-19T09:35:09.890 INFO:tasks.workunit.client.0.smithi112.stdout:3/22: link c1 c5 0 2024-09-19T09:35:09.890 INFO:tasks.workunit.client.0.smithi112.stdout:3/23: chown c2 35054693 1 2024-09-19T09:35:09.892 INFO:tasks.workunit.client.0.smithi112.stdout:4/166: creat d1/d3d/f3f x:0 0 0 2024-09-19T09:35:09.895 INFO:tasks.workunit.client.0.smithi112.stdout:5/10: link d4/f5 d4/f6 0 2024-09-19T09:35:09.896 INFO:tasks.workunit.client.0.smithi112.stdout:6/46: readlink l4 0 2024-09-19T09:35:09.899 INFO:tasks.workunit.client.0.smithi112.stdout:2/17: dwrite d0/f5 [0,4194304] 0 2024-09-19T09:35:09.900 INFO:tasks.workunit.client.0.smithi112.stdout:2/18: fsync d0/f5 0 2024-09-19T09:35:09.902 INFO:tasks.workunit.client.0.smithi112.stdout:3/24: creat f6 x:0 0 0 2024-09-19T09:35:09.902 INFO:tasks.workunit.client.0.smithi112.stdout:3/25: creat f7 x:0 0 0 2024-09-19T09:35:09.903 INFO:tasks.workunit.client.0.smithi112.stdout:0/55: dwrite d2/f4 [0,4194304] 0 2024-09-19T09:35:09.904 INFO:tasks.workunit.client.0.smithi112.stdout:4/167: rename d1/fe to d1/d3d/f40 0 2024-09-19T09:35:09.909 INFO:tasks.workunit.client.0.smithi112.stdout:4/168: dread d1/f6 [0,4194304] 0 2024-09-19T09:35:09.910 INFO:tasks.workunit.client.0.smithi112.stdout:4/169: stat d1/d3d/f40 0 2024-09-19T09:35:09.911 INFO:tasks.workunit.client.0.smithi112.stdout:2/19: creat d0/d1/f7 x:0 0 0 2024-09-19T09:35:09.911 INFO:tasks.workunit.client.0.smithi112.stdout:2/20: chown d0/d1/l3 305 1 2024-09-19T09:35:09.911 INFO:tasks.workunit.client.0.smithi112.stdout:2/21: dread - d0/d1/f7 zero size 2024-09-19T09:35:09.912 INFO:tasks.workunit.client.0.smithi112.stdout:3/26: mkdir d8 0 2024-09-19T09:35:09.914 INFO:tasks.workunit.client.0.smithi112.stdout:0/56: creat d2/d11/f13 x:0 0 0 2024-09-19T09:35:09.915 INFO:tasks.workunit.client.0.smithi112.stdout:0/57: fsync d2/fe 0 2024-09-19T09:35:09.918 INFO:tasks.workunit.client.0.smithi112.stdout:3/27: creat d8/f9 x:0 0 0 2024-09-19T09:35:09.918 INFO:tasks.workunit.client.0.smithi112.stdout:3/28: write f7 [32760,90230] 0 2024-09-19T09:35:09.918 INFO:tasks.workunit.client.0.smithi112.stdout:3/29: write d8/f9 [456741,122537] 0 2024-09-19T09:35:09.918 INFO:tasks.workunit.client.0.smithi112.stdout:3/30: dread - f6 zero size 2024-09-19T09:35:09.918 INFO:tasks.workunit.client.0.smithi112.stdout:3/31: truncate f6 98111 0 2024-09-19T09:35:09.918 INFO:tasks.workunit.client.0.smithi112.stdout:3/32: truncate d8/f9 1430584 0 2024-09-19T09:35:09.918 INFO:tasks.workunit.client.0.smithi112.stdout:0/58: stat d2/l6 0 2024-09-19T09:35:09.918 INFO:tasks.workunit.client.0.smithi112.stdout:0/59: write d2/f9 [1765995,35323] 0 2024-09-19T09:35:09.918 INFO:tasks.workunit.client.0.smithi112.stdout:0/60: creat d2/d11/f14 x:0 0 0 2024-09-19T09:35:09.919 INFO:tasks.workunit.client.0.smithi112.stdout:0/61: mknod d2/d11/c15 0 2024-09-19T09:35:09.920 INFO:tasks.workunit.client.0.smithi112.stdout:4/170: rename d1/d4/d1a to d1/d3d/d41 0 2024-09-19T09:35:09.921 INFO:tasks.workunit.client.0.smithi112.stdout:4/171: mkdir d1/d31/d42 0 2024-09-19T09:35:09.922 INFO:tasks.workunit.client.0.smithi112.stdout:4/172: unlink d1/d31/f38 0 2024-09-19T09:35:09.922 INFO:tasks.workunit.client.0.smithi112.stdout:4/173: chown d1/f1f 537403105 1 2024-09-19T09:35:09.922 INFO:tasks.workunit.client.0.smithi112.stdout:4/174: truncate d1/d4/f13 572065 0 2024-09-19T09:35:09.928 INFO:tasks.workunit.client.0.smithi112.stdout:5/11: dwrite d4/f6 [0,4194304] 0 2024-09-19T09:35:09.928 INFO:tasks.workunit.client.0.smithi112.stdout:6/47: dwrite f5 [4194304,4194304] 0 2024-09-19T09:35:09.928 INFO:tasks.workunit.client.0.smithi112.stdout:8/60: rmdir d7/d10/d11 39 2024-09-19T09:35:09.935 INFO:tasks.workunit.client.0.smithi112.stdout:5/12: symlink d4/l7 0 2024-09-19T09:35:09.936 INFO:tasks.workunit.client.0.smithi112.stdout:5/13: chown l1 1963951 1 2024-09-19T09:35:09.939 INFO:tasks.workunit.client.0.smithi112.stdout:8/61: mkdir d7/db/d15 0 2024-09-19T09:35:09.940 INFO:tasks.workunit.client.0.smithi112.stdout:6/48: getdents d8 0 2024-09-19T09:35:09.948 INFO:tasks.workunit.client.0.smithi112.stdout:6/49: rename l1 to d8/ld 0 2024-09-19T09:35:09.950 INFO:tasks.workunit.client.0.smithi112.stdout:6/50: read f6 [102096,65504] 0 2024-09-19T09:35:09.950 INFO:tasks.workunit.client.0.smithi112.stdout:6/51: fsync d8/f9 0 2024-09-19T09:35:09.960 INFO:tasks.workunit.client.0.smithi112.stdout:3/33: dwrite f7 [0,4194304] 0 2024-09-19T09:35:09.962 INFO:tasks.workunit.client.0.smithi112.stdout:0/62: rmdir d2/d11 39 2024-09-19T09:35:09.962 INFO:tasks.workunit.client.0.smithi112.stdout:0/63: stat d2/l6 0 2024-09-19T09:35:09.968 INFO:tasks.workunit.client.0.smithi112.stdout:5/14: dwrite d4/f6 [0,4194304] 0 2024-09-19T09:35:09.969 INFO:tasks.workunit.client.0.smithi112.stdout:4/175: write d1/d4/f15 [4589852,43687] 0 2024-09-19T09:35:09.973 INFO:tasks.workunit.client.0.smithi112.stdout:4/176: fdatasync d1/d4/f9 0 2024-09-19T09:35:09.973 INFO:tasks.workunit.client.0.smithi112.stdout:8/62: dwrite d7/fe [0,4194304] 0 2024-09-19T09:35:09.974 INFO:tasks.workunit.client.0.smithi112.stdout:5/15: getdents d4 0 2024-09-19T09:35:09.976 INFO:tasks.workunit.client.0.smithi112.stdout:4/177: mkdir d1/d31/d43 0 2024-09-19T09:35:09.977 INFO:tasks.workunit.client.0.smithi112.stdout:4/178: creat d1/d3d/f44 x:0 0 0 2024-09-19T09:35:09.977 INFO:tasks.workunit.client.0.smithi112.stdout:6/52: dwrite d8/f9 [0,4194304] 0 2024-09-19T09:35:09.977 INFO:tasks.workunit.client.0.smithi112.stdout:6/53: write f6 [201386,1129] 0 2024-09-19T09:35:09.977 INFO:tasks.workunit.client.0.smithi112.stdout:6/54: fdatasync d8/f9 0 2024-09-19T09:35:09.978 INFO:tasks.workunit.client.0.smithi112.stdout:6/55: chown d8/f9 0 1 2024-09-19T09:35:09.978 INFO:tasks.workunit.client.0.smithi112.stdout:8/63: creat d7/d10/f16 x:0 0 0 2024-09-19T09:35:09.979 INFO:tasks.workunit.client.0.smithi112.stdout:5/16: rmdir d4 39 2024-09-19T09:35:09.983 INFO:tasks.workunit.client.0.smithi112.stdout:3/34: write f7 [4864857,286] 0 2024-09-19T09:35:09.984 INFO:tasks.workunit.client.0.smithi112.stdout:3/35: write f7 [4645096,18304] 0 2024-09-19T09:35:09.984 INFO:tasks.workunit.client.0.smithi112.stdout:4/179: dread d1/d4/d3a/d18/f2f [0,4194304] 0 2024-09-19T09:35:09.989 INFO:tasks.workunit.client.0.smithi112.stdout:6/56: mkdir d8/de 0 2024-09-19T09:35:09.990 INFO:tasks.workunit.client.0.smithi112.stdout:8/64: mknod d7/d10/d11/c17 0 2024-09-19T09:35:09.990 INFO:tasks.workunit.client.0.smithi112.stdout:8/65: readlink d7/l9 0 2024-09-19T09:35:09.991 INFO:tasks.workunit.client.0.smithi112.stdout:0/64: dwrite d2/fe [0,4194304] 0 2024-09-19T09:35:09.991 INFO:tasks.workunit.client.0.smithi112.stdout:5/17: write d4/f6 [3696124,128110] 0 2024-09-19T09:35:09.993 INFO:tasks.workunit.client.0.smithi112.stdout:8/66: rmdir d7/d13 0 2024-09-19T09:35:09.994 INFO:tasks.workunit.client.0.smithi112.stdout:4/180: rename d1/d4/c2d to d1/c45 0 2024-09-19T09:35:10.001 INFO:tasks.workunit.client.0.smithi112.stdout:0/65: write d2/fe [1817157,59008] 0 2024-09-19T09:35:10.002 INFO:tasks.workunit.client.0.smithi112.stdout:5/18: rename d4/l7 to d4/l8 0 2024-09-19T09:35:10.003 INFO:tasks.workunit.client.0.smithi112.stdout:8/67: mknod d7/d10/c18 0 2024-09-19T09:35:10.004 INFO:tasks.workunit.client.0.smithi112.stdout:3/36: dwrite f7 [0,4194304] 0 2024-09-19T09:35:10.008 INFO:tasks.workunit.client.0.smithi112.stdout:4/181: creat d1/f46 x:0 0 0 2024-09-19T09:35:10.011 INFO:tasks.workunit.client.0.smithi112.stdout:0/66: symlink d2/l16 0 2024-09-19T09:35:10.011 INFO:tasks.workunit.client.0.smithi112.stdout:0/67: dread - d2/f12 zero size 2024-09-19T09:35:10.011 INFO:tasks.workunit.client.0.smithi112.stdout:0/68: read d2/fe [2936842,57537] 0 2024-09-19T09:35:10.016 INFO:tasks.workunit.client.0.smithi112.stdout:3/37: dread f7 [0,4194304] 0 2024-09-19T09:35:10.017 INFO:tasks.workunit.client.0.smithi112.stdout:8/68: mkdir d7/d10/d19 0 2024-09-19T09:35:10.022 INFO:tasks.workunit.client.0.smithi112.stdout:6/57: rename c3 to d8/de/cf 0 2024-09-19T09:35:10.023 INFO:tasks.workunit.client.0.smithi112.stdout:5/19: getdents d4 0 2024-09-19T09:35:10.023 INFO:tasks.workunit.client.0.smithi112.stdout:5/20: write d4/f5 [395286,124677] 0 2024-09-19T09:35:10.024 INFO:tasks.workunit.client.0.smithi112.stdout:4/182: mknod d1/d31/d43/c47 0 2024-09-19T09:35:10.028 INFO:tasks.workunit.client.0.smithi112.stdout:0/69: dwrite d2/fb [0,4194304] 0 2024-09-19T09:35:10.028 INFO:tasks.workunit.client.0.smithi112.stdout:0/70: dread - d2/f7 zero size 2024-09-19T09:35:10.028 INFO:tasks.workunit.client.0.smithi112.stdout:0/71: chown d2/fa 51 1 2024-09-19T09:35:10.028 INFO:tasks.workunit.client.0.smithi112.stdout:0/72: stat d2/fb 0 2024-09-19T09:35:10.028 INFO:tasks.workunit.client.0.smithi112.stdout:0/73: chown d2/d11/f13 3004853 1 2024-09-19T09:35:10.028 INFO:tasks.workunit.client.0.smithi112.stdout:0/74: chown d2/f12 1 1 2024-09-19T09:35:10.028 INFO:tasks.workunit.client.0.smithi112.stdout:8/69: rmdir d7/d10/d19 0 2024-09-19T09:35:10.031 INFO:tasks.workunit.client.0.smithi112.stdout:5/21: mkdir d4/d9 0 2024-09-19T09:35:10.033 INFO:tasks.workunit.client.0.smithi112.stdout:4/183: getdents d1/d3d/d41 0 2024-09-19T09:35:10.034 INFO:tasks.workunit.client.0.smithi112.stdout:3/38: getdents d8 0 2024-09-19T09:35:10.038 INFO:tasks.workunit.client.0.smithi112.stdout:0/75: unlink d2/f7 0 2024-09-19T09:35:10.039 INFO:tasks.workunit.client.0.smithi112.stdout:8/70: rename d7/l8 to d7/d10/l1a 0 2024-09-19T09:35:10.041 INFO:tasks.workunit.client.0.smithi112.stdout:4/184: mkdir d1/d31/d43/d48 0 2024-09-19T09:35:10.041 INFO:tasks.workunit.client.0.smithi112.stdout:4/185: dread - d1/fd zero size 2024-09-19T09:35:10.042 INFO:tasks.workunit.client.0.smithi112.stdout:0/76: mkdir d2/d17 0 2024-09-19T09:35:10.042 INFO:tasks.workunit.client.0.smithi112.stdout:6/58: dwrite d8/f9 [0,4194304] 0 2024-09-19T09:35:10.043 INFO:tasks.workunit.client.0.smithi112.stdout:8/71: truncate f4 2845600 0 2024-09-19T09:35:10.045 INFO:tasks.workunit.client.0.smithi112.stdout:4/186: creat d1/d4/d3a/f49 x:0 0 0 2024-09-19T09:35:10.047 INFO:tasks.workunit.client.0.smithi112.stdout:0/77: rmdir d2/d17 0 2024-09-19T09:35:10.050 INFO:tasks.workunit.client.0.smithi112.stdout:8/72: mknod d7/db/d15/c1b 0 2024-09-19T09:35:10.050 INFO:tasks.workunit.client.0.smithi112.stdout:8/73: write d7/d10/d11/f12 [241211,119441] 0 2024-09-19T09:35:10.050 INFO:tasks.workunit.client.0.smithi112.stdout:8/74: stat d7/d10/d11/c14 0 2024-09-19T09:35:10.051 INFO:tasks.workunit.client.0.smithi112.stdout:4/187: symlink d1/d31/d43/d48/l4a 0 2024-09-19T09:35:10.051 INFO:tasks.workunit.client.0.smithi112.stdout:4/188: write d1/d4/f15 [2187516,36843] 0 2024-09-19T09:35:10.051 INFO:tasks.workunit.client.0.smithi112.stdout:4/189: write d1/d3d/f44 [45275,79634] 0 2024-09-19T09:35:10.051 INFO:tasks.workunit.client.0.smithi112.stdout:4/190: write d1/f46 [736643,45383] 0 2024-09-19T09:35:10.052 INFO:tasks.workunit.client.0.smithi112.stdout:0/78: creat d2/d11/f18 x:0 0 0 2024-09-19T09:35:10.052 INFO:tasks.workunit.client.0.smithi112.stdout:0/79: chown d2/fb 33191117 1 2024-09-19T09:35:10.056 INFO:tasks.workunit.client.0.smithi112.stdout:6/59: write d8/f9 [4143869,79078] 0 2024-09-19T09:35:10.056 INFO:tasks.workunit.client.0.smithi112.stdout:8/75: getdents d7/db 0 2024-09-19T09:35:10.056 INFO:tasks.workunit.client.0.smithi112.stdout:4/191: chown d1/d4/c10 0 1 2024-09-19T09:35:10.058 INFO:tasks.workunit.client.0.smithi112.stdout:0/80: rename d2/l6 to d2/d11/l19 0 2024-09-19T09:35:10.060 INFO:tasks.workunit.client.0.smithi112.stdout:6/60: creat d8/f10 x:0 0 0 2024-09-19T09:35:10.062 INFO:tasks.workunit.client.0.smithi112.stdout:4/192: unlink d1/d4/d3a/c24 0 2024-09-19T09:35:10.063 INFO:tasks.workunit.client.0.smithi112.stdout:4/193: symlink d1/l4b 0 2024-09-19T09:35:10.064 INFO:tasks.workunit.client.0.smithi112.stdout:4/194: write d1/f1d [18014,14398] 0 2024-09-19T09:35:10.064 INFO:tasks.workunit.client.0.smithi112.stdout:4/195: chown d1/fd 747461 1 2024-09-19T09:35:10.064 INFO:tasks.workunit.client.0.smithi112.stdout:5/22: dread d4/f6 [0,4194304] 0 2024-09-19T09:35:10.066 INFO:tasks.workunit.client.0.smithi112.stdout:5/23: symlink d4/la 0 2024-09-19T09:35:10.066 INFO:tasks.workunit.client.0.smithi112.stdout:5/24: write d4/f5 [3962857,64397] 0 2024-09-19T09:35:10.067 INFO:tasks.workunit.client.0.smithi112.stdout:5/25: rmdir d4 39 2024-09-19T09:35:10.069 INFO:tasks.workunit.client.0.smithi112.stdout:3/39: dwrite d8/f9 [0,4194304] 0 2024-09-19T09:35:10.069 INFO:tasks.workunit.client.0.smithi112.stdout:3/40: chown c5 29 1 2024-09-19T09:35:10.070 INFO:tasks.workunit.client.0.smithi112.stdout:0/81: write d2/f9 [1725258,92695] 0 2024-09-19T09:35:10.070 INFO:tasks.workunit.client.0.smithi112.stdout:0/82: write d2/d11/f18 [921098,37902] 0 2024-09-19T09:35:10.071 INFO:tasks.workunit.client.0.smithi112.stdout:3/41: mknod d8/ca 0 2024-09-19T09:35:10.078 INFO:tasks.workunit.client.0.smithi112.stdout:5/26: link l1 d4/lb 0 2024-09-19T09:35:10.078 INFO:tasks.workunit.client.0.smithi112.stdout:5/27: write d4/f5 [255442,28671] 0 2024-09-19T09:35:10.078 INFO:tasks.workunit.client.0.smithi112.stdout:5/28: read d4/f6 [3663654,25772] 0 2024-09-19T09:35:10.084 INFO:tasks.workunit.client.0.smithi112.stdout:5/29: symlink d4/d9/lc 0 2024-09-19T09:35:10.084 INFO:tasks.workunit.client.0.smithi112.stdout:8/76: dwrite d7/fe [0,4194304] 0 2024-09-19T09:35:10.084 INFO:tasks.workunit.client.0.smithi112.stdout:8/77: chown d7/db 3016 1 2024-09-19T09:35:10.087 INFO:tasks.workunit.client.0.smithi112.stdout:5/30: chown d4/l8 73494554 1 2024-09-19T09:35:10.090 INFO:tasks.workunit.client.0.smithi112.stdout:8/78: rmdir d7/db 39 2024-09-19T09:35:10.090 INFO:tasks.workunit.client.0.smithi112.stdout:8/79: fsync d7/d10/f16 0 2024-09-19T09:35:10.094 INFO:tasks.workunit.client.0.smithi112.stdout:8/80: mknod d7/d10/c1c 0 2024-09-19T09:35:10.096 INFO:tasks.workunit.client.0.smithi112.stdout:8/81: creat d7/d10/d11/f1d x:0 0 0 2024-09-19T09:35:10.096 INFO:tasks.workunit.client.0.smithi112.stdout:8/82: chown f4 2 1 2024-09-19T09:35:10.097 INFO:tasks.workunit.client.0.smithi112.stdout:3/42: dwrite f7 [0,4194304] 0 2024-09-19T09:35:10.105 INFO:tasks.workunit.client.0.smithi112.stdout:4/196: dwrite d1/d4/f15 [0,4194304] 0 2024-09-19T09:35:10.107 INFO:tasks.workunit.client.0.smithi112.stdout:4/197: creat d1/d4/d3a/d18/f4c x:0 0 0 2024-09-19T09:35:10.110 INFO:tasks.workunit.client.0.smithi112.stdout:4/198: creat d1/d31/f4d x:0 0 0 2024-09-19T09:35:10.110 INFO:tasks.workunit.client.0.smithi112.stdout:4/199: readlink d1/d31/d43/d48/l4a 0 2024-09-19T09:35:10.113 INFO:tasks.workunit.client.0.smithi112.stdout:4/200: link d1/d3d/d41/l1e d1/d3d/l4e 0 2024-09-19T09:35:10.116 INFO:tasks.workunit.client.0.smithi112.stdout:5/31: truncate d4/f5 1811150 0 2024-09-19T09:35:10.126 INFO:tasks.workunit.client.0.smithi112.stdout:8/83: dwrite d7/ff [0,4194304] 0 2024-09-19T09:35:10.126 INFO:tasks.workunit.client.0.smithi112.stdout:8/84: chown d7/d10/d11/f1d 0 1 2024-09-19T09:35:10.126 INFO:tasks.workunit.client.0.smithi112.stdout:8/85: truncate d7/d10/f16 424931 0 2024-09-19T09:35:10.126 INFO:tasks.workunit.client.0.smithi112.stdout:3/43: dwrite f6 [0,4194304] 0 2024-09-19T09:35:10.131 INFO:tasks.workunit.client.0.smithi112.stdout:3/44: link d8/f9 d8/fb 0 2024-09-19T09:35:10.131 INFO:tasks.workunit.client.0.smithi112.stdout:3/45: rmdir d8 39 2024-09-19T09:35:10.132 INFO:tasks.workunit.client.0.smithi112.stdout:3/46: creat d8/fc x:0 0 0 2024-09-19T09:35:10.145 INFO:tasks.workunit.client.0.smithi112.stdout:4/201: write d1/d4/fb [2262041,76827] 0 2024-09-19T09:35:10.146 INFO:tasks.workunit.client.0.smithi112.stdout:4/202: rename d1/f1d to d1/d3d/d41/f4f 0 2024-09-19T09:35:10.155 INFO:tasks.workunit.client.0.smithi112.stdout:3/47: truncate f6 3714768 0 2024-09-19T09:35:10.158 INFO:tasks.workunit.client.0.smithi112.stdout:5/32: dwrite d4/f5 [0,4194304] 0 2024-09-19T09:35:10.158 INFO:tasks.workunit.client.0.smithi112.stdout:5/33: chown d4/f5 2 1 2024-09-19T09:35:10.158 INFO:tasks.workunit.client.0.smithi112.stdout:8/86: dwrite d7/d10/d11/f12 [0,4194304] 0 2024-09-19T09:35:10.159 INFO:tasks.workunit.client.0.smithi112.stdout:5/34: link d4/lb d4/d9/ld 0 2024-09-19T09:35:10.168 INFO:tasks.workunit.client.0.smithi112.stdout:4/203: dwrite d1/d4/f32 [0,4194304] 0 2024-09-19T09:35:10.168 INFO:tasks.workunit.client.0.smithi112.stdout:4/204: creat d1/d31/f50 x:0 0 0 2024-09-19T09:35:10.171 INFO:tasks.workunit.client.0.smithi112.stdout:3/48: dread d8/fb [0,4194304] 0 2024-09-19T09:35:10.181 INFO:tasks.workunit.client.0.smithi112.stdout:5/35: dread d4/f6 [0,4194304] 0 2024-09-19T09:35:10.189 INFO:tasks.workunit.client.0.smithi112.stdout:3/49: dread d8/fb [0,4194304] 0 2024-09-19T09:35:10.189 INFO:tasks.workunit.client.0.smithi112.stdout:3/50: creat d8/fd x:0 0 0 2024-09-19T09:35:10.189 INFO:tasks.workunit.client.0.smithi112.stdout:3/51: chown f6 12 1 2024-09-19T09:35:10.195 INFO:tasks.workunit.client.0.smithi112.stdout:3/52: dread d8/f9 [0,4194304] 0 2024-09-19T09:35:10.195 INFO:tasks.workunit.client.0.smithi112.stdout:4/205: dwrite d1/d31/f4d [0,4194304] 0 2024-09-19T09:35:10.195 INFO:tasks.workunit.client.0.smithi112.stdout:3/53: creat d8/fe x:0 0 0 2024-09-19T09:35:10.200 INFO:tasks.workunit.client.0.smithi112.stdout:3/54: rename d8/f9 to d8/ff 0 2024-09-19T09:35:10.200 INFO:tasks.workunit.client.0.smithi112.stdout:3/55: truncate d8/fe 397975 0 2024-09-19T09:35:10.200 INFO:tasks.workunit.client.0.smithi112.stdout:3/56: dread - d8/fc zero size 2024-09-19T09:35:10.200 INFO:tasks.workunit.client.0.smithi112.stdout:5/36: dwrite d4/f5 [4194304,4194304] 0 2024-09-19T09:35:10.201 INFO:tasks.workunit.client.0.smithi112.stdout:8/87: dwrite d7/fa [0,4194304] 0 2024-09-19T09:35:10.201 INFO:tasks.workunit.client.0.smithi112.stdout:8/88: fdatasync d7/d10/f16 0 2024-09-19T09:35:10.202 INFO:tasks.workunit.client.0.smithi112.stdout:4/206: rename d1/d4/d3a/d18 to d1/d31/d51 0 2024-09-19T09:35:10.206 INFO:tasks.workunit.client.0.smithi112.stdout:5/37: creat d4/d9/fe x:0 0 0 2024-09-19T09:35:10.206 INFO:tasks.workunit.client.0.smithi112.stdout:5/38: creat d4/d9/ff x:0 0 0 2024-09-19T09:35:10.206 INFO:tasks.workunit.client.0.smithi112.stdout:5/39: creat d4/d9/f10 x:0 0 0 2024-09-19T09:35:10.206 INFO:tasks.workunit.client.0.smithi112.stdout:5/40: write d4/d9/f10 [599942,40170] 0 2024-09-19T09:35:10.211 INFO:tasks.workunit.client.0.smithi112.stdout:8/89: unlink f4 0 2024-09-19T09:35:10.211 INFO:tasks.workunit.client.0.smithi112.stdout:8/90: creat d7/d10/f1e x:0 0 0 2024-09-19T09:35:10.211 INFO:tasks.workunit.client.0.smithi112.stdout:8/91: fdatasync d7/ff 0 2024-09-19T09:35:10.211 INFO:tasks.workunit.client.0.smithi112.stdout:8/92: stat d7/d10/f16 0 2024-09-19T09:35:10.211 INFO:tasks.workunit.client.0.smithi112.stdout:8/93: stat d7/d10/d11/c14 0 2024-09-19T09:35:10.211 INFO:tasks.workunit.client.0.smithi112.stdout:8/94: stat c2 0 2024-09-19T09:35:10.213 INFO:tasks.workunit.client.0.smithi112.stdout:3/57: dwrite d8/fd [0,4194304] 0 2024-09-19T09:35:10.213 INFO:tasks.workunit.client.0.smithi112.stdout:3/58: creat d8/f10 x:0 0 0 2024-09-19T09:35:10.214 INFO:tasks.workunit.client.0.smithi112.stdout:3/59: write d8/ff [4628184,114248] 0 2024-09-19T09:35:10.214 INFO:tasks.workunit.client.0.smithi112.stdout:3/60: readlink l3 0 2024-09-19T09:35:10.218 INFO:tasks.workunit.client.0.smithi112.stdout:5/41: rename d4/f6 to d4/d9/f11 0 2024-09-19T09:35:10.222 INFO:tasks.workunit.client.0.smithi112.stdout:8/95: symlink d7/db/l1f 0 2024-09-19T09:35:10.223 INFO:tasks.workunit.client.0.smithi112.stdout:4/207: unlink d1/d31/f4d 0 2024-09-19T09:35:10.223 INFO:tasks.workunit.client.0.smithi112.stdout:4/208: write d1/d4/f9 [2072015,55952] 0 2024-09-19T09:35:10.231 INFO:tasks.workunit.client.0.smithi112.stdout:3/61: symlink d8/l11 0 2024-09-19T09:35:10.235 INFO:tasks.workunit.client.0.smithi112.stdout:5/42: rename d4/d9/ld to d4/d9/l12 0 2024-09-19T09:35:10.236 INFO:tasks.workunit.client.0.smithi112.stdout:3/62: mknod d8/c12 0 2024-09-19T09:35:10.236 INFO:tasks.workunit.client.0.smithi112.stdout:3/63: read - d8/f10 zero size 2024-09-19T09:35:10.240 INFO:tasks.workunit.client.0.smithi112.stdout:5/43: rename d4/d9/fe to d4/f13 0 2024-09-19T09:35:10.240 INFO:tasks.workunit.client.0.smithi112.stdout:5/44: readlink d4/d9/lc 0 2024-09-19T09:35:10.248 INFO:tasks.workunit.client.0.smithi112.stdout:8/96: read d7/d10/d11/f12 [459316,78171] 0 2024-09-19T09:35:10.250 INFO:tasks.workunit.client.0.smithi112.stdout:8/97: unlink d7/l9 0 2024-09-19T09:35:10.250 INFO:tasks.workunit.client.0.smithi112.stdout:8/98: dread d7/d10/f16 [0,4194304] 0 2024-09-19T09:35:10.259 INFO:tasks.workunit.client.0.smithi112.stdout:4/209: dwrite d1/d31/d51/d37/f3c [0,4194304] 0 2024-09-19T09:35:10.259 INFO:tasks.workunit.client.0.smithi112.stdout:3/64: dwrite f6 [0,4194304] 0 2024-09-19T09:35:10.262 INFO:tasks.workunit.client.0.smithi112.stdout:4/210: creat d1/d3d/d41/f52 x:0 0 0 2024-09-19T09:35:10.263 INFO:tasks.workunit.client.0.smithi112.stdout:5/45: rmdir d4/d9 39 2024-09-19T09:35:10.264 INFO:tasks.workunit.client.0.smithi112.stdout:3/65: unlink d8/fc 0 2024-09-19T09:35:10.267 INFO:tasks.workunit.client.0.smithi112.stdout:4/211: rename d1/d4/f26 to d1/f53 0 2024-09-19T09:35:10.267 INFO:tasks.workunit.client.0.smithi112.stdout:4/212: write d1/d3d/d41/f4f [819451,123578] 0 2024-09-19T09:35:10.268 INFO:tasks.workunit.client.0.smithi112.stdout:5/46: mknod d4/d9/c14 0 2024-09-19T09:35:10.271 INFO:tasks.workunit.client.0.smithi112.stdout:8/99: dwrite d7/d10/f16 [0,4194304] 0 2024-09-19T09:35:10.271 INFO:tasks.workunit.client.0.smithi112.stdout:3/66: write d8/ff [3699064,118263] 0 2024-09-19T09:35:10.271 INFO:tasks.workunit.client.0.smithi112.stdout:8/100: chown c6 4917 1 2024-09-19T09:35:10.271 INFO:tasks.workunit.client.0.smithi112.stdout:5/47: mkdir d4/d15 0 2024-09-19T09:35:10.274 INFO:tasks.workunit.client.0.smithi112.stdout:8/101: symlink d7/db/d15/l20 0 2024-09-19T09:35:10.281 INFO:tasks.workunit.client.0.smithi112.stdout:5/48: write d4/f5 [7323270,40449] 0 2024-09-19T09:35:10.282 INFO:tasks.workunit.client.0.smithi112.stdout:5/49: mknod d4/d9/c16 0 2024-09-19T09:35:10.290 INFO:tasks.workunit.client.0.smithi112.stdout:8/102: dread d7/d10/f16 [0,4194304] 0 2024-09-19T09:35:10.291 INFO:tasks.workunit.client.0.smithi112.stdout:3/67: dwrite d8/fe [0,4194304] 0 2024-09-19T09:35:10.291 INFO:tasks.workunit.client.0.smithi112.stdout:3/68: truncate d8/f10 1042939 0 2024-09-19T09:35:10.291 INFO:tasks.workunit.client.0.smithi112.stdout:4/213: dwrite d1/d3d/f3f [0,4194304] 0 2024-09-19T09:35:10.291 INFO:tasks.workunit.client.0.smithi112.stdout:4/214: truncate d1/d3d/d41/f52 183525 0 2024-09-19T09:35:10.291 INFO:tasks.workunit.client.0.smithi112.stdout:4/215: write d1/f6 [850377,79069] 0 2024-09-19T09:35:10.293 INFO:tasks.workunit.client.0.smithi112.stdout:8/103: unlink d7/d10/d11/c14 0 2024-09-19T09:35:10.298 INFO:tasks.workunit.client.0.smithi112.stdout:5/50: dread d4/d9/f11 [4194304,4194304] 0 2024-09-19T09:35:10.299 INFO:tasks.workunit.client.0.smithi112.stdout:4/216: symlink d1/d31/l54 0 2024-09-19T09:35:10.299 INFO:tasks.workunit.client.0.smithi112.stdout:4/217: truncate d1/d4/f25 1264169 0 2024-09-19T09:35:10.299 INFO:tasks.workunit.client.0.smithi112.stdout:4/218: write d1/d4/f9 [2128385,109855] 0 2024-09-19T09:35:10.299 INFO:tasks.workunit.client.0.smithi112.stdout:4/219: chown d1/d3d/d41/f23 4750492 1 2024-09-19T09:35:10.299 INFO:tasks.workunit.client.0.smithi112.stdout:4/220: truncate d1/f6 981186 0 2024-09-19T09:35:10.299 INFO:tasks.workunit.client.0.smithi112.stdout:4/221: truncate d1/f46 1535799 0 2024-09-19T09:35:10.301 INFO:tasks.workunit.client.0.smithi112.stdout:4/222: fdatasync d1/f6 0 2024-09-19T09:35:10.301 INFO:tasks.workunit.client.0.smithi112.stdout:4/223: write d1/d4/f13 [1075776,62285] 0 2024-09-19T09:35:10.301 INFO:tasks.workunit.client.0.smithi112.stdout:8/104: mkdir d7/db/d21 0 2024-09-19T09:35:10.305 INFO:tasks.workunit.client.0.smithi112.stdout:5/51: getdents d4 0 2024-09-19T09:35:10.305 INFO:tasks.workunit.client.0.smithi112.stdout:5/52: write d4/f5 [7939857,51067] 0 2024-09-19T09:35:10.309 INFO:tasks.workunit.client.0.smithi112.stdout:4/224: creat d1/d31/d51/f55 x:0 0 0 2024-09-19T09:35:10.309 INFO:tasks.workunit.client.0.smithi112.stdout:4/225: chown d1/d31/d51/d37/f3c 41301 1 2024-09-19T09:35:10.309 INFO:tasks.workunit.client.0.smithi112.stdout:4/226: creat d1/d3d/f56 x:0 0 0 2024-09-19T09:35:10.310 INFO:tasks.workunit.client.0.smithi112.stdout:3/69: truncate d8/f10 384074 0 2024-09-19T09:35:10.310 INFO:tasks.workunit.client.0.smithi112.stdout:5/53: mkdir d4/d9/d17 0 2024-09-19T09:35:10.311 INFO:tasks.workunit.client.0.smithi112.stdout:5/54: fdatasync d4/f13 0 2024-09-19T09:35:10.313 INFO:tasks.workunit.client.0.smithi112.stdout:4/227: mkdir d1/d4/d3a/d57 0 2024-09-19T09:35:10.314 INFO:tasks.workunit.client.0.smithi112.stdout:4/228: truncate d1/f29 4716176 0 2024-09-19T09:35:10.316 INFO:tasks.workunit.client.0.smithi112.stdout:3/70: unlink d8/c12 0 2024-09-19T09:35:10.316 INFO:tasks.workunit.client.0.smithi112.stdout:3/71: write d8/f10 [1292587,5072] 0 2024-09-19T09:35:10.318 INFO:tasks.workunit.client.0.smithi112.stdout:8/105: dwrite d7/d10/d11/f12 [0,4194304] 0 2024-09-19T09:35:10.318 INFO:tasks.workunit.client.0.smithi112.stdout:8/106: dread - d7/d10/f1e zero size 2024-09-19T09:35:10.321 INFO:tasks.workunit.client.0.smithi112.stdout:5/55: rename d4/la to d4/d9/l18 0 2024-09-19T09:35:10.322 INFO:tasks.workunit.client.0.smithi112.stdout:3/72: mknod d8/c13 0 2024-09-19T09:35:10.323 INFO:tasks.workunit.client.0.smithi112.stdout:5/56: symlink d4/l19 0 2024-09-19T09:35:10.334 INFO:tasks.workunit.client.0.smithi112.stdout:3/73: dread f6 [0,4194304] 0 2024-09-19T09:35:10.336 INFO:tasks.workunit.client.0.smithi112.stdout:3/74: chown d8/ca 128133123 1 2024-09-19T09:35:10.337 INFO:tasks.workunit.client.0.smithi112.stdout:5/57: dread d4/d9/f10 [0,4194304] 0 2024-09-19T09:35:10.337 INFO:tasks.workunit.client.0.smithi112.stdout:5/58: symlink d4/d15/l1a 0 2024-09-19T09:35:10.337 INFO:tasks.workunit.client.0.smithi112.stdout:5/59: chown d4/d9/ff 173181551 1 2024-09-19T09:35:10.338 INFO:tasks.workunit.client.0.smithi112.stdout:5/60: chown d4/d15 106410 1 2024-09-19T09:35:10.338 INFO:tasks.workunit.client.0.smithi112.stdout:8/107: dwrite d7/fa [0,4194304] 0 2024-09-19T09:35:10.338 INFO:tasks.workunit.client.0.smithi112.stdout:5/61: mkdir d4/d1b 0 2024-09-19T09:35:10.341 INFO:tasks.workunit.client.0.smithi112.stdout:8/108: rename d7/d10/d11/f1d to d7/db/d21/f22 0 2024-09-19T09:35:10.341 INFO:tasks.workunit.client.0.smithi112.stdout:8/109: fdatasync d7/db/d21/f22 0 2024-09-19T09:35:10.342 INFO:tasks.workunit.client.0.smithi112.stdout:4/229: truncate d1/f6 907433 0 2024-09-19T09:35:10.342 INFO:tasks.workunit.client.0.smithi112.stdout:4/230: truncate d1/d3d/f44 600889 0 2024-09-19T09:35:10.342 INFO:tasks.workunit.client.0.smithi112.stdout:4/231: stat d1/c16 0 2024-09-19T09:35:10.342 INFO:tasks.workunit.client.0.smithi112.stdout:4/232: readlink d1/l1b 0 2024-09-19T09:35:10.342 INFO:tasks.workunit.client.0.smithi112.stdout:4/233: fsync d1/d3d/f44 0 2024-09-19T09:35:10.342 INFO:tasks.workunit.client.0.smithi112.stdout:4/234: chown d1/d4/f15 2321426 1 2024-09-19T09:35:10.342 INFO:tasks.workunit.client.0.smithi112.stdout:4/235: dread - d1/fd zero size 2024-09-19T09:35:10.346 INFO:tasks.workunit.client.0.smithi112.stdout:4/236: link d1/d31/c39 d1/d4/d3a/d57/c58 0 2024-09-19T09:35:10.346 INFO:tasks.workunit.client.0.smithi112.stdout:4/237: read d1/d3d/f44 [9671,10167] 0 2024-09-19T09:35:10.347 INFO:tasks.workunit.client.0.smithi112.stdout:4/238: dread - d1/d31/f50 zero size 2024-09-19T09:35:10.349 INFO:tasks.workunit.client.0.smithi112.stdout:8/110: getdents d7/d10/d11 0 2024-09-19T09:35:10.351 INFO:tasks.workunit.client.0.smithi112.stdout:3/75: dread d8/fb [0,4194304] 0 2024-09-19T09:35:10.351 INFO:tasks.workunit.client.0.smithi112.stdout:3/76: stat f7 0 2024-09-19T09:35:10.351 INFO:tasks.workunit.client.0.smithi112.stdout:3/77: fsync d8/fd 0 2024-09-19T09:35:10.351 INFO:tasks.workunit.client.0.smithi112.stdout:3/78: chown d8/fb 12609030 1 2024-09-19T09:35:10.351 INFO:tasks.workunit.client.0.smithi112.stdout:3/79: chown d8/c13 2 1 2024-09-19T09:35:10.356 INFO:tasks.workunit.client.0.smithi112.stdout:4/239: getdents d1/d3d/d41 0 2024-09-19T09:35:10.357 INFO:tasks.workunit.client.0.smithi112.stdout:4/240: creat d1/d4/f59 x:0 0 0 2024-09-19T09:35:10.359 INFO:tasks.workunit.client.0.smithi112.stdout:4/241: link d1/lf d1/d31/d43/l5a 0 2024-09-19T09:35:10.360 INFO:tasks.workunit.client.0.smithi112.stdout:4/242: chown d1/d3d/d41/f52 472757041 1 2024-09-19T09:35:10.361 INFO:tasks.workunit.client.0.smithi112.stdout:4/243: symlink d1/d31/d43/d48/l5b 0 2024-09-19T09:35:10.362 INFO:tasks.workunit.client.0.smithi112.stdout:5/62: dread d4/f5 [0,4194304] 0 2024-09-19T09:35:10.363 INFO:tasks.workunit.client.0.smithi112.stdout:3/80: write d8/fd [3389219,130978] 0 2024-09-19T09:35:10.364 INFO:tasks.workunit.client.0.smithi112.stdout:8/111: dread d7/fa [0,4194304] 0 2024-09-19T09:35:10.364 INFO:tasks.workunit.client.0.smithi112.stdout:4/244: mkdir d1/d31/d43/d48/d5c 0 2024-09-19T09:35:10.365 INFO:tasks.workunit.client.0.smithi112.stdout:3/81: symlink d8/l14 0 2024-09-19T09:35:10.365 INFO:tasks.workunit.client.0.smithi112.stdout:3/82: write d8/ff [1085824,4672] 0 2024-09-19T09:35:10.371 INFO:tasks.workunit.client.0.smithi112.stdout:4/245: dread d1/d3d/d41/f27 [0,4194304] 0 2024-09-19T09:35:10.371 INFO:tasks.workunit.client.0.smithi112.stdout:4/246: creat d1/d4/d3a/f5d x:0 0 0 2024-09-19T09:35:10.372 INFO:tasks.workunit.client.0.smithi112.stdout:8/112: dread d7/d10/f16 [0,4194304] 0 2024-09-19T09:35:10.372 INFO:tasks.workunit.client.0.smithi112.stdout:3/83: mkdir d8/d15 0 2024-09-19T09:35:10.376 INFO:tasks.workunit.client.0.smithi112.stdout:4/247: mknod d1/d31/d51/d37/c5e 0 2024-09-19T09:35:10.376 INFO:tasks.workunit.client.0.smithi112.stdout:4/248: chown d1/d4/f32 2331221 1 2024-09-19T09:35:10.376 INFO:tasks.workunit.client.0.smithi112.stdout:4/249: chown d1/l4b 149745245 1 2024-09-19T09:35:10.378 INFO:tasks.workunit.client.0.smithi112.stdout:5/63: dread d4/f5 [0,4194304] 0 2024-09-19T09:35:10.378 INFO:tasks.workunit.client.0.smithi112.stdout:5/64: stat d4/d9/f10 0 2024-09-19T09:35:10.380 INFO:tasks.workunit.client.0.smithi112.stdout:4/250: mkdir d1/d5f 0 2024-09-19T09:35:10.380 INFO:tasks.workunit.client.0.smithi112.stdout:4/251: chown d1/d31/d43/c47 1 1 2024-09-19T09:35:10.380 INFO:tasks.workunit.client.0.smithi112.stdout:4/252: readlink d1/d31/d51/l21 0 2024-09-19T09:35:10.384 INFO:tasks.workunit.client.0.smithi112.stdout:4/253: dread d1/d31/d51/f2f [0,4194304] 0 2024-09-19T09:35:10.387 INFO:tasks.workunit.client.0.smithi112.stdout:4/254: write d1/d4/d3a/f22 [496635,83117] 0 2024-09-19T09:35:10.389 INFO:tasks.workunit.client.0.smithi112.stdout:4/255: mkdir d1/d4/d3a/d57/d60 0 2024-09-19T09:35:10.411 INFO:tasks.workunit.client.0.smithi112.stdout:8/113: dwrite d7/d10/f16 [4194304,4194304] 0 2024-09-19T09:35:10.411 INFO:tasks.workunit.client.0.smithi112.stdout:8/114: chown d7/d10/d11 4136969 1 2024-09-19T09:35:10.417 INFO:tasks.workunit.client.0.smithi112.stdout:3/84: dwrite f7 [0,4194304] 0 2024-09-19T09:35:10.417 INFO:tasks.workunit.client.0.smithi112.stdout:5/65: dwrite d4/d9/ff [0,4194304] 0 2024-09-19T09:35:10.417 INFO:tasks.workunit.client.0.smithi112.stdout:4/256: dwrite d1/f1f [0,4194304] 0 2024-09-19T09:35:10.417 INFO:tasks.workunit.client.0.smithi112.stdout:4/257: write d1/f2c [1246866,126193] 0 2024-09-19T09:35:10.421 INFO:tasks.workunit.client.0.smithi112.stdout:5/66: creat d4/d9/f1c x:0 0 0 2024-09-19T09:35:10.424 INFO:tasks.workunit.client.0.smithi112.stdout:3/85: dread d8/ff [4194304,4194304] 0 2024-09-19T09:35:10.424 INFO:tasks.workunit.client.0.smithi112.stdout:8/115: dread d7/ff [0,4194304] 0 2024-09-19T09:35:10.426 INFO:tasks.workunit.client.0.smithi112.stdout:5/67: symlink d4/d9/d17/l1d 0 2024-09-19T09:35:10.428 INFO:tasks.workunit.client.0.smithi112.stdout:5/68: link d4/d15/l1a d4/d9/d17/l1e 0 2024-09-19T09:35:10.430 INFO:tasks.workunit.client.0.smithi112.stdout:5/69: link d4/f13 d4/d9/d17/f1f 0 2024-09-19T09:35:10.430 INFO:tasks.workunit.client.0.smithi112.stdout:5/70: write d4/d9/f1c [609816,39436] 0 2024-09-19T09:35:10.433 INFO:tasks.workunit.client.0.smithi112.stdout:4/258: dwrite d1/d3d/f40 [0,4194304] 0 2024-09-19T09:35:10.433 INFO:tasks.workunit.client.0.smithi112.stdout:4/259: chown d1/d3d/d41/c2b 7143 1 2024-09-19T09:35:10.434 INFO:tasks.workunit.client.0.smithi112.stdout:4/260: chown d1/d31/l54 9688573 1 2024-09-19T09:35:10.434 INFO:tasks.workunit.client.0.smithi112.stdout:8/116: dread d7/ff [0,4194304] 0 2024-09-19T09:35:10.434 INFO:tasks.workunit.client.0.smithi112.stdout:5/71: rename d4/f5 to d4/d15/f20 0 2024-09-19T09:35:10.443 INFO:tasks.workunit.client.0.smithi112.stdout:5/72: read d4/d9/f11 [2994167,36364] 0 2024-09-19T09:35:10.443 INFO:tasks.workunit.client.0.smithi112.stdout:5/73: dread - d4/f13 zero size 2024-09-19T09:35:10.443 INFO:tasks.workunit.client.0.smithi112.stdout:5/74: chown d4/d9/d17/f1f 244 1 2024-09-19T09:35:10.449 INFO:tasks.workunit.client.0.smithi112.stdout:4/261: truncate d1/d3d/f40 630838 0 2024-09-19T09:35:10.450 INFO:tasks.workunit.client.0.smithi112.stdout:4/262: write d1/f2c [513774,117042] 0 2024-09-19T09:35:10.453 INFO:tasks.workunit.client.0.smithi112.stdout:5/75: dread d4/d15/f20 [0,4194304] 0 2024-09-19T09:35:10.453 INFO:tasks.workunit.client.0.smithi112.stdout:3/86: dwrite d8/fb [0,4194304] 0 2024-09-19T09:35:10.454 INFO:tasks.workunit.client.0.smithi112.stdout:5/76: readlink d4/d9/l18 0 2024-09-19T09:35:10.460 INFO:tasks.workunit.client.0.smithi112.stdout:5/77: link d4/d9/c14 d4/d9/c21 0 2024-09-19T09:35:10.462 INFO:tasks.workunit.client.0.smithi112.stdout:5/78: symlink d4/d1b/l22 0 2024-09-19T09:35:10.463 INFO:tasks.workunit.client.0.smithi112.stdout:5/79: mknod d4/c23 0 2024-09-19T09:35:10.465 INFO:tasks.workunit.client.0.smithi112.stdout:5/80: symlink d4/d1b/l24 0 2024-09-19T09:35:10.466 INFO:tasks.workunit.client.0.smithi112.stdout:5/81: chown d4/d9/c21 4 1 2024-09-19T09:35:10.471 INFO:tasks.workunit.client.0.smithi112.stdout:8/117: dwrite d7/fa [0,4194304] 0 2024-09-19T09:35:10.471 INFO:tasks.workunit.client.0.smithi112.stdout:8/118: write d7/d10/d11/f12 [5004426,79647] 0 2024-09-19T09:35:10.471 INFO:tasks.workunit.client.0.smithi112.stdout:8/119: readlink d7/d10/l1a 0 2024-09-19T09:35:10.472 INFO:tasks.workunit.client.0.smithi112.stdout:4/263: dwrite d1/f46 [0,4194304] 0 2024-09-19T09:35:10.472 INFO:tasks.workunit.client.0.smithi112.stdout:4/264: read d1/d3d/f44 [495705,64637] 0 2024-09-19T09:35:10.472 INFO:tasks.workunit.client.0.smithi112.stdout:4/265: creat d1/d3d/f61 x:0 0 0 2024-09-19T09:35:10.473 INFO:tasks.workunit.client.0.smithi112.stdout:8/120: link c6 d7/db/d21/c23 0 2024-09-19T09:35:10.473 INFO:tasks.workunit.client.0.smithi112.stdout:8/121: dread - d7/db/d21/f22 zero size 2024-09-19T09:35:10.475 INFO:tasks.workunit.client.0.smithi112.stdout:3/87: truncate d8/fd 96458 0 2024-09-19T09:35:10.478 INFO:tasks.workunit.client.0.smithi112.stdout:4/266: truncate d1/d31/d51/f2f 247613 0 2024-09-19T09:35:10.481 INFO:tasks.workunit.client.0.smithi112.stdout:8/122: rmdir d7/db 39 2024-09-19T09:35:10.481 INFO:tasks.workunit.client.0.smithi112.stdout:8/123: write d7/fd [397041,87933] 0 2024-09-19T09:35:10.481 INFO:tasks.workunit.client.0.smithi112.stdout:8/124: chown d7/ff 1 1 2024-09-19T09:35:10.482 INFO:tasks.workunit.client.0.smithi112.stdout:3/88: mknod d8/d15/c16 0 2024-09-19T09:35:10.482 INFO:tasks.workunit.client.0.smithi112.stdout:3/89: creat d8/f17 x:0 0 0 2024-09-19T09:35:10.482 INFO:tasks.workunit.client.0.smithi112.stdout:4/267: mkdir d1/d4/d3a/d57/d62 0 2024-09-19T09:35:10.485 INFO:tasks.workunit.client.0.smithi112.stdout:8/125: creat d7/db/d21/f24 x:0 0 0 2024-09-19T09:35:10.485 INFO:tasks.workunit.client.0.smithi112.stdout:8/126: write d7/db/d21/f22 [259396,100186] 0 2024-09-19T09:35:10.485 INFO:tasks.workunit.client.0.smithi112.stdout:8/127: creat d7/d10/f25 x:0 0 0 2024-09-19T09:35:10.490 INFO:tasks.workunit.client.0.smithi112.stdout:3/90: unlink d8/fe 0 2024-09-19T09:35:10.490 INFO:tasks.workunit.client.0.smithi112.stdout:3/91: rename d8 to d8/d18 22 2024-09-19T09:35:10.491 INFO:tasks.workunit.client.0.smithi112.stdout:5/82: dwrite d4/d9/f11 [0,4194304] 0 2024-09-19T09:35:10.491 INFO:tasks.workunit.client.0.smithi112.stdout:5/83: chown d4/d9/ff 897 1 2024-09-19T09:35:10.491 INFO:tasks.workunit.client.0.smithi112.stdout:5/84: creat d4/d9/f25 x:0 0 0 2024-09-19T09:35:10.494 INFO:tasks.workunit.client.0.smithi112.stdout:8/128: creat d7/d10/d11/f26 x:0 0 0 2024-09-19T09:35:10.498 INFO:tasks.workunit.client.0.smithi112.stdout:5/85: rename d4/d9/lc to d4/l26 0 2024-09-19T09:35:10.498 INFO:tasks.workunit.client.0.smithi112.stdout:5/86: write d4/d9/f11 [7009398,95145] 0 2024-09-19T09:35:10.498 INFO:tasks.workunit.client.0.smithi112.stdout:5/87: write d4/d9/f10 [842760,14897] 0 2024-09-19T09:35:10.501 INFO:tasks.workunit.client.0.smithi112.stdout:4/268: dwrite d1/d3d/f44 [0,4194304] 0 2024-09-19T09:35:10.502 INFO:tasks.workunit.client.0.smithi112.stdout:5/88: mknod d4/c27 0 2024-09-19T09:35:10.514 INFO:tasks.workunit.client.0.smithi112.stdout:8/129: rmdir d7/d10/d11 39 2024-09-19T09:35:10.520 INFO:tasks.workunit.client.0.smithi112.stdout:8/130: dread d7/ff [0,4194304] 0 2024-09-19T09:35:10.520 INFO:tasks.workunit.client.0.smithi112.stdout:8/131: write d7/db/d21/f22 [1056926,53755] 0 2024-09-19T09:35:10.525 INFO:tasks.workunit.client.0.smithi112.stdout:8/132: dread d7/ff [0,4194304] 0 2024-09-19T09:35:10.526 INFO:tasks.workunit.client.0.smithi112.stdout:8/133: chown d7/d10/d11/c17 223185540 1 2024-09-19T09:35:10.527 INFO:tasks.workunit.client.0.smithi112.stdout:4/269: dwrite d1/d31/d51/f55 [0,4194304] 0 2024-09-19T09:35:10.527 INFO:tasks.workunit.client.0.smithi112.stdout:5/89: dwrite d4/f13 [0,4194304] 0 2024-09-19T09:35:10.534 INFO:tasks.workunit.client.0.smithi112.stdout:3/92: truncate d8/ff 1319554 0 2024-09-19T09:35:10.534 INFO:tasks.workunit.client.0.smithi112.stdout:3/93: dread - d8/f17 zero size 2024-09-19T09:35:10.534 INFO:tasks.workunit.client.0.smithi112.stdout:3/94: rename d8 to d8/d19 22 2024-09-19T09:35:10.555 INFO:tasks.workunit.client.0.smithi112.stdout:5/90: dwrite d4/d9/f10 [0,4194304] 0 2024-09-19T09:35:10.555 INFO:tasks.workunit.client.0.smithi112.stdout:8/134: dwrite d7/db/d21/f22 [0,4194304] 0 2024-09-19T09:35:10.616 INFO:tasks.workunit.client.0.smithi112.stdout:5/91: dread d4/f13 [0,4194304] 0 2024-09-19T09:35:10.616 INFO:tasks.workunit.client.0.smithi112.stdout:5/92: write d4/d9/f25 [599619,88211] 0 2024-09-19T09:35:10.616 INFO:tasks.workunit.client.0.smithi112.stdout:5/93: creat d4/d9/f28 x:0 0 0 2024-09-19T09:35:10.621 INFO:tasks.workunit.client.0.smithi112.stdout:8/135: dwrite d7/db/d21/f22 [0,4194304] 0 2024-09-19T09:35:10.624 INFO:tasks.workunit.client.0.smithi112.stdout:5/94: dread d4/f13 [0,4194304] 0 2024-09-19T09:35:10.698 INFO:tasks.workunit.client.0.smithi112.stdout:5/95: rename d4/d15 to d4/d29 0 2024-09-19T09:35:10.704 INFO:tasks.workunit.client.0.smithi112.stdout:8/136: rmdir d7 39 2024-09-19T09:35:10.707 INFO:tasks.workunit.client.0.smithi112.stdout:5/96: mkdir d4/d9/d2a 0 2024-09-19T09:35:10.709 INFO:tasks.workunit.client.0.smithi112.stdout:8/137: creat d7/db/d15/f27 x:0 0 0 2024-09-19T09:35:10.711 INFO:tasks.workunit.client.0.smithi112.stdout:5/97: stat d4/d9/c14 0 2024-09-19T09:35:10.713 INFO:tasks.workunit.client.0.smithi112.stdout:8/138: mkdir d7/d10/d11/d28 0 2024-09-19T09:35:10.716 INFO:tasks.workunit.client.0.smithi112.stdout:5/98: symlink d4/l2b 0 2024-09-19T09:35:10.725 INFO:tasks.workunit.client.0.smithi112.stdout:8/139: read d7/db/d21/f22 [3665821,82685] 0 2024-09-19T09:35:10.728 INFO:tasks.workunit.client.0.smithi112.stdout:8/140: mknod d7/d10/d11/d28/c29 0 2024-09-19T09:35:10.732 INFO:tasks.workunit.client.0.smithi112.stdout:5/99: dwrite d4/d9/f11 [4194304,4194304] 0 2024-09-19T09:35:10.737 INFO:tasks.workunit.client.0.smithi112.stdout:5/100: creat d4/d1b/f2c x:0 0 0 2024-09-19T09:35:10.740 INFO:tasks.workunit.client.0.smithi112.stdout:5/101: creat d4/d29/f2d x:0 0 0 2024-09-19T09:35:10.750 INFO:tasks.workunit.client.0.smithi112.stdout:8/141: dwrite d7/fa [0,4194304] 0 2024-09-19T09:35:10.757 INFO:tasks.workunit.client.0.smithi112.stdout:8/142: getdents d7/db/d21 0 2024-09-19T09:35:10.757 INFO:tasks.workunit.client.0.smithi112.stdout:8/143: chown c2 0 1 2024-09-19T09:35:10.763 INFO:tasks.workunit.client.0.smithi112.stdout:5/102: dwrite d4/d9/f25 [0,4194304] 0 2024-09-19T09:35:10.769 INFO:tasks.workunit.client.0.smithi112.stdout:8/144: dread d7/fa [0,4194304] 0 2024-09-19T09:35:10.769 INFO:tasks.workunit.client.0.smithi112.stdout:8/145: readlink d7/db/l1f 0 2024-09-19T09:35:10.771 INFO:tasks.workunit.client.0.smithi112.stdout:8/146: rmdir d7 39 2024-09-19T09:35:10.771 INFO:tasks.workunit.client.0.smithi112.stdout:8/147: write d7/db/d21/f24 [567549,66512] 0 2024-09-19T09:35:10.771 INFO:tasks.workunit.client.0.smithi112.stdout:8/148: fdatasync d7/db/d21/f22 0 2024-09-19T09:35:10.775 INFO:tasks.workunit.client.0.smithi112.stdout:8/149: creat d7/db/d21/f2a x:0 0 0 2024-09-19T09:35:10.776 INFO:tasks.workunit.client.0.smithi112.stdout:8/150: chown d7/d10/d11/d28/c29 659 1 2024-09-19T09:35:10.779 INFO:tasks.workunit.client.0.smithi112.stdout:8/151: rmdir d7 39 2024-09-19T09:35:10.779 INFO:tasks.workunit.client.0.smithi112.stdout:8/152: truncate d7/db/d21/f22 4706730 0 2024-09-19T09:35:10.782 INFO:tasks.workunit.client.0.smithi112.stdout:5/103: dwrite d4/d9/f28 [0,4194304] 0 2024-09-19T09:35:10.801 INFO:tasks.workunit.client.0.smithi112.stdout:8/153: dwrite d7/fe [4194304,4194304] 0 2024-09-19T09:35:10.801 INFO:tasks.workunit.client.0.smithi112.stdout:8/154: chown d7/db/lc 7 1 2024-09-19T09:35:10.804 INFO:tasks.workunit.client.0.smithi112.stdout:8/155: creat d7/d10/d11/f2b x:0 0 0 2024-09-19T09:35:10.804 INFO:tasks.workunit.client.0.smithi112.stdout:8/156: stat d7/d10/c18 0 2024-09-19T09:35:10.809 INFO:tasks.workunit.client.0.smithi112.stdout:8/157: dread d7/fa [0,4194304] 0 2024-09-19T09:35:10.826 INFO:tasks.workunit.client.0.smithi112.stdout:5/104: rename d4/d1b to d4/d9/d17/d2e 0 2024-09-19T09:35:10.830 INFO:tasks.workunit.client.0.smithi112.stdout:8/158: rename d7/db/d15 to d7/d10/d2c 0 2024-09-19T09:35:10.830 INFO:tasks.workunit.client.0.smithi112.stdout:8/159: fsync d7/db/d21/f22 0 2024-09-19T09:35:10.836 INFO:tasks.workunit.client.0.smithi112.stdout:5/105: dread d4/d9/ff [0,4194304] 0 2024-09-19T09:35:10.838 INFO:tasks.workunit.client.0.smithi112.stdout:5/106: mkdir d4/d9/d17/d2f 0 2024-09-19T09:35:10.839 INFO:tasks.workunit.client.0.smithi112.stdout:5/107: mkdir d4/d9/d17/d30 0 2024-09-19T09:35:10.839 INFO:tasks.workunit.client.0.smithi112.stdout:5/108: mknod d4/d29/c31 0 2024-09-19T09:35:10.840 INFO:tasks.workunit.client.0.smithi112.stdout:5/109: creat d4/d9/d17/d2f/f32 x:0 0 0 2024-09-19T09:35:10.841 INFO:tasks.workunit.client.0.smithi112.stdout:5/110: unlink d4/l19 0 2024-09-19T09:35:10.843 INFO:tasks.workunit.client.0.smithi112.stdout:5/111: link d4/l2b d4/d9/d17/d2f/l33 0 2024-09-19T09:35:10.844 INFO:tasks.workunit.client.0.smithi112.stdout:5/112: link d4/f13 d4/f34 0 2024-09-19T09:35:10.845 INFO:tasks.workunit.client.0.smithi112.stdout:5/113: symlink d4/l35 0 2024-09-19T09:35:10.849 INFO:tasks.workunit.client.0.smithi112.stdout:5/114: dread d4/f13 [0,4194304] 0 2024-09-19T09:35:10.857 INFO:tasks.workunit.client.0.smithi112.stdout:8/160: rmdir d7/d10/d11 39 2024-09-19T09:35:10.857 INFO:tasks.workunit.client.0.smithi112.stdout:5/115: write d4/d9/f10 [217949,118044] 0 2024-09-19T09:35:10.858 INFO:tasks.workunit.client.0.smithi112.stdout:8/161: symlink d7/db/d21/l2d 0 2024-09-19T09:35:10.858 INFO:tasks.workunit.client.0.smithi112.stdout:8/162: readlink d7/db/lc 0 2024-09-19T09:35:10.860 INFO:tasks.workunit.client.0.smithi112.stdout:5/116: mkdir d4/d29/d36 0 2024-09-19T09:35:10.860 INFO:tasks.workunit.client.0.smithi112.stdout:5/117: readlink d4/d9/l18 0 2024-09-19T09:35:10.862 INFO:tasks.workunit.client.0.smithi112.stdout:8/163: mkdir d7/db/d21/d2e 0 2024-09-19T09:35:10.862 INFO:tasks.workunit.client.0.smithi112.stdout:8/164: write d7/d10/d2c/f27 [826519,118516] 0 2024-09-19T09:35:10.863 INFO:tasks.workunit.client.0.smithi112.stdout:8/165: rename d7 to d7/d10/d2c/d2f 22 2024-09-19T09:35:10.865 INFO:tasks.workunit.client.0.smithi112.stdout:8/166: mkdir d7/db/d21/d30 0 2024-09-19T09:35:10.871 INFO:tasks.workunit.client.0.smithi112.stdout:8/167: write d7/ff [1426901,93625] 0 2024-09-19T09:35:10.872 INFO:tasks.workunit.client.0.smithi112.stdout:8/168: rename d7/d10/d2c/l20 to d7/db/d21/l31 0 2024-09-19T09:35:10.875 INFO:tasks.workunit.client.0.smithi112.stdout:5/118: dwrite d4/d9/d17/f1f [0,4194304] 0 2024-09-19T09:35:10.875 INFO:tasks.workunit.client.0.smithi112.stdout:5/119: creat d4/d9/f37 x:0 0 0 2024-09-19T09:35:10.877 INFO:tasks.workunit.client.0.smithi112.stdout:5/120: creat d4/d9/d17/d30/f38 x:0 0 0 2024-09-19T09:35:10.887 INFO:tasks.workunit.client.0.smithi112.stdout:5/121: write d4/d29/f20 [7383531,76815] 0 2024-09-19T09:35:10.889 INFO:tasks.workunit.client.0.smithi112.stdout:8/169: dwrite d7/fa [0,4194304] 0 2024-09-19T09:35:10.890 INFO:tasks.workunit.client.0.smithi112.stdout:8/170: symlink d7/d10/d11/d28/l32 0 2024-09-19T09:35:10.895 INFO:tasks.workunit.client.0.smithi112.stdout:8/171: getdents d7/db/d21 0 2024-09-19T09:35:10.899 INFO:tasks.workunit.client.0.smithi112.stdout:5/122: dread d4/d29/f20 [0,4194304] 0 2024-09-19T09:35:10.899 INFO:tasks.workunit.client.0.smithi112.stdout:5/123: readlink d4/l26 0 2024-09-19T09:35:10.901 INFO:tasks.workunit.client.0.smithi112.stdout:5/124: mkdir d4/d9/d2a/d39 0 2024-09-19T09:35:10.902 INFO:tasks.workunit.client.0.smithi112.stdout:5/125: fsync d4/f13 0 2024-09-19T09:35:10.904 INFO:tasks.workunit.client.0.smithi112.stdout:8/172: dread d7/db/d21/f24 [0,4194304] 0 2024-09-19T09:35:10.904 INFO:tasks.workunit.client.0.smithi112.stdout:8/173: write d7/db/d21/f2a [211521,454] 0 2024-09-19T09:35:10.904 INFO:tasks.workunit.client.0.smithi112.stdout:5/126: creat d4/d9/d2a/d39/f3a x:0 0 0 2024-09-19T09:35:10.906 INFO:tasks.workunit.client.0.smithi112.stdout:5/127: mkdir d4/d3b 0 2024-09-19T09:35:10.906 INFO:tasks.workunit.client.0.smithi112.stdout:5/128: truncate d4/d9/d17/d2f/f32 723042 0 2024-09-19T09:35:10.908 INFO:tasks.workunit.client.0.smithi112.stdout:5/129: rename d4/d9/f11 to d4/d29/f3c 0 2024-09-19T09:35:10.912 INFO:tasks.workunit.client.0.smithi112.stdout:5/130: mknod d4/d9/d17/d2e/c3d 0 2024-09-19T09:35:10.912 INFO:tasks.workunit.client.0.smithi112.stdout:5/131: dread - d4/d9/d17/d30/f38 zero size 2024-09-19T09:35:10.913 INFO:tasks.workunit.client.0.smithi112.stdout:5/132: stat d4/d9/l18 0 2024-09-19T09:35:10.913 INFO:tasks.workunit.client.0.smithi112.stdout:5/133: fsync d4/d9/f1c 0 2024-09-19T09:35:10.914 INFO:tasks.workunit.client.0.smithi112.stdout:5/134: mkdir d4/d9/d3e 0 2024-09-19T09:35:10.915 INFO:tasks.workunit.client.0.smithi112.stdout:5/135: mkdir d4/d3f 0 2024-09-19T09:35:10.921 INFO:tasks.workunit.client.0.smithi112.stdout:5/136: read d4/d9/ff [1909857,12081] 0 2024-09-19T09:35:10.921 INFO:tasks.workunit.client.0.smithi112.stdout:5/137: readlink d4/lb 0 2024-09-19T09:35:10.923 INFO:tasks.workunit.client.0.smithi112.stdout:5/138: rename d4/d29/l1a to d4/d9/d3e/l40 0 2024-09-19T09:35:10.924 INFO:tasks.workunit.client.0.smithi112.stdout:5/139: creat d4/d9/d17/d2e/f41 x:0 0 0 2024-09-19T09:35:10.926 INFO:tasks.workunit.client.0.smithi112.stdout:5/140: unlink d4/d9/ff 0 2024-09-19T09:35:10.926 INFO:tasks.workunit.client.0.smithi112.stdout:5/141: creat d4/d9/d17/d2e/f42 x:0 0 0 2024-09-19T09:35:10.933 INFO:tasks.workunit.client.0.smithi112.stdout:5/142: dread d4/f13 [0,4194304] 0 2024-09-19T09:35:10.935 INFO:tasks.workunit.client.0.smithi112.stdout:5/143: creat d4/d9/d2a/f43 x:0 0 0 2024-09-19T09:35:10.937 INFO:tasks.workunit.client.0.smithi112.stdout:5/144: rename d4/d9/d17/f1f to d4/d9/d17/d30/f44 0 2024-09-19T09:35:10.937 INFO:tasks.workunit.client.0.smithi112.stdout:5/145: write d4/d9/d2a/f43 [864755,53285] 0 2024-09-19T09:35:10.937 INFO:tasks.workunit.client.0.smithi112.stdout:5/146: dread - d4/d9/d17/d30/f38 zero size 2024-09-19T09:35:10.937 INFO:tasks.workunit.client.0.smithi112.stdout:5/147: dread - d4/d9/d17/d2e/f41 zero size 2024-09-19T09:35:10.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:10 smithi112 ceph-mon[27605]: pgmap v17: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 250 MiB/s rd, 322 MiB/s wr, 771 op/s 2024-09-19T09:35:10.960 INFO:tasks.workunit.client.0.smithi112.stdout:5/148: link d4/d9/l18 d4/d3f/l45 0 2024-09-19T09:35:10.961 INFO:tasks.workunit.client.0.smithi112.stdout:5/149: unlink d4/d9/d17/d2e/l22 0 2024-09-19T09:35:10.974 INFO:tasks.workunit.client.0.smithi112.stdout:5/150: dwrite d4/d9/d17/d2f/f32 [0,4194304] 0 2024-09-19T09:35:10.977 INFO:tasks.workunit.client.0.smithi112.stdout:5/151: getdents d4/d3f 0 2024-09-19T09:35:10.978 INFO:tasks.workunit.client.0.smithi112.stdout:5/152: mkdir d4/d9/d2a/d46 0 2024-09-19T09:35:10.979 INFO:tasks.workunit.client.0.smithi112.stdout:5/153: unlink d4/c27 0 2024-09-19T09:35:10.995 INFO:tasks.workunit.client.0.smithi112.stdout:5/154: dwrite d4/d9/d17/d2e/f42 [0,4194304] 0 2024-09-19T09:35:10.998 INFO:tasks.workunit.client.0.smithi112.stdout:5/155: creat d4/f47 x:0 0 0 2024-09-19T09:35:11.002 INFO:tasks.workunit.client.0.smithi112.stdout:5/156: dread d4/d29/f3c [0,4194304] 0 2024-09-19T09:35:11.004 INFO:tasks.workunit.client.0.smithi112.stdout:5/157: rename l1 to d4/d29/d36/l48 0 2024-09-19T09:35:11.004 INFO:tasks.workunit.client.0.smithi112.stdout:5/158: truncate d4/d9/f1c 1083024 0 2024-09-19T09:35:11.004 INFO:tasks.workunit.client.0.smithi112.stdout:5/159: read - d4/d29/f2d zero size 2024-09-19T09:35:11.004 INFO:tasks.workunit.client.0.smithi112.stdout:5/160: dread - d4/d29/f2d zero size 2024-09-19T09:35:11.007 INFO:tasks.workunit.client.0.smithi112.stdout:5/161: getdents d4/d9/d17/d2f 0 2024-09-19T09:35:11.007 INFO:tasks.workunit.client.0.smithi112.stdout:5/162: chown d4/d9/f25 35246730 1 2024-09-19T09:35:11.024 INFO:tasks.workunit.client.0.smithi112.stdout:5/163: dwrite d4/d9/f28 [0,4194304] 0 2024-09-19T09:35:11.025 INFO:tasks.workunit.client.0.smithi112.stdout:5/164: write d4/f47 [836816,11664] 0 2024-09-19T09:35:11.025 INFO:tasks.workunit.client.0.smithi112.stdout:5/165: write d4/d9/d17/d30/f38 [139434,76130] 0 2024-09-19T09:35:11.026 INFO:tasks.workunit.client.0.smithi112.stdout:5/166: rename d4/f47 to d4/d9/d2a/f49 0 2024-09-19T09:35:11.026 INFO:tasks.workunit.client.0.smithi112.stdout:5/167: fsync d4/d9/d17/d2e/f41 0 2024-09-19T09:35:11.026 INFO:tasks.workunit.client.0.smithi112.stdout:5/168: chown d4/d9/d17/d2e/f42 50 1 2024-09-19T09:35:11.027 INFO:tasks.workunit.client.0.smithi112.stdout:5/169: rename d4/l35 to d4/d9/d3e/l4a 0 2024-09-19T09:35:11.027 INFO:tasks.workunit.client.0.smithi112.stdout:5/170: fsync d4/d29/f20 0 2024-09-19T09:35:11.027 INFO:tasks.workunit.client.0.smithi112.stdout:5/171: chown d4/d3f 127793 1 2024-09-19T09:35:11.028 INFO:tasks.workunit.client.0.smithi112.stdout:5/172: mknod d4/c4b 0 2024-09-19T09:35:11.044 INFO:tasks.workunit.client.0.smithi112.stdout:5/173: dwrite d4/d9/f10 [0,4194304] 0 2024-09-19T09:35:11.045 INFO:tasks.workunit.client.0.smithi112.stdout:5/174: mkdir d4/d29/d4c 0 2024-09-19T09:35:11.045 INFO:tasks.workunit.client.0.smithi112.stdout:5/175: chown d4/d29/f20 0 1 2024-09-19T09:35:11.046 INFO:tasks.workunit.client.0.smithi112.stdout:5/176: rename d4/d9/c16 to d4/d9/d17/d30/c4d 0 2024-09-19T09:35:11.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:10 smithi191 ceph-mon[34834]: pgmap v17: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 250 MiB/s rd, 322 MiB/s wr, 771 op/s 2024-09-19T09:35:11.500 INFO:tasks.workunit.client.0.smithi112.stdout:1/17: sync 2024-09-19T09:35:11.506 INFO:tasks.workunit.client.0.smithi112.stdout:1/18: write f1 [1771111,47660] 0 2024-09-19T09:35:11.508 INFO:tasks.workunit.client.0.smithi112.stdout:1/19: getdents . 0 2024-09-19T09:35:11.508 INFO:tasks.workunit.client.0.smithi112.stdout:1/20: chown f1 15 1 2024-09-19T09:35:11.509 INFO:tasks.workunit.client.0.smithi112.stdout:1/21: symlink l3 0 2024-09-19T09:35:11.509 INFO:tasks.workunit.client.0.smithi112.stdout:1/22: chown l3 48039720 1 2024-09-19T09:35:11.511 INFO:tasks.workunit.client.0.smithi112.stdout:1/23: creat f4 x:0 0 0 2024-09-19T09:35:11.513 INFO:tasks.workunit.client.0.smithi112.stdout:1/24: fdatasync f1 0 2024-09-19T09:35:11.514 INFO:tasks.workunit.client.0.smithi112.stdout:1/25: symlink l5 0 2024-09-19T09:35:11.516 INFO:tasks.workunit.client.0.smithi112.stdout:1/26: dread f1 [0,4194304] 0 2024-09-19T09:35:11.518 INFO:tasks.workunit.client.0.smithi112.stdout:1/27: link f4 f6 0 2024-09-19T09:35:11.518 INFO:tasks.workunit.client.0.smithi112.stdout:1/28: write f4 [390968,114639] 0 2024-09-19T09:35:11.520 INFO:tasks.workunit.client.0.smithi112.stdout:1/29: fdatasync f6 0 2024-09-19T09:35:11.521 INFO:tasks.workunit.client.0.smithi112.stdout:1/30: mknod c7 0 2024-09-19T09:35:11.523 INFO:tasks.workunit.client.0.smithi112.stdout:1/31: rename f4 to f8 0 2024-09-19T09:35:11.523 INFO:tasks.workunit.client.0.smithi112.stdout:1/32: fsync f1 0 2024-09-19T09:35:11.523 INFO:tasks.workunit.client.0.smithi112.stdout:1/33: write f1 [1987504,59981] 0 2024-09-19T09:35:11.523 INFO:tasks.workunit.client.0.smithi112.stdout:1/34: rmdir - no directory 2024-09-19T09:35:11.523 INFO:tasks.workunit.client.0.smithi112.stdout:1/35: truncate f8 818587 0 2024-09-19T09:35:11.524 INFO:tasks.workunit.client.0.smithi112.stdout:1/36: symlink l9 0 2024-09-19T09:35:11.524 INFO:tasks.workunit.client.0.smithi112.stdout:1/37: write f1 [183925,97103] 0 2024-09-19T09:35:11.533 INFO:tasks.workunit.client.0.smithi112.stdout:1/38: getdents . 0 2024-09-19T09:35:11.732 INFO:tasks.workunit.client.0.smithi112.stdout:7/12: sync 2024-09-19T09:35:11.733 INFO:tasks.workunit.client.0.smithi112.stdout:7/13: creat d2/f4 x:0 0 0 2024-09-19T09:35:11.733 INFO:tasks.workunit.client.0.smithi112.stdout:7/14: creat d2/f5 x:0 0 0 2024-09-19T09:35:11.735 INFO:tasks.workunit.client.0.smithi112.stdout:7/15: mknod d2/c6 0 2024-09-19T09:35:11.735 INFO:tasks.workunit.client.0.smithi112.stdout:7/16: readlink l1 0 2024-09-19T09:35:11.741 INFO:tasks.workunit.client.0.smithi112.stdout:7/17: rmdir d2 39 2024-09-19T09:35:11.743 INFO:tasks.workunit.client.0.smithi112.stdout:7/18: mknod d2/c7 0 2024-09-19T09:35:11.743 INFO:tasks.workunit.client.0.smithi112.stdout:7/19: write d2/f5 [368842,107250] 0 2024-09-19T09:35:11.743 INFO:tasks.workunit.client.0.smithi112.stdout:7/20: write d2/f4 [347829,66956] 0 2024-09-19T09:35:11.744 INFO:tasks.workunit.client.0.smithi112.stdout:7/21: mkdir d2/d8 0 2024-09-19T09:35:11.745 INFO:tasks.workunit.client.0.smithi112.stdout:7/22: read d2/f4 [176557,48673] 0 2024-09-19T09:35:11.745 INFO:tasks.workunit.client.0.smithi112.stdout:7/23: chown d2/c6 23868591 1 2024-09-19T09:35:11.745 INFO:tasks.workunit.client.0.smithi112.stdout:7/24: creat d2/f9 x:0 0 0 2024-09-19T09:35:11.745 INFO:tasks.workunit.client.0.smithi112.stdout:7/25: dread - d2/f9 zero size 2024-09-19T09:35:11.745 INFO:tasks.workunit.client.0.smithi112.stdout:7/26: rename d2/d8 to d2/d8/da 22 2024-09-19T09:35:11.746 INFO:tasks.workunit.client.0.smithi112.stdout:7/27: dread - d2/f9 zero size 2024-09-19T09:35:11.746 INFO:tasks.workunit.client.0.smithi112.stdout:7/28: stat d2 0 2024-09-19T09:35:11.763 INFO:tasks.workunit.client.0.smithi112.stdout:7/29: dwrite d2/f4 [0,4194304] 0 2024-09-19T09:35:11.769 INFO:tasks.workunit.client.0.smithi112.stdout:7/30: truncate d2/f4 4130933 0 2024-09-19T09:35:11.772 INFO:tasks.workunit.client.0.smithi112.stdout:7/31: rmdir d2 39 2024-09-19T09:35:11.775 INFO:tasks.workunit.client.0.smithi112.stdout:7/32: mknod d2/cb 0 2024-09-19T09:35:11.776 INFO:tasks.workunit.client.0.smithi112.stdout:7/33: creat d2/d8/fc x:0 0 0 2024-09-19T09:35:11.776 INFO:tasks.workunit.client.0.smithi112.stdout:7/34: dread - d2/f9 zero size 2024-09-19T09:35:11.778 INFO:tasks.workunit.client.0.smithi112.stdout:7/35: creat d2/fd x:0 0 0 2024-09-19T09:35:11.778 INFO:tasks.workunit.client.0.smithi112.stdout:7/36: truncate d2/d8/fc 492531 0 2024-09-19T09:35:11.778 INFO:tasks.workunit.client.0.smithi112.stdout:7/37: truncate d2/d8/fc 507208 0 2024-09-19T09:35:11.778 INFO:tasks.workunit.client.0.smithi112.stdout:7/38: write d2/d8/fc [747412,83048] 0 2024-09-19T09:35:11.778 INFO:tasks.workunit.client.0.smithi112.stdout:7/39: write d2/fd [656043,28362] 0 2024-09-19T09:35:11.787 INFO:tasks.workunit.client.0.smithi112.stdout:7/40: dread d2/f4 [0,4194304] 0 2024-09-19T09:35:11.801 INFO:tasks.workunit.client.0.smithi112.stdout:7/41: dwrite d2/f5 [0,4194304] 0 2024-09-19T09:35:11.895 INFO:tasks.workunit.client.0.smithi112.stdout:9/8: sync 2024-09-19T09:35:11.895 INFO:tasks.workunit.client.0.smithi112.stdout:9/9: fsync f0 0 2024-09-19T09:35:11.896 INFO:tasks.workunit.client.0.smithi112.stdout:9/10: symlink l4 0 2024-09-19T09:35:11.897 INFO:tasks.workunit.client.0.smithi112.stdout:9/11: symlink l5 0 2024-09-19T09:35:11.913 INFO:tasks.workunit.client.0.smithi112.stdout:9/12: dwrite f0 [0,4194304] 0 2024-09-19T09:35:11.915 INFO:tasks.workunit.client.0.smithi112.stdout:9/13: write f0 [5162334,4361] 0 2024-09-19T09:35:11.915 INFO:tasks.workunit.client.0.smithi112.stdout:9/14: fsync f3 0 2024-09-19T09:35:11.915 INFO:tasks.workunit.client.0.smithi112.stdout:9/15: chown c2 936173 1 2024-09-19T09:35:11.916 INFO:tasks.workunit.client.0.smithi112.stdout:9/16: fsync f0 0 2024-09-19T09:35:11.918 INFO:tasks.workunit.client.0.smithi112.stdout:9/17: mknod c6 0 2024-09-19T09:35:11.918 INFO:tasks.workunit.client.0.smithi112.stdout:9/18: read - f3 zero size 2024-09-19T09:35:11.920 INFO:tasks.workunit.client.0.smithi112.stdout:2/22: sync 2024-09-19T09:35:11.920 INFO:tasks.workunit.client.0.smithi112.stdout:6/61: sync 2024-09-19T09:35:11.920 INFO:tasks.workunit.client.0.smithi112.stdout:6/62: stat d8/ca 0 2024-09-19T09:35:11.921 INFO:tasks.workunit.client.0.smithi112.stdout:2/23: creat d0/d1/f8 x:0 0 0 2024-09-19T09:35:11.921 INFO:tasks.workunit.client.0.smithi112.stdout:2/24: chown d0/d1/l3 5 1 2024-09-19T09:35:11.925 INFO:tasks.workunit.client.0.smithi112.stdout:6/63: mkdir d8/d11 0 2024-09-19T09:35:11.926 INFO:tasks.workunit.client.0.smithi112.stdout:2/25: mkdir d0/d1/d9 0 2024-09-19T09:35:11.927 INFO:tasks.workunit.client.0.smithi112.stdout:6/64: symlink d8/l12 0 2024-09-19T09:35:11.927 INFO:tasks.workunit.client.0.smithi112.stdout:6/65: read - d8/f10 zero size 2024-09-19T09:35:11.927 INFO:tasks.workunit.client.0.smithi112.stdout:6/66: readlink l7 0 2024-09-19T09:35:11.928 INFO:tasks.workunit.client.0.smithi112.stdout:2/26: unlink d0/d1/l4 0 2024-09-19T09:35:11.930 INFO:tasks.workunit.client.0.smithi112.stdout:2/27: creat d0/d6/fa x:0 0 0 2024-09-19T09:35:11.930 INFO:tasks.workunit.client.0.smithi112.stdout:2/28: stat d0/d1/d9 0 2024-09-19T09:35:11.930 INFO:tasks.workunit.client.0.smithi112.stdout:2/29: chown d0 1855029 1 2024-09-19T09:35:11.930 INFO:tasks.workunit.client.0.smithi112.stdout:2/30: creat d0/d6/fb x:0 0 0 2024-09-19T09:35:11.930 INFO:tasks.workunit.client.0.smithi112.stdout:2/31: write d0/d1/f8 [698285,15654] 0 2024-09-19T09:35:11.930 INFO:tasks.workunit.client.0.smithi112.stdout:2/32: creat d0/d6/fc x:0 0 0 2024-09-19T09:35:11.933 INFO:tasks.workunit.client.0.smithi112.stdout:9/19: dwrite f0 [0,4194304] 0 2024-09-19T09:35:11.946 INFO:tasks.workunit.client.0.smithi112.stdout:6/67: dwrite d8/f10 [0,4194304] 0 2024-09-19T09:35:11.960 INFO:tasks.workunit.client.0.smithi112.stdout:6/68: write f5 [5591371,78137] 0 2024-09-19T09:35:11.964 INFO:tasks.workunit.client.0.smithi112.stdout:9/20: dwrite f3 [0,4194304] 0 2024-09-19T09:35:11.964 INFO:tasks.workunit.client.0.smithi112.stdout:9/21: creat f7 x:0 0 0 2024-09-19T09:35:11.964 INFO:tasks.workunit.client.0.smithi112.stdout:2/33: dwrite d0/f5 [0,4194304] 0 2024-09-19T09:35:11.964 INFO:tasks.workunit.client.0.smithi112.stdout:6/69: fdatasync f5 0 2024-09-19T09:35:11.964 INFO:tasks.workunit.client.0.smithi112.stdout:2/34: write d0/d1/f7 [450460,84007] 0 2024-09-19T09:35:11.967 INFO:tasks.workunit.client.0.smithi112.stdout:9/22: rename l1 to l8 0 2024-09-19T09:35:11.973 INFO:tasks.workunit.client.0.smithi112.stdout:9/23: dread f0 [0,4194304] 0 2024-09-19T09:35:11.995 INFO:tasks.workunit.client.0.smithi112.stdout:4/270: sync 2024-09-19T09:35:11.995 INFO:tasks.workunit.client.0.smithi112.stdout:7/42: sync 2024-09-19T09:35:11.995 INFO:tasks.workunit.client.0.smithi112.stdout:7/43: chown d2/d8/fc 205112956 1 2024-09-19T09:35:11.996 INFO:tasks.workunit.client.0.smithi112.stdout:4/271: truncate d1/f1f 4358281 0 2024-09-19T09:35:11.996 INFO:tasks.workunit.client.0.smithi112.stdout:0/83: sync 2024-09-19T09:35:11.996 INFO:tasks.workunit.client.0.smithi112.stdout:4/272: write d1/d3d/d41/f52 [677173,9979] 0 2024-09-19T09:35:11.996 INFO:tasks.workunit.client.0.smithi112.stdout:8/174: sync 2024-09-19T09:35:11.996 INFO:tasks.workunit.client.0.smithi112.stdout:1/39: sync 2024-09-19T09:35:11.996 INFO:tasks.workunit.client.0.smithi112.stdout:7/44: creat d2/fe x:0 0 0 2024-09-19T09:35:11.996 INFO:tasks.workunit.client.0.smithi112.stdout:1/40: write f6 [1664181,97964] 0 2024-09-19T09:35:11.996 INFO:tasks.workunit.client.0.smithi112.stdout:3/95: sync 2024-09-19T09:35:11.997 INFO:tasks.workunit.client.0.smithi112.stdout:9/24: dwrite f3 [0,4194304] 0 2024-09-19T09:35:11.997 INFO:tasks.workunit.client.0.smithi112.stdout:9/25: rmdir - no directory 2024-09-19T09:35:11.997 INFO:tasks.workunit.client.0.smithi112.stdout:7/45: write d2/d8/fc [643206,115564] 0 2024-09-19T09:35:11.997 INFO:tasks.workunit.client.0.smithi112.stdout:1/41: write f6 [39004,13835] 0 2024-09-19T09:35:11.997 INFO:tasks.workunit.client.0.smithi112.stdout:1/42: getdents . 0 2024-09-19T09:35:11.997 INFO:tasks.workunit.client.0.smithi112.stdout:1/43: write f2 [487886,54177] 0 2024-09-19T09:35:11.999 INFO:tasks.workunit.client.0.smithi112.stdout:5/177: sync 2024-09-19T09:35:12.005 INFO:tasks.workunit.client.0.smithi112.stdout:8/175: rename d7/d10/d2c to d7/d10/d11/d33 0 2024-09-19T09:35:12.005 INFO:tasks.workunit.client.0.smithi112.stdout:8/176: fsync d7/d10/d11/f2b 0 2024-09-19T09:35:12.005 INFO:tasks.workunit.client.0.smithi112.stdout:8/177: getdents d7/db/d21/d2e 0 2024-09-19T09:35:12.005 INFO:tasks.workunit.client.0.smithi112.stdout:8/178: chown d7/db/d21/f22 3060441 1 2024-09-19T09:35:12.005 INFO:tasks.workunit.client.0.smithi112.stdout:8/179: readlink d7/db/d21/l31 0 2024-09-19T09:35:12.005 INFO:tasks.workunit.client.0.smithi112.stdout:8/180: truncate d7/fa 4336579 0 2024-09-19T09:35:12.006 INFO:tasks.workunit.client.0.smithi112.stdout:4/273: write d1/d4/f32 [280018,74122] 0 2024-09-19T09:35:12.022 INFO:tasks.workunit.client.0.smithi112.stdout:3/96: symlink d8/d15/l1a 0 2024-09-19T09:35:12.023 INFO:tasks.workunit.client.0.smithi112.stdout:5/178: dwrite d4/d9/d17/d30/f44 [4194304,4194304] 0 2024-09-19T09:35:12.023 INFO:tasks.workunit.client.0.smithi112.stdout:4/274: dwrite d1/d3d/f56 [0,4194304] 0 2024-09-19T09:35:12.024 INFO:tasks.workunit.client.0.smithi112.stdout:7/46: mknod d2/d8/cf 0 2024-09-19T09:35:12.028 INFO:tasks.workunit.client.0.smithi112.stdout:1/44: symlink la 0 2024-09-19T09:35:12.031 INFO:tasks.workunit.client.0.smithi112.stdout:0/84: rmdir d2/d11 39 2024-09-19T09:35:12.034 INFO:tasks.workunit.client.0.smithi112.stdout:8/181: mknod d7/c34 0 2024-09-19T09:35:12.034 INFO:tasks.workunit.client.0.smithi112.stdout:8/182: readlink d7/db/lc 0 2024-09-19T09:35:12.036 INFO:tasks.workunit.client.0.smithi112.stdout:3/97: mkdir d8/d15/d1b 0 2024-09-19T09:35:12.039 INFO:tasks.workunit.client.0.smithi112.stdout:5/179: mknod d4/d3f/c4e 0 2024-09-19T09:35:12.039 INFO:tasks.workunit.client.0.smithi112.stdout:5/180: chown d4/d9/d2a/f49 4 1 2024-09-19T09:35:12.039 INFO:tasks.workunit.client.0.smithi112.stdout:5/181: dread - d4/d29/f2d zero size 2024-09-19T09:35:12.039 INFO:tasks.workunit.client.0.smithi112.stdout:5/182: write d4/d9/d17/d2e/f41 [526314,121827] 0 2024-09-19T09:35:12.043 INFO:tasks.workunit.client.0.smithi112.stdout:4/275: creat d1/d31/d43/d48/f63 x:0 0 0 2024-09-19T09:35:12.043 INFO:tasks.workunit.client.0.smithi112.stdout:4/276: write d1/d4/f13 [1392350,84682] 0 2024-09-19T09:35:12.045 INFO:tasks.workunit.client.0.smithi112.stdout:1/45: mknod cb 0 2024-09-19T09:35:12.046 INFO:tasks.workunit.client.0.smithi112.stdout:8/183: symlink d7/d10/d11/l35 0 2024-09-19T09:35:12.046 INFO:tasks.workunit.client.0.smithi112.stdout:8/184: fsync d7/fa 0 2024-09-19T09:35:12.048 INFO:tasks.workunit.client.0.smithi112.stdout:3/98: mkdir d8/d15/d1b/d1c 0 2024-09-19T09:35:12.048 INFO:tasks.workunit.client.0.smithi112.stdout:3/99: write d8/f17 [752596,122146] 0 2024-09-19T09:35:12.049 INFO:tasks.workunit.client.0.smithi112.stdout:7/47: dwrite d2/f9 [0,4194304] 0 2024-09-19T09:35:12.050 INFO:tasks.workunit.client.0.smithi112.stdout:8/185: symlink d7/d10/d11/d28/l36 0 2024-09-19T09:35:12.050 INFO:tasks.workunit.client.0.smithi112.stdout:0/85: dwrite d2/f9 [0,4194304] 0 2024-09-19T09:35:12.050 INFO:tasks.workunit.client.0.smithi112.stdout:0/86: chown d2 57171 1 2024-09-19T09:35:12.054 INFO:tasks.workunit.client.0.smithi112.stdout:3/100: link d8/d15/l1a d8/d15/d1b/d1c/l1d 0 2024-09-19T09:35:12.054 INFO:tasks.workunit.client.0.smithi112.stdout:3/101: chown d8/d15/c16 180098137 1 2024-09-19T09:35:12.058 INFO:tasks.workunit.client.0.smithi112.stdout:5/183: dwrite d4/d9/d2a/f43 [0,4194304] 0 2024-09-19T09:35:12.059 INFO:tasks.workunit.client.0.smithi112.stdout:7/48: link d2/fe d2/d8/f10 0 2024-09-19T09:35:12.068 INFO:tasks.workunit.client.0.smithi112.stdout:0/87: rename d2/f9 to d2/d11/f1a 0 2024-09-19T09:35:12.068 INFO:tasks.workunit.client.0.smithi112.stdout:0/88: truncate d2/d11/f14 491212 0 2024-09-19T09:35:12.068 INFO:tasks.workunit.client.0.smithi112.stdout:5/184: read d4/d9/f25 [1212017,51879] 0 2024-09-19T09:35:12.072 INFO:tasks.workunit.client.0.smithi112.stdout:7/49: dread d2/f9 [0,4194304] 0 2024-09-19T09:35:12.072 INFO:tasks.workunit.client.0.smithi112.stdout:7/50: chown d2/f9 258317 1 2024-09-19T09:35:12.072 INFO:tasks.workunit.client.0.smithi112.stdout:7/51: write d2/f5 [4734422,64385] 0 2024-09-19T09:35:12.072 INFO:tasks.workunit.client.0.smithi112.stdout:7/52: chown d2/d8 12 1 2024-09-19T09:35:12.072 INFO:tasks.workunit.client.0.smithi112.stdout:7/53: creat d2/f11 x:0 0 0 2024-09-19T09:35:12.072 INFO:tasks.workunit.client.0.smithi112.stdout:7/54: write d2/f4 [5004258,21429] 0 2024-09-19T09:35:12.073 INFO:tasks.workunit.client.0.smithi112.stdout:3/102: link c5 d8/d15/d1b/d1c/c1e 0 2024-09-19T09:35:12.073 INFO:tasks.workunit.client.0.smithi112.stdout:3/103: write d8/fd [1053579,22577] 0 2024-09-19T09:35:12.074 INFO:tasks.workunit.client.0.smithi112.stdout:0/89: dread d2/d11/f18 [0,4194304] 0 2024-09-19T09:35:12.074 INFO:tasks.workunit.client.0.smithi112.stdout:0/90: stat d2/ld 0 2024-09-19T09:35:12.075 INFO:tasks.workunit.client.0.smithi112.stdout:0/91: fdatasync d2/f4 0 2024-09-19T09:35:12.075 INFO:tasks.workunit.client.0.smithi112.stdout:0/92: creat d2/f1b x:0 0 0 2024-09-19T09:35:12.075 INFO:tasks.workunit.client.0.smithi112.stdout:0/93: readlink d2/l5 0 2024-09-19T09:35:12.077 INFO:tasks.workunit.client.0.smithi112.stdout:7/55: symlink d2/l12 0 2024-09-19T09:35:12.077 INFO:tasks.workunit.client.0.smithi112.stdout:7/56: dread - d2/f11 zero size 2024-09-19T09:35:12.078 INFO:tasks.workunit.client.0.smithi112.stdout:3/104: mkdir d8/d15/d1b/d1c/d1f 0 2024-09-19T09:35:12.078 INFO:tasks.workunit.client.0.smithi112.stdout:3/105: readlink d8/l11 0 2024-09-19T09:35:12.080 INFO:tasks.workunit.client.0.smithi112.stdout:0/94: creat d2/d11/f1c x:0 0 0 2024-09-19T09:35:12.081 INFO:tasks.workunit.client.0.smithi112.stdout:0/95: write d2/d11/f14 [495346,20992] 0 2024-09-19T09:35:12.081 INFO:tasks.workunit.client.0.smithi112.stdout:0/96: dread - d2/f10 zero size 2024-09-19T09:35:12.081 INFO:tasks.workunit.client.0.smithi112.stdout:0/97: write d2/d11/f13 [475059,21636] 0 2024-09-19T09:35:12.081 INFO:tasks.workunit.client.0.smithi112.stdout:0/98: write d2/f10 [839339,66672] 0 2024-09-19T09:35:12.082 INFO:tasks.workunit.client.0.smithi112.stdout:7/57: link d2/f9 d2/f13 0 2024-09-19T09:35:12.082 INFO:tasks.workunit.client.0.smithi112.stdout:7/58: write d2/f11 [242024,129098] 0 2024-09-19T09:35:12.082 INFO:tasks.workunit.client.0.smithi112.stdout:1/46: dwrite f2 [0,4194304] 0 2024-09-19T09:35:12.082 INFO:tasks.workunit.client.0.smithi112.stdout:1/47: fsync f8 0 2024-09-19T09:35:12.082 INFO:tasks.workunit.client.0.smithi112.stdout:8/186: dwrite d7/ff [0,4194304] 0 2024-09-19T09:35:12.083 INFO:tasks.workunit.client.0.smithi112.stdout:0/99: mknod d2/c1d 0 2024-09-19T09:35:12.083 INFO:tasks.workunit.client.0.smithi112.stdout:3/106: dread f7 [4194304,4194304] 0 2024-09-19T09:35:12.083 INFO:tasks.workunit.client.0.smithi112.stdout:5/185: read d4/d9/d17/d2e/f42 [3205275,83634] 0 2024-09-19T09:35:12.084 INFO:tasks.workunit.client.0.smithi112.stdout:0/100: unlink d2/fa 0 2024-09-19T09:35:12.085 INFO:tasks.workunit.client.0.smithi112.stdout:0/101: chown c0 1457 1 2024-09-19T09:35:12.085 INFO:tasks.workunit.client.0.smithi112.stdout:0/102: creat d2/d11/f1e x:0 0 0 2024-09-19T09:35:12.085 INFO:tasks.workunit.client.0.smithi112.stdout:3/107: write d8/f10 [874071,26105] 0 2024-09-19T09:35:12.085 INFO:tasks.workunit.client.0.smithi112.stdout:7/59: dread d2/fd [0,4194304] 0 2024-09-19T09:35:12.085 INFO:tasks.workunit.client.0.smithi112.stdout:5/186: symlink d4/d29/d4c/l4f 0 2024-09-19T09:35:12.085 INFO:tasks.workunit.client.0.smithi112.stdout:5/187: chown d4/d9/c21 112763930 1 2024-09-19T09:35:12.089 INFO:tasks.workunit.client.0.smithi112.stdout:0/103: link d2/d11/f14 d2/f1f 0 2024-09-19T09:35:12.090 INFO:tasks.workunit.client.0.smithi112.stdout:3/108: mknod d8/d15/d1b/c20 0 2024-09-19T09:35:12.092 INFO:tasks.workunit.client.0.smithi112.stdout:3/109: mkdir d8/d15/d1b/d1c/d1f/d21 0 2024-09-19T09:35:12.096 INFO:tasks.workunit.client.0.smithi112.stdout:5/188: dread d4/f34 [4194304,4194304] 0 2024-09-19T09:35:12.103 INFO:tasks.workunit.client.0.smithi112.stdout:7/60: dread d2/f11 [0,4194304] 0 2024-09-19T09:35:12.107 INFO:tasks.workunit.client.0.smithi112.stdout:7/61: rename d2/l3 to d2/l14 0 2024-09-19T09:35:12.108 INFO:tasks.workunit.client.0.smithi112.stdout:8/187: dwrite d7/fe [4194304,4194304] 0 2024-09-19T09:35:12.108 INFO:tasks.workunit.client.0.smithi112.stdout:8/188: read - d7/d10/f25 zero size 2024-09-19T09:35:12.108 INFO:tasks.workunit.client.0.smithi112.stdout:8/189: chown d7/d10/l1a 62465 1 2024-09-19T09:35:12.114 INFO:tasks.workunit.client.0.smithi112.stdout:8/190: creat d7/d10/d11/f37 x:0 0 0 2024-09-19T09:35:12.114 INFO:tasks.workunit.client.0.smithi112.stdout:8/191: chown d7/db/d21 0 1 2024-09-19T09:35:12.123 INFO:tasks.workunit.client.0.smithi112.stdout:3/110: dwrite d8/fb [0,4194304] 0 2024-09-19T09:35:12.123 INFO:tasks.workunit.client.0.smithi112.stdout:5/189: dwrite d4/d9/d17/d2e/f42 [4194304,4194304] 0 2024-09-19T09:35:12.129 INFO:tasks.workunit.client.0.smithi112.stdout:3/111: creat d8/d15/d1b/d1c/d1f/f22 x:0 0 0 2024-09-19T09:35:12.131 INFO:tasks.workunit.client.0.smithi112.stdout:5/190: symlink d4/d29/d4c/l50 0 2024-09-19T09:35:12.131 INFO:tasks.workunit.client.0.smithi112.stdout:5/191: write d4/d9/d17/d2f/f32 [4414420,27980] 0 2024-09-19T09:35:12.139 INFO:tasks.workunit.client.0.smithi112.stdout:7/62: dwrite d2/f13 [0,4194304] 0 2024-09-19T09:35:12.139 INFO:tasks.workunit.client.0.smithi112.stdout:7/63: write d2/d8/fc [341387,85396] 0 2024-09-19T09:35:12.139 INFO:tasks.workunit.client.0.smithi112.stdout:7/64: write d2/d8/f10 [980118,119783] 0 2024-09-19T09:35:12.139 INFO:tasks.workunit.client.0.smithi112.stdout:7/65: stat d2/d8/f10 0 2024-09-19T09:35:12.139 INFO:tasks.workunit.client.0.smithi112.stdout:7/66: truncate d2/f13 4209618 0 2024-09-19T09:35:12.139 INFO:tasks.workunit.client.0.smithi112.stdout:8/192: dwrite d7/d10/f1e [0,4194304] 0 2024-09-19T09:35:12.139 INFO:tasks.workunit.client.0.smithi112.stdout:0/104: getdents d2 0 2024-09-19T09:35:12.140 INFO:tasks.workunit.client.0.smithi112.stdout:7/67: write d2/d8/f10 [893062,32940] 0 2024-09-19T09:35:12.140 INFO:tasks.workunit.client.0.smithi112.stdout:7/68: chown d2/d8/f10 89693 1 2024-09-19T09:35:12.140 INFO:tasks.workunit.client.0.smithi112.stdout:7/69: creat d2/f15 x:0 0 0 2024-09-19T09:35:12.140 INFO:tasks.workunit.client.0.smithi112.stdout:7/70: chown d2/f11 4650598 1 2024-09-19T09:35:12.141 INFO:tasks.workunit.client.0.smithi112.stdout:8/193: getdents d7/db 0 2024-09-19T09:35:12.144 INFO:tasks.workunit.client.0.smithi112.stdout:0/105: mknod d2/c20 0 2024-09-19T09:35:12.145 INFO:tasks.workunit.client.0.smithi112.stdout:3/112: dwrite d8/f10 [0,4194304] 0 2024-09-19T09:35:12.146 INFO:tasks.workunit.client.0.smithi112.stdout:3/113: fdatasync d8/fd 0 2024-09-19T09:35:12.148 INFO:tasks.workunit.client.0.smithi112.stdout:7/71: write d2/f4 [3484701,124422] 0 2024-09-19T09:35:12.148 INFO:tasks.workunit.client.0.smithi112.stdout:8/194: symlink d7/db/l38 0 2024-09-19T09:35:12.150 INFO:tasks.workunit.client.0.smithi112.stdout:8/195: fsync d7/db/d21/f24 0 2024-09-19T09:35:12.151 INFO:tasks.workunit.client.0.smithi112.stdout:8/196: write d7/fa [5180110,39063] 0 2024-09-19T09:35:12.151 INFO:tasks.workunit.client.0.smithi112.stdout:7/72: dread d2/fd [0,4194304] 0 2024-09-19T09:35:12.151 INFO:tasks.workunit.client.0.smithi112.stdout:8/197: mknod d7/d10/d11/d33/c39 0 2024-09-19T09:35:12.152 INFO:tasks.workunit.client.0.smithi112.stdout:7/73: symlink d2/d8/l16 0 2024-09-19T09:35:12.153 INFO:tasks.workunit.client.0.smithi112.stdout:8/198: mknod d7/d10/c3a 0 2024-09-19T09:35:12.154 INFO:tasks.workunit.client.0.smithi112.stdout:7/74: symlink d2/l17 0 2024-09-19T09:35:12.160 INFO:tasks.workunit.client.0.smithi112.stdout:3/114: dread d8/fb [0,4194304] 0 2024-09-19T09:35:12.162 INFO:tasks.workunit.client.0.smithi112.stdout:3/115: creat d8/d15/d1b/d1c/d1f/d21/f23 x:0 0 0 2024-09-19T09:35:12.162 INFO:tasks.workunit.client.0.smithi112.stdout:3/116: fdatasync d8/d15/d1b/d1c/d1f/f22 0 2024-09-19T09:35:12.163 INFO:tasks.workunit.client.0.smithi112.stdout:5/192: dwrite d4/d9/d17/d2f/f32 [0,4194304] 0 2024-09-19T09:35:12.164 INFO:tasks.workunit.client.0.smithi112.stdout:1/48: dwrite f2 [4194304,4194304] 0 2024-09-19T09:35:12.165 INFO:tasks.workunit.client.0.smithi112.stdout:0/106: write d2/fb [2036593,122691] 0 2024-09-19T09:35:12.166 INFO:tasks.workunit.client.0.smithi112.stdout:8/199: read d7/d10/d11/f12 [297951,56145] 0 2024-09-19T09:35:12.175 INFO:tasks.workunit.client.0.smithi112.stdout:5/193: write d4/d9/d17/d30/f44 [3123833,42345] 0 2024-09-19T09:35:12.179 INFO:tasks.workunit.client.0.smithi112.stdout:1/49: write f2 [3413762,39326] 0 2024-09-19T09:35:12.185 INFO:tasks.workunit.client.0.smithi112.stdout:5/194: dread d4/d9/f25 [0,4194304] 0 2024-09-19T09:35:12.186 INFO:tasks.workunit.client.0.smithi112.stdout:5/195: symlink d4/d9/d17/d2f/l51 0 2024-09-19T09:35:12.187 INFO:tasks.workunit.client.0.smithi112.stdout:3/117: dwrite d8/fd [0,4194304] 0 2024-09-19T09:35:12.187 INFO:tasks.workunit.client.0.smithi112.stdout:3/118: readlink d8/l14 0 2024-09-19T09:35:12.187 INFO:tasks.workunit.client.0.smithi112.stdout:3/119: write d8/d15/d1b/d1c/d1f/d21/f23 [1008185,83540] 0 2024-09-19T09:35:12.187 INFO:tasks.workunit.client.0.smithi112.stdout:3/120: stat d8/f17 0 2024-09-19T09:35:12.187 INFO:tasks.workunit.client.0.smithi112.stdout:3/121: fsync d8/fd 0 2024-09-19T09:35:12.187 INFO:tasks.workunit.client.0.smithi112.stdout:3/122: write d8/d15/d1b/d1c/d1f/d21/f23 [876390,66345] 0 2024-09-19T09:35:12.191 INFO:tasks.workunit.client.0.smithi112.stdout:5/196: symlink d4/d9/d2a/l52 0 2024-09-19T09:35:12.191 INFO:tasks.workunit.client.0.smithi112.stdout:5/197: truncate d4/d9/d17/d30/f38 495790 0 2024-09-19T09:35:12.200 INFO:tasks.workunit.client.0.smithi112.stdout:8/200: dwrite d7/d10/d11/f37 [0,4194304] 0 2024-09-19T09:35:12.200 INFO:tasks.workunit.client.0.smithi112.stdout:8/201: write d7/db/d21/f24 [1389663,60685] 0 2024-09-19T09:35:12.200 INFO:tasks.workunit.client.0.smithi112.stdout:8/202: fdatasync d7/d10/f25 0 2024-09-19T09:35:12.200 INFO:tasks.workunit.client.0.smithi112.stdout:0/107: dwrite d2/f10 [0,4194304] 0 2024-09-19T09:35:12.204 INFO:tasks.workunit.client.0.smithi112.stdout:8/203: mkdir d7/db/d21/d3b 0 2024-09-19T09:35:12.207 INFO:tasks.workunit.client.0.smithi112.stdout:0/108: creat d2/f21 x:0 0 0 2024-09-19T09:35:12.211 INFO:tasks.workunit.client.0.smithi112.stdout:7/75: getdents d2/d8 0 2024-09-19T09:35:12.211 INFO:tasks.workunit.client.0.smithi112.stdout:7/76: chown d2 110 1 2024-09-19T09:35:12.211 INFO:tasks.workunit.client.0.smithi112.stdout:7/77: write d2/fd [1694170,121293] 0 2024-09-19T09:35:12.212 INFO:tasks.workunit.client.0.smithi112.stdout:8/204: mkdir d7/d10/d11/d28/d3c 0 2024-09-19T09:35:12.213 INFO:tasks.workunit.client.0.smithi112.stdout:0/109: stat d2/f4 0 2024-09-19T09:35:12.214 INFO:tasks.workunit.client.0.smithi112.stdout:0/110: write d2/f21 [285167,107587] 0 2024-09-19T09:35:12.214 INFO:tasks.workunit.client.0.smithi112.stdout:7/78: mkdir d2/d8/d18 0 2024-09-19T09:35:12.215 INFO:tasks.workunit.client.0.smithi112.stdout:8/205: creat d7/d10/d11/d28/d3c/f3d x:0 0 0 2024-09-19T09:35:12.216 INFO:tasks.workunit.client.0.smithi112.stdout:0/111: creat d2/f22 x:0 0 0 2024-09-19T09:35:12.220 INFO:tasks.workunit.client.0.smithi112.stdout:8/206: dread d7/d10/f16 [0,4194304] 0 2024-09-19T09:35:12.221 INFO:tasks.workunit.client.0.smithi112.stdout:7/79: symlink d2/d8/l19 0 2024-09-19T09:35:12.221 INFO:tasks.workunit.client.0.smithi112.stdout:7/80: readlink d2/d8/l19 0 2024-09-19T09:35:12.222 INFO:tasks.workunit.client.0.smithi112.stdout:0/112: mknod d2/d11/c23 0 2024-09-19T09:35:12.222 INFO:tasks.workunit.client.0.smithi112.stdout:7/81: truncate d2/f5 1564690 0 2024-09-19T09:35:12.223 INFO:tasks.workunit.client.0.smithi112.stdout:0/113: creat d2/f24 x:0 0 0 2024-09-19T09:35:12.223 INFO:tasks.workunit.client.0.smithi112.stdout:0/114: truncate d2/d11/f1c 67199 0 2024-09-19T09:35:12.223 INFO:tasks.workunit.client.0.smithi112.stdout:7/82: write d2/d8/f10 [1396915,5450] 0 2024-09-19T09:35:12.228 INFO:tasks.workunit.client.0.smithi112.stdout:3/123: rename d8/d15/d1b/d1c/d1f to d8/d15/d1b/d1c/d24 0 2024-09-19T09:35:12.234 INFO:tasks.workunit.client.0.smithi112.stdout:0/115: dread d2/f4 [0,4194304] 0 2024-09-19T09:35:12.240 INFO:tasks.workunit.client.0.smithi112.stdout:0/116: link d2/l5 d2/d11/l25 0 2024-09-19T09:35:12.256 INFO:tasks.workunit.client.0.smithi112.stdout:5/198: truncate d4/d9/d17/d30/f38 122302 0 2024-09-19T09:35:12.256 INFO:tasks.workunit.client.0.smithi112.stdout:5/199: truncate d4/d9/f25 4800468 0 2024-09-19T09:35:12.257 INFO:tasks.workunit.client.0.smithi112.stdout:5/200: fdatasync d4/d9/d17/d30/f38 0 2024-09-19T09:35:12.257 INFO:tasks.workunit.client.0.smithi112.stdout:5/201: truncate d4/d9/d2a/f49 1065128 0 2024-09-19T09:35:12.258 INFO:tasks.workunit.client.0.smithi112.stdout:5/202: mkdir d4/d9/d17/d2f/d53 0 2024-09-19T09:35:12.258 INFO:tasks.workunit.client.0.smithi112.stdout:8/207: dwrite d7/d10/d11/f12 [0,4194304] 0 2024-09-19T09:35:12.259 INFO:tasks.workunit.client.0.smithi112.stdout:8/208: write d7/d10/d11/f26 [806544,18036] 0 2024-09-19T09:35:12.259 INFO:tasks.workunit.client.0.smithi112.stdout:3/124: dwrite d8/fd [0,4194304] 0 2024-09-19T09:35:12.259 INFO:tasks.workunit.client.0.smithi112.stdout:7/83: dwrite d2/f11 [0,4194304] 0 2024-09-19T09:35:12.259 INFO:tasks.workunit.client.0.smithi112.stdout:7/84: chown d2/f15 15513298 1 2024-09-19T09:35:12.262 INFO:tasks.workunit.client.0.smithi112.stdout:8/209: symlink d7/d10/d11/l3e 0 2024-09-19T09:35:12.262 INFO:tasks.workunit.client.0.smithi112.stdout:8/210: stat d7/db/d21/d3b 0 2024-09-19T09:35:12.266 INFO:tasks.workunit.client.0.smithi112.stdout:0/117: dwrite d2/f1b [0,4194304] 0 2024-09-19T09:35:12.268 INFO:tasks.workunit.client.0.smithi112.stdout:3/125: link c2 d8/c25 0 2024-09-19T09:35:12.268 INFO:tasks.workunit.client.0.smithi112.stdout:5/203: dread d4/d29/f20 [4194304,4194304] 0 2024-09-19T09:35:12.268 INFO:tasks.workunit.client.0.smithi112.stdout:5/204: fsync d4/d9/f10 0 2024-09-19T09:35:12.283 INFO:tasks.workunit.client.0.smithi112.stdout:8/211: dwrite d7/d10/f16 [4194304,4194304] 0 2024-09-19T09:35:12.285 INFO:tasks.workunit.client.0.smithi112.stdout:0/118: rename d2/lf to d2/d11/l26 0 2024-09-19T09:35:12.287 INFO:tasks.workunit.client.0.smithi112.stdout:8/212: rmdir d7/d10/d11/d33 39 2024-09-19T09:35:12.287 INFO:tasks.workunit.client.0.smithi112.stdout:8/213: fdatasync d7/ff 0 2024-09-19T09:35:12.287 INFO:tasks.workunit.client.0.smithi112.stdout:8/214: fsync d7/d10/f1e 0 2024-09-19T09:35:12.292 INFO:tasks.workunit.client.0.smithi112.stdout:3/126: truncate d8/f10 3900762 0 2024-09-19T09:35:12.300 INFO:tasks.workunit.client.0.smithi112.stdout:8/215: dread d7/fe [4194304,4194304] 0 2024-09-19T09:35:12.304 INFO:tasks.workunit.client.0.smithi112.stdout:7/85: write d2/f5 [1432587,83861] 0 2024-09-19T09:35:12.304 INFO:tasks.workunit.client.0.smithi112.stdout:7/86: dread - d2/f15 zero size 2024-09-19T09:35:12.304 INFO:tasks.workunit.client.0.smithi112.stdout:7/87: chown d2/d8/l19 9474 1 2024-09-19T09:35:12.307 INFO:tasks.workunit.client.0.smithi112.stdout:0/119: dwrite d2/f1f [0,4194304] 0 2024-09-19T09:35:12.317 INFO:tasks.workunit.client.0.smithi112.stdout:0/120: dread d2/fb [0,4194304] 0 2024-09-19T09:35:12.319 INFO:tasks.workunit.client.0.smithi112.stdout:0/121: symlink d2/l27 0 2024-09-19T09:35:12.320 INFO:tasks.workunit.client.0.smithi112.stdout:0/122: write d2/f24 [190676,117898] 0 2024-09-19T09:35:12.321 INFO:tasks.workunit.client.0.smithi112.stdout:0/123: chown d2/ld 1892 1 2024-09-19T09:35:12.322 INFO:tasks.workunit.client.0.smithi112.stdout:5/205: getdents d4/d9/d17/d2f 0 2024-09-19T09:35:12.324 INFO:tasks.workunit.client.0.smithi112.stdout:8/216: getdents d7/d10/d11 0 2024-09-19T09:35:12.324 INFO:tasks.workunit.client.0.smithi112.stdout:7/88: dwrite d2/fd [0,4194304] 0 2024-09-19T09:35:12.326 INFO:tasks.workunit.client.0.smithi112.stdout:8/217: truncate d7/ff 2236043 0 2024-09-19T09:35:12.326 INFO:tasks.workunit.client.0.smithi112.stdout:8/218: write d7/db/d21/f2a [339169,71658] 0 2024-09-19T09:35:12.326 INFO:tasks.workunit.client.0.smithi112.stdout:8/219: fdatasync d7/d10/d11/f2b 0 2024-09-19T09:35:12.330 INFO:tasks.workunit.client.0.smithi112.stdout:8/220: truncate d7/d10/f1e 570767 0 2024-09-19T09:35:12.332 INFO:tasks.workunit.client.0.smithi112.stdout:7/89: mkdir d2/d8/d1a 0 2024-09-19T09:35:12.335 INFO:tasks.workunit.client.0.smithi112.stdout:0/124: write d2/f1f [3303424,113585] 0 2024-09-19T09:35:12.336 INFO:tasks.workunit.client.0.smithi112.stdout:8/221: symlink d7/db/d21/d2e/l3f 0 2024-09-19T09:35:12.337 INFO:tasks.workunit.client.0.smithi112.stdout:7/90: unlink d2/l14 0 2024-09-19T09:35:12.341 INFO:tasks.workunit.client.0.smithi112.stdout:5/206: truncate d4/d9/f25 993540 0 2024-09-19T09:35:12.343 INFO:tasks.workunit.client.0.smithi112.stdout:5/207: getdents d4/d29/d4c 0 2024-09-19T09:35:12.346 INFO:tasks.workunit.client.0.smithi112.stdout:0/125: dread d2/fb [0,4194304] 0 2024-09-19T09:35:12.349 INFO:tasks.workunit.client.0.smithi112.stdout:5/208: symlink d4/d29/d36/l54 0 2024-09-19T09:35:12.365 INFO:tasks.workunit.client.0.smithi112.stdout:7/91: dwrite d2/f4 [4194304,4194304] 0 2024-09-19T09:35:12.365 INFO:tasks.workunit.client.0.smithi112.stdout:0/126: dwrite d2/d11/f1c [0,4194304] 0 2024-09-19T09:35:12.373 INFO:tasks.workunit.client.0.smithi112.stdout:7/92: creat d2/d8/d1a/f1b x:0 0 0 2024-09-19T09:35:12.373 INFO:tasks.workunit.client.0.smithi112.stdout:7/93: getdents d2/d8/d18 0 2024-09-19T09:35:12.373 INFO:tasks.workunit.client.0.smithi112.stdout:8/222: dread d7/ff [0,4194304] 0 2024-09-19T09:35:12.375 INFO:tasks.workunit.client.0.smithi112.stdout:0/127: creat d2/f28 x:0 0 0 2024-09-19T09:35:12.375 INFO:tasks.workunit.client.0.smithi112.stdout:0/128: creat d2/d11/f29 x:0 0 0 2024-09-19T09:35:12.378 INFO:tasks.workunit.client.0.smithi112.stdout:8/223: mkdir d7/d10/d11/d40 0 2024-09-19T09:35:12.378 INFO:tasks.workunit.client.0.smithi112.stdout:8/224: write d7/d10/d11/f26 [1370799,8681] 0 2024-09-19T09:35:12.382 INFO:tasks.workunit.client.0.smithi112.stdout:5/209: dread d4/d9/f25 [0,4194304] 0 2024-09-19T09:35:12.384 INFO:tasks.workunit.client.0.smithi112.stdout:7/94: link d2/d8/cf d2/c1c 0 2024-09-19T09:35:12.389 INFO:tasks.workunit.client.0.smithi112.stdout:8/225: symlink d7/db/d21/d3b/l41 0 2024-09-19T09:35:12.389 INFO:tasks.workunit.client.0.smithi112.stdout:0/129: dread d2/f10 [0,4194304] 0 2024-09-19T09:35:12.389 INFO:tasks.workunit.client.0.smithi112.stdout:0/130: fsync d2/f22 0 2024-09-19T09:35:12.392 INFO:tasks.workunit.client.0.smithi112.stdout:5/210: rmdir d4/d9/d17 39 2024-09-19T09:35:12.392 INFO:tasks.workunit.client.0.smithi112.stdout:8/226: readlink d7/db/l1f 0 2024-09-19T09:35:12.396 INFO:tasks.workunit.client.0.smithi112.stdout:5/211: creat d4/d9/d2a/d46/f55 x:0 0 0 2024-09-19T09:35:12.397 INFO:tasks.workunit.client.0.smithi112.stdout:8/227: mkdir d7/db/d21/d2e/d42 0 2024-09-19T09:35:12.400 INFO:tasks.workunit.client.0.smithi112.stdout:7/95: dread d2/f9 [0,4194304] 0 2024-09-19T09:35:12.401 INFO:tasks.workunit.client.0.smithi112.stdout:8/228: rmdir d7/d10/d11/d28/d3c 39 2024-09-19T09:35:12.404 INFO:tasks.workunit.client.0.smithi112.stdout:0/131: dread d2/f1b [0,4194304] 0 2024-09-19T09:35:12.404 INFO:tasks.workunit.client.0.smithi112.stdout:0/132: read - d2/f22 zero size 2024-09-19T09:35:12.406 INFO:tasks.workunit.client.0.smithi112.stdout:7/96: rename d2/f5 to d2/d8/d18/f1d 0 2024-09-19T09:35:12.412 INFO:tasks.workunit.client.0.smithi112.stdout:8/229: rename d7/d10/d11/f12 to d7/db/d21/f43 0 2024-09-19T09:35:12.415 INFO:tasks.workunit.client.0.smithi112.stdout:7/97: creat d2/d8/d18/f1e x:0 0 0 2024-09-19T09:35:12.418 INFO:tasks.workunit.client.0.smithi112.stdout:8/230: link d7/d10/d11/f37 d7/db/d21/d2e/d42/f44 0 2024-09-19T09:35:12.420 INFO:tasks.workunit.client.0.smithi112.stdout:7/98: dread d2/fe [0,4194304] 0 2024-09-19T09:35:12.421 INFO:tasks.workunit.client.0.smithi112.stdout:8/231: truncate d7/db/d21/f2a 175549 0 2024-09-19T09:35:12.421 INFO:tasks.workunit.client.0.smithi112.stdout:8/232: chown d7/db/l1f 249040 1 2024-09-19T09:35:12.423 INFO:tasks.workunit.client.0.smithi112.stdout:5/212: dwrite d4/d9/f37 [0,4194304] 0 2024-09-19T09:35:12.423 INFO:tasks.workunit.client.0.smithi112.stdout:5/213: chown d4/d29/d36 81 1 2024-09-19T09:35:12.427 INFO:tasks.workunit.client.0.smithi112.stdout:5/214: mkdir d4/d29/d36/d56 0 2024-09-19T09:35:12.428 INFO:tasks.workunit.client.0.smithi112.stdout:5/215: fsync d4/d9/d17/d2f/f32 0 2024-09-19T09:35:12.429 INFO:tasks.workunit.client.0.smithi112.stdout:0/133: dwrite d2/d11/f1e [0,4194304] 0 2024-09-19T09:35:12.434 INFO:tasks.workunit.client.0.smithi112.stdout:7/99: dread d2/d8/fc [0,4194304] 0 2024-09-19T09:35:12.438 INFO:tasks.workunit.client.0.smithi112.stdout:2/35: sync 2024-09-19T09:35:12.439 INFO:tasks.workunit.client.0.smithi112.stdout:6/70: sync 2024-09-19T09:35:12.439 INFO:tasks.workunit.client.0.smithi112.stdout:6/71: chown l7 2233 1 2024-09-19T09:35:12.442 INFO:tasks.workunit.client.0.smithi112.stdout:5/216: dread d4/d9/f28 [0,4194304] 0 2024-09-19T09:35:12.447 INFO:tasks.workunit.client.0.smithi112.stdout:8/233: dwrite d7/db/d21/d2e/d42/f44 [0,4194304] 0 2024-09-19T09:35:12.447 INFO:tasks.workunit.client.0.smithi112.stdout:0/134: read d2/d11/f1c [3609856,40420] 0 2024-09-19T09:35:12.451 INFO:tasks.workunit.client.0.smithi112.stdout:8/234: truncate d7/fa 1750727 0 2024-09-19T09:35:12.453 INFO:tasks.workunit.client.0.smithi112.stdout:2/36: dread d0/f5 [0,4194304] 0 2024-09-19T09:35:12.453 INFO:tasks.workunit.client.0.smithi112.stdout:2/37: creat d0/d1/fd x:0 0 0 2024-09-19T09:35:12.453 INFO:tasks.workunit.client.0.smithi112.stdout:2/38: truncate d0/d6/fc 645752 0 2024-09-19T09:35:12.455 INFO:tasks.workunit.client.0.smithi112.stdout:2/39: write d0/d1/f7 [380695,19493] 0 2024-09-19T09:35:12.455 INFO:tasks.workunit.client.0.smithi112.stdout:2/40: fdatasync d0/f5 0 2024-09-19T09:35:12.456 INFO:tasks.workunit.client.0.smithi112.stdout:2/41: mkdir d0/d1/de 0 2024-09-19T09:35:12.464 INFO:tasks.workunit.client.0.smithi112.stdout:8/235: dread d7/db/d21/d2e/d42/f44 [0,4194304] 0 2024-09-19T09:35:12.464 INFO:tasks.workunit.client.0.smithi112.stdout:8/236: write d7/d10/d11/d28/d3c/f3d [1018752,58642] 0 2024-09-19T09:35:12.466 INFO:tasks.workunit.client.0.smithi112.stdout:8/237: rename d7/fe to d7/db/f45 0 2024-09-19T09:35:12.467 INFO:tasks.workunit.client.0.smithi112.stdout:8/238: rename d7/d10/d11/d28/l36 to d7/db/d21/d3b/l46 0 2024-09-19T09:35:12.472 INFO:tasks.workunit.client.0.smithi112.stdout:8/239: read d7/d10/f1e [115119,130751] 0 2024-09-19T09:35:12.472 INFO:tasks.workunit.client.0.smithi112.stdout:7/100: dwrite d2/d8/d1a/f1b [0,4194304] 0 2024-09-19T09:35:12.473 INFO:tasks.workunit.client.0.smithi112.stdout:7/101: readlink d2/d8/l19 0 2024-09-19T09:35:12.475 INFO:tasks.workunit.client.0.smithi112.stdout:6/72: dwrite d8/f10 [0,4194304] 0 2024-09-19T09:35:12.476 INFO:tasks.workunit.client.0.smithi112.stdout:5/217: dwrite d4/d9/f1c [0,4194304] 0 2024-09-19T09:35:12.483 INFO:tasks.workunit.client.0.smithi112.stdout:0/135: dread d2/d11/f14 [0,4194304] 0 2024-09-19T09:35:12.483 INFO:tasks.workunit.client.0.smithi112.stdout:0/136: chown d2/d11/f14 28438 1 2024-09-19T09:35:12.483 INFO:tasks.workunit.client.0.smithi112.stdout:0/137: stat d2 0 2024-09-19T09:35:12.483 INFO:tasks.workunit.client.0.smithi112.stdout:0/138: readlink d2/d11/l26 0 2024-09-19T09:35:12.486 INFO:tasks.workunit.client.0.smithi112.stdout:0/139: dread d2/d11/f18 [0,4194304] 0 2024-09-19T09:35:12.487 INFO:tasks.workunit.client.0.smithi112.stdout:7/102: mkdir d2/d8/d1f 0 2024-09-19T09:35:12.491 INFO:tasks.workunit.client.0.smithi112.stdout:0/140: rmdir d2/d11 39 2024-09-19T09:35:12.493 INFO:tasks.workunit.client.0.smithi112.stdout:6/73: dread d8/f10 [0,4194304] 0 2024-09-19T09:35:12.493 INFO:tasks.workunit.client.0.smithi112.stdout:0/141: write d2/f12 [253029,10946] 0 2024-09-19T09:35:12.507 INFO:tasks.workunit.client.0.smithi112.stdout:0/142: dread d2/d11/f1a [0,4194304] 0 2024-09-19T09:35:12.509 INFO:tasks.workunit.client.0.smithi112.stdout:0/143: link d2/d11/f1c d2/d11/f2a 0 2024-09-19T09:35:12.521 INFO:tasks.workunit.client.0.smithi112.stdout:7/103: dwrite d2/d8/d18/f1d [0,4194304] 0 2024-09-19T09:35:12.521 INFO:tasks.workunit.client.0.smithi112.stdout:5/218: dwrite d4/d9/d17/d30/f44 [4194304,4194304] 0 2024-09-19T09:35:12.521 INFO:tasks.workunit.client.0.smithi112.stdout:5/219: chown d4/l8 51943 1 2024-09-19T09:35:12.521 INFO:tasks.workunit.client.0.smithi112.stdout:7/104: read - d2/d8/d18/f1e zero size 2024-09-19T09:35:12.521 INFO:tasks.workunit.client.0.smithi112.stdout:7/105: stat d2/d8/l19 0 2024-09-19T09:35:12.522 INFO:tasks.workunit.client.0.smithi112.stdout:0/144: fdatasync d2/f12 0 2024-09-19T09:35:12.522 INFO:tasks.workunit.client.0.smithi112.stdout:8/240: dwrite d7/d10/d11/d28/d3c/f3d [0,4194304] 0 2024-09-19T09:35:12.525 INFO:tasks.workunit.client.0.smithi112.stdout:7/106: truncate d2/d8/f10 1081677 0 2024-09-19T09:35:12.526 INFO:tasks.workunit.client.0.smithi112.stdout:0/145: symlink d2/d11/l2b 0 2024-09-19T09:35:12.528 INFO:tasks.workunit.client.0.smithi112.stdout:6/74: dwrite f6 [0,4194304] 0 2024-09-19T09:35:12.529 INFO:tasks.workunit.client.0.smithi112.stdout:8/241: link d7/db/d21/f43 d7/db/d21/f47 0 2024-09-19T09:35:12.531 INFO:tasks.workunit.client.0.smithi112.stdout:0/146: symlink d2/l2c 0 2024-09-19T09:35:12.531 INFO:tasks.workunit.client.0.smithi112.stdout:0/147: write d2/f28 [412962,127584] 0 2024-09-19T09:35:12.531 INFO:tasks.workunit.client.0.smithi112.stdout:0/148: fdatasync d2/f12 0 2024-09-19T09:35:12.532 INFO:tasks.workunit.client.0.smithi112.stdout:0/149: chown d2/c1d 103493 1 2024-09-19T09:35:12.534 INFO:tasks.workunit.client.0.smithi112.stdout:0/150: truncate d2/d11/f1e 3202099 0 2024-09-19T09:35:12.534 INFO:tasks.workunit.client.0.smithi112.stdout:0/151: fdatasync d2/f10 0 2024-09-19T09:35:12.534 INFO:tasks.workunit.client.0.smithi112.stdout:8/242: dread d7/db/d21/f24 [0,4194304] 0 2024-09-19T09:35:12.536 INFO:tasks.workunit.client.0.smithi112.stdout:8/243: mkdir d7/d10/d11/d28/d48 0 2024-09-19T09:35:12.545 INFO:tasks.workunit.client.0.smithi112.stdout:6/75: dread d8/f10 [0,4194304] 0 2024-09-19T09:35:12.546 INFO:tasks.workunit.client.0.smithi112.stdout:6/76: mkdir d8/d11/d13 0 2024-09-19T09:35:12.548 INFO:tasks.workunit.client.0.smithi112.stdout:6/77: mkdir d8/d11/d14 0 2024-09-19T09:35:12.548 INFO:tasks.workunit.client.0.smithi112.stdout:6/78: chown d8/cc 132958200 1 2024-09-19T09:35:12.548 INFO:tasks.workunit.client.0.smithi112.stdout:6/79: readlink l7 0 2024-09-19T09:35:12.549 INFO:tasks.workunit.client.0.smithi112.stdout:6/80: creat d8/de/f15 x:0 0 0 2024-09-19T09:35:12.549 INFO:tasks.workunit.client.0.smithi112.stdout:6/81: write d8/f9 [2764967,108653] 0 2024-09-19T09:35:12.549 INFO:tasks.workunit.client.0.smithi112.stdout:6/82: read d8/f9 [4198962,128476] 0 2024-09-19T09:35:12.549 INFO:tasks.workunit.client.0.smithi112.stdout:6/83: fsync f5 0 2024-09-19T09:35:12.549 INFO:tasks.workunit.client.0.smithi112.stdout:6/84: creat d8/f16 x:0 0 0 2024-09-19T09:35:12.551 INFO:tasks.workunit.client.0.smithi112.stdout:6/85: mkdir d8/de/d17 0 2024-09-19T09:35:12.552 INFO:tasks.workunit.client.0.smithi112.stdout:6/86: mkdir d8/de/d18 0 2024-09-19T09:35:12.553 INFO:tasks.workunit.client.0.smithi112.stdout:6/87: mknod d8/de/d17/c19 0 2024-09-19T09:35:12.564 INFO:tasks.workunit.client.0.smithi112.stdout:6/88: dread f5 [0,4194304] 0 2024-09-19T09:35:12.564 INFO:tasks.workunit.client.0.smithi112.stdout:6/89: getdents d8/d11/d13 0 2024-09-19T09:35:12.565 INFO:tasks.workunit.client.0.smithi112.stdout:6/90: getdents d8/d11/d13 0 2024-09-19T09:35:12.565 INFO:tasks.workunit.client.0.smithi112.stdout:6/91: write d8/f16 [420826,64934] 0 2024-09-19T09:35:12.566 INFO:tasks.workunit.client.0.smithi112.stdout:7/107: dwrite d2/d8/d18/f1e [0,4194304] 0 2024-09-19T09:35:12.567 INFO:tasks.workunit.client.0.smithi112.stdout:7/108: chown d2/l17 1155 1 2024-09-19T09:35:12.567 INFO:tasks.workunit.client.0.smithi112.stdout:7/109: write d2/fd [4870401,52734] 0 2024-09-19T09:35:12.567 INFO:tasks.workunit.client.0.smithi112.stdout:5/220: dwrite d4/d9/d2a/d39/f3a [0,4194304] 0 2024-09-19T09:35:12.567 INFO:tasks.workunit.client.0.smithi112.stdout:8/244: dwrite d7/d10/f16 [0,4194304] 0 2024-09-19T09:35:12.567 INFO:tasks.workunit.client.0.smithi112.stdout:0/152: dwrite d2/fb [0,4194304] 0 2024-09-19T09:35:12.571 INFO:tasks.workunit.client.0.smithi112.stdout:7/110: mknod d2/d8/d1a/c20 0 2024-09-19T09:35:12.573 INFO:tasks.workunit.client.0.smithi112.stdout:0/153: dread d2/f28 [0,4194304] 0 2024-09-19T09:35:12.573 INFO:tasks.workunit.client.0.smithi112.stdout:0/154: fdatasync d2/f24 0 2024-09-19T09:35:12.573 INFO:tasks.workunit.client.0.smithi112.stdout:0/155: truncate d2/f12 1015262 0 2024-09-19T09:35:12.574 INFO:tasks.workunit.client.0.smithi112.stdout:5/221: mknod d4/d9/d17/d2f/d53/c57 0 2024-09-19T09:35:12.576 INFO:tasks.workunit.client.0.smithi112.stdout:8/245: rename d7/db/d21/d30 to d7/d10/d11/d33/d49 0 2024-09-19T09:35:12.586 INFO:tasks.workunit.client.0.smithi112.stdout:7/111: unlink d2/d8/l16 0 2024-09-19T09:35:12.586 INFO:tasks.workunit.client.0.smithi112.stdout:7/112: chown d2/d8/cf 20424741 1 2024-09-19T09:35:12.588 INFO:tasks.workunit.client.0.smithi112.stdout:7/113: mkdir d2/d8/d1f/d21 0 2024-09-19T09:35:12.588 INFO:tasks.workunit.client.0.smithi112.stdout:6/92: fsync d8/de/f15 0 2024-09-19T09:35:12.591 INFO:tasks.workunit.client.0.smithi112.stdout:6/93: symlink d8/de/d18/l1a 0 2024-09-19T09:35:12.595 INFO:tasks.workunit.client.0.smithi112.stdout:6/94: rmdir d8/de/d18 39 2024-09-19T09:35:12.605 INFO:tasks.workunit.client.0.smithi112.stdout:8/246: dwrite d7/db/d21/f2a [0,4194304] 0 2024-09-19T09:35:12.609 INFO:tasks.workunit.client.0.smithi112.stdout:5/222: dwrite d4/d9/d2a/d46/f55 [0,4194304] 0 2024-09-19T09:35:12.610 INFO:tasks.workunit.client.0.smithi112.stdout:6/95: dread f5 [4194304,4194304] 0 2024-09-19T09:35:12.610 INFO:tasks.workunit.client.0.smithi112.stdout:6/96: dread - d8/de/f15 zero size 2024-09-19T09:35:12.611 INFO:tasks.workunit.client.0.smithi112.stdout:6/97: rename d8/de/cf to d8/de/c1b 0 2024-09-19T09:35:12.612 INFO:tasks.workunit.client.0.smithi112.stdout:6/98: write d8/f16 [387996,85884] 0 2024-09-19T09:35:12.613 INFO:tasks.workunit.client.0.smithi112.stdout:6/99: creat d8/d11/d14/f1c x:0 0 0 2024-09-19T09:35:12.614 INFO:tasks.workunit.client.0.smithi112.stdout:6/100: mknod d8/c1d 0 2024-09-19T09:35:12.614 INFO:tasks.workunit.client.0.smithi112.stdout:7/114: dwrite d2/f15 [0,4194304] 0 2024-09-19T09:35:12.615 INFO:tasks.workunit.client.0.smithi112.stdout:0/156: dwrite d2/fe [0,4194304] 0 2024-09-19T09:35:12.617 INFO:tasks.workunit.client.0.smithi112.stdout:8/247: write d7/db/d21/f47 [1733596,23020] 0 2024-09-19T09:35:12.623 INFO:tasks.workunit.client.0.smithi112.stdout:5/223: write d4/f13 [5087932,85326] 0 2024-09-19T09:35:12.643 INFO:tasks.workunit.client.0.smithi112.stdout:0/157: dwrite d2/d11/f1a [0,4194304] 0 2024-09-19T09:35:12.645 INFO:tasks.workunit.client.0.smithi112.stdout:0/158: symlink d2/d11/l2d 0 2024-09-19T09:35:12.646 INFO:tasks.workunit.client.0.smithi112.stdout:0/159: creat d2/d11/f2e x:0 0 0 2024-09-19T09:35:12.652 INFO:tasks.workunit.client.0.smithi112.stdout:5/224: read d4/d9/f37 [1177879,38713] 0 2024-09-19T09:35:12.657 INFO:tasks.workunit.client.0.smithi112.stdout:5/225: write d4/d9/f28 [3854854,827] 0 2024-09-19T09:35:12.658 INFO:tasks.workunit.client.0.smithi112.stdout:8/248: dwrite d7/db/d21/f43 [4194304,4194304] 0 2024-09-19T09:35:12.658 INFO:tasks.workunit.client.0.smithi112.stdout:7/115: dwrite d2/d8/fc [0,4194304] 0 2024-09-19T09:35:12.658 INFO:tasks.workunit.client.0.smithi112.stdout:6/101: dwrite f6 [0,4194304] 0 2024-09-19T09:35:12.658 INFO:tasks.workunit.client.0.smithi112.stdout:5/226: readlink d4/d9/d2a/l52 0 2024-09-19T09:35:12.658 INFO:tasks.workunit.client.0.smithi112.stdout:8/249: write d7/fa [2479023,109340] 0 2024-09-19T09:35:12.658 INFO:tasks.workunit.client.0.smithi112.stdout:8/250: fdatasync d7/fd 0 2024-09-19T09:35:12.664 INFO:tasks.workunit.client.0.smithi112.stdout:0/160: dwrite d2/f1f [0,4194304] 0 2024-09-19T09:35:12.676 INFO:tasks.workunit.client.0.smithi112.stdout:5/227: unlink d4/l2b 0 2024-09-19T09:35:12.676 INFO:tasks.workunit.client.0.smithi112.stdout:5/228: write d4/d9/f25 [1179722,93715] 0 2024-09-19T09:35:12.677 INFO:tasks.workunit.client.0.smithi112.stdout:7/116: rename d2/f4 to d2/d8/d18/f22 0 2024-09-19T09:35:12.678 INFO:tasks.workunit.client.0.smithi112.stdout:6/102: creat d8/de/d17/f1e x:0 0 0 2024-09-19T09:35:12.679 INFO:tasks.workunit.client.0.smithi112.stdout:8/251: getdents d7/db 0 2024-09-19T09:35:12.680 INFO:tasks.workunit.client.0.smithi112.stdout:5/229: creat d4/d3b/f58 x:0 0 0 2024-09-19T09:35:12.681 INFO:tasks.workunit.client.0.smithi112.stdout:0/161: rename d2/l5 to d2/d11/l2f 0 2024-09-19T09:35:12.682 INFO:tasks.workunit.client.0.smithi112.stdout:6/103: mknod d8/d11/d14/c1f 0 2024-09-19T09:35:12.682 INFO:tasks.workunit.client.0.smithi112.stdout:6/104: fdatasync f5 0 2024-09-19T09:35:12.682 INFO:tasks.workunit.client.0.smithi112.stdout:6/105: truncate d8/de/d17/f1e 585750 0 2024-09-19T09:35:12.683 INFO:tasks.workunit.client.0.smithi112.stdout:8/252: mknod d7/db/d21/d2e/c4a 0 2024-09-19T09:35:12.683 INFO:tasks.workunit.client.0.smithi112.stdout:5/230: mknod d4/d9/d2a/d46/c59 0 2024-09-19T09:35:12.685 INFO:tasks.workunit.client.0.smithi112.stdout:0/162: creat d2/f30 x:0 0 0 2024-09-19T09:35:12.685 INFO:tasks.workunit.client.0.smithi112.stdout:0/163: chown d2/f1b 349907550 1 2024-09-19T09:35:12.685 INFO:tasks.workunit.client.0.smithi112.stdout:6/106: mkdir d8/de/d18/d20 0 2024-09-19T09:35:12.685 INFO:tasks.workunit.client.0.smithi112.stdout:6/107: truncate f5 9243052 0 2024-09-19T09:35:12.687 INFO:tasks.workunit.client.0.smithi112.stdout:5/231: getdents d4/d3f 0 2024-09-19T09:35:12.687 INFO:tasks.workunit.client.0.smithi112.stdout:5/232: fdatasync d4/d9/d2a/d39/f3a 0 2024-09-19T09:35:12.687 INFO:tasks.workunit.client.0.smithi112.stdout:5/233: truncate d4/d9/d17/d2e/f42 9002657 0 2024-09-19T09:35:12.689 INFO:tasks.workunit.client.0.smithi112.stdout:0/164: link d2/d11/f29 d2/f31 0 2024-09-19T09:35:12.691 INFO:tasks.workunit.client.0.smithi112.stdout:6/108: link c0 d8/de/d17/c21 0 2024-09-19T09:35:12.692 INFO:tasks.workunit.client.0.smithi112.stdout:6/109: creat d8/de/d17/f22 x:0 0 0 2024-09-19T09:35:12.694 INFO:tasks.workunit.client.0.smithi112.stdout:6/110: link f5 d8/f23 0 2024-09-19T09:35:12.694 INFO:tasks.workunit.client.0.smithi112.stdout:6/111: stat d8/de/d18 0 2024-09-19T09:35:12.695 INFO:tasks.workunit.client.0.smithi112.stdout:7/117: dwrite d2/f9 [0,4194304] 0 2024-09-19T09:35:12.695 INFO:tasks.workunit.client.0.smithi112.stdout:0/165: dread d2/d11/f18 [0,4194304] 0 2024-09-19T09:35:12.695 INFO:tasks.workunit.client.0.smithi112.stdout:0/166: dread - d2/d11/f2e zero size 2024-09-19T09:35:12.695 INFO:tasks.workunit.client.0.smithi112.stdout:0/167: fsync d2/d11/f2a 0 2024-09-19T09:35:12.695 INFO:tasks.workunit.client.0.smithi112.stdout:6/112: dread d8/de/d17/f1e [0,4194304] 0 2024-09-19T09:35:12.698 INFO:tasks.workunit.client.0.smithi112.stdout:0/168: truncate d2/f4 3794508 0 2024-09-19T09:35:12.704 INFO:tasks.workunit.client.0.smithi112.stdout:5/234: dread d4/f34 [4194304,4194304] 0 2024-09-19T09:35:12.707 INFO:tasks.workunit.client.0.smithi112.stdout:5/235: unlink d4/d9/d17/d2e/f2c 0 2024-09-19T09:35:12.707 INFO:tasks.workunit.client.0.smithi112.stdout:5/236: write d4/f13 [6084125,12278] 0 2024-09-19T09:35:12.707 INFO:tasks.workunit.client.0.smithi112.stdout:5/237: readlink d4/d9/d3e/l40 0 2024-09-19T09:35:12.707 INFO:tasks.workunit.client.0.smithi112.stdout:5/238: creat d4/d9/d17/d2e/f5a x:0 0 0 2024-09-19T09:35:12.709 INFO:tasks.workunit.client.0.smithi112.stdout:5/239: unlink d4/d9/f37 0 2024-09-19T09:35:12.710 INFO:tasks.workunit.client.0.smithi112.stdout:8/253: dwrite d7/db/d21/f43 [0,4194304] 0 2024-09-19T09:35:12.712 INFO:tasks.workunit.client.0.smithi112.stdout:5/240: getdents d4 0 2024-09-19T09:35:12.712 INFO:tasks.workunit.client.0.smithi112.stdout:5/241: read - d4/d9/d17/d2e/f5a zero size 2024-09-19T09:35:12.713 INFO:tasks.workunit.client.0.smithi112.stdout:7/118: rmdir d2/d8/d18 39 2024-09-19T09:35:12.714 INFO:tasks.workunit.client.0.smithi112.stdout:8/254: mkdir d7/d10/d11/d28/d4b 0 2024-09-19T09:35:12.717 INFO:tasks.workunit.client.0.smithi112.stdout:5/242: rename d4/d9/d17/d2e/f5a to d4/d9/d17/f5b 0 2024-09-19T09:35:12.719 INFO:tasks.workunit.client.0.smithi112.stdout:7/119: mkdir d2/d8/d1f/d23 0 2024-09-19T09:35:12.720 INFO:tasks.workunit.client.0.smithi112.stdout:8/255: creat d7/d10/d11/d33/d49/f4c x:0 0 0 2024-09-19T09:35:12.720 INFO:tasks.workunit.client.0.smithi112.stdout:8/256: fsync d7/db/d21/f43 0 2024-09-19T09:35:12.720 INFO:tasks.workunit.client.0.smithi112.stdout:8/257: write d7/fd [198547,113067] 0 2024-09-19T09:35:12.720 INFO:tasks.workunit.client.0.smithi112.stdout:8/258: stat d7/d10/c3a 0 2024-09-19T09:35:12.722 INFO:tasks.workunit.client.0.smithi112.stdout:6/113: dwrite f6 [0,4194304] 0 2024-09-19T09:35:12.722 INFO:tasks.workunit.client.0.smithi112.stdout:5/243: symlink d4/d9/d17/d2e/l5c 0 2024-09-19T09:35:12.725 INFO:tasks.workunit.client.0.smithi112.stdout:0/169: dwrite d2/f21 [0,4194304] 0 2024-09-19T09:35:12.730 INFO:tasks.workunit.client.0.smithi112.stdout:4/277: sync 2024-09-19T09:35:12.730 INFO:tasks.workunit.client.0.smithi112.stdout:9/26: sync 2024-09-19T09:35:12.730 INFO:tasks.workunit.client.0.smithi112.stdout:4/278: write d1/d4/f9 [3179663,4284] 0 2024-09-19T09:35:12.736 INFO:tasks.workunit.client.0.smithi112.stdout:8/259: rename d7/db/d21/d3b/l46 to d7/l4d 0 2024-09-19T09:35:12.736 INFO:tasks.workunit.client.0.smithi112.stdout:8/260: chown d7/db/d21/d2e/l3f 9692031 1 2024-09-19T09:35:12.739 INFO:tasks.workunit.client.0.smithi112.stdout:6/114: link d8/f10 d8/d11/d14/f24 0 2024-09-19T09:35:12.739 INFO:tasks.workunit.client.0.smithi112.stdout:7/120: dwrite d2/f11 [0,4194304] 0 2024-09-19T09:35:12.745 INFO:tasks.workunit.client.0.smithi112.stdout:9/27: mknod c9 0 2024-09-19T09:35:12.745 INFO:tasks.workunit.client.0.smithi112.stdout:9/28: chown f7 5 1 2024-09-19T09:35:12.748 INFO:tasks.workunit.client.0.smithi112.stdout:4/279: creat d1/d31/d42/f64 x:0 0 0 2024-09-19T09:35:12.748 INFO:tasks.workunit.client.0.smithi112.stdout:4/280: creat d1/d31/d42/f65 x:0 0 0 2024-09-19T09:35:12.749 INFO:tasks.workunit.client.0.smithi112.stdout:0/170: dwrite d2/d11/f14 [4194304,4194304] 0 2024-09-19T09:35:12.750 INFO:tasks.workunit.client.0.smithi112.stdout:8/261: rename d7/d10/d11/f26 to d7/db/d21/f4e 0 2024-09-19T09:35:12.759 INFO:tasks.workunit.client.0.smithi112.stdout:6/115: symlink d8/de/l25 0 2024-09-19T09:35:12.760 INFO:tasks.workunit.client.0.smithi112.stdout:6/116: readlink d8/lb 0 2024-09-19T09:35:12.763 INFO:tasks.workunit.client.0.smithi112.stdout:5/244: getdents d4/d9/d17/d30 0 2024-09-19T09:35:12.764 INFO:tasks.workunit.client.0.smithi112.stdout:5/245: write d4/d9/d2a/f43 [5046012,80717] 0 2024-09-19T09:35:12.764 INFO:tasks.workunit.client.0.smithi112.stdout:5/246: stat d4/d9/f10 0 2024-09-19T09:35:12.769 INFO:tasks.workunit.client.0.smithi112.stdout:8/262: creat d7/d10/d11/d33/d49/f4f x:0 0 0 2024-09-19T09:35:12.770 INFO:tasks.workunit.client.0.smithi112.stdout:6/117: symlink d8/de/d18/d20/l26 0 2024-09-19T09:35:12.770 INFO:tasks.workunit.client.0.smithi112.stdout:6/118: write d8/de/d17/f22 [690108,26885] 0 2024-09-19T09:35:12.772 INFO:tasks.workunit.client.0.smithi112.stdout:4/281: dwrite d1/d3d/d41/f52 [0,4194304] 0 2024-09-19T09:35:12.772 INFO:tasks.workunit.client.0.smithi112.stdout:9/29: dwrite f7 [0,4194304] 0 2024-09-19T09:35:12.772 INFO:tasks.workunit.client.0.smithi112.stdout:0/171: dwrite d2/fb [0,4194304] 0 2024-09-19T09:35:12.773 INFO:tasks.workunit.client.0.smithi112.stdout:7/121: getdents d2 0 2024-09-19T09:35:12.776 INFO:tasks.workunit.client.0.smithi112.stdout:6/119: mknod d8/d11/d13/c27 0 2024-09-19T09:35:12.776 INFO:tasks.workunit.client.0.smithi112.stdout:6/120: fsync d8/f23 0 2024-09-19T09:35:12.776 INFO:tasks.workunit.client.0.smithi112.stdout:6/121: fsync d8/f16 0 2024-09-19T09:35:12.780 INFO:tasks.workunit.client.0.smithi112.stdout:4/282: truncate d1/f29 2783098 0 2024-09-19T09:35:12.780 INFO:tasks.workunit.client.0.smithi112.stdout:4/283: dread - d1/d31/d42/f64 zero size 2024-09-19T09:35:12.784 INFO:tasks.workunit.client.0.smithi112.stdout:7/122: creat d2/d8/f24 x:0 0 0 2024-09-19T09:35:12.785 INFO:tasks.workunit.client.0.smithi112.stdout:5/247: truncate d4/d9/d17/d2f/f32 1369726 0 2024-09-19T09:35:12.785 INFO:tasks.workunit.client.0.smithi112.stdout:9/30: dread f7 [0,4194304] 0 2024-09-19T09:35:12.786 INFO:tasks.workunit.client.0.smithi112.stdout:8/263: dwrite d7/d10/d11/d33/d49/f4f [0,4194304] 0 2024-09-19T09:35:12.787 INFO:tasks.workunit.client.0.smithi112.stdout:6/122: creat d8/de/d18/f28 x:0 0 0 2024-09-19T09:35:12.789 INFO:tasks.workunit.client.0.smithi112.stdout:0/172: getdents d2 0 2024-09-19T09:35:12.789 INFO:tasks.workunit.client.0.smithi112.stdout:0/173: creat d2/d11/f32 x:0 0 0 2024-09-19T09:35:12.789 INFO:tasks.workunit.client.0.smithi112.stdout:6/123: dread d8/f16 [0,4194304] 0 2024-09-19T09:35:12.790 INFO:tasks.workunit.client.0.smithi112.stdout:6/124: chown d8/de/f15 10 1 2024-09-19T09:35:12.790 INFO:tasks.workunit.client.0.smithi112.stdout:6/125: readlink d8/de/d18/l1a 0 2024-09-19T09:35:12.790 INFO:tasks.workunit.client.0.smithi112.stdout:7/123: symlink d2/d8/d18/l25 0 2024-09-19T09:35:12.790 INFO:tasks.workunit.client.0.smithi112.stdout:6/126: readlink l7 0 2024-09-19T09:35:12.790 INFO:tasks.workunit.client.0.smithi112.stdout:7/124: read d2/fe [429284,49350] 0 2024-09-19T09:35:12.791 INFO:tasks.workunit.client.0.smithi112.stdout:5/248: chown d4/d9/d17/d2f/d53/c57 22 1 2024-09-19T09:35:12.791 INFO:tasks.workunit.client.0.smithi112.stdout:0/174: dread d2/f24 [0,4194304] 0 2024-09-19T09:35:12.795 INFO:tasks.workunit.client.0.smithi112.stdout:5/249: dread d4/d9/d2a/f49 [0,4194304] 0 2024-09-19T09:35:12.852 INFO:tasks.workunit.client.0.smithi112.stdout:4/284: dwrite d1/d31/f50 [0,4194304] 0 2024-09-19T09:35:12.852 INFO:tasks.workunit.client.0.smithi112.stdout:4/285: chown d1/d3d/f3f 1865 1 2024-09-19T09:35:12.853 INFO:tasks.workunit.client.0.smithi112.stdout:8/264: mkdir d7/d10/d11/d50 0 2024-09-19T09:35:12.856 INFO:tasks.workunit.client.0.smithi112.stdout:7/125: write d2/d8/d1a/f1b [3259381,50093] 0 2024-09-19T09:35:12.857 INFO:tasks.workunit.client.0.smithi112.stdout:6/127: unlink d8/de/c1b 0 2024-09-19T09:35:12.858 INFO:tasks.workunit.client.0.smithi112.stdout:4/286: read d1/d4/f7 [892752,69999] 0 2024-09-19T09:35:12.858 INFO:tasks.workunit.client.0.smithi112.stdout:4/287: chown d1/d3d/f56 25 1 2024-09-19T09:35:12.858 INFO:tasks.workunit.client.0.smithi112.stdout:0/175: rename d2/f24 to d2/d11/f33 0 2024-09-19T09:35:12.858 INFO:tasks.workunit.client.0.smithi112.stdout:0/176: dread - d2/f30 zero size 2024-09-19T09:35:12.861 INFO:tasks.workunit.client.0.smithi112.stdout:5/250: dwrite d4/d9/d2a/d39/f3a [0,4194304] 0 2024-09-19T09:35:12.865 INFO:tasks.workunit.client.0.smithi112.stdout:7/126: write d2/d8/d18/f1d [3536294,17335] 0 2024-09-19T09:35:12.868 INFO:tasks.workunit.client.0.smithi112.stdout:8/265: getdents d7/d10/d11/d28 0 2024-09-19T09:35:12.870 INFO:tasks.workunit.client.0.smithi112.stdout:6/128: link d8/de/d17/f22 d8/de/d18/f29 0 2024-09-19T09:35:12.873 INFO:tasks.workunit.client.0.smithi112.stdout:0/177: getdents d2 0 2024-09-19T09:35:12.873 INFO:tasks.workunit.client.0.smithi112.stdout:0/178: write d2/f28 [98405,15255] 0 2024-09-19T09:35:12.875 INFO:tasks.workunit.client.0.smithi112.stdout:5/251: mkdir d4/d9/d17/d2e/d5d 0 2024-09-19T09:35:12.875 INFO:tasks.workunit.client.0.smithi112.stdout:3/127: sync 2024-09-19T09:35:12.875 INFO:tasks.workunit.client.0.smithi112.stdout:1/50: sync 2024-09-19T09:35:12.876 INFO:tasks.workunit.client.0.smithi112.stdout:2/42: sync 2024-09-19T09:35:12.876 INFO:tasks.workunit.client.0.smithi112.stdout:7/127: truncate d2/d8/d18/f22 5254218 0 2024-09-19T09:35:12.877 INFO:tasks.workunit.client.0.smithi112.stdout:2/43: write d0/d1/f8 [140458,52914] 0 2024-09-19T09:35:12.882 INFO:tasks.workunit.client.0.smithi112.stdout:6/129: getdents d8/d11/d13 0 2024-09-19T09:35:12.883 INFO:tasks.workunit.client.0.smithi112.stdout:6/130: chown f6 390445304 1 2024-09-19T09:35:12.886 INFO:tasks.workunit.client.0.smithi112.stdout:4/288: unlink d1/d4/c28 0 2024-09-19T09:35:12.888 INFO:tasks.workunit.client.0.smithi112.stdout:5/252: creat d4/d29/d36/d56/f5e x:0 0 0 2024-09-19T09:35:12.888 INFO:tasks.workunit.client.0.smithi112.stdout:0/179: dread d2/fe [0,4194304] 0 2024-09-19T09:35:12.889 INFO:tasks.workunit.client.0.smithi112.stdout:8/266: dwrite d7/d10/d11/d28/d3c/f3d [0,4194304] 0 2024-09-19T09:35:12.891 INFO:tasks.workunit.client.0.smithi112.stdout:1/51: unlink la 0 2024-09-19T09:35:12.892 INFO:tasks.workunit.client.0.smithi112.stdout:3/128: symlink d8/d15/l26 0 2024-09-19T09:35:12.892 INFO:tasks.workunit.client.0.smithi112.stdout:3/129: chown l4 3496140 1 2024-09-19T09:35:12.895 INFO:tasks.workunit.client.0.smithi112.stdout:1/52: dread f8 [0,4194304] 0 2024-09-19T09:35:12.895 INFO:tasks.workunit.client.0.smithi112.stdout:1/53: write f2 [435598,109246] 0 2024-09-19T09:35:12.895 INFO:tasks.workunit.client.0.smithi112.stdout:1/54: chown f6 75324632 1 2024-09-19T09:35:12.895 INFO:tasks.workunit.client.0.smithi112.stdout:6/131: mkdir d8/d11/d14/d2a 0 2024-09-19T09:35:12.895 INFO:tasks.workunit.client.0.smithi112.stdout:6/132: readlink d8/ld 0 2024-09-19T09:35:12.896 INFO:tasks.workunit.client.0.smithi112.stdout:4/289: creat d1/d4/d3a/d57/d60/f66 x:0 0 0 2024-09-19T09:35:12.898 INFO:tasks.workunit.client.0.smithi112.stdout:5/253: rmdir d4/d9/d17 39 2024-09-19T09:35:12.899 INFO:tasks.workunit.client.0.smithi112.stdout:5/254: readlink d4/l26 0 2024-09-19T09:35:12.901 INFO:tasks.workunit.client.0.smithi112.stdout:0/180: rename d2/d11/l26 to d2/l34 0 2024-09-19T09:35:12.901 INFO:tasks.workunit.client.0.smithi112.stdout:0/181: fsync d2/f22 0 2024-09-19T09:35:12.903 INFO:tasks.workunit.client.0.smithi112.stdout:8/267: symlink d7/db/d21/d2e/d42/l51 0 2024-09-19T09:35:12.903 INFO:tasks.workunit.client.0.smithi112.stdout:3/130: rmdir d8/d15/d1b/d1c/d24/d21 39 2024-09-19T09:35:12.903 INFO:tasks.workunit.client.0.smithi112.stdout:3/131: chown c2 2068499 1 2024-09-19T09:35:12.905 INFO:tasks.workunit.client.0.smithi112.stdout:6/133: write d8/f10 [1642993,8164] 0 2024-09-19T09:35:12.905 INFO:tasks.workunit.client.0.smithi112.stdout:4/290: creat d1/d3d/d41/f67 x:0 0 0 2024-09-19T09:35:12.905 INFO:tasks.workunit.client.0.smithi112.stdout:8/268: mkdir d7/d10/d11/d33/d52 0 2024-09-19T09:35:12.907 INFO:tasks.workunit.client.0.smithi112.stdout:3/132: mkdir d8/d15/d1b/d1c/d27 0 2024-09-19T09:35:12.909 INFO:tasks.workunit.client.0.smithi112.stdout:4/291: unlink d1/d4/f25 0 2024-09-19T09:35:12.909 INFO:tasks.workunit.client.0.smithi112.stdout:7/128: dwrite d2/fe [0,4194304] 0 2024-09-19T09:35:12.912 INFO:tasks.workunit.client.0.smithi112.stdout:2/44: dwrite d0/d6/fb [0,4194304] 0 2024-09-19T09:35:12.912 INFO:tasks.workunit.client.0.smithi112.stdout:2/45: creat d0/d1/ff x:0 0 0 2024-09-19T09:35:12.918 INFO:tasks.workunit.client.0.smithi112.stdout:1/55: getdents . 0 2024-09-19T09:35:12.928 INFO:tasks.workunit.client.0.smithi112.stdout:7/129: dread d2/d8/fc [0,4194304] 0 2024-09-19T09:35:12.933 INFO:tasks.workunit.client.0.smithi112.stdout:8/269: write d7/d10/d11/d33/d49/f4f [1522055,98777] 0 2024-09-19T09:35:12.935 INFO:tasks.workunit.client.0.smithi112.stdout:1/56: write f2 [5966960,116240] 0 2024-09-19T09:35:12.937 INFO:tasks.workunit.client.0.smithi112.stdout:5/255: dwrite d4/d9/d2a/f43 [0,4194304] 0 2024-09-19T09:35:12.938 INFO:tasks.workunit.client.0.smithi112.stdout:0/182: dwrite d2/d11/f33 [0,4194304] 0 2024-09-19T09:35:12.939 INFO:tasks.workunit.client.0.smithi112.stdout:0/183: chown d2/d11/l25 0 1 2024-09-19T09:35:12.939 INFO:tasks.workunit.client.0.smithi112.stdout:3/133: dwrite d8/fd [0,4194304] 0 2024-09-19T09:35:12.939 INFO:tasks.workunit.client.0.smithi112.stdout:0/184: fdatasync d2/f31 0 2024-09-19T09:35:12.954 INFO:tasks.workunit.client.0.smithi112.stdout:5/256: dwrite d4/d9/d17/d2e/f42 [4194304,4194304] 0 2024-09-19T09:35:12.954 INFO:tasks.workunit.client.0.smithi112.stdout:5/257: write d4/d9/f28 [970922,98510] 0 2024-09-19T09:35:12.966 INFO:tasks.workunit.client.0.smithi112.stdout:5/258: dwrite d4/d9/d17/d2f/f32 [0,4194304] 0 2024-09-19T09:35:12.978 INFO:tasks.workunit.client.0.smithi112.stdout:6/134: getdents d8/d11/d14 0 2024-09-19T09:35:12.979 INFO:tasks.workunit.client.0.smithi112.stdout:8/270: truncate d7/d10/d11/d33/f27 344188 0 2024-09-19T09:35:13.052 INFO:tasks.workunit.client.0.smithi112.stdout:1/57: mkdir dc 0 2024-09-19T09:35:13.057 INFO:tasks.workunit.client.0.smithi112.stdout:0/185: truncate d2/fb 576600 0 2024-09-19T09:35:13.059 INFO:tasks.workunit.client.0.smithi112.stdout:3/134: mkdir d8/d15/d1b/d28 0 2024-09-19T09:35:13.059 INFO:tasks.workunit.client.0.smithi112.stdout:3/135: readlink d8/l14 0 2024-09-19T09:35:13.060 INFO:tasks.workunit.client.0.smithi112.stdout:5/259: mkdir d4/d29/d36/d5f 0 2024-09-19T09:35:13.062 INFO:tasks.workunit.client.0.smithi112.stdout:7/130: mknod d2/d8/c26 0 2024-09-19T09:35:13.063 INFO:tasks.workunit.client.0.smithi112.stdout:6/135: mkdir d8/d2b 0 2024-09-19T09:35:13.065 INFO:tasks.workunit.client.0.smithi112.stdout:8/271: symlink d7/d10/d11/d33/d49/l53 0 2024-09-19T09:35:13.071 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:12 smithi112 ceph-mon[27605]: pgmap v18: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 210 MiB/s rd, 272 MiB/s wr, 373 op/s 2024-09-19T09:35:13.071 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:12 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:35:13.072 INFO:tasks.workunit.client.0.smithi112.stdout:3/136: creat d8/d15/f29 x:0 0 0 2024-09-19T09:35:13.072 INFO:tasks.workunit.client.0.smithi112.stdout:3/137: write d8/f17 [1290942,64815] 0 2024-09-19T09:35:13.072 INFO:tasks.workunit.client.0.smithi112.stdout:3/138: chown d8/fb 344555 1 2024-09-19T09:35:13.072 INFO:tasks.workunit.client.0.smithi112.stdout:3/139: dread - d8/d15/d1b/d1c/d24/f22 zero size 2024-09-19T09:35:13.073 INFO:tasks.workunit.client.0.smithi112.stdout:7/131: creat d2/d8/d1f/d23/f27 x:0 0 0 2024-09-19T09:35:13.074 INFO:tasks.workunit.client.0.smithi112.stdout:6/136: symlink d8/d11/d14/d2a/l2c 0 2024-09-19T09:35:13.077 INFO:tasks.workunit.client.0.smithi112.stdout:8/272: unlink d7/d10/d11/d33/d49/l53 0 2024-09-19T09:35:13.078 INFO:tasks.workunit.client.0.smithi112.stdout:0/186: getdents d2/d11 0 2024-09-19T09:35:13.081 INFO:tasks.workunit.client.0.smithi112.stdout:7/132: creat d2/f28 x:0 0 0 2024-09-19T09:35:13.081 INFO:tasks.workunit.client.0.smithi112.stdout:3/140: write d8/f10 [1145340,39278] 0 2024-09-19T09:35:13.081 INFO:tasks.workunit.client.0.smithi112.stdout:6/137: creat d8/d2b/f2d x:0 0 0 2024-09-19T09:35:13.081 INFO:tasks.workunit.client.0.smithi112.stdout:6/138: readlink d8/lb 0 2024-09-19T09:35:13.084 INFO:tasks.workunit.client.0.smithi112.stdout:8/273: creat d7/d10/d11/d33/f54 x:0 0 0 2024-09-19T09:35:13.084 INFO:tasks.workunit.client.0.smithi112.stdout:0/187: symlink d2/d11/l35 0 2024-09-19T09:35:13.086 INFO:tasks.workunit.client.0.smithi112.stdout:7/133: rename d2/d8/d18/f1d to d2/d8/d1a/f29 0 2024-09-19T09:35:13.086 INFO:tasks.workunit.client.0.smithi112.stdout:7/134: chown d2/d8/f10 9 1 2024-09-19T09:35:13.087 INFO:tasks.workunit.client.0.smithi112.stdout:6/139: creat d8/d11/d13/f2e x:0 0 0 2024-09-19T09:35:13.089 INFO:tasks.workunit.client.0.smithi112.stdout:8/274: mkdir d7/d10/d11/d55 0 2024-09-19T09:35:13.089 INFO:tasks.workunit.client.0.smithi112.stdout:3/141: write d8/fd [2565502,6534] 0 2024-09-19T09:35:13.089 INFO:tasks.workunit.client.0.smithi112.stdout:3/142: readlink d8/d15/l26 0 2024-09-19T09:35:13.090 INFO:tasks.workunit.client.0.smithi112.stdout:5/260: dwrite d4/d29/f2d [0,4194304] 0 2024-09-19T09:35:13.093 INFO:tasks.workunit.client.0.smithi112.stdout:7/135: read d2/d8/fc [3325614,37370] 0 2024-09-19T09:35:13.093 INFO:tasks.workunit.client.0.smithi112.stdout:6/140: mknod d8/d11/d14/c2f 0 2024-09-19T09:35:13.097 INFO:tasks.workunit.client.0.smithi112.stdout:3/143: creat d8/d15/d1b/d1c/d27/f2a x:0 0 0 2024-09-19T09:35:13.103 INFO:tasks.workunit.client.0.smithi112.stdout:7/136: unlink d2/d8/f10 0 2024-09-19T09:35:13.105 INFO:tasks.workunit.client.0.smithi112.stdout:6/141: mknod d8/d11/c30 0 2024-09-19T09:35:13.105 INFO:tasks.workunit.client.0.smithi112.stdout:6/142: chown f5 559 1 2024-09-19T09:35:13.105 INFO:tasks.workunit.client.0.smithi112.stdout:6/143: readlink d8/l12 0 2024-09-19T09:35:13.118 INFO:tasks.workunit.client.0.smithi112.stdout:7/137: dread d2/d8/d18/f22 [0,4194304] 0 2024-09-19T09:35:13.118 INFO:tasks.workunit.client.0.smithi112.stdout:8/275: dwrite d7/db/d21/f47 [8388608,4194304] 0 2024-09-19T09:35:13.122 INFO:tasks.workunit.client.0.smithi112.stdout:8/276: rmdir d7/d10/d11/d33/d52 0 2024-09-19T09:35:13.123 INFO:tasks.workunit.client.0.smithi112.stdout:0/188: getdents d2/d11 0 2024-09-19T09:35:13.124 INFO:tasks.workunit.client.0.smithi112.stdout:8/277: rename d7/d10/d11/d28 to d7/db/d21/d3b/d56 0 2024-09-19T09:35:13.125 INFO:tasks.workunit.client.0.smithi112.stdout:0/189: creat d2/f36 x:0 0 0 2024-09-19T09:35:13.126 INFO:tasks.workunit.client.0.smithi112.stdout:3/144: dwrite d8/fd [0,4194304] 0 2024-09-19T09:35:13.128 INFO:tasks.workunit.client.0.smithi112.stdout:5/261: dwrite d4/d9/d17/d30/f38 [0,4194304] 0 2024-09-19T09:35:13.134 INFO:tasks.workunit.client.0.smithi112.stdout:8/278: write d7/fa [1262689,109906] 0 2024-09-19T09:35:13.135 INFO:tasks.workunit.client.0.smithi112.stdout:8/279: mkdir d7/db/d21/d2e/d42/d57 0 2024-09-19T09:35:13.135 INFO:tasks.workunit.client.0.smithi112.stdout:8/280: stat d7/d10/d11/d55 0 2024-09-19T09:35:13.140 INFO:tasks.workunit.client.0.smithi112.stdout:5/262: write d4/d9/f1c [1421955,128064] 0 2024-09-19T09:35:13.141 INFO:tasks.workunit.client.0.smithi112.stdout:5/263: rename d4/d9/d17/d2f/d53/c57 to d4/d9/d3e/c60 0 2024-09-19T09:35:13.147 INFO:tasks.workunit.client.0.smithi112.stdout:6/144: dwrite d8/d11/d14/f1c [0,4194304] 0 2024-09-19T09:35:13.147 INFO:tasks.workunit.client.0.smithi112.stdout:8/281: dread d7/db/d21/f43 [4194304,4194304] 0 2024-09-19T09:35:13.149 INFO:tasks.workunit.client.0.smithi112.stdout:6/145: getdents d8/de/d18/d20 0 2024-09-19T09:35:13.149 INFO:tasks.workunit.client.0.smithi112.stdout:6/146: write d8/de/d17/f1e [1362277,82140] 0 2024-09-19T09:35:13.149 INFO:tasks.workunit.client.0.smithi112.stdout:8/282: mknod d7/c58 0 2024-09-19T09:35:13.150 INFO:tasks.workunit.client.0.smithi112.stdout:8/283: symlink d7/db/d21/l59 0 2024-09-19T09:35:13.153 INFO:tasks.workunit.client.0.smithi112.stdout:0/190: dwrite d2/f1b [4194304,4194304] 0 2024-09-19T09:35:13.153 INFO:tasks.workunit.client.0.smithi112.stdout:3/145: dwrite d8/d15/d1b/d1c/d24/d21/f23 [0,4194304] 0 2024-09-19T09:35:13.160 INFO:tasks.workunit.client.0.smithi112.stdout:6/147: dread d8/f23 [4194304,4194304] 0 2024-09-19T09:35:13.160 INFO:tasks.workunit.client.0.smithi112.stdout:7/138: dwrite d2/f15 [4194304,4194304] 0 2024-09-19T09:35:13.160 INFO:tasks.workunit.client.0.smithi112.stdout:6/148: fsync d8/d11/d14/f24 0 2024-09-19T09:35:13.161 INFO:tasks.workunit.client.0.smithi112.stdout:5/264: read d4/d9/d2a/d46/f55 [1934580,103977] 0 2024-09-19T09:35:13.161 INFO:tasks.workunit.client.0.smithi112.stdout:5/265: readlink d4/d29/d4c/l4f 0 2024-09-19T09:35:13.161 INFO:tasks.workunit.client.0.smithi112.stdout:5/266: truncate d4/d29/d36/d56/f5e 4957 0 2024-09-19T09:35:13.161 INFO:tasks.workunit.client.0.smithi112.stdout:5/267: truncate d4/d9/f28 4630217 0 2024-09-19T09:35:13.162 INFO:tasks.workunit.client.0.smithi112.stdout:3/146: write f6 [2149110,101122] 0 2024-09-19T09:35:13.164 INFO:tasks.workunit.client.0.smithi112.stdout:8/284: dread d7/db/d21/d3b/d56/d3c/f3d [0,4194304] 0 2024-09-19T09:35:13.164 INFO:tasks.workunit.client.0.smithi112.stdout:8/285: truncate d7/fa 3266168 0 2024-09-19T09:35:13.167 INFO:tasks.workunit.client.0.smithi112.stdout:0/191: write d2/fe [886569,23878] 0 2024-09-19T09:35:13.169 INFO:tasks.workunit.client.0.smithi112.stdout:7/139: write d2/fe [4443463,115744] 0 2024-09-19T09:35:13.170 INFO:tasks.workunit.client.0.smithi112.stdout:6/149: truncate d8/f16 172024 0 2024-09-19T09:35:13.171 INFO:tasks.workunit.client.0.smithi112.stdout:3/147: mkdir d8/d15/d1b/d1c/d27/d2b 0 2024-09-19T09:35:13.172 INFO:tasks.workunit.client.0.smithi112.stdout:3/148: write f6 [4624743,52266] 0 2024-09-19T09:35:13.173 INFO:tasks.workunit.client.0.smithi112.stdout:8/286: read d7/db/d21/f43 [2920754,61162] 0 2024-09-19T09:35:13.173 INFO:tasks.workunit.client.0.smithi112.stdout:8/287: write d7/d10/d11/d33/f27 [1342782,115121] 0 2024-09-19T09:35:13.177 INFO:tasks.workunit.client.0.smithi112.stdout:0/192: dread d2/d11/f33 [0,4194304] 0 2024-09-19T09:35:13.179 INFO:tasks.workunit.client.0.smithi112.stdout:7/140: mknod d2/d8/d1f/c2a 0 2024-09-19T09:35:13.179 INFO:tasks.workunit.client.0.smithi112.stdout:7/141: write d2/d8/fc [1996720,59849] 0 2024-09-19T09:35:13.179 INFO:tasks.workunit.client.0.smithi112.stdout:5/268: getdents d4/d9/d2a/d46 0 2024-09-19T09:35:13.182 INFO:tasks.workunit.client.0.smithi112.stdout:3/149: mknod d8/d15/d1b/d1c/d27/c2c 0 2024-09-19T09:35:13.182 INFO:tasks.workunit.client.0.smithi112.stdout:8/288: mknod d7/db/d21/d2e/d42/c5a 0 2024-09-19T09:35:13.185 INFO:tasks.workunit.client.0.smithi112.stdout:0/193: creat d2/d11/f37 x:0 0 0 2024-09-19T09:35:13.187 INFO:tasks.workunit.client.0.smithi112.stdout:0/194: dread d2/fb [0,4194304] 0 2024-09-19T09:35:13.187 INFO:tasks.workunit.client.0.smithi112.stdout:0/195: creat d2/f38 x:0 0 0 2024-09-19T09:35:13.187 INFO:tasks.workunit.client.0.smithi112.stdout:0/196: write d2/f28 [115061,15668] 0 2024-09-19T09:35:13.188 INFO:tasks.workunit.client.0.smithi112.stdout:3/150: symlink d8/d15/d1b/d28/l2d 0 2024-09-19T09:35:13.188 INFO:tasks.workunit.client.0.smithi112.stdout:5/269: getdents d4/d9/d2a/d39 0 2024-09-19T09:35:13.192 INFO:tasks.workunit.client.0.smithi112.stdout:8/289: dread d7/db/d21/f2a [0,4194304] 0 2024-09-19T09:35:13.192 INFO:tasks.workunit.client.0.smithi112.stdout:3/151: creat d8/d15/d1b/d1c/d24/f2e x:0 0 0 2024-09-19T09:35:13.194 INFO:tasks.workunit.client.0.smithi112.stdout:5/270: mkdir d4/d9/d17/d2e/d61 0 2024-09-19T09:35:13.194 INFO:tasks.workunit.client.0.smithi112.stdout:8/290: mkdir d7/db/d21/d3b/d56/d4b/d5b 0 2024-09-19T09:35:13.195 INFO:tasks.workunit.client.0.smithi112.stdout:3/152: mknod d8/d15/d1b/c2f 0 2024-09-19T09:35:13.196 INFO:tasks.workunit.client.0.smithi112.stdout:8/291: mknod d7/db/d21/d2e/d42/c5c 0 2024-09-19T09:35:13.197 INFO:tasks.workunit.client.0.smithi112.stdout:6/150: dwrite d8/de/d18/f29 [0,4194304] 0 2024-09-19T09:35:13.197 INFO:tasks.workunit.client.0.smithi112.stdout:7/142: dwrite d2/f28 [0,4194304] 0 2024-09-19T09:35:13.197 INFO:tasks.workunit.client.0.smithi112.stdout:7/143: fsync d2/f13 0 2024-09-19T09:35:13.197 INFO:tasks.workunit.client.0.smithi112.stdout:0/197: read d2/f1b [2434944,8402] 0 2024-09-19T09:35:13.199 INFO:tasks.workunit.client.0.smithi112.stdout:3/153: rename d8/d15/d1b/d1c/d24/f22 to d8/f30 0 2024-09-19T09:35:13.200 INFO:tasks.workunit.client.0.smithi112.stdout:8/292: creat d7/d10/d11/d33/d49/f5d x:0 0 0 2024-09-19T09:35:13.202 INFO:tasks.workunit.client.0.smithi112.stdout:8/293: write d7/db/d21/f4e [1161,77258] 0 2024-09-19T09:35:13.205 INFO:tasks.workunit.client.0.smithi112.stdout:0/198: mkdir d2/d39 0 2024-09-19T09:35:13.208 INFO:tasks.workunit.client.0.smithi112.stdout:6/151: rename d8/d11/d13/f2e to d8/de/d17/f31 0 2024-09-19T09:35:13.211 INFO:tasks.workunit.client.0.smithi112.stdout:5/271: rmdir d4/d9/d17/d2f/d53 0 2024-09-19T09:35:13.211 INFO:tasks.workunit.client.0.smithi112.stdout:5/272: write d4/d9/d17/d2f/f32 [5187703,51998] 0 2024-09-19T09:35:13.211 INFO:tasks.workunit.client.0.smithi112.stdout:5/273: stat d4/d9/d17/d2e/f41 0 2024-09-19T09:35:13.214 INFO:tasks.workunit.client.0.smithi112.stdout:8/294: creat d7/db/d21/d2e/f5e x:0 0 0 2024-09-19T09:35:13.216 INFO:tasks.workunit.client.0.smithi112.stdout:6/152: rename d8/de/f15 to d8/d11/d14/d2a/f32 0 2024-09-19T09:35:13.216 INFO:tasks.workunit.client.0.smithi112.stdout:6/153: readlink d8/d11/d14/d2a/l2c 0 2024-09-19T09:35:13.217 INFO:tasks.workunit.client.0.smithi112.stdout:7/144: dwrite d2/d8/d18/f22 [0,4194304] 0 2024-09-19T09:35:13.217 INFO:tasks.workunit.client.0.smithi112.stdout:7/145: fdatasync d2/d8/d1a/f29 0 2024-09-19T09:35:13.219 INFO:tasks.workunit.client.0.smithi112.stdout:3/154: getdents d8 0 2024-09-19T09:35:13.221 INFO:tasks.workunit.client.0.smithi112.stdout:5/274: creat d4/f62 x:0 0 0 2024-09-19T09:35:13.221 INFO:tasks.workunit.client.0.smithi112.stdout:5/275: chown d4/d29/d36/d5f 0 1 2024-09-19T09:35:13.226 INFO:tasks.workunit.client.0.smithi112.stdout:0/199: dwrite d2/f30 [0,4194304] 0 2024-09-19T09:35:13.226 INFO:tasks.workunit.client.0.smithi112.stdout:8/295: link d7/d10/f1e d7/db/d21/d3b/d56/d4b/f5f 0 2024-09-19T09:35:13.227 INFO:tasks.workunit.client.0.smithi112.stdout:6/154: rename d8/de/d18/d20/l26 to d8/d11/d13/l33 0 2024-09-19T09:35:13.231 INFO:tasks.workunit.client.0.smithi112.stdout:8/296: getdents d7/db/d21 0 2024-09-19T09:35:13.236 INFO:tasks.workunit.client.0.smithi112.stdout:5/276: dread d4/d9/d2a/f43 [0,4194304] 0 2024-09-19T09:35:13.237 INFO:tasks.workunit.client.0.smithi112.stdout:6/155: dread d8/d11/d14/f24 [0,4194304] 0 2024-09-19T09:35:13.237 INFO:tasks.workunit.client.0.smithi112.stdout:6/156: chown d8/l12 39148 1 2024-09-19T09:35:13.241 INFO:tasks.workunit.client.0.smithi112.stdout:8/297: dread d7/db/d21/f43 [0,4194304] 0 2024-09-19T09:35:13.242 INFO:tasks.workunit.client.0.smithi112.stdout:8/298: dread - d7/d10/d11/d33/d49/f5d zero size 2024-09-19T09:35:13.242 INFO:tasks.workunit.client.0.smithi112.stdout:8/299: rmdir d7/d10/d11/d33/d49 39 2024-09-19T09:35:13.242 INFO:tasks.workunit.client.0.smithi112.stdout:0/200: dread d2/d11/f1c [0,4194304] 0 2024-09-19T09:35:13.242 INFO:tasks.workunit.client.0.smithi112.stdout:7/146: dwrite d2/d8/d1f/d23/f27 [0,4194304] 0 2024-09-19T09:35:13.246 INFO:tasks.workunit.client.0.smithi112.stdout:6/157: dread d8/d11/d14/f24 [0,4194304] 0 2024-09-19T09:35:13.246 INFO:tasks.workunit.client.0.smithi112.stdout:6/158: fdatasync d8/d11/d14/d2a/f32 0 2024-09-19T09:35:13.246 INFO:tasks.workunit.client.0.smithi112.stdout:3/155: dwrite d8/d15/d1b/d1c/d24/f2e [0,4194304] 0 2024-09-19T09:35:13.247 INFO:tasks.workunit.client.0.smithi112.stdout:7/147: symlink d2/d8/d1f/d21/l2b 0 2024-09-19T09:35:13.250 INFO:tasks.workunit.client.0.smithi112.stdout:6/159: truncate d8/f16 92172 0 2024-09-19T09:35:13.255 INFO:tasks.workunit.client.0.smithi112.stdout:8/300: dread d7/d10/f16 [4194304,4194304] 0 2024-09-19T09:35:13.259 INFO:tasks.workunit.client.0.smithi112.stdout:0/201: dread d2/d11/f33 [0,4194304] 0 2024-09-19T09:35:13.276 INFO:tasks.workunit.client.0.smithi112.stdout:9/31: sync 2024-09-19T09:35:13.277 INFO:tasks.workunit.client.0.smithi112.stdout:1/58: sync 2024-09-19T09:35:13.277 INFO:tasks.workunit.client.0.smithi112.stdout:2/46: sync 2024-09-19T09:35:13.277 INFO:tasks.workunit.client.0.smithi112.stdout:4/292: sync 2024-09-19T09:35:13.277 INFO:tasks.workunit.client.0.smithi112.stdout:4/293: creat d1/d3d/f68 x:0 0 0 2024-09-19T09:35:13.277 INFO:tasks.workunit.client.0.smithi112.stdout:4/294: creat d1/d3d/d41/f69 x:0 0 0 2024-09-19T09:35:13.277 INFO:tasks.workunit.client.0.smithi112.stdout:4/295: creat d1/d4/d3a/f6a x:0 0 0 2024-09-19T09:35:13.280 INFO:tasks.workunit.client.0.smithi112.stdout:7/148: mkdir d2/d2c 0 2024-09-19T09:35:13.280 INFO:tasks.workunit.client.0.smithi112.stdout:6/160: write f5 [2923035,55063] 0 2024-09-19T09:35:13.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:12 smithi191 ceph-mon[34834]: pgmap v18: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 210 MiB/s rd, 272 MiB/s wr, 373 op/s 2024-09-19T09:35:13.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:12 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:35:13.285 INFO:tasks.workunit.client.0.smithi112.stdout:1/59: truncate f6 136980 0 2024-09-19T09:35:13.287 INFO:tasks.workunit.client.0.smithi112.stdout:9/32: symlink la 0 2024-09-19T09:35:13.287 INFO:tasks.workunit.client.0.smithi112.stdout:9/33: creat fb x:0 0 0 2024-09-19T09:35:13.287 INFO:tasks.workunit.client.0.smithi112.stdout:9/34: fsync f0 0 2024-09-19T09:35:13.289 INFO:tasks.workunit.client.0.smithi112.stdout:2/47: rename d0/d1/f8 to d0/d1/d9/f10 0 2024-09-19T09:35:13.293 INFO:tasks.workunit.client.0.smithi112.stdout:2/48: dread d0/d1/d9/f10 [0,4194304] 0 2024-09-19T09:35:13.294 INFO:tasks.workunit.client.0.smithi112.stdout:9/35: dread f0 [0,4194304] 0 2024-09-19T09:35:13.294 INFO:tasks.workunit.client.0.smithi112.stdout:9/36: creat fc x:0 0 0 2024-09-19T09:35:13.295 INFO:tasks.workunit.client.0.smithi112.stdout:1/60: creat dc/fd x:0 0 0 2024-09-19T09:35:13.296 INFO:tasks.workunit.client.0.smithi112.stdout:4/296: rmdir d1/d4/d3a/d57/d60 39 2024-09-19T09:35:13.297 INFO:tasks.workunit.client.0.smithi112.stdout:4/297: creat d1/d31/d42/f6b x:0 0 0 2024-09-19T09:35:13.298 INFO:tasks.workunit.client.0.smithi112.stdout:7/149: getdents d2/d8/d1f/d23 0 2024-09-19T09:35:13.300 INFO:tasks.workunit.client.0.smithi112.stdout:9/37: link la ld 0 2024-09-19T09:35:13.300 INFO:tasks.workunit.client.0.smithi112.stdout:9/38: truncate f3 5220970 0 2024-09-19T09:35:13.301 INFO:tasks.workunit.client.0.smithi112.stdout:1/61: link dc/fd dc/fe 0 2024-09-19T09:35:13.303 INFO:tasks.workunit.client.0.smithi112.stdout:4/298: symlink d1/d31/d43/d48/l6c 0 2024-09-19T09:35:13.303 INFO:tasks.workunit.client.0.smithi112.stdout:4/299: read - d1/d4/d3a/f5d zero size 2024-09-19T09:35:13.303 INFO:tasks.workunit.client.0.smithi112.stdout:4/300: write d1/d3d/f44 [5148008,51414] 0 2024-09-19T09:35:13.303 INFO:tasks.workunit.client.0.smithi112.stdout:2/49: getdents d0/d6 0 2024-09-19T09:35:13.304 INFO:tasks.workunit.client.0.smithi112.stdout:2/50: truncate d0/d1/fd 489252 0 2024-09-19T09:35:13.304 INFO:tasks.workunit.client.0.smithi112.stdout:2/51: dread - d0/d6/fa zero size 2024-09-19T09:35:13.304 INFO:tasks.workunit.client.0.smithi112.stdout:7/150: rename d2/d8/fc to d2/d8/d1a/f2d 0 2024-09-19T09:35:13.305 INFO:tasks.workunit.client.0.smithi112.stdout:4/301: readlink d1/d4/l5 0 2024-09-19T09:35:13.305 INFO:tasks.workunit.client.0.smithi112.stdout:4/302: creat d1/d4/d3a/d57/d60/f6d x:0 0 0 2024-09-19T09:35:13.306 INFO:tasks.workunit.client.0.smithi112.stdout:4/303: symlink d1/d31/d51/l6e 0 2024-09-19T09:35:13.307 INFO:tasks.workunit.client.0.smithi112.stdout:4/304: rename d1/c16 to d1/d4/d3a/d57/d60/c6f 0 2024-09-19T09:35:13.307 INFO:tasks.workunit.client.0.smithi112.stdout:4/305: chown d1/lf 3922 1 2024-09-19T09:35:13.309 INFO:tasks.workunit.client.0.smithi112.stdout:6/161: dwrite d8/de/d18/f29 [0,4194304] 0 2024-09-19T09:35:13.310 INFO:tasks.workunit.client.0.smithi112.stdout:6/162: rmdir d8/d11/d14/d2a 39 2024-09-19T09:35:13.311 INFO:tasks.workunit.client.0.smithi112.stdout:6/163: creat d8/d11/f34 x:0 0 0 2024-09-19T09:35:13.311 INFO:tasks.workunit.client.0.smithi112.stdout:6/164: write d8/d11/d14/f24 [1040314,56808] 0 2024-09-19T09:35:13.314 INFO:tasks.workunit.client.0.smithi112.stdout:4/306: dread d1/d31/d51/f55 [0,4194304] 0 2024-09-19T09:35:13.318 INFO:tasks.workunit.client.0.smithi112.stdout:7/151: read d2/d8/d18/f22 [4141119,19265] 0 2024-09-19T09:35:13.320 INFO:tasks.workunit.client.0.smithi112.stdout:7/152: unlink d2/d8/f24 0 2024-09-19T09:35:13.330 INFO:tasks.workunit.client.0.smithi112.stdout:7/153: dread d2/d8/d1a/f2d [0,4194304] 0 2024-09-19T09:35:13.332 INFO:tasks.workunit.client.0.smithi112.stdout:6/165: dwrite d8/de/d17/f31 [0,4194304] 0 2024-09-19T09:35:13.332 INFO:tasks.workunit.client.0.smithi112.stdout:6/166: creat d8/de/d18/f35 x:0 0 0 2024-09-19T09:35:13.340 INFO:tasks.workunit.client.0.smithi112.stdout:7/154: write d2/fd [3423470,99286] 0 2024-09-19T09:35:13.341 INFO:tasks.workunit.client.0.smithi112.stdout:7/155: getdents d2/d8/d1f 0 2024-09-19T09:35:13.342 INFO:tasks.workunit.client.0.smithi112.stdout:7/156: creat d2/d8/d1f/d21/f2e x:0 0 0 2024-09-19T09:35:13.370 INFO:tasks.workunit.client.0.smithi112.stdout:5/277: dwrite d4/f13 [0,4194304] 0 2024-09-19T09:35:13.372 INFO:tasks.workunit.client.0.smithi112.stdout:5/278: link d4/d9/f28 d4/d9/d17/d2e/f63 0 2024-09-19T09:35:13.372 INFO:tasks.workunit.client.0.smithi112.stdout:5/279: chown d4/d29/d36/l54 436202 1 2024-09-19T09:35:13.374 INFO:tasks.workunit.client.0.smithi112.stdout:5/280: mknod d4/d9/d17/c64 0 2024-09-19T09:35:13.375 INFO:tasks.workunit.client.0.smithi112.stdout:6/167: fdatasync d8/d11/d14/f24 0 2024-09-19T09:35:13.375 INFO:tasks.workunit.client.0.smithi112.stdout:5/281: symlink d4/d9/d17/d2e/d5d/l65 0 2024-09-19T09:35:13.377 INFO:tasks.workunit.client.0.smithi112.stdout:6/168: symlink d8/d11/d13/l36 0 2024-09-19T09:35:13.377 INFO:tasks.workunit.client.0.smithi112.stdout:6/169: fsync d8/f16 0 2024-09-19T09:35:13.377 INFO:tasks.workunit.client.0.smithi112.stdout:0/202: write d2/f4 [2727662,932] 0 2024-09-19T09:35:13.378 INFO:tasks.workunit.client.0.smithi112.stdout:5/282: mknod d4/d9/d2a/d39/c66 0 2024-09-19T09:35:13.378 INFO:tasks.workunit.client.0.smithi112.stdout:7/157: dwrite d2/fe [4194304,4194304] 0 2024-09-19T09:35:13.380 INFO:tasks.workunit.client.0.smithi112.stdout:6/170: symlink d8/de/d18/l37 0 2024-09-19T09:35:13.380 INFO:tasks.workunit.client.0.smithi112.stdout:6/171: chown c0 10 1 2024-09-19T09:35:13.381 INFO:tasks.workunit.client.0.smithi112.stdout:0/203: symlink d2/l3a 0 2024-09-19T09:35:13.382 INFO:tasks.workunit.client.0.smithi112.stdout:5/283: truncate d4/d9/d17/d2e/f41 28598 0 2024-09-19T09:35:13.386 INFO:tasks.workunit.client.0.smithi112.stdout:7/158: truncate d2/f13 3127227 0 2024-09-19T09:35:13.386 INFO:tasks.workunit.client.0.smithi112.stdout:1/62: dread f6 [0,4194304] 0 2024-09-19T09:35:13.387 INFO:tasks.workunit.client.0.smithi112.stdout:2/52: link d0/d1/d9/f10 d0/d1/de/f11 0 2024-09-19T09:35:13.388 INFO:tasks.workunit.client.0.smithi112.stdout:5/284: write d4/d9/d2a/f43 [3212295,44245] 0 2024-09-19T09:35:13.389 INFO:tasks.workunit.client.0.smithi112.stdout:0/204: dread d2/f4 [0,4194304] 0 2024-09-19T09:35:13.390 INFO:tasks.workunit.client.0.smithi112.stdout:7/159: unlink d2/f11 0 2024-09-19T09:35:13.391 INFO:tasks.workunit.client.0.smithi112.stdout:2/53: link d0/d1/l3 d0/d1/d9/l12 0 2024-09-19T09:35:13.393 INFO:tasks.workunit.client.0.smithi112.stdout:0/205: mkdir d2/d39/d3b 0 2024-09-19T09:35:13.394 INFO:tasks.workunit.client.0.smithi112.stdout:9/39: fsync fc 0 2024-09-19T09:35:13.394 INFO:tasks.workunit.client.0.smithi112.stdout:9/40: chown f7 14058 1 2024-09-19T09:35:13.395 INFO:tasks.workunit.client.0.smithi112.stdout:2/54: mknod d0/c13 0 2024-09-19T09:35:13.395 INFO:tasks.workunit.client.0.smithi112.stdout:2/55: dread - d0/d1/ff zero size 2024-09-19T09:35:13.395 INFO:tasks.workunit.client.0.smithi112.stdout:1/63: dread f2 [0,4194304] 0 2024-09-19T09:35:13.396 INFO:tasks.workunit.client.0.smithi112.stdout:5/285: getdents d4/d9/d2a 0 2024-09-19T09:35:13.399 INFO:tasks.workunit.client.0.smithi112.stdout:7/160: rename d2/d8/d1a/f29 to d2/d8/f2f 0 2024-09-19T09:35:13.403 INFO:tasks.workunit.client.0.smithi112.stdout:7/161: fsync d2/fd 0 2024-09-19T09:35:13.403 INFO:tasks.workunit.client.0.smithi112.stdout:7/162: read d2/d8/f2f [722217,42476] 0 2024-09-19T09:35:13.403 INFO:tasks.workunit.client.0.smithi112.stdout:7/163: chown d2/d8/c26 402 1 2024-09-19T09:35:13.403 INFO:tasks.workunit.client.0.smithi112.stdout:5/286: write d4/d29/f3c [4002713,116135] 0 2024-09-19T09:35:13.403 INFO:tasks.workunit.client.0.smithi112.stdout:2/56: mknod d0/d1/d9/c14 0 2024-09-19T09:35:13.404 INFO:tasks.workunit.client.0.smithi112.stdout:0/206: rename d2/d11/f14 to d2/f3c 0 2024-09-19T09:35:13.406 INFO:tasks.workunit.client.0.smithi112.stdout:5/287: symlink d4/d9/d17/d30/l67 0 2024-09-19T09:35:13.407 INFO:tasks.workunit.client.0.smithi112.stdout:2/57: mkdir d0/d1/de/d15 0 2024-09-19T09:35:13.407 INFO:tasks.workunit.client.0.smithi112.stdout:2/58: write d0/d1/ff [147220,107472] 0 2024-09-19T09:35:13.408 INFO:tasks.workunit.client.0.smithi112.stdout:5/288: mknod d4/d9/c68 0 2024-09-19T09:35:13.408 INFO:tasks.workunit.client.0.smithi112.stdout:5/289: readlink d4/d9/d17/l1d 0 2024-09-19T09:35:13.409 INFO:tasks.workunit.client.0.smithi112.stdout:4/307: getdents d1/d4/d3a/d57/d60 0 2024-09-19T09:35:13.410 INFO:tasks.workunit.client.0.smithi112.stdout:0/207: write d2/fb [286452,47687] 0 2024-09-19T09:35:13.410 INFO:tasks.workunit.client.0.smithi112.stdout:0/208: write d2/f4 [2164822,81498] 0 2024-09-19T09:35:13.410 INFO:tasks.workunit.client.0.smithi112.stdout:0/209: chown d2/fb 3588 1 2024-09-19T09:35:13.411 INFO:tasks.workunit.client.0.smithi112.stdout:5/290: unlink d4/f13 0 2024-09-19T09:35:13.412 INFO:tasks.workunit.client.0.smithi112.stdout:7/164: dread d2/fe [0,4194304] 0 2024-09-19T09:35:13.412 INFO:tasks.workunit.client.0.smithi112.stdout:4/308: mknod d1/d4/d3a/d57/d60/c70 0 2024-09-19T09:35:13.413 INFO:tasks.workunit.client.0.smithi112.stdout:2/59: dread d0/d1/f7 [0,4194304] 0 2024-09-19T09:35:13.413 INFO:tasks.workunit.client.0.smithi112.stdout:2/60: chown d0/d1/de 11 1 2024-09-19T09:35:13.413 INFO:tasks.workunit.client.0.smithi112.stdout:2/61: read d0/d1/d9/f10 [248240,28904] 0 2024-09-19T09:35:13.413 INFO:tasks.workunit.client.0.smithi112.stdout:0/210: link d2/f28 d2/d39/f3d 0 2024-09-19T09:35:13.413 INFO:tasks.workunit.client.0.smithi112.stdout:0/211: dread - d2/d11/f2e zero size 2024-09-19T09:35:13.415 INFO:tasks.workunit.client.0.smithi112.stdout:7/165: rmdir d2/d8/d1f/d23 39 2024-09-19T09:35:13.415 INFO:tasks.workunit.client.0.smithi112.stdout:7/166: readlink l1 0 2024-09-19T09:35:13.416 INFO:tasks.workunit.client.0.smithi112.stdout:4/309: mkdir d1/d31/d71 0 2024-09-19T09:35:13.418 INFO:tasks.workunit.client.0.smithi112.stdout:2/62: link d0/d1/l3 d0/d6/l16 0 2024-09-19T09:35:13.421 INFO:tasks.workunit.client.0.smithi112.stdout:7/167: unlink d2/c1c 0 2024-09-19T09:35:13.421 INFO:tasks.workunit.client.0.smithi112.stdout:7/168: write d2/fd [1129601,118133] 0 2024-09-19T09:35:13.421 INFO:tasks.workunit.client.0.smithi112.stdout:7/169: fdatasync d2/f28 0 2024-09-19T09:35:13.422 INFO:tasks.workunit.client.0.smithi112.stdout:4/310: mkdir d1/d3d/d72 0 2024-09-19T09:35:13.422 INFO:tasks.workunit.client.0.smithi112.stdout:4/311: write d1/d4/f59 [604599,104550] 0 2024-09-19T09:35:13.423 INFO:tasks.workunit.client.0.smithi112.stdout:2/63: mknod d0/d1/de/c17 0 2024-09-19T09:35:13.423 INFO:tasks.workunit.client.0.smithi112.stdout:9/41: dwrite fb [0,4194304] 0 2024-09-19T09:35:13.423 INFO:tasks.workunit.client.0.smithi112.stdout:9/42: creat fe x:0 0 0 2024-09-19T09:35:13.424 INFO:tasks.workunit.client.0.smithi112.stdout:1/64: dwrite f1 [0,4194304] 0 2024-09-19T09:35:13.427 INFO:tasks.workunit.client.0.smithi112.stdout:5/291: rename d4/d3b to d4/d9/d2a/d69 0 2024-09-19T09:35:13.427 INFO:tasks.workunit.client.0.smithi112.stdout:7/170: mknod d2/d8/d1f/c30 0 2024-09-19T09:35:13.438 INFO:tasks.workunit.client.0.smithi112.stdout:7/171: symlink d2/d8/d1f/d21/l31 0 2024-09-19T09:35:13.439 INFO:tasks.workunit.client.0.smithi112.stdout:7/172: chown d2/d8/l19 87402975 1 2024-09-19T09:35:13.439 INFO:tasks.workunit.client.0.smithi112.stdout:4/312: mknod d1/d4/d3a/d57/d60/c73 0 2024-09-19T09:35:13.439 INFO:tasks.workunit.client.0.smithi112.stdout:4/313: truncate d1/d3d/d41/f23 516330 0 2024-09-19T09:35:13.444 INFO:tasks.workunit.client.0.smithi112.stdout:0/212: rmdir d2/d11 39 2024-09-19T09:35:13.446 INFO:tasks.workunit.client.0.smithi112.stdout:1/65: getdents dc 0 2024-09-19T09:35:13.447 INFO:tasks.workunit.client.0.smithi112.stdout:1/66: chown l5 6859784 1 2024-09-19T09:35:13.447 INFO:tasks.workunit.client.0.smithi112.stdout:1/67: fdatasync f2 0 2024-09-19T09:35:13.447 INFO:tasks.workunit.client.0.smithi112.stdout:1/68: chown l5 83 1 2024-09-19T09:35:13.447 INFO:tasks.workunit.client.0.smithi112.stdout:7/173: dread d2/d8/d18/f1e [0,4194304] 0 2024-09-19T09:35:13.447 INFO:tasks.workunit.client.0.smithi112.stdout:7/174: stat d2/d8/d1a/c20 0 2024-09-19T09:35:13.455 INFO:tasks.workunit.client.0.smithi112.stdout:0/213: truncate d2/f30 171598 0 2024-09-19T09:35:13.456 INFO:tasks.workunit.client.0.smithi112.stdout:7/175: creat d2/d8/d1f/d23/f32 x:0 0 0 2024-09-19T09:35:13.459 INFO:tasks.workunit.client.0.smithi112.stdout:6/172: truncate d8/f16 59347 0 2024-09-19T09:35:13.461 INFO:tasks.workunit.client.0.smithi112.stdout:4/314: rmdir d1/d3d 39 2024-09-19T09:35:13.462 INFO:tasks.workunit.client.0.smithi112.stdout:0/214: mknod d2/c3e 0 2024-09-19T09:35:13.463 INFO:tasks.workunit.client.0.smithi112.stdout:4/315: creat d1/d31/d43/f74 x:0 0 0 2024-09-19T09:35:13.464 INFO:tasks.workunit.client.0.smithi112.stdout:4/316: mknod d1/d5f/c75 0 2024-09-19T09:35:13.465 INFO:tasks.workunit.client.0.smithi112.stdout:1/69: dwrite dc/fe [0,4194304] 0 2024-09-19T09:35:13.465 INFO:tasks.workunit.client.0.smithi112.stdout:4/317: mknod d1/d31/d43/d48/d5c/c76 0 2024-09-19T09:35:13.468 INFO:tasks.workunit.client.0.smithi112.stdout:7/176: dread d2/d8/d1f/d23/f27 [0,4194304] 0 2024-09-19T09:35:13.469 INFO:tasks.workunit.client.0.smithi112.stdout:7/177: symlink d2/l33 0 2024-09-19T09:35:13.500 INFO:tasks.workunit.client.0.smithi112.stdout:0/215: read d2/d11/f33 [161776,20038] 0 2024-09-19T09:35:13.500 INFO:tasks.workunit.client.0.smithi112.stdout:7/178: unlink d2/l17 0 2024-09-19T09:35:13.500 INFO:tasks.workunit.client.0.smithi112.stdout:0/216: creat d2/d39/d3b/f3f x:0 0 0 2024-09-19T09:35:13.500 INFO:tasks.workunit.client.0.smithi112.stdout:1/70: write f1 [1404769,129052] 0 2024-09-19T09:35:13.500 INFO:tasks.workunit.client.0.smithi112.stdout:7/179: link d2/d8/d1f/d23/f27 d2/d8/d1f/f34 0 2024-09-19T09:35:13.501 INFO:tasks.workunit.client.0.smithi112.stdout:7/180: chown d2/d8 5 1 2024-09-19T09:35:13.501 INFO:tasks.workunit.client.0.smithi112.stdout:4/318: dread d1/d3d/f56 [0,4194304] 0 2024-09-19T09:35:13.501 INFO:tasks.workunit.client.0.smithi112.stdout:7/181: mkdir d2/d8/d1f/d23/d35 0 2024-09-19T09:35:13.501 INFO:tasks.workunit.client.0.smithi112.stdout:4/319: mkdir d1/d31/d71/d77 0 2024-09-19T09:35:13.501 INFO:tasks.workunit.client.0.smithi112.stdout:4/320: truncate d1/d31/d42/f64 994738 0 2024-09-19T09:35:13.501 INFO:tasks.workunit.client.0.smithi112.stdout:4/321: write d1/d3d/d41/f69 [332244,76452] 0 2024-09-19T09:35:13.501 INFO:tasks.workunit.client.0.smithi112.stdout:4/322: creat d1/d4/d3a/f78 x:0 0 0 2024-09-19T09:35:13.502 INFO:tasks.workunit.client.0.smithi112.stdout:7/182: dread d2/fe [0,4194304] 0 2024-09-19T09:35:13.502 INFO:tasks.workunit.client.0.smithi112.stdout:1/71: dread dc/fe [0,4194304] 0 2024-09-19T09:35:13.502 INFO:tasks.workunit.client.0.smithi112.stdout:1/72: stat f8 0 2024-09-19T09:35:13.502 INFO:tasks.workunit.client.0.smithi112.stdout:4/323: creat d1/d4/d3a/d57/d62/f79 x:0 0 0 2024-09-19T09:35:13.502 INFO:tasks.workunit.client.0.smithi112.stdout:1/73: creat dc/ff x:0 0 0 2024-09-19T09:35:13.502 INFO:tasks.workunit.client.0.smithi112.stdout:1/74: stat f8 0 2024-09-19T09:35:13.502 INFO:tasks.workunit.client.0.smithi112.stdout:4/324: getdents d1/d31/d42 0 2024-09-19T09:35:13.502 INFO:tasks.workunit.client.0.smithi112.stdout:1/75: write dc/fe [58090,115955] 0 2024-09-19T09:35:13.502 INFO:tasks.workunit.client.0.smithi112.stdout:1/76: mkdir dc/d10 0 2024-09-19T09:35:13.502 INFO:tasks.workunit.client.0.smithi112.stdout:1/77: read f8 [105818,35591] 0 2024-09-19T09:35:13.503 INFO:tasks.workunit.client.0.smithi112.stdout:7/183: dwrite d2/d8/d1a/f2d [0,4194304] 0 2024-09-19T09:35:13.506 INFO:tasks.workunit.client.0.smithi112.stdout:4/325: rmdir d1/d4 39 2024-09-19T09:35:13.508 INFO:tasks.workunit.client.0.smithi112.stdout:4/326: mkdir d1/d4/d3a/d7a 0 2024-09-19T09:35:13.527 INFO:tasks.workunit.client.0.smithi112.stdout:7/184: dwrite d2/f13 [0,4194304] 0 2024-09-19T09:35:13.528 INFO:tasks.workunit.client.0.smithi112.stdout:7/185: chown d2/d8 0 1 2024-09-19T09:35:13.528 INFO:tasks.workunit.client.0.smithi112.stdout:7/186: truncate d2/d8/d1f/d21/f2e 1027890 0 2024-09-19T09:35:13.528 INFO:tasks.workunit.client.0.smithi112.stdout:1/78: dwrite f8 [0,4194304] 0 2024-09-19T09:35:13.528 INFO:tasks.workunit.client.0.smithi112.stdout:4/327: dwrite d1/d4/d3a/f5d [0,4194304] 0 2024-09-19T09:35:13.530 INFO:tasks.workunit.client.0.smithi112.stdout:7/187: mknod d2/c36 0 2024-09-19T09:35:13.531 INFO:tasks.workunit.client.0.smithi112.stdout:1/79: unlink l9 0 2024-09-19T09:35:13.536 INFO:tasks.workunit.client.0.smithi112.stdout:4/328: link d1/f29 d1/d3d/d72/f7b 0 2024-09-19T09:35:13.538 INFO:tasks.workunit.client.0.smithi112.stdout:7/188: creat d2/d8/d1f/d23/d35/f37 x:0 0 0 2024-09-19T09:35:13.540 INFO:tasks.workunit.client.0.smithi112.stdout:1/80: mknod dc/d10/c11 0 2024-09-19T09:35:13.544 INFO:tasks.workunit.client.0.smithi112.stdout:7/189: creat d2/d2c/f38 x:0 0 0 2024-09-19T09:35:13.546 INFO:tasks.workunit.client.0.smithi112.stdout:1/81: creat dc/d10/f12 x:0 0 0 2024-09-19T09:35:13.547 INFO:tasks.workunit.client.0.smithi112.stdout:4/329: mkdir d1/d4/d3a/d57/d60/d7c 0 2024-09-19T09:35:13.550 INFO:tasks.workunit.client.0.smithi112.stdout:1/82: mkdir dc/d13 0 2024-09-19T09:35:13.550 INFO:tasks.workunit.client.0.smithi112.stdout:1/83: chown dc/fd 15 1 2024-09-19T09:35:13.550 INFO:tasks.workunit.client.0.smithi112.stdout:1/84: dread - dc/d10/f12 zero size 2024-09-19T09:35:13.556 INFO:tasks.workunit.client.0.smithi112.stdout:4/330: write d1/d3d/d41/f52 [2525225,129330] 0 2024-09-19T09:35:13.556 INFO:tasks.workunit.client.0.smithi112.stdout:4/331: fdatasync d1/d3d/d41/f4f 0 2024-09-19T09:35:13.557 INFO:tasks.workunit.client.0.smithi112.stdout:7/190: rename d2/d8/d1f to d2/d8/d18/d39 0 2024-09-19T09:35:13.557 INFO:tasks.workunit.client.0.smithi112.stdout:7/191: creat d2/f3a x:0 0 0 2024-09-19T09:35:13.561 INFO:tasks.workunit.client.0.smithi112.stdout:4/332: dread d1/d31/d51/f55 [0,4194304] 0 2024-09-19T09:35:13.562 INFO:tasks.workunit.client.0.smithi112.stdout:4/333: creat d1/d4/f7d x:0 0 0 2024-09-19T09:35:13.565 INFO:tasks.workunit.client.0.smithi112.stdout:7/192: read d2/d8/d1a/f2d [2259500,125070] 0 2024-09-19T09:35:13.565 INFO:tasks.workunit.client.0.smithi112.stdout:7/193: fsync d2/f13 0 2024-09-19T09:35:13.569 INFO:tasks.workunit.client.0.smithi112.stdout:7/194: rename d2/d8/l19 to d2/d8/d18/d39/d23/d35/l3b 0 2024-09-19T09:35:13.572 INFO:tasks.workunit.client.0.smithi112.stdout:7/195: creat d2/d8/d18/f3c x:0 0 0 2024-09-19T09:35:13.572 INFO:tasks.workunit.client.0.smithi112.stdout:7/196: creat d2/d8/d1a/f3d x:0 0 0 2024-09-19T09:35:13.581 INFO:tasks.workunit.client.0.smithi112.stdout:4/334: dwrite d1/d3d/d41/f67 [0,4194304] 0 2024-09-19T09:35:13.592 INFO:tasks.workunit.client.0.smithi112.stdout:7/197: dwrite d2/fe [0,4194304] 0 2024-09-19T09:35:13.593 INFO:tasks.workunit.client.0.smithi112.stdout:7/198: chown d2/d8/d18 213 1 2024-09-19T09:35:13.596 INFO:tasks.workunit.client.0.smithi112.stdout:4/335: write d1/d31/d51/d37/f3c [4131669,8304] 0 2024-09-19T09:35:13.597 INFO:tasks.workunit.client.0.smithi112.stdout:4/336: chown d1/d4/d3a/d57/d62 165 1 2024-09-19T09:35:13.597 INFO:tasks.workunit.client.0.smithi112.stdout:4/337: creat d1/d31/d43/d48/f7e x:0 0 0 2024-09-19T09:35:13.610 INFO:tasks.workunit.client.0.smithi112.stdout:7/199: dwrite d2/d8/d18/d39/d23/f27 [0,4194304] 0 2024-09-19T09:35:13.612 INFO:tasks.workunit.client.0.smithi112.stdout:7/200: link d2/d8/d18/d39/d23/f32 d2/d8/d18/f3e 0 2024-09-19T09:35:13.613 INFO:tasks.workunit.client.0.smithi112.stdout:4/338: rmdir d1/d31/d43/d48 39 2024-09-19T09:35:13.614 INFO:tasks.workunit.client.0.smithi112.stdout:7/201: symlink d2/d8/d18/l3f 0 2024-09-19T09:35:13.615 INFO:tasks.workunit.client.0.smithi112.stdout:4/339: rename d1/d31/d51/d37 to d1/d4/d3a/d7a/d7f 0 2024-09-19T09:35:13.616 INFO:tasks.workunit.client.0.smithi112.stdout:7/202: link l1 d2/d8/d18/l40 0 2024-09-19T09:35:13.618 INFO:tasks.workunit.client.0.smithi112.stdout:4/340: unlink d1/ca 0 2024-09-19T09:35:13.619 INFO:tasks.workunit.client.0.smithi112.stdout:7/203: symlink d2/d8/d18/d39/d23/l41 0 2024-09-19T09:35:13.620 INFO:tasks.workunit.client.0.smithi112.stdout:7/204: truncate d2/d8/d18/f22 5160032 0 2024-09-19T09:35:13.620 INFO:tasks.workunit.client.0.smithi112.stdout:7/205: dread - d2/d8/d18/d39/d23/f32 zero size 2024-09-19T09:35:13.628 INFO:tasks.workunit.client.0.smithi112.stdout:4/341: dread d1/d4/d3a/f5d [0,4194304] 0 2024-09-19T09:35:13.628 INFO:tasks.workunit.client.0.smithi112.stdout:4/342: chown d1/d3d/d41/f23 76299778 1 2024-09-19T09:35:13.628 INFO:tasks.workunit.client.0.smithi112.stdout:4/343: dread - d1/d4/f7d zero size 2024-09-19T09:35:13.629 INFO:tasks.workunit.client.0.smithi112.stdout:7/206: rmdir d2/d8 39 2024-09-19T09:35:13.629 INFO:tasks.workunit.client.0.smithi112.stdout:7/207: chown d2/d8/c26 15966 1 2024-09-19T09:35:13.808 INFO:tasks.workunit.client.0.smithi112.stdout:3/156: sync 2024-09-19T09:35:13.809 INFO:tasks.workunit.client.0.smithi112.stdout:3/157: rename d8/d15/d1b/d1c/d27/f2a to d8/d15/d1b/d28/f31 0 2024-09-19T09:35:13.811 INFO:tasks.workunit.client.0.smithi112.stdout:3/158: unlink c2 0 2024-09-19T09:35:13.815 INFO:tasks.workunit.client.0.smithi112.stdout:3/159: fsync d8/d15/d1b/d28/f31 0 2024-09-19T09:35:13.817 INFO:tasks.workunit.client.0.smithi112.stdout:3/160: rename d8/d15/d1b/c2f to d8/d15/d1b/d1c/d24/c32 0 2024-09-19T09:35:13.824 INFO:tasks.workunit.client.0.smithi112.stdout:3/161: dread d8/f10 [0,4194304] 0 2024-09-19T09:35:13.835 INFO:tasks.workunit.client.0.smithi112.stdout:3/162: read d8/ff [3310109,19458] 0 2024-09-19T09:35:13.837 INFO:tasks.workunit.client.0.smithi112.stdout:3/163: mkdir d8/d15/d1b/d1c/d24/d33 0 2024-09-19T09:35:13.844 INFO:tasks.workunit.client.0.smithi112.stdout:3/164: write d8/d15/d1b/d1c/d24/d21/f23 [259476,58739] 0 2024-09-19T09:35:13.846 INFO:tasks.workunit.client.0.smithi112.stdout:3/165: truncate d8/f10 4591964 0 2024-09-19T09:35:13.846 INFO:tasks.workunit.client.0.smithi112.stdout:3/166: chown d8/d15/d1b/d1c/d24/f2e 23857854 1 2024-09-19T09:35:13.848 INFO:tasks.workunit.client.0.smithi112.stdout:3/167: symlink d8/d15/d1b/d1c/d24/l34 0 2024-09-19T09:35:13.853 INFO:tasks.workunit.client.0.smithi112.stdout:3/168: dread - d8/f30 zero size 2024-09-19T09:35:13.864 INFO:tasks.workunit.client.0.smithi112.stdout:3/169: dwrite d8/d15/d1b/d1c/d24/f2e [0,4194304] 0 2024-09-19T09:35:13.864 INFO:tasks.workunit.client.0.smithi112.stdout:3/170: truncate d8/f30 962394 0 2024-09-19T09:35:13.866 INFO:tasks.workunit.client.0.smithi112.stdout:3/171: creat d8/d15/d1b/d1c/d24/d33/f35 x:0 0 0 2024-09-19T09:35:14.222 INFO:tasks.workunit.client.0.smithi112.stdout:8/301: sync 2024-09-19T09:35:14.222 INFO:tasks.workunit.client.0.smithi112.stdout:8/302: chown d7/db/d21/d3b/d56/d3c 24994 1 2024-09-19T09:35:14.223 INFO:tasks.workunit.client.0.smithi112.stdout:8/303: rmdir d7 39 2024-09-19T09:35:14.232 INFO:tasks.workunit.client.0.smithi112.stdout:8/304: dread d7/db/f45 [0,4194304] 0 2024-09-19T09:35:14.234 INFO:tasks.workunit.client.0.smithi112.stdout:8/305: symlink d7/d10/d11/d55/l60 0 2024-09-19T09:35:14.236 INFO:tasks.workunit.client.0.smithi112.stdout:8/306: symlink d7/d10/d11/d33/d49/l61 0 2024-09-19T09:35:14.236 INFO:tasks.workunit.client.0.smithi112.stdout:8/307: stat d7/d10/d11/d33/d49/f5d 0 2024-09-19T09:35:14.237 INFO:tasks.workunit.client.0.smithi112.stdout:8/308: mkdir d7/d10/d11/d62 0 2024-09-19T09:35:14.238 INFO:tasks.workunit.client.0.smithi112.stdout:8/309: truncate d7/fd 547515 0 2024-09-19T09:35:14.241 INFO:tasks.workunit.client.0.smithi112.stdout:8/310: dread d7/db/d21/f4e [0,4194304] 0 2024-09-19T09:35:14.250 INFO:tasks.workunit.client.0.smithi112.stdout:8/311: dread d7/db/d21/d2e/d42/f44 [0,4194304] 0 2024-09-19T09:35:14.251 INFO:tasks.workunit.client.0.smithi112.stdout:8/312: unlink d7/db/d21/d2e/d42/f44 0 2024-09-19T09:35:14.253 INFO:tasks.workunit.client.0.smithi112.stdout:8/313: symlink d7/db/d21/d2e/d42/d57/l63 0 2024-09-19T09:35:14.253 INFO:tasks.workunit.client.0.smithi112.stdout:8/314: write d7/d10/d11/d33/f54 [160230,121605] 0 2024-09-19T09:35:14.253 INFO:tasks.workunit.client.0.smithi112.stdout:8/315: dread - d7/d10/f25 zero size 2024-09-19T09:35:14.254 INFO:tasks.workunit.client.0.smithi112.stdout:8/316: symlink d7/l64 0 2024-09-19T09:35:14.254 INFO:tasks.workunit.client.0.smithi112.stdout:8/317: chown d7/db 3901638 1 2024-09-19T09:35:14.255 INFO:tasks.workunit.client.0.smithi112.stdout:8/318: mkdir d7/d65 0 2024-09-19T09:35:14.263 INFO:tasks.workunit.client.0.smithi112.stdout:8/319: dread d7/d10/f16 [4194304,4194304] 0 2024-09-19T09:35:14.284 INFO:tasks.workunit.client.0.smithi112.stdout:8/320: dwrite d7/db/d21/f22 [4194304,4194304] 0 2024-09-19T09:35:14.285 INFO:tasks.workunit.client.0.smithi112.stdout:8/321: rmdir d7/db/d21/d2e/d42 39 2024-09-19T09:35:14.289 INFO:tasks.workunit.client.0.smithi112.stdout:8/322: dread d7/d10/f1e [0,4194304] 0 2024-09-19T09:35:14.290 INFO:tasks.workunit.client.0.smithi112.stdout:8/323: symlink d7/l66 0 2024-09-19T09:35:14.292 INFO:tasks.workunit.client.0.smithi112.stdout:8/324: rename d7/d10/d11/d33/d49 to d7/d67 0 2024-09-19T09:35:14.292 INFO:tasks.workunit.client.0.smithi112.stdout:8/325: chown d7/db/d21/l31 133662343 1 2024-09-19T09:35:14.292 INFO:tasks.workunit.client.0.smithi112.stdout:8/326: write d7/d10/d11/f2b [160655,1628] 0 2024-09-19T09:35:14.292 INFO:tasks.workunit.client.0.smithi112.stdout:8/327: chown d7/d10/f1e 31481352 1 2024-09-19T09:35:14.292 INFO:tasks.workunit.client.0.smithi112.stdout:8/328: write d7/d67/f4c [618907,92948] 0 2024-09-19T09:35:14.293 INFO:tasks.workunit.client.0.smithi112.stdout:8/329: mknod d7/d67/c68 0 2024-09-19T09:35:14.298 INFO:tasks.workunit.client.0.smithi112.stdout:8/330: dread d7/fa [0,4194304] 0 2024-09-19T09:35:14.298 INFO:tasks.workunit.client.0.smithi112.stdout:8/331: write d7/db/d21/d2e/f5e [503856,107321] 0 2024-09-19T09:35:14.299 INFO:tasks.workunit.client.0.smithi112.stdout:8/332: unlink d7/d10/c1c 0 2024-09-19T09:35:14.300 INFO:tasks.workunit.client.0.smithi112.stdout:8/333: truncate d7/d10/f16 7523543 0 2024-09-19T09:35:14.319 INFO:tasks.workunit.client.0.smithi112.stdout:8/334: dwrite d7/db/d21/d2e/f5e [0,4194304] 0 2024-09-19T09:35:14.325 INFO:tasks.workunit.client.0.smithi112.stdout:8/335: mknod d7/d67/c69 0 2024-09-19T09:35:14.328 INFO:tasks.workunit.client.0.smithi112.stdout:8/336: dread d7/fd [0,4194304] 0 2024-09-19T09:35:14.330 INFO:tasks.workunit.client.0.smithi112.stdout:7/208: sync 2024-09-19T09:35:14.330 INFO:tasks.workunit.client.0.smithi112.stdout:1/85: sync 2024-09-19T09:35:14.330 INFO:tasks.workunit.client.0.smithi112.stdout:5/292: sync 2024-09-19T09:35:14.330 INFO:tasks.workunit.client.0.smithi112.stdout:9/43: sync 2024-09-19T09:35:14.330 INFO:tasks.workunit.client.0.smithi112.stdout:1/86: read - dc/ff zero size 2024-09-19T09:35:14.330 INFO:tasks.workunit.client.0.smithi112.stdout:9/44: fsync f0 0 2024-09-19T09:35:14.330 INFO:tasks.workunit.client.0.smithi112.stdout:1/87: truncate dc/ff 861865 0 2024-09-19T09:35:14.331 INFO:tasks.workunit.client.0.smithi112.stdout:6/173: sync 2024-09-19T09:35:14.331 INFO:tasks.workunit.client.0.smithi112.stdout:2/64: sync 2024-09-19T09:35:14.331 INFO:tasks.workunit.client.0.smithi112.stdout:3/172: sync 2024-09-19T09:35:14.331 INFO:tasks.workunit.client.0.smithi112.stdout:0/217: sync 2024-09-19T09:35:14.331 INFO:tasks.workunit.client.0.smithi112.stdout:0/218: chown d2/f38 5917 1 2024-09-19T09:35:14.331 INFO:tasks.workunit.client.0.smithi112.stdout:4/344: sync 2024-09-19T09:35:14.331 INFO:tasks.workunit.client.0.smithi112.stdout:7/209: creat d2/d8/d1a/f42 x:0 0 0 2024-09-19T09:35:14.332 INFO:tasks.workunit.client.0.smithi112.stdout:1/88: mknod dc/c14 0 2024-09-19T09:35:14.332 INFO:tasks.workunit.client.0.smithi112.stdout:1/89: creat dc/d10/f15 x:0 0 0 2024-09-19T09:35:14.332 INFO:tasks.workunit.client.0.smithi112.stdout:1/90: write f8 [4738229,125549] 0 2024-09-19T09:35:14.336 INFO:tasks.workunit.client.0.smithi112.stdout:2/65: symlink d0/d1/d9/l18 0 2024-09-19T09:35:14.336 INFO:tasks.workunit.client.0.smithi112.stdout:2/66: chown d0/d1/d9 422 1 2024-09-19T09:35:14.336 INFO:tasks.workunit.client.0.smithi112.stdout:3/173: symlink d8/d15/d1b/d1c/d24/d33/l36 0 2024-09-19T09:35:14.336 INFO:tasks.workunit.client.0.smithi112.stdout:3/174: write d8/d15/d1b/d1c/d24/d21/f23 [25065,112744] 0 2024-09-19T09:35:14.338 INFO:tasks.workunit.client.0.smithi112.stdout:4/345: rename d1/d31/d43/d48/l5b to d1/d3d/d41/l80 0 2024-09-19T09:35:14.338 INFO:tasks.workunit.client.0.smithi112.stdout:1/91: dread f2 [0,4194304] 0 2024-09-19T09:35:14.339 INFO:tasks.workunit.client.0.smithi112.stdout:7/210: creat d2/d8/d18/d39/d23/d35/f43 x:0 0 0 2024-09-19T09:35:14.342 INFO:tasks.workunit.client.0.smithi112.stdout:8/337: write d7/d10/f16 [2453090,57810] 0 2024-09-19T09:35:14.342 INFO:tasks.workunit.client.0.smithi112.stdout:2/67: mknod d0/d6/c19 0 2024-09-19T09:35:14.342 INFO:tasks.workunit.client.0.smithi112.stdout:2/68: write d0/d1/ff [1294018,115760] 0 2024-09-19T09:35:14.342 INFO:tasks.workunit.client.0.smithi112.stdout:2/69: chown d0/d6 11796589 1 2024-09-19T09:35:14.344 INFO:tasks.workunit.client.0.smithi112.stdout:4/346: creat d1/d31/d43/d48/f81 x:0 0 0 2024-09-19T09:35:14.344 INFO:tasks.workunit.client.0.smithi112.stdout:4/347: fsync d1/d3d/f44 0 2024-09-19T09:35:14.344 INFO:tasks.workunit.client.0.smithi112.stdout:4/348: fdatasync d1/f17 0 2024-09-19T09:35:14.344 INFO:tasks.workunit.client.0.smithi112.stdout:4/349: write d1/d4/f13 [1975670,54441] 0 2024-09-19T09:35:14.348 INFO:tasks.workunit.client.0.smithi112.stdout:5/293: dread d4/d9/d2a/d46/f55 [0,4194304] 0 2024-09-19T09:35:14.348 INFO:tasks.workunit.client.0.smithi112.stdout:2/70: mknod d0/d6/c1a 0 2024-09-19T09:35:14.350 INFO:tasks.workunit.client.0.smithi112.stdout:4/350: symlink d1/d4/d3a/l82 0 2024-09-19T09:35:14.351 INFO:tasks.workunit.client.0.smithi112.stdout:9/45: dwrite fb [0,4194304] 0 2024-09-19T09:35:14.353 INFO:tasks.workunit.client.0.smithi112.stdout:8/338: write d7/ff [1121287,96725] 0 2024-09-19T09:35:14.353 INFO:tasks.workunit.client.0.smithi112.stdout:8/339: write d7/d10/d11/f2b [736887,4430] 0 2024-09-19T09:35:14.354 INFO:tasks.workunit.client.0.smithi112.stdout:5/294: unlink d4/d9/f28 0 2024-09-19T09:35:14.354 INFO:tasks.workunit.client.0.smithi112.stdout:5/295: dread - d4/d9/d2a/d69/f58 zero size 2024-09-19T09:35:14.355 INFO:tasks.workunit.client.0.smithi112.stdout:6/174: write d8/d11/d14/f1c [963317,8737] 0 2024-09-19T09:35:14.355 INFO:tasks.workunit.client.0.smithi112.stdout:6/175: creat d8/d2b/f38 x:0 0 0 2024-09-19T09:35:14.360 INFO:tasks.workunit.client.0.smithi112.stdout:9/46: mkdir df 0 2024-09-19T09:35:14.361 INFO:tasks.workunit.client.0.smithi112.stdout:8/340: rmdir d7/d10/d11/d40 0 2024-09-19T09:35:14.363 INFO:tasks.workunit.client.0.smithi112.stdout:3/175: write f7 [3346010,60029] 0 2024-09-19T09:35:14.363 INFO:tasks.workunit.client.0.smithi112.stdout:3/176: stat d8/d15/d1b/d1c/d24/f2e 0 2024-09-19T09:35:14.371 INFO:tasks.workunit.client.0.smithi112.stdout:7/211: dwrite d2/d8/d18/d39/d23/f32 [0,4194304] 0 2024-09-19T09:35:14.371 INFO:tasks.workunit.client.0.smithi112.stdout:7/212: write d2/fd [2535005,39081] 0 2024-09-19T09:35:14.371 INFO:tasks.workunit.client.0.smithi112.stdout:7/213: chown d2/d2c 459859 1 2024-09-19T09:35:14.371 INFO:tasks.workunit.client.0.smithi112.stdout:6/176: dread d8/de/d17/f22 [0,4194304] 0 2024-09-19T09:35:14.371 INFO:tasks.workunit.client.0.smithi112.stdout:6/177: chown d8/cc 60418 1 2024-09-19T09:35:14.372 INFO:tasks.workunit.client.0.smithi112.stdout:8/341: rmdir d7 39 2024-09-19T09:35:14.373 INFO:tasks.workunit.client.0.smithi112.stdout:1/92: truncate f6 2231710 0 2024-09-19T09:35:14.373 INFO:tasks.workunit.client.0.smithi112.stdout:1/93: write f1 [94009,62153] 0 2024-09-19T09:35:14.373 INFO:tasks.workunit.client.0.smithi112.stdout:1/94: write dc/fe [4533404,46339] 0 2024-09-19T09:35:14.373 INFO:tasks.workunit.client.0.smithi112.stdout:1/95: write dc/d10/f15 [980383,180] 0 2024-09-19T09:35:14.375 INFO:tasks.workunit.client.0.smithi112.stdout:3/177: rename d8/d15/d1b/d1c/d24/f2e to d8/d15/d1b/d1c/f37 0 2024-09-19T09:35:14.377 INFO:tasks.workunit.client.0.smithi112.stdout:6/178: mknod d8/de/d17/c39 0 2024-09-19T09:35:14.378 INFO:tasks.workunit.client.0.smithi112.stdout:8/342: symlink d7/db/d21/l6a 0 2024-09-19T09:35:14.378 INFO:tasks.workunit.client.0.smithi112.stdout:8/343: write d7/d67/f4f [864556,57337] 0 2024-09-19T09:35:14.379 INFO:tasks.workunit.client.0.smithi112.stdout:3/178: symlink d8/d15/d1b/d1c/d24/d21/l38 0 2024-09-19T09:35:14.379 INFO:tasks.workunit.client.0.smithi112.stdout:3/179: chown l4 403826748 1 2024-09-19T09:35:14.379 INFO:tasks.workunit.client.0.smithi112.stdout:3/180: write d8/f30 [1897378,5790] 0 2024-09-19T09:35:14.382 INFO:tasks.workunit.client.0.smithi112.stdout:7/214: mknod d2/d8/c44 0 2024-09-19T09:35:14.382 INFO:tasks.workunit.client.0.smithi112.stdout:8/344: symlink d7/d10/d11/d50/l6b 0 2024-09-19T09:35:14.383 INFO:tasks.workunit.client.0.smithi112.stdout:6/179: getdents d8/d11 0 2024-09-19T09:35:14.384 INFO:tasks.workunit.client.0.smithi112.stdout:7/215: mkdir d2/d8/d18/d39/d21/d45 0 2024-09-19T09:35:14.384 INFO:tasks.workunit.client.0.smithi112.stdout:4/351: dwrite d1/d4/f13 [0,4194304] 0 2024-09-19T09:35:14.385 INFO:tasks.workunit.client.0.smithi112.stdout:6/180: creat d8/de/d18/d20/f3a x:0 0 0 2024-09-19T09:35:14.385 INFO:tasks.workunit.client.0.smithi112.stdout:8/345: dread d7/fa [0,4194304] 0 2024-09-19T09:35:14.386 INFO:tasks.workunit.client.0.smithi112.stdout:7/216: unlink d2/l33 0 2024-09-19T09:35:14.388 INFO:tasks.workunit.client.0.smithi112.stdout:4/352: creat d1/d31/d42/f83 x:0 0 0 2024-09-19T09:35:14.388 INFO:tasks.workunit.client.0.smithi112.stdout:4/353: dread - d1/fd zero size 2024-09-19T09:35:14.390 INFO:tasks.workunit.client.0.smithi112.stdout:8/346: unlink d7/d10/d11/d50/l6b 0 2024-09-19T09:35:14.390 INFO:tasks.workunit.client.0.smithi112.stdout:8/347: truncate d7/d67/f4c 1359257 0 2024-09-19T09:35:14.390 INFO:tasks.workunit.client.0.smithi112.stdout:8/348: write d7/fa [1483501,63555] 0 2024-09-19T09:35:14.392 INFO:tasks.workunit.client.0.smithi112.stdout:5/296: dwrite d4/f34 [4194304,4194304] 0 2024-09-19T09:35:14.392 INFO:tasks.workunit.client.0.smithi112.stdout:2/71: dwrite d0/d6/fb [0,4194304] 0 2024-09-19T09:35:14.392 INFO:tasks.workunit.client.0.smithi112.stdout:7/217: rename d2/d8/d18/d39/d23/f32 to d2/d8/d18/d39/d23/d35/f46 0 2024-09-19T09:35:14.393 INFO:tasks.workunit.client.0.smithi112.stdout:7/218: write d2/d2c/f38 [260646,91036] 0 2024-09-19T09:35:14.394 INFO:tasks.workunit.client.0.smithi112.stdout:4/354: creat d1/d31/d43/d48/d5c/f84 x:0 0 0 2024-09-19T09:35:14.395 INFO:tasks.workunit.client.0.smithi112.stdout:9/47: truncate fb 2979143 0 2024-09-19T09:35:14.395 INFO:tasks.workunit.client.0.smithi112.stdout:9/48: chown c9 860081 1 2024-09-19T09:35:14.408 INFO:tasks.workunit.client.0.smithi112.stdout:8/349: dwrite d7/d10/d11/d33/f54 [0,4194304] 0 2024-09-19T09:35:14.408 INFO:tasks.workunit.client.0.smithi112.stdout:8/350: fdatasync d7/db/d21/f47 0 2024-09-19T09:35:14.412 INFO:tasks.workunit.client.0.smithi112.stdout:6/181: rmdir d8 39 2024-09-19T09:35:14.421 INFO:tasks.workunit.client.0.smithi112.stdout:5/297: creat d4/d29/d36/d5f/f6a x:0 0 0 2024-09-19T09:35:14.422 INFO:tasks.workunit.client.0.smithi112.stdout:1/96: dwrite f6 [0,4194304] 0 2024-09-19T09:35:14.426 INFO:tasks.workunit.client.0.smithi112.stdout:2/72: symlink d0/l1b 0 2024-09-19T09:35:14.434 INFO:tasks.workunit.client.0.smithi112.stdout:7/219: link d2/fe d2/d8/d18/d39/f47 0 2024-09-19T09:35:14.435 INFO:tasks.workunit.client.0.smithi112.stdout:4/355: dread - d1/d4/d3a/d57/d60/f66 zero size 2024-09-19T09:35:14.435 INFO:tasks.workunit.client.0.smithi112.stdout:4/356: readlink d1/d3d/d41/l3b 0 2024-09-19T09:35:14.435 INFO:tasks.workunit.client.0.smithi112.stdout:4/357: fsync d1/f46 0 2024-09-19T09:35:14.436 INFO:tasks.workunit.client.0.smithi112.stdout:9/49: mknod df/c10 0 2024-09-19T09:35:14.441 INFO:tasks.workunit.client.0.smithi112.stdout:8/351: rename d7/db/d21/l31 to d7/l6c 0 2024-09-19T09:35:14.442 INFO:tasks.workunit.client.0.smithi112.stdout:2/73: dwrite d0/d1/d9/f10 [0,4194304] 0 2024-09-19T09:35:14.443 INFO:tasks.workunit.client.0.smithi112.stdout:5/298: chown d4/d9/d17/d2e/d61 279294675 1 2024-09-19T09:35:14.444 INFO:tasks.workunit.client.0.smithi112.stdout:1/97: symlink dc/l16 0 2024-09-19T09:35:14.445 INFO:tasks.workunit.client.0.smithi112.stdout:7/220: link d2/d8/d18/l40 d2/d2c/l48 0 2024-09-19T09:35:14.447 INFO:tasks.workunit.client.0.smithi112.stdout:4/358: rmdir d1/d4/d3a/d57/d60/d7c 0 2024-09-19T09:35:14.447 INFO:tasks.workunit.client.0.smithi112.stdout:4/359: fdatasync d1/d4/d3a/f5d 0 2024-09-19T09:35:14.448 INFO:tasks.workunit.client.0.smithi112.stdout:9/50: mkdir df/d11 0 2024-09-19T09:35:14.450 INFO:tasks.workunit.client.0.smithi112.stdout:4/360: dread d1/f6 [0,4194304] 0 2024-09-19T09:35:14.453 INFO:tasks.workunit.client.0.smithi112.stdout:8/352: creat d7/db/d21/d3b/d56/d4b/d5b/f6d x:0 0 0 2024-09-19T09:35:14.457 INFO:tasks.workunit.client.0.smithi112.stdout:6/182: unlink d8/d11/d14/d2a/l2c 0 2024-09-19T09:35:14.462 INFO:tasks.workunit.client.0.smithi112.stdout:8/353: dread d7/db/d21/d3b/d56/d3c/f3d [0,4194304] 0 2024-09-19T09:35:14.463 INFO:tasks.workunit.client.0.smithi112.stdout:9/51: dwrite fb [0,4194304] 0 2024-09-19T09:35:14.464 INFO:tasks.workunit.client.0.smithi112.stdout:2/74: rename d0/d1/ff to d0/d1/f1c 0 2024-09-19T09:35:14.464 INFO:tasks.workunit.client.0.smithi112.stdout:2/75: dread - d0/d6/fa zero size 2024-09-19T09:35:14.466 INFO:tasks.workunit.client.0.smithi112.stdout:5/299: unlink d4/d9/d2a/d39/c66 0 2024-09-19T09:35:14.466 INFO:tasks.workunit.client.0.smithi112.stdout:5/300: chown d4/d9/d3e/l40 12 1 2024-09-19T09:35:14.468 INFO:tasks.workunit.client.0.smithi112.stdout:1/98: rename c7 to dc/c17 0 2024-09-19T09:35:14.469 INFO:tasks.workunit.client.0.smithi112.stdout:7/221: mkdir d2/d49 0 2024-09-19T09:35:14.470 INFO:tasks.workunit.client.0.smithi112.stdout:4/361: symlink d1/d4/d3a/d57/l85 0 2024-09-19T09:35:14.471 INFO:tasks.workunit.client.0.smithi112.stdout:8/354: mknod d7/d10/d11/d62/c6e 0 2024-09-19T09:35:14.471 INFO:tasks.workunit.client.0.smithi112.stdout:8/355: truncate d7/db/d21/d2e/f5e 5083566 0 2024-09-19T09:35:14.473 INFO:tasks.workunit.client.0.smithi112.stdout:9/52: mkdir df/d12 0 2024-09-19T09:35:14.473 INFO:tasks.workunit.client.0.smithi112.stdout:5/301: mkdir d4/d9/d6b 0 2024-09-19T09:35:14.474 INFO:tasks.workunit.client.0.smithi112.stdout:7/222: mknod d2/d8/d1a/c4a 0 2024-09-19T09:35:14.474 INFO:tasks.workunit.client.0.smithi112.stdout:7/223: creat d2/d8/d18/d39/d23/d35/f4b x:0 0 0 2024-09-19T09:35:14.474 INFO:tasks.workunit.client.0.smithi112.stdout:2/76: read d0/d1/d9/f10 [2832504,84835] 0 2024-09-19T09:35:14.474 INFO:tasks.workunit.client.0.smithi112.stdout:2/77: chown d0/d1 16 1 2024-09-19T09:35:14.476 INFO:tasks.workunit.client.0.smithi112.stdout:9/53: creat df/f13 x:0 0 0 2024-09-19T09:35:14.479 INFO:tasks.workunit.client.0.smithi112.stdout:5/302: creat d4/d3f/f6c x:0 0 0 2024-09-19T09:35:14.479 INFO:tasks.workunit.client.0.smithi112.stdout:6/183: dwrite d8/de/d17/f31 [0,4194304] 0 2024-09-19T09:35:14.479 INFO:tasks.workunit.client.0.smithi112.stdout:5/303: write d4/d9/f25 [33670,12298] 0 2024-09-19T09:35:14.480 INFO:tasks.workunit.client.0.smithi112.stdout:5/304: dread - d4/d3f/f6c zero size 2024-09-19T09:35:14.480 INFO:tasks.workunit.client.0.smithi112.stdout:6/184: write d8/d11/f34 [969366,45771] 0 2024-09-19T09:35:14.484 INFO:tasks.workunit.client.0.smithi112.stdout:2/78: link d0/d6/fc d0/d6/f1d 0 2024-09-19T09:35:14.485 INFO:tasks.workunit.client.0.smithi112.stdout:4/362: getdents d1/d31/d43 0 2024-09-19T09:35:14.490 INFO:tasks.workunit.client.0.smithi112.stdout:5/305: creat d4/d9/d6b/f6d x:0 0 0 2024-09-19T09:35:14.491 INFO:tasks.workunit.client.0.smithi112.stdout:8/356: dread d7/db/d21/f43 [4194304,4194304] 0 2024-09-19T09:35:14.491 INFO:tasks.workunit.client.0.smithi112.stdout:8/357: truncate d7/d10/d11/d33/f27 2202571 0 2024-09-19T09:35:14.493 INFO:tasks.workunit.client.0.smithi112.stdout:6/185: rename l7 to d8/d11/l3b 0 2024-09-19T09:35:14.493 INFO:tasks.workunit.client.0.smithi112.stdout:8/358: dread d7/fd [0,4194304] 0 2024-09-19T09:35:14.493 INFO:tasks.workunit.client.0.smithi112.stdout:8/359: chown d7/db/d21/d2e 27532913 1 2024-09-19T09:35:14.496 INFO:tasks.workunit.client.0.smithi112.stdout:4/363: creat d1/d4/d3a/d57/d62/f86 x:0 0 0 2024-09-19T09:35:14.497 INFO:tasks.workunit.client.0.smithi112.stdout:2/79: dread d0/f5 [0,4194304] 0 2024-09-19T09:35:14.498 INFO:tasks.workunit.client.0.smithi112.stdout:2/80: read d0/d1/f1c [628226,60161] 0 2024-09-19T09:35:14.498 INFO:tasks.workunit.client.0.smithi112.stdout:2/81: read d0/d1/f1c [513601,62279] 0 2024-09-19T09:35:14.499 INFO:tasks.workunit.client.0.smithi112.stdout:6/186: mkdir d8/d11/d14/d3c 0 2024-09-19T09:35:14.499 INFO:tasks.workunit.client.0.smithi112.stdout:9/54: dwrite fe [0,4194304] 0 2024-09-19T09:35:14.499 INFO:tasks.workunit.client.0.smithi112.stdout:9/55: write f7 [4536321,128870] 0 2024-09-19T09:35:14.500 INFO:tasks.workunit.client.0.smithi112.stdout:8/360: symlink d7/d10/d11/d55/l6f 0 2024-09-19T09:35:14.500 INFO:tasks.workunit.client.0.smithi112.stdout:8/361: write d7/ff [1512369,88366] 0 2024-09-19T09:35:14.502 INFO:tasks.workunit.client.0.smithi112.stdout:1/99: dwrite f6 [4194304,4194304] 0 2024-09-19T09:35:14.502 INFO:tasks.workunit.client.0.smithi112.stdout:1/100: fdatasync dc/d10/f15 0 2024-09-19T09:35:14.503 INFO:tasks.workunit.client.0.smithi112.stdout:4/364: creat d1/d3d/f87 x:0 0 0 2024-09-19T09:35:14.503 INFO:tasks.workunit.client.0.smithi112.stdout:4/365: fsync d1/d31/d43/d48/f7e 0 2024-09-19T09:35:14.503 INFO:tasks.workunit.client.0.smithi112.stdout:4/366: readlink d1/lf 0 2024-09-19T09:35:14.503 INFO:tasks.workunit.client.0.smithi112.stdout:7/224: dwrite d2/d8/d18/d39/f34 [0,4194304] 0 2024-09-19T09:35:14.503 INFO:tasks.workunit.client.0.smithi112.stdout:5/306: truncate d4/d9/d17/d30/f38 3182312 0 2024-09-19T09:35:14.504 INFO:tasks.workunit.client.0.smithi112.stdout:2/82: mkdir d0/d1/d9/d1e 0 2024-09-19T09:35:14.504 INFO:tasks.workunit.client.0.smithi112.stdout:2/83: chown d0/d6/fb 23175 1 2024-09-19T09:35:14.507 INFO:tasks.workunit.client.0.smithi112.stdout:9/56: mkdir df/d11/d14 0 2024-09-19T09:35:14.507 INFO:tasks.workunit.client.0.smithi112.stdout:9/57: stat fb 0 2024-09-19T09:35:14.507 INFO:tasks.workunit.client.0.smithi112.stdout:9/58: chown fb 610164164 1 2024-09-19T09:35:14.507 INFO:tasks.workunit.client.0.smithi112.stdout:9/59: fsync f3 0 2024-09-19T09:35:14.510 INFO:tasks.workunit.client.0.smithi112.stdout:1/101: creat dc/d13/f18 x:0 0 0 2024-09-19T09:35:14.511 INFO:tasks.workunit.client.0.smithi112.stdout:4/367: mkdir d1/d4/d3a/d57/d62/d88 0 2024-09-19T09:35:14.512 INFO:tasks.workunit.client.0.smithi112.stdout:7/225: truncate d2/d8/d18/f1e 3747754 0 2024-09-19T09:35:14.514 INFO:tasks.workunit.client.0.smithi112.stdout:5/307: mknod d4/d9/d2a/d39/c6e 0 2024-09-19T09:35:14.515 INFO:tasks.workunit.client.0.smithi112.stdout:8/362: dread d7/db/d21/d2e/f5e [0,4194304] 0 2024-09-19T09:35:14.515 INFO:tasks.workunit.client.0.smithi112.stdout:8/363: write d7/d67/f4f [3181854,47873] 0 2024-09-19T09:35:14.518 INFO:tasks.workunit.client.0.smithi112.stdout:1/102: symlink dc/d10/l19 0 2024-09-19T09:35:14.519 INFO:tasks.workunit.client.0.smithi112.stdout:4/368: mkdir d1/d31/d51/d89 0 2024-09-19T09:35:14.520 INFO:tasks.workunit.client.0.smithi112.stdout:5/308: getdents d4/d9/d17/d2e 0 2024-09-19T09:35:14.523 INFO:tasks.workunit.client.0.smithi112.stdout:6/187: dwrite d8/f23 [4194304,4194304] 0 2024-09-19T09:35:14.523 INFO:tasks.workunit.client.0.smithi112.stdout:6/188: chown d8/de/l25 18 1 2024-09-19T09:35:14.524 INFO:tasks.workunit.client.0.smithi112.stdout:8/364: rename d7/db/d21/d3b/d56/c29 to d7/d67/c70 0 2024-09-19T09:35:14.524 INFO:tasks.workunit.client.0.smithi112.stdout:2/84: dwrite d0/d1/fd [0,4194304] 0 2024-09-19T09:35:14.526 INFO:tasks.workunit.client.0.smithi112.stdout:1/103: mknod dc/c1a 0 2024-09-19T09:35:14.528 INFO:tasks.workunit.client.0.smithi112.stdout:9/60: getdents df/d11 0 2024-09-19T09:35:14.532 INFO:tasks.workunit.client.0.smithi112.stdout:6/189: creat d8/d11/d14/d2a/f3d x:0 0 0 2024-09-19T09:35:14.532 INFO:tasks.workunit.client.0.smithi112.stdout:6/190: readlink d8/ld 0 2024-09-19T09:35:14.535 INFO:tasks.workunit.client.0.smithi112.stdout:7/226: dwrite d2/d8/d1a/f3d [0,4194304] 0 2024-09-19T09:35:14.535 INFO:tasks.workunit.client.0.smithi112.stdout:7/227: read - d2/d8/d18/d39/d23/d35/f43 zero size 2024-09-19T09:35:14.537 INFO:tasks.workunit.client.0.smithi112.stdout:9/61: creat df/d11/f15 x:0 0 0 2024-09-19T09:35:14.537 INFO:tasks.workunit.client.0.smithi112.stdout:9/62: write fb [4332084,48667] 0 2024-09-19T09:35:14.538 INFO:tasks.workunit.client.0.smithi112.stdout:2/85: dread d0/f5 [0,4194304] 0 2024-09-19T09:35:14.546 INFO:tasks.workunit.client.0.smithi112.stdout:7/228: truncate d2/f13 3157310 0 2024-09-19T09:35:14.548 INFO:tasks.workunit.client.0.smithi112.stdout:6/191: dread d8/f9 [0,4194304] 0 2024-09-19T09:35:14.548 INFO:tasks.workunit.client.0.smithi112.stdout:6/192: write d8/d11/d14/f1c [1250970,63953] 0 2024-09-19T09:35:14.548 INFO:tasks.workunit.client.0.smithi112.stdout:9/63: mknod df/d11/d14/c16 0 2024-09-19T09:35:14.555 INFO:tasks.workunit.client.0.smithi112.stdout:2/86: rmdir d0/d1/de 39 2024-09-19T09:35:14.555 INFO:tasks.workunit.client.0.smithi112.stdout:2/87: creat d0/d1/f1f x:0 0 0 2024-09-19T09:35:14.556 INFO:tasks.workunit.client.0.smithi112.stdout:6/193: dread f5 [4194304,4194304] 0 2024-09-19T09:35:14.557 INFO:tasks.workunit.client.0.smithi112.stdout:5/309: truncate d4/f34 1726028 0 2024-09-19T09:35:14.558 INFO:tasks.workunit.client.0.smithi112.stdout:4/369: dwrite d1/d4/d3a/d7a/d7f/f3c [0,4194304] 0 2024-09-19T09:35:14.558 INFO:tasks.workunit.client.0.smithi112.stdout:4/370: chown d1/d31/d43/d48/f7e 1874193 1 2024-09-19T09:35:14.559 INFO:tasks.workunit.client.0.smithi112.stdout:7/229: unlink d2/d8/d18/d39/d23/d35/f46 0 2024-09-19T09:35:14.560 INFO:tasks.workunit.client.0.smithi112.stdout:1/104: dwrite dc/d13/f18 [0,4194304] 0 2024-09-19T09:35:14.560 INFO:tasks.workunit.client.0.smithi112.stdout:1/105: creat dc/d13/f1b x:0 0 0 2024-09-19T09:35:14.560 INFO:tasks.workunit.client.0.smithi112.stdout:1/106: creat dc/d13/f1c x:0 0 0 2024-09-19T09:35:14.563 INFO:tasks.workunit.client.0.smithi112.stdout:9/64: truncate fe 2734681 0 2024-09-19T09:35:14.563 INFO:tasks.workunit.client.0.smithi112.stdout:9/65: chown df/d11/f15 247 1 2024-09-19T09:35:14.573 INFO:tasks.workunit.client.0.smithi112.stdout:1/107: dread f6 [4194304,4194304] 0 2024-09-19T09:35:14.573 INFO:tasks.workunit.client.0.smithi112.stdout:1/108: creat dc/d13/f1d x:0 0 0 2024-09-19T09:35:14.581 INFO:tasks.workunit.client.0.smithi112.stdout:6/194: dwrite d8/d11/d14/f1c [0,4194304] 0 2024-09-19T09:35:14.587 INFO:tasks.workunit.client.0.smithi112.stdout:2/88: mknod d0/d1/c20 0 2024-09-19T09:35:14.587 INFO:tasks.workunit.client.0.smithi112.stdout:2/89: fdatasync d0/d1/fd 0 2024-09-19T09:35:14.590 INFO:tasks.workunit.client.0.smithi112.stdout:5/310: rename d4/d9/d17/l1e to d4/d29/d4c/l6f 0 2024-09-19T09:35:14.593 INFO:tasks.workunit.client.0.smithi112.stdout:6/195: dread f6 [0,4194304] 0 2024-09-19T09:35:14.593 INFO:tasks.workunit.client.0.smithi112.stdout:7/230: mkdir d2/d8/d18/d39/d23/d35/d4c 0 2024-09-19T09:35:14.599 INFO:tasks.workunit.client.0.smithi112.stdout:9/66: mknod df/d11/c17 0 2024-09-19T09:35:14.599 INFO:tasks.workunit.client.0.smithi112.stdout:9/67: write fc [233384,80063] 0 2024-09-19T09:35:14.599 INFO:tasks.workunit.client.0.smithi112.stdout:9/68: write fc [594276,24816] 0 2024-09-19T09:35:14.615 INFO:tasks.workunit.client.0.smithi112.stdout:9/69: dwrite f7 [0,4194304] 0 2024-09-19T09:35:14.684 INFO:tasks.workunit.client.0.smithi112.stdout:2/90: symlink d0/d6/l21 0 2024-09-19T09:35:14.777 INFO:tasks.workunit.client.0.smithi112.stdout:1/109: rename dc/c14 to dc/d10/c1e 0 2024-09-19T09:35:14.777 INFO:tasks.workunit.client.0.smithi112.stdout:1/110: creat dc/f1f x:0 0 0 2024-09-19T09:35:14.777 INFO:tasks.workunit.client.0.smithi112.stdout:1/111: creat dc/f20 x:0 0 0 2024-09-19T09:35:14.779 INFO:tasks.workunit.client.0.smithi112.stdout:5/311: mkdir d4/d29/d36/d70 0 2024-09-19T09:35:14.781 INFO:tasks.workunit.client.0.smithi112.stdout:6/196: getdents d8 0 2024-09-19T09:35:14.783 INFO:tasks.workunit.client.0.smithi112.stdout:5/312: dread d4/d9/d17/d2e/f41 [0,4194304] 0 2024-09-19T09:35:14.784 INFO:tasks.workunit.client.0.smithi112.stdout:9/70: creat df/d11/d14/f18 x:0 0 0 2024-09-19T09:35:14.787 INFO:tasks.workunit.client.0.smithi112.stdout:2/91: truncate d0/d1/fd 3202092 0 2024-09-19T09:35:14.787 INFO:tasks.workunit.client.0.smithi112.stdout:2/92: creat d0/d1/f22 x:0 0 0 2024-09-19T09:35:14.787 INFO:tasks.workunit.client.0.smithi112.stdout:2/93: fdatasync d0/d1/de/f11 0 2024-09-19T09:35:14.793 INFO:tasks.workunit.client.0.smithi112.stdout:6/197: creat d8/d11/d14/f3e x:0 0 0 2024-09-19T09:35:14.794 INFO:tasks.workunit.client.0.smithi112.stdout:6/198: chown d8/c1d 228 1 2024-09-19T09:35:14.795 INFO:tasks.workunit.client.0.smithi112.stdout:1/112: dwrite dc/fd [4194304,4194304] 0 2024-09-19T09:35:14.795 INFO:tasks.workunit.client.0.smithi112.stdout:1/113: stat dc/d10/f15 0 2024-09-19T09:35:14.795 INFO:tasks.workunit.client.0.smithi112.stdout:1/114: creat dc/f21 x:0 0 0 2024-09-19T09:35:14.795 INFO:tasks.workunit.client.0.smithi112.stdout:1/115: dread - dc/d13/f1b zero size 2024-09-19T09:35:14.795 INFO:tasks.workunit.client.0.smithi112.stdout:1/116: write dc/d10/f12 [2383,122249] 0 2024-09-19T09:35:14.795 INFO:tasks.workunit.client.0.smithi112.stdout:1/117: write dc/f21 [544775,36860] 0 2024-09-19T09:35:14.796 INFO:tasks.workunit.client.0.smithi112.stdout:7/231: mkdir d2/d8/d18/d39/d21/d45/d4d 0 2024-09-19T09:35:14.797 INFO:tasks.workunit.client.0.smithi112.stdout:5/313: truncate d4/d9/d17/d2f/f32 3956415 0 2024-09-19T09:35:14.797 INFO:tasks.workunit.client.0.smithi112.stdout:5/314: stat d4/d29/c31 0 2024-09-19T09:35:14.798 INFO:tasks.workunit.client.0.smithi112.stdout:5/315: write d4/d29/d36/d5f/f6a [170725,72500] 0 2024-09-19T09:35:14.805 INFO:tasks.workunit.client.0.smithi112.stdout:9/71: rename df/d12 to df/d11/d14/d19 0 2024-09-19T09:35:14.805 INFO:tasks.workunit.client.0.smithi112.stdout:9/72: write df/d11/d14/f18 [29698,34276] 0 2024-09-19T09:35:14.808 INFO:tasks.workunit.client.0.smithi112.stdout:2/94: symlink d0/l23 0 2024-09-19T09:35:14.813 INFO:tasks.workunit.client.0.smithi112.stdout:5/316: mknod d4/d29/c71 0 2024-09-19T09:35:14.813 INFO:tasks.workunit.client.0.smithi112.stdout:5/317: write d4/d9/d17/d2e/f41 [276108,72234] 0 2024-09-19T09:35:14.817 INFO:tasks.workunit.client.0.smithi112.stdout:1/118: rename cb to dc/d10/c22 0 2024-09-19T09:35:14.817 INFO:tasks.workunit.client.0.smithi112.stdout:1/119: chown dc/d13/f1c 148 1 2024-09-19T09:35:14.819 INFO:tasks.workunit.client.0.smithi112.stdout:9/73: truncate fb 886007 0 2024-09-19T09:35:14.819 INFO:tasks.workunit.client.0.smithi112.stdout:9/74: write df/d11/d14/f18 [228811,41757] 0 2024-09-19T09:35:14.819 INFO:tasks.workunit.client.0.smithi112.stdout:9/75: fsync df/d11/f15 0 2024-09-19T09:35:14.824 INFO:tasks.workunit.client.0.smithi112.stdout:9/76: rename df/c10 to df/c1a 0 2024-09-19T09:35:14.824 INFO:tasks.workunit.client.0.smithi112.stdout:9/77: chown f0 10242 1 2024-09-19T09:35:14.826 INFO:tasks.workunit.client.0.smithi112.stdout:5/318: rename d4/d9/d17/d2e to d4/d9/d17/d2f/d72 0 2024-09-19T09:35:14.830 INFO:tasks.workunit.client.0.smithi112.stdout:0/219: sync 2024-09-19T09:35:14.832 INFO:tasks.workunit.client.0.smithi112.stdout:6/199: dwrite d8/f23 [0,4194304] 0 2024-09-19T09:35:14.832 INFO:tasks.workunit.client.0.smithi112.stdout:4/371: dwrite d1/d3d/d72/f7b [0,4194304] 0 2024-09-19T09:35:14.833 INFO:tasks.workunit.client.0.smithi112.stdout:6/200: symlink d8/de/d17/l3f 0 2024-09-19T09:35:14.834 INFO:tasks.workunit.client.0.smithi112.stdout:6/201: write d8/de/d18/d20/f3a [255244,43478] 0 2024-09-19T09:35:14.834 INFO:tasks.workunit.client.0.smithi112.stdout:6/202: chown d8/d11/d14 1575 1 2024-09-19T09:35:14.834 INFO:tasks.workunit.client.0.smithi112.stdout:9/78: write fe [496511,97774] 0 2024-09-19T09:35:14.838 INFO:tasks.workunit.client.0.smithi112.stdout:7/232: dwrite d2/d8/d18/d39/f47 [0,4194304] 0 2024-09-19T09:35:14.839 INFO:tasks.workunit.client.0.smithi112.stdout:4/372: truncate d1/f46 1420433 0 2024-09-19T09:35:14.840 INFO:tasks.workunit.client.0.smithi112.stdout:2/95: getdents d0/d1 0 2024-09-19T09:35:14.844 INFO:tasks.workunit.client.0.smithi112.stdout:7/233: mkdir d2/d8/d18/d39/d21/d4e 0 2024-09-19T09:35:14.845 INFO:tasks.workunit.client.0.smithi112.stdout:4/373: symlink d1/d31/d43/d48/d5c/l8a 0 2024-09-19T09:35:14.846 INFO:tasks.workunit.client.0.smithi112.stdout:4/374: write d1/d31/d42/f83 [502928,111983] 0 2024-09-19T09:35:14.846 INFO:tasks.workunit.client.0.smithi112.stdout:4/375: read - d1/d31/d43/d48/d5c/f84 zero size 2024-09-19T09:35:14.846 INFO:tasks.workunit.client.0.smithi112.stdout:4/376: write d1/d31/d43/f74 [802137,62892] 0 2024-09-19T09:35:14.853 INFO:tasks.workunit.client.0.smithi112.stdout:7/234: symlink d2/d8/d18/d39/d23/l4f 0 2024-09-19T09:35:14.854 INFO:tasks.workunit.client.0.smithi112.stdout:7/235: read d2/d8/d18/d39/d21/f2e [632625,129165] 0 2024-09-19T09:35:14.854 INFO:tasks.workunit.client.0.smithi112.stdout:7/236: chown d2/d8/d18/f3e 1 1 2024-09-19T09:35:14.863 INFO:tasks.workunit.client.0.smithi112.stdout:4/377: dread d1/d3d/d72/f7b [0,4194304] 0 2024-09-19T09:35:14.863 INFO:tasks.workunit.client.0.smithi112.stdout:4/378: chown d1/d3d/d41/f4f 365914439 1 2024-09-19T09:35:14.867 INFO:tasks.workunit.client.0.smithi112.stdout:7/237: dread d2/f13 [0,4194304] 0 2024-09-19T09:35:14.868 INFO:tasks.workunit.client.0.smithi112.stdout:7/238: symlink d2/d8/d18/d39/d21/d45/l50 0 2024-09-19T09:35:14.868 INFO:tasks.workunit.client.0.smithi112.stdout:7/239: chown d2/d8/f2f 730706 1 2024-09-19T09:35:14.868 INFO:tasks.workunit.client.0.smithi112.stdout:0/220: dwrite d2/d11/f33 [0,4194304] 0 2024-09-19T09:35:14.868 INFO:tasks.workunit.client.0.smithi112.stdout:5/319: dwrite d4/d9/d2a/f43 [0,4194304] 0 2024-09-19T09:35:14.869 INFO:tasks.workunit.client.0.smithi112.stdout:6/203: dwrite d8/de/d17/f22 [0,4194304] 0 2024-09-19T09:35:14.869 INFO:tasks.workunit.client.0.smithi112.stdout:6/204: chown d8/d2b 3 1 2024-09-19T09:35:14.874 INFO:tasks.workunit.client.0.smithi112.stdout:0/221: creat d2/d11/f40 x:0 0 0 2024-09-19T09:35:14.874 INFO:tasks.workunit.client.0.smithi112.stdout:0/222: truncate d2/f31 624599 0 2024-09-19T09:35:14.875 INFO:tasks.workunit.client.0.smithi112.stdout:7/240: dread d2/d8/d1a/f1b [0,4194304] 0 2024-09-19T09:35:14.878 INFO:tasks.workunit.client.0.smithi112.stdout:4/379: dwrite d1/d3d/f61 [0,4194304] 0 2024-09-19T09:35:14.880 INFO:tasks.workunit.client.0.smithi112.stdout:0/223: rename d2/l34 to d2/d11/l41 0 2024-09-19T09:35:14.881 INFO:tasks.workunit.client.0.smithi112.stdout:5/320: getdents d4/d9 0 2024-09-19T09:35:14.881 INFO:tasks.workunit.client.0.smithi112.stdout:5/321: write d4/d29/d36/d5f/f6a [57346,40921] 0 2024-09-19T09:35:14.882 INFO:tasks.workunit.client.0.smithi112.stdout:0/224: dread d2/d39/f3d [0,4194304] 0 2024-09-19T09:35:14.883 INFO:tasks.workunit.client.0.smithi112.stdout:6/205: dread d8/de/d17/f22 [0,4194304] 0 2024-09-19T09:35:14.884 INFO:tasks.workunit.client.0.smithi112.stdout:7/241: link d2/f15 d2/d8/d18/d39/d21/f51 0 2024-09-19T09:35:14.889 INFO:tasks.workunit.client.0.smithi112.stdout:4/380: mkdir d1/d31/d51/d89/d8b 0 2024-09-19T09:35:14.894 INFO:tasks.workunit.client.0.smithi112.stdout:6/206: mkdir d8/d11/d40 0 2024-09-19T09:35:14.895 INFO:tasks.workunit.client.0.smithi112.stdout:5/322: dwrite d4/f34 [0,4194304] 0 2024-09-19T09:35:14.897 INFO:tasks.workunit.client.0.smithi112.stdout:7/242: rmdir d2/d8/d18/d39/d23 39 2024-09-19T09:35:14.900 INFO:tasks.workunit.client.0.smithi112.stdout:4/381: mknod d1/d5f/c8c 0 2024-09-19T09:35:14.900 INFO:tasks.workunit.client.0.smithi112.stdout:4/382: dread - d1/d31/d43/d48/f63 zero size 2024-09-19T09:35:14.904 INFO:tasks.workunit.client.0.smithi112.stdout:6/207: unlink d8/lb 0 2024-09-19T09:35:14.905 INFO:tasks.workunit.client.0.smithi112.stdout:6/208: truncate d8/de/d18/f35 534104 0 2024-09-19T09:35:14.905 INFO:tasks.workunit.client.0.smithi112.stdout:6/209: chown d8/d2b/f38 26702 1 2024-09-19T09:35:14.905 INFO:tasks.workunit.client.0.smithi112.stdout:6/210: fdatasync d8/f16 0 2024-09-19T09:35:14.905 INFO:tasks.workunit.client.0.smithi112.stdout:6/211: fsync d8/de/d18/f35 0 2024-09-19T09:35:14.905 INFO:tasks.workunit.client.0.smithi112.stdout:6/212: creat d8/d11/d14/f41 x:0 0 0 2024-09-19T09:35:14.905 INFO:tasks.workunit.client.0.smithi112.stdout:7/243: creat d2/d8/d18/d39/d23/f52 x:0 0 0 2024-09-19T09:35:14.907 INFO:tasks.workunit.client.0.smithi112.stdout:0/225: rmdir d2 39 2024-09-19T09:35:14.907 INFO:tasks.workunit.client.0.smithi112.stdout:7/244: dread d2/d2c/f38 [0,4194304] 0 2024-09-19T09:35:14.911 INFO:tasks.workunit.client.0.smithi112.stdout:6/213: symlink d8/de/d18/d20/l42 0 2024-09-19T09:35:14.912 INFO:tasks.workunit.client.0.smithi112.stdout:6/214: dread d8/de/d18/d20/f3a [0,4194304] 0 2024-09-19T09:35:14.912 INFO:tasks.workunit.client.0.smithi112.stdout:0/226: rename d2/d11/l41 to d2/d39/l42 0 2024-09-19T09:35:14.913 INFO:tasks.workunit.client.0.smithi112.stdout:7/245: truncate d2/fd 1225899 0 2024-09-19T09:35:14.914 INFO:tasks.workunit.client.0.smithi112.stdout:6/215: creat d8/d11/f43 x:0 0 0 2024-09-19T09:35:14.915 INFO:tasks.workunit.client.0.smithi112.stdout:5/323: dwrite d4/d9/d2a/f49 [0,4194304] 0 2024-09-19T09:35:14.915 INFO:tasks.workunit.client.0.smithi112.stdout:5/324: creat d4/f73 x:0 0 0 2024-09-19T09:35:14.915 INFO:tasks.workunit.client.0.smithi112.stdout:0/227: rename d2/ld to d2/d39/d3b/l43 0 2024-09-19T09:35:14.916 INFO:tasks.workunit.client.0.smithi112.stdout:7/246: truncate d2/fe 3084054 0 2024-09-19T09:35:14.924 INFO:tasks.workunit.client.0.smithi112.stdout:6/216: symlink d8/d11/d14/d2a/l44 0 2024-09-19T09:35:14.924 INFO:tasks.workunit.client.0.smithi112.stdout:6/217: dread - d8/d11/d14/f3e zero size 2024-09-19T09:35:14.924 INFO:tasks.workunit.client.0.smithi112.stdout:6/218: readlink d8/de/d17/l3f 0 2024-09-19T09:35:14.925 INFO:tasks.workunit.client.0.smithi112.stdout:7/247: dread d2/f13 [0,4194304] 0 2024-09-19T09:35:14.930 INFO:tasks.workunit.client.0.smithi112.stdout:5/325: truncate d4/d29/f2d 4190204 0 2024-09-19T09:35:14.930 INFO:tasks.workunit.client.0.smithi112.stdout:0/228: rmdir d2/d11 39 2024-09-19T09:35:14.943 INFO:tasks.workunit.client.0.smithi112.stdout:4/383: dwrite d1/d31/d51/f2f [0,4194304] 0 2024-09-19T09:35:14.944 INFO:tasks.workunit.client.0.smithi112.stdout:6/219: rmdir d8/de 39 2024-09-19T09:35:14.946 INFO:tasks.workunit.client.0.smithi112.stdout:7/248: mknod d2/d8/d18/d39/d21/d4e/c53 0 2024-09-19T09:35:14.950 INFO:tasks.workunit.client.0.smithi112.stdout:6/220: dread d8/de/d17/f1e [0,4194304] 0 2024-09-19T09:35:14.950 INFO:tasks.workunit.client.0.smithi112.stdout:6/221: chown d8/de/d18/f29 32664788 1 2024-09-19T09:35:14.950 INFO:tasks.workunit.client.0.smithi112.stdout:6/222: fdatasync d8/de/d18/f35 0 2024-09-19T09:35:14.950 INFO:tasks.workunit.client.0.smithi112.stdout:6/223: readlink d8/d11/d13/l33 0 2024-09-19T09:35:14.950 INFO:tasks.workunit.client.0.smithi112.stdout:5/326: rename d4/d29/c31 to d4/d9/d17/d2f/d72/d61/c74 0 2024-09-19T09:35:14.951 INFO:tasks.workunit.client.0.smithi112.stdout:5/327: stat d4/l26 0 2024-09-19T09:35:14.951 INFO:tasks.workunit.client.0.smithi112.stdout:5/328: dread - d4/d3f/f6c zero size 2024-09-19T09:35:14.951 INFO:tasks.workunit.client.0.smithi112.stdout:0/229: rmdir d2/d11 39 2024-09-19T09:35:14.951 INFO:tasks.workunit.client.0.smithi112.stdout:4/384: dread d1/f46 [0,4194304] 0 2024-09-19T09:35:14.955 INFO:tasks.workunit.client.0.smithi112.stdout:6/224: dread f6 [0,4194304] 0 2024-09-19T09:35:14.957 INFO:tasks.workunit.client.0.smithi112.stdout:5/329: symlink d4/d9/d17/d2f/d72/d5d/l75 0 2024-09-19T09:35:14.958 INFO:tasks.workunit.client.0.smithi112.stdout:5/330: getdents d4/d29/d36/d70 0 2024-09-19T09:35:14.959 INFO:tasks.workunit.client.0.smithi112.stdout:7/249: dread d2/d8/d1a/f2d [0,4194304] 0 2024-09-19T09:35:14.959 INFO:tasks.workunit.client.0.smithi112.stdout:4/385: read d1/d3d/f56 [2467864,7419] 0 2024-09-19T09:35:14.959 INFO:tasks.workunit.client.0.smithi112.stdout:6/225: symlink d8/de/d18/l45 0 2024-09-19T09:35:14.959 INFO:tasks.workunit.client.0.smithi112.stdout:6/226: chown d8 174 1 2024-09-19T09:35:14.964 INFO:tasks.workunit.client.0.smithi112.stdout:6/227: creat d8/de/d17/f46 x:0 0 0 2024-09-19T09:35:14.965 INFO:tasks.workunit.client.0.smithi112.stdout:5/331: dread d4/d9/d17/d30/f38 [0,4194304] 0 2024-09-19T09:35:14.965 INFO:tasks.workunit.client.0.smithi112.stdout:5/332: dread - d4/f73 zero size 2024-09-19T09:35:14.966 INFO:tasks.workunit.client.0.smithi112.stdout:7/250: rename d2/d8 to d2/d2c/d54 0 2024-09-19T09:35:14.969 INFO:tasks.workunit.client.0.smithi112.stdout:7/251: mknod d2/d49/c55 0 2024-09-19T09:35:14.969 INFO:tasks.workunit.client.0.smithi112.stdout:7/252: creat d2/f56 x:0 0 0 2024-09-19T09:35:14.970 INFO:tasks.workunit.client.0.smithi112.stdout:5/333: dread d4/d9/d17/d2f/d72/f42 [0,4194304] 0 2024-09-19T09:35:14.972 INFO:tasks.workunit.client.0.smithi112.stdout:0/230: dwrite d2/f4 [0,4194304] 0 2024-09-19T09:35:14.972 INFO:tasks.workunit.client.0.smithi112.stdout:0/231: write d2/fb [1452459,112531] 0 2024-09-19T09:35:14.973 INFO:tasks.workunit.client.0.smithi112.stdout:7/253: creat d2/d2c/d54/d18/d39/d23/f57 x:0 0 0 2024-09-19T09:35:14.974 INFO:tasks.workunit.client.0.smithi112.stdout:7/254: chown d2/d2c/d54/d18/d39/d21 500076 1 2024-09-19T09:35:14.974 INFO:tasks.workunit.client.0.smithi112.stdout:5/334: getdents d4/d9/d2a 0 2024-09-19T09:35:14.975 INFO:tasks.workunit.client.0.smithi112.stdout:0/232: mkdir d2/d39/d3b/d44 0 2024-09-19T09:35:14.977 INFO:tasks.workunit.client.0.smithi112.stdout:7/255: creat d2/d49/f58 x:0 0 0 2024-09-19T09:35:14.978 INFO:tasks.workunit.client.0.smithi112.stdout:5/335: truncate d4/d9/d17/d2f/d72/f42 2880579 0 2024-09-19T09:35:14.980 INFO:tasks.workunit.client.0.smithi112.stdout:7/256: rename d2/d2c/d54/d18/d39/d23/f27 to d2/f59 0 2024-09-19T09:35:14.981 INFO:tasks.workunit.client.0.smithi112.stdout:5/336: symlink d4/d29/l76 0 2024-09-19T09:35:14.983 INFO:tasks.workunit.client.0.smithi112.stdout:7/257: rmdir d2/d2c/d54/d18/d39/d21 39 2024-09-19T09:35:14.985 INFO:tasks.workunit.client.0.smithi112.stdout:7/258: rename d2/d2c/d54/d1a/f2d to d2/d49/f5a 0 2024-09-19T09:35:14.995 INFO:tasks.workunit.client.0.smithi112.stdout:6/228: dwrite d8/d11/d14/f41 [0,4194304] 0 2024-09-19T09:35:14.995 INFO:tasks.workunit.client.0.smithi112.stdout:6/229: dread - d8/d11/d14/d2a/f3d zero size 2024-09-19T09:35:14.995 INFO:tasks.workunit.client.0.smithi112.stdout:6/230: fsync d8/de/d18/f28 0 2024-09-19T09:35:14.996 INFO:tasks.workunit.client.0.smithi112.stdout:0/233: dwrite d2/f38 [0,4194304] 0 2024-09-19T09:35:14.996 INFO:tasks.workunit.client.0.smithi112.stdout:0/234: readlink d2/d11/l35 0 2024-09-19T09:35:14.997 INFO:tasks.workunit.client.0.smithi112.stdout:6/231: link d8/f9 d8/d11/d14/f47 0 2024-09-19T09:35:15.018 INFO:tasks.workunit.client.0.smithi112.stdout:7/259: dwrite d2/d2c/d54/d18/d39/d23/d35/f43 [0,4194304] 0 2024-09-19T09:35:15.018 INFO:tasks.workunit.client.0.smithi112.stdout:6/232: dwrite d8/d11/f43 [0,4194304] 0 2024-09-19T09:35:15.023 INFO:tasks.workunit.client.0.smithi112.stdout:7/260: chown d2/d2c/d54/d18/f22 844 1 2024-09-19T09:35:15.028 INFO:tasks.workunit.client.0.smithi112.stdout:6/233: rename d8/d2b to d8/de/d17/d48 0 2024-09-19T09:35:15.046 INFO:tasks.workunit.client.0.smithi112.stdout:6/234: dwrite d8/d11/d14/f41 [0,4194304] 0 2024-09-19T09:35:15.046 INFO:tasks.workunit.client.0.smithi112.stdout:7/261: dwrite d2/d2c/d54/d18/d39/f34 [0,4194304] 0 2024-09-19T09:35:15.048 INFO:tasks.workunit.client.0.smithi112.stdout:6/235: mkdir d8/de/d17/d49 0 2024-09-19T09:35:15.050 INFO:tasks.workunit.client.0.smithi112.stdout:7/262: link d2/d2c/d54/d18/d39/d21/d45/l50 d2/d2c/d54/d18/d39/d21/d4e/l5b 0 2024-09-19T09:35:15.054 INFO:tasks.workunit.client.0.smithi112.stdout:7/263: dread - d2/d2c/d54/d18/f3c zero size 2024-09-19T09:35:15.054 INFO:tasks.workunit.client.0.smithi112.stdout:7/264: write d2/d2c/d54/f2f [744815,21690] 0 2024-09-19T09:35:15.060 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:14 smithi112 ceph-mon[27605]: pgmap v19: 65 pgs: 65 active+clean; 2.3 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 268 MiB/s rd, 343 MiB/s wr, 505 op/s 2024-09-19T09:35:15.060 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:14 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:15.061 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:14 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:15.063 INFO:tasks.workunit.client.0.smithi112.stdout:6/236: dwrite d8/de/d18/d20/f3a [0,4194304] 0 2024-09-19T09:35:15.064 INFO:tasks.workunit.client.0.smithi112.stdout:6/237: truncate d8/d11/d14/d2a/f32 176605 0 2024-09-19T09:35:15.076 INFO:tasks.workunit.client.0.smithi112.stdout:6/238: link d8/d11/d13/l33 d8/de/d17/l4a 0 2024-09-19T09:35:15.077 INFO:tasks.workunit.client.0.smithi112.stdout:7/265: dwrite d2/d2c/d54/d18/d39/d23/d35/f4b [0,4194304] 0 2024-09-19T09:35:15.081 INFO:tasks.workunit.client.0.smithi112.stdout:7/266: rename d2/d2c/d54/d18/d39/d23/d35/f43 to d2/d2c/d54/d18/d39/d21/d45/f5c 0 2024-09-19T09:35:15.084 INFO:tasks.workunit.client.0.smithi112.stdout:7/267: rename d2/f3a to d2/d2c/f5d 0 2024-09-19T09:35:15.085 INFO:tasks.workunit.client.0.smithi112.stdout:7/268: truncate d2/f9 437394 0 2024-09-19T09:35:15.086 INFO:tasks.workunit.client.0.smithi112.stdout:7/269: rmdir d2/d2c/d54/d18/d39/d21/d45 39 2024-09-19T09:35:15.087 INFO:tasks.workunit.client.0.smithi112.stdout:7/270: stat d2/d2c/d54/d18/l25 0 2024-09-19T09:35:15.091 INFO:tasks.workunit.client.0.smithi112.stdout:6/239: dwrite d8/de/d17/f22 [0,4194304] 0 2024-09-19T09:35:15.091 INFO:tasks.workunit.client.0.smithi112.stdout:6/240: write d8/f10 [3467698,95642] 0 2024-09-19T09:35:15.091 INFO:tasks.workunit.client.0.smithi112.stdout:6/241: fsync d8/f23 0 2024-09-19T09:35:15.091 INFO:tasks.workunit.client.0.smithi112.stdout:6/242: chown d8/f23 32 1 2024-09-19T09:35:15.093 INFO:tasks.workunit.client.0.smithi112.stdout:6/243: mkdir d8/d11/d14/d3c/d4b 0 2024-09-19T09:35:15.097 INFO:tasks.workunit.client.0.smithi112.stdout:6/244: rename d8/de/d17/l4a to d8/de/d17/d48/l4c 0 2024-09-19T09:35:15.097 INFO:tasks.workunit.client.0.smithi112.stdout:6/245: write d8/d11/d14/d2a/f3d [1009823,101076] 0 2024-09-19T09:35:15.098 INFO:tasks.workunit.client.0.smithi112.stdout:6/246: dread d8/d11/d14/d2a/f32 [0,4194304] 0 2024-09-19T09:35:15.098 INFO:tasks.workunit.client.0.smithi112.stdout:6/247: creat d8/d11/d14/d2a/f4d x:0 0 0 2024-09-19T09:35:15.108 INFO:tasks.workunit.client.0.smithi112.stdout:7/271: dwrite d2/fd [0,4194304] 0 2024-09-19T09:35:15.109 INFO:tasks.workunit.client.0.smithi112.stdout:7/272: creat d2/d2c/d54/d18/d39/d21/d4e/f5e x:0 0 0 2024-09-19T09:35:15.110 INFO:tasks.workunit.client.0.smithi112.stdout:7/273: rmdir d2/d2c/d54/d18/d39/d21/d45 39 2024-09-19T09:35:15.116 INFO:tasks.workunit.client.0.smithi112.stdout:6/248: getdents d8/d11/d14/d3c 0 2024-09-19T09:35:15.128 INFO:tasks.workunit.client.0.smithi112.stdout:7/274: mknod d2/d2c/d54/d18/d39/d23/c5f 0 2024-09-19T09:35:15.131 INFO:tasks.workunit.client.0.smithi112.stdout:6/249: dwrite d8/d11/d14/d2a/f3d [0,4194304] 0 2024-09-19T09:35:15.141 INFO:tasks.workunit.client.0.smithi112.stdout:6/250: dread d8/f10 [0,4194304] 0 2024-09-19T09:35:15.141 INFO:tasks.workunit.client.0.smithi112.stdout:6/251: stat d8/l12 0 2024-09-19T09:35:15.146 INFO:tasks.workunit.client.0.smithi112.stdout:7/275: dwrite d2/f9 [0,4194304] 0 2024-09-19T09:35:15.146 INFO:tasks.workunit.client.0.smithi112.stdout:6/252: dread d8/f9 [0,4194304] 0 2024-09-19T09:35:15.146 INFO:tasks.workunit.client.0.smithi112.stdout:6/253: truncate d8/de/d17/f46 458064 0 2024-09-19T09:35:15.148 INFO:tasks.workunit.client.0.smithi112.stdout:6/254: mknod d8/de/d18/c4e 0 2024-09-19T09:35:15.148 INFO:tasks.workunit.client.0.smithi112.stdout:6/255: stat d8/d11/d13/l36 0 2024-09-19T09:35:15.168 INFO:tasks.workunit.client.0.smithi112.stdout:7/276: dwrite d2/d49/f5a [0,4194304] 0 2024-09-19T09:35:15.170 INFO:tasks.workunit.client.0.smithi112.stdout:7/277: link d2/c7 d2/d49/c60 0 2024-09-19T09:35:15.172 INFO:tasks.workunit.client.0.smithi112.stdout:7/278: symlink d2/d2c/d54/d18/d39/d21/d45/d4d/l61 0 2024-09-19T09:35:15.176 INFO:tasks.workunit.client.0.smithi112.stdout:7/279: getdents d2/d2c/d54/d18/d39/d21 0 2024-09-19T09:35:15.176 INFO:tasks.workunit.client.0.smithi112.stdout:7/280: chown d2/fd 158791465 1 2024-09-19T09:35:15.197 INFO:tasks.workunit.client.0.smithi112.stdout:7/281: dwrite d2/d49/f58 [0,4194304] 0 2024-09-19T09:35:15.202 INFO:tasks.workunit.client.0.smithi112.stdout:7/282: creat d2/d2c/d54/d1a/f62 x:0 0 0 2024-09-19T09:35:15.223 INFO:tasks.workunit.client.0.smithi112.stdout:7/283: dwrite d2/d2c/d54/d18/d39/f47 [0,4194304] 0 2024-09-19T09:35:15.223 INFO:tasks.workunit.client.0.smithi112.stdout:7/284: fsync d2/f13 0 2024-09-19T09:35:15.227 INFO:tasks.workunit.client.0.smithi112.stdout:7/285: creat d2/d2c/d54/f63 x:0 0 0 2024-09-19T09:35:15.238 INFO:tasks.workunit.client.0.smithi112.stdout:7/286: symlink d2/d2c/d54/l64 0 2024-09-19T09:35:15.252 INFO:tasks.workunit.client.0.smithi112.stdout:7/287: write d2/d2c/d54/d1a/f3d [317229,103866] 0 2024-09-19T09:35:15.252 INFO:tasks.workunit.client.0.smithi112.stdout:7/288: chown d2/d2c/d54/d1a/f1b 83065 1 2024-09-19T09:35:15.279 INFO:tasks.workunit.client.0.smithi112.stdout:7/289: dwrite d2/f9 [0,4194304] 0 2024-09-19T09:35:15.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:14 smithi191 ceph-mon[34834]: pgmap v19: 65 pgs: 65 active+clean; 2.3 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 268 MiB/s rd, 343 MiB/s wr, 505 op/s 2024-09-19T09:35:15.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:14 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:15.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:14 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:15.286 INFO:tasks.workunit.client.0.smithi112.stdout:7/290: creat d2/d2c/d54/d18/d39/d23/d35/d4c/f65 x:0 0 0 2024-09-19T09:35:15.286 INFO:tasks.workunit.client.0.smithi112.stdout:7/291: stat d2/d2c/d54/d1a/f42 0 2024-09-19T09:35:15.289 INFO:tasks.workunit.client.0.smithi112.stdout:7/292: rename d2/f56 to d2/d2c/d54/d18/d39/d21/d45/f66 0 2024-09-19T09:35:15.870 INFO:tasks.workunit.client.0.smithi112.stdout:2/96: sync 2024-09-19T09:35:15.870 INFO:tasks.workunit.client.0.smithi112.stdout:8/365: sync 2024-09-19T09:35:15.870 INFO:tasks.workunit.client.0.smithi112.stdout:1/120: sync 2024-09-19T09:35:15.871 INFO:tasks.workunit.client.0.smithi112.stdout:4/386: sync 2024-09-19T09:35:15.871 INFO:tasks.workunit.client.0.smithi112.stdout:3/181: sync 2024-09-19T09:35:15.871 INFO:tasks.workunit.client.0.smithi112.stdout:9/79: sync 2024-09-19T09:35:15.871 INFO:tasks.workunit.client.0.smithi112.stdout:9/80: dread - df/d11/f15 zero size 2024-09-19T09:35:15.871 INFO:tasks.workunit.client.0.smithi112.stdout:4/387: write d1/d3d/d41/f52 [3417642,43173] 0 2024-09-19T09:35:15.871 INFO:tasks.workunit.client.0.smithi112.stdout:2/97: mkdir d0/d6/d24 0 2024-09-19T09:35:15.871 INFO:tasks.workunit.client.0.smithi112.stdout:2/98: write d0/d1/f1f [868625,121381] 0 2024-09-19T09:35:15.873 INFO:tasks.workunit.client.0.smithi112.stdout:3/182: truncate d8/f17 1816888 0 2024-09-19T09:35:15.873 INFO:tasks.workunit.client.0.smithi112.stdout:3/183: read - d8/d15/d1b/d1c/d24/d33/f35 zero size 2024-09-19T09:35:15.873 INFO:tasks.workunit.client.0.smithi112.stdout:3/184: write d8/d15/f29 [522317,65968] 0 2024-09-19T09:35:15.873 INFO:tasks.workunit.client.0.smithi112.stdout:2/99: write d0/d1/f1c [845454,15816] 0 2024-09-19T09:35:15.877 INFO:tasks.workunit.client.0.smithi112.stdout:8/366: creat d7/db/d21/d3b/d56/d4b/f71 x:0 0 0 2024-09-19T09:35:15.880 INFO:tasks.workunit.client.0.smithi112.stdout:3/185: mknod d8/d15/d1b/d28/c39 0 2024-09-19T09:35:15.881 INFO:tasks.workunit.client.0.smithi112.stdout:9/81: write f3 [372574,93118] 0 2024-09-19T09:35:15.883 INFO:tasks.workunit.client.0.smithi112.stdout:9/82: mknod df/d11/c1b 0 2024-09-19T09:35:15.885 INFO:tasks.workunit.client.0.smithi112.stdout:9/83: creat df/d11/d14/d19/f1c x:0 0 0 2024-09-19T09:35:15.885 INFO:tasks.workunit.client.0.smithi112.stdout:9/84: write df/d11/d14/f18 [1231449,15467] 0 2024-09-19T09:35:15.899 INFO:tasks.workunit.client.0.smithi112.stdout:3/186: dread d8/f30 [0,4194304] 0 2024-09-19T09:35:15.901 INFO:tasks.workunit.client.0.smithi112.stdout:3/187: link d8/d15/d1b/d1c/d24/d33/l36 d8/d15/d1b/l3a 0 2024-09-19T09:35:15.903 INFO:tasks.workunit.client.0.smithi112.stdout:3/188: truncate d8/fd 1658084 0 2024-09-19T09:35:15.916 INFO:tasks.workunit.client.0.smithi112.stdout:8/367: dwrite d7/fd [0,4194304] 0 2024-09-19T09:35:15.917 INFO:tasks.workunit.client.0.smithi112.stdout:4/388: dwrite d1/d3d/f3f [4194304,4194304] 0 2024-09-19T09:35:15.917 INFO:tasks.workunit.client.0.smithi112.stdout:4/389: stat d1/d31/d43/d48/f63 0 2024-09-19T09:35:15.917 INFO:tasks.workunit.client.0.smithi112.stdout:4/390: truncate d1/f46 2185635 0 2024-09-19T09:35:15.920 INFO:tasks.workunit.client.0.smithi112.stdout:4/391: symlink d1/d4/d3a/d7a/l8d 0 2024-09-19T09:35:15.920 INFO:tasks.workunit.client.0.smithi112.stdout:4/392: chown d1/d4/f9 67002489 1 2024-09-19T09:35:15.927 INFO:tasks.workunit.client.0.smithi112.stdout:8/368: dread d7/d67/f4f [0,4194304] 0 2024-09-19T09:35:15.928 INFO:tasks.workunit.client.0.smithi112.stdout:8/369: write d7/d10/d11/d33/f27 [1561155,4045] 0 2024-09-19T09:35:15.984 INFO:tasks.workunit.client.0.smithi112.stdout:1/121: dwrite dc/d13/f1c [0,4194304] 0 2024-09-19T09:35:15.984 INFO:tasks.workunit.client.0.smithi112.stdout:4/393: fsync d1/d3d/d41/f52 0 2024-09-19T09:35:15.984 INFO:tasks.workunit.client.0.smithi112.stdout:1/122: write dc/ff [1243641,112847] 0 2024-09-19T09:35:15.984 INFO:tasks.workunit.client.0.smithi112.stdout:1/123: chown dc/d13/f18 458537375 1 2024-09-19T09:35:15.984 INFO:tasks.workunit.client.0.smithi112.stdout:1/124: truncate dc/f20 5867 0 2024-09-19T09:35:15.988 INFO:tasks.workunit.client.0.smithi112.stdout:9/85: dwrite fc [0,4194304] 0 2024-09-19T09:35:15.997 INFO:tasks.workunit.client.0.smithi112.stdout:4/394: truncate d1/d4/d3a/f5d 1451002 0 2024-09-19T09:35:16.003 INFO:tasks.workunit.client.0.smithi112.stdout:4/395: symlink d1/d31/d71/l8e 0 2024-09-19T09:35:16.004 INFO:tasks.workunit.client.0.smithi112.stdout:4/396: creat d1/d31/d43/d48/d5c/f8f x:0 0 0 2024-09-19T09:35:16.005 INFO:tasks.workunit.client.0.smithi112.stdout:1/125: rmdir dc/d13 39 2024-09-19T09:35:16.005 INFO:tasks.workunit.client.0.smithi112.stdout:1/126: creat dc/f23 x:0 0 0 2024-09-19T09:35:16.005 INFO:tasks.workunit.client.0.smithi112.stdout:1/127: write dc/f1f [744402,120705] 0 2024-09-19T09:35:16.005 INFO:tasks.workunit.client.0.smithi112.stdout:1/128: fsync dc/fd 0 2024-09-19T09:35:16.007 INFO:tasks.workunit.client.0.smithi112.stdout:9/86: getdents df/d11/d14 0 2024-09-19T09:35:16.007 INFO:tasks.workunit.client.0.smithi112.stdout:9/87: fdatasync fc 0 2024-09-19T09:35:16.010 INFO:tasks.workunit.client.0.smithi112.stdout:1/129: write f6 [7664192,126059] 0 2024-09-19T09:35:16.010 INFO:tasks.workunit.client.0.smithi112.stdout:1/130: write dc/d10/f12 [286989,127971] 0 2024-09-19T09:35:16.024 INFO:tasks.workunit.client.0.smithi112.stdout:9/88: dwrite f3 [4194304,4194304] 0 2024-09-19T09:35:16.033 INFO:tasks.workunit.client.0.smithi112.stdout:1/131: dwrite dc/d13/f1d [0,4194304] 0 2024-09-19T09:35:16.033 INFO:tasks.workunit.client.0.smithi112.stdout:1/132: fsync dc/fe 0 2024-09-19T09:35:16.034 INFO:tasks.workunit.client.0.smithi112.stdout:9/89: truncate f3 3940272 0 2024-09-19T09:35:16.034 INFO:tasks.workunit.client.0.smithi112.stdout:1/133: write dc/f21 [329181,12275] 0 2024-09-19T09:35:16.037 INFO:tasks.workunit.client.0.smithi112.stdout:9/90: rename f7 to df/d11/d14/f1d 0 2024-09-19T09:35:16.040 INFO:tasks.workunit.client.0.smithi112.stdout:9/91: mkdir df/d11/d14/d19/d1e 0 2024-09-19T09:35:16.041 INFO:tasks.workunit.client.0.smithi112.stdout:9/92: truncate fb 1550108 0 2024-09-19T09:35:16.042 INFO:tasks.workunit.client.0.smithi112.stdout:1/134: rename dc/d10 to dc/d24 0 2024-09-19T09:35:16.042 INFO:tasks.workunit.client.0.smithi112.stdout:1/135: chown dc/d24/f12 11 1 2024-09-19T09:35:16.042 INFO:tasks.workunit.client.0.smithi112.stdout:1/136: read - dc/f23 zero size 2024-09-19T09:35:16.042 INFO:tasks.workunit.client.0.smithi112.stdout:1/137: write dc/ff [2115555,6961] 0 2024-09-19T09:35:16.046 INFO:tasks.workunit.client.0.smithi112.stdout:9/93: dread fb [0,4194304] 0 2024-09-19T09:35:16.047 INFO:tasks.workunit.client.0.smithi112.stdout:1/138: dread dc/f21 [0,4194304] 0 2024-09-19T09:35:16.048 INFO:tasks.workunit.client.0.smithi112.stdout:9/94: creat df/d11/d14/f1f x:0 0 0 2024-09-19T09:35:16.048 INFO:tasks.workunit.client.0.smithi112.stdout:9/95: truncate df/d11/d14/d19/f1c 422689 0 2024-09-19T09:35:16.049 INFO:tasks.workunit.client.0.smithi112.stdout:1/139: creat dc/d13/f25 x:0 0 0 2024-09-19T09:35:16.061 INFO:tasks.workunit.client.0.smithi112.stdout:9/96: dwrite df/f13 [0,4194304] 0 2024-09-19T09:35:16.065 INFO:tasks.workunit.client.0.smithi112.stdout:9/97: mkdir df/d20 0 2024-09-19T09:35:16.065 INFO:tasks.workunit.client.0.smithi112.stdout:9/98: write df/d11/d14/f1f [77844,104304] 0 2024-09-19T09:35:16.081 INFO:tasks.workunit.client.0.smithi112.stdout:9/99: getdents df 0 2024-09-19T09:35:16.083 INFO:tasks.workunit.client.0.smithi112.stdout:9/100: link ld df/d11/d14/l21 0 2024-09-19T09:35:16.085 INFO:tasks.workunit.client.0.smithi112.stdout:9/101: symlink df/d11/d14/l22 0 2024-09-19T09:35:16.085 INFO:tasks.workunit.client.0.smithi112.stdout:9/102: chown df/f13 8148128 1 2024-09-19T09:35:16.086 INFO:tasks.workunit.client.0.smithi112.stdout:9/103: mknod df/d11/d14/c23 0 2024-09-19T09:35:16.094 INFO:tasks.workunit.client.0.smithi112.stdout:9/104: dread f0 [0,4194304] 0 2024-09-19T09:35:16.110 INFO:tasks.workunit.client.0.smithi112.stdout:9/105: dwrite fb [0,4194304] 0 2024-09-19T09:35:16.110 INFO:tasks.workunit.client.0.smithi112.stdout:9/106: write df/d11/f15 [686122,114980] 0 2024-09-19T09:35:16.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:15 smithi112 ceph-mon[27605]: Reconfiguring alertmanager.smithi112 (dependencies changed)... 2024-09-19T09:35:16.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:15 smithi112 ceph-mon[27605]: Deploying daemon alertmanager.smithi112 on smithi112 2024-09-19T09:35:16.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:15 smithi112 ceph-mon[27605]: pgmap v20: 65 pgs: 65 active+clean; 2.3 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 158 MiB/s rd, 197 MiB/s wr, 307 op/s 2024-09-19T09:35:16.271 INFO:tasks.workunit.client.0.smithi112.stdout:5/337: sync 2024-09-19T09:35:16.272 INFO:tasks.workunit.client.0.smithi112.stdout:5/338: truncate d4/d9/d2a/f49 197960 0 2024-09-19T09:35:16.273 INFO:tasks.workunit.client.0.smithi112.stdout:5/339: creat d4/d9/d3e/f77 x:0 0 0 2024-09-19T09:35:16.273 INFO:tasks.workunit.client.0.smithi112.stdout:5/340: stat d4/d9/d2a/d39/c6e 0 2024-09-19T09:35:16.274 INFO:tasks.workunit.client.0.smithi112.stdout:5/341: symlink d4/d29/d36/d5f/l78 0 2024-09-19T09:35:16.275 INFO:tasks.workunit.client.0.smithi112.stdout:5/342: creat d4/d9/d2a/d69/f79 x:0 0 0 2024-09-19T09:35:16.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:15 smithi191 ceph-mon[34834]: Reconfiguring alertmanager.smithi112 (dependencies changed)... 2024-09-19T09:35:16.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:15 smithi191 ceph-mon[34834]: Deploying daemon alertmanager.smithi112 on smithi112 2024-09-19T09:35:16.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:15 smithi191 ceph-mon[34834]: pgmap v20: 65 pgs: 65 active+clean; 2.3 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 158 MiB/s rd, 197 MiB/s wr, 307 op/s 2024-09-19T09:35:16.297 INFO:tasks.workunit.client.0.smithi112.stdout:5/343: dwrite d4/d9/d3e/f77 [0,4194304] 0 2024-09-19T09:35:16.301 INFO:tasks.workunit.client.0.smithi112.stdout:5/344: mknod d4/d29/d36/d56/c7a 0 2024-09-19T09:35:16.304 INFO:tasks.workunit.client.0.smithi112.stdout:5/345: truncate d4/d29/f3c 7630473 0 2024-09-19T09:35:16.304 INFO:tasks.workunit.client.0.smithi112.stdout:5/346: chown d4/d9/d17/d2f/d72/f41 46428 1 2024-09-19T09:35:16.305 INFO:tasks.workunit.client.0.smithi112.stdout:5/347: rename d4/d9/d3e/l4a to d4/d29/d4c/l7b 0 2024-09-19T09:35:16.307 INFO:tasks.workunit.client.0.smithi112.stdout:5/348: mkdir d4/d9/d17/d7c 0 2024-09-19T09:35:16.331 INFO:tasks.workunit.client.0.smithi112.stdout:5/349: dwrite d4/d9/d17/d30/f38 [0,4194304] 0 2024-09-19T09:35:16.333 INFO:tasks.workunit.client.0.smithi112.stdout:5/350: rename d4/d9/d17/d2f/d72/d5d to d4/d9/d17/d2f/d7d 0 2024-09-19T09:35:16.334 INFO:tasks.workunit.client.0.smithi112.stdout:5/351: symlink d4/d9/d3e/l7e 0 2024-09-19T09:35:16.344 INFO:tasks.workunit.client.0.smithi112.stdout:5/352: truncate d4/d9/d17/d30/f38 1573868 0 2024-09-19T09:35:16.345 INFO:tasks.workunit.client.0.smithi112.stdout:5/353: mkdir d4/d9/d3e/d7f 0 2024-09-19T09:35:16.348 INFO:tasks.workunit.client.0.smithi112.stdout:5/354: creat d4/d9/d17/d30/f80 x:0 0 0 2024-09-19T09:35:16.348 INFO:tasks.workunit.client.0.smithi112.stdout:5/355: chown d4/d9/d17/d2f/d72/d61 9 1 2024-09-19T09:35:16.362 INFO:tasks.workunit.client.0.smithi112.stdout:5/356: dread d4/d9/d3e/f77 [0,4194304] 0 2024-09-19T09:35:16.362 INFO:tasks.workunit.client.0.smithi112.stdout:5/357: creat d4/d9/d2a/d69/f81 x:0 0 0 2024-09-19T09:35:16.384 INFO:tasks.workunit.client.0.smithi112.stdout:5/358: dwrite d4/d9/d2a/d46/f55 [0,4194304] 0 2024-09-19T09:35:16.397 INFO:tasks.workunit.client.0.smithi112.stdout:5/359: dread d4/d9/f10 [0,4194304] 0 2024-09-19T09:35:16.403 INFO:tasks.workunit.client.0.smithi112.stdout:5/360: dread d4/d9/d17/d2f/f32 [0,4194304] 0 2024-09-19T09:35:16.403 INFO:tasks.workunit.client.0.smithi112.stdout:5/361: chown d4/d9/c21 3631 1 2024-09-19T09:35:16.403 INFO:tasks.workunit.client.0.smithi112.stdout:5/362: readlink d4/d9/d2a/l52 0 2024-09-19T09:35:16.417 INFO:tasks.workunit.client.0.smithi112.stdout:5/363: dwrite d4/d29/f20 [4194304,4194304] 0 2024-09-19T09:35:16.417 INFO:tasks.workunit.client.0.smithi112.stdout:5/364: rename d4/d9/d2a to d4/d9/d2a/d69/d82 22 2024-09-19T09:35:16.418 INFO:tasks.workunit.client.0.smithi112.stdout:5/365: symlink d4/d9/d17/d2f/d7d/l83 0 2024-09-19T09:35:16.428 INFO:tasks.workunit.client.0.smithi112.stdout:5/366: write d4/d9/d2a/f43 [3127017,112645] 0 2024-09-19T09:35:16.428 INFO:tasks.workunit.client.0.smithi112.stdout:5/367: write d4/d9/d17/d2f/d72/f42 [1135772,56237] 0 2024-09-19T09:35:16.428 INFO:tasks.workunit.client.0.smithi112.stdout:5/368: chown d4/d9/c68 9631125 1 2024-09-19T09:35:16.428 INFO:tasks.workunit.client.0.smithi112.stdout:5/369: chown d4/d9/c14 40 1 2024-09-19T09:35:16.428 INFO:tasks.workunit.client.0.smithi112.stdout:5/370: chown d4/d9/d2a/d69/f58 22 1 2024-09-19T09:35:16.835 INFO:tasks.workunit.client.0.smithi112.stdout:0/235: sync 2024-09-19T09:35:16.836 INFO:tasks.workunit.client.0.smithi112.stdout:0/236: mkdir d2/d45 0 2024-09-19T09:35:16.838 INFO:tasks.workunit.client.0.smithi112.stdout:0/237: link d2/d11/f2a d2/d39/f46 0 2024-09-19T09:35:16.838 INFO:tasks.workunit.client.0.smithi112.stdout:0/238: fdatasync d2/d11/f1a 0 2024-09-19T09:35:16.839 INFO:tasks.workunit.client.0.smithi112.stdout:0/239: link d2/f12 d2/d11/f47 0 2024-09-19T09:35:16.840 INFO:tasks.workunit.client.0.smithi112.stdout:0/240: symlink d2/d11/l48 0 2024-09-19T09:35:16.841 INFO:tasks.workunit.client.0.smithi112.stdout:0/241: readlink d2/d11/l25 0 2024-09-19T09:35:16.841 INFO:tasks.workunit.client.0.smithi112.stdout:0/242: dread - d2/d11/f2e zero size 2024-09-19T09:35:16.850 INFO:tasks.workunit.client.0.smithi112.stdout:0/243: dread d2/d11/f33 [0,4194304] 0 2024-09-19T09:35:16.851 INFO:tasks.workunit.client.0.smithi112.stdout:0/244: dread d2/f30 [0,4194304] 0 2024-09-19T09:35:16.852 INFO:tasks.workunit.client.0.smithi112.stdout:0/245: write d2/f21 [5069128,10227] 0 2024-09-19T09:35:16.852 INFO:tasks.workunit.client.0.smithi112.stdout:0/246: fdatasync d2/f31 0 2024-09-19T09:35:16.852 INFO:tasks.workunit.client.0.smithi112.stdout:0/247: read - d2/d11/f2e zero size 2024-09-19T09:35:16.853 INFO:tasks.workunit.client.0.smithi112.stdout:0/248: rename d2/d11/f1a to d2/f49 0 2024-09-19T09:35:16.854 INFO:tasks.workunit.client.0.smithi112.stdout:0/249: symlink d2/d45/l4a 0 2024-09-19T09:35:16.856 INFO:tasks.workunit.client.0.smithi112.stdout:0/250: rename d2/d39/f3d to d2/d39/d3b/f4b 0 2024-09-19T09:35:16.857 INFO:tasks.workunit.client.0.smithi112.stdout:0/251: symlink d2/l4c 0 2024-09-19T09:35:16.857 INFO:tasks.workunit.client.0.smithi112.stdout:0/252: chown d2/d11/f33 14762023 1 2024-09-19T09:35:16.857 INFO:tasks.workunit.client.0.smithi112.stdout:0/253: truncate d2/d39/d3b/f4b 1500553 0 2024-09-19T09:35:16.857 INFO:tasks.workunit.client.0.smithi112.stdout:0/254: write d2/f10 [5170118,73139] 0 2024-09-19T09:35:16.857 INFO:tasks.workunit.client.0.smithi112.stdout:0/255: truncate d2/d11/f40 197760 0 2024-09-19T09:35:16.865 INFO:tasks.workunit.client.0.smithi112.stdout:0/256: dread d2/fe [0,4194304] 0 2024-09-19T09:35:16.867 INFO:tasks.workunit.client.0.smithi112.stdout:0/257: dread d2/f30 [0,4194304] 0 2024-09-19T09:35:16.867 INFO:tasks.workunit.client.0.smithi112.stdout:0/258: chown d2/cc 3580016 1 2024-09-19T09:35:16.867 INFO:tasks.workunit.client.0.smithi112.stdout:0/259: creat d2/d45/f4d x:0 0 0 2024-09-19T09:35:16.869 INFO:tasks.workunit.client.0.smithi112.stdout:0/260: creat d2/f4e x:0 0 0 2024-09-19T09:35:16.869 INFO:tasks.workunit.client.0.smithi112.stdout:0/261: chown d2/c1d 187 1 2024-09-19T09:35:16.887 INFO:tasks.workunit.client.0.smithi112.stdout:0/262: dwrite d2/d11/f2a [0,4194304] 0 2024-09-19T09:35:16.889 INFO:tasks.workunit.client.0.smithi112.stdout:0/263: truncate d2/f12 104913 0 2024-09-19T09:35:16.889 INFO:tasks.workunit.client.0.smithi112.stdout:0/264: stat d2/d39/f46 0 2024-09-19T09:35:16.892 INFO:tasks.workunit.client.0.smithi112.stdout:0/265: link d2/f1b d2/d39/f4f 0 2024-09-19T09:35:16.896 INFO:tasks.workunit.client.0.smithi112.stdout:0/266: getdents d2/d45 0 2024-09-19T09:35:16.898 INFO:tasks.workunit.client.0.smithi112.stdout:0/267: mknod d2/d11/c50 0 2024-09-19T09:35:16.898 INFO:tasks.workunit.client.0.smithi112.stdout:0/268: chown d2/d11/c50 4 1 2024-09-19T09:35:16.903 INFO:tasks.workunit.client.0.smithi112.stdout:0/269: link d2/d11/c15 d2/d39/c51 0 2024-09-19T09:35:16.937 INFO:tasks.workunit.client.0.smithi112.stdout:0/270: dwrite d2/f38 [0,4194304] 0 2024-09-19T09:35:16.938 INFO:tasks.workunit.client.0.smithi112.stdout:0/271: dread - d2/d11/f32 zero size 2024-09-19T09:35:16.939 INFO:tasks.workunit.client.0.smithi112.stdout:0/272: symlink d2/d39/d3b/d44/l52 0 2024-09-19T09:35:16.940 INFO:tasks.workunit.client.0.smithi112.stdout:0/273: creat d2/d11/f53 x:0 0 0 2024-09-19T09:35:16.941 INFO:tasks.workunit.client.0.smithi112.stdout:0/274: rmdir d2/d45 39 2024-09-19T09:35:16.942 INFO:tasks.workunit.client.0.smithi112.stdout:0/275: chown d2/d39/d3b/f4b 5 1 2024-09-19T09:35:16.942 INFO:tasks.workunit.client.0.smithi112.stdout:0/276: chown d2/f3c 635099335 1 2024-09-19T09:35:16.963 INFO:tasks.workunit.client.0.smithi112.stdout:0/277: dwrite d2/f21 [0,4194304] 0 2024-09-19T09:35:16.964 INFO:tasks.workunit.client.0.smithi112.stdout:0/278: truncate d2/d11/f37 59683 0 2024-09-19T09:35:16.964 INFO:tasks.workunit.client.0.smithi112.stdout:0/279: creat d2/d45/f54 x:0 0 0 2024-09-19T09:35:16.964 INFO:tasks.workunit.client.0.smithi112.stdout:0/280: chown d2/d11/l2d 24 1 2024-09-19T09:35:16.966 INFO:tasks.workunit.client.0.smithi112.stdout:0/281: unlink d2/d11/l25 0 2024-09-19T09:35:16.966 INFO:tasks.workunit.client.0.smithi112.stdout:0/282: fdatasync d2/f10 0 2024-09-19T09:35:16.966 INFO:tasks.workunit.client.0.smithi112.stdout:0/283: write d2/d11/f2e [828948,96794] 0 2024-09-19T09:35:16.967 INFO:tasks.workunit.client.0.smithi112.stdout:0/284: rename d2/l16 to d2/d39/d3b/d44/l55 0 2024-09-19T09:35:16.969 INFO:tasks.workunit.client.0.smithi112.stdout:0/285: rename d2/d11/f18 to d2/f56 0 2024-09-19T09:35:16.969 INFO:tasks.workunit.client.0.smithi112.stdout:0/286: creat d2/f57 x:0 0 0 2024-09-19T09:35:16.971 INFO:tasks.workunit.client.0.smithi112.stdout:0/287: mkdir d2/d39/d58 0 2024-09-19T09:35:16.972 INFO:tasks.workunit.client.0.smithi112.stdout:0/288: dread d2/f31 [0,4194304] 0 2024-09-19T09:35:16.981 INFO:tasks.workunit.client.0.smithi112.stdout:0/289: dread d2/f38 [0,4194304] 0 2024-09-19T09:35:16.988 INFO:tasks.workunit.client.0.smithi112.stdout:0/290: write d2/f3c [1287718,105717] 0 2024-09-19T09:35:16.989 INFO:tasks.workunit.client.0.smithi112.stdout:0/291: rmdir d2/d39/d3b/d44 39 2024-09-19T09:35:16.989 INFO:tasks.workunit.client.0.smithi112.stdout:0/292: getdents d2/d39/d58 0 2024-09-19T09:35:16.990 INFO:tasks.workunit.client.0.smithi112.stdout:0/293: dread d2/d11/f47 [0,4194304] 0 2024-09-19T09:35:16.990 INFO:tasks.workunit.client.0.smithi112.stdout:0/294: write d2/f22 [951024,68972] 0 2024-09-19T09:35:16.990 INFO:tasks.workunit.client.0.smithi112.stdout:0/295: readlink d2/d11/l2b 0 2024-09-19T09:35:16.994 INFO:tasks.workunit.client.0.smithi112.stdout:0/296: mkdir d2/d59 0 2024-09-19T09:35:16.994 INFO:tasks.workunit.client.0.smithi112.stdout:0/297: chown d2/l2c 2083 1 2024-09-19T09:35:17.010 INFO:tasks.workunit.client.0.smithi112.stdout:0/298: dwrite d2/fb [0,4194304] 0 2024-09-19T09:35:17.021 INFO:tasks.workunit.client.0.smithi112.stdout:0/299: dread d2/f21 [0,4194304] 0 2024-09-19T09:35:17.021 INFO:tasks.workunit.client.0.smithi112.stdout:0/300: write d2/f56 [1721788,3879] 0 2024-09-19T09:35:17.036 INFO:tasks.workunit.client.0.smithi112.stdout:0/301: dwrite d2/d11/f47 [0,4194304] 0 2024-09-19T09:35:17.040 INFO:tasks.workunit.client.0.smithi112.stdout:0/302: getdents d2/d11 0 2024-09-19T09:35:17.043 INFO:tasks.workunit.client.0.smithi112.stdout:0/303: mknod d2/d39/d3b/d44/c5a 0 2024-09-19T09:35:17.043 INFO:tasks.workunit.client.0.smithi112.stdout:0/304: truncate d2/d11/f29 1054345 0 2024-09-19T09:35:17.063 INFO:tasks.workunit.client.0.smithi112.stdout:0/305: dwrite d2/f28 [0,4194304] 0 2024-09-19T09:35:17.063 INFO:tasks.workunit.client.0.smithi112.stdout:0/306: write d2/d45/f4d [348434,76712] 0 2024-09-19T09:35:17.063 INFO:tasks.workunit.client.0.smithi112.stdout:0/307: stat d2/f3c 0 2024-09-19T09:35:17.065 INFO:tasks.workunit.client.0.smithi112.stdout:0/308: symlink d2/d11/l5b 0 2024-09-19T09:35:17.066 INFO:tasks.workunit.client.0.smithi112.stdout:0/309: truncate d2/d11/f33 2929494 0 2024-09-19T09:35:17.068 INFO:tasks.workunit.client.0.smithi112.stdout:0/310: creat d2/d59/f5c x:0 0 0 2024-09-19T09:35:17.068 INFO:tasks.workunit.client.0.smithi112.stdout:0/311: creat d2/f5d x:0 0 0 2024-09-19T09:35:17.076 INFO:tasks.workunit.client.0.smithi112.stdout:0/312: dread d2/f12 [0,4194304] 0 2024-09-19T09:35:17.180 INFO:tasks.workunit.client.0.smithi112.stdout:6/256: sync 2024-09-19T09:35:17.180 INFO:tasks.workunit.client.0.smithi112.stdout:6/257: fdatasync d8/d11/d14/f3e 0 2024-09-19T09:35:17.180 INFO:tasks.workunit.client.0.smithi112.stdout:6/258: rename d8 to d8/de/d4f 22 2024-09-19T09:35:17.181 INFO:tasks.workunit.client.0.smithi112.stdout:6/259: truncate d8/d11/d14/f41 3484678 0 2024-09-19T09:35:17.182 INFO:tasks.workunit.client.0.smithi112.stdout:6/260: symlink d8/d11/d14/l50 0 2024-09-19T09:35:17.182 INFO:tasks.workunit.client.0.smithi112.stdout:6/261: symlink d8/l51 0 2024-09-19T09:35:17.183 INFO:tasks.workunit.client.0.smithi112.stdout:6/262: dread - d8/de/d17/d48/f38 zero size 2024-09-19T09:35:17.184 INFO:tasks.workunit.client.0.smithi112.stdout:6/263: link d8/de/d17/f22 d8/de/f52 0 2024-09-19T09:35:17.185 INFO:tasks.workunit.client.0.smithi112.stdout:6/264: symlink d8/d11/d13/l53 0 2024-09-19T09:35:17.185 INFO:tasks.workunit.client.0.smithi112.stdout:6/265: write d8/d11/d14/f3e [994221,49506] 0 2024-09-19T09:35:17.185 INFO:tasks.workunit.client.0.smithi112.stdout:6/266: creat d8/d11/d14/d3c/d4b/f54 x:0 0 0 2024-09-19T09:35:17.207 INFO:tasks.workunit.client.0.smithi112.stdout:6/267: dwrite d8/d11/d14/d2a/f3d [0,4194304] 0 2024-09-19T09:35:17.218 INFO:tasks.workunit.client.0.smithi112.stdout:6/268: dread d8/f10 [0,4194304] 0 2024-09-19T09:35:17.228 INFO:tasks.workunit.client.0.smithi112.stdout:6/269: dread d8/d11/d14/f3e [0,4194304] 0 2024-09-19T09:35:17.252 INFO:tasks.workunit.client.0.smithi112.stdout:6/270: dwrite d8/de/f52 [0,4194304] 0 2024-09-19T09:35:17.252 INFO:tasks.workunit.client.0.smithi112.stdout:6/271: chown d8/d11/f43 444720519 1 2024-09-19T09:35:17.255 INFO:tasks.workunit.client.0.smithi112.stdout:6/272: creat d8/de/d18/f55 x:0 0 0 2024-09-19T09:35:17.274 INFO:tasks.workunit.client.0.smithi112.stdout:6/273: dwrite d8/de/f52 [4194304,4194304] 0 2024-09-19T09:35:17.278 INFO:tasks.workunit.client.0.smithi112.stdout:6/274: creat d8/d11/d13/f56 x:0 0 0 2024-09-19T09:35:17.303 INFO:tasks.workunit.client.0.smithi112.stdout:6/275: dwrite d8/d11/d14/d3c/d4b/f54 [0,4194304] 0 2024-09-19T09:35:17.303 INFO:tasks.workunit.client.0.smithi112.stdout:6/276: creat d8/d11/d14/f57 x:0 0 0 2024-09-19T09:35:17.311 INFO:tasks.workunit.client.0.smithi112.stdout:6/277: unlink d8/de/d17/c19 0 2024-09-19T09:35:17.311 INFO:tasks.workunit.client.0.smithi112.stdout:6/278: chown d8/d11/d13/f56 63 1 2024-09-19T09:35:17.311 INFO:tasks.workunit.client.0.smithi112.stdout:6/279: getdents d8/d11/d40 0 2024-09-19T09:35:17.311 INFO:tasks.workunit.client.0.smithi112.stdout:6/280: creat d8/de/d18/f58 x:0 0 0 2024-09-19T09:35:17.311 INFO:tasks.workunit.client.0.smithi112.stdout:6/281: readlink d8/de/d17/d48/l4c 0 2024-09-19T09:35:17.311 INFO:tasks.workunit.client.0.smithi112.stdout:6/282: write d8/d11/f43 [4736897,51987] 0 2024-09-19T09:35:17.311 INFO:tasks.workunit.client.0.smithi112.stdout:6/283: fdatasync d8/d11/d14/d3c/d4b/f54 0 2024-09-19T09:35:17.317 INFO:tasks.workunit.client.0.smithi112.stdout:6/284: rename d8/d11/d14/f41 to d8/d11/d14/d3c/f59 0 2024-09-19T09:35:17.319 INFO:tasks.workunit.client.0.smithi112.stdout:6/285: stat d8/de/d17/c21 0 2024-09-19T09:35:17.319 INFO:tasks.workunit.client.0.smithi112.stdout:6/286: dread d8/de/d18/f35 [0,4194304] 0 2024-09-19T09:35:17.321 INFO:tasks.workunit.client.0.smithi112.stdout:6/287: link d8/de/d18/l37 d8/d11/d14/d3c/d4b/l5a 0 2024-09-19T09:35:17.378 INFO:tasks.workunit.client.0.smithi112.stdout:6/288: mknod d8/d11/c5b 0 2024-09-19T09:35:17.390 INFO:tasks.workunit.client.0.smithi112.stdout:6/289: write d8/de/d18/d20/f3a [464218,29568] 0 2024-09-19T09:35:17.393 INFO:tasks.workunit.client.0.smithi112.stdout:7/293: sync 2024-09-19T09:35:17.396 INFO:tasks.workunit.client.0.smithi112.stdout:7/294: mknod d2/d2c/d54/c67 0 2024-09-19T09:35:17.398 INFO:tasks.workunit.client.0.smithi112.stdout:7/295: rename d2/d2c/d54/d18/f22 to d2/d2c/d54/d18/d39/d21/d45/d4d/f68 0 2024-09-19T09:35:17.398 INFO:tasks.workunit.client.0.smithi112.stdout:7/296: fsync d2/f9 0 2024-09-19T09:35:17.399 INFO:tasks.workunit.client.0.smithi112.stdout:7/297: truncate d2/d2c/f5d 220759 0 2024-09-19T09:35:17.399 INFO:tasks.workunit.client.0.smithi112.stdout:7/298: stat d2/d49/c55 0 2024-09-19T09:35:17.402 INFO:tasks.workunit.client.0.smithi112.stdout:6/290: write d8/de/f52 [4787076,42160] 0 2024-09-19T09:35:17.406 INFO:tasks.workunit.client.0.smithi112.stdout:6/291: unlink d8/de/d17/l3f 0 2024-09-19T09:35:17.408 INFO:tasks.workunit.client.0.smithi112.stdout:6/292: symlink d8/d11/d14/d3c/l5c 0 2024-09-19T09:35:17.409 INFO:tasks.workunit.client.0.smithi112.stdout:6/293: symlink d8/de/d18/l5d 0 2024-09-19T09:35:17.409 INFO:tasks.workunit.client.0.smithi112.stdout:6/294: chown d8/de 74584807 1 2024-09-19T09:35:17.411 INFO:tasks.workunit.client.0.smithi112.stdout:6/295: symlink d8/de/d17/l5e 0 2024-09-19T09:35:17.413 INFO:tasks.workunit.client.0.smithi112.stdout:6/296: rename d8/de/d17/d48/f2d to d8/de/d17/d48/f5f 0 2024-09-19T09:35:17.414 INFO:tasks.workunit.client.0.smithi112.stdout:6/297: mkdir d8/d11/d14/d3c/d4b/d60 0 2024-09-19T09:35:17.414 INFO:tasks.workunit.client.0.smithi112.stdout:6/298: write d8/d11/d14/d3c/d4b/f54 [4358369,112790] 0 2024-09-19T09:35:17.422 INFO:tasks.workunit.client.0.smithi112.stdout:7/299: dwrite d2/d2c/d54/d18/d39/d23/f57 [0,4194304] 0 2024-09-19T09:35:17.422 INFO:tasks.workunit.client.0.smithi112.stdout:7/300: creat d2/d2c/f69 x:0 0 0 2024-09-19T09:35:17.448 INFO:tasks.workunit.client.0.smithi112.stdout:6/299: dwrite f6 [0,4194304] 0 2024-09-19T09:35:17.448 INFO:tasks.workunit.client.0.smithi112.stdout:7/301: dwrite d2/f28 [0,4194304] 0 2024-09-19T09:35:17.449 INFO:tasks.workunit.client.0.smithi112.stdout:6/300: mkdir d8/de/d61 0 2024-09-19T09:35:17.452 INFO:tasks.workunit.client.0.smithi112.stdout:6/301: mknod d8/c62 0 2024-09-19T09:35:17.452 INFO:tasks.workunit.client.0.smithi112.stdout:7/302: rmdir d2/d2c/d54/d18/d39/d21/d4e 39 2024-09-19T09:35:17.453 INFO:tasks.workunit.client.0.smithi112.stdout:6/302: rename d8/de/d17/d48 to d8/d11/d14/d3c/d4b/d63 0 2024-09-19T09:35:17.454 INFO:tasks.workunit.client.0.smithi112.stdout:6/303: symlink d8/de/d61/l64 0 2024-09-19T09:35:17.466 INFO:tasks.workunit.client.0.smithi112.stdout:7/303: read d2/d49/f5a [1114947,16318] 0 2024-09-19T09:35:17.477 INFO:tasks.workunit.client.0.smithi112.stdout:6/304: dwrite d8/de/d18/d20/f3a [0,4194304] 0 2024-09-19T09:35:17.479 INFO:tasks.workunit.client.0.smithi112.stdout:6/305: symlink d8/d11/d14/d3c/d4b/d63/l65 0 2024-09-19T09:35:17.482 INFO:tasks.workunit.client.0.smithi112.stdout:6/306: mkdir d8/de/d66 0 2024-09-19T09:35:17.489 INFO:tasks.workunit.client.0.smithi112.stdout:7/304: dwrite d2/d2c/d54/d18/f3c [0,4194304] 0 2024-09-19T09:35:17.489 INFO:tasks.workunit.client.0.smithi112.stdout:7/305: dread - d2/d2c/d54/d18/d39/d23/f52 zero size 2024-09-19T09:35:17.494 INFO:tasks.workunit.client.0.smithi112.stdout:6/307: write d8/d11/d14/d3c/f59 [2480574,109839] 0 2024-09-19T09:35:17.494 INFO:tasks.workunit.client.0.smithi112.stdout:6/308: write d8/d11/d14/d3c/d4b/d63/f5f [497202,125184] 0 2024-09-19T09:35:17.498 INFO:tasks.workunit.client.0.smithi112.stdout:6/309: mknod d8/de/d66/c67 0 2024-09-19T09:35:17.498 INFO:tasks.workunit.client.0.smithi112.stdout:6/310: stat d8/cc 0 2024-09-19T09:35:17.512 INFO:tasks.workunit.client.0.smithi112.stdout:6/311: dwrite d8/f9 [0,4194304] 0 2024-09-19T09:35:17.512 INFO:tasks.workunit.client.0.smithi112.stdout:6/312: creat d8/d11/d14/d2a/f68 x:0 0 0 2024-09-19T09:35:17.514 INFO:tasks.workunit.client.0.smithi112.stdout:6/313: creat d8/de/d18/d20/f69 x:0 0 0 2024-09-19T09:35:17.516 INFO:tasks.workunit.client.0.smithi112.stdout:6/314: creat d8/de/d17/d49/f6a x:0 0 0 2024-09-19T09:35:17.516 INFO:tasks.workunit.client.0.smithi112.stdout:6/315: fdatasync d8/de/d17/f1e 0 2024-09-19T09:35:17.516 INFO:tasks.workunit.client.0.smithi112.stdout:6/316: write d8/d11/d13/f56 [33946,17021] 0 2024-09-19T09:35:17.528 INFO:tasks.workunit.client.0.smithi112.stdout:6/317: dread d8/d11/f43 [0,4194304] 0 2024-09-19T09:35:17.528 INFO:tasks.workunit.client.0.smithi112.stdout:6/318: fsync d8/d11/d14/f1c 0 2024-09-19T09:35:17.528 INFO:tasks.workunit.client.0.smithi112.stdout:6/319: mknod d8/de/d17/d49/c6b 0 2024-09-19T09:35:17.529 INFO:tasks.workunit.client.0.smithi112.stdout:6/320: rmdir d8/d11/d14/d3c/d4b/d63 39 2024-09-19T09:35:17.531 INFO:tasks.workunit.client.0.smithi112.stdout:6/321: rmdir d8/d11/d14/d3c/d4b/d63 39 2024-09-19T09:35:17.537 INFO:tasks.workunit.client.0.smithi112.stdout:6/322: mknod d8/d11/d14/d3c/d4b/c6c 0 2024-09-19T09:35:17.537 INFO:tasks.workunit.client.0.smithi112.stdout:6/323: creat d8/de/d18/d20/f6d x:0 0 0 2024-09-19T09:35:17.537 INFO:tasks.workunit.client.0.smithi112.stdout:6/324: write d8/f9 [4969627,22294] 0 2024-09-19T09:35:17.540 INFO:tasks.workunit.client.0.smithi112.stdout:6/325: rmdir d8/d11/d40 0 2024-09-19T09:35:17.546 INFO:tasks.workunit.client.0.smithi112.stdout:6/326: getdents d8/de/d17/d49 0 2024-09-19T09:35:17.547 INFO:tasks.workunit.client.0.smithi112.stdout:6/327: write d8/d11/d14/f3e [62469,52342] 0 2024-09-19T09:35:17.547 INFO:tasks.workunit.client.0.smithi112.stdout:6/328: readlink d8/ld 0 2024-09-19T09:35:17.867 INFO:tasks.workunit.client.0.smithi112.stdout:2/100: sync 2024-09-19T09:35:17.867 INFO:tasks.workunit.client.0.smithi112.stdout:3/189: sync 2024-09-19T09:35:17.867 INFO:tasks.workunit.client.0.smithi112.stdout:8/370: sync 2024-09-19T09:35:17.868 INFO:tasks.workunit.client.0.smithi112.stdout:8/371: truncate d7/fa 2390547 0 2024-09-19T09:35:17.870 INFO:tasks.workunit.client.0.smithi112.stdout:2/101: symlink d0/d1/l25 0 2024-09-19T09:35:17.871 INFO:tasks.workunit.client.0.smithi112.stdout:2/102: creat d0/d6/d24/f26 x:0 0 0 2024-09-19T09:35:17.873 INFO:tasks.workunit.client.0.smithi112.stdout:3/190: dread d8/d15/d1b/d1c/d24/d21/f23 [0,4194304] 0 2024-09-19T09:35:17.877 INFO:tasks.workunit.client.0.smithi112.stdout:3/191: link d8/d15/l1a d8/d15/d1b/d1c/d24/d33/l3b 0 2024-09-19T09:35:17.877 INFO:tasks.workunit.client.0.smithi112.stdout:3/192: chown c5 51093 1 2024-09-19T09:35:17.894 INFO:tasks.workunit.client.0.smithi112.stdout:3/193: rename d8/d15/d1b/d1c/d24 to d8/d15/d1b/d1c/d27/d3c 0 2024-09-19T09:35:17.894 INFO:tasks.workunit.client.0.smithi112.stdout:3/194: write d8/d15/d1b/d1c/d27/d3c/d33/f35 [789115,113978] 0 2024-09-19T09:35:17.895 INFO:tasks.workunit.client.0.smithi112.stdout:3/195: rename d8/d15/d1b/d1c/d27/d3c/c32 to d8/d15/d1b/d1c/d27/d3c/c3d 0 2024-09-19T09:35:17.895 INFO:tasks.workunit.client.0.smithi112.stdout:8/372: dwrite d7/d10/d11/f2b [0,4194304] 0 2024-09-19T09:35:17.896 INFO:tasks.workunit.client.0.smithi112.stdout:2/103: dwrite d0/d1/f1f [0,4194304] 0 2024-09-19T09:35:17.896 INFO:tasks.workunit.client.0.smithi112.stdout:2/104: write d0/d6/fc [1352571,100405] 0 2024-09-19T09:35:17.898 INFO:tasks.workunit.client.0.smithi112.stdout:3/196: unlink d8/d15/d1b/c20 0 2024-09-19T09:35:17.899 INFO:tasks.workunit.client.0.smithi112.stdout:3/197: write d8/f17 [1417800,44688] 0 2024-09-19T09:35:17.906 INFO:tasks.workunit.client.0.smithi112.stdout:2/105: write d0/d6/fb [1322174,58867] 0 2024-09-19T09:35:17.907 INFO:tasks.workunit.client.0.smithi112.stdout:3/198: symlink d8/d15/d1b/l3e 0 2024-09-19T09:35:17.908 INFO:tasks.workunit.client.0.smithi112.stdout:2/106: mkdir d0/d1/de/d27 0 2024-09-19T09:35:17.908 INFO:tasks.workunit.client.0.smithi112.stdout:2/107: stat d0/d1/f7 0 2024-09-19T09:35:17.908 INFO:tasks.workunit.client.0.smithi112.stdout:2/108: write d0/d6/fc [2191342,36737] 0 2024-09-19T09:35:17.908 INFO:tasks.workunit.client.0.smithi112.stdout:2/109: stat d0/c13 0 2024-09-19T09:35:17.910 INFO:tasks.workunit.client.0.smithi112.stdout:3/199: getdents d8/d15/d1b/d28 0 2024-09-19T09:35:17.915 INFO:tasks.workunit.client.0.smithi112.stdout:3/200: mknod d8/d15/d1b/d1c/d27/c3f 0 2024-09-19T09:35:17.931 INFO:tasks.workunit.client.0.smithi112.stdout:3/201: dwrite f7 [0,4194304] 0 2024-09-19T09:35:17.932 INFO:tasks.workunit.client.0.smithi112.stdout:3/202: chown d8/l11 61 1 2024-09-19T09:35:17.933 INFO:tasks.workunit.client.0.smithi112.stdout:3/203: rmdir d8/d15/d1b/d1c/d27/d3c 39 2024-09-19T09:35:17.935 INFO:tasks.workunit.client.0.smithi112.stdout:3/204: mknod d8/d15/d1b/d1c/d27/d3c/c40 0 2024-09-19T09:35:17.936 INFO:tasks.workunit.client.0.smithi112.stdout:3/205: symlink d8/d15/d1b/d1c/d27/d2b/l41 0 2024-09-19T09:35:17.937 INFO:tasks.workunit.client.0.smithi112.stdout:3/206: truncate d8/d15/d1b/d1c/d27/d3c/d21/f23 3135938 0 2024-09-19T09:35:17.937 INFO:tasks.workunit.client.0.smithi112.stdout:3/207: readlink l4 0 2024-09-19T09:35:17.938 INFO:tasks.workunit.client.0.smithi112.stdout:3/208: mknod d8/d15/d1b/c42 0 2024-09-19T09:35:17.939 INFO:tasks.workunit.client.0.smithi112.stdout:3/209: mkdir d8/d15/d1b/d1c/d43 0 2024-09-19T09:35:17.939 INFO:tasks.workunit.client.0.smithi112.stdout:3/210: write d8/d15/d1b/d1c/f37 [4673257,120027] 0 2024-09-19T09:35:17.939 INFO:tasks.workunit.client.0.smithi112.stdout:3/211: write d8/d15/d1b/d28/f31 [1046206,6281] 0 2024-09-19T09:35:17.939 INFO:tasks.workunit.client.0.smithi112.stdout:3/212: write d8/f30 [2566300,63734] 0 2024-09-19T09:35:17.944 INFO:tasks.workunit.client.0.smithi112.stdout:3/213: mkdir d8/d15/d1b/d1c/d27/d3c/d21/d44 0 2024-09-19T09:35:17.961 INFO:tasks.workunit.client.0.smithi112.stdout:3/214: dwrite d8/d15/d1b/d28/f31 [0,4194304] 0 2024-09-19T09:35:17.964 INFO:tasks.workunit.client.0.smithi112.stdout:3/215: rename d8/fd to d8/d15/d1b/d1c/d27/d2b/f45 0 2024-09-19T09:35:17.964 INFO:tasks.workunit.client.0.smithi112.stdout:3/216: write d8/d15/d1b/d1c/d27/d3c/d21/f23 [379987,26783] 0 2024-09-19T09:35:17.965 INFO:tasks.workunit.client.0.smithi112.stdout:3/217: link d8/d15/d1b/d1c/l1d d8/d15/d1b/d1c/d27/d3c/l46 0 2024-09-19T09:35:17.966 INFO:tasks.workunit.client.0.smithi112.stdout:3/218: creat d8/d15/d1b/d1c/d27/d3c/d33/f47 x:0 0 0 2024-09-19T09:35:17.981 INFO:tasks.workunit.client.0.smithi112.stdout:3/219: dwrite d8/d15/d1b/d1c/d27/d3c/d33/f35 [0,4194304] 0 2024-09-19T09:35:17.981 INFO:tasks.workunit.client.0.smithi112.stdout:3/220: fdatasync f6 0 2024-09-19T09:35:17.981 INFO:tasks.workunit.client.0.smithi112.stdout:3/221: readlink d8/d15/l1a 0 2024-09-19T09:35:17.985 INFO:tasks.workunit.client.0.smithi112.stdout:3/222: mkdir d8/d48 0 2024-09-19T09:35:17.987 INFO:tasks.workunit.client.0.smithi112.stdout:3/223: mkdir d8/d15/d1b/d1c/d27/d3c/d21/d44/d49 0 2024-09-19T09:35:17.988 INFO:tasks.workunit.client.0.smithi112.stdout:3/224: symlink d8/d15/d1b/d1c/d27/d3c/d21/l4a 0 2024-09-19T09:35:17.989 INFO:tasks.workunit.client.0.smithi112.stdout:3/225: symlink d8/d15/d1b/d1c/d27/d3c/d21/l4b 0 2024-09-19T09:35:17.989 INFO:tasks.workunit.client.0.smithi112.stdout:3/226: write d8/d15/d1b/d1c/d27/d3c/d21/f23 [1668568,73020] 0 2024-09-19T09:35:17.989 INFO:tasks.workunit.client.0.smithi112.stdout:3/227: rename d8 to d8/d15/d1b/d4c 22 2024-09-19T09:35:17.989 INFO:tasks.workunit.client.0.smithi112.stdout:3/228: dread - d8/d15/d1b/d1c/d27/d3c/d33/f47 zero size 2024-09-19T09:35:17.991 INFO:tasks.workunit.client.0.smithi112.stdout:3/229: creat d8/f4d x:0 0 0 2024-09-19T09:35:17.991 INFO:tasks.workunit.client.0.smithi112.stdout:3/230: stat d8/d15/d1b/d1c/d27/d3c/d21 0 2024-09-19T09:35:17.999 INFO:tasks.workunit.client.0.smithi112.stdout:3/231: dread d8/f30 [0,4194304] 0 2024-09-19T09:35:18.000 INFO:tasks.workunit.client.0.smithi112.stdout:3/232: creat d8/d15/d1b/d1c/d43/f4e x:0 0 0 2024-09-19T09:35:18.001 INFO:tasks.workunit.client.0.smithi112.stdout:3/233: unlink d8/d15/d1b/l3e 0 2024-09-19T09:35:18.002 INFO:tasks.workunit.client.0.smithi112.stdout:3/234: mkdir d8/d15/d1b/d1c/d43/d4f 0 2024-09-19T09:35:18.002 INFO:tasks.workunit.client.0.smithi112.stdout:3/235: write f6 [1941140,109826] 0 2024-09-19T09:35:18.003 INFO:tasks.workunit.client.0.smithi112.stdout:3/236: getdents d8/d15/d1b/d1c 0 2024-09-19T09:35:18.010 INFO:tasks.workunit.client.0.smithi112.stdout:3/237: dread d8/f10 [0,4194304] 0 2024-09-19T09:35:18.016 INFO:tasks.workunit.client.0.smithi112.stdout:3/238: dread d8/d15/d1b/d1c/d27/d3c/d33/f35 [0,4194304] 0 2024-09-19T09:35:18.038 INFO:tasks.workunit.client.0.smithi112.stdout:3/239: dwrite d8/f4d [0,4194304] 0 2024-09-19T09:35:18.041 INFO:tasks.workunit.client.0.smithi112.stdout:3/240: symlink d8/l50 0 2024-09-19T09:35:18.042 INFO:tasks.workunit.client.0.smithi112.stdout:3/241: mknod d8/d48/c51 0 2024-09-19T09:35:18.044 INFO:tasks.workunit.client.0.smithi112.stdout:3/242: link d8/d15/d1b/d1c/d27/d3c/d21/l4b d8/d15/l52 0 2024-09-19T09:35:18.045 INFO:tasks.workunit.client.0.smithi112.stdout:3/243: rmdir d8/d15/d1b/d1c/d27/d3c 39 2024-09-19T09:35:18.045 INFO:tasks.workunit.client.0.smithi112.stdout:3/244: stat d8/d15/d1b/d1c 0 2024-09-19T09:35:18.046 INFO:tasks.workunit.client.0.smithi112.stdout:3/245: creat d8/d15/d1b/f53 x:0 0 0 2024-09-19T09:35:18.172 INFO:tasks.workunit.client.0.smithi112.stdout:9/107: sync 2024-09-19T09:35:18.172 INFO:tasks.workunit.client.0.smithi112.stdout:4/397: sync 2024-09-19T09:35:18.172 INFO:tasks.workunit.client.0.smithi112.stdout:1/140: sync 2024-09-19T09:35:18.172 INFO:tasks.workunit.client.0.smithi112.stdout:4/398: truncate d1/d4/f32 4732753 0 2024-09-19T09:35:18.172 INFO:tasks.workunit.client.0.smithi112.stdout:4/399: fsync d1/d31/d51/f55 0 2024-09-19T09:35:18.175 INFO:tasks.workunit.client.0.smithi112.stdout:9/108: symlink df/l24 0 2024-09-19T09:35:18.175 INFO:tasks.workunit.client.0.smithi112.stdout:9/109: write fb [5109006,17113] 0 2024-09-19T09:35:18.175 INFO:tasks.workunit.client.0.smithi112.stdout:9/110: chown df/d11/d14/f1d 169848 1 2024-09-19T09:35:18.176 INFO:tasks.workunit.client.0.smithi112.stdout:1/141: mkdir dc/d26 0 2024-09-19T09:35:18.176 INFO:tasks.workunit.client.0.smithi112.stdout:1/142: truncate dc/d13/f25 917103 0 2024-09-19T09:35:18.177 INFO:tasks.workunit.client.0.smithi112.stdout:4/400: getdents d1/d3d/d41 0 2024-09-19T09:35:18.179 INFO:tasks.workunit.client.0.smithi112.stdout:1/143: mkdir dc/d26/d27 0 2024-09-19T09:35:18.179 INFO:tasks.workunit.client.0.smithi112.stdout:1/144: fsync dc/ff 0 2024-09-19T09:35:18.179 INFO:tasks.workunit.client.0.smithi112.stdout:4/401: symlink d1/d4/d3a/d7a/l90 0 2024-09-19T09:35:18.180 INFO:tasks.workunit.client.0.smithi112.stdout:1/145: dread dc/d24/f12 [0,4194304] 0 2024-09-19T09:35:18.181 INFO:tasks.workunit.client.0.smithi112.stdout:4/402: mkdir d1/d31/d71/d91 0 2024-09-19T09:35:18.182 INFO:tasks.workunit.client.0.smithi112.stdout:9/111: read fc [3908863,89096] 0 2024-09-19T09:35:18.183 INFO:tasks.workunit.client.0.smithi112.stdout:1/146: symlink dc/l28 0 2024-09-19T09:35:18.183 INFO:tasks.workunit.client.0.smithi112.stdout:1/147: write dc/f23 [501582,30800] 0 2024-09-19T09:35:18.183 INFO:tasks.workunit.client.0.smithi112.stdout:1/148: fdatasync dc/f21 0 2024-09-19T09:35:18.183 INFO:tasks.workunit.client.0.smithi112.stdout:4/403: creat d1/d4/d3a/f92 x:0 0 0 2024-09-19T09:35:18.186 INFO:tasks.workunit.client.0.smithi112.stdout:9/112: rename df/d11/d14/d19/f1c to df/d11/f25 0 2024-09-19T09:35:18.186 INFO:tasks.workunit.client.0.smithi112.stdout:1/149: creat dc/d26/f29 x:0 0 0 2024-09-19T09:35:18.187 INFO:tasks.workunit.client.0.smithi112.stdout:1/150: creat dc/f2a x:0 0 0 2024-09-19T09:35:18.188 INFO:tasks.workunit.client.0.smithi112.stdout:4/404: mkdir d1/d3d/d93 0 2024-09-19T09:35:18.189 INFO:tasks.workunit.client.0.smithi112.stdout:4/405: chown d1/d3d/d41/c2b 0 1 2024-09-19T09:35:18.189 INFO:tasks.workunit.client.0.smithi112.stdout:4/406: write d1/fd [413029,119729] 0 2024-09-19T09:35:18.189 INFO:tasks.workunit.client.0.smithi112.stdout:4/407: chown d1/d4/d3a/f78 0 1 2024-09-19T09:35:18.189 INFO:tasks.workunit.client.0.smithi112.stdout:4/408: getdents d1/d3d/d41 0 2024-09-19T09:35:18.189 INFO:tasks.workunit.client.0.smithi112.stdout:4/409: creat d1/d31/d43/d48/f94 x:0 0 0 2024-09-19T09:35:18.189 INFO:tasks.workunit.client.0.smithi112.stdout:9/113: unlink la 0 2024-09-19T09:35:18.192 INFO:tasks.workunit.client.0.smithi112.stdout:9/114: symlink df/d11/d14/d19/d1e/l26 0 2024-09-19T09:35:18.193 INFO:tasks.workunit.client.0.smithi112.stdout:9/115: unlink df/d11/d14/l21 0 2024-09-19T09:35:18.195 INFO:tasks.workunit.client.0.smithi112.stdout:9/116: creat df/d20/f27 x:0 0 0 2024-09-19T09:35:18.196 INFO:tasks.workunit.client.0.smithi112.stdout:4/410: dread d1/d4/f32 [0,4194304] 0 2024-09-19T09:35:18.196 INFO:tasks.workunit.client.0.smithi112.stdout:9/117: truncate df/f13 2530369 0 2024-09-19T09:35:18.196 INFO:tasks.workunit.client.0.smithi112.stdout:4/411: creat d1/d4/d3a/f95 x:0 0 0 2024-09-19T09:35:18.197 INFO:tasks.workunit.client.0.smithi112.stdout:9/118: dread df/d11/f25 [0,4194304] 0 2024-09-19T09:35:18.203 INFO:tasks.workunit.client.0.smithi112.stdout:9/119: dread df/d11/f15 [0,4194304] 0 2024-09-19T09:35:18.203 INFO:tasks.workunit.client.0.smithi112.stdout:9/120: write df/d20/f27 [107975,26251] 0 2024-09-19T09:35:18.205 INFO:tasks.workunit.client.0.smithi112.stdout:1/151: dwrite dc/fd [4194304,4194304] 0 2024-09-19T09:35:18.205 INFO:tasks.workunit.client.0.smithi112.stdout:9/121: dread df/d11/f15 [0,4194304] 0 2024-09-19T09:35:18.209 INFO:tasks.workunit.client.0.smithi112.stdout:4/412: dread d1/d31/d51/f2f [0,4194304] 0 2024-09-19T09:35:18.209 INFO:tasks.workunit.client.0.smithi112.stdout:4/413: readlink d1/d4/d3a/d57/l85 0 2024-09-19T09:35:18.225 INFO:tasks.workunit.client.0.smithi112.stdout:9/122: unlink df/f13 0 2024-09-19T09:35:18.226 INFO:tasks.workunit.client.0.smithi112.stdout:4/414: dwrite d1/d3d/f87 [0,4194304] 0 2024-09-19T09:35:18.226 INFO:tasks.workunit.client.0.smithi112.stdout:9/123: write fe [972346,125305] 0 2024-09-19T09:35:18.227 INFO:tasks.workunit.client.0.smithi112.stdout:4/415: mkdir d1/d31/d96 0 2024-09-19T09:35:18.229 INFO:tasks.workunit.client.0.smithi112.stdout:9/124: chown df/d11/d14/c16 6843 1 2024-09-19T09:35:18.229 INFO:tasks.workunit.client.0.smithi112.stdout:9/125: readlink l5 0 2024-09-19T09:35:18.260 INFO:tasks.workunit.client.0.smithi112.stdout:9/126: dwrite fc [0,4194304] 0 2024-09-19T09:35:18.268 INFO:tasks.workunit.client.0.smithi112.stdout:9/127: unlink fb 0 2024-09-19T09:35:18.288 INFO:tasks.workunit.client.0.smithi112.stdout:9/128: dwrite df/d11/d14/f1f [0,4194304] 0 2024-09-19T09:35:18.288 INFO:tasks.workunit.client.0.smithi112.stdout:4/416: dwrite d1/d3d/f87 [4194304,4194304] 0 2024-09-19T09:35:18.301 INFO:tasks.workunit.client.0.smithi112.stdout:4/417: write d1/d4/d3a/d7a/d7f/f3c [3003182,125970] 0 2024-09-19T09:35:18.301 INFO:tasks.workunit.client.0.smithi112.stdout:4/418: fdatasync d1/d4/f7 0 2024-09-19T09:35:18.302 INFO:tasks.workunit.client.0.smithi112.stdout:4/419: read d1/d4/f59 [623391,45112] 0 2024-09-19T09:35:18.304 INFO:tasks.workunit.client.0.smithi112.stdout:4/420: symlink d1/d31/d71/d77/l97 0 2024-09-19T09:35:18.304 INFO:tasks.workunit.client.0.smithi112.stdout:4/421: truncate d1/d31/d51/f4c 173056 0 2024-09-19T09:35:18.305 INFO:tasks.workunit.client.0.smithi112.stdout:4/422: link d1/d3d/d41/l1e d1/d31/d43/l98 0 2024-09-19T09:35:18.308 INFO:tasks.workunit.client.0.smithi112.stdout:4/423: creat d1/d31/d71/f99 x:0 0 0 2024-09-19T09:35:18.309 INFO:tasks.workunit.client.0.smithi112.stdout:9/129: dwrite fe [0,4194304] 0 2024-09-19T09:35:18.313 INFO:tasks.workunit.client.0.smithi112.stdout:4/424: creat d1/d31/f9a x:0 0 0 2024-09-19T09:35:18.313 INFO:tasks.workunit.client.0.smithi112.stdout:4/425: fdatasync d1/d4/f9 0 2024-09-19T09:35:18.314 INFO:tasks.workunit.client.0.smithi112.stdout:4/426: truncate d1/d31/d42/f65 691390 0 2024-09-19T09:35:18.314 INFO:tasks.workunit.client.0.smithi112.stdout:4/427: chown d1/d4/d3a/d57/l85 4743148 1 2024-09-19T09:35:18.318 INFO:tasks.workunit.client.0.smithi112.stdout:9/130: readlink ld 0 2024-09-19T09:35:18.319 INFO:tasks.workunit.client.0.smithi112.stdout:9/131: readlink l5 0 2024-09-19T09:35:18.322 INFO:tasks.workunit.client.0.smithi112.stdout:4/428: link d1/d31/d42/f6b d1/f9b 0 2024-09-19T09:35:18.336 INFO:tasks.workunit.client.0.smithi112.stdout:9/132: dread df/d11/d14/f1f [0,4194304] 0 2024-09-19T09:35:18.339 INFO:tasks.workunit.client.0.smithi112.stdout:4/429: write d1/d3d/d41/f67 [2134778,78248] 0 2024-09-19T09:35:18.341 INFO:tasks.workunit.client.0.smithi112.stdout:9/133: mkdir df/d11/d14/d19/d28 0 2024-09-19T09:35:18.383 INFO:tasks.workunit.client.0.smithi112.stdout:4/430: dwrite d1/d31/d51/f55 [0,4194304] 0 2024-09-19T09:35:18.384 INFO:tasks.workunit.client.0.smithi112.stdout:9/134: dwrite fc [4194304,4194304] 0 2024-09-19T09:35:18.384 INFO:tasks.workunit.client.0.smithi112.stdout:9/135: chown df/c1a 57314789 1 2024-09-19T09:35:18.387 INFO:tasks.workunit.client.0.smithi112.stdout:4/431: mknod d1/d3d/d93/c9c 0 2024-09-19T09:35:18.389 INFO:tasks.workunit.client.0.smithi112.stdout:9/136: symlink df/d20/l29 0 2024-09-19T09:35:18.390 INFO:tasks.workunit.client.0.smithi112.stdout:9/137: read f3 [3757358,8399] 0 2024-09-19T09:35:18.392 INFO:tasks.workunit.client.0.smithi112.stdout:9/138: truncate fe 2704089 0 2024-09-19T09:35:18.394 INFO:tasks.workunit.client.0.smithi112.stdout:9/139: mknod df/d11/c2a 0 2024-09-19T09:35:18.396 INFO:tasks.workunit.client.0.smithi112.stdout:9/140: symlink df/l2b 0 2024-09-19T09:35:18.399 INFO:tasks.workunit.client.0.smithi112.stdout:9/141: mknod df/d11/d14/d19/c2c 0 2024-09-19T09:35:18.400 INFO:tasks.workunit.client.0.smithi112.stdout:4/432: write d1/d3d/f61 [1100944,121043] 0 2024-09-19T09:35:18.403 INFO:tasks.workunit.client.0.smithi112.stdout:4/433: write d1/d31/d43/f74 [509486,39809] 0 2024-09-19T09:35:18.404 INFO:tasks.workunit.client.0.smithi112.stdout:5/371: sync 2024-09-19T09:35:18.406 INFO:tasks.workunit.client.0.smithi112.stdout:4/434: rmdir d1/d31/d51 39 2024-09-19T09:35:18.420 INFO:tasks.workunit.client.0.smithi112.stdout:5/372: truncate d4/d9/d17/d30/f38 1479865 0 2024-09-19T09:35:18.423 INFO:tasks.workunit.client.0.smithi112.stdout:5/373: rename d4/d9/d17/d2f/d72/d61 to d4/d84 0 2024-09-19T09:35:18.427 INFO:tasks.workunit.client.0.smithi112.stdout:4/435: dwrite d1/f6 [0,4194304] 0 2024-09-19T09:35:18.431 INFO:tasks.workunit.client.0.smithi112.stdout:4/436: symlink d1/d4/d3a/d57/d60/l9d 0 2024-09-19T09:35:18.457 INFO:tasks.workunit.client.0.smithi112.stdout:5/374: dwrite d4/d9/d17/d2f/d72/f63 [0,4194304] 0 2024-09-19T09:35:18.457 INFO:tasks.workunit.client.0.smithi112.stdout:5/375: chown d4/d9/d3e/l7e 0 1 2024-09-19T09:35:18.457 INFO:tasks.workunit.client.0.smithi112.stdout:5/376: read - d4/d9/d6b/f6d zero size 2024-09-19T09:35:18.457 INFO:tasks.workunit.client.0.smithi112.stdout:4/437: dwrite d1/d4/d3a/f5d [0,4194304] 0 2024-09-19T09:35:18.457 INFO:tasks.workunit.client.0.smithi112.stdout:5/377: symlink d4/d84/l85 0 2024-09-19T09:35:18.477 INFO:tasks.workunit.client.0.smithi112.stdout:4/438: dwrite d1/d4/f59 [0,4194304] 0 2024-09-19T09:35:18.487 INFO:tasks.workunit.client.0.smithi112.stdout:4/439: write d1/d4/f59 [3669566,92603] 0 2024-09-19T09:35:18.493 INFO:tasks.workunit.client.0.smithi112.stdout:4/440: write d1/d3d/d72/f7b [2027917,74523] 0 2024-09-19T09:35:18.513 INFO:tasks.workunit.client.0.smithi112.stdout:4/441: dwrite d1/d3d/d41/f4f [0,4194304] 0 2024-09-19T09:35:18.513 INFO:tasks.workunit.client.0.smithi112.stdout:4/442: chown d1/d31/d51/l21 55625 1 2024-09-19T09:35:18.515 INFO:tasks.workunit.client.0.smithi112.stdout:4/443: mkdir d1/d31/d96/d9e 0 2024-09-19T09:35:18.598 INFO:tasks.workunit.client.0.smithi112.stdout:0/313: sync 2024-09-19T09:35:18.619 INFO:tasks.workunit.client.0.smithi112.stdout:0/314: dwrite d2/f4e [0,4194304] 0 2024-09-19T09:35:18.623 INFO:tasks.workunit.client.0.smithi112.stdout:0/315: unlink d2/d45/l4a 0 2024-09-19T09:35:18.623 INFO:tasks.workunit.client.0.smithi112.stdout:0/316: creat d2/f5e x:0 0 0 2024-09-19T09:35:18.624 INFO:tasks.workunit.client.0.smithi112.stdout:0/317: mknod d2/d39/d58/c5f 0 2024-09-19T09:35:18.634 INFO:tasks.workunit.client.0.smithi112.stdout:0/318: read d2/d11/f1c [4117218,91422] 0 2024-09-19T09:35:18.634 INFO:tasks.workunit.client.0.smithi112.stdout:0/319: creat d2/d59/f60 x:0 0 0 2024-09-19T09:35:18.643 INFO:tasks.workunit.client.0.smithi112.stdout:0/320: write d2/f38 [625862,21852] 0 2024-09-19T09:35:18.643 INFO:tasks.workunit.client.0.smithi112.stdout:0/321: symlink d2/l61 0 2024-09-19T09:35:18.645 INFO:tasks.workunit.client.0.smithi112.stdout:0/322: symlink d2/d59/l62 0 2024-09-19T09:35:18.646 INFO:tasks.workunit.client.0.smithi112.stdout:0/323: mknod d2/d59/c63 0 2024-09-19T09:35:18.647 INFO:tasks.workunit.client.0.smithi112.stdout:0/324: mknod d2/d39/d3b/c64 0 2024-09-19T09:35:18.659 INFO:tasks.workunit.client.0.smithi112.stdout:0/325: truncate d2/f38 1529486 0 2024-09-19T09:35:18.664 INFO:tasks.workunit.client.0.smithi112.stdout:0/326: dread d2/f56 [0,4194304] 0 2024-09-19T09:35:18.664 INFO:tasks.workunit.client.0.smithi112.stdout:0/327: write d2/d39/d3b/f4b [4805081,49374] 0 2024-09-19T09:35:18.664 INFO:tasks.workunit.client.0.smithi112.stdout:0/328: fsync d2/d11/f2a 0 2024-09-19T09:35:18.664 INFO:tasks.workunit.client.0.smithi112.stdout:0/329: creat d2/d59/f65 x:0 0 0 2024-09-19T09:35:18.664 INFO:tasks.workunit.client.0.smithi112.stdout:0/330: truncate d2/d39/d3b/f4b 5902425 0 2024-09-19T09:35:18.665 INFO:tasks.workunit.client.0.smithi112.stdout:0/331: fdatasync d2/f1f 0 2024-09-19T09:35:18.682 INFO:tasks.workunit.client.0.smithi112.stdout:0/332: dwrite d2/f1b [4194304,4194304] 0 2024-09-19T09:35:18.683 INFO:tasks.workunit.client.0.smithi112.stdout:0/333: dread - d2/d45/f54 zero size 2024-09-19T09:35:18.685 INFO:tasks.workunit.client.0.smithi112.stdout:0/334: rename d2/d39/d3b/d44/c5a to d2/d39/d3b/c66 0 2024-09-19T09:35:18.685 INFO:tasks.workunit.client.0.smithi112.stdout:0/335: creat d2/f67 x:0 0 0 2024-09-19T09:35:18.686 INFO:tasks.workunit.client.0.smithi112.stdout:6/329: sync 2024-09-19T09:35:18.686 INFO:tasks.workunit.client.0.smithi112.stdout:8/373: sync 2024-09-19T09:35:18.686 INFO:tasks.workunit.client.0.smithi112.stdout:7/306: sync 2024-09-19T09:35:18.688 INFO:tasks.workunit.client.0.smithi112.stdout:0/336: mkdir d2/d68 0 2024-09-19T09:35:18.690 INFO:tasks.workunit.client.0.smithi112.stdout:7/307: truncate d2/fe 3273774 0 2024-09-19T09:35:18.692 INFO:tasks.workunit.client.0.smithi112.stdout:6/330: mkdir d8/de/d66/d6e 0 2024-09-19T09:35:18.694 INFO:tasks.workunit.client.0.smithi112.stdout:8/374: truncate d7/db/d21/d3b/d56/d4b/f5f 498262 0 2024-09-19T09:35:18.698 INFO:tasks.workunit.client.0.smithi112.stdout:0/337: creat d2/d39/d3b/d44/f69 x:0 0 0 2024-09-19T09:35:18.698 INFO:tasks.workunit.client.0.smithi112.stdout:0/338: creat d2/d39/d3b/d44/f6a x:0 0 0 2024-09-19T09:35:18.700 INFO:tasks.workunit.client.0.smithi112.stdout:6/331: creat d8/d11/d14/d3c/d4b/d60/f6f x:0 0 0 2024-09-19T09:35:18.706 INFO:tasks.workunit.client.0.smithi112.stdout:8/375: mkdir d7/db/d21/d72 0 2024-09-19T09:35:18.709 INFO:tasks.workunit.client.0.smithi112.stdout:6/332: dread f6 [0,4194304] 0 2024-09-19T09:35:18.709 INFO:tasks.workunit.client.0.smithi112.stdout:6/333: fdatasync d8/de/d18/d20/f69 0 2024-09-19T09:35:18.709 INFO:tasks.workunit.client.0.smithi112.stdout:0/339: symlink d2/d59/l6b 0 2024-09-19T09:35:18.710 INFO:tasks.workunit.client.0.smithi112.stdout:0/340: dread - d2/f67 zero size 2024-09-19T09:35:18.710 INFO:tasks.workunit.client.0.smithi112.stdout:0/341: readlink d2/d11/l5b 0 2024-09-19T09:35:18.710 INFO:tasks.workunit.client.0.smithi112.stdout:0/342: truncate d2/d45/f54 721433 0 2024-09-19T09:35:18.710 INFO:tasks.workunit.client.0.smithi112.stdout:0/343: readlink d2/d39/d3b/l43 0 2024-09-19T09:35:18.712 INFO:tasks.workunit.client.0.smithi112.stdout:8/376: creat d7/db/f73 x:0 0 0 2024-09-19T09:35:18.715 INFO:tasks.workunit.client.0.smithi112.stdout:6/334: getdents d8 0 2024-09-19T09:35:18.715 INFO:tasks.workunit.client.0.smithi112.stdout:6/335: readlink d8/d11/d14/l50 0 2024-09-19T09:35:18.717 INFO:tasks.workunit.client.0.smithi112.stdout:8/377: rmdir d7/db/d21/d3b/d56/d3c 39 2024-09-19T09:35:18.729 INFO:tasks.workunit.client.0.smithi112.stdout:8/378: dread d7/db/d21/f43 [8388608,4194304] 0 2024-09-19T09:35:18.731 INFO:tasks.workunit.client.0.smithi112.stdout:8/379: mkdir d7/d65/d74 0 2024-09-19T09:35:18.731 INFO:tasks.workunit.client.0.smithi112.stdout:8/380: chown d7/db/d21/f43 106189710 1 2024-09-19T09:35:18.731 INFO:tasks.workunit.client.0.smithi112.stdout:8/381: chown d7/d10/f25 59990 1 2024-09-19T09:35:18.732 INFO:tasks.workunit.client.0.smithi112.stdout:8/382: read d7/d10/d11/d33/f27 [1483329,79869] 0 2024-09-19T09:35:18.733 INFO:tasks.workunit.client.0.smithi112.stdout:8/383: link d7/d10/d11/d55/l60 d7/db/d21/d3b/d56/d4b/l75 0 2024-09-19T09:35:18.735 INFO:tasks.workunit.client.0.smithi112.stdout:6/336: dwrite d8/d11/d14/f57 [0,4194304] 0 2024-09-19T09:35:18.735 INFO:tasks.workunit.client.0.smithi112.stdout:6/337: write d8/f10 [965782,3098] 0 2024-09-19T09:35:18.739 INFO:tasks.workunit.client.0.smithi112.stdout:6/338: mkdir d8/de/d61/d70 0 2024-09-19T09:35:18.750 INFO:tasks.workunit.client.0.smithi112.stdout:8/384: dwrite d7/d10/f25 [0,4194304] 0 2024-09-19T09:35:18.752 INFO:tasks.workunit.client.0.smithi112.stdout:8/385: creat d7/f76 x:0 0 0 2024-09-19T09:35:18.757 INFO:tasks.workunit.client.0.smithi112.stdout:8/386: dread d7/db/d21/f43 [8388608,4194304] 0 2024-09-19T09:35:18.758 INFO:tasks.workunit.client.0.smithi112.stdout:8/387: rmdir d7/db/d21/d3b 39 2024-09-19T09:35:18.759 INFO:tasks.workunit.client.0.smithi112.stdout:8/388: dread d7/db/d21/d2e/f5e [4194304,4194304] 0 2024-09-19T09:35:18.761 INFO:tasks.workunit.client.0.smithi112.stdout:8/389: write d7/d67/f4c [521735,127663] 0 2024-09-19T09:35:18.761 INFO:tasks.workunit.client.0.smithi112.stdout:8/390: write d7/d10/f1e [1249615,112716] 0 2024-09-19T09:35:18.761 INFO:tasks.workunit.client.0.smithi112.stdout:8/391: fsync d7/db/d21/f22 0 2024-09-19T09:35:18.761 INFO:tasks.workunit.client.0.smithi112.stdout:6/339: dwrite d8/f23 [4194304,4194304] 0 2024-09-19T09:35:18.766 INFO:tasks.workunit.client.0.smithi112.stdout:8/392: link d7/db/d21/d3b/d56/d4b/l75 d7/d10/d11/d50/l77 0 2024-09-19T09:35:18.768 INFO:tasks.workunit.client.0.smithi112.stdout:6/340: symlink d8/d11/d14/d3c/d4b/d63/l71 0 2024-09-19T09:35:18.768 INFO:tasks.workunit.client.0.smithi112.stdout:6/341: write d8/f23 [9339704,107218] 0 2024-09-19T09:35:18.769 INFO:tasks.workunit.client.0.smithi112.stdout:6/342: dread d8/d11/d13/f56 [0,4194304] 0 2024-09-19T09:35:18.769 INFO:tasks.workunit.client.0.smithi112.stdout:6/343: chown d8/d11/d14/f57 911034 1 2024-09-19T09:35:18.769 INFO:tasks.workunit.client.0.smithi112.stdout:6/344: chown d8/de/d18/f29 2 1 2024-09-19T09:35:18.770 INFO:tasks.workunit.client.0.smithi112.stdout:6/345: link d8/d11/d14/d2a/f4d d8/de/d66/d6e/f72 0 2024-09-19T09:35:18.770 INFO:tasks.workunit.client.0.smithi112.stdout:6/346: chown f5 4650736 1 2024-09-19T09:35:18.772 INFO:tasks.workunit.client.0.smithi112.stdout:6/347: mkdir d8/d73 0 2024-09-19T09:35:18.772 INFO:tasks.workunit.client.0.smithi112.stdout:6/348: truncate d8/de/d66/d6e/f72 294645 0 2024-09-19T09:35:18.772 INFO:tasks.workunit.client.0.smithi112.stdout:6/349: write d8/d11/d14/d3c/d4b/d63/f38 [141021,388] 0 2024-09-19T09:35:18.774 INFO:tasks.workunit.client.0.smithi112.stdout:6/350: mknod d8/c74 0 2024-09-19T09:35:18.775 INFO:tasks.workunit.client.0.smithi112.stdout:6/351: write d8/d11/d14/d2a/f32 [1008467,100615] 0 2024-09-19T09:35:18.775 INFO:tasks.workunit.client.0.smithi112.stdout:8/393: dread d7/d10/d11/d33/f54 [0,4194304] 0 2024-09-19T09:35:18.776 INFO:tasks.workunit.client.0.smithi112.stdout:8/394: mknod d7/d65/c78 0 2024-09-19T09:35:18.776 INFO:tasks.workunit.client.0.smithi112.stdout:8/395: fdatasync d7/db/d21/d2e/f5e 0 2024-09-19T09:35:18.777 INFO:tasks.workunit.client.0.smithi112.stdout:8/396: fsync d7/d10/d11/f37 0 2024-09-19T09:35:18.777 INFO:tasks.workunit.client.0.smithi112.stdout:8/397: getdents d7/db/d21/d3b/d56/d3c 0 2024-09-19T09:35:18.783 INFO:tasks.workunit.client.0.smithi112.stdout:8/398: dread d7/d10/f16 [4194304,4194304] 0 2024-09-19T09:35:18.784 INFO:tasks.workunit.client.0.smithi112.stdout:8/399: truncate d7/d10/d11/f2b 2949672 0 2024-09-19T09:35:18.791 INFO:tasks.workunit.client.0.smithi112.stdout:6/352: dwrite d8/d11/f34 [0,4194304] 0 2024-09-19T09:35:18.793 INFO:tasks.workunit.client.0.smithi112.stdout:6/353: mknod d8/d73/c75 0 2024-09-19T09:35:18.796 INFO:tasks.workunit.client.0.smithi112.stdout:6/354: unlink d8/de/d61/l64 0 2024-09-19T09:35:18.797 INFO:tasks.workunit.client.0.smithi112.stdout:6/355: write d8/de/d66/d6e/f72 [196911,9462] 0 2024-09-19T09:35:18.799 INFO:tasks.workunit.client.0.smithi112.stdout:6/356: creat d8/d73/f76 x:0 0 0 2024-09-19T09:35:18.816 INFO:tasks.workunit.client.0.smithi112.stdout:6/357: dwrite d8/de/d18/f29 [8388608,4194304] 0 2024-09-19T09:35:18.816 INFO:tasks.workunit.client.0.smithi112.stdout:6/358: creat d8/d11/d14/d2a/f77 x:0 0 0 2024-09-19T09:35:18.825 INFO:tasks.workunit.client.0.smithi112.stdout:6/359: write d8/d11/d14/f1c [3452588,114782] 0 2024-09-19T09:35:18.826 INFO:tasks.workunit.client.0.smithi112.stdout:2/110: sync 2024-09-19T09:35:18.828 INFO:tasks.workunit.client.0.smithi112.stdout:6/360: symlink d8/de/d61/l78 0 2024-09-19T09:35:18.828 INFO:tasks.workunit.client.0.smithi112.stdout:6/361: creat d8/d11/d14/d2a/f79 x:0 0 0 2024-09-19T09:35:18.829 INFO:tasks.workunit.client.0.smithi112.stdout:2/111: rename d0/d1/d9 to d0/d1/d28 0 2024-09-19T09:35:18.829 INFO:tasks.workunit.client.0.smithi112.stdout:2/112: write d0/d1/f1c [1721311,87036] 0 2024-09-19T09:35:18.830 INFO:tasks.workunit.client.0.smithi112.stdout:6/362: rmdir d8/d11/d14/d3c 39 2024-09-19T09:35:18.831 INFO:tasks.workunit.client.0.smithi112.stdout:2/113: symlink d0/d6/l29 0 2024-09-19T09:35:18.832 INFO:tasks.workunit.client.0.smithi112.stdout:6/363: unlink d8/d11/d14/d3c/d4b/f54 0 2024-09-19T09:35:18.833 INFO:tasks.workunit.client.0.smithi112.stdout:2/114: creat d0/d1/de/d27/f2a x:0 0 0 2024-09-19T09:35:18.834 INFO:tasks.workunit.client.0.smithi112.stdout:6/364: symlink d8/d11/l7a 0 2024-09-19T09:35:18.834 INFO:tasks.workunit.client.0.smithi112.stdout:6/365: stat d8/de/d17/f22 0 2024-09-19T09:35:18.834 INFO:tasks.workunit.client.0.smithi112.stdout:6/366: chown d8/de/d18/f58 22856390 1 2024-09-19T09:35:18.836 INFO:tasks.workunit.client.0.smithi112.stdout:6/367: mkdir d8/de/d61/d70/d7b 0 2024-09-19T09:35:18.839 INFO:tasks.workunit.client.0.smithi112.stdout:6/368: link d8/l12 d8/de/d66/d6e/l7c 0 2024-09-19T09:35:18.839 INFO:tasks.workunit.client.0.smithi112.stdout:6/369: truncate d8/f16 367818 0 2024-09-19T09:35:18.839 INFO:tasks.workunit.client.0.smithi112.stdout:6/370: creat d8/d11/d14/d2a/f7d x:0 0 0 2024-09-19T09:35:18.839 INFO:tasks.workunit.client.0.smithi112.stdout:6/371: write d8/de/d18/d20/f69 [487148,110325] 0 2024-09-19T09:35:18.839 INFO:tasks.workunit.client.0.smithi112.stdout:6/372: truncate d8/de/d17/f46 749505 0 2024-09-19T09:35:18.841 INFO:tasks.workunit.client.0.smithi112.stdout:6/373: symlink d8/de/d66/l7e 0 2024-09-19T09:35:18.843 INFO:tasks.workunit.client.0.smithi112.stdout:6/374: dread d8/d11/d14/f47 [4194304,4194304] 0 2024-09-19T09:35:18.845 INFO:tasks.workunit.client.0.smithi112.stdout:6/375: rename d8/de/d17/f1e to d8/d11/d13/f7f 0 2024-09-19T09:35:18.847 INFO:tasks.workunit.client.0.smithi112.stdout:2/115: dwrite d0/d1/f22 [0,4194304] 0 2024-09-19T09:35:18.852 INFO:tasks.workunit.client.0.smithi112.stdout:2/116: symlink d0/d1/de/d27/l2b 0 2024-09-19T09:35:18.852 INFO:tasks.workunit.client.0.smithi112.stdout:2/117: chown d0/d6/l21 4 1 2024-09-19T09:35:18.853 INFO:tasks.workunit.client.0.smithi112.stdout:2/118: symlink d0/l2c 0 2024-09-19T09:35:18.853 INFO:tasks.workunit.client.0.smithi112.stdout:2/119: fsync d0/d6/d24/f26 0 2024-09-19T09:35:18.854 INFO:tasks.workunit.client.0.smithi112.stdout:2/120: rmdir d0/d1/de/d15 0 2024-09-19T09:35:18.854 INFO:tasks.workunit.client.0.smithi112.stdout:2/121: chown d0/d1/f1c 599 1 2024-09-19T09:35:18.861 INFO:tasks.workunit.client.0.smithi112.stdout:6/376: truncate d8/de/d17/f46 4174 0 2024-09-19T09:35:18.861 INFO:tasks.workunit.client.0.smithi112.stdout:6/377: dread - d8/d11/d14/d2a/f79 zero size 2024-09-19T09:35:18.862 INFO:tasks.workunit.client.0.smithi112.stdout:2/122: dread d0/d1/de/f11 [0,4194304] 0 2024-09-19T09:35:18.864 INFO:tasks.workunit.client.0.smithi112.stdout:2/123: read d0/d6/fc [1201068,45333] 0 2024-09-19T09:35:18.864 INFO:tasks.workunit.client.0.smithi112.stdout:6/378: link d8/d11/d14/d3c/f59 d8/de/f80 0 2024-09-19T09:35:18.866 INFO:tasks.workunit.client.0.smithi112.stdout:6/379: mknod d8/d11/d14/d2a/c81 0 2024-09-19T09:35:18.869 INFO:tasks.workunit.client.0.smithi112.stdout:6/380: mkdir d8/de/d18/d82 0 2024-09-19T09:35:18.872 INFO:tasks.workunit.client.0.smithi112.stdout:6/381: mkdir d8/de/d18/d20/d83 0 2024-09-19T09:35:18.874 INFO:tasks.workunit.client.0.smithi112.stdout:6/382: mknod d8/d11/d14/d3c/d4b/d63/c84 0 2024-09-19T09:35:18.876 INFO:tasks.workunit.client.0.smithi112.stdout:6/383: symlink d8/de/d17/l85 0 2024-09-19T09:35:18.876 INFO:tasks.workunit.client.0.smithi112.stdout:6/384: dread - d8/d73/f76 zero size 2024-09-19T09:35:18.876 INFO:tasks.workunit.client.0.smithi112.stdout:6/385: chown d8/d11/f34 491113048 1 2024-09-19T09:35:18.876 INFO:tasks.workunit.client.0.smithi112.stdout:6/386: chown d8/d11/d14/d3c/d4b/d63/c84 972 1 2024-09-19T09:35:18.880 INFO:tasks.workunit.client.0.smithi112.stdout:2/124: dwrite d0/d6/fa [0,4194304] 0 2024-09-19T09:35:18.882 INFO:tasks.workunit.client.0.smithi112.stdout:2/125: getdents d0/d6/d24 0 2024-09-19T09:35:18.882 INFO:tasks.workunit.client.0.smithi112.stdout:2/126: write d0/d1/de/d27/f2a [596274,113552] 0 2024-09-19T09:35:18.889 INFO:tasks.workunit.client.0.smithi112.stdout:2/127: dread d0/d6/f1d [0,4194304] 0 2024-09-19T09:35:18.893 INFO:tasks.workunit.client.0.smithi112.stdout:6/387: dwrite d8/de/d18/f28 [0,4194304] 0 2024-09-19T09:35:18.900 INFO:tasks.workunit.client.0.smithi112.stdout:2/128: dread d0/d1/de/f11 [0,4194304] 0 2024-09-19T09:35:18.900 INFO:tasks.workunit.client.0.smithi112.stdout:2/129: chown d0/d1/l25 106 1 2024-09-19T09:35:18.900 INFO:tasks.workunit.client.0.smithi112.stdout:2/130: chown d0/d1/l3 273 1 2024-09-19T09:35:18.901 INFO:tasks.workunit.client.0.smithi112.stdout:6/388: dread d8/f23 [0,4194304] 0 2024-09-19T09:35:18.901 INFO:tasks.workunit.client.0.smithi112.stdout:2/131: rename d0/c13 to d0/d1/de/c2d 0 2024-09-19T09:35:18.902 INFO:tasks.workunit.client.0.smithi112.stdout:2/132: fsync d0/d1/f7 0 2024-09-19T09:35:18.902 INFO:tasks.workunit.client.0.smithi112.stdout:6/389: mkdir d8/de/d61/d70/d86 0 2024-09-19T09:35:18.903 INFO:tasks.workunit.client.0.smithi112.stdout:2/133: creat d0/f2e x:0 0 0 2024-09-19T09:35:18.904 INFO:tasks.workunit.client.0.smithi112.stdout:6/390: fsync d8/de/d66/d6e/f72 0 2024-09-19T09:35:18.904 INFO:tasks.workunit.client.0.smithi112.stdout:6/391: stat d8/de/d18/f29 0 2024-09-19T09:35:18.904 INFO:tasks.workunit.client.0.smithi112.stdout:6/392: stat l4 0 2024-09-19T09:35:18.914 INFO:tasks.workunit.client.0.smithi112.stdout:2/134: dread d0/d6/fa [0,4194304] 0 2024-09-19T09:35:18.922 INFO:tasks.workunit.client.0.smithi112.stdout:2/135: dread d0/d6/fb [0,4194304] 0 2024-09-19T09:35:18.922 INFO:tasks.workunit.client.0.smithi112.stdout:2/136: read d0/d1/d28/f10 [2385953,87242] 0 2024-09-19T09:35:18.930 INFO:tasks.workunit.client.0.smithi112.stdout:2/137: write d0/d1/f22 [393172,3438] 0 2024-09-19T09:35:18.946 INFO:tasks.workunit.client.0.smithi112.stdout:2/138: dwrite d0/f2e [0,4194304] 0 2024-09-19T09:35:18.949 INFO:tasks.workunit.client.0.smithi112.stdout:2/139: symlink d0/d1/de/l2f 0 2024-09-19T09:35:18.949 INFO:tasks.workunit.client.0.smithi112.stdout:2/140: creat d0/d1/de/d27/f30 x:0 0 0 2024-09-19T09:35:18.962 INFO:tasks.workunit.client.0.smithi112.stdout:2/141: dwrite d0/d6/fc [0,4194304] 0 2024-09-19T09:35:18.976 INFO:tasks.workunit.client.0.smithi112.stdout:2/142: dwrite d0/d6/f1d [0,4194304] 0 2024-09-19T09:35:18.977 INFO:tasks.workunit.client.0.smithi112.stdout:2/143: unlink d0/d6/d24/f26 0 2024-09-19T09:35:18.990 INFO:tasks.workunit.client.0.smithi112.stdout:2/144: dwrite d0/d1/fd [0,4194304] 0 2024-09-19T09:35:19.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:18 smithi112 ceph-mon[27605]: pgmap v21: 65 pgs: 65 active+clean; 2.3 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 158 MiB/s rd, 197 MiB/s wr, 307 op/s 2024-09-19T09:35:19.225 INFO:tasks.workunit.client.0.smithi112.stdout:3/246: sync 2024-09-19T09:35:19.249 INFO:tasks.workunit.client.0.smithi112.stdout:3/247: dwrite d8/d15/d1b/d1c/d27/d3c/d33/f35 [0,4194304] 0 2024-09-19T09:35:19.250 INFO:tasks.workunit.client.0.smithi112.stdout:3/248: symlink d8/d48/l54 0 2024-09-19T09:35:19.253 INFO:tasks.workunit.client.0.smithi112.stdout:3/249: creat d8/d15/d1b/d1c/f55 x:0 0 0 2024-09-19T09:35:19.253 INFO:tasks.workunit.client.0.smithi112.stdout:3/250: chown d8/d15/d1b/d1c/d27/d3c/d21/l38 3037 1 2024-09-19T09:35:19.253 INFO:tasks.workunit.client.0.smithi112.stdout:3/251: fsync f6 0 2024-09-19T09:35:19.260 INFO:tasks.workunit.client.0.smithi112.stdout:3/252: dread d8/d15/d1b/d1c/d27/d2b/f45 [0,4194304] 0 2024-09-19T09:35:19.280 INFO:tasks.workunit.client.0.smithi112.stdout:3/253: rmdir d8/d15/d1b 39 2024-09-19T09:35:19.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:18 smithi191 ceph-mon[34834]: pgmap v21: 65 pgs: 65 active+clean; 2.3 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 158 MiB/s rd, 197 MiB/s wr, 307 op/s 2024-09-19T09:35:19.295 INFO:tasks.workunit.client.0.smithi112.stdout:3/254: dread d8/ff [0,4194304] 0 2024-09-19T09:35:19.318 INFO:tasks.workunit.client.0.smithi112.stdout:3/255: dwrite d8/d15/d1b/d1c/f37 [4194304,4194304] 0 2024-09-19T09:35:19.326 INFO:tasks.workunit.client.0.smithi112.stdout:3/256: write d8/d15/d1b/d28/f31 [2655741,20912] 0 2024-09-19T09:35:19.327 INFO:tasks.workunit.client.0.smithi112.stdout:3/257: write f6 [3304545,78719] 0 2024-09-19T09:35:19.329 INFO:tasks.workunit.client.0.smithi112.stdout:3/258: rename d8/d15/d1b/d1c/d27/d3c/c3d to d8/d15/d1b/d1c/d27/d2b/c56 0 2024-09-19T09:35:19.331 INFO:tasks.workunit.client.0.smithi112.stdout:3/259: creat d8/d15/d1b/d1c/d27/d3c/d33/f57 x:0 0 0 2024-09-19T09:35:19.331 INFO:tasks.workunit.client.0.smithi112.stdout:3/260: write d8/d15/d1b/d1c/d27/d3c/d33/f57 [544807,94736] 0 2024-09-19T09:35:19.331 INFO:tasks.workunit.client.0.smithi112.stdout:3/261: chown l3 436 1 2024-09-19T09:35:19.333 INFO:tasks.workunit.client.0.smithi112.stdout:3/262: truncate d8/d15/f29 270730 0 2024-09-19T09:35:19.354 INFO:tasks.workunit.client.0.smithi112.stdout:3/263: dwrite d8/d15/d1b/d1c/d27/d3c/d33/f57 [0,4194304] 0 2024-09-19T09:35:19.357 INFO:tasks.workunit.client.0.smithi112.stdout:3/264: creat d8/d15/d1b/d1c/d27/d3c/f58 x:0 0 0 2024-09-19T09:35:19.361 INFO:tasks.workunit.client.0.smithi112.stdout:3/265: rename d8/d15/d1b/d1c/d27/d3c/d21 to d8/d15/d1b/d1c/d27/d3c/d33/d59 0 2024-09-19T09:35:19.361 INFO:tasks.workunit.client.0.smithi112.stdout:3/266: creat d8/d15/f5a x:0 0 0 2024-09-19T09:35:19.361 INFO:tasks.workunit.client.0.smithi112.stdout:3/267: creat d8/d15/d1b/d1c/d27/d3c/f5b x:0 0 0 2024-09-19T09:35:19.361 INFO:tasks.workunit.client.0.smithi112.stdout:3/268: chown d8/d15/d1b/d28/c39 447215 1 2024-09-19T09:35:19.361 INFO:tasks.workunit.client.0.smithi112.stdout:3/269: fdatasync d8/d15/d1b/d1c/d27/d3c/d33/f57 0 2024-09-19T09:35:19.366 INFO:tasks.workunit.client.0.smithi112.stdout:3/270: creat d8/d15/d1b/d1c/d27/d2b/f5c x:0 0 0 2024-09-19T09:35:19.367 INFO:tasks.workunit.client.0.smithi112.stdout:1/152: sync 2024-09-19T09:35:19.369 INFO:tasks.workunit.client.0.smithi112.stdout:3/271: mkdir d8/d15/d1b/d1c/d27/d3c/d33/d59/d44/d49/d5d 0 2024-09-19T09:35:19.370 INFO:tasks.workunit.client.0.smithi112.stdout:1/153: symlink dc/l2b 0 2024-09-19T09:35:19.371 INFO:tasks.workunit.client.0.smithi112.stdout:1/154: dread dc/d24/f12 [0,4194304] 0 2024-09-19T09:35:19.373 INFO:tasks.workunit.client.0.smithi112.stdout:3/272: truncate d8/d15/d1b/d28/f31 3835453 0 2024-09-19T09:35:19.375 INFO:tasks.workunit.client.0.smithi112.stdout:1/155: mknod dc/d13/c2c 0 2024-09-19T09:35:19.380 INFO:tasks.workunit.client.0.smithi112.stdout:1/156: creat dc/d24/f2d x:0 0 0 2024-09-19T09:35:19.383 INFO:tasks.workunit.client.0.smithi112.stdout:1/157: symlink dc/l2e 0 2024-09-19T09:35:19.385 INFO:tasks.workunit.client.0.smithi112.stdout:3/273: rename d8/d15/d1b/d28/f31 to d8/d15/d1b/d1c/d27/d3c/f5e 0 2024-09-19T09:35:19.385 INFO:tasks.workunit.client.0.smithi112.stdout:3/274: write d8/d15/d1b/d1c/d27/d3c/f58 [340006,50051] 0 2024-09-19T09:35:19.385 INFO:tasks.workunit.client.0.smithi112.stdout:3/275: write d8/d15/d1b/d1c/d27/d3c/d33/f35 [4299773,34622] 0 2024-09-19T09:35:19.388 INFO:tasks.workunit.client.0.smithi112.stdout:3/276: creat d8/d15/d1b/d1c/d43/d4f/f5f x:0 0 0 2024-09-19T09:35:19.391 INFO:tasks.workunit.client.0.smithi112.stdout:1/158: getdents dc 0 2024-09-19T09:35:19.391 INFO:tasks.workunit.client.0.smithi112.stdout:1/159: write dc/f21 [708010,69957] 0 2024-09-19T09:35:19.395 INFO:tasks.workunit.client.0.smithi112.stdout:1/160: symlink dc/d13/l2f 0 2024-09-19T09:35:19.396 INFO:tasks.workunit.client.0.smithi112.stdout:3/277: symlink d8/l60 0 2024-09-19T09:35:19.397 INFO:tasks.workunit.client.0.smithi112.stdout:1/161: rename dc/d26/d27 to dc/d30 0 2024-09-19T09:35:19.398 INFO:tasks.workunit.client.0.smithi112.stdout:1/162: fsync dc/d24/f15 0 2024-09-19T09:35:19.400 INFO:tasks.workunit.client.0.smithi112.stdout:3/278: mknod d8/c61 0 2024-09-19T09:35:19.405 INFO:tasks.workunit.client.0.smithi112.stdout:3/279: dread d8/d15/d1b/d1c/d27/d3c/f58 [0,4194304] 0 2024-09-19T09:35:19.408 INFO:tasks.workunit.client.0.smithi112.stdout:3/280: getdents d8/d15/d1b/d1c/d27/d2b 0 2024-09-19T09:35:19.408 INFO:tasks.workunit.client.0.smithi112.stdout:3/281: write d8/d15/d1b/f53 [984288,14655] 0 2024-09-19T09:35:19.410 INFO:tasks.workunit.client.0.smithi112.stdout:3/282: rmdir d8/d15/d1b/d1c/d43 39 2024-09-19T09:35:19.413 INFO:tasks.workunit.client.0.smithi112.stdout:3/283: unlink d8/d15/d1b/l3a 0 2024-09-19T09:35:19.415 INFO:tasks.workunit.client.0.smithi112.stdout:3/284: unlink d8/d15/d1b/d1c/d27/d3c/d33/d59/f23 0 2024-09-19T09:35:19.415 INFO:tasks.workunit.client.0.smithi112.stdout:3/285: dread - d8/d15/d1b/d1c/d27/d3c/d33/f47 zero size 2024-09-19T09:35:19.415 INFO:tasks.workunit.client.0.smithi112.stdout:1/163: dwrite f2 [0,4194304] 0 2024-09-19T09:35:19.415 INFO:tasks.workunit.client.0.smithi112.stdout:1/164: chown l5 7455305 1 2024-09-19T09:35:19.415 INFO:tasks.workunit.client.0.smithi112.stdout:1/165: chown dc/d24/c11 29 1 2024-09-19T09:35:19.415 INFO:tasks.workunit.client.0.smithi112.stdout:1/166: write f8 [7484574,39787] 0 2024-09-19T09:35:19.416 INFO:tasks.workunit.client.0.smithi112.stdout:3/286: mkdir d8/d15/d1b/d1c/d27/d62 0 2024-09-19T09:35:19.416 INFO:tasks.workunit.client.0.smithi112.stdout:3/287: fdatasync d8/f17 0 2024-09-19T09:35:19.417 INFO:tasks.workunit.client.0.smithi112.stdout:3/288: mkdir d8/d15/d1b/d1c/d27/d3c/d33/d59/d44/d49/d63 0 2024-09-19T09:35:19.417 INFO:tasks.workunit.client.0.smithi112.stdout:3/289: readlink d8/d48/l54 0 2024-09-19T09:35:19.419 INFO:tasks.workunit.client.0.smithi112.stdout:3/290: rename d8/d15/d1b/d1c/d27/d2b/c56 to d8/d15/d1b/d1c/d27/d3c/d33/d59/d44/d49/c64 0 2024-09-19T09:35:19.422 INFO:tasks.workunit.client.0.smithi112.stdout:3/291: truncate d8/f4d 835238 0 2024-09-19T09:35:19.422 INFO:tasks.workunit.client.0.smithi112.stdout:3/292: fdatasync d8/d15/d1b/d1c/d43/d4f/f5f 0 2024-09-19T09:35:19.422 INFO:tasks.workunit.client.0.smithi112.stdout:3/293: readlink l3 0 2024-09-19T09:35:19.423 INFO:tasks.workunit.client.0.smithi112.stdout:3/294: creat d8/d15/d1b/d1c/d27/d3c/d33/d59/d44/d49/d5d/f65 x:0 0 0 2024-09-19T09:35:19.425 INFO:tasks.workunit.client.0.smithi112.stdout:3/295: mkdir d8/d15/d1b/d1c/d27/d3c/d33/d66 0 2024-09-19T09:35:19.425 INFO:tasks.workunit.client.0.smithi112.stdout:3/296: truncate d8/d15/d1b/d1c/d27/d2b/f5c 985689 0 2024-09-19T09:35:19.627 INFO:tasks.workunit.client.0.smithi112.stdout:6/393: sync 2024-09-19T09:35:19.627 INFO:tasks.workunit.client.0.smithi112.stdout:5/378: sync 2024-09-19T09:35:19.627 INFO:tasks.workunit.client.0.smithi112.stdout:9/142: sync 2024-09-19T09:35:19.627 INFO:tasks.workunit.client.0.smithi112.stdout:8/400: sync 2024-09-19T09:35:19.627 INFO:tasks.workunit.client.0.smithi112.stdout:2/145: sync 2024-09-19T09:35:19.627 INFO:tasks.workunit.client.0.smithi112.stdout:9/143: creat df/d11/d14/f2d x:0 0 0 2024-09-19T09:35:19.627 INFO:tasks.workunit.client.0.smithi112.stdout:4/444: sync 2024-09-19T09:35:19.627 INFO:tasks.workunit.client.0.smithi112.stdout:7/308: sync 2024-09-19T09:35:19.627 INFO:tasks.workunit.client.0.smithi112.stdout:0/344: sync 2024-09-19T09:35:19.627 INFO:tasks.workunit.client.0.smithi112.stdout:7/309: chown d2/d2c/d54/d18/d39/d23/l4f 7 1 2024-09-19T09:35:19.630 INFO:tasks.workunit.client.0.smithi112.stdout:2/146: creat d0/d1/d28/f31 x:0 0 0 2024-09-19T09:35:19.631 INFO:tasks.workunit.client.0.smithi112.stdout:9/144: rename df/d11/f15 to df/d11/d14/f2e 0 2024-09-19T09:35:19.636 INFO:tasks.workunit.client.0.smithi112.stdout:4/445: symlink d1/d4/d3a/d57/d62/d88/l9f 0 2024-09-19T09:35:19.636 INFO:tasks.workunit.client.0.smithi112.stdout:4/446: chown d1/d3d/f61 51 1 2024-09-19T09:35:19.636 INFO:tasks.workunit.client.0.smithi112.stdout:4/447: truncate d1/d31/d43/d48/d5c/f8f 226640 0 2024-09-19T09:35:19.637 INFO:tasks.workunit.client.0.smithi112.stdout:8/401: write d7/d10/d11/d33/f54 [2678524,91667] 0 2024-09-19T09:35:19.638 INFO:tasks.workunit.client.0.smithi112.stdout:6/394: write f5 [3715245,14738] 0 2024-09-19T09:35:19.638 INFO:tasks.workunit.client.0.smithi112.stdout:6/395: truncate d8/d11/d14/d3c/f59 4365764 0 2024-09-19T09:35:19.639 INFO:tasks.workunit.client.0.smithi112.stdout:7/310: symlink d2/d2c/d54/d18/d39/d21/l6a 0 2024-09-19T09:35:19.641 INFO:tasks.workunit.client.0.smithi112.stdout:0/345: dread d2/f49 [0,4194304] 0 2024-09-19T09:35:19.641 INFO:tasks.workunit.client.0.smithi112.stdout:0/346: truncate d2/d45/f4d 1172747 0 2024-09-19T09:35:19.641 INFO:tasks.workunit.client.0.smithi112.stdout:5/379: mknod d4/d9/d17/d2f/c86 0 2024-09-19T09:35:19.642 INFO:tasks.workunit.client.0.smithi112.stdout:5/380: dread - d4/d9/d2a/d69/f79 zero size 2024-09-19T09:35:19.642 INFO:tasks.workunit.client.0.smithi112.stdout:9/145: symlink df/d11/l2f 0 2024-09-19T09:35:19.644 INFO:tasks.workunit.client.0.smithi112.stdout:4/448: rename d1/d3d/d41/f52 to d1/d31/d71/d91/fa0 0 2024-09-19T09:35:19.645 INFO:tasks.workunit.client.0.smithi112.stdout:8/402: truncate d7/db/d21/f2a 2897620 0 2024-09-19T09:35:19.647 INFO:tasks.workunit.client.0.smithi112.stdout:6/396: link d8/cc d8/de/d17/d49/c87 0 2024-09-19T09:35:19.647 INFO:tasks.workunit.client.0.smithi112.stdout:0/347: symlink d2/d39/d3b/d44/l6c 0 2024-09-19T09:35:19.648 INFO:tasks.workunit.client.0.smithi112.stdout:0/348: truncate d2/d39/d3b/d44/f6a 538743 0 2024-09-19T09:35:19.648 INFO:tasks.workunit.client.0.smithi112.stdout:2/147: dwrite d0/d1/fd [0,4194304] 0 2024-09-19T09:35:19.649 INFO:tasks.workunit.client.0.smithi112.stdout:5/381: mknod d4/d9/d17/d2f/d7d/c87 0 2024-09-19T09:35:19.651 INFO:tasks.workunit.client.0.smithi112.stdout:7/311: rename d2/d2c/d54/d18/d39/d21/d4e/c53 to d2/d2c/d54/d18/d39/d21/d45/d4d/c6b 0 2024-09-19T09:35:19.652 INFO:tasks.workunit.client.0.smithi112.stdout:4/449: symlink d1/d31/la1 0 2024-09-19T09:35:19.653 INFO:tasks.workunit.client.0.smithi112.stdout:6/397: symlink d8/d11/d14/d2a/l88 0 2024-09-19T09:35:19.656 INFO:tasks.workunit.client.0.smithi112.stdout:7/312: mknod d2/d2c/d54/d18/d39/d21/c6c 0 2024-09-19T09:35:19.656 INFO:tasks.workunit.client.0.smithi112.stdout:7/313: chown d2/d2c/d54/c67 14034769 1 2024-09-19T09:35:19.656 INFO:tasks.workunit.client.0.smithi112.stdout:0/349: write d2/f1f [8311784,62644] 0 2024-09-19T09:35:19.657 INFO:tasks.workunit.client.0.smithi112.stdout:0/350: readlink d2/d11/l2d 0 2024-09-19T09:35:19.657 INFO:tasks.workunit.client.0.smithi112.stdout:7/314: dread d2/d2c/d54/d18/d39/d21/f2e [0,4194304] 0 2024-09-19T09:35:19.657 INFO:tasks.workunit.client.0.smithi112.stdout:7/315: write d2/d2c/f5d [478864,123946] 0 2024-09-19T09:35:19.658 INFO:tasks.workunit.client.0.smithi112.stdout:6/398: mknod d8/d11/d14/d3c/c89 0 2024-09-19T09:35:19.660 INFO:tasks.workunit.client.0.smithi112.stdout:9/146: rename c9 to df/c30 0 2024-09-19T09:35:19.662 INFO:tasks.workunit.client.0.smithi112.stdout:4/450: rename d1/d4/d3a/d57/d60/c70 to d1/d4/d3a/d57/d60/ca2 0 2024-09-19T09:35:19.663 INFO:tasks.workunit.client.0.smithi112.stdout:7/316: unlink d2/f9 0 2024-09-19T09:35:19.664 INFO:tasks.workunit.client.0.smithi112.stdout:2/148: rename d0/l2c to d0/d1/d28/l32 0 2024-09-19T09:35:19.665 INFO:tasks.workunit.client.0.smithi112.stdout:8/403: dwrite d7/d10/f1e [0,4194304] 0 2024-09-19T09:35:19.665 INFO:tasks.workunit.client.0.smithi112.stdout:9/147: mknod df/d11/d14/d19/d1e/c31 0 2024-09-19T09:35:19.668 INFO:tasks.workunit.client.0.smithi112.stdout:4/451: mknod d1/d4/d3a/d57/d62/ca3 0 2024-09-19T09:35:19.670 INFO:tasks.workunit.client.0.smithi112.stdout:6/399: dread d8/de/d18/f28 [0,4194304] 0 2024-09-19T09:35:19.671 INFO:tasks.workunit.client.0.smithi112.stdout:6/400: stat d8/f23 0 2024-09-19T09:35:19.671 INFO:tasks.workunit.client.0.smithi112.stdout:5/382: rename d4/d29/d4c to d4/d9/d2a/d39/d88 0 2024-09-19T09:35:19.671 INFO:tasks.workunit.client.0.smithi112.stdout:7/317: rename d2/d2c/d54/d18/d39/d23/d35 to d2/d2c/d54/d18/d39/d23/d35/d6d 22 2024-09-19T09:35:19.671 INFO:tasks.workunit.client.0.smithi112.stdout:7/318: fdatasync d2/d2c/d54/d1a/f3d 0 2024-09-19T09:35:19.673 INFO:tasks.workunit.client.0.smithi112.stdout:2/149: mknod d0/d6/d24/c33 0 2024-09-19T09:35:19.675 INFO:tasks.workunit.client.0.smithi112.stdout:9/148: creat df/d11/d14/d19/d28/f32 x:0 0 0 2024-09-19T09:35:19.677 INFO:tasks.workunit.client.0.smithi112.stdout:8/404: rename d7/d65/d74 to d7/db/d21/d3b/d56/d3c/d79 0 2024-09-19T09:35:19.678 INFO:tasks.workunit.client.0.smithi112.stdout:5/383: truncate d4/d29/f3c 7335483 0 2024-09-19T09:35:19.679 INFO:tasks.workunit.client.0.smithi112.stdout:7/319: creat d2/d2c/d54/d18/d39/d21/d45/d4d/f6e x:0 0 0 2024-09-19T09:35:19.680 INFO:tasks.workunit.client.0.smithi112.stdout:9/149: creat df/d11/d14/d19/f33 x:0 0 0 2024-09-19T09:35:19.682 INFO:tasks.workunit.client.0.smithi112.stdout:8/405: rmdir d7/d10/d11/d62 39 2024-09-19T09:35:19.682 INFO:tasks.workunit.client.0.smithi112.stdout:8/406: creat d7/d10/d11/d33/f7a x:0 0 0 2024-09-19T09:35:19.683 INFO:tasks.workunit.client.0.smithi112.stdout:9/150: truncate df/d11/d14/f1f 1746079 0 2024-09-19T09:35:19.683 INFO:tasks.workunit.client.0.smithi112.stdout:9/151: write df/d11/d14/f2d [641841,39797] 0 2024-09-19T09:35:19.687 INFO:tasks.workunit.client.0.smithi112.stdout:6/401: rename d8/d11/d14/d3c/d4b/d60 to d8/de/d61/d70/d7b/d8a 0 2024-09-19T09:35:19.689 INFO:tasks.workunit.client.0.smithi112.stdout:6/402: creat d8/f8b x:0 0 0 2024-09-19T09:35:19.690 INFO:tasks.workunit.client.0.smithi112.stdout:2/150: dread d0/d1/fd [0,4194304] 0 2024-09-19T09:35:19.692 INFO:tasks.workunit.client.0.smithi112.stdout:4/452: dwrite d1/f17 [0,4194304] 0 2024-09-19T09:35:19.692 INFO:tasks.workunit.client.0.smithi112.stdout:6/403: rename d8/de/d18/c4e to d8/d11/d14/d3c/d4b/c8c 0 2024-09-19T09:35:19.694 INFO:tasks.workunit.client.0.smithi112.stdout:7/320: dread d2/d49/f5a [0,4194304] 0 2024-09-19T09:35:19.697 INFO:tasks.workunit.client.0.smithi112.stdout:7/321: mknod d2/d2c/d54/d18/d39/d21/d45/c6f 0 2024-09-19T09:35:19.699 INFO:tasks.workunit.client.0.smithi112.stdout:6/404: getdents d8/de/d18/d20 0 2024-09-19T09:35:19.702 INFO:tasks.workunit.client.0.smithi112.stdout:8/407: dread d7/d10/d11/f37 [0,4194304] 0 2024-09-19T09:35:19.704 INFO:tasks.workunit.client.0.smithi112.stdout:8/408: unlink d7/db/d21/f43 0 2024-09-19T09:35:19.704 INFO:tasks.workunit.client.0.smithi112.stdout:8/409: write d7/db/d21/d3b/d56/d4b/d5b/f6d [860146,112575] 0 2024-09-19T09:35:19.711 INFO:tasks.workunit.client.0.smithi112.stdout:8/410: dread d7/db/d21/f4e [0,4194304] 0 2024-09-19T09:35:19.712 INFO:tasks.workunit.client.0.smithi112.stdout:8/411: mkdir d7/d10/d11/d50/d7b 0 2024-09-19T09:35:19.713 INFO:tasks.workunit.client.0.smithi112.stdout:5/384: dwrite d4/d9/d17/d2f/f32 [0,4194304] 0 2024-09-19T09:35:19.717 INFO:tasks.workunit.client.0.smithi112.stdout:2/151: dwrite d0/d6/f1d [0,4194304] 0 2024-09-19T09:35:19.717 INFO:tasks.workunit.client.0.smithi112.stdout:9/152: dwrite df/d11/d14/d19/f33 [0,4194304] 0 2024-09-19T09:35:19.717 INFO:tasks.workunit.client.0.smithi112.stdout:9/153: fdatasync fe 0 2024-09-19T09:35:19.720 INFO:tasks.workunit.client.0.smithi112.stdout:5/385: rename d4/d9/d2a/d69/f79 to d4/d9/d17/d30/f89 0 2024-09-19T09:35:19.720 INFO:tasks.workunit.client.0.smithi112.stdout:6/405: dread d8/f23 [4194304,4194304] 0 2024-09-19T09:35:19.720 INFO:tasks.workunit.client.0.smithi112.stdout:5/386: truncate d4/d3f/f6c 678640 0 2024-09-19T09:35:19.720 INFO:tasks.workunit.client.0.smithi112.stdout:5/387: fsync d4/d9/d17/d2f/d72/f41 0 2024-09-19T09:35:19.721 INFO:tasks.workunit.client.0.smithi112.stdout:7/322: dread d2/d2c/d54/d18/d39/d21/d45/d4d/f68 [0,4194304] 0 2024-09-19T09:35:19.721 INFO:tasks.workunit.client.0.smithi112.stdout:7/323: truncate d2/d2c/d54/d18/d39/d23/f52 704977 0 2024-09-19T09:35:19.724 INFO:tasks.workunit.client.0.smithi112.stdout:9/154: creat df/d11/d14/d19/d1e/f34 x:0 0 0 2024-09-19T09:35:19.725 INFO:tasks.workunit.client.0.smithi112.stdout:6/406: write d8/d11/f43 [169529,104489] 0 2024-09-19T09:35:19.731 INFO:tasks.workunit.client.0.smithi112.stdout:7/324: mkdir d2/d2c/d54/d18/d39/d23/d35/d4c/d70 0 2024-09-19T09:35:19.732 INFO:tasks.workunit.client.0.smithi112.stdout:5/388: write d4/d9/d2a/d39/f3a [4157826,94343] 0 2024-09-19T09:35:19.732 INFO:tasks.workunit.client.0.smithi112.stdout:5/389: fdatasync d4/d3f/f6c 0 2024-09-19T09:35:19.732 INFO:tasks.workunit.client.0.smithi112.stdout:5/390: chown d4/d9/d17/d2f/d72/l24 38573 1 2024-09-19T09:35:19.733 INFO:tasks.workunit.client.0.smithi112.stdout:4/453: dwrite d1/d31/d43/d48/d5c/f84 [0,4194304] 0 2024-09-19T09:35:19.733 INFO:tasks.workunit.client.0.smithi112.stdout:4/454: stat d1/d31/d43/f74 0 2024-09-19T09:35:19.734 INFO:tasks.workunit.client.0.smithi112.stdout:2/152: dwrite d0/d1/fd [0,4194304] 0 2024-09-19T09:35:19.736 INFO:tasks.workunit.client.0.smithi112.stdout:9/155: mkdir df/d35 0 2024-09-19T09:35:19.736 INFO:tasks.workunit.client.0.smithi112.stdout:9/156: dread - df/d11/d14/d19/d28/f32 zero size 2024-09-19T09:35:19.736 INFO:tasks.workunit.client.0.smithi112.stdout:9/157: dread - df/d11/d14/d19/d28/f32 zero size 2024-09-19T09:35:19.737 INFO:tasks.workunit.client.0.smithi112.stdout:7/325: mkdir d2/d2c/d54/d18/d39/d21/d71 0 2024-09-19T09:35:19.740 INFO:tasks.workunit.client.0.smithi112.stdout:4/455: unlink d1/d4/f13 0 2024-09-19T09:35:19.741 INFO:tasks.workunit.client.0.smithi112.stdout:4/456: write d1/d4/d3a/d57/d60/f66 [574757,95252] 0 2024-09-19T09:35:19.742 INFO:tasks.workunit.client.0.smithi112.stdout:9/158: symlink df/d11/d14/d19/l36 0 2024-09-19T09:35:19.744 INFO:tasks.workunit.client.0.smithi112.stdout:4/457: mkdir d1/d5f/da4 0 2024-09-19T09:35:19.746 INFO:tasks.workunit.client.0.smithi112.stdout:9/159: mknod df/d11/c37 0 2024-09-19T09:35:19.746 INFO:tasks.workunit.client.0.smithi112.stdout:9/160: chown df/d11/c37 430653 1 2024-09-19T09:35:19.746 INFO:tasks.workunit.client.0.smithi112.stdout:2/153: read d0/d1/fd [2604474,21192] 0 2024-09-19T09:35:19.752 INFO:tasks.workunit.client.0.smithi112.stdout:6/407: dwrite d8/f10 [0,4194304] 0 2024-09-19T09:35:19.753 INFO:tasks.workunit.client.0.smithi112.stdout:6/408: getdents d8/de/d61/d70/d86 0 2024-09-19T09:35:19.753 INFO:tasks.workunit.client.0.smithi112.stdout:7/326: write d2/d49/f58 [3136123,24895] 0 2024-09-19T09:35:19.754 INFO:tasks.workunit.client.0.smithi112.stdout:7/327: creat d2/d2c/d54/d1a/f72 x:0 0 0 2024-09-19T09:35:19.756 INFO:tasks.workunit.client.0.smithi112.stdout:2/154: dread d0/d1/f22 [0,4194304] 0 2024-09-19T09:35:19.756 INFO:tasks.workunit.client.0.smithi112.stdout:2/155: dread - d0/d1/d28/f31 zero size 2024-09-19T09:35:19.756 INFO:tasks.workunit.client.0.smithi112.stdout:2/156: creat d0/d1/de/d27/f34 x:0 0 0 2024-09-19T09:35:19.757 INFO:tasks.workunit.client.0.smithi112.stdout:7/328: symlink d2/d2c/d54/d18/d39/d23/l73 0 2024-09-19T09:35:19.759 INFO:tasks.workunit.client.0.smithi112.stdout:4/458: dread d1/d3d/d41/f67 [0,4194304] 0 2024-09-19T09:35:19.759 INFO:tasks.workunit.client.0.smithi112.stdout:5/391: dwrite d4/d9/d3e/f77 [0,4194304] 0 2024-09-19T09:35:19.762 INFO:tasks.workunit.client.0.smithi112.stdout:7/329: symlink d2/d2c/d54/d18/d39/d21/l74 0 2024-09-19T09:35:19.767 INFO:tasks.workunit.client.0.smithi112.stdout:6/409: read f5 [8127155,39982] 0 2024-09-19T09:35:19.768 INFO:tasks.workunit.client.0.smithi112.stdout:7/330: mknod d2/d2c/d54/d18/d39/d23/d35/c75 0 2024-09-19T09:35:19.772 INFO:tasks.workunit.client.0.smithi112.stdout:7/331: mkdir d2/d2c/d54/d18/d39/d23/d35/d76 0 2024-09-19T09:35:19.772 INFO:tasks.workunit.client.0.smithi112.stdout:7/332: dread - d2/d2c/d54/d18/d39/d23/d35/f37 zero size 2024-09-19T09:35:19.775 INFO:tasks.workunit.client.0.smithi112.stdout:7/333: fsync d2/fe 0 2024-09-19T09:35:19.777 INFO:tasks.workunit.client.0.smithi112.stdout:7/334: symlink d2/d2c/d54/d18/d39/d23/d35/d4c/d70/l77 0 2024-09-19T09:35:19.778 INFO:tasks.workunit.client.0.smithi112.stdout:5/392: dread d4/d29/f20 [0,4194304] 0 2024-09-19T09:35:19.778 INFO:tasks.workunit.client.0.smithi112.stdout:5/393: read - d4/d9/d17/d30/f80 zero size 2024-09-19T09:35:19.778 INFO:tasks.workunit.client.0.smithi112.stdout:5/394: readlink d4/d29/d36/l48 0 2024-09-19T09:35:19.778 INFO:tasks.workunit.client.0.smithi112.stdout:5/395: chown d4/d29/f2d 0 1 2024-09-19T09:35:19.778 INFO:tasks.workunit.client.0.smithi112.stdout:7/335: creat d2/d2c/d54/d18/d39/d21/d71/f78 x:0 0 0 2024-09-19T09:35:19.780 INFO:tasks.workunit.client.0.smithi112.stdout:9/161: dwrite df/d11/d14/d19/f33 [0,4194304] 0 2024-09-19T09:35:19.781 INFO:tasks.workunit.client.0.smithi112.stdout:6/410: write d8/de/d18/d20/f3a [2880016,103739] 0 2024-09-19T09:35:19.782 INFO:tasks.workunit.client.0.smithi112.stdout:2/157: dwrite d0/d6/fc [0,4194304] 0 2024-09-19T09:35:19.782 INFO:tasks.workunit.client.0.smithi112.stdout:5/396: creat d4/d9/d17/d2f/f8a x:0 0 0 2024-09-19T09:35:19.783 INFO:tasks.workunit.client.0.smithi112.stdout:5/397: creat d4/d29/d36/d5f/f8b x:0 0 0 2024-09-19T09:35:19.784 INFO:tasks.workunit.client.0.smithi112.stdout:7/336: creat d2/d2c/d54/d18/d39/f79 x:0 0 0 2024-09-19T09:35:19.785 INFO:tasks.workunit.client.0.smithi112.stdout:9/162: creat df/d35/f38 x:0 0 0 2024-09-19T09:35:19.788 INFO:tasks.workunit.client.0.smithi112.stdout:9/163: dread df/d11/d14/f2d [0,4194304] 0 2024-09-19T09:35:19.789 INFO:tasks.workunit.client.0.smithi112.stdout:6/411: symlink d8/de/d17/l8d 0 2024-09-19T09:35:19.789 INFO:tasks.workunit.client.0.smithi112.stdout:6/412: dread - d8/d11/d14/d2a/f68 zero size 2024-09-19T09:35:19.790 INFO:tasks.workunit.client.0.smithi112.stdout:2/158: rmdir d0/d1 39 2024-09-19T09:35:19.790 INFO:tasks.workunit.client.0.smithi112.stdout:2/159: chown d0/d1/l3 84132794 1 2024-09-19T09:35:19.792 INFO:tasks.workunit.client.0.smithi112.stdout:4/459: dwrite d1/d4/d3a/f78 [0,4194304] 0 2024-09-19T09:35:19.792 INFO:tasks.workunit.client.0.smithi112.stdout:4/460: chown d1/d31/d43/d48/l6c 56315 1 2024-09-19T09:35:19.796 INFO:tasks.workunit.client.0.smithi112.stdout:7/337: creat d2/d2c/d54/d18/d39/d23/f7a x:0 0 0 2024-09-19T09:35:19.797 INFO:tasks.workunit.client.0.smithi112.stdout:6/413: mknod d8/de/c8e 0 2024-09-19T09:35:19.797 INFO:tasks.workunit.client.0.smithi112.stdout:2/160: symlink d0/d1/l35 0 2024-09-19T09:35:19.797 INFO:tasks.workunit.client.0.smithi112.stdout:2/161: readlink d0/d6/l16 0 2024-09-19T09:35:19.800 INFO:tasks.workunit.client.0.smithi112.stdout:5/398: rename d4/d9/d17/d30/l67 to d4/d84/l8c 0 2024-09-19T09:35:19.801 INFO:tasks.workunit.client.0.smithi112.stdout:5/399: chown d4/d9/d17/d2f/f32 14009083 1 2024-09-19T09:35:19.801 INFO:tasks.workunit.client.0.smithi112.stdout:5/400: chown d4/d9/d3e 32 1 2024-09-19T09:35:19.802 INFO:tasks.workunit.client.0.smithi112.stdout:7/338: mkdir d2/d2c/d54/d18/d39/d23/d35/d4c/d70/d7b 0 2024-09-19T09:35:19.805 INFO:tasks.workunit.client.0.smithi112.stdout:6/414: mkdir d8/de/d66/d8f 0 2024-09-19T09:35:19.807 INFO:tasks.workunit.client.0.smithi112.stdout:9/164: rename df/d11/d14/d19/c2c to df/d11/c39 0 2024-09-19T09:35:19.807 INFO:tasks.workunit.client.0.smithi112.stdout:9/165: fsync fe 0 2024-09-19T09:35:19.807 INFO:tasks.workunit.client.0.smithi112.stdout:9/166: chown df/d11/c1b 0 1 2024-09-19T09:35:19.808 INFO:tasks.workunit.client.0.smithi112.stdout:2/162: dread d0/d6/f1d [0,4194304] 0 2024-09-19T09:35:19.812 INFO:tasks.workunit.client.0.smithi112.stdout:9/167: link df/d11/c1b df/d35/c3a 0 2024-09-19T09:35:19.844 INFO:tasks.workunit.client.0.smithi112.stdout:5/401: dwrite d4/d9/f10 [0,4194304] 0 2024-09-19T09:35:19.844 INFO:tasks.workunit.client.0.smithi112.stdout:5/402: readlink d4/d9/d3e/l40 0 2024-09-19T09:35:19.845 INFO:tasks.workunit.client.0.smithi112.stdout:5/403: symlink d4/d29/l8d 0 2024-09-19T09:35:19.859 INFO:tasks.workunit.client.0.smithi112.stdout:7/339: dwrite d2/d2c/d54/d18/d39/d23/d35/f37 [0,4194304] 0 2024-09-19T09:35:19.859 INFO:tasks.workunit.client.0.smithi112.stdout:2/163: dwrite d0/d1/de/d27/f30 [0,4194304] 0 2024-09-19T09:35:19.861 INFO:tasks.workunit.client.0.smithi112.stdout:7/340: fdatasync d2/d49/f58 0 2024-09-19T09:35:19.861 INFO:tasks.workunit.client.0.smithi112.stdout:7/341: fsync d2/d2c/d54/f63 0 2024-09-19T09:35:19.861 INFO:tasks.workunit.client.0.smithi112.stdout:7/342: readlink d2/d2c/d54/d18/d39/d21/d45/l50 0 2024-09-19T09:35:19.863 INFO:tasks.workunit.client.0.smithi112.stdout:7/343: mkdir d2/d2c/d54/d18/d39/d21/d4e/d7c 0 2024-09-19T09:35:19.863 INFO:tasks.workunit.client.0.smithi112.stdout:7/344: chown d2/d2c/d54/d18/d39/d21/d45/f5c 3 1 2024-09-19T09:35:19.864 INFO:tasks.workunit.client.0.smithi112.stdout:4/461: dwrite d1/d4/d3a/d7a/d7f/f3c [0,4194304] 0 2024-09-19T09:35:19.864 INFO:tasks.workunit.client.0.smithi112.stdout:9/168: dwrite df/d11/d14/f2d [0,4194304] 0 2024-09-19T09:35:19.865 INFO:tasks.workunit.client.0.smithi112.stdout:9/169: creat df/d11/d14/f3b x:0 0 0 2024-09-19T09:35:19.865 INFO:tasks.workunit.client.0.smithi112.stdout:5/404: dwrite d4/d29/d36/d5f/f8b [0,4194304] 0 2024-09-19T09:35:19.866 INFO:tasks.workunit.client.0.smithi112.stdout:4/462: mknod d1/d4/d3a/d7a/d7f/ca5 0 2024-09-19T09:35:19.868 INFO:tasks.workunit.client.0.smithi112.stdout:7/345: link d2/d2c/d54/c44 d2/d2c/d54/c7d 0 2024-09-19T09:35:19.868 INFO:tasks.workunit.client.0.smithi112.stdout:7/346: write d2/d2c/d54/d18/d39/d21/d45/f66 [226568,96774] 0 2024-09-19T09:35:19.868 INFO:tasks.workunit.client.0.smithi112.stdout:2/164: write d0/d6/fc [2396163,103864] 0 2024-09-19T09:35:19.868 INFO:tasks.workunit.client.0.smithi112.stdout:6/415: dwrite d8/d11/d14/f47 [4194304,4194304] 0 2024-09-19T09:35:19.869 INFO:tasks.workunit.client.0.smithi112.stdout:6/416: fsync f5 0 2024-09-19T09:35:19.874 INFO:tasks.workunit.client.0.smithi112.stdout:9/170: dread df/d11/d14/f1d [0,4194304] 0 2024-09-19T09:35:19.878 INFO:tasks.workunit.client.0.smithi112.stdout:5/405: creat d4/d9/d17/f8e x:0 0 0 2024-09-19T09:35:19.881 INFO:tasks.workunit.client.0.smithi112.stdout:4/463: creat d1/d3d/fa6 x:0 0 0 2024-09-19T09:35:19.881 INFO:tasks.workunit.client.0.smithi112.stdout:4/464: chown d1/d31/d96/d9e 242 1 2024-09-19T09:35:19.883 INFO:tasks.workunit.client.0.smithi112.stdout:7/347: truncate d2/d2c/d54/d18/d39/d21/d45/f5c 2236347 0 2024-09-19T09:35:19.887 INFO:tasks.workunit.client.0.smithi112.stdout:2/165: dwrite d0/d1/fd [0,4194304] 0 2024-09-19T09:35:19.887 INFO:tasks.workunit.client.0.smithi112.stdout:2/166: fdatasync d0/d6/fa 0 2024-09-19T09:35:19.902 INFO:tasks.workunit.client.0.smithi112.stdout:9/171: dwrite df/d11/d14/f18 [0,4194304] 0 2024-09-19T09:35:19.902 INFO:tasks.workunit.client.0.smithi112.stdout:4/465: dwrite d1/d3d/f56 [0,4194304] 0 2024-09-19T09:35:19.905 INFO:tasks.workunit.client.0.smithi112.stdout:6/417: mknod d8/d11/d14/d3c/c90 0 2024-09-19T09:35:19.905 INFO:tasks.workunit.client.0.smithi112.stdout:6/418: write d8/de/d17/f31 [4731896,128376] 0 2024-09-19T09:35:19.907 INFO:tasks.workunit.client.0.smithi112.stdout:5/406: mknod d4/d9/d2a/c8f 0 2024-09-19T09:35:19.909 INFO:tasks.workunit.client.0.smithi112.stdout:2/167: rmdir d0/d1/de 39 2024-09-19T09:35:19.916 INFO:tasks.workunit.client.0.smithi112.stdout:7/348: rename d2/d2c/d54/d18/d39/d21/l2b to d2/d2c/d54/d18/l7e 0 2024-09-19T09:35:19.916 INFO:tasks.workunit.client.0.smithi112.stdout:7/349: rename d2/d2c/d54/d18/d39/d21 to d2/d2c/d54/d18/d39/d21/d45/d4d/d7f 22 2024-09-19T09:35:19.918 INFO:tasks.workunit.client.0.smithi112.stdout:2/168: rename d0/d6/fb to d0/d6/f36 0 2024-09-19T09:35:19.918 INFO:tasks.workunit.client.0.smithi112.stdout:2/169: write d0/d1/f7 [966296,41055] 0 2024-09-19T09:35:19.918 INFO:tasks.workunit.client.0.smithi112.stdout:2/170: fdatasync d0/d6/f1d 0 2024-09-19T09:35:19.919 INFO:tasks.workunit.client.0.smithi112.stdout:7/350: getdents d2 0 2024-09-19T09:35:19.919 INFO:tasks.workunit.client.0.smithi112.stdout:7/351: truncate d2/d2c/d54/d18/f3e 4454645 0 2024-09-19T09:35:19.921 INFO:tasks.workunit.client.0.smithi112.stdout:5/407: write d4/d29/d36/d5f/f8b [3096668,19745] 0 2024-09-19T09:35:19.922 INFO:tasks.workunit.client.0.smithi112.stdout:6/419: write d8/f9 [443881,119176] 0 2024-09-19T09:35:19.922 INFO:tasks.workunit.client.0.smithi112.stdout:6/420: truncate d8/d11/f34 4572769 0 2024-09-19T09:35:19.922 INFO:tasks.workunit.client.0.smithi112.stdout:6/421: chown d8/de/d18/f58 59224 1 2024-09-19T09:35:19.924 INFO:tasks.workunit.client.0.smithi112.stdout:2/171: link d0/d6/c1a d0/d1/d28/d1e/c37 0 2024-09-19T09:35:19.927 INFO:tasks.workunit.client.0.smithi112.stdout:5/408: rename d4/d9/d17/d2f/d7d/l75 to d4/d29/d36/l90 0 2024-09-19T09:35:19.931 INFO:tasks.workunit.client.0.smithi112.stdout:6/422: creat d8/de/d18/d20/f91 x:0 0 0 2024-09-19T09:35:19.932 INFO:tasks.workunit.client.0.smithi112.stdout:6/423: chown d8/d11/d14/d3c/f59 4690 1 2024-09-19T09:35:19.933 INFO:tasks.workunit.client.0.smithi112.stdout:5/409: rename d4/d9/d3e/l7e to d4/d9/d2a/d39/l91 0 2024-09-19T09:35:19.934 INFO:tasks.workunit.client.0.smithi112.stdout:4/466: dwrite d1/d4/d3a/d57/d62/f86 [0,4194304] 0 2024-09-19T09:35:19.934 INFO:tasks.workunit.client.0.smithi112.stdout:4/467: fdatasync d1/d4/d3a/f22 0 2024-09-19T09:35:19.934 INFO:tasks.workunit.client.0.smithi112.stdout:5/410: creat d4/d9/d17/d30/f92 x:0 0 0 2024-09-19T09:35:19.935 INFO:tasks.workunit.client.0.smithi112.stdout:5/411: chown d4/d9/d17/d7c 101381654 1 2024-09-19T09:35:19.936 INFO:tasks.workunit.client.0.smithi112.stdout:7/352: dwrite d2/d2c/d54/d18/d39/d21/d45/d4d/f6e [0,4194304] 0 2024-09-19T09:35:19.936 INFO:tasks.workunit.client.0.smithi112.stdout:9/172: dwrite df/d20/f27 [0,4194304] 0 2024-09-19T09:35:19.937 INFO:tasks.workunit.client.0.smithi112.stdout:4/468: mkdir d1/d31/da7 0 2024-09-19T09:35:19.937 INFO:tasks.workunit.client.0.smithi112.stdout:4/469: stat d1/d3d/d41/f4f 0 2024-09-19T09:35:19.938 INFO:tasks.workunit.client.0.smithi112.stdout:5/412: symlink d4/d9/d2a/l93 0 2024-09-19T09:35:19.939 INFO:tasks.workunit.client.0.smithi112.stdout:2/172: write d0/d1/de/d27/f30 [2833589,52205] 0 2024-09-19T09:35:19.940 INFO:tasks.workunit.client.0.smithi112.stdout:6/424: write d8/d11/d14/d2a/f3d [1020258,125484] 0 2024-09-19T09:35:19.940 INFO:tasks.workunit.client.0.smithi112.stdout:6/425: readlink l4 0 2024-09-19T09:35:19.942 INFO:tasks.workunit.client.0.smithi112.stdout:7/353: rename d2/d2c/d54/d1a/c20 to d2/d2c/d54/d18/d39/d23/d35/d4c/d70/c80 0 2024-09-19T09:35:19.942 INFO:tasks.workunit.client.0.smithi112.stdout:7/354: creat d2/d2c/d54/d18/d39/d21/d71/f81 x:0 0 0 2024-09-19T09:35:19.945 INFO:tasks.workunit.client.0.smithi112.stdout:4/470: truncate d1/d4/d3a/f22 172936 0 2024-09-19T09:35:19.947 INFO:tasks.workunit.client.0.smithi112.stdout:5/413: rmdir d4/d9/d17/d2f/d72 39 2024-09-19T09:35:19.948 INFO:tasks.workunit.client.0.smithi112.stdout:9/173: dread df/d11/d14/f18 [0,4194304] 0 2024-09-19T09:35:19.949 INFO:tasks.workunit.client.0.smithi112.stdout:5/414: dread d4/d29/d36/d56/f5e [0,4194304] 0 2024-09-19T09:35:19.949 INFO:tasks.workunit.client.0.smithi112.stdout:5/415: write d4/d9/d2a/d39/f3a [1196620,41058] 0 2024-09-19T09:35:19.950 INFO:tasks.workunit.client.0.smithi112.stdout:2/173: creat d0/d1/f38 x:0 0 0 2024-09-19T09:35:19.953 INFO:tasks.workunit.client.0.smithi112.stdout:6/426: rename d8/d11/d14/d2a/f77 to d8/de/d66/d6e/f92 0 2024-09-19T09:35:19.953 INFO:tasks.workunit.client.0.smithi112.stdout:6/427: write d8/d11/d14/d2a/f79 [155221,46213] 0 2024-09-19T09:35:19.956 INFO:tasks.workunit.client.0.smithi112.stdout:7/355: mknod d2/d2c/d54/d18/d39/c82 0 2024-09-19T09:35:19.961 INFO:tasks.workunit.client.0.smithi112.stdout:4/471: dwrite d1/d31/d43/d48/f81 [0,4194304] 0 2024-09-19T09:35:19.967 INFO:tasks.workunit.client.0.smithi112.stdout:7/356: dread d2/d49/f5a [0,4194304] 0 2024-09-19T09:35:19.967 INFO:tasks.workunit.client.0.smithi112.stdout:2/174: creat d0/d6/d24/f39 x:0 0 0 2024-09-19T09:35:19.969 INFO:tasks.workunit.client.0.smithi112.stdout:9/174: rename df/d11/d14/d19/d1e/f34 to df/d11/f3c 0 2024-09-19T09:35:19.972 INFO:tasks.workunit.client.0.smithi112.stdout:9/175: dread df/d11/d14/f2e [0,4194304] 0 2024-09-19T09:35:19.972 INFO:tasks.workunit.client.0.smithi112.stdout:9/176: dread - df/d35/f38 zero size 2024-09-19T09:35:19.972 INFO:tasks.workunit.client.0.smithi112.stdout:9/177: chown df/d11/l2f 7 1 2024-09-19T09:35:19.972 INFO:tasks.workunit.client.0.smithi112.stdout:9/178: creat df/d20/f3d x:0 0 0 2024-09-19T09:35:19.973 INFO:tasks.workunit.client.0.smithi112.stdout:5/416: write d4/d9/d17/d30/f44 [545944,77443] 0 2024-09-19T09:35:19.973 INFO:tasks.workunit.client.0.smithi112.stdout:5/417: stat d4/d9 0 2024-09-19T09:35:19.974 INFO:tasks.workunit.client.0.smithi112.stdout:5/418: truncate d4/d9/d17/d2f/d72/f63 4797838 0 2024-09-19T09:35:19.976 INFO:tasks.workunit.client.0.smithi112.stdout:4/472: mkdir d1/d4/d3a/d7a/d7f/da8 0 2024-09-19T09:35:19.978 INFO:tasks.workunit.client.0.smithi112.stdout:2/175: rename d0/d1/f1c to d0/d6/f3a 0 2024-09-19T09:35:19.983 INFO:tasks.workunit.client.0.smithi112.stdout:9/179: mknod df/d11/d14/c3e 0 2024-09-19T09:35:19.984 INFO:tasks.workunit.client.0.smithi112.stdout:4/473: write d1/d3d/f3f [6114588,48361] 0 2024-09-19T09:35:19.988 INFO:tasks.workunit.client.0.smithi112.stdout:9/180: dread df/d11/d14/f1f [0,4194304] 0 2024-09-19T09:35:19.988 INFO:tasks.workunit.client.0.smithi112.stdout:9/181: chown df/d11/d14 19764 1 2024-09-19T09:35:19.988 INFO:tasks.workunit.client.0.smithi112.stdout:6/428: rmdir d8/d11/d14 39 2024-09-19T09:35:19.989 INFO:tasks.workunit.client.0.smithi112.stdout:5/419: unlink d4/d9/d3e/l40 0 2024-09-19T09:35:19.989 INFO:tasks.workunit.client.0.smithi112.stdout:5/420: chown d4/d9/d17/d2f/d72/l24 540877 1 2024-09-19T09:35:19.990 INFO:tasks.workunit.client.0.smithi112.stdout:5/421: fdatasync d4/d29/f20 0 2024-09-19T09:35:19.991 INFO:tasks.workunit.client.0.smithi112.stdout:5/422: dread d4/d9/d2a/f49 [0,4194304] 0 2024-09-19T09:35:19.992 INFO:tasks.workunit.client.0.smithi112.stdout:2/176: link d0/d6/c19 d0/d1/c3b 0 2024-09-19T09:35:19.994 INFO:tasks.workunit.client.0.smithi112.stdout:4/474: mknod d1/d5f/ca9 0 2024-09-19T09:35:20.001 INFO:tasks.workunit.client.0.smithi112.stdout:5/423: symlink d4/d9/d2a/d69/l94 0 2024-09-19T09:35:20.001 INFO:tasks.workunit.client.0.smithi112.stdout:4/475: link d1/d31/f50 d1/d3d/d72/faa 0 2024-09-19T09:35:20.001 INFO:tasks.workunit.client.0.smithi112.stdout:4/476: chown d1/d3d/f40 25891 1 2024-09-19T09:35:20.001 INFO:tasks.workunit.client.0.smithi112.stdout:4/477: chown d1/f6 7530 1 2024-09-19T09:35:20.002 INFO:tasks.workunit.client.0.smithi112.stdout:2/177: write d0/d1/fd [1521803,109682] 0 2024-09-19T09:35:20.002 INFO:tasks.workunit.client.0.smithi112.stdout:2/178: truncate d0/d1/f22 4243173 0 2024-09-19T09:35:20.002 INFO:tasks.workunit.client.0.smithi112.stdout:2/179: write d0/d6/fc [5123316,81233] 0 2024-09-19T09:35:20.003 INFO:tasks.workunit.client.0.smithi112.stdout:4/478: symlink d1/d5f/da4/lab 0 2024-09-19T09:35:20.003 INFO:tasks.workunit.client.0.smithi112.stdout:4/479: readlink d1/l4b 0 2024-09-19T09:35:20.003 INFO:tasks.workunit.client.0.smithi112.stdout:4/480: readlink d1/d4/d3a/d57/d62/d88/l9f 0 2024-09-19T09:35:20.014 INFO:tasks.workunit.client.0.smithi112.stdout:8/412: sync 2024-09-19T09:35:20.014 INFO:tasks.workunit.client.0.smithi112.stdout:0/351: sync 2024-09-19T09:35:20.014 INFO:tasks.workunit.client.0.smithi112.stdout:3/297: sync 2024-09-19T09:35:20.014 INFO:tasks.workunit.client.0.smithi112.stdout:1/167: sync 2024-09-19T09:35:20.014 INFO:tasks.workunit.client.0.smithi112.stdout:8/413: readlink d7/d10/d11/d55/l6f 0 2024-09-19T09:35:20.014 INFO:tasks.workunit.client.0.smithi112.stdout:1/168: chown dc/d13/f1c 4699352 1 2024-09-19T09:35:20.014 INFO:tasks.workunit.client.0.smithi112.stdout:5/424: write d4/d29/f2d [3240593,29967] 0 2024-09-19T09:35:20.016 INFO:tasks.workunit.client.0.smithi112.stdout:1/169: symlink dc/d30/l31 0 2024-09-19T09:35:20.016 INFO:tasks.workunit.client.0.smithi112.stdout:1/170: chown l5 33649 1 2024-09-19T09:35:20.017 INFO:tasks.workunit.client.0.smithi112.stdout:1/171: read dc/f21 [293507,32441] 0 2024-09-19T09:35:20.018 INFO:tasks.workunit.client.0.smithi112.stdout:6/429: dwrite d8/f23 [0,4194304] 0 2024-09-19T09:35:20.019 INFO:tasks.workunit.client.0.smithi112.stdout:6/430: chown d8/d11/d14/d2a/f7d 46 1 2024-09-19T09:35:20.021 INFO:tasks.workunit.client.0.smithi112.stdout:6/431: creat d8/de/d66/f93 x:0 0 0 2024-09-19T09:35:20.024 INFO:tasks.workunit.client.0.smithi112.stdout:6/432: mkdir d8/de/d17/d94 0 2024-09-19T09:35:20.026 INFO:tasks.workunit.client.0.smithi112.stdout:6/433: mknod d8/de/d61/c95 0 2024-09-19T09:35:20.026 INFO:tasks.workunit.client.0.smithi112.stdout:6/434: write d8/d11/d14/d2a/f3d [5131123,63711] 0 2024-09-19T09:35:20.028 INFO:tasks.workunit.client.0.smithi112.stdout:6/435: creat d8/d11/d14/d2a/f96 x:0 0 0 2024-09-19T09:35:20.033 INFO:tasks.workunit.client.0.smithi112.stdout:9/182: dwrite df/d11/d14/f1d [0,4194304] 0 2024-09-19T09:35:20.033 INFO:tasks.workunit.client.0.smithi112.stdout:9/183: readlink df/d11/l2f 0 2024-09-19T09:35:20.035 INFO:tasks.workunit.client.0.smithi112.stdout:4/481: dwrite d1/d31/d71/d91/fa0 [0,4194304] 0 2024-09-19T09:35:20.035 INFO:tasks.workunit.client.0.smithi112.stdout:4/482: chown d1/d3d/f56 18761859 1 2024-09-19T09:35:20.036 INFO:tasks.workunit.client.0.smithi112.stdout:4/483: dread - d1/d4/d3a/d57/d60/f6d zero size 2024-09-19T09:35:20.036 INFO:tasks.workunit.client.0.smithi112.stdout:4/484: creat d1/d4/d3a/d57/d62/fac x:0 0 0 2024-09-19T09:35:20.037 INFO:tasks.workunit.client.0.smithi112.stdout:4/485: rmdir d1/d3d/d72 39 2024-09-19T09:35:20.039 INFO:tasks.workunit.client.0.smithi112.stdout:4/486: creat d1/d31/d51/fad x:0 0 0 2024-09-19T09:35:20.039 INFO:tasks.workunit.client.0.smithi112.stdout:9/184: write df/d11/d14/f18 [1460246,13135] 0 2024-09-19T09:35:20.040 INFO:tasks.workunit.client.0.smithi112.stdout:2/180: dwrite d0/d1/de/f11 [4194304,4194304] 0 2024-09-19T09:35:20.040 INFO:tasks.workunit.client.0.smithi112.stdout:2/181: write d0/d1/f22 [3028470,58449] 0 2024-09-19T09:35:20.040 INFO:tasks.workunit.client.0.smithi112.stdout:2/182: read d0/d1/f7 [224233,39781] 0 2024-09-19T09:35:20.041 INFO:tasks.workunit.client.0.smithi112.stdout:4/487: rename d1/d4/d3a/d7a/l90 to d1/d31/d43/lae 0 2024-09-19T09:35:20.041 INFO:tasks.workunit.client.0.smithi112.stdout:4/488: fsync d1/d4/f59 0 2024-09-19T09:35:20.051 INFO:tasks.workunit.client.0.smithi112.stdout:5/425: dwrite d4/d9/f1c [0,4194304] 0 2024-09-19T09:35:20.051 INFO:tasks.workunit.client.0.smithi112.stdout:5/426: readlink d4/d9/d2a/l93 0 2024-09-19T09:35:20.051 INFO:tasks.workunit.client.0.smithi112.stdout:5/427: chown d4/d9/d2a/f43 4078960 1 2024-09-19T09:35:20.052 INFO:tasks.workunit.client.0.smithi112.stdout:5/428: dread d4/d29/d36/d56/f5e [0,4194304] 0 2024-09-19T09:35:20.052 INFO:tasks.workunit.client.0.smithi112.stdout:1/172: dwrite f8 [4194304,4194304] 0 2024-09-19T09:35:20.055 INFO:tasks.workunit.client.0.smithi112.stdout:3/298: dwrite d8/d15/d1b/d1c/d27/d3c/f5b [0,4194304] 0 2024-09-19T09:35:20.055 INFO:tasks.workunit.client.0.smithi112.stdout:1/173: unlink dc/d13/f1d 0 2024-09-19T09:35:20.055 INFO:tasks.workunit.client.0.smithi112.stdout:1/174: creat dc/d24/f32 x:0 0 0 2024-09-19T09:35:20.055 INFO:tasks.workunit.client.0.smithi112.stdout:1/175: creat dc/d13/f33 x:0 0 0 2024-09-19T09:35:20.055 INFO:tasks.workunit.client.0.smithi112.stdout:1/176: stat dc/f20 0 2024-09-19T09:35:20.061 INFO:tasks.workunit.client.0.smithi112.stdout:3/299: mkdir d8/d48/d67 0 2024-09-19T09:35:20.066 INFO:tasks.workunit.client.0.smithi112.stdout:4/489: dread d1/d31/d43/d48/d5c/f84 [0,4194304] 0 2024-09-19T09:35:20.070 INFO:tasks.workunit.client.0.smithi112.stdout:6/436: dwrite d8/d11/f34 [4194304,4194304] 0 2024-09-19T09:35:20.071 INFO:tasks.workunit.client.0.smithi112.stdout:3/300: rename d8/d15/d1b/d1c/d27/d3c to d8/d15/d1b/d1c/d68 0 2024-09-19T09:35:20.071 INFO:tasks.workunit.client.0.smithi112.stdout:3/301: chown d8/d15/d1b/d1c/d68/d33/f35 0 1 2024-09-19T09:35:20.072 INFO:tasks.workunit.client.0.smithi112.stdout:6/437: unlink d8/d11/d14/d3c/d4b/l5a 0 2024-09-19T09:35:20.073 INFO:tasks.workunit.client.0.smithi112.stdout:6/438: unlink d8/d11/d14/c2f 0 2024-09-19T09:35:20.076 INFO:tasks.workunit.client.0.smithi112.stdout:6/439: write d8/d11/d13/f7f [306676,22175] 0 2024-09-19T09:35:20.077 INFO:tasks.workunit.client.0.smithi112.stdout:6/440: rename d8/de/d18/d20/f6d to d8/de/d66/d8f/f97 0 2024-09-19T09:35:20.089 INFO:tasks.workunit.client.0.smithi112.stdout:9/185: dwrite df/d11/d14/f2e [0,4194304] 0 2024-09-19T09:35:20.089 INFO:tasks.workunit.client.0.smithi112.stdout:9/186: fdatasync f3 0 2024-09-19T09:35:20.089 INFO:tasks.workunit.client.0.smithi112.stdout:9/187: creat df/d20/f3f x:0 0 0 2024-09-19T09:35:20.090 INFO:tasks.workunit.client.0.smithi112.stdout:3/302: write d8/d15/d1b/d1c/d68/d33/f57 [3704218,17128] 0 2024-09-19T09:35:20.092 INFO:tasks.workunit.client.0.smithi112.stdout:3/303: dread d8/d15/d1b/d1c/d68/f58 [0,4194304] 0 2024-09-19T09:35:20.095 INFO:tasks.workunit.client.0.smithi112.stdout:2/183: dwrite d0/d1/de/d27/f30 [0,4194304] 0 2024-09-19T09:35:20.096 INFO:tasks.workunit.client.0.smithi112.stdout:5/429: dwrite d4/d29/d36/d5f/f8b [4194304,4194304] 0 2024-09-19T09:35:20.097 INFO:tasks.workunit.client.0.smithi112.stdout:3/304: dread d8/f17 [0,4194304] 0 2024-09-19T09:35:20.099 INFO:tasks.workunit.client.0.smithi112.stdout:4/490: dwrite d1/d3d/f3f [0,4194304] 0 2024-09-19T09:35:20.099 INFO:tasks.workunit.client.0.smithi112.stdout:4/491: creat d1/d31/d42/faf x:0 0 0 2024-09-19T09:35:20.099 INFO:tasks.workunit.client.0.smithi112.stdout:6/441: dwrite d8/d11/d14/d3c/d4b/d63/f5f [0,4194304] 0 2024-09-19T09:35:20.099 INFO:tasks.workunit.client.0.smithi112.stdout:6/442: fdatasync d8/f23 0 2024-09-19T09:35:20.099 INFO:tasks.workunit.client.0.smithi112.stdout:4/492: truncate d1/d3d/f3f 9331778 0 2024-09-19T09:35:20.107 INFO:tasks.workunit.client.0.smithi112.stdout:9/188: fsync f0 0 2024-09-19T09:35:20.115 INFO:tasks.workunit.client.0.smithi112.stdout:5/430: mknod d4/d9/d2a/d69/c95 0 2024-09-19T09:35:20.127 INFO:tasks.workunit.client.0.smithi112.stdout:2/184: dwrite d0/d1/f7 [0,4194304] 0 2024-09-19T09:35:20.128 INFO:tasks.workunit.client.0.smithi112.stdout:4/493: dwrite d1/d4/f15 [4194304,4194304] 0 2024-09-19T09:35:20.128 INFO:tasks.workunit.client.0.smithi112.stdout:9/189: dwrite fe [0,4194304] 0 2024-09-19T09:35:20.133 INFO:tasks.workunit.client.0.smithi112.stdout:2/185: link d0/d6/c1a d0/d6/c3c 0 2024-09-19T09:35:20.133 INFO:tasks.workunit.client.0.smithi112.stdout:2/186: creat d0/d1/f3d x:0 0 0 2024-09-19T09:35:20.133 INFO:tasks.workunit.client.0.smithi112.stdout:2/187: chown d0/d6/l29 741980 1 2024-09-19T09:35:20.133 INFO:tasks.workunit.client.0.smithi112.stdout:2/188: stat d0/d1/d28/l18 0 2024-09-19T09:35:20.134 INFO:tasks.workunit.client.0.smithi112.stdout:4/494: creat d1/d4/d3a/d57/fb0 x:0 0 0 2024-09-19T09:35:20.137 INFO:tasks.workunit.client.0.smithi112.stdout:9/190: mkdir df/d11/d14/d19/d40 0 2024-09-19T09:35:20.137 INFO:tasks.workunit.client.0.smithi112.stdout:9/191: creat df/d11/d14/f41 x:0 0 0 2024-09-19T09:35:20.160 INFO:tasks.workunit.client.0.smithi112.stdout:4/495: dwrite d1/f17 [4194304,4194304] 0 2024-09-19T09:35:20.160 INFO:tasks.workunit.client.0.smithi112.stdout:2/189: dwrite d0/d6/fc [0,4194304] 0 2024-09-19T09:35:20.160 INFO:tasks.workunit.client.0.smithi112.stdout:3/305: dwrite d8/f10 [0,4194304] 0 2024-09-19T09:35:20.162 INFO:tasks.workunit.client.0.smithi112.stdout:4/496: mkdir d1/d5f/da4/db1 0 2024-09-19T09:35:20.163 INFO:tasks.workunit.client.0.smithi112.stdout:2/190: mkdir d0/d3e 0 2024-09-19T09:35:20.167 INFO:tasks.workunit.client.0.smithi112.stdout:2/191: symlink d0/d6/d24/l3f 0 2024-09-19T09:35:20.167 INFO:tasks.workunit.client.0.smithi112.stdout:2/192: chown d0/d6/f1d 1 1 2024-09-19T09:35:20.167 INFO:tasks.workunit.client.0.smithi112.stdout:4/497: rmdir d1/d4/d3a/d57/d62 39 2024-09-19T09:35:20.170 INFO:tasks.workunit.client.0.smithi112.stdout:4/498: dread d1/d31/d43/f74 [0,4194304] 0 2024-09-19T09:35:20.171 INFO:tasks.workunit.client.0.smithi112.stdout:4/499: rmdir d1/d4/d3a/d7a 39 2024-09-19T09:35:20.173 INFO:tasks.workunit.client.0.smithi112.stdout:4/500: creat d1/d3d/d72/fb2 x:0 0 0 2024-09-19T09:35:20.176 INFO:tasks.workunit.client.0.smithi112.stdout:3/306: dwrite d8/d15/d1b/d1c/d27/d2b/f45 [0,4194304] 0 2024-09-19T09:35:20.184 INFO:tasks.workunit.client.0.smithi112.stdout:2/193: dwrite d0/d6/fc [4194304,4194304] 0 2024-09-19T09:35:20.184 INFO:tasks.workunit.client.0.smithi112.stdout:2/194: creat d0/d1/f40 x:0 0 0 2024-09-19T09:35:20.186 INFO:tasks.workunit.client.0.smithi112.stdout:4/501: dread d1/d4/f59 [0,4194304] 0 2024-09-19T09:35:20.192 INFO:tasks.workunit.client.0.smithi112.stdout:2/195: dread d0/d6/f3a [0,4194304] 0 2024-09-19T09:35:20.192 INFO:tasks.workunit.client.0.smithi112.stdout:2/196: write d0/d1/de/f11 [895219,92799] 0 2024-09-19T09:35:20.193 INFO:tasks.workunit.client.0.smithi112.stdout:2/197: write d0/d6/f3a [810001,32262] 0 2024-09-19T09:35:20.193 INFO:tasks.workunit.client.0.smithi112.stdout:2/198: readlink d0/l23 0 2024-09-19T09:35:20.193 INFO:tasks.workunit.client.0.smithi112.stdout:2/199: write d0/d1/f3d [54053,85964] 0 2024-09-19T09:35:20.283 INFO:tasks.workunit.client.0.smithi112.stdout:3/307: truncate d8/d15/d1b/d1c/d27/d2b/f45 150652 0 2024-09-19T09:35:20.290 INFO:tasks.workunit.client.0.smithi112.stdout:4/502: dread d1/d31/d51/f4c [0,4194304] 0 2024-09-19T09:35:20.291 INFO:tasks.workunit.client.0.smithi112.stdout:3/308: dread d8/d15/d1b/d1c/d68/f5b [0,4194304] 0 2024-09-19T09:35:20.291 INFO:tasks.workunit.client.0.smithi112.stdout:2/200: mknod d0/d6/c41 0 2024-09-19T09:35:20.295 INFO:tasks.workunit.client.0.smithi112.stdout:2/201: rename d0/d1/d28/c14 to d0/d6/c42 0 2024-09-19T09:35:20.297 INFO:tasks.workunit.client.0.smithi112.stdout:4/503: mkdir d1/d4/d3a/d57/d60/db3 0 2024-09-19T09:35:20.298 INFO:tasks.workunit.client.0.smithi112.stdout:3/309: mknod d8/c69 0 2024-09-19T09:35:20.300 INFO:tasks.workunit.client.0.smithi112.stdout:2/202: unlink d0/d1/de/d27/l2b 0 2024-09-19T09:35:20.301 INFO:tasks.workunit.client.0.smithi112.stdout:4/504: creat d1/d31/d71/d77/fb4 x:0 0 0 2024-09-19T09:35:20.302 INFO:tasks.workunit.client.0.smithi112.stdout:3/310: symlink d8/d15/d1b/d1c/d68/l6a 0 2024-09-19T09:35:20.302 INFO:tasks.workunit.client.0.smithi112.stdout:3/311: truncate d8/d15/d1b/d1c/d68/f58 1412263 0 2024-09-19T09:35:20.303 INFO:tasks.workunit.client.0.smithi112.stdout:2/203: truncate d0/f5 1411035 0 2024-09-19T09:35:20.306 INFO:tasks.workunit.client.0.smithi112.stdout:3/312: creat d8/d15/d1b/d1c/d68/d33/f6b x:0 0 0 2024-09-19T09:35:20.307 INFO:tasks.workunit.client.0.smithi112.stdout:4/505: mknod d1/d4/cb5 0 2024-09-19T09:35:20.309 INFO:tasks.workunit.client.0.smithi112.stdout:3/313: creat d8/d15/d1b/d1c/f6c x:0 0 0 2024-09-19T09:35:20.309 INFO:tasks.workunit.client.0.smithi112.stdout:3/314: write d8/d15/d1b/d1c/d68/d33/f57 [3977801,84716] 0 2024-09-19T09:35:20.309 INFO:tasks.workunit.client.0.smithi112.stdout:3/315: creat d8/d15/d1b/f6d x:0 0 0 2024-09-19T09:35:20.311 INFO:tasks.workunit.client.0.smithi112.stdout:3/316: rename d8/d15/d1b/d1c/d27/d2b/l41 to d8/d15/d1b/d1c/d68/d33/d66/l6e 0 2024-09-19T09:35:20.312 INFO:tasks.workunit.client.0.smithi112.stdout:3/317: mkdir d8/d15/d1b/d1c/d68/d33/d6f 0 2024-09-19T09:35:20.321 INFO:tasks.workunit.client.0.smithi112.stdout:2/204: dwrite d0/d1/de/d27/f30 [0,4194304] 0 2024-09-19T09:35:20.321 INFO:tasks.workunit.client.0.smithi112.stdout:2/205: write d0/d1/fd [4968097,95483] 0 2024-09-19T09:35:20.322 INFO:tasks.workunit.client.0.smithi112.stdout:4/506: dread d1/d4/d3a/f5d [0,4194304] 0 2024-09-19T09:35:20.322 INFO:tasks.workunit.client.0.smithi112.stdout:4/507: dread - d1/d31/d42/f6b zero size 2024-09-19T09:35:20.341 INFO:tasks.workunit.client.0.smithi112.stdout:3/318: dwrite d8/d15/f5a [0,4194304] 0 2024-09-19T09:35:20.342 INFO:tasks.workunit.client.0.smithi112.stdout:4/508: dwrite d1/d3d/f68 [0,4194304] 0 2024-09-19T09:35:20.342 INFO:tasks.workunit.client.0.smithi112.stdout:4/509: chown d1/d3d/c3e 2008401 1 2024-09-19T09:35:20.344 INFO:tasks.workunit.client.0.smithi112.stdout:3/319: creat d8/d15/d1b/d1c/d68/f70 x:0 0 0 2024-09-19T09:35:20.345 INFO:tasks.workunit.client.0.smithi112.stdout:2/206: write d0/f5 [593145,106570] 0 2024-09-19T09:35:20.345 INFO:tasks.workunit.client.0.smithi112.stdout:2/207: chown d0/d1/d28/f31 497566 1 2024-09-19T09:35:20.346 INFO:tasks.workunit.client.0.smithi112.stdout:4/510: symlink d1/d31/lb6 0 2024-09-19T09:35:20.346 INFO:tasks.workunit.client.0.smithi112.stdout:4/511: fdatasync d1/d31/f9a 0 2024-09-19T09:35:20.347 INFO:tasks.workunit.client.0.smithi112.stdout:3/320: truncate d8/d15/d1b/d1c/d68/d33/f35 2708346 0 2024-09-19T09:35:20.350 INFO:tasks.workunit.client.0.smithi112.stdout:3/321: creat d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d63/f71 x:0 0 0 2024-09-19T09:35:20.353 INFO:tasks.workunit.client.0.smithi112.stdout:4/512: mknod d1/d4/d3a/d57/d60/cb7 0 2024-09-19T09:35:20.355 INFO:tasks.workunit.client.0.smithi112.stdout:4/513: read d1/d3d/f40 [348059,105950] 0 2024-09-19T09:35:20.355 INFO:tasks.workunit.client.0.smithi112.stdout:4/514: mknod d1/d31/d71/d91/cb8 0 2024-09-19T09:35:20.356 INFO:tasks.workunit.client.0.smithi112.stdout:4/515: rename d1/d4/d3a/f49 to d1/fb9 0 2024-09-19T09:35:20.365 INFO:tasks.workunit.client.0.smithi112.stdout:2/208: truncate d0/d1/f3d 113335 0 2024-09-19T09:35:20.367 INFO:tasks.workunit.client.0.smithi112.stdout:2/209: rmdir d0/d1/d28 39 2024-09-19T09:35:20.369 INFO:tasks.workunit.client.0.smithi112.stdout:2/210: creat d0/d1/d28/f43 x:0 0 0 2024-09-19T09:35:20.369 INFO:tasks.workunit.client.0.smithi112.stdout:2/211: dread - d0/d1/d28/f43 zero size 2024-09-19T09:35:20.370 INFO:tasks.workunit.client.0.smithi112.stdout:2/212: truncate d0/d1/fd 5008555 0 2024-09-19T09:35:20.370 INFO:tasks.workunit.client.0.smithi112.stdout:2/213: write d0/d1/d28/f43 [854749,98042] 0 2024-09-19T09:35:20.370 INFO:tasks.workunit.client.0.smithi112.stdout:2/214: fdatasync d0/d6/f36 0 2024-09-19T09:35:20.370 INFO:tasks.workunit.client.0.smithi112.stdout:2/215: fsync d0/d6/f36 0 2024-09-19T09:35:20.371 INFO:tasks.workunit.client.0.smithi112.stdout:4/516: dwrite d1/d3d/d72/fb2 [0,4194304] 0 2024-09-19T09:35:20.371 INFO:tasks.workunit.client.0.smithi112.stdout:4/517: truncate d1/d4/f7d 433668 0 2024-09-19T09:35:20.375 INFO:tasks.workunit.client.0.smithi112.stdout:4/518: truncate d1/d4/d3a/d57/d62/f86 4080555 0 2024-09-19T09:35:20.380 INFO:tasks.workunit.client.0.smithi112.stdout:4/519: rmdir d1/d31/d43/d48 39 2024-09-19T09:35:20.386 INFO:tasks.workunit.client.0.smithi112.stdout:4/520: write d1/d31/d43/d48/d5c/f84 [3019948,18808] 0 2024-09-19T09:35:20.386 INFO:tasks.workunit.client.0.smithi112.stdout:4/521: fsync d1/d4/f15 0 2024-09-19T09:35:20.386 INFO:tasks.workunit.client.0.smithi112.stdout:4/522: chown d1/l4b 65217158 1 2024-09-19T09:35:20.386 INFO:tasks.workunit.client.0.smithi112.stdout:4/523: getdents d1/d5f/da4/db1 0 2024-09-19T09:35:20.390 INFO:tasks.workunit.client.0.smithi112.stdout:2/216: write d0/d1/f3d [610331,90187] 0 2024-09-19T09:35:20.394 INFO:tasks.workunit.client.0.smithi112.stdout:4/524: truncate d1/d31/d43/d48/f81 2532820 0 2024-09-19T09:35:20.394 INFO:tasks.workunit.client.0.smithi112.stdout:4/525: stat d1/d31/da7 0 2024-09-19T09:35:20.398 INFO:tasks.workunit.client.0.smithi112.stdout:4/526: creat d1/d4/fba x:0 0 0 2024-09-19T09:35:20.398 INFO:tasks.workunit.client.0.smithi112.stdout:4/527: write d1/f29 [2062792,78652] 0 2024-09-19T09:35:20.398 INFO:tasks.workunit.client.0.smithi112.stdout:4/528: dread - d1/d31/d43/d48/f63 zero size 2024-09-19T09:35:20.398 INFO:tasks.workunit.client.0.smithi112.stdout:4/529: write d1/d3d/d41/f67 [1687703,130881] 0 2024-09-19T09:35:20.400 INFO:tasks.workunit.client.0.smithi112.stdout:3/322: write d8/d15/d1b/d1c/d68/d33/f35 [2031408,94835] 0 2024-09-19T09:35:20.402 INFO:tasks.workunit.client.0.smithi112.stdout:4/530: getdents d1/d3d 0 2024-09-19T09:35:20.409 INFO:tasks.workunit.client.0.smithi112.stdout:0/352: sync 2024-09-19T09:35:20.409 INFO:tasks.workunit.client.0.smithi112.stdout:7/357: sync 2024-09-19T09:35:20.409 INFO:tasks.workunit.client.0.smithi112.stdout:8/414: sync 2024-09-19T09:35:20.409 INFO:tasks.workunit.client.0.smithi112.stdout:7/358: dread - d2/d2c/d54/d18/d39/d21/d71/f81 zero size 2024-09-19T09:35:20.409 INFO:tasks.workunit.client.0.smithi112.stdout:7/359: readlink d2/d2c/d54/d18/l7e 0 2024-09-19T09:35:20.409 INFO:tasks.workunit.client.0.smithi112.stdout:4/531: dread d1/d3d/d41/f27 [0,4194304] 0 2024-09-19T09:35:20.412 INFO:tasks.workunit.client.0.smithi112.stdout:4/532: link d1/d31/d43/d48/f7e d1/d4/d3a/d7a/fbb 0 2024-09-19T09:35:20.412 INFO:tasks.workunit.client.0.smithi112.stdout:4/533: fdatasync d1/d4/f9 0 2024-09-19T09:35:20.418 INFO:tasks.workunit.client.0.smithi112.stdout:4/534: mknod d1/d31/d71/d77/cbc 0 2024-09-19T09:35:20.418 INFO:tasks.workunit.client.0.smithi112.stdout:7/360: dread d2/d2c/d54/d18/d39/f47 [0,4194304] 0 2024-09-19T09:35:20.421 INFO:tasks.workunit.client.0.smithi112.stdout:8/415: write d7/d10/f16 [6197413,82607] 0 2024-09-19T09:35:20.421 INFO:tasks.workunit.client.0.smithi112.stdout:4/535: rename d1/d31/d71/l8e to d1/d5f/da4/lbd 0 2024-09-19T09:35:20.421 INFO:tasks.workunit.client.0.smithi112.stdout:4/536: truncate d1/fd 674956 0 2024-09-19T09:35:20.421 INFO:tasks.workunit.client.0.smithi112.stdout:8/416: write d7/d10/f16 [1689503,53563] 0 2024-09-19T09:35:20.421 INFO:tasks.workunit.client.0.smithi112.stdout:4/537: write d1/f29 [3279134,114469] 0 2024-09-19T09:35:20.421 INFO:tasks.workunit.client.0.smithi112.stdout:0/353: dread d2/d39/f4f [0,4194304] 0 2024-09-19T09:35:20.422 INFO:tasks.workunit.client.0.smithi112.stdout:0/354: write d2/f38 [1977401,71284] 0 2024-09-19T09:35:20.422 INFO:tasks.workunit.client.0.smithi112.stdout:0/355: fdatasync d2/d11/f32 0 2024-09-19T09:35:20.422 INFO:tasks.workunit.client.0.smithi112.stdout:7/361: mknod d2/d2c/d54/d18/d39/d23/d35/d76/c83 0 2024-09-19T09:35:20.422 INFO:tasks.workunit.client.0.smithi112.stdout:7/362: readlink d2/d2c/d54/d18/l7e 0 2024-09-19T09:35:20.426 INFO:tasks.workunit.client.0.smithi112.stdout:4/538: symlink d1/d31/d43/d48/d5c/lbe 0 2024-09-19T09:35:20.427 INFO:tasks.workunit.client.0.smithi112.stdout:0/356: creat d2/d39/f6d x:0 0 0 2024-09-19T09:35:20.427 INFO:tasks.workunit.client.0.smithi112.stdout:0/357: chown d2/d59/f65 11 1 2024-09-19T09:35:20.429 INFO:tasks.workunit.client.0.smithi112.stdout:8/417: symlink d7/db/d21/d3b/d56/l7c 0 2024-09-19T09:35:20.432 INFO:tasks.workunit.client.0.smithi112.stdout:4/539: link d1/d3d/d41/c34 d1/d4/d3a/d7a/d7f/cbf 0 2024-09-19T09:35:20.433 INFO:tasks.workunit.client.0.smithi112.stdout:0/358: mkdir d2/d6e 0 2024-09-19T09:35:20.433 INFO:tasks.workunit.client.0.smithi112.stdout:0/359: write d2/d39/f6d [5279,43171] 0 2024-09-19T09:35:20.435 INFO:tasks.workunit.client.0.smithi112.stdout:3/323: dwrite d8/d15/d1b/f6d [0,4194304] 0 2024-09-19T09:35:20.437 INFO:tasks.workunit.client.0.smithi112.stdout:4/540: dread d1/d31/d42/f65 [0,4194304] 0 2024-09-19T09:35:20.437 INFO:tasks.workunit.client.0.smithi112.stdout:4/541: truncate d1/d4/d3a/f6a 211387 0 2024-09-19T09:35:20.437 INFO:tasks.workunit.client.0.smithi112.stdout:4/542: dread - d1/d31/d43/d48/f63 zero size 2024-09-19T09:35:20.438 INFO:tasks.workunit.client.0.smithi112.stdout:7/363: dread d2/d2c/d54/d18/f1e [0,4194304] 0 2024-09-19T09:35:20.440 INFO:tasks.workunit.client.0.smithi112.stdout:0/360: mkdir d2/d6e/d6f 0 2024-09-19T09:35:20.440 INFO:tasks.workunit.client.0.smithi112.stdout:0/361: stat d2/d11/l5b 0 2024-09-19T09:35:20.443 INFO:tasks.workunit.client.0.smithi112.stdout:1/177: sync 2024-09-19T09:35:20.444 INFO:tasks.workunit.client.0.smithi112.stdout:3/324: write d8/fb [3932732,107891] 0 2024-09-19T09:35:20.444 INFO:tasks.workunit.client.0.smithi112.stdout:3/325: stat d8/d15/d1b/d28/l2d 0 2024-09-19T09:35:20.448 INFO:tasks.workunit.client.0.smithi112.stdout:4/543: symlink d1/d3d/lc0 0 2024-09-19T09:35:20.448 INFO:tasks.workunit.client.0.smithi112.stdout:4/544: stat d1/d4/d3a/d7a 0 2024-09-19T09:35:20.448 INFO:tasks.workunit.client.0.smithi112.stdout:4/545: stat d1/d31/d71/d77/l97 0 2024-09-19T09:35:20.448 INFO:tasks.workunit.client.0.smithi112.stdout:4/546: read d1/d4/fb [1121222,33200] 0 2024-09-19T09:35:20.450 INFO:tasks.workunit.client.0.smithi112.stdout:7/364: mknod d2/d2c/d54/d18/d39/d21/d45/d4d/c84 0 2024-09-19T09:35:20.453 INFO:tasks.workunit.client.0.smithi112.stdout:8/418: getdents d7/db/d21/d3b/d56 0 2024-09-19T09:35:20.456 INFO:tasks.workunit.client.0.smithi112.stdout:3/326: mkdir d8/d15/d1b/d1c/d68/d33/d72 0 2024-09-19T09:35:20.463 INFO:tasks.workunit.client.0.smithi112.stdout:7/365: mkdir d2/d2c/d54/d18/d85 0 2024-09-19T09:35:20.490 INFO:tasks.workunit.client.0.smithi112.stdout:1/178: dwrite dc/f21 [0,4194304] 0 2024-09-19T09:35:20.491 INFO:tasks.workunit.client.0.smithi112.stdout:8/419: dwrite d7/f76 [0,4194304] 0 2024-09-19T09:35:20.491 INFO:tasks.workunit.client.0.smithi112.stdout:8/420: fdatasync d7/d10/f16 0 2024-09-19T09:35:20.491 INFO:tasks.workunit.client.0.smithi112.stdout:8/421: chown d7/d10/d11/d62 286 1 2024-09-19T09:35:20.491 INFO:tasks.workunit.client.0.smithi112.stdout:3/327: dwrite d8/d15/d1b/d1c/d68/d33/f57 [0,4194304] 0 2024-09-19T09:35:20.491 INFO:tasks.workunit.client.0.smithi112.stdout:3/328: fsync d8/d15/d1b/d1c/d43/d4f/f5f 0 2024-09-19T09:35:20.491 INFO:tasks.workunit.client.0.smithi112.stdout:0/362: dwrite d2/f3c [0,4194304] 0 2024-09-19T09:35:20.497 INFO:tasks.workunit.client.0.smithi112.stdout:7/366: getdents d2/d2c/d54/d18/d39/d21/d45/d4d 0 2024-09-19T09:35:20.497 INFO:tasks.workunit.client.0.smithi112.stdout:7/367: fsync d2/d2c/d54/d1a/f3d 0 2024-09-19T09:35:20.497 INFO:tasks.workunit.client.0.smithi112.stdout:7/368: fsync d2/f28 0 2024-09-19T09:35:20.497 INFO:tasks.workunit.client.0.smithi112.stdout:7/369: stat d2/d2c/d54/d18/d39/d23/d35/c75 0 2024-09-19T09:35:20.500 INFO:tasks.workunit.client.0.smithi112.stdout:1/179: rename dc/d30 to dc/d26/d34 0 2024-09-19T09:35:20.505 INFO:tasks.workunit.client.0.smithi112.stdout:8/422: mknod d7/d67/c7d 0 2024-09-19T09:35:20.505 INFO:tasks.workunit.client.0.smithi112.stdout:8/423: write d7/db/d21/d3b/d56/d3c/f3d [4691649,66010] 0 2024-09-19T09:35:20.508 INFO:tasks.workunit.client.0.smithi112.stdout:3/329: symlink d8/d15/d1b/l73 0 2024-09-19T09:35:20.509 INFO:tasks.workunit.client.0.smithi112.stdout:7/370: read d2/d2c/d54/d18/d39/d21/f51 [2332347,45743] 0 2024-09-19T09:35:20.510 INFO:tasks.workunit.client.0.smithi112.stdout:0/363: link d2/d11/l2b d2/d39/d3b/d44/l70 0 2024-09-19T09:35:20.510 INFO:tasks.workunit.client.0.smithi112.stdout:0/364: creat d2/d39/d3b/d44/f71 x:0 0 0 2024-09-19T09:35:20.511 INFO:tasks.workunit.client.0.smithi112.stdout:0/365: dread - d2/f5d zero size 2024-09-19T09:35:20.512 INFO:tasks.workunit.client.0.smithi112.stdout:3/330: unlink d8/d15/d1b/d28/c39 0 2024-09-19T09:35:20.512 INFO:tasks.workunit.client.0.smithi112.stdout:3/331: write d8/d15/d1b/d1c/d68/f58 [1949357,105442] 0 2024-09-19T09:35:20.512 INFO:tasks.workunit.client.0.smithi112.stdout:1/180: write f8 [5131028,122587] 0 2024-09-19T09:35:20.513 INFO:tasks.workunit.client.0.smithi112.stdout:1/181: dread - dc/d13/f33 zero size 2024-09-19T09:35:20.513 INFO:tasks.workunit.client.0.smithi112.stdout:1/182: readlink dc/l2b 0 2024-09-19T09:35:20.513 INFO:tasks.workunit.client.0.smithi112.stdout:1/183: stat dc/d13/f33 0 2024-09-19T09:35:20.515 INFO:tasks.workunit.client.0.smithi112.stdout:0/366: rename d2/c3e to d2/d39/d3b/c72 0 2024-09-19T09:35:20.519 INFO:tasks.workunit.client.0.smithi112.stdout:3/332: mknod d8/d15/d1b/d1c/d68/d33/c74 0 2024-09-19T09:35:20.519 INFO:tasks.workunit.client.0.smithi112.stdout:3/333: chown d8/d15/d1b/d1c/d68/d33/f57 1633 1 2024-09-19T09:35:20.519 INFO:tasks.workunit.client.0.smithi112.stdout:1/184: symlink dc/d26/d34/l35 0 2024-09-19T09:35:20.521 INFO:tasks.workunit.client.0.smithi112.stdout:0/367: symlink d2/d39/d3b/l73 0 2024-09-19T09:35:20.522 INFO:tasks.workunit.client.0.smithi112.stdout:3/334: mknod d8/d15/d1b/d1c/d68/d33/d6f/c75 0 2024-09-19T09:35:20.523 INFO:tasks.workunit.client.0.smithi112.stdout:1/185: mkdir dc/d26/d34/d36 0 2024-09-19T09:35:20.526 INFO:tasks.workunit.client.0.smithi112.stdout:3/335: creat d8/d15/d1b/d1c/d68/d33/d6f/f76 x:0 0 0 2024-09-19T09:35:20.526 INFO:tasks.workunit.client.0.smithi112.stdout:3/336: fdatasync d8/d15/d1b/d1c/d68/d33/f35 0 2024-09-19T09:35:20.527 INFO:tasks.workunit.client.0.smithi112.stdout:1/186: creat dc/d26/d34/d36/f37 x:0 0 0 2024-09-19T09:35:20.530 INFO:tasks.workunit.client.0.smithi112.stdout:7/371: dread d2/d2c/d54/d18/f3e [0,4194304] 0 2024-09-19T09:35:20.530 INFO:tasks.workunit.client.0.smithi112.stdout:7/372: fdatasync d2/d49/f5a 0 2024-09-19T09:35:20.530 INFO:tasks.workunit.client.0.smithi112.stdout:7/373: chown d2 2 1 2024-09-19T09:35:20.533 INFO:tasks.workunit.client.0.smithi112.stdout:1/187: symlink dc/d26/l38 0 2024-09-19T09:35:20.536 INFO:tasks.workunit.client.0.smithi112.stdout:1/188: dread dc/f23 [0,4194304] 0 2024-09-19T09:35:20.536 INFO:tasks.workunit.client.0.smithi112.stdout:1/189: write f1 [4380758,105868] 0 2024-09-19T09:35:20.541 INFO:tasks.workunit.client.0.smithi112.stdout:0/368: getdents d2/d39/d3b 0 2024-09-19T09:35:20.548 INFO:tasks.workunit.client.0.smithi112.stdout:1/190: write f6 [983863,60027] 0 2024-09-19T09:35:20.548 INFO:tasks.workunit.client.0.smithi112.stdout:1/191: chown dc/d24 5589004 1 2024-09-19T09:35:20.549 INFO:tasks.workunit.client.0.smithi112.stdout:1/192: unlink l5 0 2024-09-19T09:35:20.549 INFO:tasks.workunit.client.0.smithi112.stdout:1/193: chown dc/l2b 258 1 2024-09-19T09:35:20.550 INFO:tasks.workunit.client.0.smithi112.stdout:1/194: mknod dc/d13/c39 0 2024-09-19T09:35:20.550 INFO:tasks.workunit.client.0.smithi112.stdout:1/195: write dc/d13/f18 [4287356,20328] 0 2024-09-19T09:35:20.554 INFO:tasks.workunit.client.0.smithi112.stdout:0/369: dread d2/f4e [0,4194304] 0 2024-09-19T09:35:20.555 INFO:tasks.workunit.client.0.smithi112.stdout:0/370: link d2/d11/f32 d2/d68/f74 0 2024-09-19T09:35:20.555 INFO:tasks.workunit.client.0.smithi112.stdout:0/371: chown d2/d59/f60 28350 1 2024-09-19T09:35:20.556 INFO:tasks.workunit.client.0.smithi112.stdout:0/372: mkdir d2/d6e/d75 0 2024-09-19T09:35:20.557 INFO:tasks.workunit.client.0.smithi112.stdout:0/373: getdents d2/d39 0 2024-09-19T09:35:20.557 INFO:tasks.workunit.client.0.smithi112.stdout:3/337: dwrite d8/d15/d1b/d1c/d68/d33/f35 [0,4194304] 0 2024-09-19T09:35:20.557 INFO:tasks.workunit.client.0.smithi112.stdout:7/374: dwrite d2/d2c/d54/d18/d39/d21/d45/d4d/f68 [0,4194304] 0 2024-09-19T09:35:20.560 INFO:tasks.workunit.client.0.smithi112.stdout:0/374: rename d2/d11/f13 to d2/d6e/d75/f76 0 2024-09-19T09:35:20.562 INFO:tasks.workunit.client.0.smithi112.stdout:0/375: link d2/f21 d2/d11/f77 0 2024-09-19T09:35:20.562 INFO:tasks.workunit.client.0.smithi112.stdout:0/376: stat d2/d11 0 2024-09-19T09:35:20.564 INFO:tasks.workunit.client.0.smithi112.stdout:0/377: unlink d2/l27 0 2024-09-19T09:35:20.574 INFO:tasks.workunit.client.0.smithi112.stdout:1/196: dread f2 [0,4194304] 0 2024-09-19T09:35:20.575 INFO:tasks.workunit.client.0.smithi112.stdout:1/197: stat dc/f23 0 2024-09-19T09:35:20.575 INFO:tasks.workunit.client.0.smithi112.stdout:0/378: dread d2/d11/f2e [0,4194304] 0 2024-09-19T09:35:20.576 INFO:tasks.workunit.client.0.smithi112.stdout:0/379: stat d2/d59/f65 0 2024-09-19T09:35:20.577 INFO:tasks.workunit.client.0.smithi112.stdout:0/380: dread d2/d11/f40 [0,4194304] 0 2024-09-19T09:35:20.577 INFO:tasks.workunit.client.0.smithi112.stdout:0/381: write d2/d39/f46 [865226,100423] 0 2024-09-19T09:35:20.577 INFO:tasks.workunit.client.0.smithi112.stdout:0/382: fdatasync d2/d11/f53 0 2024-09-19T09:35:20.582 INFO:tasks.workunit.client.0.smithi112.stdout:0/383: write d2/f12 [425866,106411] 0 2024-09-19T09:35:20.582 INFO:tasks.workunit.client.0.smithi112.stdout:0/384: getdents d2/d39 0 2024-09-19T09:35:20.582 INFO:tasks.workunit.client.0.smithi112.stdout:0/385: write d2/f31 [1728302,21375] 0 2024-09-19T09:35:20.583 INFO:tasks.workunit.client.0.smithi112.stdout:0/386: mknod d2/d39/d58/c78 0 2024-09-19T09:35:20.583 INFO:tasks.workunit.client.0.smithi112.stdout:0/387: unlink d2/f67 0 2024-09-19T09:35:20.584 INFO:tasks.workunit.client.0.smithi112.stdout:0/388: rmdir d2/d39 39 2024-09-19T09:35:20.589 INFO:tasks.workunit.client.0.smithi112.stdout:7/375: dwrite d2/d2c/d54/d1a/f62 [0,4194304] 0 2024-09-19T09:35:20.590 INFO:tasks.workunit.client.0.smithi112.stdout:0/389: write d2/d11/f33 [211469,59622] 0 2024-09-19T09:35:20.691 INFO:tasks.workunit.client.0.smithi112.stdout:7/376: creat d2/d2c/d54/d18/d39/d23/d35/d4c/d70/d7b/f86 x:0 0 0 2024-09-19T09:35:20.768 INFO:tasks.workunit.client.0.smithi112.stdout:7/377: creat d2/d2c/d54/d18/f87 x:0 0 0 2024-09-19T09:35:20.769 INFO:tasks.workunit.client.0.smithi112.stdout:7/378: chown d2/d2c/d54/d18/d39/d23/f7a 29 1 2024-09-19T09:35:20.769 INFO:tasks.workunit.client.0.smithi112.stdout:7/379: write d2/d49/f58 [1614868,112519] 0 2024-09-19T09:35:20.769 INFO:tasks.workunit.client.0.smithi112.stdout:7/380: rename d2/d2c/d54 to d2/d2c/d54/d18/d39/d23/d35/d4c/d88 22 2024-09-19T09:35:20.771 INFO:tasks.workunit.client.0.smithi112.stdout:7/381: rmdir d2/d2c/d54/d18/d39/d23/d35/d4c 39 2024-09-19T09:35:20.771 INFO:tasks.workunit.client.0.smithi112.stdout:7/382: write d2/d2c/d54/d18/d39/d21/d4e/f5e [50426,94408] 0 2024-09-19T09:35:20.771 INFO:tasks.workunit.client.0.smithi112.stdout:7/383: stat d2/d2c/d54/d18/f3e 0 2024-09-19T09:35:20.782 INFO:tasks.workunit.client.0.smithi112.stdout:7/384: write d2/d2c/d54/d1a/f62 [1114286,34315] 0 2024-09-19T09:35:20.782 INFO:tasks.workunit.client.0.smithi112.stdout:7/385: readlink d2/d2c/d54/d18/d39/d21/d45/l50 0 2024-09-19T09:35:20.786 INFO:tasks.workunit.client.0.smithi112.stdout:7/386: unlink d2/f15 0 2024-09-19T09:35:20.790 INFO:tasks.workunit.client.0.smithi112.stdout:7/387: link d2/d2c/d54/d18/d39/d21/l31 d2/l89 0 2024-09-19T09:35:20.794 INFO:tasks.workunit.client.0.smithi112.stdout:7/388: rename d2/d2c/d54/d18/d39/d21/d4e to d2/d2c/d54/d18/d8a 0 2024-09-19T09:35:20.796 INFO:tasks.workunit.client.0.smithi112.stdout:7/389: rename d2/d2c/d54/d18/d39/f79 to d2/d2c/d54/d18/d8a/f8b 0 2024-09-19T09:35:20.798 INFO:tasks.workunit.client.0.smithi112.stdout:7/390: mknod d2/d2c/d54/d18/d8a/d7c/c8c 0 2024-09-19T09:35:20.809 INFO:tasks.workunit.client.0.smithi112.stdout:7/391: write d2/f13 [1596779,62434] 0 2024-09-19T09:35:20.809 INFO:tasks.workunit.client.0.smithi112.stdout:7/392: chown d2/d2c/d54/d18/d39/d21 7583964 1 2024-09-19T09:35:20.809 INFO:tasks.workunit.client.0.smithi112.stdout:7/393: write d2/d2c/d54/f63 [415789,49161] 0 2024-09-19T09:35:20.811 INFO:tasks.workunit.client.0.smithi112.stdout:7/394: rename d2/d2c/d54/d18/d39/d21/d45/f66 to d2/d2c/d54/d18/d39/d23/d35/d76/f8d 0 2024-09-19T09:35:20.812 INFO:tasks.workunit.client.0.smithi112.stdout:9/192: sync 2024-09-19T09:35:20.812 INFO:tasks.workunit.client.0.smithi112.stdout:6/443: sync 2024-09-19T09:35:20.812 INFO:tasks.workunit.client.0.smithi112.stdout:5/431: sync 2024-09-19T09:35:20.812 INFO:tasks.workunit.client.0.smithi112.stdout:5/432: write d4/d9/d17/f8e [902444,52838] 0 2024-09-19T09:35:20.817 INFO:tasks.workunit.client.0.smithi112.stdout:9/193: unlink df/d11/d14/c23 0 2024-09-19T09:35:20.818 INFO:tasks.workunit.client.0.smithi112.stdout:6/444: truncate d8/f10 3777153 0 2024-09-19T09:35:20.821 INFO:tasks.workunit.client.0.smithi112.stdout:9/194: truncate f0 536662 0 2024-09-19T09:35:20.822 INFO:tasks.workunit.client.0.smithi112.stdout:5/433: rmdir d4/d3f 39 2024-09-19T09:35:20.823 INFO:tasks.workunit.client.0.smithi112.stdout:5/434: dread - d4/d9/d17/d30/f89 zero size 2024-09-19T09:35:20.826 INFO:tasks.workunit.client.0.smithi112.stdout:5/435: mknod d4/d9/d2a/d39/c96 0 2024-09-19T09:35:20.830 INFO:tasks.workunit.client.0.smithi112.stdout:5/436: unlink d4/d9/d2a/d39/d88/l7b 0 2024-09-19T09:35:20.831 INFO:tasks.workunit.client.0.smithi112.stdout:7/395: dwrite d2/f28 [0,4194304] 0 2024-09-19T09:35:20.832 INFO:tasks.workunit.client.0.smithi112.stdout:5/437: mknod d4/d9/d2a/c97 0 2024-09-19T09:35:20.834 INFO:tasks.workunit.client.0.smithi112.stdout:7/396: symlink d2/d2c/d54/d18/d39/d23/d35/d76/l8e 0 2024-09-19T09:35:20.834 INFO:tasks.workunit.client.0.smithi112.stdout:7/397: fsync d2/d2c/d54/d18/d39/d23/f57 0 2024-09-19T09:35:20.835 INFO:tasks.workunit.client.0.smithi112.stdout:5/438: mkdir d4/d9/d6b/d98 0 2024-09-19T09:35:20.835 INFO:tasks.workunit.client.0.smithi112.stdout:5/439: chown d4/d9/d2a/d39/d88 24 1 2024-09-19T09:35:20.836 INFO:tasks.workunit.client.0.smithi112.stdout:9/195: dread df/d11/d14/f2e [0,4194304] 0 2024-09-19T09:35:20.836 INFO:tasks.workunit.client.0.smithi112.stdout:5/440: creat d4/d84/f99 x:0 0 0 2024-09-19T09:35:20.849 INFO:tasks.workunit.client.0.smithi112.stdout:6/445: dwrite d8/f23 [4194304,4194304] 0 2024-09-19T09:35:20.851 INFO:tasks.workunit.client.0.smithi112.stdout:6/446: dread d8/d11/f43 [4194304,4194304] 0 2024-09-19T09:35:20.853 INFO:tasks.workunit.client.0.smithi112.stdout:7/398: write d2/f28 [2695940,37751] 0 2024-09-19T09:35:20.858 INFO:tasks.workunit.client.0.smithi112.stdout:7/399: rename d2/d2c/d54/d18/d39/d21/l31 to d2/d2c/d54/d18/d39/d23/l8f 0 2024-09-19T09:35:20.873 INFO:tasks.workunit.client.0.smithi112.stdout:7/400: write d2/d2c/d54/d18/f3c [1713017,48514] 0 2024-09-19T09:35:20.878 INFO:tasks.workunit.client.0.smithi112.stdout:6/447: dwrite d8/de/f80 [0,4194304] 0 2024-09-19T09:35:20.878 INFO:tasks.workunit.client.0.smithi112.stdout:9/196: dwrite df/d11/d14/d19/d28/f32 [0,4194304] 0 2024-09-19T09:35:20.881 INFO:tasks.workunit.client.0.smithi112.stdout:5/441: dwrite d4/d9/d3e/f77 [0,4194304] 0 2024-09-19T09:35:20.884 INFO:tasks.workunit.client.0.smithi112.stdout:9/197: creat df/d11/d14/d19/f42 x:0 0 0 2024-09-19T09:35:20.886 INFO:tasks.workunit.client.0.smithi112.stdout:7/401: write d2/d2c/d54/d18/d39/d21/d45/f5c [1644015,79258] 0 2024-09-19T09:35:20.894 INFO:tasks.workunit.client.0.smithi112.stdout:5/442: rename d4/d29/d36/l90 to d4/l9a 0 2024-09-19T09:35:20.894 INFO:tasks.workunit.client.0.smithi112.stdout:5/443: read d4/d29/f3c [675802,111780] 0 2024-09-19T09:35:20.894 INFO:tasks.workunit.client.0.smithi112.stdout:5/444: stat d4/d9/d2a/d46 0 2024-09-19T09:35:20.894 INFO:tasks.workunit.client.0.smithi112.stdout:6/448: dwrite d8/d11/d13/f7f [0,4194304] 0 2024-09-19T09:35:20.899 INFO:tasks.workunit.client.0.smithi112.stdout:7/402: creat d2/d2c/d54/d18/d8a/d7c/f90 x:0 0 0 2024-09-19T09:35:20.904 INFO:tasks.workunit.client.0.smithi112.stdout:7/403: mknod d2/d2c/d54/d18/d85/c91 0 2024-09-19T09:35:20.904 INFO:tasks.workunit.client.0.smithi112.stdout:5/445: write d4/d9/d17/d2f/f32 [387196,3271] 0 2024-09-19T09:35:20.904 INFO:tasks.workunit.client.0.smithi112.stdout:6/449: write f6 [739076,57381] 0 2024-09-19T09:35:20.904 INFO:tasks.workunit.client.0.smithi112.stdout:6/450: creat d8/d11/d13/f98 x:0 0 0 2024-09-19T09:35:20.907 INFO:tasks.workunit.client.0.smithi112.stdout:7/404: creat d2/d2c/d54/d18/d85/f92 x:0 0 0 2024-09-19T09:35:20.909 INFO:tasks.workunit.client.0.smithi112.stdout:7/405: write d2/d49/f58 [4364263,67191] 0 2024-09-19T09:35:20.910 INFO:tasks.workunit.client.0.smithi112.stdout:6/451: link d8/d11/d14/d2a/f32 d8/de/d61/f99 0 2024-09-19T09:35:20.912 INFO:tasks.workunit.client.0.smithi112.stdout:6/452: link d8/de/c8e d8/d11/d14/c9a 0 2024-09-19T09:35:20.913 INFO:tasks.workunit.client.0.smithi112.stdout:6/453: mknod d8/de/c9b 0 2024-09-19T09:35:20.915 INFO:tasks.workunit.client.0.smithi112.stdout:6/454: symlink d8/de/d17/l9c 0 2024-09-19T09:35:20.916 INFO:tasks.workunit.client.0.smithi112.stdout:6/455: creat d8/de/d61/d70/d86/f9d x:0 0 0 2024-09-19T09:35:20.916 INFO:tasks.workunit.client.0.smithi112.stdout:6/456: creat d8/de/d66/f9e x:0 0 0 2024-09-19T09:35:20.917 INFO:tasks.workunit.client.0.smithi112.stdout:6/457: symlink d8/de/d17/d94/l9f 0 2024-09-19T09:35:20.921 INFO:tasks.workunit.client.0.smithi112.stdout:7/406: write d2/d2c/d54/d18/d39/d23/d35/f4b [2166871,97823] 0 2024-09-19T09:35:20.921 INFO:tasks.workunit.client.0.smithi112.stdout:7/407: readlink d2/d2c/d54/d18/d39/d23/l4f 0 2024-09-19T09:35:20.923 INFO:tasks.workunit.client.0.smithi112.stdout:7/408: rmdir d2/d2c/d54/d18/d39 39 2024-09-19T09:35:20.925 INFO:tasks.workunit.client.0.smithi112.stdout:7/409: mknod d2/d2c/d54/d1a/c93 0 2024-09-19T09:35:20.926 INFO:tasks.workunit.client.0.smithi112.stdout:6/458: write d8/f10 [3746952,96386] 0 2024-09-19T09:35:20.927 INFO:tasks.workunit.client.0.smithi112.stdout:6/459: write d8/de/d18/d20/f69 [1183366,115509] 0 2024-09-19T09:35:20.927 INFO:tasks.workunit.client.0.smithi112.stdout:6/460: dread - d8/de/d66/d8f/f97 zero size 2024-09-19T09:35:20.927 INFO:tasks.workunit.client.0.smithi112.stdout:6/461: write d8/d11/d14/f1c [622697,44489] 0 2024-09-19T09:35:20.927 INFO:tasks.workunit.client.0.smithi112.stdout:6/462: write d8/de/d18/f58 [166396,9595] 0 2024-09-19T09:35:20.927 INFO:tasks.workunit.client.0.smithi112.stdout:6/463: read f6 [3410777,65798] 0 2024-09-19T09:35:20.927 INFO:tasks.workunit.client.0.smithi112.stdout:6/464: dread - d8/d11/d14/d2a/f96 zero size 2024-09-19T09:35:20.928 INFO:tasks.workunit.client.0.smithi112.stdout:7/410: dread - d2/d2c/d54/d18/d39/d23/d35/d4c/f65 zero size 2024-09-19T09:35:20.928 INFO:tasks.workunit.client.0.smithi112.stdout:7/411: dread - d2/d2c/f69 zero size 2024-09-19T09:35:20.928 INFO:tasks.workunit.client.0.smithi112.stdout:7/412: stat d2/d2c/d54/d18/d39/d23/d35/d4c/d70/d7b 0 2024-09-19T09:35:20.928 INFO:tasks.workunit.client.0.smithi112.stdout:6/465: write d8/d11/d14/d2a/f32 [837935,128717] 0 2024-09-19T09:35:20.930 INFO:tasks.workunit.client.0.smithi112.stdout:6/466: truncate d8/f9 2733822 0 2024-09-19T09:35:20.931 INFO:tasks.workunit.client.0.smithi112.stdout:5/446: dwrite d4/d9/d17/d30/f38 [0,4194304] 0 2024-09-19T09:35:20.932 INFO:tasks.workunit.client.0.smithi112.stdout:7/413: dread d2/d2c/f38 [0,4194304] 0 2024-09-19T09:35:20.933 INFO:tasks.workunit.client.0.smithi112.stdout:6/467: rmdir d8/de/d18/d82 0 2024-09-19T09:35:20.936 INFO:tasks.workunit.client.0.smithi112.stdout:5/447: creat d4/d9/d17/d2f/d72/f9b x:0 0 0 2024-09-19T09:35:20.936 INFO:tasks.workunit.client.0.smithi112.stdout:5/448: write d4/d3f/f6c [631980,6184] 0 2024-09-19T09:35:20.940 INFO:tasks.workunit.client.0.smithi112.stdout:6/468: creat d8/de/fa0 x:0 0 0 2024-09-19T09:35:20.941 INFO:tasks.workunit.client.0.smithi112.stdout:5/449: symlink d4/d29/d36/d56/l9c 0 2024-09-19T09:35:20.942 INFO:tasks.workunit.client.0.smithi112.stdout:5/450: dread d4/d29/d36/d56/f5e [0,4194304] 0 2024-09-19T09:35:20.942 INFO:tasks.workunit.client.0.smithi112.stdout:5/451: write d4/d9/d17/d30/f44 [1018439,57961] 0 2024-09-19T09:35:20.942 INFO:tasks.workunit.client.0.smithi112.stdout:5/452: fsync d4/d9/d17/d2f/d72/f63 0 2024-09-19T09:35:20.950 INFO:tasks.workunit.client.0.smithi112.stdout:2/217: sync 2024-09-19T09:35:20.962 INFO:tasks.workunit.client.0.smithi112.stdout:2/218: read d0/d1/f7 [3319435,79286] 0 2024-09-19T09:35:20.962 INFO:tasks.workunit.client.0.smithi112.stdout:7/414: dwrite d2/d2c/d54/d18/d39/d23/d35/f4b [0,4194304] 0 2024-09-19T09:35:20.962 INFO:tasks.workunit.client.0.smithi112.stdout:7/415: stat d2/d2c/f38 0 2024-09-19T09:35:20.962 INFO:tasks.workunit.client.0.smithi112.stdout:7/416: truncate d2/d2c/d54/d18/f1e 4541333 0 2024-09-19T09:35:20.964 INFO:tasks.workunit.client.0.smithi112.stdout:7/417: creat d2/d2c/d54/d18/d8a/f94 x:0 0 0 2024-09-19T09:35:20.965 INFO:tasks.workunit.client.0.smithi112.stdout:7/418: creat d2/d2c/d54/d18/d39/d21/d45/d4d/f95 x:0 0 0 2024-09-19T09:35:20.969 INFO:tasks.workunit.client.0.smithi112.stdout:6/469: dwrite d8/d11/d14/f57 [0,4194304] 0 2024-09-19T09:35:20.969 INFO:tasks.workunit.client.0.smithi112.stdout:5/453: dwrite d4/f62 [0,4194304] 0 2024-09-19T09:35:20.971 INFO:tasks.workunit.client.0.smithi112.stdout:6/470: symlink d8/de/d61/d70/d7b/d8a/la1 0 2024-09-19T09:35:20.976 INFO:tasks.workunit.client.0.smithi112.stdout:2/219: write d0/d6/fa [1793146,130973] 0 2024-09-19T09:35:20.976 INFO:tasks.workunit.client.0.smithi112.stdout:6/471: mknod d8/d73/ca2 0 2024-09-19T09:35:20.977 INFO:tasks.workunit.client.0.smithi112.stdout:5/454: mknod d4/d9/d17/d30/c9d 0 2024-09-19T09:35:20.978 INFO:tasks.workunit.client.0.smithi112.stdout:7/419: dread d2/d2c/d54/d1a/f1b [0,4194304] 0 2024-09-19T09:35:20.983 INFO:tasks.workunit.client.0.smithi112.stdout:2/220: mkdir d0/d6/d44 0 2024-09-19T09:35:20.985 INFO:tasks.workunit.client.0.smithi112.stdout:6/472: unlink d8/d11/d14/d2a/f79 0 2024-09-19T09:35:20.986 INFO:tasks.workunit.client.0.smithi112.stdout:5/455: unlink d4/d9/d17/d2f/d72/c3d 0 2024-09-19T09:35:20.987 INFO:tasks.workunit.client.0.smithi112.stdout:5/456: write d4/d29/f20 [7653484,13331] 0 2024-09-19T09:35:20.988 INFO:tasks.workunit.client.0.smithi112.stdout:7/420: symlink d2/d2c/d54/d1a/l96 0 2024-09-19T09:35:20.988 INFO:tasks.workunit.client.0.smithi112.stdout:7/421: creat d2/d49/f97 x:0 0 0 2024-09-19T09:35:20.990 INFO:tasks.workunit.client.0.smithi112.stdout:2/221: mknod d0/d6/c45 0 2024-09-19T09:35:20.990 INFO:tasks.workunit.client.0.smithi112.stdout:2/222: readlink d0/d6/l29 0 2024-09-19T09:35:20.996 INFO:tasks.workunit.client.0.smithi112.stdout:6/473: link d8/d11/d14/l50 d8/de/d18/la3 0 2024-09-19T09:35:21.001 INFO:tasks.workunit.client.0.smithi112.stdout:2/223: dread d0/d1/d28/f10 [0,4194304] 0 2024-09-19T09:35:21.006 INFO:tasks.workunit.client.0.smithi112.stdout:5/457: link d4/d29/l8d d4/d29/d36/l9e 0 2024-09-19T09:35:21.006 INFO:tasks.workunit.client.0.smithi112.stdout:5/458: write d4/d9/d17/d2f/f32 [3658677,95791] 0 2024-09-19T09:35:21.006 INFO:tasks.workunit.client.0.smithi112.stdout:5/459: creat d4/d9/d2a/d69/f9f x:0 0 0 2024-09-19T09:35:21.006 INFO:tasks.workunit.client.0.smithi112.stdout:5/460: dread - d4/d9/d2a/d69/f81 zero size 2024-09-19T09:35:21.006 INFO:tasks.workunit.client.0.smithi112.stdout:5/461: write d4/d84/f99 [589941,51644] 0 2024-09-19T09:35:21.007 INFO:tasks.workunit.client.0.smithi112.stdout:7/422: symlink d2/d2c/d54/d18/d39/d23/d35/d4c/l98 0 2024-09-19T09:35:21.008 INFO:tasks.workunit.client.0.smithi112.stdout:2/224: getdents d0/d1/de 0 2024-09-19T09:35:21.010 INFO:tasks.workunit.client.0.smithi112.stdout:5/462: symlink d4/d9/d2a/d39/la0 0 2024-09-19T09:35:21.012 INFO:tasks.workunit.client.0.smithi112.stdout:5/463: creat d4/d9/d2a/d39/d88/fa1 x:0 0 0 2024-09-19T09:35:21.012 INFO:tasks.workunit.client.0.smithi112.stdout:5/464: chown d4/d9 230 1 2024-09-19T09:35:21.013 INFO:tasks.workunit.client.0.smithi112.stdout:5/465: fsync d4/d9/d6b/f6d 0 2024-09-19T09:35:21.013 INFO:tasks.workunit.client.0.smithi112.stdout:5/466: fsync d4/d9/d17/d30/f92 0 2024-09-19T09:35:21.013 INFO:tasks.workunit.client.0.smithi112.stdout:5/467: truncate d4/d29/d36/d56/f5e 1036059 0 2024-09-19T09:35:21.013 INFO:tasks.workunit.client.0.smithi112.stdout:5/468: mkdir d4/d29/d36/da2 0 2024-09-19T09:35:21.013 INFO:tasks.workunit.client.0.smithi112.stdout:5/469: getdents d4/d9/d6b/d98 0 2024-09-19T09:35:21.015 INFO:tasks.workunit.client.0.smithi112.stdout:6/474: dwrite d8/d11/d14/d2a/f68 [0,4194304] 0 2024-09-19T09:35:21.015 INFO:tasks.workunit.client.0.smithi112.stdout:6/475: creat d8/d11/d13/fa4 x:0 0 0 2024-09-19T09:35:21.015 INFO:tasks.workunit.client.0.smithi112.stdout:6/476: write d8/de/d66/d8f/f97 [780620,47252] 0 2024-09-19T09:35:21.015 INFO:tasks.workunit.client.0.smithi112.stdout:6/477: creat d8/d11/d14/d2a/fa5 x:0 0 0 2024-09-19T09:35:21.020 INFO:tasks.workunit.client.0.smithi112.stdout:2/225: write d0/d6/fc [3660841,124746] 0 2024-09-19T09:35:21.021 INFO:tasks.workunit.client.0.smithi112.stdout:7/423: dread d2/d49/f58 [0,4194304] 0 2024-09-19T09:35:21.032 INFO:tasks.workunit.client.0.smithi112.stdout:2/226: dwrite d0/d1/d28/f10 [4194304,4194304] 0 2024-09-19T09:35:21.032 INFO:tasks.workunit.client.0.smithi112.stdout:2/227: write d0/d1/f3d [1634351,33297] 0 2024-09-19T09:35:21.032 INFO:tasks.workunit.client.0.smithi112.stdout:2/228: creat d0/d6/d24/f46 x:0 0 0 2024-09-19T09:35:21.045 INFO:tasks.workunit.client.0.smithi112.stdout:2/229: dwrite d0/d1/f22 [0,4194304] 0 2024-09-19T09:35:21.055 INFO:tasks.workunit.client.0.smithi112.stdout:2/230: dread d0/d1/de/f11 [4194304,4194304] 0 2024-09-19T09:35:21.055 INFO:tasks.workunit.client.0.smithi112.stdout:2/231: write d0/d6/f36 [4145441,100437] 0 2024-09-19T09:35:21.069 INFO:tasks.workunit.client.0.smithi112.stdout:2/232: dwrite d0/d1/f3d [0,4194304] 0 2024-09-19T09:35:21.086 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:20 smithi191 ceph-mon[34834]: pgmap v22: 65 pgs: 65 active+clean; 1.8 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 198 MiB/s rd, 238 MiB/s wr, 429 op/s 2024-09-19T09:35:21.132 INFO:tasks.workunit.client.0.smithi112.stdout:7/424: mkdir d2/d99 0 2024-09-19T09:35:21.138 INFO:tasks.workunit.client.0.smithi112.stdout:2/233: link d0/d1/d28/f31 d0/d1/de/f47 0 2024-09-19T09:35:21.153 INFO:tasks.workunit.client.0.smithi112.stdout:7/425: rmdir d2 39 2024-09-19T09:35:21.154 INFO:tasks.workunit.client.0.smithi112.stdout:7/426: mknod d2/d2c/d54/d18/d39/d23/d35/d76/c9a 0 2024-09-19T09:35:21.154 INFO:tasks.workunit.client.0.smithi112.stdout:7/427: stat d2 0 2024-09-19T09:35:21.154 INFO:tasks.workunit.client.0.smithi112.stdout:7/428: fdatasync d2/d2c/d54/d1a/f72 0 2024-09-19T09:35:21.154 INFO:tasks.workunit.client.0.smithi112.stdout:7/429: read d2/d2c/d54/d1a/f1b [4167637,82713] 0 2024-09-19T09:35:21.154 INFO:tasks.workunit.client.0.smithi112.stdout:7/430: stat d2/l89 0 2024-09-19T09:35:21.155 INFO:tasks.workunit.client.0.smithi112.stdout:7/431: link d2/d2c/d54/d1a/f72 d2/d99/f9b 0 2024-09-19T09:35:21.155 INFO:tasks.workunit.client.0.smithi112.stdout:7/432: chown d2/d2c/d54/d18/d39/d23/d35/d4c/d70 111 1 2024-09-19T09:35:21.156 INFO:tasks.workunit.client.0.smithi112.stdout:2/234: truncate d0/d1/d28/f10 3314769 0 2024-09-19T09:35:21.156 INFO:tasks.workunit.client.0.smithi112.stdout:7/433: rmdir d2/d2c/d54 39 2024-09-19T09:35:21.158 INFO:tasks.workunit.client.0.smithi112.stdout:2/235: rename d0/d1/l3 to d0/d1/d28/d1e/l48 0 2024-09-19T09:35:21.158 INFO:tasks.workunit.client.0.smithi112.stdout:4/547: sync 2024-09-19T09:35:21.158 INFO:tasks.workunit.client.0.smithi112.stdout:8/424: sync 2024-09-19T09:35:21.158 INFO:tasks.workunit.client.0.smithi112.stdout:4/548: write d1/d4/d3a/d57/d62/f79 [860610,59264] 0 2024-09-19T09:35:21.163 INFO:tasks.workunit.client.0.smithi112.stdout:7/434: fsync d2/d99/f9b 0 2024-09-19T09:35:21.163 INFO:tasks.workunit.client.0.smithi112.stdout:7/435: read d2/d2c/d54/d18/d39/d23/d35/d76/f8d [15751,58455] 0 2024-09-19T09:35:21.168 INFO:tasks.workunit.client.0.smithi112.stdout:2/236: rename d0/d1/d28/d1e to d0/d3e/d49 0 2024-09-19T09:35:21.169 INFO:tasks.workunit.client.0.smithi112.stdout:4/549: write d1/f6 [120091,98628] 0 2024-09-19T09:35:21.169 INFO:tasks.workunit.client.0.smithi112.stdout:7/436: creat d2/d2c/d54/d18/d39/d23/d35/f9c x:0 0 0 2024-09-19T09:35:21.171 INFO:tasks.workunit.client.0.smithi112.stdout:4/550: rename d1/f1f to d1/d4/d3a/d7a/d7f/fc1 0 2024-09-19T09:35:21.172 INFO:tasks.workunit.client.0.smithi112.stdout:7/437: creat d2/d2c/d54/d18/d39/d23/d35/d4c/f9d x:0 0 0 2024-09-19T09:35:21.174 INFO:tasks.workunit.client.0.smithi112.stdout:4/551: dread d1/d4/f7d [0,4194304] 0 2024-09-19T09:35:21.175 INFO:tasks.workunit.client.0.smithi112.stdout:7/438: link d2/d2c/d54/d1a/f72 d2/d2c/d54/d18/d39/f9e 0 2024-09-19T09:35:21.175 INFO:tasks.workunit.client.0.smithi112.stdout:7/439: write d2/d2c/d54/d18/f3c [1817387,28196] 0 2024-09-19T09:35:21.175 INFO:tasks.workunit.client.0.smithi112.stdout:7/440: write d2/d2c/d54/d18/d39/f9e [397190,12348] 0 2024-09-19T09:35:21.176 INFO:tasks.workunit.client.0.smithi112.stdout:4/552: mkdir d1/d5f/dc2 0 2024-09-19T09:35:21.179 INFO:tasks.workunit.client.0.smithi112.stdout:2/237: dread d0/d1/de/d27/f30 [0,4194304] 0 2024-09-19T09:35:21.179 INFO:tasks.workunit.client.0.smithi112.stdout:7/441: link d2/d2c/d54/d18/l25 d2/d2c/d54/d18/l9f 0 2024-09-19T09:35:21.184 INFO:tasks.workunit.client.0.smithi112.stdout:2/238: unlink d0/d6/f3a 0 2024-09-19T09:35:21.188 INFO:tasks.workunit.client.0.smithi112.stdout:2/239: mkdir d0/d4a 0 2024-09-19T09:35:21.188 INFO:tasks.workunit.client.0.smithi112.stdout:2/240: fsync d0/d6/f36 0 2024-09-19T09:35:21.188 INFO:tasks.workunit.client.0.smithi112.stdout:2/241: write d0/d6/d24/f39 [652031,9454] 0 2024-09-19T09:35:21.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:20 smithi112 ceph-mon[27605]: pgmap v22: 65 pgs: 65 active+clean; 1.8 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 198 MiB/s rd, 238 MiB/s wr, 429 op/s 2024-09-19T09:35:21.195 INFO:tasks.workunit.client.0.smithi112.stdout:2/242: dread d0/d1/f3d [0,4194304] 0 2024-09-19T09:35:21.199 INFO:tasks.workunit.client.0.smithi112.stdout:4/553: dwrite d1/f6 [0,4194304] 0 2024-09-19T09:35:21.201 INFO:tasks.workunit.client.0.smithi112.stdout:4/554: rmdir d1/d4/d3a/d57 39 2024-09-19T09:35:21.232 INFO:tasks.workunit.client.0.smithi112.stdout:2/243: dwrite d0/d6/d24/f46 [0,4194304] 0 2024-09-19T09:35:21.234 INFO:tasks.workunit.client.0.smithi112.stdout:2/244: mkdir d0/d1/de/d4b 0 2024-09-19T09:35:21.234 INFO:tasks.workunit.client.0.smithi112.stdout:4/555: dwrite d1/d31/d71/d77/fb4 [0,4194304] 0 2024-09-19T09:35:21.235 INFO:tasks.workunit.client.0.smithi112.stdout:4/556: fsync d1/d4/d3a/d57/d60/f6d 0 2024-09-19T09:35:21.235 INFO:tasks.workunit.client.0.smithi112.stdout:7/442: dwrite d2/d2c/d54/d18/f3e [0,4194304] 0 2024-09-19T09:35:21.236 INFO:tasks.workunit.client.0.smithi112.stdout:2/245: link d0/d1/fd d0/d3e/d49/f4c 0 2024-09-19T09:35:21.236 INFO:tasks.workunit.client.0.smithi112.stdout:2/246: stat d0/d1/d28/l18 0 2024-09-19T09:35:21.239 INFO:tasks.workunit.client.0.smithi112.stdout:7/443: dread d2/d2c/d54/d18/d39/d23/d35/d76/f8d [0,4194304] 0 2024-09-19T09:35:21.240 INFO:tasks.workunit.client.0.smithi112.stdout:4/557: unlink d1/d4/f32 0 2024-09-19T09:35:21.243 INFO:tasks.workunit.client.0.smithi112.stdout:2/247: symlink d0/d3e/l4d 0 2024-09-19T09:35:21.243 INFO:tasks.workunit.client.0.smithi112.stdout:7/444: getdents d2/d2c/d54 0 2024-09-19T09:35:21.244 INFO:tasks.workunit.client.0.smithi112.stdout:4/558: truncate d1/d3d/d41/f27 2360709 0 2024-09-19T09:35:21.244 INFO:tasks.workunit.client.0.smithi112.stdout:4/559: write d1/d31/d42/f6b [976129,1751] 0 2024-09-19T09:35:21.246 INFO:tasks.workunit.client.0.smithi112.stdout:2/248: rename d0/d6/c45 to d0/c4e 0 2024-09-19T09:35:21.252 INFO:tasks.workunit.client.0.smithi112.stdout:4/560: rename d1/d3d/f87 to d1/d4/d3a/d57/d60/db3/fc3 0 2024-09-19T09:35:21.252 INFO:tasks.workunit.client.0.smithi112.stdout:4/561: dread - d1/d3d/fa6 zero size 2024-09-19T09:35:21.253 INFO:tasks.workunit.client.0.smithi112.stdout:2/249: mkdir d0/d1/de/d4f 0 2024-09-19T09:35:21.253 INFO:tasks.workunit.client.0.smithi112.stdout:2/250: dread - d0/d1/de/f47 zero size 2024-09-19T09:35:21.253 INFO:tasks.workunit.client.0.smithi112.stdout:2/251: chown d0/d6/l21 1889297 1 2024-09-19T09:35:21.255 INFO:tasks.workunit.client.0.smithi112.stdout:7/445: truncate d2/d2c/d54/d18/d39/d21/f51 8324158 0 2024-09-19T09:35:21.260 INFO:tasks.workunit.client.0.smithi112.stdout:7/446: dread d2/d2c/d54/d18/d8a/f5e [0,4194304] 0 2024-09-19T09:35:21.263 INFO:tasks.workunit.client.0.smithi112.stdout:7/447: dread - d2/d2c/d54/d18/d39/d21/d71/f78 zero size 2024-09-19T09:35:21.267 INFO:tasks.workunit.client.0.smithi112.stdout:7/448: mknod d2/d2c/d54/d18/d39/d21/ca0 0 2024-09-19T09:35:21.272 INFO:tasks.workunit.client.0.smithi112.stdout:4/562: dwrite d1/d3d/f40 [0,4194304] 0 2024-09-19T09:35:21.272 INFO:tasks.workunit.client.0.smithi112.stdout:4/563: truncate d1/d31/d42/f6b 1207734 0 2024-09-19T09:35:21.275 INFO:tasks.workunit.client.0.smithi112.stdout:4/564: rename d1/d3d/d41/f23 to d1/d31/d42/fc4 0 2024-09-19T09:35:21.275 INFO:tasks.workunit.client.0.smithi112.stdout:4/565: fsync d1/d31/d51/fad 0 2024-09-19T09:35:21.275 INFO:tasks.workunit.client.0.smithi112.stdout:4/566: fsync d1/d4/f59 0 2024-09-19T09:35:21.280 INFO:tasks.workunit.client.0.smithi112.stdout:7/449: dread d2/d2c/d54/d1a/f3d [0,4194304] 0 2024-09-19T09:35:21.281 INFO:tasks.workunit.client.0.smithi112.stdout:4/567: creat d1/d4/d3a/d57/d60/fc5 x:0 0 0 2024-09-19T09:35:21.281 INFO:tasks.workunit.client.0.smithi112.stdout:4/568: dread - d1/d31/f9a zero size 2024-09-19T09:35:21.283 INFO:tasks.workunit.client.0.smithi112.stdout:7/450: mkdir d2/d2c/d54/d18/da1 0 2024-09-19T09:35:21.285 INFO:tasks.workunit.client.0.smithi112.stdout:7/451: getdents d2 0 2024-09-19T09:35:21.287 INFO:tasks.workunit.client.0.smithi112.stdout:7/452: creat d2/d2c/d54/d18/d39/d21/fa2 x:0 0 0 2024-09-19T09:35:21.290 INFO:tasks.workunit.client.0.smithi112.stdout:7/453: creat d2/d2c/d54/d18/d85/fa3 x:0 0 0 2024-09-19T09:35:21.290 INFO:tasks.workunit.client.0.smithi112.stdout:7/454: write d2/d2c/d54/d18/d39/d21/d45/d4d/f95 [842000,108893] 0 2024-09-19T09:35:21.290 INFO:tasks.workunit.client.0.smithi112.stdout:7/455: fdatasync d2/d2c/d54/d18/d39/d21/fa2 0 2024-09-19T09:35:21.291 INFO:tasks.workunit.client.0.smithi112.stdout:4/569: dread d1/d4/d3a/d57/d62/f86 [0,4194304] 0 2024-09-19T09:35:21.293 INFO:tasks.workunit.client.0.smithi112.stdout:7/456: rename d2/d2c/d54/cf to d2/d2c/d54/d18/d39/ca4 0 2024-09-19T09:35:21.293 INFO:tasks.workunit.client.0.smithi112.stdout:7/457: dread - d2/d2c/f69 zero size 2024-09-19T09:35:21.293 INFO:tasks.workunit.client.0.smithi112.stdout:7/458: fsync d2/d2c/d54/d18/d39/d21/d45/f5c 0 2024-09-19T09:35:21.296 INFO:tasks.workunit.client.0.smithi112.stdout:4/570: unlink d1/d31/d43/lae 0 2024-09-19T09:35:21.296 INFO:tasks.workunit.client.0.smithi112.stdout:4/571: readlink d1/d31/la1 0 2024-09-19T09:35:21.297 INFO:tasks.workunit.client.0.smithi112.stdout:4/572: fsync d1/f53 0 2024-09-19T09:35:21.297 INFO:tasks.workunit.client.0.smithi112.stdout:4/573: truncate d1/d31/d42/faf 976921 0 2024-09-19T09:35:21.297 INFO:tasks.workunit.client.0.smithi112.stdout:4/574: write d1/d4/d3a/d57/fb0 [510403,44087] 0 2024-09-19T09:35:21.305 INFO:tasks.workunit.client.0.smithi112.stdout:7/459: rmdir d2/d2c/d54/d18/d39/d23/d35 39 2024-09-19T09:35:21.309 INFO:tasks.workunit.client.0.smithi112.stdout:3/338: sync 2024-09-19T09:35:21.309 INFO:tasks.workunit.client.0.smithi112.stdout:3/339: write d8/d15/d1b/d1c/d43/f4e [614050,83964] 0 2024-09-19T09:35:21.310 INFO:tasks.workunit.client.0.smithi112.stdout:3/340: readlink d8/d15/l26 0 2024-09-19T09:35:21.310 INFO:tasks.workunit.client.0.smithi112.stdout:1/198: sync 2024-09-19T09:35:21.310 INFO:tasks.workunit.client.0.smithi112.stdout:0/390: sync 2024-09-19T09:35:21.310 INFO:tasks.workunit.client.0.smithi112.stdout:9/198: sync 2024-09-19T09:35:21.310 INFO:tasks.workunit.client.0.smithi112.stdout:9/199: fsync df/d11/f3c 0 2024-09-19T09:35:21.310 INFO:tasks.workunit.client.0.smithi112.stdout:9/200: write f0 [657750,24720] 0 2024-09-19T09:35:21.310 INFO:tasks.workunit.client.0.smithi112.stdout:9/201: creat df/d11/d14/d19/d28/f43 x:0 0 0 2024-09-19T09:35:21.313 INFO:tasks.workunit.client.0.smithi112.stdout:1/199: dread dc/f20 [0,4194304] 0 2024-09-19T09:35:21.315 INFO:tasks.workunit.client.0.smithi112.stdout:7/460: dread d2/d49/f58 [0,4194304] 0 2024-09-19T09:35:21.315 INFO:tasks.workunit.client.0.smithi112.stdout:7/461: write d2/d2c/d54/d18/d85/fa3 [171275,44303] 0 2024-09-19T09:35:21.316 INFO:tasks.workunit.client.0.smithi112.stdout:3/341: creat d8/d15/d1b/f77 x:0 0 0 2024-09-19T09:35:21.317 INFO:tasks.workunit.client.0.smithi112.stdout:7/462: dread d2/d99/f9b [0,4194304] 0 2024-09-19T09:35:21.318 INFO:tasks.workunit.client.0.smithi112.stdout:0/391: link d2/l3a d2/d11/l79 0 2024-09-19T09:35:21.319 INFO:tasks.workunit.client.0.smithi112.stdout:0/392: write d2/f12 [5112635,41223] 0 2024-09-19T09:35:21.323 INFO:tasks.workunit.client.0.smithi112.stdout:1/200: link dc/l28 dc/d24/l3a 0 2024-09-19T09:35:21.325 INFO:tasks.workunit.client.0.smithi112.stdout:3/342: creat d8/d48/f78 x:0 0 0 2024-09-19T09:35:21.325 INFO:tasks.workunit.client.0.smithi112.stdout:4/575: dwrite d1/d4/d3a/d7a/d7f/f3c [0,4194304] 0 2024-09-19T09:35:21.325 INFO:tasks.workunit.client.0.smithi112.stdout:3/343: write d8/d15/d1b/d1c/f6c [635098,130443] 0 2024-09-19T09:35:21.330 INFO:tasks.workunit.client.0.smithi112.stdout:7/463: rmdir d2/d49 39 2024-09-19T09:35:21.330 INFO:tasks.workunit.client.0.smithi112.stdout:7/464: fsync d2/d2c/d54/d18/d8a/f8b 0 2024-09-19T09:35:21.333 INFO:tasks.workunit.client.0.smithi112.stdout:0/393: truncate d2/d11/f33 2197945 0 2024-09-19T09:35:21.333 INFO:tasks.workunit.client.0.smithi112.stdout:0/394: dread - d2/f36 zero size 2024-09-19T09:35:21.337 INFO:tasks.workunit.client.0.smithi112.stdout:1/201: symlink dc/d13/l3b 0 2024-09-19T09:35:21.340 INFO:tasks.workunit.client.0.smithi112.stdout:7/465: write d2/d2c/d54/d18/d39/d21/f2e [1762113,125115] 0 2024-09-19T09:35:21.342 INFO:tasks.workunit.client.0.smithi112.stdout:0/395: unlink d2/d39/d3b/d44/f6a 0 2024-09-19T09:35:21.342 INFO:tasks.workunit.client.0.smithi112.stdout:7/466: stat d2/d2c/d54/d18/l3f 0 2024-09-19T09:35:21.344 INFO:tasks.workunit.client.0.smithi112.stdout:4/576: read d1/d4/d3a/f78 [764419,54281] 0 2024-09-19T09:35:21.348 INFO:tasks.workunit.client.0.smithi112.stdout:0/396: mkdir d2/d59/d7a 0 2024-09-19T09:35:21.349 INFO:tasks.workunit.client.0.smithi112.stdout:7/467: rmdir d2/d2c/d54/d18/d39/d23/d35/d4c/d70 39 2024-09-19T09:35:21.349 INFO:tasks.workunit.client.0.smithi112.stdout:7/468: write d2/f28 [38825,84597] 0 2024-09-19T09:35:21.354 INFO:tasks.workunit.client.0.smithi112.stdout:4/577: write d1/d31/f50 [4089489,39655] 0 2024-09-19T09:35:21.354 INFO:tasks.workunit.client.0.smithi112.stdout:4/578: fdatasync d1/d31/d42/faf 0 2024-09-19T09:35:21.355 INFO:tasks.workunit.client.0.smithi112.stdout:0/397: link d2/f56 d2/d39/d58/f7b 0 2024-09-19T09:35:21.355 INFO:tasks.workunit.client.0.smithi112.stdout:0/398: fdatasync d2/d39/d3b/d44/f71 0 2024-09-19T09:35:21.359 INFO:tasks.workunit.client.0.smithi112.stdout:7/469: truncate d2/d49/f58 3076456 0 2024-09-19T09:35:21.359 INFO:tasks.workunit.client.0.smithi112.stdout:3/344: dwrite d8/ff [0,4194304] 0 2024-09-19T09:35:21.359 INFO:tasks.workunit.client.0.smithi112.stdout:3/345: chown d8/d48/c51 0 1 2024-09-19T09:35:21.359 INFO:tasks.workunit.client.0.smithi112.stdout:3/346: chown d8/c69 39 1 2024-09-19T09:35:21.359 INFO:tasks.workunit.client.0.smithi112.stdout:4/579: creat d1/d3d/d93/fc6 x:0 0 0 2024-09-19T09:35:21.360 INFO:tasks.workunit.client.0.smithi112.stdout:4/580: chown d1/d5f/da4/lbd 13966 1 2024-09-19T09:35:21.360 INFO:tasks.workunit.client.0.smithi112.stdout:4/581: chown d1/d31/d43/d48/d5c/f8f 16201 1 2024-09-19T09:35:21.363 INFO:tasks.workunit.client.0.smithi112.stdout:0/399: link d2/l4c d2/d39/d58/l7c 0 2024-09-19T09:35:21.363 INFO:tasks.workunit.client.0.smithi112.stdout:0/400: write d2/d11/f2e [1626936,111631] 0 2024-09-19T09:35:21.363 INFO:tasks.workunit.client.0.smithi112.stdout:0/401: fdatasync d2/f36 0 2024-09-19T09:35:21.364 INFO:tasks.workunit.client.0.smithi112.stdout:7/470: chown d2/d2c/d54/d18/d39/d21/c6c 11577 1 2024-09-19T09:35:21.369 INFO:tasks.workunit.client.0.smithi112.stdout:0/402: creat d2/d39/f7d x:0 0 0 2024-09-19T09:35:21.371 INFO:tasks.workunit.client.0.smithi112.stdout:7/471: creat d2/d2c/d54/d18/d39/d21/d45/fa5 x:0 0 0 2024-09-19T09:35:21.373 INFO:tasks.workunit.client.0.smithi112.stdout:3/347: rmdir d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d63 39 2024-09-19T09:35:21.377 INFO:tasks.workunit.client.0.smithi112.stdout:7/472: creat d2/d2c/d54/d18/d8a/fa6 x:0 0 0 2024-09-19T09:35:21.377 INFO:tasks.workunit.client.0.smithi112.stdout:4/582: dwrite d1/f29 [0,4194304] 0 2024-09-19T09:35:21.377 INFO:tasks.workunit.client.0.smithi112.stdout:0/403: dread d2/f4 [0,4194304] 0 2024-09-19T09:35:21.378 INFO:tasks.workunit.client.0.smithi112.stdout:3/348: getdents d8/d15/d1b/d1c/d68/d33/d59 0 2024-09-19T09:35:21.380 INFO:tasks.workunit.client.0.smithi112.stdout:7/473: creat d2/d2c/d54/d18/d39/d23/d35/fa7 x:0 0 0 2024-09-19T09:35:21.387 INFO:tasks.workunit.client.0.smithi112.stdout:0/404: rename d2/d11/c50 to d2/d6e/c7e 0 2024-09-19T09:35:21.387 INFO:tasks.workunit.client.0.smithi112.stdout:0/405: write d2/f22 [1755962,44596] 0 2024-09-19T09:35:21.389 INFO:tasks.workunit.client.0.smithi112.stdout:3/349: unlink d8/d15/d1b/d1c/d68/d33/f47 0 2024-09-19T09:35:21.391 INFO:tasks.workunit.client.0.smithi112.stdout:4/583: mknod d1/d4/cc7 0 2024-09-19T09:35:21.391 INFO:tasks.workunit.client.0.smithi112.stdout:4/584: truncate d1/d4/d3a/f92 330929 0 2024-09-19T09:35:21.392 INFO:tasks.workunit.client.0.smithi112.stdout:0/406: getdents d2/d6e/d75 0 2024-09-19T09:35:21.395 INFO:tasks.workunit.client.0.smithi112.stdout:3/350: symlink d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d5d/l79 0 2024-09-19T09:35:21.397 INFO:tasks.workunit.client.0.smithi112.stdout:0/407: creat d2/d59/d7a/f7f x:0 0 0 2024-09-19T09:35:21.398 INFO:tasks.workunit.client.0.smithi112.stdout:0/408: fsync d2/d11/f29 0 2024-09-19T09:35:21.400 INFO:tasks.workunit.client.0.smithi112.stdout:3/351: mknod d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d63/c7a 0 2024-09-19T09:35:21.401 INFO:tasks.workunit.client.0.smithi112.stdout:4/585: dread d1/d3d/f3f [0,4194304] 0 2024-09-19T09:35:21.402 INFO:tasks.workunit.client.0.smithi112.stdout:3/352: mkdir d8/d15/d1b/d1c/d68/d33/d7b 0 2024-09-19T09:35:21.402 INFO:tasks.workunit.client.0.smithi112.stdout:4/586: symlink d1/d4/d3a/d7a/lc8 0 2024-09-19T09:35:21.404 INFO:tasks.workunit.client.0.smithi112.stdout:7/474: dwrite d2/d2c/d54/d18/d39/d23/f7a [0,4194304] 0 2024-09-19T09:35:21.405 INFO:tasks.workunit.client.0.smithi112.stdout:4/587: creat d1/d4/d3a/d57/d62/d88/fc9 x:0 0 0 2024-09-19T09:35:21.412 INFO:tasks.workunit.client.0.smithi112.stdout:7/475: rmdir d2/d2c/d54/d1a 39 2024-09-19T09:35:21.430 INFO:tasks.workunit.client.0.smithi112.stdout:3/353: dwrite d8/d15/d1b/d1c/d68/f70 [0,4194304] 0 2024-09-19T09:35:21.430 INFO:tasks.workunit.client.0.smithi112.stdout:3/354: chown d8/d15/d1b/l73 646 1 2024-09-19T09:35:21.432 INFO:tasks.workunit.client.0.smithi112.stdout:3/355: creat d8/d15/d1b/d1c/f7c x:0 0 0 2024-09-19T09:35:21.437 INFO:tasks.workunit.client.0.smithi112.stdout:4/588: dwrite d1/d3d/f3f [4194304,4194304] 0 2024-09-19T09:35:21.438 INFO:tasks.workunit.client.0.smithi112.stdout:7/476: dwrite d2/d2c/d54/d18/d8a/f8b [0,4194304] 0 2024-09-19T09:35:21.439 INFO:tasks.workunit.client.0.smithi112.stdout:4/589: unlink d1/d4/c20 0 2024-09-19T09:35:21.439 INFO:tasks.workunit.client.0.smithi112.stdout:4/590: fdatasync d1/d3d/d93/fc6 0 2024-09-19T09:35:21.445 INFO:tasks.workunit.client.0.smithi112.stdout:3/356: read d8/d15/f5a [1567517,92157] 0 2024-09-19T09:35:21.446 INFO:tasks.workunit.client.0.smithi112.stdout:3/357: getdents d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d5d 0 2024-09-19T09:35:21.447 INFO:tasks.workunit.client.0.smithi112.stdout:3/358: readlink d8/d15/d1b/d28/l2d 0 2024-09-19T09:35:21.448 INFO:tasks.workunit.client.0.smithi112.stdout:4/591: dread d1/d31/d71/d91/fa0 [0,4194304] 0 2024-09-19T09:35:21.449 INFO:tasks.workunit.client.0.smithi112.stdout:4/592: rename d1/d4/f7d to d1/d3d/d72/fca 0 2024-09-19T09:35:21.455 INFO:tasks.workunit.client.0.smithi112.stdout:3/359: dread d8/d15/d1b/d1c/d68/f5b [0,4194304] 0 2024-09-19T09:35:21.456 INFO:tasks.workunit.client.0.smithi112.stdout:7/477: dwrite d2/d2c/d54/d18/d8a/f94 [0,4194304] 0 2024-09-19T09:35:21.456 INFO:tasks.workunit.client.0.smithi112.stdout:3/360: creat d8/f7d x:0 0 0 2024-09-19T09:35:21.459 INFO:tasks.workunit.client.0.smithi112.stdout:3/361: dread d8/f17 [0,4194304] 0 2024-09-19T09:35:21.462 INFO:tasks.workunit.client.0.smithi112.stdout:4/593: dread d1/f17 [4194304,4194304] 0 2024-09-19T09:35:21.462 INFO:tasks.workunit.client.0.smithi112.stdout:4/594: fdatasync d1/f53 0 2024-09-19T09:35:21.464 INFO:tasks.workunit.client.0.smithi112.stdout:3/362: mkdir d8/d48/d67/d7e 0 2024-09-19T09:35:21.465 INFO:tasks.workunit.client.0.smithi112.stdout:3/363: write d8/f17 [735682,63651] 0 2024-09-19T09:35:21.465 INFO:tasks.workunit.client.0.smithi112.stdout:3/364: write d8/d15/d1b/d1c/d68/d33/f6b [274879,103595] 0 2024-09-19T09:35:21.465 INFO:tasks.workunit.client.0.smithi112.stdout:7/478: getdents d2/d2c/d54/d18/d85 0 2024-09-19T09:35:21.465 INFO:tasks.workunit.client.0.smithi112.stdout:3/365: creat d8/d15/d1b/d1c/d68/d33/d6f/f7f x:0 0 0 2024-09-19T09:35:21.469 INFO:tasks.workunit.client.0.smithi112.stdout:4/595: stat d1/l1b 0 2024-09-19T09:35:21.469 INFO:tasks.workunit.client.0.smithi112.stdout:4/596: creat d1/d31/d71/d77/fcb x:0 0 0 2024-09-19T09:35:21.470 INFO:tasks.workunit.client.0.smithi112.stdout:3/366: dread d8/d15/d1b/d1c/d68/d33/f6b [0,4194304] 0 2024-09-19T09:35:21.470 INFO:tasks.workunit.client.0.smithi112.stdout:3/367: fdatasync d8/d15/d1b/d1c/f6c 0 2024-09-19T09:35:21.470 INFO:tasks.workunit.client.0.smithi112.stdout:3/368: truncate d8/d15/d1b/d1c/d27/d2b/f5c 1644362 0 2024-09-19T09:35:21.472 INFO:tasks.workunit.client.0.smithi112.stdout:7/479: dread d2/d49/f5a [0,4194304] 0 2024-09-19T09:35:21.475 INFO:tasks.workunit.client.0.smithi112.stdout:4/597: rename d1/l30 to d1/d31/d43/d48/lcc 0 2024-09-19T09:35:21.475 INFO:tasks.workunit.client.0.smithi112.stdout:4/598: write d1/d3d/d41/f69 [1072829,42364] 0 2024-09-19T09:35:21.478 INFO:tasks.workunit.client.0.smithi112.stdout:3/369: creat d8/d48/d67/f80 x:0 0 0 2024-09-19T09:35:21.478 INFO:tasks.workunit.client.0.smithi112.stdout:3/370: dread - d8/d48/f78 zero size 2024-09-19T09:35:21.480 INFO:tasks.workunit.client.0.smithi112.stdout:3/371: rmdir d8/d15 39 2024-09-19T09:35:21.482 INFO:tasks.workunit.client.0.smithi112.stdout:3/372: dread d8/d15/d1b/d1c/d27/d2b/f5c [0,4194304] 0 2024-09-19T09:35:21.483 INFO:tasks.workunit.client.0.smithi112.stdout:7/480: dread d2/d2c/d54/d18/d8a/f94 [0,4194304] 0 2024-09-19T09:35:21.486 INFO:tasks.workunit.client.0.smithi112.stdout:7/481: creat d2/d2c/d54/d18/d39/d23/d35/d4c/d70/d7b/fa8 x:0 0 0 2024-09-19T09:35:21.486 INFO:tasks.workunit.client.0.smithi112.stdout:7/482: dread - d2/d2c/d54/d18/d39/d23/d35/d4c/d70/d7b/f86 zero size 2024-09-19T09:35:21.501 INFO:tasks.workunit.client.0.smithi112.stdout:4/599: dwrite d1/d4/d3a/d7a/d7f/f3c [4194304,4194304] 0 2024-09-19T09:35:21.501 INFO:tasks.workunit.client.0.smithi112.stdout:3/373: dwrite d8/ff [4194304,4194304] 0 2024-09-19T09:35:21.501 INFO:tasks.workunit.client.0.smithi112.stdout:7/483: dread d2/d2c/d54/d18/d39/d23/f57 [0,4194304] 0 2024-09-19T09:35:21.501 INFO:tasks.workunit.client.0.smithi112.stdout:3/374: chown d8/d15/d1b/c42 66604013 1 2024-09-19T09:35:21.505 INFO:tasks.workunit.client.0.smithi112.stdout:4/600: mknod d1/d3d/ccd 0 2024-09-19T09:35:21.505 INFO:tasks.workunit.client.0.smithi112.stdout:4/601: write d1/d4/d3a/d57/d60/f66 [1449560,27707] 0 2024-09-19T09:35:21.505 INFO:tasks.workunit.client.0.smithi112.stdout:4/602: chown d1/f9b 4534307 1 2024-09-19T09:35:21.505 INFO:tasks.workunit.client.0.smithi112.stdout:7/484: mknod d2/d2c/d54/d18/d39/d23/ca9 0 2024-09-19T09:35:21.506 INFO:tasks.workunit.client.0.smithi112.stdout:4/603: stat d1/c3 0 2024-09-19T09:35:21.511 INFO:tasks.workunit.client.0.smithi112.stdout:3/375: write d8/f10 [3208329,103431] 0 2024-09-19T09:35:21.511 INFO:tasks.workunit.client.0.smithi112.stdout:7/485: rmdir d2/d2c/d54/d18/d39/d23/d35 39 2024-09-19T09:35:21.514 INFO:tasks.workunit.client.0.smithi112.stdout:3/376: mknod d8/d15/d1b/d1c/d27/c81 0 2024-09-19T09:35:21.514 INFO:tasks.workunit.client.0.smithi112.stdout:7/486: truncate d2/d2c/d54/d18/d39/d23/f57 4122946 0 2024-09-19T09:35:21.515 INFO:tasks.workunit.client.0.smithi112.stdout:3/377: getdents d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d63 0 2024-09-19T09:35:21.517 INFO:tasks.workunit.client.0.smithi112.stdout:7/487: symlink d2/d2c/d54/d18/da1/laa 0 2024-09-19T09:35:21.517 INFO:tasks.workunit.client.0.smithi112.stdout:7/488: write d2/d2c/d54/d18/d39/d21/f2e [2455702,78498] 0 2024-09-19T09:35:21.517 INFO:tasks.workunit.client.0.smithi112.stdout:7/489: write d2/d2c/d54/d18/f3c [2055109,34404] 0 2024-09-19T09:35:21.526 INFO:tasks.workunit.client.0.smithi112.stdout:4/604: dwrite d1/d4/d3a/d57/d60/fc5 [0,4194304] 0 2024-09-19T09:35:21.531 INFO:tasks.workunit.client.0.smithi112.stdout:4/605: dread d1/d3d/d41/f27 [0,4194304] 0 2024-09-19T09:35:21.539 INFO:tasks.workunit.client.0.smithi112.stdout:4/606: dread d1/d31/d51/f55 [0,4194304] 0 2024-09-19T09:35:21.541 INFO:tasks.workunit.client.0.smithi112.stdout:4/607: creat d1/d4/d3a/d57/fce x:0 0 0 2024-09-19T09:35:21.541 INFO:tasks.workunit.client.0.smithi112.stdout:4/608: stat d1/d31/d42/f6b 0 2024-09-19T09:35:21.541 INFO:tasks.workunit.client.0.smithi112.stdout:4/609: chown d1/d31/d42 384306428 1 2024-09-19T09:35:21.542 INFO:tasks.workunit.client.0.smithi112.stdout:3/378: dwrite d8/ff [0,4194304] 0 2024-09-19T09:35:21.542 INFO:tasks.workunit.client.0.smithi112.stdout:4/610: truncate d1/d3d/f68 271275 0 2024-09-19T09:35:21.545 INFO:tasks.workunit.client.0.smithi112.stdout:3/379: mknod d8/d15/d1b/d28/c82 0 2024-09-19T09:35:21.546 INFO:tasks.workunit.client.0.smithi112.stdout:3/380: truncate d8/d15/d1b/d1c/d43/d4f/f5f 630472 0 2024-09-19T09:35:21.550 INFO:tasks.workunit.client.0.smithi112.stdout:3/381: mkdir d8/d15/d1b/d1c/d68/d33/d83 0 2024-09-19T09:35:21.551 INFO:tasks.workunit.client.0.smithi112.stdout:3/382: chown d8 0 1 2024-09-19T09:35:21.551 INFO:tasks.workunit.client.0.smithi112.stdout:3/383: fsync d8/f17 0 2024-09-19T09:35:21.600 INFO:tasks.workunit.client.0.smithi112.stdout:5/470: sync 2024-09-19T09:35:21.600 INFO:tasks.workunit.client.0.smithi112.stdout:6/478: sync 2024-09-19T09:35:21.600 INFO:tasks.workunit.client.0.smithi112.stdout:6/479: chown d8/d11/d14 25584 1 2024-09-19T09:35:21.600 INFO:tasks.workunit.client.0.smithi112.stdout:5/471: write d4/d9/d2a/d39/f3a [574075,107826] 0 2024-09-19T09:35:21.609 INFO:tasks.workunit.client.0.smithi112.stdout:4/611: write d1/d31/d42/fc4 [1506482,40286] 0 2024-09-19T09:35:21.610 INFO:tasks.workunit.client.0.smithi112.stdout:3/384: mkdir d8/d15/d1b/d1c/d27/d2b/d84 0 2024-09-19T09:35:21.610 INFO:tasks.workunit.client.0.smithi112.stdout:3/385: creat d8/d15/d1b/d1c/d68/d33/f85 x:0 0 0 2024-09-19T09:35:21.610 INFO:tasks.workunit.client.0.smithi112.stdout:3/386: stat f6 0 2024-09-19T09:35:21.610 INFO:tasks.workunit.client.0.smithi112.stdout:3/387: readlink d8/d15/d1b/d1c/d68/d33/l36 0 2024-09-19T09:35:21.614 INFO:tasks.workunit.client.0.smithi112.stdout:6/480: rename d8/de/d66/l7e to d8/de/d18/la6 0 2024-09-19T09:35:21.615 INFO:tasks.workunit.client.0.smithi112.stdout:6/481: fdatasync d8/d11/d14/d3c/d4b/d63/f5f 0 2024-09-19T09:35:21.616 INFO:tasks.workunit.client.0.smithi112.stdout:5/472: link d4/d9/d2a/d39/f3a d4/d9/fa3 0 2024-09-19T09:35:21.616 INFO:tasks.workunit.client.0.smithi112.stdout:5/473: write d4/d9/fa3 [4275385,23658] 0 2024-09-19T09:35:21.616 INFO:tasks.workunit.client.0.smithi112.stdout:8/425: sync 2024-09-19T09:35:21.617 INFO:tasks.workunit.client.0.smithi112.stdout:3/388: creat d8/d15/d1b/d1c/d27/f86 x:0 0 0 2024-09-19T09:35:21.618 INFO:tasks.workunit.client.0.smithi112.stdout:6/482: creat d8/de/d17/fa7 x:0 0 0 2024-09-19T09:35:21.618 INFO:tasks.workunit.client.0.smithi112.stdout:6/483: write d8/d11/d13/f98 [1017506,122266] 0 2024-09-19T09:35:21.618 INFO:tasks.workunit.client.0.smithi112.stdout:6/484: fsync d8/d11/d14/d2a/f7d 0 2024-09-19T09:35:21.619 INFO:tasks.workunit.client.0.smithi112.stdout:8/426: unlink d7/db/d21/d3b/d56/d4b/d5b/f6d 0 2024-09-19T09:35:21.621 INFO:tasks.workunit.client.0.smithi112.stdout:5/474: mknod d4/d9/d17/d2f/d72/ca4 0 2024-09-19T09:35:21.622 INFO:tasks.workunit.client.0.smithi112.stdout:3/389: link d8/d15/d1b/d1c/l1d d8/d15/d1b/d1c/d68/l87 0 2024-09-19T09:35:21.623 INFO:tasks.workunit.client.0.smithi112.stdout:4/612: dwrite d1/d3d/d41/f27 [0,4194304] 0 2024-09-19T09:35:21.624 INFO:tasks.workunit.client.0.smithi112.stdout:6/485: rename d8/d11/c30 to d8/d11/d14/d2a/ca8 0 2024-09-19T09:35:21.624 INFO:tasks.workunit.client.0.smithi112.stdout:6/486: write f5 [9738483,28885] 0 2024-09-19T09:35:21.629 INFO:tasks.workunit.client.0.smithi112.stdout:6/487: symlink d8/de/d61/d70/d86/la9 0 2024-09-19T09:35:21.630 INFO:tasks.workunit.client.0.smithi112.stdout:6/488: dread d8/de/d18/f35 [0,4194304] 0 2024-09-19T09:35:21.630 INFO:tasks.workunit.client.0.smithi112.stdout:6/489: read d8/f10 [3786672,23964] 0 2024-09-19T09:35:21.631 INFO:tasks.workunit.client.0.smithi112.stdout:8/427: creat d7/db/d21/d2e/f7e x:0 0 0 2024-09-19T09:35:21.633 INFO:tasks.workunit.client.0.smithi112.stdout:6/490: mknod d8/de/d61/caa 0 2024-09-19T09:35:21.633 INFO:tasks.workunit.client.0.smithi112.stdout:8/428: mknod d7/db/d21/d2e/c7f 0 2024-09-19T09:35:21.635 INFO:tasks.workunit.client.0.smithi112.stdout:6/491: mknod d8/d11/d13/cab 0 2024-09-19T09:35:21.660 INFO:tasks.workunit.client.0.smithi112.stdout:3/390: dwrite d8/d15/d1b/d1c/d68/d33/f6b [0,4194304] 0 2024-09-19T09:35:21.664 INFO:tasks.workunit.client.0.smithi112.stdout:5/475: dwrite d4/d9/d17/d2f/d72/f42 [0,4194304] 0 2024-09-19T09:35:21.665 INFO:tasks.workunit.client.0.smithi112.stdout:4/613: dwrite d1/d4/d3a/d57/d62/fac [0,4194304] 0 2024-09-19T09:35:21.665 INFO:tasks.workunit.client.0.smithi112.stdout:8/429: dwrite d7/d10/d11/d33/f7a [0,4194304] 0 2024-09-19T09:35:21.666 INFO:tasks.workunit.client.0.smithi112.stdout:6/492: dwrite d8/d11/d14/d2a/f32 [0,4194304] 0 2024-09-19T09:35:21.667 INFO:tasks.workunit.client.0.smithi112.stdout:6/493: chown d8/l51 79 1 2024-09-19T09:35:21.667 INFO:tasks.workunit.client.0.smithi112.stdout:6/494: chown d8/de/d61/d70 403780 1 2024-09-19T09:35:21.667 INFO:tasks.workunit.client.0.smithi112.stdout:6/495: write d8/de/d17/f31 [5265688,83178] 0 2024-09-19T09:35:21.678 INFO:tasks.workunit.client.0.smithi112.stdout:6/496: rename d8/de/d17/f22 to d8/de/d66/d8f/fac 0 2024-09-19T09:35:21.679 INFO:tasks.workunit.client.0.smithi112.stdout:6/497: dread d8/d11/d14/d2a/f4d [0,4194304] 0 2024-09-19T09:35:21.680 INFO:tasks.workunit.client.0.smithi112.stdout:8/430: truncate d7/db/d21/f2a 1015954 0 2024-09-19T09:35:21.681 INFO:tasks.workunit.client.0.smithi112.stdout:6/498: mknod d8/de/d66/d6e/cad 0 2024-09-19T09:35:21.681 INFO:tasks.workunit.client.0.smithi112.stdout:6/499: chown d8 0 1 2024-09-19T09:35:21.681 INFO:tasks.workunit.client.0.smithi112.stdout:6/500: stat d8/de/d18/f58 0 2024-09-19T09:35:21.683 INFO:tasks.workunit.client.0.smithi112.stdout:6/501: truncate d8/d11/d14/f47 2331523 0 2024-09-19T09:35:21.684 INFO:tasks.workunit.client.0.smithi112.stdout:8/431: mknod d7/db/d21/d72/c80 0 2024-09-19T09:35:21.692 INFO:tasks.workunit.client.0.smithi112.stdout:3/391: dwrite d8/d15/d1b/d1c/d68/d33/f57 [0,4194304] 0 2024-09-19T09:35:21.693 INFO:tasks.workunit.client.0.smithi112.stdout:3/392: creat d8/d15/d1b/d1c/d43/f88 x:0 0 0 2024-09-19T09:35:21.693 INFO:tasks.workunit.client.0.smithi112.stdout:3/393: read - d8/d15/d1b/d1c/d68/d33/d6f/f76 zero size 2024-09-19T09:35:21.695 INFO:tasks.workunit.client.0.smithi112.stdout:6/502: dread d8/d11/d14/d3c/f59 [0,4194304] 0 2024-09-19T09:35:21.695 INFO:tasks.workunit.client.0.smithi112.stdout:5/476: dwrite d4/d29/f20 [0,4194304] 0 2024-09-19T09:35:21.695 INFO:tasks.workunit.client.0.smithi112.stdout:5/477: dread - d4/d9/d17/d30/f92 zero size 2024-09-19T09:35:21.696 INFO:tasks.workunit.client.0.smithi112.stdout:4/614: dwrite d1/d3d/f61 [4194304,4194304] 0 2024-09-19T09:35:21.696 INFO:tasks.workunit.client.0.smithi112.stdout:4/615: write d1/d31/d42/f64 [1880811,102790] 0 2024-09-19T09:35:21.696 INFO:tasks.workunit.client.0.smithi112.stdout:4/616: chown d1/d5f/da4 314 1 2024-09-19T09:35:21.696 INFO:tasks.workunit.client.0.smithi112.stdout:4/617: creat d1/d31/d51/fcf x:0 0 0 2024-09-19T09:35:21.698 INFO:tasks.workunit.client.0.smithi112.stdout:6/503: mkdir d8/de/d17/dae 0 2024-09-19T09:35:21.699 INFO:tasks.workunit.client.0.smithi112.stdout:6/504: readlink d8/de/d17/l8d 0 2024-09-19T09:35:21.699 INFO:tasks.workunit.client.0.smithi112.stdout:6/505: fsync d8/d11/d14/d2a/f4d 0 2024-09-19T09:35:21.699 INFO:tasks.workunit.client.0.smithi112.stdout:6/506: chown d8/d11/d14/d3c/d4b/c6c 0 1 2024-09-19T09:35:21.699 INFO:tasks.workunit.client.0.smithi112.stdout:6/507: dread - d8/d11/d14/d2a/fa5 zero size 2024-09-19T09:35:21.707 INFO:tasks.workunit.client.0.smithi112.stdout:6/508: unlink d8/d11/d14/f47 0 2024-09-19T09:35:21.717 INFO:tasks.workunit.client.0.smithi112.stdout:3/394: dwrite d8/f17 [0,4194304] 0 2024-09-19T09:35:21.721 INFO:tasks.workunit.client.0.smithi112.stdout:6/509: dread d8/d11/d14/d3c/d4b/d63/f5f [0,4194304] 0 2024-09-19T09:35:21.722 INFO:tasks.workunit.client.0.smithi112.stdout:3/395: rename d8/d15/d1b/d1c/d68/d33/l3b to d8/d15/d1b/d1c/d68/d33/d59/l89 0 2024-09-19T09:35:21.726 INFO:tasks.workunit.client.0.smithi112.stdout:4/618: dwrite d1/d31/d71/d77/fcb [0,4194304] 0 2024-09-19T09:35:21.733 INFO:tasks.workunit.client.0.smithi112.stdout:4/619: creat d1/d3d/d41/fd0 x:0 0 0 2024-09-19T09:35:21.733 INFO:tasks.workunit.client.0.smithi112.stdout:4/620: getdents d1/d31/d96/d9e 0 2024-09-19T09:35:21.735 INFO:tasks.workunit.client.0.smithi112.stdout:4/621: unlink d1/d31/d42/f65 0 2024-09-19T09:35:21.737 INFO:tasks.workunit.client.0.smithi112.stdout:4/622: mknod d1/d31/d51/d89/cd1 0 2024-09-19T09:35:21.737 INFO:tasks.workunit.client.0.smithi112.stdout:4/623: truncate d1/d4/d3a/f92 1085877 0 2024-09-19T09:35:21.737 INFO:tasks.workunit.client.0.smithi112.stdout:4/624: creat d1/d4/d3a/fd2 x:0 0 0 2024-09-19T09:35:21.738 INFO:tasks.workunit.client.0.smithi112.stdout:4/625: read d1/d31/d43/d48/d5c/f8f [59804,63573] 0 2024-09-19T09:35:21.738 INFO:tasks.workunit.client.0.smithi112.stdout:4/626: fdatasync d1/d31/d51/f4c 0 2024-09-19T09:35:21.741 INFO:tasks.workunit.client.0.smithi112.stdout:6/510: dwrite d8/de/d17/fa7 [0,4194304] 0 2024-09-19T09:35:21.743 INFO:tasks.workunit.client.0.smithi112.stdout:3/396: dwrite d8/f17 [0,4194304] 0 2024-09-19T09:35:21.744 INFO:tasks.workunit.client.0.smithi112.stdout:4/627: symlink d1/d5f/da4/ld3 0 2024-09-19T09:35:21.747 INFO:tasks.workunit.client.0.smithi112.stdout:3/397: truncate d8/d15/d1b/d1c/d68/f5b 2728673 0 2024-09-19T09:35:21.753 INFO:tasks.workunit.client.0.smithi112.stdout:6/511: read d8/d11/d14/d2a/f68 [2887696,122748] 0 2024-09-19T09:35:21.753 INFO:tasks.workunit.client.0.smithi112.stdout:6/512: read d8/d11/d14/d2a/f68 [3352100,4076] 0 2024-09-19T09:35:21.755 INFO:tasks.workunit.client.0.smithi112.stdout:4/628: write d1/d4/d3a/f5d [3965830,95135] 0 2024-09-19T09:35:21.755 INFO:tasks.workunit.client.0.smithi112.stdout:4/629: fsync d1/d31/d42/faf 0 2024-09-19T09:35:21.755 INFO:tasks.workunit.client.0.smithi112.stdout:3/398: dread d8/d15/d1b/d1c/d68/f5e [0,4194304] 0 2024-09-19T09:35:21.756 INFO:tasks.workunit.client.0.smithi112.stdout:3/399: write d8/d15/d1b/d1c/d68/f58 [175363,121769] 0 2024-09-19T09:35:21.756 INFO:tasks.workunit.client.0.smithi112.stdout:3/400: read - d8/d15/d1b/d1c/d68/d33/d6f/f7f zero size 2024-09-19T09:35:21.766 INFO:tasks.workunit.client.0.smithi112.stdout:6/513: symlink d8/d11/d14/d3c/laf 0 2024-09-19T09:35:21.766 INFO:tasks.workunit.client.0.smithi112.stdout:4/630: dread d1/d4/f15 [0,4194304] 0 2024-09-19T09:35:21.766 INFO:tasks.workunit.client.0.smithi112.stdout:4/631: dread - d1/d31/d43/d48/f7e zero size 2024-09-19T09:35:21.767 INFO:tasks.workunit.client.0.smithi112.stdout:6/514: mknod d8/de/d18/d20/cb0 0 2024-09-19T09:35:21.768 INFO:tasks.workunit.client.0.smithi112.stdout:4/632: link d1/d4/d3a/d57/d62/d88/fc9 d1/d31/d96/d9e/fd4 0 2024-09-19T09:35:21.769 INFO:tasks.workunit.client.0.smithi112.stdout:4/633: creat d1/d4/d3a/d57/d62/d88/fd5 x:0 0 0 2024-09-19T09:35:21.770 INFO:tasks.workunit.client.0.smithi112.stdout:6/515: rename d8/d11/d14/f1c to d8/de/d61/d70/fb1 0 2024-09-19T09:35:21.773 INFO:tasks.workunit.client.0.smithi112.stdout:4/634: mkdir d1/d3d/d72/dd6 0 2024-09-19T09:35:21.773 INFO:tasks.workunit.client.0.smithi112.stdout:4/635: fsync d1/f29 0 2024-09-19T09:35:21.774 INFO:tasks.workunit.client.0.smithi112.stdout:3/401: dwrite f6 [0,4194304] 0 2024-09-19T09:35:21.774 INFO:tasks.workunit.client.0.smithi112.stdout:3/402: fdatasync d8/d15/d1b/d1c/f37 0 2024-09-19T09:35:21.807 INFO:tasks.workunit.client.0.smithi112.stdout:3/403: dwrite d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d5d/f65 [0,4194304] 0 2024-09-19T09:35:21.807 INFO:tasks.workunit.client.0.smithi112.stdout:4/636: dwrite d1/d31/d43/d48/f63 [0,4194304] 0 2024-09-19T09:35:21.807 INFO:tasks.workunit.client.0.smithi112.stdout:3/404: creat d8/d15/d1b/d1c/d68/d33/d6f/f8a x:0 0 0 2024-09-19T09:35:21.807 INFO:tasks.workunit.client.0.smithi112.stdout:4/637: creat d1/d3d/d72/fd7 x:0 0 0 2024-09-19T09:35:21.807 INFO:tasks.workunit.client.0.smithi112.stdout:6/516: dwrite d8/de/f80 [0,4194304] 0 2024-09-19T09:35:21.814 INFO:tasks.workunit.client.0.smithi112.stdout:4/638: unlink d1/l4b 0 2024-09-19T09:35:21.814 INFO:tasks.workunit.client.0.smithi112.stdout:4/639: getdents d1/d3d/d72/dd6 0 2024-09-19T09:35:21.814 INFO:tasks.workunit.client.0.smithi112.stdout:4/640: chown d1/d5f/da4/lbd 19492086 1 2024-09-19T09:35:21.815 INFO:tasks.workunit.client.0.smithi112.stdout:4/641: dread d1/d4/d3a/f92 [0,4194304] 0 2024-09-19T09:35:21.815 INFO:tasks.workunit.client.0.smithi112.stdout:3/405: symlink d8/d15/d1b/d1c/d68/d33/d83/l8b 0 2024-09-19T09:35:21.815 INFO:tasks.workunit.client.0.smithi112.stdout:3/406: write d8/d48/f78 [633204,84395] 0 2024-09-19T09:35:21.818 INFO:tasks.workunit.client.0.smithi112.stdout:4/642: creat d1/d4/d3a/d57/d62/fd8 x:0 0 0 2024-09-19T09:35:21.825 INFO:tasks.workunit.client.0.smithi112.stdout:2/252: sync 2024-09-19T09:35:21.826 INFO:tasks.workunit.client.0.smithi112.stdout:9/202: sync 2024-09-19T09:35:21.826 INFO:tasks.workunit.client.0.smithi112.stdout:3/407: write d8/d15/d1b/d1c/d68/f70 [1151965,103994] 0 2024-09-19T09:35:21.827 INFO:tasks.workunit.client.0.smithi112.stdout:2/253: mkdir d0/d3e/d50 0 2024-09-19T09:35:21.828 INFO:tasks.workunit.client.0.smithi112.stdout:2/254: chown d0/d1 2514264 1 2024-09-19T09:35:21.828 INFO:tasks.workunit.client.0.smithi112.stdout:2/255: write d0/d1/de/f47 [748692,2021] 0 2024-09-19T09:35:21.828 INFO:tasks.workunit.client.0.smithi112.stdout:3/408: mknod d8/d15/d1b/d28/c8c 0 2024-09-19T09:35:21.830 INFO:tasks.workunit.client.0.smithi112.stdout:4/643: getdents d1/d3d/d72 0 2024-09-19T09:35:21.832 INFO:tasks.workunit.client.0.smithi112.stdout:3/409: mkdir d8/d15/d1b/d1c/d68/d8d 0 2024-09-19T09:35:21.836 INFO:tasks.workunit.client.0.smithi112.stdout:9/203: read fe [2363141,121260] 0 2024-09-19T09:35:21.837 INFO:tasks.workunit.client.0.smithi112.stdout:9/204: rename fe to df/d11/d14/f44 0 2024-09-19T09:35:21.837 INFO:tasks.workunit.client.0.smithi112.stdout:9/205: truncate df/d11/d14/f3b 95238 0 2024-09-19T09:35:21.838 INFO:tasks.workunit.client.0.smithi112.stdout:9/206: chown l8 86995 1 2024-09-19T09:35:21.838 INFO:tasks.workunit.client.0.smithi112.stdout:9/207: chown df/d11/d14/d19/d28 27646 1 2024-09-19T09:35:21.840 INFO:tasks.workunit.client.0.smithi112.stdout:6/517: dwrite d8/f9 [0,4194304] 0 2024-09-19T09:35:21.841 INFO:tasks.workunit.client.0.smithi112.stdout:3/410: dread d8/d15/d1b/d1c/d68/f5e [0,4194304] 0 2024-09-19T09:35:21.842 INFO:tasks.workunit.client.0.smithi112.stdout:2/256: dread d0/d1/f1f [0,4194304] 0 2024-09-19T09:35:21.844 INFO:tasks.workunit.client.0.smithi112.stdout:6/518: symlink d8/de/d66/d8f/lb2 0 2024-09-19T09:35:21.844 INFO:tasks.workunit.client.0.smithi112.stdout:6/519: chown d8/de/d61/d70/d86/la9 111 1 2024-09-19T09:35:21.845 INFO:tasks.workunit.client.0.smithi112.stdout:3/411: mkdir d8/d15/d1b/d1c/d68/d33/d8e 0 2024-09-19T09:35:21.846 INFO:tasks.workunit.client.0.smithi112.stdout:3/412: read d8/d15/f5a [1897971,92790] 0 2024-09-19T09:35:21.846 INFO:tasks.workunit.client.0.smithi112.stdout:4/644: write d1/d31/d71/d77/fcb [2908924,53358] 0 2024-09-19T09:35:21.847 INFO:tasks.workunit.client.0.smithi112.stdout:4/645: write d1/d31/d51/f4c [598218,93472] 0 2024-09-19T09:35:21.847 INFO:tasks.workunit.client.0.smithi112.stdout:4/646: fdatasync d1/d31/f9a 0 2024-09-19T09:35:21.847 INFO:tasks.workunit.client.0.smithi112.stdout:4/647: chown d1/d4/c10 1524808666 1 2024-09-19T09:35:21.847 INFO:tasks.workunit.client.0.smithi112.stdout:3/413: mknod d8/d15/d1b/d1c/d68/d33/c8f 0 2024-09-19T09:35:21.849 INFO:tasks.workunit.client.0.smithi112.stdout:3/414: creat d8/d15/d1b/d1c/d68/d33/d83/f90 x:0 0 0 2024-09-19T09:35:21.849 INFO:tasks.workunit.client.0.smithi112.stdout:3/415: chown d8/f4d 7747612 1 2024-09-19T09:35:21.850 INFO:tasks.workunit.client.0.smithi112.stdout:3/416: mknod d8/d15/d1b/d1c/d68/d33/d66/c91 0 2024-09-19T09:35:21.854 INFO:tasks.workunit.client.0.smithi112.stdout:9/208: dread df/d11/d14/d19/f33 [0,4194304] 0 2024-09-19T09:35:21.856 INFO:tasks.workunit.client.0.smithi112.stdout:6/520: read d8/d11/d13/f98 [953607,46948] 0 2024-09-19T09:35:21.856 INFO:tasks.workunit.client.0.smithi112.stdout:6/521: dread - d8/de/d66/f93 zero size 2024-09-19T09:35:21.876 INFO:tasks.workunit.client.0.smithi112.stdout:2/257: dwrite d0/d6/d24/f39 [0,4194304] 0 2024-09-19T09:35:21.876 INFO:tasks.workunit.client.0.smithi112.stdout:3/417: dwrite d8/d15/d1b/d1c/d68/f5b [0,4194304] 0 2024-09-19T09:35:21.876 INFO:tasks.workunit.client.0.smithi112.stdout:4/648: dwrite d1/d4/d3a/f78 [0,4194304] 0 2024-09-19T09:35:21.876 INFO:tasks.workunit.client.0.smithi112.stdout:4/649: creat d1/d4/d3a/d57/fd9 x:0 0 0 2024-09-19T09:35:21.933 INFO:tasks.workunit.client.0.smithi112.stdout:9/209: link df/d11/l2f df/d11/d14/d19/l45 0 2024-09-19T09:35:21.935 INFO:tasks.workunit.client.0.smithi112.stdout:6/522: link d8/de/d18/la6 d8/d11/d14/d2a/lb3 0 2024-09-19T09:35:21.935 INFO:tasks.workunit.client.0.smithi112.stdout:6/523: chown d8/d11/d14/c9a 0 1 2024-09-19T09:35:21.935 INFO:tasks.workunit.client.0.smithi112.stdout:6/524: write d8/d73/f76 [440650,125391] 0 2024-09-19T09:35:21.936 INFO:tasks.workunit.client.0.smithi112.stdout:6/525: write d8/d11/d14/f3e [349919,52327] 0 2024-09-19T09:35:21.936 INFO:tasks.workunit.client.0.smithi112.stdout:6/526: creat d8/de/fb4 x:0 0 0 2024-09-19T09:35:21.938 INFO:tasks.workunit.client.0.smithi112.stdout:9/210: dread df/d11/d14/f44 [0,4194304] 0 2024-09-19T09:35:21.939 INFO:tasks.workunit.client.0.smithi112.stdout:9/211: readlink l5 0 2024-09-19T09:35:22.008 INFO:tasks.workunit.client.0.smithi112.stdout:3/418: creat d8/d48/d67/d7e/f92 x:0 0 0 2024-09-19T09:35:22.015 INFO:tasks.workunit.client.0.smithi112.stdout:4/650: creat d1/d31/d96/fda x:0 0 0 2024-09-19T09:35:22.021 INFO:tasks.workunit.client.0.smithi112.stdout:2/258: rmdir d0/d1/de/d27 39 2024-09-19T09:35:22.023 INFO:tasks.workunit.client.0.smithi112.stdout:3/419: creat d8/f93 x:0 0 0 2024-09-19T09:35:22.025 INFO:tasks.workunit.client.0.smithi112.stdout:9/212: rmdir df/d20 39 2024-09-19T09:35:22.027 INFO:tasks.workunit.client.0.smithi112.stdout:2/259: link d0/d6/fc d0/d6/d24/f51 0 2024-09-19T09:35:22.029 INFO:tasks.workunit.client.0.smithi112.stdout:3/420: unlink d8/d15/d1b/d1c/d68/d33/d59/l4a 0 2024-09-19T09:35:22.029 INFO:tasks.workunit.client.0.smithi112.stdout:3/421: chown d8/f7d 447 1 2024-09-19T09:35:22.029 INFO:tasks.workunit.client.0.smithi112.stdout:3/422: read - d8/d15/d1b/d1c/f55 zero size 2024-09-19T09:35:22.029 INFO:tasks.workunit.client.0.smithi112.stdout:4/651: link d1/d31/d96/fda d1/d31/d43/d48/fdb 0 2024-09-19T09:35:22.029 INFO:tasks.workunit.client.0.smithi112.stdout:4/652: chown d1/d31/d71/d77/l97 28532438 1 2024-09-19T09:35:22.029 INFO:tasks.workunit.client.0.smithi112.stdout:4/653: chown d1/d4/d3a/fd2 4469 1 2024-09-19T09:35:22.031 INFO:tasks.workunit.client.0.smithi112.stdout:9/213: symlink df/d20/l46 0 2024-09-19T09:35:22.032 INFO:tasks.workunit.client.0.smithi112.stdout:4/654: symlink d1/d4/d3a/d57/d60/db3/ldc 0 2024-09-19T09:35:22.032 INFO:tasks.workunit.client.0.smithi112.stdout:9/214: symlink df/d35/l47 0 2024-09-19T09:35:22.034 INFO:tasks.workunit.client.0.smithi112.stdout:4/655: creat d1/fdd x:0 0 0 2024-09-19T09:35:22.035 INFO:tasks.workunit.client.0.smithi112.stdout:9/215: symlink df/d11/l48 0 2024-09-19T09:35:22.036 INFO:tasks.workunit.client.0.smithi112.stdout:4/656: mknod d1/d5f/da4/cde 0 2024-09-19T09:35:22.039 INFO:tasks.workunit.client.0.smithi112.stdout:9/216: unlink df/d11/d14/d19/d28/f32 0 2024-09-19T09:35:22.039 INFO:tasks.workunit.client.0.smithi112.stdout:9/217: dread - df/d20/f3f zero size 2024-09-19T09:35:22.039 INFO:tasks.workunit.client.0.smithi112.stdout:9/218: dread - df/d35/f38 zero size 2024-09-19T09:35:22.044 INFO:tasks.workunit.client.0.smithi112.stdout:4/657: creat d1/d31/d43/fdf x:0 0 0 2024-09-19T09:35:22.044 INFO:tasks.workunit.client.0.smithi112.stdout:4/658: dread - d1/d31/d96/fda zero size 2024-09-19T09:35:22.052 INFO:tasks.workunit.client.0.smithi112.stdout:9/219: dwrite df/d20/f3d [0,4194304] 0 2024-09-19T09:35:22.062 INFO:tasks.workunit.client.0.smithi112.stdout:9/220: rmdir df/d11/d14/d19/d28 39 2024-09-19T09:35:22.071 INFO:tasks.workunit.client.0.smithi112.stdout:9/221: dread f3 [0,4194304] 0 2024-09-19T09:35:22.095 INFO:tasks.workunit.client.0.smithi112.stdout:9/222: dwrite df/d11/d14/f18 [0,4194304] 0 2024-09-19T09:35:22.103 INFO:tasks.workunit.client.0.smithi112.stdout:9/223: rename df/d11/c37 to df/d20/c49 0 2024-09-19T09:35:22.108 INFO:tasks.workunit.client.0.smithi112.stdout:9/224: unlink l4 0 2024-09-19T09:35:22.110 INFO:tasks.workunit.client.0.smithi112.stdout:9/225: link df/d11/d14/f2e df/d20/f4a 0 2024-09-19T09:35:22.129 INFO:tasks.workunit.client.0.smithi112.stdout:9/226: dwrite df/d11/d14/f3b [0,4194304] 0 2024-09-19T09:35:22.132 INFO:tasks.workunit.client.0.smithi112.stdout:9/227: dread df/d11/d14/f1d [4194304,4194304] 0 2024-09-19T09:35:22.132 INFO:tasks.workunit.client.0.smithi112.stdout:9/228: chown df/d11/d14/f2e 25727415 1 2024-09-19T09:35:22.139 INFO:tasks.workunit.client.0.smithi112.stdout:1/202: sync 2024-09-19T09:35:22.140 INFO:tasks.workunit.client.0.smithi112.stdout:7/490: sync 2024-09-19T09:35:22.140 INFO:tasks.workunit.client.0.smithi112.stdout:0/409: sync 2024-09-19T09:35:22.140 INFO:tasks.workunit.client.0.smithi112.stdout:1/203: stat dc/d26/d34/l35 0 2024-09-19T09:35:22.140 INFO:tasks.workunit.client.0.smithi112.stdout:1/204: dread - dc/d13/f33 zero size 2024-09-19T09:35:22.140 INFO:tasks.workunit.client.0.smithi112.stdout:1/205: chown dc/d26/d34/d36 2 1 2024-09-19T09:35:22.140 INFO:tasks.workunit.client.0.smithi112.stdout:1/206: creat dc/d26/f3c x:0 0 0 2024-09-19T09:35:22.140 INFO:tasks.workunit.client.0.smithi112.stdout:0/410: creat d2/d39/d3b/d44/f80 x:0 0 0 2024-09-19T09:35:22.140 INFO:tasks.workunit.client.0.smithi112.stdout:1/207: fdatasync dc/f21 0 2024-09-19T09:35:22.141 INFO:tasks.workunit.client.0.smithi112.stdout:7/491: truncate d2/d2c/d54/d1a/f1b 120206 0 2024-09-19T09:35:22.145 INFO:tasks.workunit.client.0.smithi112.stdout:0/411: mkdir d2/d81 0 2024-09-19T09:35:22.148 INFO:tasks.workunit.client.0.smithi112.stdout:9/229: dwrite df/d11/d14/f44 [4194304,4194304] 0 2024-09-19T09:35:22.149 INFO:tasks.workunit.client.0.smithi112.stdout:7/492: rename d2/d2c/d54/d18/d39/d23/l8f to d2/d2c/d54/d18/d85/lab 0 2024-09-19T09:35:22.149 INFO:tasks.workunit.client.0.smithi112.stdout:7/493: write d2/d2c/f38 [278432,39138] 0 2024-09-19T09:35:22.149 INFO:tasks.workunit.client.0.smithi112.stdout:7/494: read - d2/d2c/d54/d1a/f42 zero size 2024-09-19T09:35:22.154 INFO:tasks.workunit.client.0.smithi112.stdout:9/230: creat df/d11/d14/d19/d40/f4b x:0 0 0 2024-09-19T09:35:22.154 INFO:tasks.workunit.client.0.smithi112.stdout:9/231: fdatasync df/d11/d14/f41 0 2024-09-19T09:35:22.155 INFO:tasks.workunit.client.0.smithi112.stdout:0/412: dread d2/d39/f4f [0,4194304] 0 2024-09-19T09:35:22.155 INFO:tasks.workunit.client.0.smithi112.stdout:1/208: dwrite dc/d24/f32 [0,4194304] 0 2024-09-19T09:35:22.155 INFO:tasks.workunit.client.0.smithi112.stdout:1/209: readlink dc/d26/d34/l31 0 2024-09-19T09:35:22.155 INFO:tasks.workunit.client.0.smithi112.stdout:7/495: mknod d2/d2c/d54/d18/d39/d23/d35/d76/cac 0 2024-09-19T09:35:22.158 INFO:tasks.workunit.client.0.smithi112.stdout:0/413: link d2/l2c d2/d68/l82 0 2024-09-19T09:35:22.159 INFO:tasks.workunit.client.0.smithi112.stdout:1/210: rename dc/d26/d34/d36/f37 to dc/d26/f3d 0 2024-09-19T09:35:22.161 INFO:tasks.workunit.client.0.smithi112.stdout:7/496: dread d2/d2c/f38 [0,4194304] 0 2024-09-19T09:35:22.162 INFO:tasks.workunit.client.0.smithi112.stdout:9/232: dread df/d11/d14/f44 [0,4194304] 0 2024-09-19T09:35:22.163 INFO:tasks.workunit.client.0.smithi112.stdout:1/211: rmdir dc 39 2024-09-19T09:35:22.165 INFO:tasks.workunit.client.0.smithi112.stdout:7/497: rename d2/d2c/d54/d18/d39/d21/d45/d4d/f95 to d2/d2c/d54/d18/d39/d23/d35/fad 0 2024-09-19T09:35:22.172 INFO:tasks.workunit.client.0.smithi112.stdout:1/212: mknod dc/d26/d34/d36/c3e 0 2024-09-19T09:35:22.178 INFO:tasks.workunit.client.0.smithi112.stdout:9/233: dwrite df/d11/d14/f41 [0,4194304] 0 2024-09-19T09:35:22.178 INFO:tasks.workunit.client.0.smithi112.stdout:9/234: stat df/d11/d14/f2d 0 2024-09-19T09:35:22.191 INFO:tasks.workunit.client.0.smithi112.stdout:1/213: dwrite dc/d24/f2d [0,4194304] 0 2024-09-19T09:35:22.192 INFO:tasks.workunit.client.0.smithi112.stdout:9/235: dread df/d11/d14/f18 [0,4194304] 0 2024-09-19T09:35:22.193 INFO:tasks.workunit.client.0.smithi112.stdout:7/498: dwrite d2/f59 [0,4194304] 0 2024-09-19T09:35:22.194 INFO:tasks.workunit.client.0.smithi112.stdout:7/499: symlink d2/d2c/d54/d18/d8a/d7c/lae 0 2024-09-19T09:35:22.195 INFO:tasks.workunit.client.0.smithi112.stdout:7/500: link d2/d49/c55 d2/d2c/d54/d18/d39/caf 0 2024-09-19T09:35:22.196 INFO:tasks.workunit.client.0.smithi112.stdout:7/501: creat d2/d99/fb0 x:0 0 0 2024-09-19T09:35:22.196 INFO:tasks.workunit.client.0.smithi112.stdout:7/502: write d2/d2c/d54/d18/d85/f92 [156,17808] 0 2024-09-19T09:35:22.197 INFO:tasks.workunit.client.0.smithi112.stdout:7/503: mkdir d2/d2c/d54/d18/d8a/d7c/db1 0 2024-09-19T09:35:22.197 INFO:tasks.workunit.client.0.smithi112.stdout:7/504: write d2/d2c/f38 [1323959,59812] 0 2024-09-19T09:35:22.200 INFO:tasks.workunit.client.0.smithi112.stdout:7/505: unlink d2/d2c/d54/d18/d39/d21/l6a 0 2024-09-19T09:35:22.209 INFO:tasks.workunit.client.0.smithi112.stdout:1/214: write dc/fe [5385110,42099] 0 2024-09-19T09:35:22.211 INFO:tasks.workunit.client.0.smithi112.stdout:1/215: link dc/f1f dc/d26/d34/f3f 0 2024-09-19T09:35:22.214 INFO:tasks.workunit.client.0.smithi112.stdout:1/216: rename dc/d24/f15 to dc/d24/f40 0 2024-09-19T09:35:22.214 INFO:tasks.workunit.client.0.smithi112.stdout:1/217: creat dc/d13/f41 x:0 0 0 2024-09-19T09:35:22.214 INFO:tasks.workunit.client.0.smithi112.stdout:9/236: dwrite df/d11/f25 [0,4194304] 0 2024-09-19T09:35:22.214 INFO:tasks.workunit.client.0.smithi112.stdout:9/237: write df/d35/f38 [672784,8008] 0 2024-09-19T09:35:22.214 INFO:tasks.workunit.client.0.smithi112.stdout:9/238: chown df/d11/d14/f2e 63448016 1 2024-09-19T09:35:22.219 INFO:tasks.workunit.client.0.smithi112.stdout:9/239: unlink ld 0 2024-09-19T09:35:22.220 INFO:tasks.workunit.client.0.smithi112.stdout:7/506: dwrite d2/d2c/d54/d18/d39/d23/d35/d4c/f9d [0,4194304] 0 2024-09-19T09:35:22.221 INFO:tasks.workunit.client.0.smithi112.stdout:1/218: dread f1 [0,4194304] 0 2024-09-19T09:35:22.222 INFO:tasks.workunit.client.0.smithi112.stdout:9/240: rename df/d20/f3f to df/d11/d14/f4c 0 2024-09-19T09:35:22.237 INFO:tasks.workunit.client.0.smithi112.stdout:7/507: dwrite d2/d2c/d54/d18/d39/d21/d45/fa5 [0,4194304] 0 2024-09-19T09:35:22.240 INFO:tasks.workunit.client.0.smithi112.stdout:1/219: rename dc/d24/f2d to dc/d13/f42 0 2024-09-19T09:35:22.240 INFO:tasks.workunit.client.0.smithi112.stdout:1/220: write dc/f2a [892793,5717] 0 2024-09-19T09:35:22.248 INFO:tasks.workunit.client.0.smithi112.stdout:9/241: rename df/d20 to df/d4d 0 2024-09-19T09:35:22.248 INFO:tasks.workunit.client.0.smithi112.stdout:9/242: chown df/l2b 4486191 1 2024-09-19T09:35:22.249 INFO:tasks.workunit.client.0.smithi112.stdout:7/508: rename d2/fd to d2/d2c/d54/d18/d85/fb2 0 2024-09-19T09:35:22.253 INFO:tasks.workunit.client.0.smithi112.stdout:8/432: sync 2024-09-19T09:35:22.253 INFO:tasks.workunit.client.0.smithi112.stdout:5/478: sync 2024-09-19T09:35:22.253 INFO:tasks.workunit.client.0.smithi112.stdout:5/479: chown d4/d9/l12 5 1 2024-09-19T09:35:22.253 INFO:tasks.workunit.client.0.smithi112.stdout:5/480: truncate d4/d9/d6b/f6d 776573 0 2024-09-19T09:35:22.254 INFO:tasks.workunit.client.0.smithi112.stdout:1/221: rename dc/l2b to dc/d26/d34/d36/l43 0 2024-09-19T09:35:22.257 INFO:tasks.workunit.client.0.smithi112.stdout:8/433: mknod d7/d10/d11/d33/c81 0 2024-09-19T09:35:22.257 INFO:tasks.workunit.client.0.smithi112.stdout:5/481: rmdir d4/d29/d36 39 2024-09-19T09:35:22.259 INFO:tasks.workunit.client.0.smithi112.stdout:5/482: write d4/d84/f99 [360070,78137] 0 2024-09-19T09:35:22.260 INFO:tasks.workunit.client.0.smithi112.stdout:1/222: mkdir dc/d26/d44 0 2024-09-19T09:35:22.263 INFO:tasks.workunit.client.0.smithi112.stdout:7/509: dwrite d2/d2c/d54/d18/d39/d23/d35/d4c/d70/d7b/fa8 [0,4194304] 0 2024-09-19T09:35:22.267 INFO:tasks.workunit.client.0.smithi112.stdout:8/434: dread d7/db/d21/f2a [0,4194304] 0 2024-09-19T09:35:22.267 INFO:tasks.workunit.client.0.smithi112.stdout:5/483: symlink d4/d9/d17/la5 0 2024-09-19T09:35:22.272 INFO:tasks.workunit.client.0.smithi112.stdout:5/484: mkdir d4/d9/d17/da6 0 2024-09-19T09:35:22.275 INFO:tasks.workunit.client.0.smithi112.stdout:5/485: unlink d4/d9/d17/d2f/d7d/l83 0 2024-09-19T09:35:22.278 INFO:tasks.workunit.client.0.smithi112.stdout:5/486: rename d4/d9/d17/d30/f38 to d4/d9/fa7 0 2024-09-19T09:35:22.278 INFO:tasks.workunit.client.0.smithi112.stdout:5/487: creat d4/d29/d36/d56/fa8 x:0 0 0 2024-09-19T09:35:22.279 INFO:tasks.workunit.client.0.smithi112.stdout:7/510: write d2/d2c/d54/d18/d39/d23/d35/d4c/d70/d7b/fa8 [4807366,126288] 0 2024-09-19T09:35:22.279 INFO:tasks.workunit.client.0.smithi112.stdout:7/511: write d2/d2c/d54/d1a/f3d [1422822,46928] 0 2024-09-19T09:35:22.279 INFO:tasks.workunit.client.0.smithi112.stdout:7/512: fsync d2/d2c/d54/d18/d39/d23/d35/f9c 0 2024-09-19T09:35:22.279 INFO:tasks.workunit.client.0.smithi112.stdout:7/513: dread - d2/d2c/f69 zero size 2024-09-19T09:35:22.279 INFO:tasks.workunit.client.0.smithi112.stdout:7/514: truncate d2/d99/fb0 460619 0 2024-09-19T09:35:22.279 INFO:tasks.workunit.client.0.smithi112.stdout:1/223: dwrite f2 [4194304,4194304] 0 2024-09-19T09:35:22.283 INFO:tasks.workunit.client.0.smithi112.stdout:7/515: mknod d2/d2c/d54/d18/d39/d23/d35/d76/cb3 0 2024-09-19T09:35:22.283 INFO:tasks.workunit.client.0.smithi112.stdout:7/516: chown d2/d2c/d54/d18/d39/d23/ca9 610 1 2024-09-19T09:35:22.284 INFO:tasks.workunit.client.0.smithi112.stdout:1/224: rmdir dc/d26/d34/d36 39 2024-09-19T09:35:22.286 INFO:tasks.workunit.client.0.smithi112.stdout:8/435: dwrite d7/db/d21/d3b/d56/d4b/f71 [0,4194304] 0 2024-09-19T09:35:22.287 INFO:tasks.workunit.client.0.smithi112.stdout:7/517: mkdir d2/d2c/d54/d18/db4 0 2024-09-19T09:35:22.291 INFO:tasks.workunit.client.0.smithi112.stdout:7/518: symlink d2/d2c/d54/lb5 0 2024-09-19T09:35:22.301 INFO:tasks.workunit.client.0.smithi112.stdout:8/436: write d7/db/f45 [6625340,93853] 0 2024-09-19T09:35:22.303 INFO:tasks.workunit.client.0.smithi112.stdout:8/437: creat d7/d10/d11/d50/f82 x:0 0 0 2024-09-19T09:35:22.303 INFO:tasks.workunit.client.0.smithi112.stdout:8/438: truncate d7/d10/f16 4911593 0 2024-09-19T09:35:22.305 INFO:tasks.workunit.client.0.smithi112.stdout:8/439: unlink d7/db/d21/d3b/d56/d4b/l75 0 2024-09-19T09:35:22.305 INFO:tasks.workunit.client.0.smithi112.stdout:5/488: dwrite d4/d9/fa3 [0,4194304] 0 2024-09-19T09:35:22.306 INFO:tasks.workunit.client.0.smithi112.stdout:5/489: chown d4/d9/f25 165 1 2024-09-19T09:35:22.307 INFO:tasks.workunit.client.0.smithi112.stdout:5/490: mkdir d4/d3f/da9 0 2024-09-19T09:35:22.308 INFO:tasks.workunit.client.0.smithi112.stdout:5/491: rename d4/d9/d17/d30/c9d to d4/d9/d2a/d46/caa 0 2024-09-19T09:35:22.310 INFO:tasks.workunit.client.0.smithi112.stdout:1/225: dwrite f1 [0,4194304] 0 2024-09-19T09:35:22.310 INFO:tasks.workunit.client.0.smithi112.stdout:1/226: chown dc/f20 0 1 2024-09-19T09:35:22.310 INFO:tasks.workunit.client.0.smithi112.stdout:1/227: fdatasync dc/ff 0 2024-09-19T09:35:22.311 INFO:tasks.workunit.client.0.smithi112.stdout:1/228: mkdir dc/d24/d45 0 2024-09-19T09:35:22.311 INFO:tasks.workunit.client.0.smithi112.stdout:1/229: dread - dc/d26/f29 zero size 2024-09-19T09:35:22.311 INFO:tasks.workunit.client.0.smithi112.stdout:1/230: creat dc/d24/f46 x:0 0 0 2024-09-19T09:35:22.314 INFO:tasks.workunit.client.0.smithi112.stdout:1/231: symlink dc/d26/d44/l47 0 2024-09-19T09:35:22.315 INFO:tasks.workunit.client.0.smithi112.stdout:1/232: symlink dc/d26/d44/l48 0 2024-09-19T09:35:22.315 INFO:tasks.workunit.client.0.smithi112.stdout:1/233: fsync dc/d13/f1b 0 2024-09-19T09:35:22.322 INFO:tasks.workunit.client.0.smithi112.stdout:5/492: read d4/d9/d3e/f77 [3279221,14906] 0 2024-09-19T09:35:22.322 INFO:tasks.workunit.client.0.smithi112.stdout:7/519: dwrite d2/d2c/d54/d18/d39/d21/f51 [4194304,4194304] 0 2024-09-19T09:35:22.322 INFO:tasks.workunit.client.0.smithi112.stdout:7/520: symlink d2/d2c/d54/d18/da1/lb6 0 2024-09-19T09:35:22.322 INFO:tasks.workunit.client.0.smithi112.stdout:7/521: readlink d2/d2c/d54/d18/d39/d23/d35/d76/l8e 0 2024-09-19T09:35:22.323 INFO:tasks.workunit.client.0.smithi112.stdout:7/522: creat d2/d2c/d54/d18/d39/fb7 x:0 0 0 2024-09-19T09:35:22.324 INFO:tasks.workunit.client.0.smithi112.stdout:8/440: dwrite d7/d67/f4f [4194304,4194304] 0 2024-09-19T09:35:22.324 INFO:tasks.workunit.client.0.smithi112.stdout:8/441: write d7/db/d21/d2e/f7e [1040910,104242] 0 2024-09-19T09:35:22.325 INFO:tasks.workunit.client.0.smithi112.stdout:7/523: dread d2/d2c/d54/d18/d39/f9e [0,4194304] 0 2024-09-19T09:35:22.330 INFO:tasks.workunit.client.0.smithi112.stdout:8/442: creat d7/d65/f83 x:0 0 0 2024-09-19T09:35:22.331 INFO:tasks.workunit.client.0.smithi112.stdout:7/524: symlink d2/d2c/d54/d18/d39/d23/d35/d4c/d70/d7b/lb8 0 2024-09-19T09:35:22.331 INFO:tasks.workunit.client.0.smithi112.stdout:7/525: chown d2/d2c/d54/d18/d39/d21/d45/f5c 221015103 1 2024-09-19T09:35:22.332 INFO:tasks.workunit.client.0.smithi112.stdout:8/443: truncate d7/d10/d11/d33/f7a 2880384 0 2024-09-19T09:35:22.332 INFO:tasks.workunit.client.0.smithi112.stdout:7/526: getdents d2/d2c 0 2024-09-19T09:35:22.334 INFO:tasks.workunit.client.0.smithi112.stdout:8/444: creat d7/db/d21/d3b/d56/d3c/f84 x:0 0 0 2024-09-19T09:35:22.335 INFO:tasks.workunit.client.0.smithi112.stdout:8/445: read d7/db/d21/d2e/f7e [702800,3707] 0 2024-09-19T09:35:22.337 INFO:tasks.workunit.client.0.smithi112.stdout:8/446: rmdir d7/d10/d11/d50/d7b 0 2024-09-19T09:35:22.339 INFO:tasks.workunit.client.0.smithi112.stdout:8/447: rmdir d7/d67 39 2024-09-19T09:35:22.339 INFO:tasks.workunit.client.0.smithi112.stdout:8/448: readlink d7/d10/d11/d50/l77 0 2024-09-19T09:35:22.343 INFO:tasks.workunit.client.0.smithi112.stdout:7/527: dread d2/d2c/d54/d18/d39/d23/f57 [0,4194304] 0 2024-09-19T09:35:22.354 INFO:tasks.workunit.client.0.smithi112.stdout:7/528: read d2/d2c/d54/d18/f3e [1761547,10053] 0 2024-09-19T09:35:22.355 INFO:tasks.workunit.client.0.smithi112.stdout:7/529: mknod d2/cb9 0 2024-09-19T09:35:22.356 INFO:tasks.workunit.client.0.smithi112.stdout:8/449: dwrite d7/db/d21/d3b/d56/d3c/f3d [4194304,4194304] 0 2024-09-19T09:35:22.365 INFO:tasks.workunit.client.0.smithi112.stdout:8/450: dread d7/db/d21/d3b/d56/d3c/f3d [4194304,4194304] 0 2024-09-19T09:35:22.365 INFO:tasks.workunit.client.0.smithi112.stdout:8/451: mkdir d7/db/d21/d3b/d56/d3c/d79/d85 0 2024-09-19T09:35:22.371 INFO:tasks.workunit.client.0.smithi112.stdout:8/452: write d7/db/d21/d3b/d56/d3c/f3d [6288485,127547] 0 2024-09-19T09:35:22.371 INFO:tasks.workunit.client.0.smithi112.stdout:7/530: dwrite d2/d2c/d54/d18/d39/d23/d35/f4b [0,4194304] 0 2024-09-19T09:35:22.371 INFO:tasks.workunit.client.0.smithi112.stdout:7/531: write d2/d2c/d54/d18/d39/d21/fa2 [708003,99124] 0 2024-09-19T09:35:22.373 INFO:tasks.workunit.client.0.smithi112.stdout:7/532: mkdir d2/d2c/d54/dba 0 2024-09-19T09:35:22.373 INFO:tasks.workunit.client.0.smithi112.stdout:7/533: read d2/d49/f58 [3053102,125621] 0 2024-09-19T09:35:22.374 INFO:tasks.workunit.client.0.smithi112.stdout:7/534: mknod d2/d2c/d54/cbb 0 2024-09-19T09:35:22.375 INFO:tasks.workunit.client.0.smithi112.stdout:7/535: creat d2/d2c/d54/d1a/fbc x:0 0 0 2024-09-19T09:35:22.382 INFO:tasks.workunit.client.0.smithi112.stdout:7/536: dread d2/d2c/d54/d18/d39/d21/d45/f5c [0,4194304] 0 2024-09-19T09:35:22.384 INFO:tasks.workunit.client.0.smithi112.stdout:7/537: creat d2/d2c/d54/d18/db4/fbd x:0 0 0 2024-09-19T09:35:22.385 INFO:tasks.workunit.client.0.smithi112.stdout:7/538: mkdir d2/d2c/d54/d18/d39/d21/d45/d4d/dbe 0 2024-09-19T09:35:22.385 INFO:tasks.workunit.client.0.smithi112.stdout:7/539: chown d2/d2c/d54/d18/d39/d23/d35/d4c/d70/d7b/f86 57174888 1 2024-09-19T09:35:22.388 INFO:tasks.workunit.client.0.smithi112.stdout:8/453: dwrite d7/db/d21/d3b/d56/d4b/f5f [0,4194304] 0 2024-09-19T09:35:22.388 INFO:tasks.workunit.client.0.smithi112.stdout:8/454: fdatasync d7/d67/f4f 0 2024-09-19T09:35:22.402 INFO:tasks.workunit.client.0.smithi112.stdout:6/527: sync 2024-09-19T09:35:22.404 INFO:tasks.workunit.client.0.smithi112.stdout:6/528: getdents d8/de/d61/d70/d7b/d8a 0 2024-09-19T09:35:22.404 INFO:tasks.workunit.client.0.smithi112.stdout:6/529: fsync d8/d11/d14/d2a/f3d 0 2024-09-19T09:35:22.404 INFO:tasks.workunit.client.0.smithi112.stdout:8/455: dwrite d7/db/f73 [0,4194304] 0 2024-09-19T09:35:22.407 INFO:tasks.workunit.client.0.smithi112.stdout:6/530: dread d8/f23 [8388608,4194304] 0 2024-09-19T09:35:22.407 INFO:tasks.workunit.client.0.smithi112.stdout:6/531: write d8/d11/d14/f24 [1093262,125282] 0 2024-09-19T09:35:22.410 INFO:tasks.workunit.client.0.smithi112.stdout:6/532: mkdir d8/de/d61/d70/db5 0 2024-09-19T09:35:22.412 INFO:tasks.workunit.client.0.smithi112.stdout:6/533: truncate d8/de/d18/d20/f69 20601 0 2024-09-19T09:35:22.413 INFO:tasks.workunit.client.0.smithi112.stdout:6/534: dread - d8/d11/d14/d2a/f7d zero size 2024-09-19T09:35:22.414 INFO:tasks.workunit.client.0.smithi112.stdout:6/535: creat d8/de/d61/d70/fb6 x:0 0 0 2024-09-19T09:35:22.414 INFO:tasks.workunit.client.0.smithi112.stdout:8/456: write d7/db/f73 [1913702,48657] 0 2024-09-19T09:35:22.416 INFO:tasks.workunit.client.0.smithi112.stdout:6/536: symlink d8/de/d18/d20/lb7 0 2024-09-19T09:35:22.416 INFO:tasks.workunit.client.0.smithi112.stdout:6/537: write d8/de/d66/d6e/f92 [7530,123999] 0 2024-09-19T09:35:22.423 INFO:tasks.workunit.client.0.smithi112.stdout:8/457: dread d7/d10/f16 [0,4194304] 0 2024-09-19T09:35:22.423 INFO:tasks.workunit.client.0.smithi112.stdout:6/538: read d8/de/f80 [1837815,60298] 0 2024-09-19T09:35:22.424 INFO:tasks.workunit.client.0.smithi112.stdout:8/458: mknod d7/d10/d11/d62/c86 0 2024-09-19T09:35:22.425 INFO:tasks.workunit.client.0.smithi112.stdout:6/539: mknod d8/de/d17/dae/cb8 0 2024-09-19T09:35:22.425 INFO:tasks.workunit.client.0.smithi112.stdout:6/540: creat d8/d11/d14/d2a/fb9 x:0 0 0 2024-09-19T09:35:22.426 INFO:tasks.workunit.client.0.smithi112.stdout:8/459: mknod d7/db/d21/d3b/d56/d48/c87 0 2024-09-19T09:35:22.426 INFO:tasks.workunit.client.0.smithi112.stdout:8/460: chown d7/db/d21/d3b 19879041 1 2024-09-19T09:35:22.437 INFO:tasks.workunit.client.0.smithi112.stdout:6/541: dread d8/d11/f43 [0,4194304] 0 2024-09-19T09:35:22.437 INFO:tasks.workunit.client.0.smithi112.stdout:6/542: chown d8/de/d17/d94 0 1 2024-09-19T09:35:22.438 INFO:tasks.workunit.client.0.smithi112.stdout:6/543: link d8/d11/d13/f98 d8/de/d17/dae/fba 0 2024-09-19T09:35:22.444 INFO:tasks.workunit.client.0.smithi112.stdout:8/461: dwrite d7/d10/f16 [4194304,4194304] 0 2024-09-19T09:35:22.456 INFO:tasks.workunit.client.0.smithi112.stdout:8/462: write d7/db/d21/f22 [5398346,128149] 0 2024-09-19T09:35:22.456 INFO:tasks.workunit.client.0.smithi112.stdout:8/463: truncate d7/d10/d11/d33/f27 1823572 0 2024-09-19T09:35:22.458 INFO:tasks.workunit.client.0.smithi112.stdout:6/544: dwrite d8/de/d66/d6e/f92 [0,4194304] 0 2024-09-19T09:35:22.461 INFO:tasks.workunit.client.0.smithi112.stdout:6/545: rename d8/l51 to d8/de/d61/d70/d86/lbb 0 2024-09-19T09:35:22.463 INFO:tasks.workunit.client.0.smithi112.stdout:8/464: dread d7/fa [0,4194304] 0 2024-09-19T09:35:22.472 INFO:tasks.workunit.client.0.smithi112.stdout:6/546: dread d8/d11/f34 [4194304,4194304] 0 2024-09-19T09:35:22.474 INFO:tasks.workunit.client.0.smithi112.stdout:6/547: unlink d8/de/d61/f99 0 2024-09-19T09:35:22.475 INFO:tasks.workunit.client.0.smithi112.stdout:6/548: mknod d8/de/d61/d70/d7b/d8a/cbc 0 2024-09-19T09:35:22.476 INFO:tasks.workunit.client.0.smithi112.stdout:8/465: dread d7/db/d21/f22 [0,4194304] 0 2024-09-19T09:35:22.476 INFO:tasks.workunit.client.0.smithi112.stdout:6/549: creat d8/de/d66/d6e/fbd x:0 0 0 2024-09-19T09:35:22.477 INFO:tasks.workunit.client.0.smithi112.stdout:6/550: creat d8/de/d18/d20/fbe x:0 0 0 2024-09-19T09:35:22.477 INFO:tasks.workunit.client.0.smithi112.stdout:8/466: getdents d7/db/d21/d72 0 2024-09-19T09:35:22.479 INFO:tasks.workunit.client.0.smithi112.stdout:8/467: creat d7/d10/d11/d62/f88 x:0 0 0 2024-09-19T09:35:22.480 INFO:tasks.workunit.client.0.smithi112.stdout:8/468: symlink d7/db/d21/d2e/d42/d57/l89 0 2024-09-19T09:35:22.482 INFO:tasks.workunit.client.0.smithi112.stdout:8/469: symlink d7/db/d21/d3b/d56/d4b/l8a 0 2024-09-19T09:35:22.483 INFO:tasks.workunit.client.0.smithi112.stdout:8/470: unlink d7/db/d21/f2a 0 2024-09-19T09:35:22.484 INFO:tasks.workunit.client.0.smithi112.stdout:8/471: read d7/db/d21/f47 [1094018,2766] 0 2024-09-19T09:35:22.491 INFO:tasks.workunit.client.0.smithi112.stdout:6/551: dwrite d8/d11/d14/d2a/fb9 [0,4194304] 0 2024-09-19T09:35:22.497 INFO:tasks.workunit.client.0.smithi112.stdout:6/552: mkdir d8/de/d61/dbf 0 2024-09-19T09:35:22.497 INFO:tasks.workunit.client.0.smithi112.stdout:6/553: fdatasync d8/de/d61/d70/fb1 0 2024-09-19T09:35:22.497 INFO:tasks.workunit.client.0.smithi112.stdout:6/554: write d8/d11/d14/d3c/f59 [3278812,116991] 0 2024-09-19T09:35:22.503 INFO:tasks.workunit.client.0.smithi112.stdout:8/472: dwrite d7/db/d21/d3b/d56/d4b/f71 [0,4194304] 0 2024-09-19T09:35:22.513 INFO:tasks.workunit.client.0.smithi112.stdout:8/473: read d7/f76 [2905692,15427] 0 2024-09-19T09:35:22.513 INFO:tasks.workunit.client.0.smithi112.stdout:8/474: fsync d7/fd 0 2024-09-19T09:35:22.514 INFO:tasks.workunit.client.0.smithi112.stdout:8/475: symlink d7/db/d21/d3b/d56/d3c/d79/l8b 0 2024-09-19T09:35:22.531 INFO:tasks.workunit.client.0.smithi112.stdout:8/476: dwrite d7/db/d21/f22 [0,4194304] 0 2024-09-19T09:35:22.540 INFO:tasks.workunit.client.0.smithi112.stdout:8/477: read d7/d10/d11/f2b [343536,20574] 0 2024-09-19T09:35:22.540 INFO:tasks.workunit.client.0.smithi112.stdout:8/478: fdatasync d7/db/d21/d3b/d56/d4b/f71 0 2024-09-19T09:35:22.541 INFO:tasks.workunit.client.0.smithi112.stdout:8/479: mkdir d7/db/d21/d2e/d8c 0 2024-09-19T09:35:22.542 INFO:tasks.workunit.client.0.smithi112.stdout:8/480: mknod d7/d10/d11/c8d 0 2024-09-19T09:35:22.544 INFO:tasks.workunit.client.0.smithi112.stdout:8/481: unlink d7/l66 0 2024-09-19T09:35:22.544 INFO:tasks.workunit.client.0.smithi112.stdout:8/482: truncate d7/d67/f5d 153451 0 2024-09-19T09:35:22.544 INFO:tasks.workunit.client.0.smithi112.stdout:8/483: chown d7/db/d21/d2e/f7e 11719 1 2024-09-19T09:35:22.545 INFO:tasks.workunit.client.0.smithi112.stdout:8/484: symlink d7/db/d21/d3b/d56/d3c/l8e 0 2024-09-19T09:35:22.548 INFO:tasks.workunit.client.0.smithi112.stdout:8/485: rename d7/d10/d11/d62/f88 to d7/db/d21/d2e/d8c/f8f 0 2024-09-19T09:35:22.565 INFO:tasks.workunit.client.0.smithi112.stdout:8/486: dwrite d7/db/d21/d3b/d56/d3c/f84 [0,4194304] 0 2024-09-19T09:35:22.565 INFO:tasks.workunit.client.0.smithi112.stdout:8/487: write d7/db/d21/d2e/f7e [482416,26119] 0 2024-09-19T09:35:22.567 INFO:tasks.workunit.client.0.smithi112.stdout:8/488: mkdir d7/db/d21/d3b/d56/d4b/d90 0 2024-09-19T09:35:22.567 INFO:tasks.workunit.client.0.smithi112.stdout:8/489: write d7/fa [1702886,31924] 0 2024-09-19T09:35:22.581 INFO:tasks.workunit.client.0.smithi112.stdout:8/490: dwrite d7/d67/f4c [0,4194304] 0 2024-09-19T09:35:22.581 INFO:tasks.workunit.client.0.smithi112.stdout:8/491: creat d7/d65/f91 x:0 0 0 2024-09-19T09:35:22.586 INFO:tasks.workunit.client.0.smithi112.stdout:8/492: mkdir d7/d67/d92 0 2024-09-19T09:35:22.591 INFO:tasks.workunit.client.0.smithi112.stdout:8/493: dread d7/db/d21/f24 [0,4194304] 0 2024-09-19T09:35:22.592 INFO:tasks.workunit.client.0.smithi112.stdout:8/494: mknod d7/db/d21/d3b/d56/d4b/c93 0 2024-09-19T09:35:22.595 INFO:tasks.workunit.client.0.smithi112.stdout:8/495: truncate d7/d10/d11/d33/f27 781762 0 2024-09-19T09:35:22.597 INFO:tasks.workunit.client.0.smithi112.stdout:8/496: link d7/d10/d11/d33/f54 d7/db/d21/d3b/d56/d3c/f94 0 2024-09-19T09:35:22.614 INFO:tasks.workunit.client.0.smithi112.stdout:8/497: dwrite d7/db/d21/d3b/d56/d4b/f5f [0,4194304] 0 2024-09-19T09:35:22.614 INFO:tasks.workunit.client.0.smithi112.stdout:2/260: sync 2024-09-19T09:35:22.615 INFO:tasks.workunit.client.0.smithi112.stdout:3/423: sync 2024-09-19T09:35:22.615 INFO:tasks.workunit.client.0.smithi112.stdout:3/424: write d8/f93 [473408,83908] 0 2024-09-19T09:35:22.615 INFO:tasks.workunit.client.0.smithi112.stdout:8/498: creat d7/db/d21/d3b/d56/d48/f95 x:0 0 0 2024-09-19T09:35:22.618 INFO:tasks.workunit.client.0.smithi112.stdout:8/499: creat d7/d10/d11/f96 x:0 0 0 2024-09-19T09:35:22.618 INFO:tasks.workunit.client.0.smithi112.stdout:2/261: rmdir d0/d1/d28 39 2024-09-19T09:35:22.619 INFO:tasks.workunit.client.0.smithi112.stdout:8/500: mkdir d7/db/d21/d2e/d8c/d97 0 2024-09-19T09:35:22.619 INFO:tasks.workunit.client.0.smithi112.stdout:8/501: write d7/db/d21/d2e/f7e [576088,127410] 0 2024-09-19T09:35:22.621 INFO:tasks.workunit.client.0.smithi112.stdout:2/262: truncate d0/d6/f1d 5881494 0 2024-09-19T09:35:22.621 INFO:tasks.workunit.client.0.smithi112.stdout:2/263: stat d0/d1/f1f 0 2024-09-19T09:35:22.627 INFO:tasks.workunit.client.0.smithi112.stdout:3/425: dread d8/d15/d1b/d1c/d68/d33/f35 [0,4194304] 0 2024-09-19T09:35:22.627 INFO:tasks.workunit.client.0.smithi112.stdout:3/426: creat d8/d15/d1b/d1c/d43/f94 x:0 0 0 2024-09-19T09:35:22.627 INFO:tasks.workunit.client.0.smithi112.stdout:3/427: chown d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d5d/f65 271186080 1 2024-09-19T09:35:22.630 INFO:tasks.workunit.client.0.smithi112.stdout:2/264: rename d0/d6/d24/f51 to d0/d1/de/d4f/f52 0 2024-09-19T09:35:22.633 INFO:tasks.workunit.client.0.smithi112.stdout:3/428: rename d8/d15/d1b/d1c/f6c to d8/d15/d1b/d1c/d43/d4f/f95 0 2024-09-19T09:35:22.633 INFO:tasks.workunit.client.0.smithi112.stdout:8/502: dwrite d7/db/d21/d3b/d56/d3c/f3d [8388608,4194304] 0 2024-09-19T09:35:22.635 INFO:tasks.workunit.client.0.smithi112.stdout:3/429: symlink d8/d15/d1b/d1c/d68/d33/d59/l96 0 2024-09-19T09:35:22.635 INFO:tasks.workunit.client.0.smithi112.stdout:3/430: fdatasync d8/d15/d1b/d1c/d27/d2b/f5c 0 2024-09-19T09:35:22.635 INFO:tasks.workunit.client.0.smithi112.stdout:3/431: dread - d8/d15/d1b/d1c/f55 zero size 2024-09-19T09:35:22.635 INFO:tasks.workunit.client.0.smithi112.stdout:3/432: readlink l4 0 2024-09-19T09:35:22.635 INFO:tasks.workunit.client.0.smithi112.stdout:3/433: dread - d8/f7d zero size 2024-09-19T09:35:22.635 INFO:tasks.workunit.client.0.smithi112.stdout:2/265: dread d0/d1/de/d27/f30 [0,4194304] 0 2024-09-19T09:35:22.635 INFO:tasks.workunit.client.0.smithi112.stdout:2/266: write d0/d6/f1d [6791355,35415] 0 2024-09-19T09:35:22.636 INFO:tasks.workunit.client.0.smithi112.stdout:8/503: creat d7/d10/d11/d55/f98 x:0 0 0 2024-09-19T09:35:22.636 INFO:tasks.workunit.client.0.smithi112.stdout:8/504: creat d7/d10/d11/d50/f99 x:0 0 0 2024-09-19T09:35:22.636 INFO:tasks.workunit.client.0.smithi112.stdout:8/505: chown d7/d10/d11/c17 247 1 2024-09-19T09:35:22.640 INFO:tasks.workunit.client.0.smithi112.stdout:8/506: truncate d7/db/f73 3915321 0 2024-09-19T09:35:22.640 INFO:tasks.workunit.client.0.smithi112.stdout:2/267: dread d0/f5 [0,4194304] 0 2024-09-19T09:35:22.643 INFO:tasks.workunit.client.0.smithi112.stdout:8/507: symlink d7/db/d21/d3b/d56/d3c/l9a 0 2024-09-19T09:35:22.644 INFO:tasks.workunit.client.0.smithi112.stdout:2/268: creat d0/d1/de/d4b/f53 x:0 0 0 2024-09-19T09:35:22.647 INFO:tasks.workunit.client.0.smithi112.stdout:8/508: truncate d7/d10/d11/f2b 560079 0 2024-09-19T09:35:22.648 INFO:tasks.workunit.client.0.smithi112.stdout:3/434: dwrite d8/d15/d1b/d1c/d27/d2b/f45 [0,4194304] 0 2024-09-19T09:35:22.648 INFO:tasks.workunit.client.0.smithi112.stdout:3/435: truncate d8/d15/d1b/d1c/d27/d2b/f45 4906201 0 2024-09-19T09:35:22.648 INFO:tasks.workunit.client.0.smithi112.stdout:3/436: chown d8/d15/d1b/d1c/d68/d33/d7b 7296066 1 2024-09-19T09:35:22.648 INFO:tasks.workunit.client.0.smithi112.stdout:2/269: symlink d0/d1/de/d27/l54 0 2024-09-19T09:35:22.650 INFO:tasks.workunit.client.0.smithi112.stdout:8/509: mknod d7/d10/d11/d33/c9b 0 2024-09-19T09:35:22.654 INFO:tasks.workunit.client.0.smithi112.stdout:3/437: rename d8/d15/d1b/d1c/d27/d2b/f45 to d8/d15/d1b/d1c/d68/d33/d66/f97 0 2024-09-19T09:35:22.655 INFO:tasks.workunit.client.0.smithi112.stdout:2/270: link d0/l23 d0/d4a/l55 0 2024-09-19T09:35:22.655 INFO:tasks.workunit.client.0.smithi112.stdout:2/271: fdatasync d0/d6/d24/f46 0 2024-09-19T09:35:22.656 INFO:tasks.workunit.client.0.smithi112.stdout:8/510: readlink d7/db/d21/l6a 0 2024-09-19T09:35:22.659 INFO:tasks.workunit.client.0.smithi112.stdout:3/438: mknod d8/d15/d1b/d28/c98 0 2024-09-19T09:35:22.663 INFO:tasks.workunit.client.0.smithi112.stdout:2/272: mkdir d0/d1/de/d56 0 2024-09-19T09:35:22.667 INFO:tasks.workunit.client.0.smithi112.stdout:2/273: mkdir d0/d3e/d50/d57 0 2024-09-19T09:35:22.668 INFO:tasks.workunit.client.0.smithi112.stdout:2/274: link d0/l23 d0/d3e/d50/d57/l58 0 2024-09-19T09:35:22.675 INFO:tasks.workunit.client.0.smithi112.stdout:3/439: dwrite d8/ff [4194304,4194304] 0 2024-09-19T09:35:22.675 INFO:tasks.workunit.client.0.smithi112.stdout:3/440: fsync d8/d15/d1b/d1c/d27/f86 0 2024-09-19T09:35:22.692 INFO:tasks.workunit.client.0.smithi112.stdout:3/441: dwrite d8/d15/d1b/d1c/d68/f70 [0,4194304] 0 2024-09-19T09:35:22.692 INFO:tasks.workunit.client.0.smithi112.stdout:3/442: dread - d8/d48/d67/d7e/f92 zero size 2024-09-19T09:35:22.707 INFO:tasks.workunit.client.0.smithi112.stdout:3/443: dwrite d8/d15/f29 [0,4194304] 0 2024-09-19T09:35:22.707 INFO:tasks.workunit.client.0.smithi112.stdout:3/444: stat d8/d15/d1b/d1c/d68/d8d 0 2024-09-19T09:35:22.713 INFO:tasks.workunit.client.0.smithi112.stdout:3/445: mkdir d8/d15/d1b/d1c/d27/d62/d99 0 2024-09-19T09:35:22.722 INFO:tasks.workunit.client.0.smithi112.stdout:3/446: write d8/fb [3792356,128704] 0 2024-09-19T09:35:22.724 INFO:tasks.workunit.client.0.smithi112.stdout:3/447: mknod d8/d15/d1b/d1c/d68/d33/d59/d44/d49/c9a 0 2024-09-19T09:35:22.725 INFO:tasks.workunit.client.0.smithi112.stdout:3/448: mkdir d8/d15/d1b/d1c/d43/d9b 0 2024-09-19T09:35:22.742 INFO:tasks.workunit.client.0.smithi112.stdout:3/449: dwrite f7 [0,4194304] 0 2024-09-19T09:35:22.742 INFO:tasks.workunit.client.0.smithi112.stdout:3/450: chown d8/d15/d1b/d1c/d68/d33/d7b 4747 1 2024-09-19T09:35:22.754 INFO:tasks.workunit.client.0.smithi112.stdout:3/451: dwrite d8/d15/d1b/f6d [4194304,4194304] 0 2024-09-19T09:35:22.754 INFO:tasks.workunit.client.0.smithi112.stdout:3/452: creat d8/d15/d1b/d1c/d68/d33/d83/f9c x:0 0 0 2024-09-19T09:35:22.790 INFO:tasks.workunit.client.0.smithi112.stdout:4/659: sync 2024-09-19T09:35:22.797 INFO:tasks.workunit.client.0.smithi112.stdout:3/453: rmdir d8/d15/d1b/d1c/d68/d33/d59 39 2024-09-19T09:35:22.798 INFO:tasks.workunit.client.0.smithi112.stdout:3/454: write d8/d15/d1b/d1c/d43/d4f/f95 [1638632,11347] 0 2024-09-19T09:35:22.800 INFO:tasks.workunit.client.0.smithi112.stdout:3/455: truncate d8/d15/d1b/d1c/d68/d33/f57 414354 0 2024-09-19T09:35:22.800 INFO:tasks.workunit.client.0.smithi112.stdout:3/456: dread - d8/d15/d1b/d1c/d68/d33/d83/f90 zero size 2024-09-19T09:35:22.801 INFO:tasks.workunit.client.0.smithi112.stdout:3/457: rename d8/d15/d1b/d1c/d68/d33/d59/l4b to d8/d48/d67/d7e/l9d 0 2024-09-19T09:35:22.803 INFO:tasks.workunit.client.0.smithi112.stdout:3/458: dread d8/d15/d1b/f53 [0,4194304] 0 2024-09-19T09:35:22.804 INFO:tasks.workunit.client.0.smithi112.stdout:3/459: mkdir d8/d15/d1b/d1c/d68/d33/d83/d9e 0 2024-09-19T09:35:22.805 INFO:tasks.workunit.client.0.smithi112.stdout:3/460: truncate d8/d15/d1b/d1c/d27/d2b/f5c 513638 0 2024-09-19T09:35:22.805 INFO:tasks.workunit.client.0.smithi112.stdout:3/461: write d8/d15/d1b/d1c/f7c [668346,91407] 0 2024-09-19T09:35:22.806 INFO:tasks.workunit.client.0.smithi112.stdout:4/660: dwrite d1/d31/d43/d48/d5c/f8f [0,4194304] 0 2024-09-19T09:35:22.811 INFO:tasks.workunit.client.0.smithi112.stdout:4/661: mknod d1/d31/d43/d48/ce0 0 2024-09-19T09:35:22.811 INFO:tasks.workunit.client.0.smithi112.stdout:4/662: creat d1/d31/d51/fe1 x:0 0 0 2024-09-19T09:35:22.811 INFO:tasks.workunit.client.0.smithi112.stdout:4/663: chown d1/d4/d3a/d57/d60/fc5 1 1 2024-09-19T09:35:22.811 INFO:tasks.workunit.client.0.smithi112.stdout:4/664: read - d1/d31/d96/fda zero size 2024-09-19T09:35:22.812 INFO:tasks.workunit.client.0.smithi112.stdout:4/665: write d1/d31/d43/fdf [856510,100750] 0 2024-09-19T09:35:22.815 INFO:tasks.workunit.client.0.smithi112.stdout:3/462: dread d8/d15/d1b/d1c/d68/d33/d66/f97 [0,4194304] 0 2024-09-19T09:35:22.825 INFO:tasks.workunit.client.0.smithi112.stdout:3/463: rmdir d8/d15/d1b/d1c 39 2024-09-19T09:35:22.827 INFO:tasks.workunit.client.0.smithi112.stdout:3/464: creat d8/d15/d1b/d1c/d68/d33/d59/d44/f9f x:0 0 0 2024-09-19T09:35:22.828 INFO:tasks.workunit.client.0.smithi112.stdout:3/465: mkdir d8/d15/d1b/d1c/d27/d62/d99/da0 0 2024-09-19T09:35:22.828 INFO:tasks.workunit.client.0.smithi112.stdout:4/666: dwrite d1/d3d/d41/fd0 [0,4194304] 0 2024-09-19T09:35:22.828 INFO:tasks.workunit.client.0.smithi112.stdout:4/667: truncate d1/d3d/fa6 86215 0 2024-09-19T09:35:22.829 INFO:tasks.workunit.client.0.smithi112.stdout:3/466: mkdir d8/d15/d1b/d1c/d27/da1 0 2024-09-19T09:35:22.829 INFO:tasks.workunit.client.0.smithi112.stdout:3/467: write d8/d15/d1b/d1c/d68/d33/d83/f9c [526171,126348] 0 2024-09-19T09:35:22.832 INFO:tasks.workunit.client.0.smithi112.stdout:4/668: unlink d1/d4/d3a/d7a/lc8 0 2024-09-19T09:35:22.834 INFO:tasks.workunit.client.0.smithi112.stdout:4/669: mkdir d1/d3d/d72/de2 0 2024-09-19T09:35:22.837 INFO:tasks.workunit.client.0.smithi112.stdout:4/670: getdents d1/d4/d3a/d57/d62/d88 0 2024-09-19T09:35:22.841 INFO:tasks.workunit.client.0.smithi112.stdout:4/671: rename d1/d31/d43/l5a to d1/d3d/d41/le3 0 2024-09-19T09:35:22.845 INFO:tasks.workunit.client.0.smithi112.stdout:4/672: link d1/f46 d1/d31/d42/fe4 0 2024-09-19T09:35:22.845 INFO:tasks.workunit.client.0.smithi112.stdout:4/673: chown d1/d31/d43/d48/ce0 3536 1 2024-09-19T09:35:22.845 INFO:tasks.workunit.client.0.smithi112.stdout:4/674: creat d1/d31/d96/fe5 x:0 0 0 2024-09-19T09:35:22.845 INFO:tasks.workunit.client.0.smithi112.stdout:4/675: write d1/f9b [1694805,110037] 0 2024-09-19T09:35:22.849 INFO:tasks.workunit.client.0.smithi112.stdout:4/676: creat d1/d4/d3a/d7a/fe6 x:0 0 0 2024-09-19T09:35:22.849 INFO:tasks.workunit.client.0.smithi112.stdout:4/677: write d1/d4/d3a/d7a/fe6 [403437,79529] 0 2024-09-19T09:35:22.849 INFO:tasks.workunit.client.0.smithi112.stdout:4/678: write d1/d31/d43/d48/f94 [181478,12203] 0 2024-09-19T09:35:22.853 INFO:tasks.workunit.client.0.smithi112.stdout:3/468: dwrite d8/d15/d1b/d1c/d43/f4e [0,4194304] 0 2024-09-19T09:35:22.860 INFO:tasks.workunit.client.0.smithi112.stdout:3/469: rename d8/d15/d1b/d1c/f55 to d8/d15/d1b/d1c/d68/d33/d66/fa2 0 2024-09-19T09:35:22.866 INFO:tasks.workunit.client.0.smithi112.stdout:4/679: dwrite d1/d31/d42/fc4 [0,4194304] 0 2024-09-19T09:35:22.873 INFO:tasks.workunit.client.0.smithi112.stdout:4/680: mkdir d1/d5f/da4/de7 0 2024-09-19T09:35:22.873 INFO:tasks.workunit.client.0.smithi112.stdout:4/681: truncate d1/d4/d3a/f95 915417 0 2024-09-19T09:35:22.874 INFO:tasks.workunit.client.0.smithi112.stdout:4/682: unlink d1/d31/d43/d48/l6c 0 2024-09-19T09:35:22.875 INFO:tasks.workunit.client.0.smithi112.stdout:4/683: mkdir d1/d5f/da4/de8 0 2024-09-19T09:35:22.875 INFO:tasks.workunit.client.0.smithi112.stdout:4/684: fdatasync d1/d3d/d72/fb2 0 2024-09-19T09:35:22.875 INFO:tasks.workunit.client.0.smithi112.stdout:4/685: mkdir d1/d31/d43/d48/de9 0 2024-09-19T09:35:22.876 INFO:tasks.workunit.client.0.smithi112.stdout:4/686: creat d1/d4/d3a/d57/d60/fea x:0 0 0 2024-09-19T09:35:22.876 INFO:tasks.workunit.client.0.smithi112.stdout:4/687: chown d1/d31/d51/d89/d8b 63 1 2024-09-19T09:35:22.876 INFO:tasks.workunit.client.0.smithi112.stdout:4/688: creat d1/d31/d42/feb x:0 0 0 2024-09-19T09:35:22.883 INFO:tasks.workunit.client.0.smithi112.stdout:4/689: write d1/d3d/f56 [3519047,106623] 0 2024-09-19T09:35:22.883 INFO:tasks.workunit.client.0.smithi112.stdout:4/690: truncate d1/d4/d3a/d57/fb0 1482781 0 2024-09-19T09:35:22.883 INFO:tasks.workunit.client.0.smithi112.stdout:4/691: truncate d1/d31/d43/d48/fdb 174930 0 2024-09-19T09:35:22.884 INFO:tasks.workunit.client.0.smithi112.stdout:4/692: rename d1/d3d/f40 to d1/d3d/d72/fec 0 2024-09-19T09:35:22.885 INFO:tasks.workunit.client.0.smithi112.stdout:4/693: symlink d1/d4/d3a/d7a/led 0 2024-09-19T09:35:22.885 INFO:tasks.workunit.client.0.smithi112.stdout:4/694: creat d1/d5f/da4/de8/fee x:0 0 0 2024-09-19T09:35:22.890 INFO:tasks.workunit.client.0.smithi112.stdout:3/470: dwrite d8/f7d [0,4194304] 0 2024-09-19T09:35:22.890 INFO:tasks.workunit.client.0.smithi112.stdout:4/695: dread d1/f46 [0,4194304] 0 2024-09-19T09:35:22.890 INFO:tasks.workunit.client.0.smithi112.stdout:3/471: write d8/d15/d1b/d1c/f7c [1124315,107893] 0 2024-09-19T09:35:22.900 INFO:tasks.workunit.client.0.smithi112.stdout:3/472: rename d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d5d/l79 to d8/d15/d1b/d1c/d27/d62/d99/la3 0 2024-09-19T09:35:22.908 INFO:tasks.workunit.client.0.smithi112.stdout:3/473: dread d8/f10 [0,4194304] 0 2024-09-19T09:35:22.913 INFO:tasks.workunit.client.0.smithi112.stdout:3/474: rename d8/d15/d1b/d1c/d68/f58 to d8/d15/d1b/d1c/d68/d8d/fa4 0 2024-09-19T09:35:22.913 INFO:tasks.workunit.client.0.smithi112.stdout:3/475: dread - d8/d15/d1b/f77 zero size 2024-09-19T09:35:22.913 INFO:tasks.workunit.client.0.smithi112.stdout:3/476: fsync d8/d15/d1b/d1c/d27/f86 0 2024-09-19T09:35:22.913 INFO:tasks.workunit.client.0.smithi112.stdout:3/477: write d8/d15/d1b/d1c/d27/d2b/f5c [1291412,113537] 0 2024-09-19T09:35:22.913 INFO:tasks.workunit.client.0.smithi112.stdout:4/696: dwrite d1/d31/d51/fe1 [0,4194304] 0 2024-09-19T09:35:22.933 INFO:tasks.workunit.client.0.smithi112.stdout:3/478: dwrite d8/f17 [0,4194304] 0 2024-09-19T09:35:22.933 INFO:tasks.workunit.client.0.smithi112.stdout:3/479: chown d8/d15/d1b/d1c/d68/d33/d6f/f8a 1 1 2024-09-19T09:35:22.934 INFO:tasks.workunit.client.0.smithi112.stdout:4/697: dwrite d1/f46 [0,4194304] 0 2024-09-19T09:35:22.934 INFO:tasks.workunit.client.0.smithi112.stdout:4/698: read d1/d31/d43/d48/fdb [117344,94441] 0 2024-09-19T09:35:22.935 INFO:tasks.workunit.client.0.smithi112.stdout:3/480: mknod d8/d15/d1b/d1c/d27/da1/ca5 0 2024-09-19T09:35:22.935 INFO:tasks.workunit.client.0.smithi112.stdout:3/481: fdatasync d8/d15/d1b/d1c/d68/d33/d6f/f8a 0 2024-09-19T09:35:22.935 INFO:tasks.workunit.client.0.smithi112.stdout:3/482: readlink d8/d48/l54 0 2024-09-19T09:35:22.935 INFO:tasks.workunit.client.0.smithi112.stdout:3/483: chown d8/d15/d1b/d1c/d68/d33/d83/f9c 82 1 2024-09-19T09:35:22.935 INFO:tasks.workunit.client.0.smithi112.stdout:3/484: chown d8/d15/d1b/d1c/d68/d33/d72 857097 1 2024-09-19T09:35:22.935 INFO:tasks.workunit.client.0.smithi112.stdout:3/485: chown f7 17716 1 2024-09-19T09:35:22.937 INFO:tasks.workunit.client.0.smithi112.stdout:3/486: creat d8/d15/d1b/d1c/d43/fa6 x:0 0 0 2024-09-19T09:35:22.938 INFO:tasks.workunit.client.0.smithi112.stdout:4/699: dread d1/d3d/d41/f69 [0,4194304] 0 2024-09-19T09:35:22.938 INFO:tasks.workunit.client.0.smithi112.stdout:4/700: creat d1/d4/d3a/d57/fef x:0 0 0 2024-09-19T09:35:22.942 INFO:tasks.workunit.client.0.smithi112.stdout:4/701: unlink d1/d5f/da4/lab 0 2024-09-19T09:35:22.946 INFO:tasks.workunit.client.0.smithi112.stdout:0/414: sync 2024-09-19T09:35:22.946 INFO:tasks.workunit.client.0.smithi112.stdout:0/415: creat d2/d59/f83 x:0 0 0 2024-09-19T09:35:22.951 INFO:tasks.workunit.client.0.smithi112.stdout:4/702: dread d1/d4/f9 [0,4194304] 0 2024-09-19T09:35:22.951 INFO:tasks.workunit.client.0.smithi112.stdout:4/703: stat d1/d4/d3a/d7a/d7f/f3c 0 2024-09-19T09:35:22.951 INFO:tasks.workunit.client.0.smithi112.stdout:4/704: stat d1/d4/d3a/d57/d60/cb7 0 2024-09-19T09:35:22.951 INFO:tasks.workunit.client.0.smithi112.stdout:4/705: mknod d1/d5f/da4/de8/cf0 0 2024-09-19T09:35:22.952 INFO:tasks.workunit.client.0.smithi112.stdout:4/706: link d1/d31/d43/d48/ce0 d1/d3d/d72/cf1 0 2024-09-19T09:35:22.958 INFO:tasks.workunit.client.0.smithi112.stdout:3/487: dwrite d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d5d/f65 [4194304,4194304] 0 2024-09-19T09:35:22.964 INFO:tasks.workunit.client.0.smithi112.stdout:4/707: dread d1/d3d/d72/faa [0,4194304] 0 2024-09-19T09:35:22.964 INFO:tasks.workunit.client.0.smithi112.stdout:4/708: fsync d1/d31/d43/d48/f7e 0 2024-09-19T09:35:22.964 INFO:tasks.workunit.client.0.smithi112.stdout:3/488: dread d8/d15/d1b/d1c/d68/d33/f35 [0,4194304] 0 2024-09-19T09:35:22.965 INFO:tasks.workunit.client.0.smithi112.stdout:4/709: unlink d1/d31/d51/f55 0 2024-09-19T09:35:22.967 INFO:tasks.workunit.client.0.smithi112.stdout:3/489: getdents d8/d15 0 2024-09-19T09:35:22.970 INFO:tasks.workunit.client.0.smithi112.stdout:3/490: creat d8/d15/d1b/d1c/d68/d8d/fa7 x:0 0 0 2024-09-19T09:35:22.970 INFO:tasks.workunit.client.0.smithi112.stdout:3/491: write d8/d48/f78 [1482610,5334] 0 2024-09-19T09:35:22.970 INFO:tasks.workunit.client.0.smithi112.stdout:3/492: chown d8/d15/d1b/l73 136779 1 2024-09-19T09:35:22.970 INFO:tasks.workunit.client.0.smithi112.stdout:3/493: creat d8/d48/d67/fa8 x:0 0 0 2024-09-19T09:35:22.973 INFO:tasks.workunit.client.0.smithi112.stdout:3/494: rename d8/d15/l52 to d8/d15/d1b/d1c/d43/d9b/la9 0 2024-09-19T09:35:22.973 INFO:tasks.workunit.client.0.smithi112.stdout:3/495: readlink d8/l11 0 2024-09-19T09:35:22.973 INFO:tasks.workunit.client.0.smithi112.stdout:3/496: write d8/d15/d1b/d1c/d68/d33/d66/fa2 [624120,93592] 0 2024-09-19T09:35:22.973 INFO:tasks.workunit.client.0.smithi112.stdout:3/497: readlink d8/d15/d1b/d1c/l1d 0 2024-09-19T09:35:22.973 INFO:tasks.workunit.client.0.smithi112.stdout:3/498: dread - d8/d15/d1b/d1c/d68/d8d/fa7 zero size 2024-09-19T09:35:22.974 INFO:tasks.workunit.client.0.smithi112.stdout:3/499: chown d8/d15/d1b/f77 207081 1 2024-09-19T09:35:22.975 INFO:tasks.workunit.client.0.smithi112.stdout:3/500: link d8/d15/d1b/d1c/d68/l34 d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d5d/laa 0 2024-09-19T09:35:22.976 INFO:tasks.workunit.client.0.smithi112.stdout:3/501: readlink d8/l14 0 2024-09-19T09:35:22.976 INFO:tasks.workunit.client.0.smithi112.stdout:3/502: chown d8/d15/d1b/d1c/d68/d33/f35 599268 1 2024-09-19T09:35:22.985 INFO:tasks.workunit.client.0.smithi112.stdout:3/503: read d8/d15/d1b/d1c/d68/d33/f35 [1345707,58065] 0 2024-09-19T09:35:22.985 INFO:tasks.workunit.client.0.smithi112.stdout:4/710: dwrite d1/d3d/d72/fb2 [0,4194304] 0 2024-09-19T09:35:22.995 INFO:tasks.workunit.client.0.smithi112.stdout:4/711: unlink d1/d4/d3a/fd2 0 2024-09-19T09:35:22.998 INFO:tasks.workunit.client.0.smithi112.stdout:4/712: symlink d1/d4/d3a/d57/d62/lf2 0 2024-09-19T09:35:23.021 INFO:tasks.workunit.client.0.smithi112.stdout:1/234: sync 2024-09-19T09:35:23.021 INFO:tasks.workunit.client.0.smithi112.stdout:9/243: sync 2024-09-19T09:35:23.021 INFO:tasks.workunit.client.0.smithi112.stdout:1/235: dread - dc/d24/f46 zero size 2024-09-19T09:35:23.021 INFO:tasks.workunit.client.0.smithi112.stdout:9/244: creat df/d11/d14/d19/d40/f4e x:0 0 0 2024-09-19T09:35:23.023 INFO:tasks.workunit.client.0.smithi112.stdout:3/504: dread f6 [0,4194304] 0 2024-09-19T09:35:23.023 INFO:tasks.workunit.client.0.smithi112.stdout:3/505: stat d8/d15/d1b/d28/c98 0 2024-09-19T09:35:23.023 INFO:tasks.workunit.client.0.smithi112.stdout:9/245: symlink df/d11/d14/l4f 0 2024-09-19T09:35:23.023 INFO:tasks.workunit.client.0.smithi112.stdout:4/713: dwrite d1/d4/d3a/d57/fef [0,4194304] 0 2024-09-19T09:35:23.025 INFO:tasks.workunit.client.0.smithi112.stdout:3/506: creat d8/d15/d1b/d1c/d68/d33/d7b/fab x:0 0 0 2024-09-19T09:35:23.025 INFO:tasks.workunit.client.0.smithi112.stdout:3/507: write d8/d15/d1b/d1c/d43/d4f/f95 [1675090,130138] 0 2024-09-19T09:35:23.025 INFO:tasks.workunit.client.0.smithi112.stdout:3/508: getdents d8/d15/d1b/d1c/d68/d33/d8e 0 2024-09-19T09:35:23.025 INFO:tasks.workunit.client.0.smithi112.stdout:3/509: chown d8/d15/d1b/d1c/d43/d4f 9450 1 2024-09-19T09:35:23.027 INFO:tasks.workunit.client.0.smithi112.stdout:9/246: rename df/d11/l48 to df/d11/d14/d19/d1e/l50 0 2024-09-19T09:35:23.031 INFO:tasks.workunit.client.0.smithi112.stdout:4/714: link d1/d4/d3a/f6a d1/d3d/d72/dd6/ff3 0 2024-09-19T09:35:23.031 INFO:tasks.workunit.client.0.smithi112.stdout:4/715: fdatasync d1/d4/d3a/f5d 0 2024-09-19T09:35:23.035 INFO:tasks.workunit.client.0.smithi112.stdout:3/510: dread d8/d15/d1b/d1c/d68/d33/f35 [0,4194304] 0 2024-09-19T09:35:23.035 INFO:tasks.workunit.client.0.smithi112.stdout:3/511: write d8/d48/d67/fa8 [1004243,37007] 0 2024-09-19T09:35:23.036 INFO:tasks.workunit.client.0.smithi112.stdout:4/716: creat d1/d4/d3a/d57/d60/ff4 x:0 0 0 2024-09-19T09:35:23.037 INFO:tasks.workunit.client.0.smithi112.stdout:1/236: dwrite dc/d24/f32 [0,4194304] 0 2024-09-19T09:35:23.040 INFO:tasks.workunit.client.0.smithi112.stdout:3/512: mknod d8/d15/d1b/d1c/d68/d33/d83/cac 0 2024-09-19T09:35:23.040 INFO:tasks.workunit.client.0.smithi112.stdout:3/513: getdents d8/d15/d1b/d1c/d68/d33/d83/d9e 0 2024-09-19T09:35:23.043 INFO:tasks.workunit.client.0.smithi112.stdout:4/717: rename d1/d3d/f56 to d1/d31/d43/ff5 0 2024-09-19T09:35:23.043 INFO:tasks.workunit.client.0.smithi112.stdout:4/718: creat d1/d3d/d93/ff6 x:0 0 0 2024-09-19T09:35:23.047 INFO:tasks.workunit.client.0.smithi112.stdout:1/237: mknod dc/d13/c49 0 2024-09-19T09:35:23.049 INFO:tasks.workunit.client.0.smithi112.stdout:9/247: dwrite df/d11/d14/f2d [0,4194304] 0 2024-09-19T09:35:23.049 INFO:tasks.workunit.client.0.smithi112.stdout:3/514: dread d8/d15/d1b/d1c/f37 [4194304,4194304] 0 2024-09-19T09:35:23.050 INFO:tasks.workunit.client.0.smithi112.stdout:3/515: creat d8/d15/d1b/fad x:0 0 0 2024-09-19T09:35:23.053 INFO:tasks.workunit.client.0.smithi112.stdout:4/719: dread d1/d3d/f3f [0,4194304] 0 2024-09-19T09:35:23.057 INFO:tasks.workunit.client.0.smithi112.stdout:9/248: mkdir df/d11/d14/d51 0 2024-09-19T09:35:23.060 INFO:tasks.workunit.client.0.smithi112.stdout:3/516: mknod d8/d15/d1b/d1c/cae 0 2024-09-19T09:35:23.060 INFO:tasks.workunit.client.0.smithi112.stdout:3/517: dread - d8/d15/d1b/d1c/d68/d33/d83/f90 zero size 2024-09-19T09:35:23.060 INFO:tasks.workunit.client.0.smithi112.stdout:3/518: fdatasync d8/d15/d1b/fad 0 2024-09-19T09:35:23.060 INFO:tasks.workunit.client.0.smithi112.stdout:1/238: rmdir dc/d13 39 2024-09-19T09:35:23.061 INFO:tasks.workunit.client.0.smithi112.stdout:1/239: fdatasync dc/f1f 0 2024-09-19T09:35:23.061 INFO:tasks.workunit.client.0.smithi112.stdout:1/240: readlink dc/d24/l3a 0 2024-09-19T09:35:23.061 INFO:tasks.workunit.client.0.smithi112.stdout:1/241: write dc/d24/f40 [1929954,44281] 0 2024-09-19T09:35:23.061 INFO:tasks.workunit.client.0.smithi112.stdout:1/242: truncate dc/d13/f1b 461461 0 2024-09-19T09:35:23.061 INFO:tasks.workunit.client.0.smithi112.stdout:1/243: fsync f8 0 2024-09-19T09:35:23.064 INFO:tasks.workunit.client.0.smithi112.stdout:4/720: rename d1/fdd to d1/ff7 0 2024-09-19T09:35:23.065 INFO:tasks.workunit.client.0.smithi112.stdout:1/244: mknod dc/d26/d44/c4a 0 2024-09-19T09:35:23.065 INFO:tasks.workunit.client.0.smithi112.stdout:9/249: dread df/d11/d14/f41 [0,4194304] 0 2024-09-19T09:35:23.066 INFO:tasks.workunit.client.0.smithi112.stdout:4/721: mkdir d1/d4/d3a/d57/d62/df8 0 2024-09-19T09:35:23.067 INFO:tasks.workunit.client.0.smithi112.stdout:9/250: rmdir df/d11/d14/d19/d28 39 2024-09-19T09:35:23.070 INFO:tasks.workunit.client.0.smithi112.stdout:4/722: link d1/d31/l54 d1/d31/d43/lf9 0 2024-09-19T09:35:23.073 INFO:tasks.workunit.client.0.smithi112.stdout:4/723: truncate d1/d3d/d41/f67 1927509 0 2024-09-19T09:35:23.075 INFO:tasks.workunit.client.0.smithi112.stdout:4/724: creat d1/d3d/d72/dd6/ffa x:0 0 0 2024-09-19T09:35:23.077 INFO:tasks.workunit.client.0.smithi112.stdout:4/725: symlink d1/d5f/dc2/lfb 0 2024-09-19T09:35:23.077 INFO:tasks.workunit.client.0.smithi112.stdout:4/726: creat d1/ffc x:0 0 0 2024-09-19T09:35:23.079 INFO:tasks.workunit.client.0.smithi112.stdout:4/727: dread d1/d4/d3a/f6a [0,4194304] 0 2024-09-19T09:35:23.080 INFO:tasks.workunit.client.0.smithi112.stdout:4/728: mknod d1/d4/d3a/cfd 0 2024-09-19T09:35:23.081 INFO:tasks.workunit.client.0.smithi112.stdout:4/729: symlink d1/lfe 0 2024-09-19T09:35:23.081 INFO:tasks.workunit.client.0.smithi112.stdout:4/730: chown d1/d31/d42/fc4 2118610891 1 2024-09-19T09:35:23.084 INFO:tasks.workunit.client.0.smithi112.stdout:3/519: dwrite d8/d48/d67/fa8 [0,4194304] 0 2024-09-19T09:35:23.091 INFO:tasks.workunit.client.0.smithi112.stdout:1/245: dwrite dc/f23 [0,4194304] 0 2024-09-19T09:35:23.094 INFO:tasks.workunit.client.0.smithi112.stdout:1/246: symlink dc/d26/l4b 0 2024-09-19T09:35:23.097 INFO:tasks.workunit.client.0.smithi112.stdout:1/247: truncate f2 5754441 0 2024-09-19T09:35:23.099 INFO:tasks.workunit.client.0.smithi112.stdout:4/731: dwrite d1/d4/d3a/d7a/fe6 [0,4194304] 0 2024-09-19T09:35:23.099 INFO:tasks.workunit.client.0.smithi112.stdout:3/520: read d8/d15/d1b/f6d [5022323,77630] 0 2024-09-19T09:35:23.101 INFO:tasks.workunit.client.0.smithi112.stdout:9/251: dwrite df/d4d/f27 [0,4194304] 0 2024-09-19T09:35:23.104 INFO:tasks.workunit.client.0.smithi112.stdout:4/732: symlink d1/d5f/lff 0 2024-09-19T09:35:23.105 INFO:tasks.workunit.client.0.smithi112.stdout:4/733: stat d1/d31/d71/d77/cbc 0 2024-09-19T09:35:23.105 INFO:tasks.workunit.client.0.smithi112.stdout:4/734: chown d1/d31/d51/fe1 67 1 2024-09-19T09:35:23.109 INFO:tasks.workunit.client.0.smithi112.stdout:9/252: mknod df/d11/d14/d19/d28/c52 0 2024-09-19T09:35:23.114 INFO:tasks.workunit.client.0.smithi112.stdout:9/253: symlink df/d11/d14/d19/d40/l53 0 2024-09-19T09:35:23.124 INFO:tasks.workunit.client.0.smithi112.stdout:1/248: dwrite dc/f20 [0,4194304] 0 2024-09-19T09:35:23.128 INFO:tasks.workunit.client.0.smithi112.stdout:1/249: truncate dc/f23 2276942 0 2024-09-19T09:35:23.130 INFO:tasks.workunit.client.0.smithi112.stdout:3/521: dwrite d8/d15/f5a [0,4194304] 0 2024-09-19T09:35:23.130 INFO:tasks.workunit.client.0.smithi112.stdout:4/735: dwrite d1/ffc [0,4194304] 0 2024-09-19T09:35:23.130 INFO:tasks.workunit.client.0.smithi112.stdout:3/522: creat d8/d48/faf x:0 0 0 2024-09-19T09:35:23.130 INFO:tasks.workunit.client.0.smithi112.stdout:4/736: write d1/d31/d42/feb [1047557,74578] 0 2024-09-19T09:35:23.130 INFO:tasks.workunit.client.0.smithi112.stdout:4/737: creat d1/d31/d42/f100 x:0 0 0 2024-09-19T09:35:23.130 INFO:tasks.workunit.client.0.smithi112.stdout:4/738: chown d1/d4 309 1 2024-09-19T09:35:23.134 INFO:tasks.workunit.client.0.smithi112.stdout:9/254: getdents df/d11/d14/d19/d40 0 2024-09-19T09:35:23.139 INFO:tasks.workunit.client.0.smithi112.stdout:4/739: write d1/d3d/d72/fec [2123609,92252] 0 2024-09-19T09:35:23.139 INFO:tasks.workunit.client.0.smithi112.stdout:4/740: creat d1/f101 x:0 0 0 2024-09-19T09:35:23.140 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:22 smithi112 ceph-mon[27605]: pgmap v23: 65 pgs: 65 active+clean; 1.8 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 98 MiB/s rd, 112 MiB/s wr, 253 op/s 2024-09-19T09:35:23.145 INFO:tasks.workunit.client.0.smithi112.stdout:3/523: mkdir d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d63/db0 0 2024-09-19T09:35:23.146 INFO:tasks.workunit.client.0.smithi112.stdout:5/493: sync 2024-09-19T09:35:23.146 INFO:tasks.workunit.client.0.smithi112.stdout:7/540: sync 2024-09-19T09:35:23.146 INFO:tasks.workunit.client.0.smithi112.stdout:2/275: sync 2024-09-19T09:35:23.147 INFO:tasks.workunit.client.0.smithi112.stdout:6/555: sync 2024-09-19T09:35:23.147 INFO:tasks.workunit.client.0.smithi112.stdout:6/556: chown d8/l12 11169 1 2024-09-19T09:35:23.147 INFO:tasks.workunit.client.0.smithi112.stdout:2/276: fdatasync d0/d1/de/d4b/f53 0 2024-09-19T09:35:23.148 INFO:tasks.workunit.client.0.smithi112.stdout:8/511: sync 2024-09-19T09:35:23.150 INFO:tasks.workunit.client.0.smithi112.stdout:1/250: getdents dc/d26 0 2024-09-19T09:35:23.150 INFO:tasks.workunit.client.0.smithi112.stdout:1/251: write dc/d26/f3c [772897,80236] 0 2024-09-19T09:35:23.150 INFO:tasks.workunit.client.0.smithi112.stdout:1/252: chown dc/l2e 16331217 1 2024-09-19T09:35:23.150 INFO:tasks.workunit.client.0.smithi112.stdout:1/253: write dc/fe [4973305,102840] 0 2024-09-19T09:35:23.151 INFO:tasks.workunit.client.0.smithi112.stdout:4/741: write d1/d31/d51/fe1 [1629379,62716] 0 2024-09-19T09:35:23.151 INFO:tasks.workunit.client.0.smithi112.stdout:4/742: stat d1/f17 0 2024-09-19T09:35:23.152 INFO:tasks.workunit.client.0.smithi112.stdout:9/255: link df/d11/d14/d19/f33 df/d11/d14/d51/f54 0 2024-09-19T09:35:23.157 INFO:tasks.workunit.client.0.smithi112.stdout:3/524: symlink d8/d15/d1b/d1c/d68/d8d/lb1 0 2024-09-19T09:35:23.157 INFO:tasks.workunit.client.0.smithi112.stdout:3/525: fsync d8/d48/d67/f80 0 2024-09-19T09:35:23.157 INFO:tasks.workunit.client.0.smithi112.stdout:3/526: stat d8/d15/d1b/d1c/d27/d2b 0 2024-09-19T09:35:23.157 INFO:tasks.workunit.client.0.smithi112.stdout:3/527: fsync d8/d48/d67/d7e/f92 0 2024-09-19T09:35:23.157 INFO:tasks.workunit.client.0.smithi112.stdout:3/528: dread - d8/d48/faf zero size 2024-09-19T09:35:23.157 INFO:tasks.workunit.client.0.smithi112.stdout:3/529: write d8/f93 [1107791,95793] 0 2024-09-19T09:35:23.159 INFO:tasks.workunit.client.0.smithi112.stdout:2/277: truncate d0/d1/d28/f10 2144079 0 2024-09-19T09:35:23.160 INFO:tasks.workunit.client.0.smithi112.stdout:6/557: mkdir d8/d11/d14/d3c/dc0 0 2024-09-19T09:35:23.163 INFO:tasks.workunit.client.0.smithi112.stdout:8/512: mknod d7/db/d21/d2e/d8c/d97/c9c 0 2024-09-19T09:35:23.163 INFO:tasks.workunit.client.0.smithi112.stdout:8/513: chown d7/d10/d11/d33/c1b 17801 1 2024-09-19T09:35:23.165 INFO:tasks.workunit.client.0.smithi112.stdout:1/254: mkdir dc/d26/d34/d4c 0 2024-09-19T09:35:23.168 INFO:tasks.workunit.client.0.smithi112.stdout:9/256: link df/d11/d14/d19/l36 df/d11/d14/d19/d1e/l55 0 2024-09-19T09:35:23.170 INFO:tasks.workunit.client.0.smithi112.stdout:5/494: rename d4/d29/f20 to d4/d9/d17/d30/fab 0 2024-09-19T09:35:23.172 INFO:tasks.workunit.client.0.smithi112.stdout:2/278: mknod d0/d3e/d49/c59 0 2024-09-19T09:35:23.173 INFO:tasks.workunit.client.0.smithi112.stdout:2/279: stat d0/d6/l21 0 2024-09-19T09:35:23.173 INFO:tasks.workunit.client.0.smithi112.stdout:6/558: mkdir d8/d73/dc1 0 2024-09-19T09:35:23.175 INFO:tasks.workunit.client.0.smithi112.stdout:1/255: mknod dc/d24/c4d 0 2024-09-19T09:35:23.175 INFO:tasks.workunit.client.0.smithi112.stdout:1/256: fdatasync dc/d26/f3d 0 2024-09-19T09:35:23.176 INFO:tasks.workunit.client.0.smithi112.stdout:5/495: mknod d4/d3f/cac 0 2024-09-19T09:35:23.177 INFO:tasks.workunit.client.0.smithi112.stdout:7/541: dwrite d2/d2c/f38 [0,4194304] 0 2024-09-19T09:35:23.179 INFO:tasks.workunit.client.0.smithi112.stdout:6/559: mkdir d8/d11/d13/dc2 0 2024-09-19T09:35:23.179 INFO:tasks.workunit.client.0.smithi112.stdout:6/560: chown d8/d11/l7a 1 1 2024-09-19T09:35:23.183 INFO:tasks.workunit.client.0.smithi112.stdout:5/496: getdents d4/d9/d17/d2f 0 2024-09-19T09:35:23.184 INFO:tasks.workunit.client.0.smithi112.stdout:5/497: chown d4/d9/d3e/d7f 12 1 2024-09-19T09:35:23.184 INFO:tasks.workunit.client.0.smithi112.stdout:9/257: write df/d4d/f4a [4125470,47579] 0 2024-09-19T09:35:23.184 INFO:tasks.workunit.client.0.smithi112.stdout:9/258: getdents df/d11/d14/d19/d40 0 2024-09-19T09:35:23.184 INFO:tasks.workunit.client.0.smithi112.stdout:9/259: fsync df/d11/f25 0 2024-09-19T09:35:23.190 INFO:tasks.workunit.client.0.smithi112.stdout:7/542: creat d2/d49/fbf x:0 0 0 2024-09-19T09:35:23.190 INFO:tasks.workunit.client.0.smithi112.stdout:0/416: sync 2024-09-19T09:35:23.192 INFO:tasks.workunit.client.0.smithi112.stdout:6/561: link d8/de/d17/dae/fba d8/de/d61/d70/d7b/fc3 0 2024-09-19T09:35:23.193 INFO:tasks.workunit.client.0.smithi112.stdout:4/743: dwrite d1/d3d/d72/faa [0,4194304] 0 2024-09-19T09:35:23.194 INFO:tasks.workunit.client.0.smithi112.stdout:3/530: dwrite f7 [4194304,4194304] 0 2024-09-19T09:35:23.197 INFO:tasks.workunit.client.0.smithi112.stdout:1/257: dread f8 [4194304,4194304] 0 2024-09-19T09:35:23.197 INFO:tasks.workunit.client.0.smithi112.stdout:1/258: stat dc/l16 0 2024-09-19T09:35:23.201 INFO:tasks.workunit.client.0.smithi112.stdout:2/280: dwrite d0/d3e/d49/f4c [0,4194304] 0 2024-09-19T09:35:23.201 INFO:tasks.workunit.client.0.smithi112.stdout:8/514: dwrite d7/db/d21/d2e/d8c/f8f [0,4194304] 0 2024-09-19T09:35:23.201 INFO:tasks.workunit.client.0.smithi112.stdout:3/531: write d8/f4d [496037,84345] 0 2024-09-19T09:35:23.212 INFO:tasks.workunit.client.0.smithi112.stdout:9/260: mknod df/c56 0 2024-09-19T09:35:23.217 INFO:tasks.workunit.client.0.smithi112.stdout:6/562: mknod d8/de/d61/d70/db5/cc4 0 2024-09-19T09:35:23.218 INFO:tasks.workunit.client.0.smithi112.stdout:0/417: dwrite d2/f3c [0,4194304] 0 2024-09-19T09:35:23.220 INFO:tasks.workunit.client.0.smithi112.stdout:4/744: mknod d1/d31/d51/d89/c102 0 2024-09-19T09:35:23.229 INFO:tasks.workunit.client.0.smithi112.stdout:8/515: symlink d7/d10/d11/d50/l9d 0 2024-09-19T09:35:23.229 INFO:tasks.workunit.client.0.smithi112.stdout:8/516: read d7/db/d21/d3b/d56/d3c/f94 [948870,27571] 0 2024-09-19T09:35:23.229 INFO:tasks.workunit.client.0.smithi112.stdout:8/517: chown d7/d10/d11/d33/c81 1723 1 2024-09-19T09:35:23.232 INFO:tasks.workunit.client.0.smithi112.stdout:6/563: dread d8/d11/f34 [0,4194304] 0 2024-09-19T09:35:23.233 INFO:tasks.workunit.client.0.smithi112.stdout:9/261: unlink df/d11/c39 0 2024-09-19T09:35:23.235 INFO:tasks.workunit.client.0.smithi112.stdout:7/543: rename d2/d2c/d54/d18/f3c to d2/d2c/d54/d18/fc0 0 2024-09-19T09:35:23.237 INFO:tasks.workunit.client.0.smithi112.stdout:0/418: creat d2/d39/d3b/f84 x:0 0 0 2024-09-19T09:35:23.237 INFO:tasks.workunit.client.0.smithi112.stdout:0/419: fdatasync d2/d11/f2e 0 2024-09-19T09:35:23.237 INFO:tasks.workunit.client.0.smithi112.stdout:0/420: readlink d2/d39/d3b/d44/l55 0 2024-09-19T09:35:23.238 INFO:tasks.workunit.client.0.smithi112.stdout:9/262: dread df/d11/d14/f1f [0,4194304] 0 2024-09-19T09:35:23.238 INFO:tasks.workunit.client.0.smithi112.stdout:9/263: write f3 [4390499,2722] 0 2024-09-19T09:35:23.238 INFO:tasks.workunit.client.0.smithi112.stdout:5/498: dwrite d4/d9/fa7 [0,4194304] 0 2024-09-19T09:35:23.238 INFO:tasks.workunit.client.0.smithi112.stdout:8/518: mkdir d7/d10/d11/d55/d9e 0 2024-09-19T09:35:23.239 INFO:tasks.workunit.client.0.smithi112.stdout:3/532: unlink d8/ca 0 2024-09-19T09:35:23.239 INFO:tasks.workunit.client.0.smithi112.stdout:0/421: dread d2/f30 [0,4194304] 0 2024-09-19T09:35:23.241 INFO:tasks.workunit.client.0.smithi112.stdout:2/281: dwrite d0/d1/de/d4b/f53 [0,4194304] 0 2024-09-19T09:35:23.241 INFO:tasks.workunit.client.0.smithi112.stdout:1/259: dwrite dc/d24/f32 [0,4194304] 0 2024-09-19T09:35:23.241 INFO:tasks.workunit.client.0.smithi112.stdout:1/260: chown dc/d26/l38 13 1 2024-09-19T09:35:23.242 INFO:tasks.workunit.client.0.smithi112.stdout:6/564: mkdir d8/dc5 0 2024-09-19T09:35:23.242 INFO:tasks.workunit.client.0.smithi112.stdout:4/745: dwrite d1/d4/d3a/d57/d60/fea [0,4194304] 0 2024-09-19T09:35:23.242 INFO:tasks.workunit.client.0.smithi112.stdout:4/746: write d1/d4/d3a/d57/d62/fd8 [594674,99115] 0 2024-09-19T09:35:23.243 INFO:tasks.workunit.client.0.smithi112.stdout:5/499: dread d4/d9/d17/f8e [0,4194304] 0 2024-09-19T09:35:23.243 INFO:tasks.workunit.client.0.smithi112.stdout:9/264: creat df/d11/d14/d19/d28/f57 x:0 0 0 2024-09-19T09:35:23.243 INFO:tasks.workunit.client.0.smithi112.stdout:9/265: readlink df/d35/l47 0 2024-09-19T09:35:23.247 INFO:tasks.workunit.client.0.smithi112.stdout:3/533: link d8/d15/d1b/d1c/d68/d33/d59/l96 d8/d15/d1b/d1c/d68/d33/d8e/lb2 0 2024-09-19T09:35:23.249 INFO:tasks.workunit.client.0.smithi112.stdout:9/266: write df/d11/d14/f1f [1196975,15505] 0 2024-09-19T09:35:23.252 INFO:tasks.workunit.client.0.smithi112.stdout:0/422: truncate d2/f10 4480293 0 2024-09-19T09:35:23.252 INFO:tasks.workunit.client.0.smithi112.stdout:0/423: chown d2/d39/d3b/c72 0 1 2024-09-19T09:35:23.252 INFO:tasks.workunit.client.0.smithi112.stdout:0/424: dread - d2/f5d zero size 2024-09-19T09:35:23.252 INFO:tasks.workunit.client.0.smithi112.stdout:0/425: creat d2/d59/f85 x:0 0 0 2024-09-19T09:35:23.252 INFO:tasks.workunit.client.0.smithi112.stdout:0/426: fsync d2/f22 0 2024-09-19T09:35:23.254 INFO:tasks.workunit.client.0.smithi112.stdout:2/282: write d0/d3e/d49/f4c [3835559,105130] 0 2024-09-19T09:35:23.254 INFO:tasks.workunit.client.0.smithi112.stdout:2/283: chown d0/d1/de/d27/f2a 5 1 2024-09-19T09:35:23.254 INFO:tasks.workunit.client.0.smithi112.stdout:2/284: chown d0/d6/c3c 1 1 2024-09-19T09:35:23.254 INFO:tasks.workunit.client.0.smithi112.stdout:6/565: write d8/d11/f34 [5092315,116684] 0 2024-09-19T09:35:23.256 INFO:tasks.workunit.client.0.smithi112.stdout:4/747: dread d1/d31/d43/d48/d5c/f84 [0,4194304] 0 2024-09-19T09:35:23.256 INFO:tasks.workunit.client.0.smithi112.stdout:4/748: creat d1/d4/d3a/d7a/f103 x:0 0 0 2024-09-19T09:35:23.258 INFO:tasks.workunit.client.0.smithi112.stdout:1/261: fdatasync dc/fe 0 2024-09-19T09:35:23.258 INFO:tasks.workunit.client.0.smithi112.stdout:1/262: chown dc/d13/f18 1028540 1 2024-09-19T09:35:23.259 INFO:tasks.workunit.client.0.smithi112.stdout:1/263: read dc/d24/f12 [158564,117666] 0 2024-09-19T09:35:23.259 INFO:tasks.workunit.client.0.smithi112.stdout:1/264: write dc/d24/f12 [529331,75605] 0 2024-09-19T09:35:23.259 INFO:tasks.workunit.client.0.smithi112.stdout:3/534: dread f7 [4194304,4194304] 0 2024-09-19T09:35:23.260 INFO:tasks.workunit.client.0.smithi112.stdout:3/535: readlink d8/d15/d1b/d1c/d68/d33/d66/l6e 0 2024-09-19T09:35:23.260 INFO:tasks.workunit.client.0.smithi112.stdout:3/536: stat d8/d15/d1b/d1c/d68/d8d 0 2024-09-19T09:35:23.265 INFO:tasks.workunit.client.0.smithi112.stdout:7/544: dwrite d2/d2c/d54/d18/d39/d21/d45/d4d/f6e [4194304,4194304] 0 2024-09-19T09:35:23.265 INFO:tasks.workunit.client.0.smithi112.stdout:7/545: fsync d2/d2c/d54/d18/d8a/f94 0 2024-09-19T09:35:23.266 INFO:tasks.workunit.client.0.smithi112.stdout:5/500: rename d4/d9/d3e/c60 to d4/d9/d6b/cad 0 2024-09-19T09:35:23.268 INFO:tasks.workunit.client.0.smithi112.stdout:6/566: dread d8/de/d18/f28 [0,4194304] 0 2024-09-19T09:35:23.268 INFO:tasks.workunit.client.0.smithi112.stdout:6/567: readlink d8/de/d17/l8d 0 2024-09-19T09:35:23.269 INFO:tasks.workunit.client.0.smithi112.stdout:4/749: write d1/f17 [3239439,1924] 0 2024-09-19T09:35:23.279 INFO:tasks.workunit.client.0.smithi112.stdout:5/501: dread d4/d9/d2a/d39/f3a [0,4194304] 0 2024-09-19T09:35:23.281 INFO:tasks.workunit.client.0.smithi112.stdout:9/267: dwrite df/d35/f38 [0,4194304] 0 2024-09-19T09:35:23.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:22 smithi191 ceph-mon[34834]: pgmap v23: 65 pgs: 65 active+clean; 1.8 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 98 MiB/s rd, 112 MiB/s wr, 253 op/s 2024-09-19T09:35:23.285 INFO:tasks.workunit.client.0.smithi112.stdout:1/265: dwrite f2 [0,4194304] 0 2024-09-19T09:35:23.286 INFO:tasks.workunit.client.0.smithi112.stdout:3/537: dwrite d8/d15/d1b/d1c/d68/f5e [0,4194304] 0 2024-09-19T09:35:23.286 INFO:tasks.workunit.client.0.smithi112.stdout:3/538: stat d8/d15/d1b/d1c/d27 0 2024-09-19T09:35:23.289 INFO:tasks.workunit.client.0.smithi112.stdout:0/427: mknod d2/d45/c86 0 2024-09-19T09:35:23.289 INFO:tasks.workunit.client.0.smithi112.stdout:0/428: readlink d2/d11/l2f 0 2024-09-19T09:35:23.293 INFO:tasks.workunit.client.0.smithi112.stdout:9/268: write df/d11/d14/f3b [1981881,112279] 0 2024-09-19T09:35:23.293 INFO:tasks.workunit.client.0.smithi112.stdout:9/269: dread - df/d11/d14/d19/f42 zero size 2024-09-19T09:35:23.298 INFO:tasks.workunit.client.0.smithi112.stdout:3/539: dread d8/f17 [0,4194304] 0 2024-09-19T09:35:23.298 INFO:tasks.workunit.client.0.smithi112.stdout:3/540: stat d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d5d/f65 0 2024-09-19T09:35:23.298 INFO:tasks.workunit.client.0.smithi112.stdout:3/541: fdatasync d8/d15/d1b/d1c/d43/d4f/f5f 0 2024-09-19T09:35:23.300 INFO:tasks.workunit.client.0.smithi112.stdout:5/502: dwrite d4/d9/d2a/f49 [0,4194304] 0 2024-09-19T09:35:23.301 INFO:tasks.workunit.client.0.smithi112.stdout:7/546: creat d2/d2c/d54/d18/d39/d21/fc1 x:0 0 0 2024-09-19T09:35:23.301 INFO:tasks.workunit.client.0.smithi112.stdout:7/547: creat d2/d49/fc2 x:0 0 0 2024-09-19T09:35:23.309 INFO:tasks.workunit.client.0.smithi112.stdout:0/429: rmdir d2/d39/d58 39 2024-09-19T09:35:23.309 INFO:tasks.workunit.client.0.smithi112.stdout:0/430: chown d2/d59/f65 1643 1 2024-09-19T09:35:23.309 INFO:tasks.workunit.client.0.smithi112.stdout:0/431: write d2/d39/d3b/f84 [855177,109378] 0 2024-09-19T09:35:23.311 INFO:tasks.workunit.client.0.smithi112.stdout:0/432: write d2/d39/d58/f7b [419948,16990] 0 2024-09-19T09:35:23.311 INFO:tasks.workunit.client.0.smithi112.stdout:0/433: write d2/d11/f47 [5128567,89436] 0 2024-09-19T09:35:23.311 INFO:tasks.workunit.client.0.smithi112.stdout:9/270: mknod df/d11/c58 0 2024-09-19T09:35:23.313 INFO:tasks.workunit.client.0.smithi112.stdout:8/519: dwrite d7/d67/f5d [0,4194304] 0 2024-09-19T09:35:23.313 INFO:tasks.workunit.client.0.smithi112.stdout:8/520: creat d7/db/d21/d3b/d56/d3c/f9f x:0 0 0 2024-09-19T09:35:23.315 INFO:tasks.workunit.client.0.smithi112.stdout:5/503: truncate d4/d29/f2d 1547111 0 2024-09-19T09:35:23.317 INFO:tasks.workunit.client.0.smithi112.stdout:6/568: dread d8/d11/d14/d2a/f32 [0,4194304] 0 2024-09-19T09:35:23.317 INFO:tasks.workunit.client.0.smithi112.stdout:7/548: dwrite d2/d2c/d54/d1a/f42 [0,4194304] 0 2024-09-19T09:35:23.317 INFO:tasks.workunit.client.0.smithi112.stdout:6/569: fsync d8/de/d66/f9e 0 2024-09-19T09:35:23.317 INFO:tasks.workunit.client.0.smithi112.stdout:6/570: readlink d8/de/d18/la6 0 2024-09-19T09:35:23.323 INFO:tasks.workunit.client.0.smithi112.stdout:2/285: rename d0/d1/de to d0/d3e/d50/d57/d5a 0 2024-09-19T09:35:23.323 INFO:tasks.workunit.client.0.smithi112.stdout:5/504: dread d4/d9/fa3 [0,4194304] 0 2024-09-19T09:35:23.328 INFO:tasks.workunit.client.0.smithi112.stdout:3/542: symlink d8/lb3 0 2024-09-19T09:35:23.328 INFO:tasks.workunit.client.0.smithi112.stdout:8/521: dread d7/db/d21/f22 [4194304,4194304] 0 2024-09-19T09:35:23.329 INFO:tasks.workunit.client.0.smithi112.stdout:8/522: chown d7/db/d21/d3b 1 1 2024-09-19T09:35:23.329 INFO:tasks.workunit.client.0.smithi112.stdout:8/523: creat d7/db/d21/d3b/d56/d4b/fa0 x:0 0 0 2024-09-19T09:35:23.329 INFO:tasks.workunit.client.0.smithi112.stdout:8/524: stat d7/db/d21/d3b/d56/d4b/d5b 0 2024-09-19T09:35:23.329 INFO:tasks.workunit.client.0.smithi112.stdout:8/525: write d7/ff [1879913,52303] 0 2024-09-19T09:35:23.329 INFO:tasks.workunit.client.0.smithi112.stdout:8/526: truncate d7/db/d21/d2e/f5e 5250690 0 2024-09-19T09:35:23.332 INFO:tasks.workunit.client.0.smithi112.stdout:3/543: dread d8/d15/d1b/f53 [0,4194304] 0 2024-09-19T09:35:23.332 INFO:tasks.workunit.client.0.smithi112.stdout:3/544: write d8/d15/d1b/d1c/d68/d33/d83/f9c [1330311,84342] 0 2024-09-19T09:35:23.335 INFO:tasks.workunit.client.0.smithi112.stdout:9/271: dwrite df/d11/d14/f3b [0,4194304] 0 2024-09-19T09:35:23.338 INFO:tasks.workunit.client.0.smithi112.stdout:6/571: creat d8/de/d61/fc6 x:0 0 0 2024-09-19T09:35:23.342 INFO:tasks.workunit.client.0.smithi112.stdout:3/545: dread d8/fb [0,4194304] 0 2024-09-19T09:35:23.343 INFO:tasks.workunit.client.0.smithi112.stdout:2/286: creat d0/d1/f5b x:0 0 0 2024-09-19T09:35:23.344 INFO:tasks.workunit.client.0.smithi112.stdout:4/750: rename d1/d4/d3a/d57/fd9 to d1/f104 0 2024-09-19T09:35:23.344 INFO:tasks.workunit.client.0.smithi112.stdout:4/751: getdents d1/d31/d51/d89/d8b 0 2024-09-19T09:35:23.345 INFO:tasks.workunit.client.0.smithi112.stdout:9/272: read df/d11/d14/f41 [360327,59266] 0 2024-09-19T09:35:23.345 INFO:tasks.workunit.client.0.smithi112.stdout:9/273: chown df/d11/d14/d19/d28 25798568 1 2024-09-19T09:35:23.345 INFO:tasks.workunit.client.0.smithi112.stdout:5/505: dwrite d4/d9/d2a/d39/f3a [4194304,4194304] 0 2024-09-19T09:35:23.348 INFO:tasks.workunit.client.0.smithi112.stdout:0/434: rmdir d2/d45 39 2024-09-19T09:35:23.349 INFO:tasks.workunit.client.0.smithi112.stdout:6/572: write d8/d11/d13/f7f [426427,105095] 0 2024-09-19T09:35:23.356 INFO:tasks.workunit.client.0.smithi112.stdout:4/752: read d1/d4/f15 [821438,33260] 0 2024-09-19T09:35:23.356 INFO:tasks.workunit.client.0.smithi112.stdout:4/753: creat d1/d3d/d93/f105 x:0 0 0 2024-09-19T09:35:23.356 INFO:tasks.workunit.client.0.smithi112.stdout:4/754: chown d1/d5f/da4/de7 10190 1 2024-09-19T09:35:23.356 INFO:tasks.workunit.client.0.smithi112.stdout:4/755: fsync d1/d4/d3a/d57/d62/f79 0 2024-09-19T09:35:23.357 INFO:tasks.workunit.client.0.smithi112.stdout:6/573: write d8/d11/d14/d3c/d4b/d63/f5f [2617476,16339] 0 2024-09-19T09:35:23.358 INFO:tasks.workunit.client.0.smithi112.stdout:7/549: symlink d2/d2c/d54/d18/lc3 0 2024-09-19T09:35:23.360 INFO:tasks.workunit.client.0.smithi112.stdout:3/546: creat d8/d15/d1b/d1c/d68/fb4 x:0 0 0 2024-09-19T09:35:23.363 INFO:tasks.workunit.client.0.smithi112.stdout:1/266: rename dc/d13/f41 to dc/d26/f4e 0 2024-09-19T09:35:23.364 INFO:tasks.workunit.client.0.smithi112.stdout:9/274: rename df to df/d11/d14/d19/d40/d59 22 2024-09-19T09:35:23.364 INFO:tasks.workunit.client.0.smithi112.stdout:1/267: read - dc/d26/f4e zero size 2024-09-19T09:35:23.364 INFO:tasks.workunit.client.0.smithi112.stdout:0/435: mknod d2/d59/d7a/c87 0 2024-09-19T09:35:23.365 INFO:tasks.workunit.client.0.smithi112.stdout:8/527: getdents d7/d10/d11/d55 0 2024-09-19T09:35:23.366 INFO:tasks.workunit.client.0.smithi112.stdout:8/528: write d7/db/d21/d3b/d56/d3c/f9f [912542,2195] 0 2024-09-19T09:35:23.367 INFO:tasks.workunit.client.0.smithi112.stdout:4/756: mkdir d1/d31/d96/d106 0 2024-09-19T09:35:23.367 INFO:tasks.workunit.client.0.smithi112.stdout:7/550: dread d2/d2c/d54/d18/fc0 [0,4194304] 0 2024-09-19T09:35:23.367 INFO:tasks.workunit.client.0.smithi112.stdout:7/551: readlink d2/d2c/d54/d18/d39/d23/l41 0 2024-09-19T09:35:23.369 INFO:tasks.workunit.client.0.smithi112.stdout:6/574: creat d8/de/d18/fc7 x:0 0 0 2024-09-19T09:35:23.369 INFO:tasks.workunit.client.0.smithi112.stdout:3/547: mkdir d8/d15/d1b/d1c/db5 0 2024-09-19T09:35:23.372 INFO:tasks.workunit.client.0.smithi112.stdout:5/506: rename d4/d9/d6b/d98 to d4/d9/d17/d2f/d72/dae 0 2024-09-19T09:35:23.374 INFO:tasks.workunit.client.0.smithi112.stdout:1/268: mknod dc/c4f 0 2024-09-19T09:35:23.375 INFO:tasks.workunit.client.0.smithi112.stdout:1/269: write dc/d24/f40 [1801315,22227] 0 2024-09-19T09:35:23.375 INFO:tasks.workunit.client.0.smithi112.stdout:1/270: readlink dc/d26/l4b 0 2024-09-19T09:35:23.375 INFO:tasks.workunit.client.0.smithi112.stdout:0/436: link d2/d45/c86 d2/d6e/d6f/c88 0 2024-09-19T09:35:23.375 INFO:tasks.workunit.client.0.smithi112.stdout:0/437: write d2/f56 [691993,63216] 0 2024-09-19T09:35:23.376 INFO:tasks.workunit.client.0.smithi112.stdout:8/529: rmdir d7/db/d21/d3b/d56/d4b/d90 0 2024-09-19T09:35:23.376 INFO:tasks.workunit.client.0.smithi112.stdout:8/530: read d7/db/d21/d3b/d56/d3c/f94 [3562936,85715] 0 2024-09-19T09:35:23.377 INFO:tasks.workunit.client.0.smithi112.stdout:4/757: getdents d1/d3d/d72 0 2024-09-19T09:35:23.378 INFO:tasks.workunit.client.0.smithi112.stdout:6/575: mkdir d8/de/d61/dbf/dc8 0 2024-09-19T09:35:23.381 INFO:tasks.workunit.client.0.smithi112.stdout:7/552: rename d2/d2c/d54/d18/d39/caf to d2/d2c/d54/d18/d39/d23/d35/d4c/d70/cc4 0 2024-09-19T09:35:23.382 INFO:tasks.workunit.client.0.smithi112.stdout:5/507: symlink d4/d9/d6b/laf 0 2024-09-19T09:35:23.382 INFO:tasks.workunit.client.0.smithi112.stdout:5/508: write d4/f73 [57411,84401] 0 2024-09-19T09:35:23.383 INFO:tasks.workunit.client.0.smithi112.stdout:9/275: rmdir df/d11/d14/d19/d28 39 2024-09-19T09:35:23.383 INFO:tasks.workunit.client.0.smithi112.stdout:1/271: dread dc/f20 [0,4194304] 0 2024-09-19T09:35:23.383 INFO:tasks.workunit.client.0.smithi112.stdout:1/272: creat dc/d24/f50 x:0 0 0 2024-09-19T09:35:23.385 INFO:tasks.workunit.client.0.smithi112.stdout:0/438: symlink d2/d59/d7a/l89 0 2024-09-19T09:35:23.386 INFO:tasks.workunit.client.0.smithi112.stdout:1/273: dread dc/d26/d34/f3f [0,4194304] 0 2024-09-19T09:35:23.388 INFO:tasks.workunit.client.0.smithi112.stdout:8/531: truncate d7/fa 75547 0 2024-09-19T09:35:23.388 INFO:tasks.workunit.client.0.smithi112.stdout:4/758: truncate d1/d3d/d72/dd6/ff3 491438 0 2024-09-19T09:35:23.389 INFO:tasks.workunit.client.0.smithi112.stdout:3/548: getdents d8/d15/d1b/d1c/d68/d33/d7b 0 2024-09-19T09:35:23.390 INFO:tasks.workunit.client.0.smithi112.stdout:7/553: getdents d2 0 2024-09-19T09:35:23.392 INFO:tasks.workunit.client.0.smithi112.stdout:5/509: unlink d4/d9/d17/d2f/l33 0 2024-09-19T09:35:23.392 INFO:tasks.workunit.client.0.smithi112.stdout:5/510: chown d4/lb 40 1 2024-09-19T09:35:23.392 INFO:tasks.workunit.client.0.smithi112.stdout:5/511: stat d4/f34 0 2024-09-19T09:35:23.393 INFO:tasks.workunit.client.0.smithi112.stdout:9/276: link l5 df/d4d/l5a 0 2024-09-19T09:35:23.395 INFO:tasks.workunit.client.0.smithi112.stdout:0/439: unlink d2/d59/c63 0 2024-09-19T09:35:23.395 INFO:tasks.workunit.client.0.smithi112.stdout:1/274: write dc/f21 [368209,130183] 0 2024-09-19T09:35:23.397 INFO:tasks.workunit.client.0.smithi112.stdout:4/759: mkdir d1/d5f/da4/d107 0 2024-09-19T09:35:23.398 INFO:tasks.workunit.client.0.smithi112.stdout:3/549: creat d8/d15/d1b/d1c/d68/d33/d72/fb6 x:0 0 0 2024-09-19T09:35:23.398 INFO:tasks.workunit.client.0.smithi112.stdout:3/550: chown d8/d15/d1b/d1c/d27/d62/d99 16 1 2024-09-19T09:35:23.398 INFO:tasks.workunit.client.0.smithi112.stdout:8/532: dread d7/d10/d11/d33/f7a [0,4194304] 0 2024-09-19T09:35:23.398 INFO:tasks.workunit.client.0.smithi112.stdout:6/576: dwrite d8/d11/d13/f56 [0,4194304] 0 2024-09-19T09:35:23.399 INFO:tasks.workunit.client.0.smithi112.stdout:7/554: creat d2/d2c/d54/d18/d39/d23/d35/fc5 x:0 0 0 2024-09-19T09:35:23.400 INFO:tasks.workunit.client.0.smithi112.stdout:1/275: write dc/ff [989066,27329] 0 2024-09-19T09:35:23.400 INFO:tasks.workunit.client.0.smithi112.stdout:1/276: stat dc/c1a 0 2024-09-19T09:35:23.401 INFO:tasks.workunit.client.0.smithi112.stdout:5/512: creat d4/d29/d36/da2/fb0 x:0 0 0 2024-09-19T09:35:23.401 INFO:tasks.workunit.client.0.smithi112.stdout:6/577: dread d8/de/d66/d8f/f97 [0,4194304] 0 2024-09-19T09:35:23.402 INFO:tasks.workunit.client.0.smithi112.stdout:9/277: creat df/d11/f5b x:0 0 0 2024-09-19T09:35:23.403 INFO:tasks.workunit.client.0.smithi112.stdout:0/440: mkdir d2/d39/d3b/d8a 0 2024-09-19T09:35:23.404 INFO:tasks.workunit.client.0.smithi112.stdout:0/441: creat d2/d59/d7a/f8b x:0 0 0 2024-09-19T09:35:23.404 INFO:tasks.workunit.client.0.smithi112.stdout:3/551: truncate d8/f30 1289483 0 2024-09-19T09:35:23.404 INFO:tasks.workunit.client.0.smithi112.stdout:3/552: write d8/d48/d67/f80 [922493,43376] 0 2024-09-19T09:35:23.408 INFO:tasks.workunit.client.0.smithi112.stdout:9/278: mkdir df/d11/d14/d19/d40/d5c 0 2024-09-19T09:35:23.410 INFO:tasks.workunit.client.0.smithi112.stdout:4/760: write d1/d3d/d41/fd0 [734307,80804] 0 2024-09-19T09:35:23.410 INFO:tasks.workunit.client.0.smithi112.stdout:4/761: readlink d1/d4/d3a/d57/d60/db3/ldc 0 2024-09-19T09:35:23.410 INFO:tasks.workunit.client.0.smithi112.stdout:4/762: readlink d1/d4/d3a/d57/d62/lf2 0 2024-09-19T09:35:23.411 INFO:tasks.workunit.client.0.smithi112.stdout:4/763: write d1/d31/d43/d48/f63 [4222049,33914] 0 2024-09-19T09:35:23.411 INFO:tasks.workunit.client.0.smithi112.stdout:1/277: dread dc/d13/f42 [0,4194304] 0 2024-09-19T09:35:23.412 INFO:tasks.workunit.client.0.smithi112.stdout:0/442: unlink d2/d59/d7a/c87 0 2024-09-19T09:35:23.415 INFO:tasks.workunit.client.0.smithi112.stdout:7/555: dread d2/d2c/d54/d18/d39/f47 [0,4194304] 0 2024-09-19T09:35:23.415 INFO:tasks.workunit.client.0.smithi112.stdout:3/553: unlink d8/d15/d1b/d1c/d68/c40 0 2024-09-19T09:35:23.415 INFO:tasks.workunit.client.0.smithi112.stdout:7/556: creat d2/d49/fc6 x:0 0 0 2024-09-19T09:35:23.416 INFO:tasks.workunit.client.0.smithi112.stdout:6/578: rmdir d8/de/d66/d6e 39 2024-09-19T09:35:23.418 INFO:tasks.workunit.client.0.smithi112.stdout:9/279: mkdir df/d4d/d5d 0 2024-09-19T09:35:23.418 INFO:tasks.workunit.client.0.smithi112.stdout:9/280: chown f3 1824026 1 2024-09-19T09:35:23.420 INFO:tasks.workunit.client.0.smithi112.stdout:4/764: unlink d1/d4/d3a/d57/d62/lf2 0 2024-09-19T09:35:23.420 INFO:tasks.workunit.client.0.smithi112.stdout:4/765: stat d1/d3d/d93 0 2024-09-19T09:35:23.421 INFO:tasks.workunit.client.0.smithi112.stdout:1/278: creat dc/d13/f51 x:0 0 0 2024-09-19T09:35:23.425 INFO:tasks.workunit.client.0.smithi112.stdout:7/557: link d2/d99/f9b d2/d2c/d54/d18/d39/d21/d45/fc7 0 2024-09-19T09:35:23.426 INFO:tasks.workunit.client.0.smithi112.stdout:6/579: mknod d8/d11/d14/d3c/dc0/cc9 0 2024-09-19T09:35:23.426 INFO:tasks.workunit.client.0.smithi112.stdout:1/279: dread dc/f20 [0,4194304] 0 2024-09-19T09:35:23.426 INFO:tasks.workunit.client.0.smithi112.stdout:1/280: write dc/d26/f29 [962562,54313] 0 2024-09-19T09:35:23.426 INFO:tasks.workunit.client.0.smithi112.stdout:1/281: creat dc/d24/f52 x:0 0 0 2024-09-19T09:35:23.427 INFO:tasks.workunit.client.0.smithi112.stdout:9/281: rename df/d11/d14/d19/d1e/l26 to df/d11/d14/d19/l5e 0 2024-09-19T09:35:23.428 INFO:tasks.workunit.client.0.smithi112.stdout:9/282: creat df/d11/d14/f5f x:0 0 0 2024-09-19T09:35:23.430 INFO:tasks.workunit.client.0.smithi112.stdout:6/580: symlink d8/de/d66/d6e/lca 0 2024-09-19T09:35:23.430 INFO:tasks.workunit.client.0.smithi112.stdout:6/581: fdatasync d8/d11/d14/f57 0 2024-09-19T09:35:23.430 INFO:tasks.workunit.client.0.smithi112.stdout:6/582: write d8/d11/d14/f3e [1060838,41169] 0 2024-09-19T09:35:23.432 INFO:tasks.workunit.client.0.smithi112.stdout:4/766: rename d1/d31/d71/d91/cb8 to d1/d31/d43/d48/c108 0 2024-09-19T09:35:23.433 INFO:tasks.workunit.client.0.smithi112.stdout:8/533: dwrite d7/db/d21/f24 [0,4194304] 0 2024-09-19T09:35:23.433 INFO:tasks.workunit.client.0.smithi112.stdout:8/534: readlink d7/l6c 0 2024-09-19T09:35:23.434 INFO:tasks.workunit.client.0.smithi112.stdout:6/583: dread d8/de/d66/d6e/f72 [0,4194304] 0 2024-09-19T09:35:23.434 INFO:tasks.workunit.client.0.smithi112.stdout:6/584: read d8/f16 [195236,19794] 0 2024-09-19T09:35:23.435 INFO:tasks.workunit.client.0.smithi112.stdout:5/513: dwrite d4/f34 [4194304,4194304] 0 2024-09-19T09:35:23.436 INFO:tasks.workunit.client.0.smithi112.stdout:9/283: symlink df/l60 0 2024-09-19T09:35:23.436 INFO:tasks.workunit.client.0.smithi112.stdout:3/554: dwrite d8/d15/d1b/d1c/d68/d33/d7b/fab [0,4194304] 0 2024-09-19T09:35:23.436 INFO:tasks.workunit.client.0.smithi112.stdout:3/555: chown d8/d48/c51 126725 1 2024-09-19T09:35:23.436 INFO:tasks.workunit.client.0.smithi112.stdout:3/556: stat d8/d15/d1b/d1c/d43/fa6 0 2024-09-19T09:35:23.437 INFO:tasks.workunit.client.0.smithi112.stdout:1/282: rename dc/d24/f32 to dc/f53 0 2024-09-19T09:35:23.439 INFO:tasks.workunit.client.0.smithi112.stdout:4/767: unlink d1/d31/d51/c1c 0 2024-09-19T09:35:23.439 INFO:tasks.workunit.client.0.smithi112.stdout:4/768: readlink d1/d5f/da4/lbd 0 2024-09-19T09:35:23.444 INFO:tasks.workunit.client.0.smithi112.stdout:6/585: mknod d8/de/d17/ccb 0 2024-09-19T09:35:23.448 INFO:tasks.workunit.client.0.smithi112.stdout:9/284: creat df/f61 x:0 0 0 2024-09-19T09:35:23.454 INFO:tasks.workunit.client.0.smithi112.stdout:1/283: dread dc/d13/f18 [0,4194304] 0 2024-09-19T09:35:23.457 INFO:tasks.workunit.client.0.smithi112.stdout:5/514: dread d4/d29/f3c [0,4194304] 0 2024-09-19T09:35:23.457 INFO:tasks.workunit.client.0.smithi112.stdout:8/535: dwrite d7/db/d21/d2e/f5e [4194304,4194304] 0 2024-09-19T09:35:23.458 INFO:tasks.workunit.client.0.smithi112.stdout:8/536: getdents d7/db/d21/d72 0 2024-09-19T09:35:23.464 INFO:tasks.workunit.client.0.smithi112.stdout:3/557: unlink d8/d48/d67/d7e/l9d 0 2024-09-19T09:35:23.464 INFO:tasks.workunit.client.0.smithi112.stdout:4/769: dwrite d1/d31/d43/fdf [0,4194304] 0 2024-09-19T09:35:23.464 INFO:tasks.workunit.client.0.smithi112.stdout:6/586: dwrite d8/de/d66/d6e/fbd [0,4194304] 0 2024-09-19T09:35:23.464 INFO:tasks.workunit.client.0.smithi112.stdout:6/587: readlink d8/de/l25 0 2024-09-19T09:35:23.464 INFO:tasks.workunit.client.0.smithi112.stdout:6/588: fdatasync d8/de/d18/d20/f91 0 2024-09-19T09:35:23.464 INFO:tasks.workunit.client.0.smithi112.stdout:4/770: write d1/ff7 [882460,10971] 0 2024-09-19T09:35:23.464 INFO:tasks.workunit.client.0.smithi112.stdout:6/589: write d8/de/d18/d20/f3a [4253666,95646] 0 2024-09-19T09:35:23.468 INFO:tasks.workunit.client.0.smithi112.stdout:9/285: link df/d11/d14/f18 df/d11/d14/f62 0 2024-09-19T09:35:23.479 INFO:tasks.workunit.client.0.smithi112.stdout:1/284: link dc/d24/f40 dc/d26/d34/d4c/f54 0 2024-09-19T09:35:23.481 INFO:tasks.workunit.client.0.smithi112.stdout:5/515: symlink d4/d84/lb1 0 2024-09-19T09:35:23.484 INFO:tasks.workunit.client.0.smithi112.stdout:8/537: mkdir d7/d10/d11/d55/d9e/da1 0 2024-09-19T09:35:23.484 INFO:tasks.workunit.client.0.smithi112.stdout:8/538: creat d7/db/fa2 x:0 0 0 2024-09-19T09:35:23.490 INFO:tasks.workunit.client.0.smithi112.stdout:5/516: dread d4/d9/f25 [0,4194304] 0 2024-09-19T09:35:23.490 INFO:tasks.workunit.client.0.smithi112.stdout:8/539: fdatasync d7/db/d21/d3b/d56/d3c/f9f 0 2024-09-19T09:35:23.496 INFO:tasks.workunit.client.0.smithi112.stdout:2/287: truncate d0/d1/fd 4294518 0 2024-09-19T09:35:23.498 INFO:tasks.workunit.client.0.smithi112.stdout:1/285: dwrite dc/d13/f33 [0,4194304] 0 2024-09-19T09:35:23.498 INFO:tasks.workunit.client.0.smithi112.stdout:1/286: chown f6 499 1 2024-09-19T09:35:23.500 INFO:tasks.workunit.client.0.smithi112.stdout:4/771: unlink d1/d3d/f3f 0 2024-09-19T09:35:23.500 INFO:tasks.workunit.client.0.smithi112.stdout:4/772: dread - d1/d4/d3a/d57/d62/d88/fd5 zero size 2024-09-19T09:35:23.500 INFO:tasks.workunit.client.0.smithi112.stdout:4/773: truncate d1/d31/d43/d48/f94 586014 0 2024-09-19T09:35:23.502 INFO:tasks.workunit.client.0.smithi112.stdout:4/774: dread d1/d31/d51/f4c [0,4194304] 0 2024-09-19T09:35:23.502 INFO:tasks.workunit.client.0.smithi112.stdout:4/775: getdents d1/d31/da7 0 2024-09-19T09:35:23.502 INFO:tasks.workunit.client.0.smithi112.stdout:4/776: truncate d1/f101 256109 0 2024-09-19T09:35:23.506 INFO:tasks.workunit.client.0.smithi112.stdout:9/286: unlink df/d11/d14/c16 0 2024-09-19T09:35:23.506 INFO:tasks.workunit.client.0.smithi112.stdout:4/777: write d1/f9b [641924,31089] 0 2024-09-19T09:35:23.506 INFO:tasks.workunit.client.0.smithi112.stdout:4/778: fsync d1/d3d/d72/f7b 0 2024-09-19T09:35:23.527 INFO:tasks.workunit.client.0.smithi112.stdout:1/287: dwrite dc/d26/d34/d4c/f54 [0,4194304] 0 2024-09-19T09:35:23.527 INFO:tasks.workunit.client.0.smithi112.stdout:1/288: write dc/d26/f4e [596568,64557] 0 2024-09-19T09:35:23.531 INFO:tasks.workunit.client.0.smithi112.stdout:9/287: dwrite df/d11/d14/d19/d40/f4b [0,4194304] 0 2024-09-19T09:35:23.531 INFO:tasks.workunit.client.0.smithi112.stdout:4/779: dwrite d1/f101 [0,4194304] 0 2024-09-19T09:35:23.542 INFO:tasks.workunit.client.0.smithi112.stdout:5/517: mkdir d4/d9/d17/da6/db2 0 2024-09-19T09:35:23.546 INFO:tasks.workunit.client.0.smithi112.stdout:8/540: link d7/db/d21/d2e/d8c/d97/c9c d7/db/d21/d3b/d56/d48/ca3 0 2024-09-19T09:35:23.551 INFO:tasks.workunit.client.0.smithi112.stdout:1/289: mkdir dc/d26/d34/d4c/d55 0 2024-09-19T09:35:23.551 INFO:tasks.workunit.client.0.smithi112.stdout:1/290: fsync dc/d26/d34/f3f 0 2024-09-19T09:35:23.551 INFO:tasks.workunit.client.0.smithi112.stdout:4/780: dwrite d1/d4/d3a/d7a/fe6 [0,4194304] 0 2024-09-19T09:35:23.551 INFO:tasks.workunit.client.0.smithi112.stdout:4/781: fdatasync d1/d4/d3a/f22 0 2024-09-19T09:35:23.555 INFO:tasks.workunit.client.0.smithi112.stdout:0/443: rmdir d2/d59/d7a 39 2024-09-19T09:35:23.557 INFO:tasks.workunit.client.0.smithi112.stdout:1/291: dread dc/fe [4194304,4194304] 0 2024-09-19T09:35:23.558 INFO:tasks.workunit.client.0.smithi112.stdout:9/288: mkdir df/d11/d14/d19/d1e/d63 0 2024-09-19T09:35:23.559 INFO:tasks.workunit.client.0.smithi112.stdout:5/518: link d4/d9/d6b/f6d d4/d3f/da9/fb3 0 2024-09-19T09:35:23.561 INFO:tasks.workunit.client.0.smithi112.stdout:8/541: truncate d7/d10/d11/d33/f54 3591092 0 2024-09-19T09:35:23.561 INFO:tasks.workunit.client.0.smithi112.stdout:8/542: creat d7/db/d21/d3b/d56/d3c/fa4 x:0 0 0 2024-09-19T09:35:23.563 INFO:tasks.workunit.client.0.smithi112.stdout:2/288: getdents d0/d6/d24 0 2024-09-19T09:35:23.567 INFO:tasks.workunit.client.0.smithi112.stdout:7/558: fsync d2/d99/f9b 0 2024-09-19T09:35:23.568 INFO:tasks.workunit.client.0.smithi112.stdout:7/559: fdatasync d2/d2c/d54/d18/d39/fb7 0 2024-09-19T09:35:23.568 INFO:tasks.workunit.client.0.smithi112.stdout:7/560: readlink d2/d2c/d54/d18/d39/d23/l4f 0 2024-09-19T09:35:23.568 INFO:tasks.workunit.client.0.smithi112.stdout:4/782: creat d1/d4/d3a/d57/d60/db3/f109 x:0 0 0 2024-09-19T09:35:23.568 INFO:tasks.workunit.client.0.smithi112.stdout:0/444: mknod d2/d11/c8c 0 2024-09-19T09:35:23.570 INFO:tasks.workunit.client.0.smithi112.stdout:1/292: creat dc/d26/d34/d4c/d55/f56 x:0 0 0 2024-09-19T09:35:23.572 INFO:tasks.workunit.client.0.smithi112.stdout:9/289: mknod df/d11/d14/c64 0 2024-09-19T09:35:23.576 INFO:tasks.workunit.client.0.smithi112.stdout:5/519: mkdir d4/d9/d17/db4 0 2024-09-19T09:35:23.582 INFO:tasks.workunit.client.0.smithi112.stdout:8/543: unlink d7/d10/d11/l35 0 2024-09-19T09:35:23.582 INFO:tasks.workunit.client.0.smithi112.stdout:2/289: symlink d0/d4a/l5c 0 2024-09-19T09:35:23.584 INFO:tasks.workunit.client.0.smithi112.stdout:7/561: mkdir d2/d2c/d54/d18/d8a/d7c/db1/dc8 0 2024-09-19T09:35:23.584 INFO:tasks.workunit.client.0.smithi112.stdout:7/562: stat d2/d2c/d54/d18/d39/d21/d71 0 2024-09-19T09:35:23.584 INFO:tasks.workunit.client.0.smithi112.stdout:7/563: write d2/d2c/d54/d18/d39/d23/d35/fc5 [4297,49719] 0 2024-09-19T09:35:23.586 INFO:tasks.workunit.client.0.smithi112.stdout:4/783: link d1/f29 d1/d31/d96/f10a 0 2024-09-19T09:35:23.587 INFO:tasks.workunit.client.0.smithi112.stdout:4/784: creat d1/d3d/d41/f10b x:0 0 0 2024-09-19T09:35:23.588 INFO:tasks.workunit.client.0.smithi112.stdout:0/445: rename d2/d39/d3b/c66 to d2/d39/d3b/d8a/c8d 0 2024-09-19T09:35:23.592 INFO:tasks.workunit.client.0.smithi112.stdout:2/290: symlink d0/d4a/l5d 0 2024-09-19T09:35:23.592 INFO:tasks.workunit.client.0.smithi112.stdout:2/291: fsync d0/d1/f22 0 2024-09-19T09:35:23.594 INFO:tasks.workunit.client.0.smithi112.stdout:0/446: creat d2/d6e/d75/f8e x:0 0 0 2024-09-19T09:35:23.595 INFO:tasks.workunit.client.0.smithi112.stdout:8/544: write d7/db/d21/d2e/f5e [7269567,58351] 0 2024-09-19T09:35:23.600 INFO:tasks.workunit.client.0.smithi112.stdout:2/292: creat d0/d4a/f5e x:0 0 0 2024-09-19T09:35:23.600 INFO:tasks.workunit.client.0.smithi112.stdout:2/293: truncate d0/d1/d28/f10 2687655 0 2024-09-19T09:35:23.600 INFO:tasks.workunit.client.0.smithi112.stdout:2/294: truncate d0/d3e/d50/d57/d5a/d27/f34 415753 0 2024-09-19T09:35:23.601 INFO:tasks.workunit.client.0.smithi112.stdout:4/785: dread d1/d4/d3a/d57/d60/fc5 [0,4194304] 0 2024-09-19T09:35:23.601 INFO:tasks.workunit.client.0.smithi112.stdout:8/545: mknod d7/db/d21/d3b/d56/d3c/ca5 0 2024-09-19T09:35:23.601 INFO:tasks.workunit.client.0.smithi112.stdout:8/546: readlink d7/d10/d11/d55/l60 0 2024-09-19T09:35:23.601 INFO:tasks.workunit.client.0.smithi112.stdout:8/547: readlink d7/db/lc 0 2024-09-19T09:35:23.602 INFO:tasks.workunit.client.0.smithi112.stdout:8/548: dread - d7/db/d21/d3b/d56/d3c/fa4 zero size 2024-09-19T09:35:23.602 INFO:tasks.workunit.client.0.smithi112.stdout:5/520: dwrite d4/d9/f10 [0,4194304] 0 2024-09-19T09:35:23.602 INFO:tasks.workunit.client.0.smithi112.stdout:5/521: chown d4/d9/d17/d2f/d7d/l65 804418263 1 2024-09-19T09:35:23.604 INFO:tasks.workunit.client.0.smithi112.stdout:2/295: mkdir d0/d1/d5f 0 2024-09-19T09:35:23.604 INFO:tasks.workunit.client.0.smithi112.stdout:4/786: mknod d1/d4/d3a/d7a/d7f/da8/c10c 0 2024-09-19T09:35:23.609 INFO:tasks.workunit.client.0.smithi112.stdout:7/564: dwrite d2/d2c/d54/d1a/fbc [0,4194304] 0 2024-09-19T09:35:23.609 INFO:tasks.workunit.client.0.smithi112.stdout:7/565: dread - d2/d49/fc6 zero size 2024-09-19T09:35:23.614 INFO:tasks.workunit.client.0.smithi112.stdout:7/566: creat d2/d2c/d54/d18/d39/d23/d35/d4c/d70/fc9 x:0 0 0 2024-09-19T09:35:23.615 INFO:tasks.workunit.client.0.smithi112.stdout:7/567: symlink d2/lca 0 2024-09-19T09:35:23.622 INFO:tasks.workunit.client.0.smithi112.stdout:8/549: read d7/db/d21/d3b/d56/d4b/f5f [3347712,2243] 0 2024-09-19T09:35:23.624 INFO:tasks.workunit.client.0.smithi112.stdout:8/550: symlink d7/d10/d11/d55/d9e/la6 0 2024-09-19T09:35:23.624 INFO:tasks.workunit.client.0.smithi112.stdout:8/551: chown d7/d10/l1a 337 1 2024-09-19T09:35:23.653 INFO:tasks.workunit.client.0.smithi112.stdout:2/296: dwrite d0/d1/f1f [0,4194304] 0 2024-09-19T09:35:23.653 INFO:tasks.workunit.client.0.smithi112.stdout:5/522: dwrite d4/d9/d17/d30/fab [0,4194304] 0 2024-09-19T09:35:23.653 INFO:tasks.workunit.client.0.smithi112.stdout:5/523: creat d4/d9/d17/d2f/d72/fb5 x:0 0 0 2024-09-19T09:35:23.654 INFO:tasks.workunit.client.0.smithi112.stdout:3/558: dwrite d8/d15/d1b/d1c/d68/d33/d7b/fab [4194304,4194304] 0 2024-09-19T09:35:23.654 INFO:tasks.workunit.client.0.smithi112.stdout:7/568: dwrite d2/d2c/d54/d18/d39/d21/fa2 [0,4194304] 0 2024-09-19T09:35:23.654 INFO:tasks.workunit.client.0.smithi112.stdout:7/569: write d2/d2c/d54/d18/fc0 [2460448,80147] 0 2024-09-19T09:35:23.656 INFO:tasks.workunit.client.0.smithi112.stdout:8/552: dwrite d7/db/d21/d3b/d56/d4b/fa0 [0,4194304] 0 2024-09-19T09:35:23.656 INFO:tasks.workunit.client.0.smithi112.stdout:8/553: write d7/d10/d11/d55/f98 [694499,113554] 0 2024-09-19T09:35:23.657 INFO:tasks.workunit.client.0.smithi112.stdout:2/297: mknod d0/d3e/d50/d57/d5a/c60 0 2024-09-19T09:35:23.658 INFO:tasks.workunit.client.0.smithi112.stdout:9/290: rmdir df/d11/d14 39 2024-09-19T09:35:23.658 INFO:tasks.workunit.client.0.smithi112.stdout:9/291: dread - df/d11/d14/f4c zero size 2024-09-19T09:35:23.661 INFO:tasks.workunit.client.0.smithi112.stdout:5/524: creat d4/d9/d17/d2f/fb6 x:0 0 0 2024-09-19T09:35:23.669 INFO:tasks.workunit.client.0.smithi112.stdout:7/570: symlink d2/d2c/d54/d18/d8a/lcb 0 2024-09-19T09:35:23.670 INFO:tasks.workunit.client.0.smithi112.stdout:8/554: dread d7/d10/d11/f37 [0,4194304] 0 2024-09-19T09:35:23.670 INFO:tasks.workunit.client.0.smithi112.stdout:3/559: dwrite f7 [0,4194304] 0 2024-09-19T09:35:23.673 INFO:tasks.workunit.client.0.smithi112.stdout:1/293: truncate dc/d24/f40 3067380 0 2024-09-19T09:35:23.673 INFO:tasks.workunit.client.0.smithi112.stdout:1/294: chown dc/f53 201319429 1 2024-09-19T09:35:23.674 INFO:tasks.workunit.client.0.smithi112.stdout:2/298: truncate d0/d3e/d50/d57/d5a/d4f/f52 1821633 0 2024-09-19T09:35:23.676 INFO:tasks.workunit.client.0.smithi112.stdout:8/555: dread d7/db/d21/d3b/d56/d4b/f5f [0,4194304] 0 2024-09-19T09:35:23.676 INFO:tasks.workunit.client.0.smithi112.stdout:8/556: truncate d7/d65/f91 34364 0 2024-09-19T09:35:23.677 INFO:tasks.workunit.client.0.smithi112.stdout:9/292: truncate df/d4d/f4a 248391 0 2024-09-19T09:35:23.677 INFO:tasks.workunit.client.0.smithi112.stdout:9/293: chown df/d11/d14/d19/l5e 36 1 2024-09-19T09:35:23.678 INFO:tasks.workunit.client.0.smithi112.stdout:5/525: mknod d4/d29/d36/d70/cb7 0 2024-09-19T09:35:23.679 INFO:tasks.workunit.client.0.smithi112.stdout:7/571: mkdir d2/d2c/d54/d18/d8a/dcc 0 2024-09-19T09:35:23.679 INFO:tasks.workunit.client.0.smithi112.stdout:7/572: dread - d2/d2c/d54/d18/d39/d23/d35/fa7 zero size 2024-09-19T09:35:23.681 INFO:tasks.workunit.client.0.smithi112.stdout:3/560: symlink d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d63/lb7 0 2024-09-19T09:35:23.681 INFO:tasks.workunit.client.0.smithi112.stdout:3/561: stat d8/d15/d1b/d1c/d27/d2b/f5c 0 2024-09-19T09:35:23.682 INFO:tasks.workunit.client.0.smithi112.stdout:1/295: symlink dc/d26/d44/l57 0 2024-09-19T09:35:23.682 INFO:tasks.workunit.client.0.smithi112.stdout:1/296: write dc/d24/f50 [723950,32845] 0 2024-09-19T09:35:23.685 INFO:tasks.workunit.client.0.smithi112.stdout:2/299: mkdir d0/d3e/d61 0 2024-09-19T09:35:23.693 INFO:tasks.workunit.client.0.smithi112.stdout:7/573: mkdir d2/d2c/d54/d18/d85/dcd 0 2024-09-19T09:35:23.693 INFO:tasks.workunit.client.0.smithi112.stdout:7/574: readlink d2/l89 0 2024-09-19T09:35:23.695 INFO:tasks.workunit.client.0.smithi112.stdout:5/526: dwrite d4/d9/d17/d30/f89 [0,4194304] 0 2024-09-19T09:35:23.697 INFO:tasks.workunit.client.0.smithi112.stdout:3/562: mknod d8/d15/d1b/d1c/d68/d33/d83/cb8 0 2024-09-19T09:35:23.699 INFO:tasks.workunit.client.0.smithi112.stdout:1/297: mkdir dc/d13/d58 0 2024-09-19T09:35:23.699 INFO:tasks.workunit.client.0.smithi112.stdout:1/298: readlink dc/d26/d44/l48 0 2024-09-19T09:35:23.706 INFO:tasks.workunit.client.0.smithi112.stdout:1/299: mkdir dc/d59 0 2024-09-19T09:35:23.706 INFO:tasks.workunit.client.0.smithi112.stdout:1/300: creat dc/d26/d34/d4c/d55/f5a x:0 0 0 2024-09-19T09:35:23.707 INFO:tasks.workunit.client.0.smithi112.stdout:2/300: dwrite d0/d1/f1f [0,4194304] 0 2024-09-19T09:35:23.709 INFO:tasks.workunit.client.0.smithi112.stdout:7/575: rmdir d2/d2c/d54/d18/d39/d23/d35/d4c/d70 39 2024-09-19T09:35:23.709 INFO:tasks.workunit.client.0.smithi112.stdout:5/527: dread d4/d9/d2a/f43 [0,4194304] 0 2024-09-19T09:35:23.712 INFO:tasks.workunit.client.0.smithi112.stdout:1/301: truncate dc/d26/d34/f3f 10310 0 2024-09-19T09:35:23.712 INFO:tasks.workunit.client.0.smithi112.stdout:1/302: dread - dc/d26/d34/d4c/d55/f5a zero size 2024-09-19T09:35:23.716 INFO:tasks.workunit.client.0.smithi112.stdout:3/563: dread d8/fb [4194304,4194304] 0 2024-09-19T09:35:23.717 INFO:tasks.workunit.client.0.smithi112.stdout:3/564: mkdir d8/d15/d1b/d1c/d68/db9 0 2024-09-19T09:35:23.719 INFO:tasks.workunit.client.0.smithi112.stdout:3/565: rmdir d8/d15/d1b/d1c/d68/d33/d66 39 2024-09-19T09:35:23.719 INFO:tasks.workunit.client.0.smithi112.stdout:3/566: chown d8/f17 5123185 1 2024-09-19T09:35:23.724 INFO:tasks.workunit.client.0.smithi112.stdout:9/294: read df/d4d/f4a [120516,66813] 0 2024-09-19T09:35:23.724 INFO:tasks.workunit.client.0.smithi112.stdout:9/295: dread - df/d11/f5b zero size 2024-09-19T09:35:23.724 INFO:tasks.workunit.client.0.smithi112.stdout:9/296: write df/d11/d14/d19/d40/f4b [4238044,112449] 0 2024-09-19T09:35:23.729 INFO:tasks.workunit.client.0.smithi112.stdout:9/297: link df/d11/c17 df/d11/d14/d19/d28/c65 0 2024-09-19T09:35:23.732 INFO:tasks.workunit.client.0.smithi112.stdout:9/298: rename df/d4d to df/d11/d14/d19/d66 0 2024-09-19T09:35:23.732 INFO:tasks.workunit.client.0.smithi112.stdout:9/299: fsync f3 0 2024-09-19T09:35:23.734 INFO:tasks.workunit.client.0.smithi112.stdout:9/300: unlink df/d11/d14/f41 0 2024-09-19T09:35:23.736 INFO:tasks.workunit.client.0.smithi112.stdout:9/301: rename df/d11/d14/d19/d40/l53 to df/d11/d14/d19/d40/l67 0 2024-09-19T09:35:23.737 INFO:tasks.workunit.client.0.smithi112.stdout:9/302: mknod df/d11/d14/d19/d66/d5d/c68 0 2024-09-19T09:35:23.738 INFO:tasks.workunit.client.0.smithi112.stdout:9/303: truncate df/d35/f38 2819378 0 2024-09-19T09:35:23.739 INFO:tasks.workunit.client.0.smithi112.stdout:9/304: chown df/d11/f25 0 1 2024-09-19T09:35:23.751 INFO:tasks.workunit.client.0.smithi112.stdout:5/528: dwrite d4/d9/d17/d30/f92 [0,4194304] 0 2024-09-19T09:35:23.763 INFO:tasks.workunit.client.0.smithi112.stdout:1/303: dwrite dc/d26/d34/d4c/f54 [0,4194304] 0 2024-09-19T09:35:23.764 INFO:tasks.workunit.client.0.smithi112.stdout:2/301: dwrite d0/d1/fd [0,4194304] 0 2024-09-19T09:35:23.764 INFO:tasks.workunit.client.0.smithi112.stdout:2/302: readlink d0/d4a/l55 0 2024-09-19T09:35:23.764 INFO:tasks.workunit.client.0.smithi112.stdout:3/567: dwrite d8/d48/d67/f80 [0,4194304] 0 2024-09-19T09:35:23.764 INFO:tasks.workunit.client.0.smithi112.stdout:7/576: dwrite d2/d2c/d54/d1a/fbc [0,4194304] 0 2024-09-19T09:35:23.766 INFO:tasks.workunit.client.0.smithi112.stdout:9/305: dwrite df/d11/d14/f1f [0,4194304] 0 2024-09-19T09:35:23.769 INFO:tasks.workunit.client.0.smithi112.stdout:1/304: read dc/d13/f18 [1502349,51363] 0 2024-09-19T09:35:23.772 INFO:tasks.workunit.client.0.smithi112.stdout:5/529: dwrite d4/d9/d17/d2f/f8a [0,4194304] 0 2024-09-19T09:35:23.772 INFO:tasks.workunit.client.0.smithi112.stdout:5/530: write d4/d9/d2a/d69/f9f [354417,89945] 0 2024-09-19T09:35:23.773 INFO:tasks.workunit.client.0.smithi112.stdout:5/531: fdatasync d4/d9/d17/d30/f80 0 2024-09-19T09:35:23.780 INFO:tasks.workunit.client.0.smithi112.stdout:5/532: link d4/d9/d17/d2f/f32 d4/d3f/da9/fb8 0 2024-09-19T09:35:23.781 INFO:tasks.workunit.client.0.smithi112.stdout:1/305: dread f8 [0,4194304] 0 2024-09-19T09:35:23.781 INFO:tasks.workunit.client.0.smithi112.stdout:1/306: chown dc/d26/d44/l57 8241 1 2024-09-19T09:35:23.794 INFO:tasks.workunit.client.0.smithi112.stdout:5/533: write d4/d29/d36/d5f/f8b [6086657,8373] 0 2024-09-19T09:35:23.794 INFO:tasks.workunit.client.0.smithi112.stdout:5/534: dread - d4/d9/d2a/d69/f58 zero size 2024-09-19T09:35:23.794 INFO:tasks.workunit.client.0.smithi112.stdout:5/535: truncate d4/d3f/f6c 907855 0 2024-09-19T09:35:23.802 INFO:tasks.workunit.client.0.smithi112.stdout:3/568: dwrite d8/d15/f29 [4194304,4194304] 0 2024-09-19T09:35:23.802 INFO:tasks.workunit.client.0.smithi112.stdout:3/569: stat d8/d15/d1b/d1c/d27/d2b 0 2024-09-19T09:35:23.804 INFO:tasks.workunit.client.0.smithi112.stdout:3/570: getdents d8/d15/d1b/d1c/d68/d33/d66 0 2024-09-19T09:35:23.805 INFO:tasks.workunit.client.0.smithi112.stdout:2/303: dwrite d0/d3e/d49/f4c [0,4194304] 0 2024-09-19T09:35:23.805 INFO:tasks.workunit.client.0.smithi112.stdout:2/304: read d0/f5 [1364245,46571] 0 2024-09-19T09:35:23.806 INFO:tasks.workunit.client.0.smithi112.stdout:9/306: dwrite df/d11/d14/f18 [4194304,4194304] 0 2024-09-19T09:35:23.807 INFO:tasks.workunit.client.0.smithi112.stdout:9/307: fsync f0 0 2024-09-19T09:35:23.807 INFO:tasks.workunit.client.0.smithi112.stdout:9/308: chown df/d11/c1b 403 1 2024-09-19T09:35:23.807 INFO:tasks.workunit.client.0.smithi112.stdout:9/309: truncate df/d11/d14/f2e 685944 0 2024-09-19T09:35:23.807 INFO:tasks.workunit.client.0.smithi112.stdout:2/305: rmdir d0/d6/d24 39 2024-09-19T09:35:23.808 INFO:tasks.workunit.client.0.smithi112.stdout:9/310: rmdir df/d11/d14/d51 39 2024-09-19T09:35:23.809 INFO:tasks.workunit.client.0.smithi112.stdout:2/306: creat d0/d6/f62 x:0 0 0 2024-09-19T09:35:23.821 INFO:tasks.workunit.client.0.smithi112.stdout:9/311: dread df/d11/d14/d51/f54 [0,4194304] 0 2024-09-19T09:35:23.824 INFO:tasks.workunit.client.0.smithi112.stdout:1/307: dwrite dc/f21 [4194304,4194304] 0 2024-09-19T09:35:23.824 INFO:tasks.workunit.client.0.smithi112.stdout:1/308: write dc/fe [7193511,13399] 0 2024-09-19T09:35:23.824 INFO:tasks.workunit.client.0.smithi112.stdout:1/309: chown f6 308 1 2024-09-19T09:35:23.826 INFO:tasks.workunit.client.0.smithi112.stdout:5/536: dwrite d4/d9/d2a/d39/f3a [0,4194304] 0 2024-09-19T09:35:23.829 INFO:tasks.workunit.client.0.smithi112.stdout:5/537: symlink d4/d9/d17/d30/lb9 0 2024-09-19T09:35:23.830 INFO:tasks.workunit.client.0.smithi112.stdout:5/538: mkdir d4/d9/d2a/d39/d88/dba 0 2024-09-19T09:35:23.833 INFO:tasks.workunit.client.0.smithi112.stdout:3/571: dwrite d8/d15/d1b/d1c/d68/d33/f57 [0,4194304] 0 2024-09-19T09:35:23.833 INFO:tasks.workunit.client.0.smithi112.stdout:2/307: dwrite d0/d3e/d50/d57/d5a/d4b/f53 [0,4194304] 0 2024-09-19T09:35:23.834 INFO:tasks.workunit.client.0.smithi112.stdout:3/572: getdents d8/d15/d1b/d1c/d68/d33/d6f 0 2024-09-19T09:35:23.839 INFO:tasks.workunit.client.0.smithi112.stdout:3/573: rename d8/d15/d1b/d1c/d68/l46 to d8/d15/d1b/d1c/d68/d33/d72/lba 0 2024-09-19T09:35:23.839 INFO:tasks.workunit.client.0.smithi112.stdout:3/574: truncate d8/d15/d1b/d1c/d43/d4f/f5f 1214123 0 2024-09-19T09:35:23.840 INFO:tasks.workunit.client.0.smithi112.stdout:2/308: rmdir d0/d1 39 2024-09-19T09:35:23.843 INFO:tasks.workunit.client.0.smithi112.stdout:2/309: creat d0/d3e/d61/f63 x:0 0 0 2024-09-19T09:35:23.843 INFO:tasks.workunit.client.0.smithi112.stdout:2/310: write d0/d6/fa [2937140,8074] 0 2024-09-19T09:35:23.845 INFO:tasks.workunit.client.0.smithi112.stdout:2/311: creat d0/d3e/d50/f64 x:0 0 0 2024-09-19T09:35:23.845 INFO:tasks.workunit.client.0.smithi112.stdout:2/312: write d0/f5 [274696,54937] 0 2024-09-19T09:35:23.848 INFO:tasks.workunit.client.0.smithi112.stdout:9/312: dwrite df/d11/d14/d19/f33 [0,4194304] 0 2024-09-19T09:35:23.849 INFO:tasks.workunit.client.0.smithi112.stdout:5/539: dwrite d4/d9/fa3 [0,4194304] 0 2024-09-19T09:35:23.850 INFO:tasks.workunit.client.0.smithi112.stdout:3/575: write d8/f17 [3484693,70416] 0 2024-09-19T09:35:23.851 INFO:tasks.workunit.client.0.smithi112.stdout:9/313: creat df/d11/d14/d19/d1e/f69 x:0 0 0 2024-09-19T09:35:23.854 INFO:tasks.workunit.client.0.smithi112.stdout:3/576: getdents d8/d48 0 2024-09-19T09:35:23.856 INFO:tasks.workunit.client.0.smithi112.stdout:3/577: creat d8/d15/d1b/d1c/d27/d62/d99/fbb x:0 0 0 2024-09-19T09:35:23.861 INFO:tasks.workunit.client.0.smithi112.stdout:3/578: rename d8/d15/d1b/d1c/d43/f4e to d8/d15/d1b/d1c/d68/d33/d8e/fbc 0 2024-09-19T09:35:23.865 INFO:tasks.workunit.client.0.smithi112.stdout:3/579: symlink d8/d48/d67/lbd 0 2024-09-19T09:35:23.865 INFO:tasks.workunit.client.0.smithi112.stdout:3/580: write d8/d15/d1b/d1c/d68/d33/d83/f9c [1532478,82239] 0 2024-09-19T09:35:23.868 INFO:tasks.workunit.client.0.smithi112.stdout:3/581: creat d8/d15/d1b/d1c/d43/d4f/fbe x:0 0 0 2024-09-19T09:35:23.868 INFO:tasks.workunit.client.0.smithi112.stdout:3/582: creat d8/d15/d1b/d1c/d68/d33/d59/d44/fbf x:0 0 0 2024-09-19T09:35:23.868 INFO:tasks.workunit.client.0.smithi112.stdout:3/583: truncate d8/d15/d1b/d1c/d43/d4f/fbe 784570 0 2024-09-19T09:35:23.868 INFO:tasks.workunit.client.0.smithi112.stdout:3/584: write d8/d15/d1b/d1c/d68/d33/f35 [2378412,97269] 0 2024-09-19T09:35:23.870 INFO:tasks.workunit.client.0.smithi112.stdout:3/585: creat d8/d15/d1b/d1c/d43/d9b/fc0 x:0 0 0 2024-09-19T09:35:23.871 INFO:tasks.workunit.client.0.smithi112.stdout:2/313: dwrite d0/f2e [0,4194304] 0 2024-09-19T09:35:23.871 INFO:tasks.workunit.client.0.smithi112.stdout:2/314: write d0/d3e/d61/f63 [966757,104026] 0 2024-09-19T09:35:23.881 INFO:tasks.workunit.client.0.smithi112.stdout:5/540: dwrite d4/d9/d17/d2f/d72/f42 [0,4194304] 0 2024-09-19T09:35:23.881 INFO:tasks.workunit.client.0.smithi112.stdout:5/541: mkdir d4/d9/d17/dbb 0 2024-09-19T09:35:23.881 INFO:tasks.workunit.client.0.smithi112.stdout:5/542: readlink d4/d9/d17/la5 0 2024-09-19T09:35:23.881 INFO:tasks.workunit.client.0.smithi112.stdout:3/586: dread d8/f10 [0,4194304] 0 2024-09-19T09:35:23.881 INFO:tasks.workunit.client.0.smithi112.stdout:5/543: getdents d4 0 2024-09-19T09:35:23.883 INFO:tasks.workunit.client.0.smithi112.stdout:3/587: creat d8/d15/d1b/d1c/d27/d62/fc1 x:0 0 0 2024-09-19T09:35:23.884 INFO:tasks.workunit.client.0.smithi112.stdout:2/315: dread d0/d6/f36 [0,4194304] 0 2024-09-19T09:35:23.893 INFO:tasks.workunit.client.0.smithi112.stdout:3/588: write d8/d15/f29 [609188,72741] 0 2024-09-19T09:35:23.898 INFO:tasks.workunit.client.0.smithi112.stdout:2/316: dread d0/d3e/d61/f63 [0,4194304] 0 2024-09-19T09:35:23.898 INFO:tasks.workunit.client.0.smithi112.stdout:5/544: dwrite d4/d9/d17/d30/fab [4194304,4194304] 0 2024-09-19T09:35:23.900 INFO:tasks.workunit.client.0.smithi112.stdout:2/317: rename d0/d6/f1d to d0/d3e/d50/d57/d5a/d4b/f65 0 2024-09-19T09:35:23.902 INFO:tasks.workunit.client.0.smithi112.stdout:2/318: creat d0/d3e/f66 x:0 0 0 2024-09-19T09:35:23.908 INFO:tasks.workunit.client.0.smithi112.stdout:5/545: dread d4/d9/d17/d2f/f8a [0,4194304] 0 2024-09-19T09:35:23.909 INFO:tasks.workunit.client.0.smithi112.stdout:5/546: rmdir d4/d9/d2a/d39/d88 39 2024-09-19T09:35:23.909 INFO:tasks.workunit.client.0.smithi112.stdout:5/547: dread - d4/d9/d2a/d69/f58 zero size 2024-09-19T09:35:23.910 INFO:tasks.workunit.client.0.smithi112.stdout:2/319: dread d0/d3e/d49/f4c [0,4194304] 0 2024-09-19T09:35:23.911 INFO:tasks.workunit.client.0.smithi112.stdout:3/589: dwrite d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d63/f71 [0,4194304] 0 2024-09-19T09:35:23.911 INFO:tasks.workunit.client.0.smithi112.stdout:3/590: read - d8/d15/d1b/d1c/d68/d33/d72/fb6 zero size 2024-09-19T09:35:23.911 INFO:tasks.workunit.client.0.smithi112.stdout:3/591: chown d8/c61 0 1 2024-09-19T09:35:23.911 INFO:tasks.workunit.client.0.smithi112.stdout:2/320: mkdir d0/d1/d28/d67 0 2024-09-19T09:35:23.916 INFO:tasks.workunit.client.0.smithi112.stdout:5/548: write d4/d9/f10 [3664812,28595] 0 2024-09-19T09:35:23.959 INFO:tasks.workunit.client.0.smithi112.stdout:2/321: creat d0/d3e/d50/d57/d5a/d56/f68 x:0 0 0 2024-09-19T09:35:23.960 INFO:tasks.workunit.client.0.smithi112.stdout:3/592: mknod d8/d15/d1b/d1c/d43/d9b/cc2 0 2024-09-19T09:35:23.960 INFO:tasks.workunit.client.0.smithi112.stdout:3/593: readlink d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d63/lb7 0 2024-09-19T09:35:23.960 INFO:tasks.workunit.client.0.smithi112.stdout:3/594: write d8/d15/d1b/f77 [105142,84289] 0 2024-09-19T09:35:23.963 INFO:tasks.workunit.client.0.smithi112.stdout:5/549: link d4/d9/d17/c64 d4/d29/cbc 0 2024-09-19T09:35:23.966 INFO:tasks.workunit.client.0.smithi112.stdout:5/550: creat d4/d9/d3e/d7f/fbd x:0 0 0 2024-09-19T09:35:23.966 INFO:tasks.workunit.client.0.smithi112.stdout:5/551: write d4/d9/d2a/d39/f3a [9249356,122230] 0 2024-09-19T09:35:23.966 INFO:tasks.workunit.client.0.smithi112.stdout:5/552: write d4/d84/f99 [670085,22590] 0 2024-09-19T09:35:23.966 INFO:tasks.workunit.client.0.smithi112.stdout:2/322: getdents d0/d3e/d50 0 2024-09-19T09:35:23.967 INFO:tasks.workunit.client.0.smithi112.stdout:5/553: truncate d4/d9/d2a/d46/f55 3657912 0 2024-09-19T09:35:23.968 INFO:tasks.workunit.client.0.smithi112.stdout:5/554: chown d4/d29/cbc 2 1 2024-09-19T09:35:23.968 INFO:tasks.workunit.client.0.smithi112.stdout:5/555: read d4/d9/d2a/f43 [1524273,128061] 0 2024-09-19T09:35:23.968 INFO:tasks.workunit.client.0.smithi112.stdout:2/323: creat d0/d3e/d50/d57/d5a/d27/f69 x:0 0 0 2024-09-19T09:35:23.970 INFO:tasks.workunit.client.0.smithi112.stdout:5/556: creat d4/d9/d2a/d39/d88/dba/fbe x:0 0 0 2024-09-19T09:35:23.970 INFO:tasks.workunit.client.0.smithi112.stdout:2/324: rmdir d0/d3e/d50/d57 39 2024-09-19T09:35:23.971 INFO:tasks.workunit.client.0.smithi112.stdout:5/557: mkdir d4/dbf 0 2024-09-19T09:35:23.972 INFO:tasks.workunit.client.0.smithi112.stdout:2/325: link d0/d1/f40 d0/d3e/d50/f6a 0 2024-09-19T09:35:23.980 INFO:tasks.workunit.client.0.smithi112.stdout:3/595: dwrite d8/d15/d1b/d1c/d43/f88 [0,4194304] 0 2024-09-19T09:35:23.980 INFO:tasks.workunit.client.0.smithi112.stdout:3/596: write d8/fb [2337056,42647] 0 2024-09-19T09:35:23.980 INFO:tasks.workunit.client.0.smithi112.stdout:3/597: getdents d8/d48 0 2024-09-19T09:35:23.985 INFO:tasks.workunit.client.0.smithi112.stdout:3/598: creat d8/d15/d1b/d1c/d27/d2b/fc3 x:0 0 0 2024-09-19T09:35:23.985 INFO:tasks.workunit.client.0.smithi112.stdout:3/599: creat d8/d15/d1b/fc4 x:0 0 0 2024-09-19T09:35:23.985 INFO:tasks.workunit.client.0.smithi112.stdout:2/326: rmdir d0/d3e/d50/d57/d5a/d27 39 2024-09-19T09:35:23.989 INFO:tasks.workunit.client.0.smithi112.stdout:5/558: dread d4/d9/d2a/d39/f3a [4194304,4194304] 0 2024-09-19T09:35:23.989 INFO:tasks.workunit.client.0.smithi112.stdout:5/559: write d4/d29/d36/da2/fb0 [475514,126894] 0 2024-09-19T09:35:23.989 INFO:tasks.workunit.client.0.smithi112.stdout:5/560: fdatasync d4/d3f/f6c 0 2024-09-19T09:35:23.991 INFO:tasks.workunit.client.0.smithi112.stdout:3/600: creat d8/d15/d1b/d1c/d68/d33/d8e/fc5 x:0 0 0 2024-09-19T09:35:23.992 INFO:tasks.workunit.client.0.smithi112.stdout:5/561: symlink d4/dbf/lc0 0 2024-09-19T09:35:23.994 INFO:tasks.workunit.client.0.smithi112.stdout:2/327: dread d0/d1/f7 [0,4194304] 0 2024-09-19T09:35:23.994 INFO:tasks.workunit.client.0.smithi112.stdout:2/328: write d0/d6/d24/f39 [4763214,94742] 0 2024-09-19T09:35:23.995 INFO:tasks.workunit.client.0.smithi112.stdout:3/601: rename d8/d15/d1b/d1c/d27/da1/ca5 to d8/d15/d1b/d1c/d68/d33/d59/d44/d49/d63/db0/cc6 0 2024-09-19T09:35:23.996 INFO:tasks.workunit.client.0.smithi112.stdout:5/562: mknod d4/d9/d17/d7c/cc1 0 2024-09-19T09:35:24.001 INFO:tasks.workunit.client.0.smithi112.stdout:2/329: link d0/d4a/l5c d0/d6/d44/l6b 0 2024-09-19T09:35:24.002 INFO:tasks.workunit.client.0.smithi112.stdout:2/330: creat d0/d3e/d61/f6c x:0 0 0 2024-09-19T09:35:24.002 INFO:tasks.workunit.client.0.smithi112.stdout:2/331: dread - d0/d3e/f66 zero size 2024-09-19T09:35:24.002 INFO:tasks.workunit.client.0.smithi112.stdout:3/602: rmdir d8/d15/d1b/d1c/d68/d33/d59/d44/d49 39 2024-09-19T09:35:24.003 INFO:tasks.workunit.client.0.smithi112.stdout:2/332: write d0/d3e/d61/f63 [298470,105114] 0 2024-09-19T09:35:24.006 INFO:tasks.workunit.client.0.smithi112.stdout:3/603: symlink d8/d15/d1b/d1c/lc7 0 2024-09-19T09:35:24.006 INFO:tasks.workunit.client.0.smithi112.stdout:3/604: stat d8/d15/d1b/d1c/d68/fb4 0 2024-09-19T09:35:24.008 INFO:tasks.workunit.client.0.smithi112.stdout:2/333: unlink d0/d6/c41 0 2024-09-19T09:35:24.011 INFO:tasks.workunit.client.0.smithi112.stdout:3/605: mkdir d8/d15/d1b/d1c/d68/d33/d8e/dc8 0 2024-09-19T09:35:24.011 INFO:tasks.workunit.client.0.smithi112.stdout:3/606: creat d8/d15/d1b/d1c/d68/fc9 x:0 0 0 2024-09-19T09:35:24.013 INFO:tasks.workunit.client.0.smithi112.stdout:3/607: mknod d8/d15/d1b/d1c/d68/d33/d8e/cca 0 2024-09-19T09:35:24.015 INFO:tasks.workunit.client.0.smithi112.stdout:3/608: mknod d8/d15/d1b/d1c/d68/d33/ccb 0 2024-09-19T09:35:24.017 INFO:tasks.workunit.client.0.smithi112.stdout:3/609: unlink d8/d15/d1b/d1c/d27/c81 0 2024-09-19T09:35:24.017 INFO:tasks.workunit.client.0.smithi112.stdout:3/610: write d8/d15/d1b/d1c/d68/fb4 [95843,120397] 0 2024-09-19T09:35:24.019 INFO:tasks.workunit.client.0.smithi112.stdout:3/611: rename d8/d15/d1b/d1c/d68/d33/d66/l6e to d8/d15/d1b/d1c/d68/d33/lcc 0 2024-09-19T09:35:24.019 INFO:tasks.workunit.client.0.smithi112.stdout:2/334: read d0/d6/d24/f46 [2155362,80271] 0 2024-09-19T09:35:24.020 INFO:tasks.workunit.client.0.smithi112.stdout:3/612: mknod d8/d15/d1b/d1c/d68/d33/d8e/dc8/ccd 0 2024-09-19T09:35:24.020 INFO:tasks.workunit.client.0.smithi112.stdout:3/613: read - d8/d15/d1b/fad zero size 2024-09-19T09:35:24.020 INFO:tasks.workunit.client.0.smithi112.stdout:5/563: read d4/d9/d2a/d46/f55 [2104400,122826] 0 2024-09-19T09:35:24.021 INFO:tasks.workunit.client.0.smithi112.stdout:3/614: creat d8/d15/d1b/d1c/d43/d9b/fce x:0 0 0 2024-09-19T09:35:24.024 INFO:tasks.workunit.client.0.smithi112.stdout:3/615: rename d8/d15/d1b/d1c/d68/d33/d59 to d8/d15/d1b/d1c/d27/d62/dcf 0 2024-09-19T09:35:24.026 INFO:tasks.workunit.client.0.smithi112.stdout:5/564: write d4/d9/d17/d2f/f8a [1937795,25844] 0 2024-09-19T09:35:24.026 INFO:tasks.workunit.client.0.smithi112.stdout:5/565: readlink d4/l9a 0 2024-09-19T09:35:24.026 INFO:tasks.workunit.client.0.smithi112.stdout:5/566: creat d4/d9/d3e/d7f/fc2 x:0 0 0 2024-09-19T09:35:24.029 INFO:tasks.workunit.client.0.smithi112.stdout:3/616: rmdir d8/d48/d67 39 2024-09-19T09:35:24.032 INFO:tasks.workunit.client.0.smithi112.stdout:5/567: symlink d4/d29/d36/d70/lc3 0 2024-09-19T09:35:24.039 INFO:tasks.workunit.client.0.smithi112.stdout:3/617: write d8/d15/d1b/d1c/d68/f5e [1542446,110337] 0 2024-09-19T09:35:24.044 INFO:tasks.workunit.client.0.smithi112.stdout:3/618: dread d8/d15/d1b/d1c/d43/d4f/f95 [0,4194304] 0 2024-09-19T09:35:24.044 INFO:tasks.workunit.client.0.smithi112.stdout:3/619: dread - d8/d15/d1b/d1c/d68/d33/d72/fb6 zero size 2024-09-19T09:35:24.044 INFO:tasks.workunit.client.0.smithi112.stdout:3/620: creat d8/d15/d1b/d1c/d68/d33/d72/fd0 x:0 0 0 2024-09-19T09:35:24.044 INFO:tasks.workunit.client.0.smithi112.stdout:3/621: chown d8/d15/d1b/d1c/d68/f5e 10497518 1 2024-09-19T09:35:24.044 INFO:tasks.workunit.client.0.smithi112.stdout:3/622: read - d8/d15/d1b/d1c/d27/d62/dcf/d44/f9f zero size 2024-09-19T09:35:24.044 INFO:tasks.workunit.client.0.smithi112.stdout:3/623: chown d8/d15/d1b/d1c/d27/d62/d99/fbb 1970699 1 2024-09-19T09:35:24.045 INFO:tasks.workunit.client.0.smithi112.stdout:2/335: dwrite d0/d1/f5b [0,4194304] 0 2024-09-19T09:35:24.045 INFO:tasks.workunit.client.0.smithi112.stdout:2/336: write d0/d3e/d50/f6a [16606,51591] 0 2024-09-19T09:35:24.046 INFO:tasks.workunit.client.0.smithi112.stdout:3/624: mknod d8/d48/cd1 0 2024-09-19T09:35:24.052 INFO:tasks.workunit.client.0.smithi112.stdout:5/568: dwrite d4/d9/d2a/d39/d88/dba/fbe [0,4194304] 0 2024-09-19T09:35:24.052 INFO:tasks.workunit.client.0.smithi112.stdout:5/569: getdents d4/d9/d17/dbb 0 2024-09-19T09:35:24.055 INFO:tasks.workunit.client.0.smithi112.stdout:5/570: stat d4/d9/l18 0 2024-09-19T09:35:24.056 INFO:tasks.workunit.client.0.smithi112.stdout:5/571: mknod d4/cc4 0 2024-09-19T09:35:24.065 INFO:tasks.workunit.client.0.smithi112.stdout:5/572: dread d4/d29/d36/da2/fb0 [0,4194304] 0 2024-09-19T09:35:24.066 INFO:tasks.workunit.client.0.smithi112.stdout:5/573: symlink d4/d9/d3e/d7f/lc5 0 2024-09-19T09:35:24.068 INFO:tasks.workunit.client.0.smithi112.stdout:3/625: dwrite d8/f7d [0,4194304] 0 2024-09-19T09:35:24.068 INFO:tasks.workunit.client.0.smithi112.stdout:5/574: rmdir d4/d9/d17/d2f 39 2024-09-19T09:35:24.069 INFO:tasks.workunit.client.0.smithi112.stdout:2/337: dwrite d0/d6/fa [0,4194304] 0 2024-09-19T09:35:24.071 INFO:tasks.workunit.client.0.smithi112.stdout:5/575: symlink d4/d9/d17/d2f/lc6 0 2024-09-19T09:35:24.071 INFO:tasks.workunit.client.0.smithi112.stdout:5/576: fsync d4/d9/d2a/d39/d88/fa1 0 2024-09-19T09:35:24.074 INFO:tasks.workunit.client.0.smithi112.stdout:5/577: creat d4/d9/d2a/d39/d88/fc7 x:0 0 0 2024-09-19T09:35:24.079 INFO:tasks.workunit.client.0.smithi112.stdout:5/578: mkdir d4/dbf/dc8 0 2024-09-19T09:35:24.080 INFO:tasks.workunit.client.0.smithi112.stdout:2/338: dread d0/d1/d28/f10 [0,4194304] 0 2024-09-19T09:35:24.085 INFO:tasks.workunit.client.0.smithi112.stdout:2/339: rename d0/d3e/d50/d57/l58 to d0/d3e/d50/l6d 0 2024-09-19T09:35:24.087 INFO:tasks.workunit.client.0.smithi112.stdout:2/340: mknod d0/d3e/d50/c6e 0 2024-09-19T09:35:24.087 INFO:tasks.workunit.client.0.smithi112.stdout:2/341: dread - d0/d4a/f5e zero size 2024-09-19T09:35:24.095 INFO:tasks.workunit.client.0.smithi112.stdout:2/342: getdents d0/d3e/d50 0 2024-09-19T09:35:24.118 INFO:tasks.workunit.client.0.smithi112.stdout:5/579: dwrite d4/d9/d2a/d46/f55 [0,4194304] 0 2024-09-19T09:35:24.119 INFO:tasks.workunit.client.0.smithi112.stdout:5/580: getdents d4/d29/d36/d5f 0 2024-09-19T09:35:24.121 INFO:tasks.workunit.client.0.smithi112.stdout:5/581: rename d4/dbf/dc8 to d4/d29/d36/dc9 0 2024-09-19T09:35:24.121 INFO:tasks.workunit.client.0.smithi112.stdout:5/582: write d4/d3f/da9/fb8 [4145452,101022] 0 2024-09-19T09:35:24.121 INFO:tasks.workunit.client.0.smithi112.stdout:5/583: truncate d4/d9/d3e/d7f/fbd 330840 0 2024-09-19T09:35:24.123 INFO:tasks.workunit.client.0.smithi112.stdout:5/584: truncate d4/d9/d17/d30/f92 3210861 0 2024-09-19T09:35:24.123 INFO:tasks.workunit.client.0.smithi112.stdout:5/585: readlink d4/d29/d36/l54 0 2024-09-19T09:35:24.124 INFO:tasks.workunit.client.0.smithi112.stdout:5/586: symlink d4/d9/d17/d2f/d7d/lca 0 2024-09-19T09:35:24.124 INFO:tasks.workunit.client.0.smithi112.stdout:5/587: creat d4/d84/fcb x:0 0 0 2024-09-19T09:35:24.126 INFO:tasks.workunit.client.0.smithi112.stdout:5/588: symlink d4/d9/d2a/d69/lcc 0 2024-09-19T09:35:24.127 INFO:tasks.workunit.client.0.smithi112.stdout:5/589: unlink d4/d9/d2a/d69/lcc 0 2024-09-19T09:35:24.127 INFO:tasks.workunit.client.0.smithi112.stdout:5/590: readlink d4/d29/l8d 0 2024-09-19T09:35:24.129 INFO:tasks.workunit.client.0.smithi112.stdout:5/591: rmdir d4/d9/d2a/d39/d88/dba 39 2024-09-19T09:35:24.137 INFO:tasks.workunit.client.0.smithi112.stdout:5/592: dread d4/d9/f1c [0,4194304] 0 2024-09-19T09:35:24.138 INFO:tasks.workunit.client.0.smithi112.stdout:5/593: creat d4/d9/d2a/d39/d88/fcd x:0 0 0 2024-09-19T09:35:24.140 INFO:tasks.workunit.client.0.smithi112.stdout:5/594: mkdir d4/d9/d17/da6/db2/dce 0 2024-09-19T09:35:24.159 INFO:tasks.workunit.client.0.smithi112.stdout:5/595: dwrite d4/d9/d3e/f77 [0,4194304] 0 2024-09-19T09:35:24.159 INFO:tasks.workunit.client.0.smithi112.stdout:5/596: write d4/d9/d3e/d7f/fc2 [1004550,45309] 0 2024-09-19T09:35:24.159 INFO:tasks.workunit.client.0.smithi112.stdout:5/597: truncate d4/d9/d3e/d7f/fbd 777924 0 2024-09-19T09:35:24.159 INFO:tasks.workunit.client.0.smithi112.stdout:5/598: fdatasync d4/d9/fa7 0 2024-09-19T09:35:24.169 INFO:tasks.workunit.client.0.smithi112.stdout:5/599: dread d4/d9/d17/d30/f89 [0,4194304] 0 2024-09-19T09:35:24.170 INFO:tasks.workunit.client.0.smithi112.stdout:5/600: dread d4/d29/d36/d56/f5e [0,4194304] 0 2024-09-19T09:35:24.184 INFO:tasks.workunit.client.0.smithi112.stdout:5/601: dwrite d4/d9/d17/d30/fab [4194304,4194304] 0 2024-09-19T09:35:24.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:23 smithi112 ceph-mon[27605]: pgmap v24: 65 pgs: 65 active+clean; 1.6 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 153 MiB/s rd, 176 MiB/s wr, 381 op/s 2024-09-19T09:35:24.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:23 smithi191 ceph-mon[34834]: pgmap v24: 65 pgs: 65 active+clean; 1.6 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 153 MiB/s rd, 176 MiB/s wr, 381 op/s 2024-09-19T09:35:24.481 INFO:tasks.workunit.client.0.smithi112.stdout:6/590: sync 2024-09-19T09:35:24.490 INFO:tasks.workunit.client.0.smithi112.stdout:6/591: read d8/f9 [1403456,103636] 0 2024-09-19T09:35:24.492 INFO:tasks.workunit.client.0.smithi112.stdout:6/592: dread d8/de/d17/dae/fba [0,4194304] 0 2024-09-19T09:35:24.628 INFO:tasks.workunit.client.0.smithi112.stdout:6/593: symlink d8/de/d61/d70/db5/lcc 0 2024-09-19T09:35:24.646 INFO:tasks.workunit.client.0.smithi112.stdout:6/594: dwrite d8/d11/d14/d2a/f32 [0,4194304] 0 2024-09-19T09:35:24.646 INFO:tasks.workunit.client.0.smithi112.stdout:6/595: write d8/d11/d14/f57 [5074562,104937] 0 2024-09-19T09:35:24.658 INFO:tasks.workunit.client.0.smithi112.stdout:6/596: dwrite d8/de/d66/d6e/fbd [4194304,4194304] 0 2024-09-19T09:35:24.672 INFO:tasks.workunit.client.0.smithi112.stdout:6/597: dwrite d8/de/d18/f58 [0,4194304] 0 2024-09-19T09:35:24.692 INFO:tasks.workunit.client.0.smithi112.stdout:6/598: dwrite d8/d11/d14/f57 [4194304,4194304] 0 2024-09-19T09:35:24.693 INFO:tasks.workunit.client.0.smithi112.stdout:6/599: unlink d8/d11/d14/d2a/f96 0 2024-09-19T09:35:24.693 INFO:tasks.workunit.client.0.smithi112.stdout:6/600: creat d8/de/fcd x:0 0 0 2024-09-19T09:35:24.693 INFO:tasks.workunit.client.0.smithi112.stdout:6/601: chown d8/de/d17/d49/c87 325 1 2024-09-19T09:35:24.695 INFO:tasks.workunit.client.0.smithi112.stdout:6/602: mkdir d8/de/d66/d8f/dce 0 2024-09-19T09:35:24.697 INFO:tasks.workunit.client.0.smithi112.stdout:6/603: link d8/de/d17/c21 d8/de/d61/d70/d7b/d8a/ccf 0 2024-09-19T09:35:24.697 INFO:tasks.workunit.client.0.smithi112.stdout:6/604: write d8/de/fa0 [959063,85019] 0 2024-09-19T09:35:24.698 INFO:tasks.workunit.client.0.smithi112.stdout:6/605: link d8/de/d66/d8f/fac d8/de/d66/fd0 0 2024-09-19T09:35:24.700 INFO:tasks.workunit.client.0.smithi112.stdout:6/606: symlink d8/de/d17/d49/ld1 0 2024-09-19T09:35:24.700 INFO:tasks.workunit.client.0.smithi112.stdout:6/607: fdatasync d8/d11/d14/f24 0 2024-09-19T09:35:24.701 INFO:tasks.workunit.client.0.smithi112.stdout:6/608: creat d8/de/d61/dbf/dc8/fd2 x:0 0 0 2024-09-19T09:35:24.716 INFO:tasks.workunit.client.0.smithi112.stdout:6/609: dwrite d8/de/d17/d49/f6a [0,4194304] 0 2024-09-19T09:35:24.718 INFO:tasks.workunit.client.0.smithi112.stdout:6/610: mkdir d8/d11/d14/d3c/d4b/d63/dd3 0 2024-09-19T09:35:24.735 INFO:tasks.workunit.client.0.smithi112.stdout:6/611: dwrite d8/de/d61/dbf/dc8/fd2 [0,4194304] 0 2024-09-19T09:35:24.748 INFO:tasks.workunit.client.0.smithi112.stdout:6/612: dwrite d8/d11/d14/d2a/f7d [0,4194304] 0 2024-09-19T09:35:24.758 INFO:tasks.workunit.client.0.smithi112.stdout:6/613: write f5 [7877105,81308] 0 2024-09-19T09:35:24.758 INFO:tasks.workunit.client.0.smithi112.stdout:6/614: chown d8/de/c8e 26849 1 2024-09-19T09:35:24.760 INFO:tasks.workunit.client.0.smithi112.stdout:4/787: sync 2024-09-19T09:35:24.761 INFO:tasks.workunit.client.0.smithi112.stdout:0/447: sync 2024-09-19T09:35:24.761 INFO:tasks.workunit.client.0.smithi112.stdout:7/577: sync 2024-09-19T09:35:24.761 INFO:tasks.workunit.client.0.smithi112.stdout:8/557: sync 2024-09-19T09:35:24.762 INFO:tasks.workunit.client.0.smithi112.stdout:3/626: sync 2024-09-19T09:35:24.762 INFO:tasks.workunit.client.0.smithi112.stdout:2/343: sync 2024-09-19T09:35:24.762 INFO:tasks.workunit.client.0.smithi112.stdout:9/314: sync 2024-09-19T09:35:24.762 INFO:tasks.workunit.client.0.smithi112.stdout:9/315: fsync df/d11/d14/d19/d66/f3d 0 2024-09-19T09:35:24.762 INFO:tasks.workunit.client.0.smithi112.stdout:1/310: sync 2024-09-19T09:35:24.762 INFO:tasks.workunit.client.0.smithi112.stdout:5/602: sync 2024-09-19T09:35:24.763 INFO:tasks.workunit.client.0.smithi112.stdout:7/578: link d2/lca d2/d2c/d54/d18/db4/lce 0 2024-09-19T09:35:24.764 INFO:tasks.workunit.client.0.smithi112.stdout:0/448: dread d2/d39/d58/f7b [0,4194304] 0 2024-09-19T09:35:24.765 INFO:tasks.workunit.client.0.smithi112.stdout:8/558: symlink d7/db/d21/d3b/d56/d3c/d79/d85/la7 0 2024-09-19T09:35:24.766 INFO:tasks.workunit.client.0.smithi112.stdout:8/559: chown d7/d10/d11/d50/l77 409139008 1 2024-09-19T09:35:24.766 INFO:tasks.workunit.client.0.smithi112.stdout:0/449: dread d2/d6e/d75/f76 [0,4194304] 0 2024-09-19T09:35:24.767 INFO:tasks.workunit.client.0.smithi112.stdout:2/344: unlink d0/c4e 0 2024-09-19T09:35:24.769 INFO:tasks.workunit.client.0.smithi112.stdout:9/316: creat df/d11/d14/d51/f6a x:0 0 0 2024-09-19T09:35:24.769 INFO:tasks.workunit.client.0.smithi112.stdout:9/317: chown df/d11/d14/f18 4844792 1 2024-09-19T09:35:24.770 INFO:tasks.workunit.client.0.smithi112.stdout:1/311: mknod dc/d59/c5b 0 2024-09-19T09:35:24.771 INFO:tasks.workunit.client.0.smithi112.stdout:1/312: dread dc/f1f [0,4194304] 0 2024-09-19T09:35:24.771 INFO:tasks.workunit.client.0.smithi112.stdout:1/313: chown dc/d13/f18 45342 1 2024-09-19T09:35:24.772 INFO:tasks.workunit.client.0.smithi112.stdout:5/603: rename d4/d9/d2a/f43 to d4/d9/d17/da6/db2/fcf 0 2024-09-19T09:35:24.773 INFO:tasks.workunit.client.0.smithi112.stdout:4/788: rmdir d1/d3d/d93 39 2024-09-19T09:35:24.775 INFO:tasks.workunit.client.0.smithi112.stdout:7/579: mkdir d2/d2c/d54/d18/d39/d23/d35/d4c/d70/dcf 0 2024-09-19T09:35:24.777 INFO:tasks.workunit.client.0.smithi112.stdout:8/560: link d7/d65/f83 d7/db/d21/d3b/d56/d48/fa8 0 2024-09-19T09:35:24.778 INFO:tasks.workunit.client.0.smithi112.stdout:9/318: mkdir df/d11/d14/d19/d40/d5c/d6b 0 2024-09-19T09:35:24.779 INFO:tasks.workunit.client.0.smithi112.stdout:9/319: fsync df/d11/d14/f62 0 2024-09-19T09:35:24.781 INFO:tasks.workunit.client.0.smithi112.stdout:1/314: rename dc/l28 to dc/d26/d34/l5c 0 2024-09-19T09:35:24.781 INFO:tasks.workunit.client.0.smithi112.stdout:1/315: fdatasync f8 0 2024-09-19T09:35:24.783 INFO:tasks.workunit.client.0.smithi112.stdout:9/320: mkdir df/d11/d14/d19/d40/d5c/d6b/d6c 0 2024-09-19T09:35:24.786 INFO:tasks.workunit.client.0.smithi112.stdout:9/321: mknod df/d11/d14/d19/d40/d5c/d6b/d6c/c6d 0 2024-09-19T09:35:24.786 INFO:tasks.workunit.client.0.smithi112.stdout:0/450: dwrite d2/d68/f74 [0,4194304] 0 2024-09-19T09:35:24.786 INFO:tasks.workunit.client.0.smithi112.stdout:0/451: chown d2/d11/f1e 80393 1 2024-09-19T09:35:24.789 INFO:tasks.workunit.client.0.smithi112.stdout:7/580: dread d2/d49/f58 [0,4194304] 0 2024-09-19T09:35:24.791 INFO:tasks.workunit.client.0.smithi112.stdout:7/581: symlink d2/d2c/d54/d18/d39/d21/d71/ld0 0 2024-09-19T09:35:24.791 INFO:tasks.workunit.client.0.smithi112.stdout:7/582: chown d2/d2c/d54/d18/d39/d21/d45/f5c 888 1 2024-09-19T09:35:24.791 INFO:tasks.workunit.client.0.smithi112.stdout:7/583: chown d2/d2c/d54/d1a/f72 87 1 2024-09-19T09:35:24.793 INFO:tasks.workunit.client.0.smithi112.stdout:7/584: getdents d2/d2c/d54/d18/d8a/d7c/db1 0 2024-09-19T09:35:24.801 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:35:24.801 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-19T09:35:24.802 INFO:tasks.workunit.client.0.smithi112.stdout:4/789: write d1/d3d/d72/fca [861276,46520] 0 2024-09-19T09:35:24.802 INFO:tasks.workunit.client.0.smithi112.stdout:4/790: getdents d1/d5f/da4/de7 0 2024-09-19T09:35:24.803 INFO:tasks.workunit.client.0.smithi112.stdout:0/452: dread d2/f10 [0,4194304] 0 2024-09-19T09:35:24.803 INFO:tasks.workunit.client.0.smithi112.stdout:4/791: link d1/d3d/d41/c2b d1/d3d/d72/de2/c10d 0 2024-09-19T09:35:24.803 INFO:tasks.workunit.client.0.smithi112.stdout:4/792: write d1/f6 [5190507,46978] 0 2024-09-19T09:35:24.807 INFO:tasks.workunit.client.0.smithi112.stdout:0/453: dread d2/d39/d3b/f4b [4194304,4194304] 0 2024-09-19T09:35:24.808 INFO:tasks.workunit.client.0.smithi112.stdout:0/454: creat d2/d6e/d6f/f8f x:0 0 0 2024-09-19T09:35:24.809 INFO:tasks.workunit.client.0.smithi112.stdout:0/455: creat d2/f90 x:0 0 0 2024-09-19T09:35:24.810 INFO:tasks.workunit.client.0.smithi112.stdout:0/456: symlink d2/d39/d3b/d8a/l91 0 2024-09-19T09:35:24.810 INFO:tasks.workunit.client.0.smithi112.stdout:0/457: write d2/f12 [3957487,54788] 0 2024-09-19T09:35:24.810 INFO:tasks.workunit.client.0.smithi112.stdout:0/458: write d2/d59/f85 [408100,71924] 0 2024-09-19T09:35:24.810 INFO:tasks.workunit.client.0.smithi112.stdout:0/459: readlink d2/d11/l35 0 2024-09-19T09:35:24.811 INFO:tasks.workunit.client.0.smithi112.stdout:0/460: mkdir d2/d68/d92 0 2024-09-19T09:35:24.811 INFO:tasks.workunit.client.0.smithi112.stdout:0/461: chown d2/d11/c23 106 1 2024-09-19T09:35:24.811 INFO:tasks.workunit.client.0.smithi112.stdout:0/462: write d2/d39/f46 [2611320,109587] 0 2024-09-19T09:35:24.811 INFO:tasks.workunit.client.0.smithi112.stdout:0/463: mknod d2/d6e/d75/c93 0 2024-09-19T09:35:24.819 INFO:tasks.workunit.client.0.smithi112.stdout:2/345: dwrite d0/d3e/d50/d57/d5a/d27/f30 [0,4194304] 0 2024-09-19T09:35:24.819 INFO:tasks.workunit.client.0.smithi112.stdout:4/793: dread d1/f53 [0,4194304] 0 2024-09-19T09:35:24.820 INFO:tasks.workunit.client.0.smithi112.stdout:2/346: readlink d0/l1b 0 2024-09-19T09:35:24.822 INFO:tasks.workunit.client.0.smithi112.stdout:4/794: mknod d1/d4/d3a/d57/c10e 0 2024-09-19T09:35:24.822 INFO:tasks.workunit.client.0.smithi112.stdout:4/795: chown d1/d4/d3a/f78 428167 1 2024-09-19T09:35:24.822 INFO:tasks.workunit.client.0.smithi112.stdout:4/796: getdents d1/d4/d3a/d57/d62/df8 0 2024-09-19T09:35:24.824 INFO:tasks.workunit.client.0.smithi112.stdout:4/797: creat d1/d5f/dc2/f10f x:0 0 0 2024-09-19T09:35:24.824 INFO:tasks.workunit.client.0.smithi112.stdout:4/798: chown d1/d4/d3a/d57/c10e 131476 1 2024-09-19T09:35:24.824 INFO:tasks.workunit.client.0.smithi112.stdout:4/799: fdatasync d1/f9b 0 2024-09-19T09:35:24.824 INFO:tasks.workunit.client.0.smithi112.stdout:9/322: dwrite df/d11/f5b [0,4194304] 0 2024-09-19T09:35:24.824 INFO:tasks.workunit.client.0.smithi112.stdout:5/604: dwrite d4/d29/d36/d5f/f8b [4194304,4194304] 0 2024-09-19T09:35:24.824 INFO:tasks.workunit.client.0.smithi112.stdout:7/585: dwrite d2/d2c/d54/d18/d39/d23/d35/fa7 [0,4194304] 0 2024-09-19T09:35:24.825 INFO:tasks.workunit.client.0.smithi112.stdout:8/561: dwrite d7/d10/d11/d33/f7a [0,4194304] 0 2024-09-19T09:35:24.825 INFO:tasks.workunit.client.0.smithi112.stdout:1/316: dwrite dc/d13/f42 [4194304,4194304] 0 2024-09-19T09:35:24.826 INFO:tasks.workunit.client.0.smithi112.stdout:9/323: symlink df/d11/d14/d19/d40/l6e 0 2024-09-19T09:35:24.829 INFO:tasks.workunit.client.0.smithi112.stdout:5/605: creat d4/d29/d36/dc9/fd0 x:0 0 0 2024-09-19T09:35:24.831 INFO:tasks.workunit.client.0.smithi112.stdout:7/586: link d2/d2c/d54/d18/d39/d23/d35/d76/c83 d2/d2c/d54/d18/d39/d21/d45/d4d/cd1 0 2024-09-19T09:35:24.835 INFO:tasks.workunit.client.0.smithi112.stdout:8/562: creat d7/db/d21/d2e/d42/d57/fa9 x:0 0 0 2024-09-19T09:35:24.838 INFO:tasks.workunit.client.0.smithi112.stdout:1/317: creat dc/d59/f5d x:0 0 0 2024-09-19T09:35:24.838 INFO:tasks.workunit.client.0.smithi112.stdout:1/318: chown dc/l2e 633704 1 2024-09-19T09:35:24.841 INFO:tasks.workunit.client.0.smithi112.stdout:7/587: rename d2/d2c/d54/f63 to d2/d2c/d54/d18/d8a/d7c/db1/dc8/fd2 0 2024-09-19T09:35:24.843 INFO:tasks.workunit.client.0.smithi112.stdout:1/319: truncate dc/d13/f18 1076297 0 2024-09-19T09:35:24.846 INFO:tasks.workunit.client.0.smithi112.stdout:2/347: dwrite d0/d6/fc [0,4194304] 0 2024-09-19T09:35:24.847 INFO:tasks.workunit.client.0.smithi112.stdout:7/588: unlink d2/lca 0 2024-09-19T09:35:24.847 INFO:tasks.workunit.client.0.smithi112.stdout:7/589: chown d2/d2c/d54/d18/d85/lab 35659 1 2024-09-19T09:35:24.847 INFO:tasks.workunit.client.0.smithi112.stdout:7/590: readlink d2/d2c/d54/d18/d39/d23/l4f 0 2024-09-19T09:35:24.848 INFO:tasks.workunit.client.0.smithi112.stdout:8/563: link d7/d10/d11/d55/l6f d7/db/d21/laa 0 2024-09-19T09:35:24.849 INFO:tasks.workunit.client.0.smithi112.stdout:1/320: symlink dc/d26/l5e 0 2024-09-19T09:35:24.850 INFO:tasks.workunit.client.0.smithi112.stdout:2/348: creat d0/d1/f6f x:0 0 0 2024-09-19T09:35:24.851 INFO:tasks.workunit.client.0.smithi112.stdout:8/564: rename d7/d10/d11/d33/c81 to d7/db/d21/d3b/d56/d3c/d79/d85/cab 0 2024-09-19T09:35:24.852 INFO:tasks.workunit.client.0.smithi112.stdout:2/349: dread d0/d1/f40 [0,4194304] 0 2024-09-19T09:35:24.853 INFO:tasks.workunit.client.0.smithi112.stdout:1/321: rename dc/f2a to dc/d26/f5f 0 2024-09-19T09:35:24.854 INFO:tasks.workunit.client.0.smithi112.stdout:2/350: dread d0/d3e/d61/f63 [0,4194304] 0 2024-09-19T09:35:24.854 INFO:tasks.workunit.client.0.smithi112.stdout:2/351: write d0/d3e/d50/d57/d5a/d27/f34 [915978,11783] 0 2024-09-19T09:35:24.855 INFO:tasks.workunit.client.0.smithi112.stdout:1/322: creat dc/d13/d58/f60 x:0 0 0 2024-09-19T09:35:24.855 INFO:tasks.workunit.client.0.smithi112.stdout:0/464: dwrite d2/d59/f85 [0,4194304] 0 2024-09-19T09:35:24.856 INFO:tasks.workunit.client.0.smithi112.stdout:2/352: creat d0/d1/d28/d67/f70 x:0 0 0 2024-09-19T09:35:24.856 INFO:tasks.workunit.client.0.smithi112.stdout:2/353: write d0/f2e [4916902,102457] 0 2024-09-19T09:35:24.857 INFO:tasks.workunit.client.0.smithi112.stdout:9/324: rmdir df/d11 39 2024-09-19T09:35:24.857 INFO:tasks.workunit.client.0.smithi112.stdout:5/606: dwrite d4/d9/d17/d30/f44 [4194304,4194304] 0 2024-09-19T09:35:24.860 INFO:tasks.workunit.client.0.smithi112.stdout:1/323: rename dc/c17 to dc/d13/c61 0 2024-09-19T09:35:24.864 INFO:tasks.workunit.client.0.smithi112.stdout:0/465: truncate d2/d39/d3b/f84 796326 0 2024-09-19T09:35:24.864 INFO:tasks.workunit.client.0.smithi112.stdout:0/466: write d2/f3c [5166052,51799] 0 2024-09-19T09:35:24.867 INFO:tasks.workunit.client.0.smithi112.stdout:9/325: creat df/d11/d14/d19/d40/d5c/d6b/f6f x:0 0 0 2024-09-19T09:35:24.869 INFO:tasks.workunit.client.0.smithi112.stdout:5/607: unlink d4/d3f/da9/fb3 0 2024-09-19T09:35:24.870 INFO:tasks.workunit.client.0.smithi112.stdout:0/467: getdents d2/d68 0 2024-09-19T09:35:24.870 INFO:tasks.workunit.client.0.smithi112.stdout:0/468: write d2/d39/d3b/d44/f80 [473952,129230] 0 2024-09-19T09:35:24.871 INFO:tasks.workunit.client.0.smithi112.stdout:9/326: mknod df/d11/d14/d19/d40/d5c/d6b/c70 0 2024-09-19T09:35:24.872 INFO:tasks.workunit.client.0.smithi112.stdout:9/327: chown df/d11/d14/d19/d66/d5d 54894 1 2024-09-19T09:35:24.873 INFO:tasks.workunit.client.0.smithi112.stdout:5/608: rename d4/d3f/f6c to d4/d29/d36/d70/fd1 0 2024-09-19T09:35:24.873 INFO:tasks.workunit.client.0.smithi112.stdout:9/328: mknod df/c71 0 2024-09-19T09:35:24.874 INFO:tasks.workunit.client.0.smithi112.stdout:9/329: fsync fc 0 2024-09-19T09:35:24.874 INFO:tasks.workunit.client.0.smithi112.stdout:5/609: truncate d4/d9/d17/da6/db2/fcf 46297 0 2024-09-19T09:35:24.875 INFO:tasks.workunit.client.0.smithi112.stdout:9/330: rmdir df/d11/d14/d19/d1e/d63 0 2024-09-19T09:35:24.875 INFO:tasks.workunit.client.0.smithi112.stdout:9/331: dread - df/d11/d14/d19/d40/d5c/d6b/f6f zero size 2024-09-19T09:35:24.876 INFO:tasks.workunit.client.0.smithi112.stdout:5/610: creat d4/d9/d2a/d46/fd2 x:0 0 0 2024-09-19T09:35:24.876 INFO:tasks.workunit.client.0.smithi112.stdout:5/611: truncate d4/d9/d3e/f77 5036221 0 2024-09-19T09:35:24.876 INFO:tasks.workunit.client.0.smithi112.stdout:5/612: read d4/d29/f2d [628840,10082] 0 2024-09-19T09:35:24.876 INFO:tasks.workunit.client.0.smithi112.stdout:5/613: creat d4/d9/d3e/fd3 x:0 0 0 2024-09-19T09:35:24.877 INFO:tasks.workunit.client.0.smithi112.stdout:5/614: stat d4/d29/c71 0 2024-09-19T09:35:24.877 INFO:tasks.workunit.client.0.smithi112.stdout:5/615: creat d4/d9/d2a/d46/fd4 x:0 0 0 2024-09-19T09:35:24.879 INFO:tasks.workunit.client.0.smithi112.stdout:5/616: creat d4/d29/d36/d70/fd5 x:0 0 0 2024-09-19T09:35:24.879 INFO:tasks.workunit.client.0.smithi112.stdout:5/617: write d4/d3f/da9/fb8 [4135136,54392] 0 2024-09-19T09:35:24.879 INFO:tasks.workunit.client.0.smithi112.stdout:5/618: write d4/d29/d36/d5f/f6a [910446,25456] 0 2024-09-19T09:35:24.881 INFO:tasks.workunit.client.0.smithi112.stdout:0/469: dread d2/f28 [0,4194304] 0 2024-09-19T09:35:24.881 INFO:tasks.workunit.client.0.smithi112.stdout:0/470: chown d2/d59/f85 78308 1 2024-09-19T09:35:24.883 INFO:tasks.workunit.client.0.smithi112.stdout:0/471: link d2/d11/c15 d2/d59/c94 0 2024-09-19T09:35:24.883 INFO:tasks.workunit.client.0.smithi112.stdout:4/800: dwrite d1/d3d/d72/fca [0,4194304] 0 2024-09-19T09:35:24.884 INFO:tasks.workunit.client.0.smithi112.stdout:8/565: dwrite d7/db/d21/d3b/d56/d4b/f71 [0,4194304] 0 2024-09-19T09:35:24.884 INFO:tasks.workunit.client.0.smithi112.stdout:8/566: fsync d7/db/d21/d3b/d56/d3c/f3d 0 2024-09-19T09:35:24.884 INFO:tasks.workunit.client.0.smithi112.stdout:8/567: creat d7/d10/d11/d50/fac x:0 0 0 2024-09-19T09:35:24.884 INFO:tasks.workunit.client.0.smithi112.stdout:1/324: dwrite dc/d26/f3d [0,4194304] 0 2024-09-19T09:35:24.885 INFO:tasks.workunit.client.0.smithi112.stdout:5/619: rename d4/d9/d3e/d7f to d4/d9/d17/dd6 0 2024-09-19T09:35:24.888 INFO:tasks.workunit.client.0.smithi112.stdout:4/801: link d1/d31/d43/ff5 d1/d3d/d72/dd6/f110 0 2024-09-19T09:35:24.892 INFO:tasks.workunit.client.0.smithi112.stdout:9/332: dread df/d11/d14/f62 [4194304,4194304] 0 2024-09-19T09:35:24.893 INFO:tasks.workunit.client.0.smithi112.stdout:8/568: symlink d7/d10/d11/lad 0 2024-09-19T09:35:24.894 INFO:tasks.workunit.client.0.smithi112.stdout:2/354: rmdir d0/d1/d28/d67 39 2024-09-19T09:35:24.901 INFO:tasks.workunit.client.0.smithi112.stdout:1/325: mknod dc/d26/c62 0 2024-09-19T09:35:24.901 INFO:tasks.workunit.client.0.smithi112.stdout:1/326: fsync dc/ff 0 2024-09-19T09:35:24.901 INFO:tasks.workunit.client.0.smithi112.stdout:1/327: stat dc/d26/d44/l57 0 2024-09-19T09:35:24.901 INFO:tasks.workunit.client.0.smithi112.stdout:9/333: write df/d11/d14/d19/d66/f3d [2365897,119049] 0 2024-09-19T09:35:24.906 INFO:tasks.workunit.client.0.smithi112.stdout:8/569: unlink d7/db/l1f 0 2024-09-19T09:35:24.909 INFO:tasks.workunit.client.0.smithi112.stdout:2/355: link d0/d3e/d50/d57/d5a/d27/f30 d0/d3e/d50/f71 0 2024-09-19T09:35:24.910 INFO:tasks.workunit.client.0.smithi112.stdout:1/328: mkdir dc/d26/d44/d63 0 2024-09-19T09:35:24.912 INFO:tasks.workunit.client.0.smithi112.stdout:9/334: rename df/d11/d14/d19/d66/c49 to df/d11/d14/d19/d66/c72 0 2024-09-19T09:35:24.914 INFO:tasks.workunit.client.0.smithi112.stdout:2/356: rename d0/d6/d44 to d0/d3e/d50/d57/d5a/d4f/d72 0 2024-09-19T09:35:24.916 INFO:tasks.workunit.client.0.smithi112.stdout:1/329: mkdir dc/d26/d34/d4c/d64 0 2024-09-19T09:35:24.917 INFO:tasks.workunit.client.0.smithi112.stdout:9/335: creat df/d11/d14/d19/d1e/f73 x:0 0 0 2024-09-19T09:35:24.917 INFO:tasks.workunit.client.0.smithi112.stdout:0/472: dwrite d2/d6e/d75/f8e [0,4194304] 0 2024-09-19T09:35:24.920 INFO:tasks.workunit.client.0.smithi112.stdout:2/357: creat d0/d3e/d50/d57/d5a/d27/f73 x:0 0 0 2024-09-19T09:35:24.921 INFO:tasks.workunit.client.0.smithi112.stdout:8/570: dread d7/db/d21/d3b/d56/d4b/f5f [0,4194304] 0 2024-09-19T09:35:24.922 INFO:tasks.workunit.client.0.smithi112.stdout:4/802: dwrite d1/d31/d96/fe5 [0,4194304] 0 2024-09-19T09:35:24.922 INFO:tasks.workunit.client.0.smithi112.stdout:5/620: dwrite d4/d9/d2a/d39/d88/dba/fbe [0,4194304] 0 2024-09-19T09:35:24.922 INFO:tasks.workunit.client.0.smithi112.stdout:8/571: chown d7/db/f45 57 1 2024-09-19T09:35:24.922 INFO:tasks.workunit.client.0.smithi112.stdout:5/621: fsync d4/d29/d36/d70/fd5 0 2024-09-19T09:35:24.922 INFO:tasks.workunit.client.0.smithi112.stdout:8/572: creat d7/db/d21/d3b/d56/d3c/fae x:0 0 0 2024-09-19T09:35:24.923 INFO:tasks.workunit.client.0.smithi112.stdout:1/330: link dc/d13/c49 dc/d26/c65 0 2024-09-19T09:35:24.923 INFO:tasks.workunit.client.0.smithi112.stdout:1/331: stat dc/f53 0 2024-09-19T09:35:24.923 INFO:tasks.workunit.client.0.smithi112.stdout:5/622: write d4/d29/d36/d56/f5e [380633,15665] 0 2024-09-19T09:35:24.923 INFO:tasks.workunit.client.0.smithi112.stdout:1/332: write dc/d26/f29 [1001525,115325] 0 2024-09-19T09:35:24.924 INFO:tasks.workunit.client.0.smithi112.stdout:9/336: rmdir df/d11/d14/d19/d40/d5c 39 2024-09-19T09:35:24.928 INFO:tasks.workunit.client.0.smithi112.stdout:0/473: mkdir d2/d39/d3b/d44/d95 0 2024-09-19T09:35:24.930 INFO:tasks.workunit.client.0.smithi112.stdout:2/358: truncate d0/d3e/d50/d57/d5a/d4b/f53 1693356 0 2024-09-19T09:35:24.930 INFO:tasks.workunit.client.0.smithi112.stdout:2/359: write d0/d3e/d50/d57/d5a/d27/f69 [403907,53289] 0 2024-09-19T09:35:24.930 INFO:tasks.workunit.client.0.smithi112.stdout:2/360: chown d0/d1/d28/f43 127287 1 2024-09-19T09:35:24.930 INFO:tasks.workunit.client.0.smithi112.stdout:2/361: dread - d0/d3e/d50/f64 zero size 2024-09-19T09:35:24.931 INFO:tasks.workunit.client.0.smithi112.stdout:5/623: read d4/d9/d2a/d39/f3a [5426271,73728] 0 2024-09-19T09:35:24.936 INFO:tasks.workunit.client.0.smithi112.stdout:2/362: write d0/d1/fd [1082647,112125] 0 2024-09-19T09:35:24.937 INFO:tasks.workunit.client.0.smithi112.stdout:4/803: symlink d1/d4/d3a/d7a/d7f/da8/l111 0 2024-09-19T09:35:24.937 INFO:tasks.workunit.client.0.smithi112.stdout:9/337: write df/d11/d14/d19/f33 [1169072,127515] 0 2024-09-19T09:35:24.940 INFO:tasks.workunit.client.0.smithi112.stdout:1/333: creat dc/d26/d34/d4c/f66 x:0 0 0 2024-09-19T09:35:24.940 INFO:tasks.workunit.client.0.smithi112.stdout:1/334: stat dc/d59/f5d 0 2024-09-19T09:35:24.942 INFO:tasks.workunit.client.0.smithi112.stdout:0/474: rename d2/d39/d3b/d8a/l91 to d2/d39/d58/l96 0 2024-09-19T09:35:24.943 INFO:tasks.workunit.client.0.smithi112.stdout:5/624: symlink d4/d9/ld7 0 2024-09-19T09:35:24.943 INFO:tasks.workunit.client.0.smithi112.stdout:5/625: fdatasync d4/d9/f25 0 2024-09-19T09:35:24.945 INFO:tasks.workunit.client.0.smithi112.stdout:2/363: symlink d0/d6/l74 0 2024-09-19T09:35:24.946 INFO:tasks.workunit.client.0.smithi112.stdout:9/338: getdents df/d11 0 2024-09-19T09:35:24.948 INFO:tasks.workunit.client.0.smithi112.stdout:8/573: getdents d7/db 0 2024-09-19T09:35:24.949 INFO:tasks.workunit.client.0.smithi112.stdout:1/335: symlink dc/d24/d45/l67 0 2024-09-19T09:35:24.951 INFO:tasks.workunit.client.0.smithi112.stdout:0/475: unlink d2/f5e 0 2024-09-19T09:35:24.953 INFO:tasks.workunit.client.0.smithi112.stdout:9/339: link df/d11/d14/f2d df/d11/f74 0 2024-09-19T09:35:24.954 INFO:tasks.workunit.client.0.smithi112.stdout:1/336: truncate dc/f53 3142627 0 2024-09-19T09:35:24.955 INFO:tasks.workunit.client.0.smithi112.stdout:1/337: readlink dc/d26/d34/l31 0 2024-09-19T09:35:24.955 INFO:tasks.workunit.client.0.smithi112.stdout:1/338: chown dc/d13/f25 8423 1 2024-09-19T09:35:24.955 INFO:tasks.workunit.client.0.smithi112.stdout:0/476: mknod d2/d68/d92/c97 0 2024-09-19T09:35:24.955 INFO:tasks.workunit.client.0.smithi112.stdout:0/477: dread - d2/d39/d3b/f3f zero size 2024-09-19T09:35:24.956 INFO:tasks.workunit.client.0.smithi112.stdout:9/340: dread - df/d11/d14/f4c zero size 2024-09-19T09:35:24.957 INFO:tasks.workunit.client.0.smithi112.stdout:9/341: symlink df/d11/d14/d19/d40/d5c/d6b/d6c/l75 0 2024-09-19T09:35:24.959 INFO:tasks.workunit.client.0.smithi112.stdout:9/342: mknod df/d11/d14/d19/d40/d5c/d6b/c76 0 2024-09-19T09:35:24.961 INFO:tasks.workunit.client.0.smithi112.stdout:9/343: write df/d11/f3c [416388,37008] 0 2024-09-19T09:35:24.962 INFO:tasks.workunit.client.0.smithi112.stdout:4/804: dwrite d1/d31/d43/d48/d5c/f8f [0,4194304] 0 2024-09-19T09:35:24.962 INFO:tasks.workunit.client.0.smithi112.stdout:8/574: dread d7/db/d21/d3b/d56/d4b/f71 [0,4194304] 0 2024-09-19T09:35:24.962 INFO:tasks.workunit.client.0.smithi112.stdout:5/626: dwrite d4/d9/d2a/d69/f58 [0,4194304] 0 2024-09-19T09:35:24.963 INFO:tasks.workunit.client.0.smithi112.stdout:2/364: write d0/d3e/d50/d57/d5a/d4b/f65 [2038037,130952] 0 2024-09-19T09:35:24.964 INFO:tasks.workunit.client.0.smithi112.stdout:9/344: symlink df/d11/d14/d19/d1e/l77 0 2024-09-19T09:35:24.964 INFO:tasks.workunit.client.0.smithi112.stdout:9/345: chown df/l2b 25689 1 2024-09-19T09:35:24.965 INFO:tasks.workunit.client.0.smithi112.stdout:4/805: creat d1/d3d/d93/f112 x:0 0 0 2024-09-19T09:35:24.968 INFO:tasks.workunit.client.0.smithi112.stdout:1/339: write f2 [1967027,119073] 0 2024-09-19T09:35:24.968 INFO:tasks.workunit.client.0.smithi112.stdout:8/575: symlink d7/d10/d11/d62/laf 0 2024-09-19T09:35:24.968 INFO:tasks.workunit.client.0.smithi112.stdout:8/576: truncate d7/d10/d11/d50/f99 1041382 0 2024-09-19T09:35:24.970 INFO:tasks.workunit.client.0.smithi112.stdout:0/478: dread d2/d11/f47 [0,4194304] 0 2024-09-19T09:35:24.972 INFO:tasks.workunit.client.0.smithi112.stdout:0/479: dread d2/d39/d3b/f84 [0,4194304] 0 2024-09-19T09:35:24.972 INFO:tasks.workunit.client.0.smithi112.stdout:5/627: mknod d4/d9/d17/db4/cd8 0 2024-09-19T09:35:24.979 INFO:tasks.workunit.client.0.smithi112.stdout:1/340: unlink dc/d26/c65 0 2024-09-19T09:35:24.981 INFO:tasks.workunit.client.0.smithi112.stdout:8/577: unlink d7/d10/d11/d55/f98 0 2024-09-19T09:35:24.981 INFO:tasks.workunit.client.0.smithi112.stdout:8/578: chown d7/d10/d11/c8d 204 1 2024-09-19T09:35:24.982 INFO:tasks.workunit.client.0.smithi112.stdout:0/480: creat d2/d39/d3b/d44/d95/f98 x:0 0 0 2024-09-19T09:35:24.985 INFO:tasks.workunit.client.0.smithi112.stdout:5/628: link d4/l26 d4/d9/d17/da6/ld9 0 2024-09-19T09:35:24.985 INFO:tasks.workunit.client.0.smithi112.stdout:5/629: creat d4/d9/d3e/fda x:0 0 0 2024-09-19T09:35:24.988 INFO:tasks.workunit.client.0.smithi112.stdout:1/341: mkdir dc/d26/d34/d36/d68 0 2024-09-19T09:35:24.989 INFO:tasks.workunit.client.0.smithi112.stdout:8/579: rmdir d7/db/d21/d2e/d8c 39 2024-09-19T09:35:24.990 INFO:tasks.workunit.client.0.smithi112.stdout:4/806: dwrite d1/d4/d3a/d57/d62/d88/fd5 [0,4194304] 0 2024-09-19T09:35:24.991 INFO:tasks.workunit.client.0.smithi112.stdout:0/481: creat d2/d11/f99 x:0 0 0 2024-09-19T09:35:24.991 INFO:tasks.workunit.client.0.smithi112.stdout:5/630: mkdir d4/d3f/da9/ddb 0 2024-09-19T09:35:24.992 INFO:tasks.workunit.client.0.smithi112.stdout:9/346: write df/d11/f5b [863258,8661] 0 2024-09-19T09:35:24.995 INFO:tasks.workunit.client.0.smithi112.stdout:8/580: rename d7/db/d21/d2e/d42/c5a to d7/db/d21/d2e/d42/d57/cb0 0 2024-09-19T09:35:25.005 INFO:tasks.workunit.client.0.smithi112.stdout:2/365: truncate d0/f2e 233136 0 2024-09-19T09:35:25.012 INFO:tasks.workunit.client.0.smithi112.stdout:1/342: dwrite dc/fd [0,4194304] 0 2024-09-19T09:35:25.012 INFO:tasks.workunit.client.0.smithi112.stdout:4/807: dwrite d1/d4/d3a/d57/d62/f79 [0,4194304] 0 2024-09-19T09:35:25.012 INFO:tasks.workunit.client.0.smithi112.stdout:5/631: dread d4/d9/d17/d2f/d72/f42 [0,4194304] 0 2024-09-19T09:35:25.012 INFO:tasks.workunit.client.0.smithi112.stdout:5/632: read d4/d29/d36/d70/fd1 [400390,102079] 0 2024-09-19T09:35:25.017 INFO:tasks.workunit.client.0.smithi112.stdout:2/366: dread d0/d3e/d50/d57/d5a/d4f/f52 [0,4194304] 0 2024-09-19T09:35:25.022 INFO:tasks.workunit.client.0.smithi112.stdout:9/347: rename df/d11/d14/d19/d66/d5d/c68 to df/d35/c78 0 2024-09-19T09:35:25.023 INFO:tasks.workunit.client.0.smithi112.stdout:8/581: symlink d7/db/d21/d2e/d42/lb1 0 2024-09-19T09:35:25.026 INFO:tasks.workunit.client.0.smithi112.stdout:0/482: rmdir d2/d11 39 2024-09-19T09:35:25.029 INFO:tasks.workunit.client.0.smithi112.stdout:2/367: dread d0/d1/f5b [0,4194304] 0 2024-09-19T09:35:25.029 INFO:tasks.workunit.client.0.smithi112.stdout:1/343: dwrite dc/d13/f1c [0,4194304] 0 2024-09-19T09:35:25.029 INFO:tasks.workunit.client.0.smithi112.stdout:1/344: chown dc/d13/d58 448 1 2024-09-19T09:35:25.029 INFO:tasks.workunit.client.0.smithi112.stdout:1/345: fdatasync dc/d13/f1c 0 2024-09-19T09:35:25.029 INFO:tasks.workunit.client.0.smithi112.stdout:1/346: fsync dc/d24/f52 0 2024-09-19T09:35:25.031 INFO:tasks.workunit.client.0.smithi112.stdout:4/808: symlink d1/d3d/d41/l113 0 2024-09-19T09:35:25.031 INFO:tasks.workunit.client.0.smithi112.stdout:4/809: dread - d1/d3d/d93/ff6 zero size 2024-09-19T09:35:25.033 INFO:tasks.workunit.client.0.smithi112.stdout:9/348: mknod df/d11/d14/d19/d1e/c79 0 2024-09-19T09:35:25.035 INFO:tasks.workunit.client.0.smithi112.stdout:8/582: stat d7/db/d21/l59 0 2024-09-19T09:35:25.037 INFO:tasks.workunit.client.0.smithi112.stdout:0/483: creat d2/d11/f9a x:0 0 0 2024-09-19T09:35:25.039 INFO:tasks.workunit.client.0.smithi112.stdout:5/633: mknod d4/d9/d17/d30/cdc 0 2024-09-19T09:35:25.041 INFO:tasks.workunit.client.0.smithi112.stdout:1/347: rmdir dc/d13 39 2024-09-19T09:35:25.043 INFO:tasks.workunit.client.0.smithi112.stdout:9/349: write fc [4794067,72920] 0 2024-09-19T09:35:25.043 INFO:tasks.workunit.client.0.smithi112.stdout:9/350: read - df/d11/d14/d19/f42 zero size 2024-09-19T09:35:25.043 INFO:tasks.workunit.client.0.smithi112.stdout:1/348: dread dc/d13/f1b [0,4194304] 0 2024-09-19T09:35:25.045 INFO:tasks.workunit.client.0.smithi112.stdout:9/351: unlink df/d11/d14/d51/f6a 0 2024-09-19T09:35:25.047 INFO:tasks.workunit.client.0.smithi112.stdout:1/349: creat dc/f69 x:0 0 0 2024-09-19T09:35:25.047 INFO:tasks.workunit.client.0.smithi112.stdout:0/484: dread d2/d11/f32 [0,4194304] 0 2024-09-19T09:35:25.048 INFO:tasks.workunit.client.0.smithi112.stdout:1/350: dread dc/d26/d34/f3f [0,4194304] 0 2024-09-19T09:35:25.049 INFO:tasks.workunit.client.0.smithi112.stdout:0/485: rename d2/d11/f77 to d2/d39/f9b 0 2024-09-19T09:35:25.050 INFO:tasks.workunit.client.0.smithi112.stdout:0/486: write d2/d39/f7d [938959,122165] 0 2024-09-19T09:35:25.050 INFO:tasks.workunit.client.0.smithi112.stdout:0/487: dread d2/d11/f40 [0,4194304] 0 2024-09-19T09:35:25.051 INFO:tasks.workunit.client.0.smithi112.stdout:0/488: chown d2/d11/f99 16621920 1 2024-09-19T09:35:25.051 INFO:tasks.workunit.client.0.smithi112.stdout:1/351: mkdir dc/d13/d58/d6a 0 2024-09-19T09:35:25.051 INFO:tasks.workunit.client.0.smithi112.stdout:1/352: fdatasync f1 0 2024-09-19T09:35:25.052 INFO:tasks.workunit.client.0.smithi112.stdout:0/489: unlink d2/d59/f65 0 2024-09-19T09:35:25.060 INFO:tasks.workunit.client.0.smithi112.stdout:2/368: dwrite d0/d1/f5b [0,4194304] 0 2024-09-19T09:35:25.060 INFO:tasks.workunit.client.0.smithi112.stdout:9/352: dread df/d11/f74 [0,4194304] 0 2024-09-19T09:35:25.062 INFO:tasks.workunit.client.0.smithi112.stdout:9/353: creat df/d11/d14/d19/d28/f7a x:0 0 0 2024-09-19T09:35:25.062 INFO:tasks.workunit.client.0.smithi112.stdout:9/354: creat df/d11/d14/d19/d1e/f7b x:0 0 0 2024-09-19T09:35:25.064 INFO:tasks.workunit.client.0.smithi112.stdout:0/490: write d2/f3c [3623747,70101] 0 2024-09-19T09:35:25.064 INFO:tasks.workunit.client.0.smithi112.stdout:0/491: stat d2/f49 0 2024-09-19T09:35:25.064 INFO:tasks.workunit.client.0.smithi112.stdout:0/492: fdatasync d2/fb 0 2024-09-19T09:35:25.065 INFO:tasks.workunit.client.0.smithi112.stdout:9/355: creat df/d11/d14/d19/d66/d5d/f7c x:0 0 0 2024-09-19T09:35:25.071 INFO:tasks.workunit.client.0.smithi112.stdout:1/353: dwrite dc/f69 [0,4194304] 0 2024-09-19T09:35:25.081 INFO:tasks.workunit.client.0.smithi112.stdout:2/369: dread d0/d6/d24/f46 [0,4194304] 0 2024-09-19T09:35:25.083 INFO:tasks.workunit.client.0.smithi112.stdout:1/354: write dc/f23 [2096923,31460] 0 2024-09-19T09:35:25.083 INFO:tasks.workunit.client.0.smithi112.stdout:2/370: unlink d0/d3e/l4d 0 2024-09-19T09:35:25.084 INFO:tasks.workunit.client.0.smithi112.stdout:1/355: mknod dc/d24/d45/c6b 0 2024-09-19T09:35:25.084 INFO:tasks.workunit.client.0.smithi112.stdout:1/356: write dc/d13/f1b [696038,4865] 0 2024-09-19T09:35:25.085 INFO:tasks.workunit.client.0.smithi112.stdout:1/357: chown dc/d26/d44/l47 65 1 2024-09-19T09:35:25.086 INFO:tasks.workunit.client.0.smithi112.stdout:1/358: mknod dc/d26/d34/d4c/d64/c6c 0 2024-09-19T09:35:25.087 INFO:tasks.workunit.client.0.smithi112.stdout:1/359: read dc/d13/f18 [828270,120031] 0 2024-09-19T09:35:25.087 INFO:tasks.workunit.client.0.smithi112.stdout:1/360: truncate dc/d26/d34/d4c/f66 956049 0 2024-09-19T09:35:25.087 INFO:tasks.workunit.client.0.smithi112.stdout:1/361: fdatasync dc/fe 0 2024-09-19T09:35:25.087 INFO:tasks.workunit.client.0.smithi112.stdout:1/362: dread - dc/d26/d34/d4c/d55/f56 zero size 2024-09-19T09:35:25.087 INFO:tasks.workunit.client.0.smithi112.stdout:1/363: write dc/d13/f25 [674134,5480] 0 2024-09-19T09:35:25.087 INFO:tasks.workunit.client.0.smithi112.stdout:1/364: write dc/d13/f25 [1672655,73568] 0 2024-09-19T09:35:25.087 INFO:tasks.workunit.client.0.smithi112.stdout:1/365: chown dc/d24/c1e 67833178 1 2024-09-19T09:35:25.092 INFO:tasks.workunit.client.0.smithi112.stdout:0/493: dwrite d2/d11/f9a [0,4194304] 0 2024-09-19T09:35:25.093 INFO:tasks.workunit.client.0.smithi112.stdout:9/356: dwrite df/d35/f38 [0,4194304] 0 2024-09-19T09:35:25.093 INFO:tasks.workunit.client.0.smithi112.stdout:9/357: fsync df/d11/d14/d19/d66/f27 0 2024-09-19T09:35:25.094 INFO:tasks.workunit.client.0.smithi112.stdout:0/494: creat d2/d59/d7a/f9c x:0 0 0 2024-09-19T09:35:25.095 INFO:tasks.workunit.client.0.smithi112.stdout:9/358: unlink df/d11/d14/d19/d28/f7a 0 2024-09-19T09:35:25.095 INFO:tasks.workunit.client.0.smithi112.stdout:9/359: chown df/d11/d14/d19/d40/d5c 25 1 2024-09-19T09:35:25.095 INFO:tasks.workunit.client.0.smithi112.stdout:9/360: mknod df/d11/d14/d19/d40/d5c/c7d 0 2024-09-19T09:35:25.099 INFO:tasks.workunit.client.0.smithi112.stdout:2/371: dread d0/d3e/d50/d57/d5a/d27/f30 [0,4194304] 0 2024-09-19T09:35:25.105 INFO:tasks.workunit.client.0.smithi112.stdout:1/366: dwrite dc/d26/d34/d4c/f66 [0,4194304] 0 2024-09-19T09:35:25.105 INFO:tasks.workunit.client.0.smithi112.stdout:0/495: dread d2/f12 [0,4194304] 0 2024-09-19T09:35:25.105 INFO:tasks.workunit.client.0.smithi112.stdout:0/496: write d2/f30 [677054,94122] 0 2024-09-19T09:35:25.105 INFO:tasks.workunit.client.0.smithi112.stdout:0/497: write d2/f22 [1649278,72860] 0 2024-09-19T09:35:25.105 INFO:tasks.workunit.client.0.smithi112.stdout:0/498: chown d2/d6e/d75/f76 63098 1 2024-09-19T09:35:25.117 INFO:tasks.workunit.client.0.smithi112.stdout:2/372: dwrite d0/d3e/d50/f71 [0,4194304] 0 2024-09-19T09:35:25.125 INFO:tasks.workunit.client.0.smithi112.stdout:2/373: read d0/d1/f3d [2438620,17024] 0 2024-09-19T09:35:25.160 INFO:tasks.workunit.client.0.smithi112.stdout:9/361: creat df/d11/d14/d51/f7e x:0 0 0 2024-09-19T09:35:25.160 INFO:tasks.workunit.client.0.smithi112.stdout:9/362: dread - df/d11/d14/d19/d1e/f7b zero size 2024-09-19T09:35:25.162 INFO:tasks.workunit.client.0.smithi112.stdout:1/367: creat dc/d26/d34/f6d x:0 0 0 2024-09-19T09:35:25.164 INFO:tasks.workunit.client.0.smithi112.stdout:0/499: symlink d2/d6e/d6f/l9d 0 2024-09-19T09:35:25.166 INFO:tasks.workunit.client.0.smithi112.stdout:2/374: link d0/d3e/d49/c59 d0/d3e/d61/c75 0 2024-09-19T09:35:25.178 INFO:tasks.workunit.client.0.smithi112.stdout:9/363: symlink df/d11/d14/d19/d40/l7f 0 2024-09-19T09:35:25.178 INFO:tasks.workunit.client.0.smithi112.stdout:1/368: truncate dc/f69 4012077 0 2024-09-19T09:35:25.179 INFO:tasks.workunit.client.0.smithi112.stdout:0/500: truncate d2/d39/d3b/f4b 430062 0 2024-09-19T09:35:25.181 INFO:tasks.workunit.client.0.smithi112.stdout:9/364: creat df/d11/d14/d19/d40/d5c/d6b/d6c/f80 x:0 0 0 2024-09-19T09:35:25.183 INFO:tasks.workunit.client.0.smithi112.stdout:0/501: symlink d2/d59/l9e 0 2024-09-19T09:35:25.184 INFO:tasks.workunit.client.0.smithi112.stdout:2/375: dwrite d0/d3e/d50/f71 [0,4194304] 0 2024-09-19T09:35:25.184 INFO:tasks.workunit.client.0.smithi112.stdout:2/376: fsync d0/d3e/d50/f71 0 2024-09-19T09:35:25.184 INFO:tasks.workunit.client.0.smithi112.stdout:0/502: rename d2/d11/f2e to d2/d39/d3b/d8a/f9f 0 2024-09-19T09:35:25.184 INFO:tasks.workunit.client.0.smithi112.stdout:0/503: truncate d2/f57 99741 0 2024-09-19T09:35:25.185 INFO:tasks.workunit.client.0.smithi112.stdout:0/504: readlink d2/d68/l82 0 2024-09-19T09:35:25.185 INFO:tasks.workunit.client.0.smithi112.stdout:0/505: chown d2/d59/d7a/l89 24895888 1 2024-09-19T09:35:25.185 INFO:tasks.workunit.client.0.smithi112.stdout:2/377: symlink d0/d6/d24/l76 0 2024-09-19T09:35:25.186 INFO:tasks.workunit.client.0.smithi112.stdout:0/506: rename d2/d39/d58 to d2/d6e/da0 0 2024-09-19T09:35:25.187 INFO:tasks.workunit.client.0.smithi112.stdout:0/507: chown d2/d68/d92/c97 0 1 2024-09-19T09:35:25.188 INFO:tasks.workunit.client.0.smithi112.stdout:2/378: creat d0/d1/d28/d67/f77 x:0 0 0 2024-09-19T09:35:25.190 INFO:tasks.workunit.client.0.smithi112.stdout:2/379: mkdir d0/d1/d5f/d78 0 2024-09-19T09:35:25.190 INFO:tasks.workunit.client.0.smithi112.stdout:2/380: fdatasync d0/d3e/d50/d57/d5a/d4b/f65 0 2024-09-19T09:35:25.190 INFO:tasks.workunit.client.0.smithi112.stdout:2/381: readlink d0/d1/d28/l18 0 2024-09-19T09:35:25.190 INFO:tasks.workunit.client.0.smithi112.stdout:2/382: write d0/d1/d28/f10 [2695432,27410] 0 2024-09-19T09:35:25.191 INFO:tasks.workunit.client.0.smithi112.stdout:2/383: creat d0/d3e/d50/d57/f79 x:0 0 0 2024-09-19T09:35:25.193 INFO:tasks.workunit.client.0.smithi112.stdout:9/365: dread f3 [0,4194304] 0 2024-09-19T09:35:25.194 INFO:tasks.workunit.client.0.smithi112.stdout:9/366: symlink df/d11/d14/d19/d1e/l81 0 2024-09-19T09:35:25.195 INFO:tasks.workunit.client.0.smithi112.stdout:9/367: symlink df/d11/d14/d19/d28/l82 0 2024-09-19T09:35:25.200 INFO:tasks.workunit.client.0.smithi112.stdout:1/369: dwrite dc/d26/d34/f6d [0,4194304] 0 2024-09-19T09:35:25.200 INFO:tasks.workunit.client.0.smithi112.stdout:1/370: write dc/d26/f29 [1668096,89519] 0 2024-09-19T09:35:25.205 INFO:tasks.workunit.client.0.smithi112.stdout:1/371: symlink dc/d59/l6e 0 2024-09-19T09:35:25.205 INFO:tasks.workunit.client.0.smithi112.stdout:1/372: readlink dc/d13/l2f 0 2024-09-19T09:35:25.206 INFO:tasks.workunit.client.0.smithi112.stdout:1/373: mkdir dc/d26/d34/d6f 0 2024-09-19T09:35:25.206 INFO:tasks.workunit.client.0.smithi112.stdout:1/374: fdatasync dc/d26/d34/f6d 0 2024-09-19T09:35:25.208 INFO:tasks.workunit.client.0.smithi112.stdout:2/384: fsync d0/d1/d28/d67/f77 0 2024-09-19T09:35:25.208 INFO:tasks.workunit.client.0.smithi112.stdout:2/385: fsync d0/d1/fd 0 2024-09-19T09:35:25.208 INFO:tasks.workunit.client.0.smithi112.stdout:0/508: dwrite d2/f3c [4194304,4194304] 0 2024-09-19T09:35:25.208 INFO:tasks.workunit.client.0.smithi112.stdout:0/509: write d2/d59/f5c [63877,123583] 0 2024-09-19T09:35:25.208 INFO:tasks.workunit.client.0.smithi112.stdout:0/510: fsync d2/d11/f1c 0 2024-09-19T09:35:25.209 INFO:tasks.workunit.client.0.smithi112.stdout:1/375: rename dc/d26/f3c to dc/d26/f70 0 2024-09-19T09:35:25.210 INFO:tasks.workunit.client.0.smithi112.stdout:1/376: chown dc/f69 0 1 2024-09-19T09:35:25.210 INFO:tasks.workunit.client.0.smithi112.stdout:1/377: rename dc/d26/d44 to dc/d26/d44/d71 22 2024-09-19T09:35:25.212 INFO:tasks.workunit.client.0.smithi112.stdout:2/386: symlink d0/d3e/d50/d57/d5a/l7a 0 2024-09-19T09:35:25.212 INFO:tasks.workunit.client.0.smithi112.stdout:0/511: dread d2/d39/d3b/f4b [0,4194304] 0 2024-09-19T09:35:25.212 INFO:tasks.workunit.client.0.smithi112.stdout:9/368: getdents df/d11/d14/d19/d1e 0 2024-09-19T09:35:25.213 INFO:tasks.workunit.client.0.smithi112.stdout:1/378: creat dc/d26/d34/d36/d68/f72 x:0 0 0 2024-09-19T09:35:25.223 INFO:tasks.workunit.client.0.smithi112.stdout:2/387: link d0/d6/fc d0/d1/d5f/d78/f7b 0 2024-09-19T09:35:25.223 INFO:tasks.workunit.client.0.smithi112.stdout:2/388: fdatasync d0/d1/f1f 0 2024-09-19T09:35:25.225 INFO:tasks.workunit.client.0.smithi112.stdout:0/512: dread d2/d11/f9a [0,4194304] 0 2024-09-19T09:35:25.226 INFO:tasks.workunit.client.0.smithi112.stdout:9/369: symlink df/d11/d14/d19/d1e/l83 0 2024-09-19T09:35:25.226 INFO:tasks.workunit.client.0.smithi112.stdout:9/370: truncate df/d11/d14/d19/d40/d5c/d6b/d6c/f80 267875 0 2024-09-19T09:35:25.227 INFO:tasks.workunit.client.0.smithi112.stdout:1/379: mkdir dc/d59/d73 0 2024-09-19T09:35:25.230 INFO:tasks.workunit.client.0.smithi112.stdout:0/513: mkdir d2/d59/da1 0 2024-09-19T09:35:25.232 INFO:tasks.workunit.client.0.smithi112.stdout:0/514: dread d2/f28 [0,4194304] 0 2024-09-19T09:35:25.232 INFO:tasks.workunit.client.0.smithi112.stdout:9/371: mknod df/d11/d14/d19/d28/c84 0 2024-09-19T09:35:25.236 INFO:tasks.workunit.client.0.smithi112.stdout:1/380: dread dc/d13/f42 [0,4194304] 0 2024-09-19T09:35:25.236 INFO:tasks.workunit.client.0.smithi112.stdout:1/381: readlink dc/d26/d44/l48 0 2024-09-19T09:35:25.254 INFO:tasks.workunit.client.0.smithi112.stdout:2/389: rmdir d0 39 2024-09-19T09:35:25.254 INFO:tasks.workunit.client.0.smithi112.stdout:2/390: write d0/d6/d24/f46 [2696318,54300] 0 2024-09-19T09:35:25.254 INFO:tasks.workunit.client.0.smithi112.stdout:2/391: chown d0/d6/c19 2 1 2024-09-19T09:35:25.254 INFO:tasks.workunit.client.0.smithi112.stdout:0/515: symlink d2/d6e/d6f/la2 0 2024-09-19T09:35:25.255 INFO:tasks.workunit.client.0.smithi112.stdout:1/382: dwrite dc/fd [0,4194304] 0 2024-09-19T09:35:25.256 INFO:tasks.workunit.client.0.smithi112.stdout:2/392: stat d0/d1/d28/l32 0 2024-09-19T09:35:25.256 INFO:tasks.workunit.client.0.smithi112.stdout:2/393: chown d0/d1/fd 2740 1 2024-09-19T09:35:25.256 INFO:tasks.workunit.client.0.smithi112.stdout:9/372: dwrite df/d11/d14/d51/f54 [0,4194304] 0 2024-09-19T09:35:25.256 INFO:tasks.workunit.client.0.smithi112.stdout:9/373: dread - df/d11/d14/d51/f7e zero size 2024-09-19T09:35:25.257 INFO:tasks.workunit.client.0.smithi112.stdout:2/394: rename d0/d3e/d49/c59 to d0/d3e/d50/c7c 0 2024-09-19T09:35:25.259 INFO:tasks.workunit.client.0.smithi112.stdout:2/395: rmdir d0/d3e/d50/d57/d5a/d4b 39 2024-09-19T09:35:25.261 INFO:tasks.workunit.client.0.smithi112.stdout:2/396: creat d0/d4a/f7d x:0 0 0 2024-09-19T09:35:25.262 INFO:tasks.workunit.client.0.smithi112.stdout:2/397: symlink d0/d4a/l7e 0 2024-09-19T09:35:25.262 INFO:tasks.workunit.client.0.smithi112.stdout:2/398: readlink d0/d4a/l55 0 2024-09-19T09:35:25.263 INFO:tasks.workunit.client.0.smithi112.stdout:2/399: chown d0/d3e/d50/d57 247 1 2024-09-19T09:35:25.263 INFO:tasks.workunit.client.0.smithi112.stdout:2/400: mkdir d0/d3e/d7f 0 2024-09-19T09:35:25.264 INFO:tasks.workunit.client.0.smithi112.stdout:2/401: readlink d0/d1/d28/l32 0 2024-09-19T09:35:25.265 INFO:tasks.workunit.client.0.smithi112.stdout:2/402: mkdir d0/d3e/d50/d57/d80 0 2024-09-19T09:35:25.266 INFO:tasks.workunit.client.0.smithi112.stdout:0/516: dread d2/fe [0,4194304] 0 2024-09-19T09:35:25.267 INFO:tasks.workunit.client.0.smithi112.stdout:2/403: rmdir d0/d3e/d7f 0 2024-09-19T09:35:25.267 INFO:tasks.workunit.client.0.smithi112.stdout:1/383: write dc/d13/f1c [3171737,14768] 0 2024-09-19T09:35:25.268 INFO:tasks.workunit.client.0.smithi112.stdout:1/384: getdents dc/d26/d44/d63 0 2024-09-19T09:35:25.268 INFO:tasks.workunit.client.0.smithi112.stdout:1/385: readlink dc/d26/d34/l5c 0 2024-09-19T09:35:25.268 INFO:tasks.workunit.client.0.smithi112.stdout:1/386: readlink dc/d26/d34/d36/l43 0 2024-09-19T09:35:25.272 INFO:tasks.workunit.client.0.smithi112.stdout:2/404: rename d0/f2e to d0/d1/d28/d67/f81 0 2024-09-19T09:35:25.272 INFO:tasks.workunit.client.0.smithi112.stdout:2/405: fsync d0/d1/fd 0 2024-09-19T09:35:25.272 INFO:tasks.workunit.client.0.smithi112.stdout:9/374: dwrite df/f61 [0,4194304] 0 2024-09-19T09:35:25.272 INFO:tasks.workunit.client.0.smithi112.stdout:9/375: chown df/d11/d14/f18 122515559 1 2024-09-19T09:35:25.282 INFO:tasks.workunit.client.0.smithi112.stdout:6/615: sync 2024-09-19T09:35:25.282 INFO:tasks.workunit.client.0.smithi112.stdout:3/627: sync 2024-09-19T09:35:25.282 INFO:tasks.workunit.client.0.smithi112.stdout:7/591: sync 2024-09-19T09:35:25.285 INFO:tasks.workunit.client.0.smithi112.stdout:6/616: creat d8/de/d66/d8f/dce/fd4 x:0 0 0 2024-09-19T09:35:25.285 INFO:tasks.workunit.client.0.smithi112.stdout:6/617: write d8/de/d66/d8f/dce/fd4 [530461,3376] 0 2024-09-19T09:35:25.286 INFO:tasks.workunit.client.0.smithi112.stdout:2/406: dread d0/d1/f7 [0,4194304] 0 2024-09-19T09:35:25.288 INFO:tasks.workunit.client.0.smithi112.stdout:3/628: creat d8/d15/d1b/d1c/d68/d33/d6f/fd2 x:0 0 0 2024-09-19T09:35:25.289 INFO:tasks.workunit.client.0.smithi112.stdout:4/810: sync 2024-09-19T09:35:25.289 INFO:tasks.workunit.client.0.smithi112.stdout:4/811: creat d1/d4/d3a/d57/f114 x:0 0 0 2024-09-19T09:35:25.289 INFO:tasks.workunit.client.0.smithi112.stdout:4/812: fsync d1/f6 0 2024-09-19T09:35:25.289 INFO:tasks.workunit.client.0.smithi112.stdout:8/583: sync 2024-09-19T09:35:25.289 INFO:tasks.workunit.client.0.smithi112.stdout:5/634: sync 2024-09-19T09:35:25.289 INFO:tasks.workunit.client.0.smithi112.stdout:5/635: write d4/d9/d17/d2f/f8a [421144,5240] 0 2024-09-19T09:35:25.289 INFO:tasks.workunit.client.0.smithi112.stdout:5/636: write d4/d9/d2a/f49 [4223063,62939] 0 2024-09-19T09:35:25.290 INFO:tasks.workunit.client.0.smithi112.stdout:2/407: symlink d0/d1/d5f/l82 0 2024-09-19T09:35:25.290 INFO:tasks.workunit.client.0.smithi112.stdout:2/408: write d0/d1/d28/f43 [984304,122578] 0 2024-09-19T09:35:25.292 INFO:tasks.workunit.client.0.smithi112.stdout:3/629: symlink d8/d15/d1b/d1c/d68/d8d/ld3 0 2024-09-19T09:35:25.293 INFO:tasks.workunit.client.0.smithi112.stdout:3/630: read d8/d15/d1b/d1c/d68/d33/d66/f97 [4774470,1226] 0 2024-09-19T09:35:25.295 INFO:tasks.workunit.client.0.smithi112.stdout:4/813: unlink d1/d4/d3a/d57/d62/d88/l9f 0 2024-09-19T09:35:25.296 INFO:tasks.workunit.client.0.smithi112.stdout:8/584: link d7/db/d21/d2e/f7e d7/db/d21/d3b/d56/d3c/d79/fb2 0 2024-09-19T09:35:25.299 INFO:tasks.workunit.client.0.smithi112.stdout:5/637: creat d4/d3f/fdd x:0 0 0 2024-09-19T09:35:25.301 INFO:tasks.workunit.client.0.smithi112.stdout:0/517: dwrite d2/f21 [4194304,4194304] 0 2024-09-19T09:35:25.301 INFO:tasks.workunit.client.0.smithi112.stdout:0/518: chown d2/d6e/da0/c78 86 1 2024-09-19T09:35:25.301 INFO:tasks.workunit.client.0.smithi112.stdout:0/519: truncate d2/f30 1058429 0 2024-09-19T09:35:25.302 INFO:tasks.workunit.client.0.smithi112.stdout:2/409: getdents d0/d3e/d49 0 2024-09-19T09:35:25.302 INFO:tasks.workunit.client.0.smithi112.stdout:2/410: chown d0/d1/f5b 47567962 1 2024-09-19T09:35:25.302 INFO:tasks.workunit.client.0.smithi112.stdout:2/411: chown d0/d3e/d50/d57/d80 6297138 1 2024-09-19T09:35:25.302 INFO:tasks.workunit.client.0.smithi112.stdout:1/387: dwrite dc/d26/d34/d36/d68/f72 [0,4194304] 0 2024-09-19T09:35:25.303 INFO:tasks.workunit.client.0.smithi112.stdout:1/388: chown dc/d59/c5b 490 1 2024-09-19T09:35:25.303 INFO:tasks.workunit.client.0.smithi112.stdout:1/389: fdatasync dc/d24/f40 0 2024-09-19T09:35:25.303 INFO:tasks.workunit.client.0.smithi112.stdout:3/631: mkdir d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/dd4 0 2024-09-19T09:35:25.305 INFO:tasks.workunit.client.0.smithi112.stdout:5/638: mkdir d4/d9/d2a/d46/dde 0 2024-09-19T09:35:25.305 INFO:tasks.workunit.client.0.smithi112.stdout:5/639: read d4/d9/d17/d2f/f8a [2788475,73627] 0 2024-09-19T09:35:25.305 INFO:tasks.workunit.client.0.smithi112.stdout:5/640: chown d4/d84/c74 297 1 2024-09-19T09:35:25.305 INFO:tasks.workunit.client.0.smithi112.stdout:5/641: fdatasync d4/d9/d17/d30/fab 0 2024-09-19T09:35:25.309 INFO:tasks.workunit.client.0.smithi112.stdout:0/520: mknod d2/d68/d92/ca3 0 2024-09-19T09:35:25.309 INFO:tasks.workunit.client.0.smithi112.stdout:0/521: chown d2/d39/d3b/d44 1952798181 1 2024-09-19T09:35:25.309 INFO:tasks.workunit.client.0.smithi112.stdout:0/522: stat d2/f30 0 2024-09-19T09:35:25.309 INFO:tasks.workunit.client.0.smithi112.stdout:2/412: symlink d0/l83 0 2024-09-19T09:35:25.309 INFO:tasks.workunit.client.0.smithi112.stdout:2/413: fsync d0/d1/fd 0 2024-09-19T09:35:25.309 INFO:tasks.workunit.client.0.smithi112.stdout:2/414: write d0/d3e/d50/d57/d5a/f47 [178411,83301] 0 2024-09-19T09:35:25.309 INFO:tasks.workunit.client.0.smithi112.stdout:2/415: chown d0/d1/d28/d67 926353714 1 2024-09-19T09:35:25.310 INFO:tasks.workunit.client.0.smithi112.stdout:4/814: dread d1/d31/d71/d77/fcb [0,4194304] 0 2024-09-19T09:35:25.310 INFO:tasks.workunit.client.0.smithi112.stdout:4/815: truncate d1/d4/d3a/f6a 854975 0 2024-09-19T09:35:25.311 INFO:tasks.workunit.client.0.smithi112.stdout:1/390: symlink dc/d26/d34/d4c/d55/l74 0 2024-09-19T09:35:25.312 INFO:tasks.workunit.client.0.smithi112.stdout:3/632: truncate d8/d48/d67/f80 4041673 0 2024-09-19T09:35:25.315 INFO:tasks.workunit.client.0.smithi112.stdout:9/376: dwrite df/d35/f38 [0,4194304] 0 2024-09-19T09:35:25.316 INFO:tasks.workunit.client.0.smithi112.stdout:7/592: dwrite d2/d2c/d54/f2f [0,4194304] 0 2024-09-19T09:35:25.316 INFO:tasks.workunit.client.0.smithi112.stdout:6/618: dwrite d8/de/d61/fc6 [0,4194304] 0 2024-09-19T09:35:25.316 INFO:tasks.workunit.client.0.smithi112.stdout:7/593: fsync d2/d2c/d54/d18/d8a/f94 0 2024-09-19T09:35:25.316 INFO:tasks.workunit.client.0.smithi112.stdout:7/594: chown d2/d2c/d54/d18/d39/d21/d45/l50 144660 1 2024-09-19T09:35:25.316 INFO:tasks.workunit.client.0.smithi112.stdout:7/595: stat d2/d2c/d54/d18/d39/d21/d45/d4d/l61 0 2024-09-19T09:35:25.318 INFO:tasks.workunit.client.0.smithi112.stdout:5/642: getdents d4/d9/d2a/d39/d88/dba 0 2024-09-19T09:35:25.318 INFO:tasks.workunit.client.0.smithi112.stdout:5/643: write d4/d9/d17/d2f/d72/f9b [460747,94818] 0 2024-09-19T09:35:25.318 INFO:tasks.workunit.client.0.smithi112.stdout:5/644: truncate d4/d9/d3e/fda 738366 0 2024-09-19T09:35:25.320 INFO:tasks.workunit.client.0.smithi112.stdout:2/416: truncate d0/d1/f5b 3703447 0 2024-09-19T09:35:25.322 INFO:tasks.workunit.client.0.smithi112.stdout:3/633: dread f6 [0,4194304] 0 2024-09-19T09:35:25.324 INFO:tasks.workunit.client.0.smithi112.stdout:4/816: rename d1/d3d/d72/fca to d1/d31/d51/d89/d8b/f115 0 2024-09-19T09:35:25.325 INFO:tasks.workunit.client.0.smithi112.stdout:9/377: creat df/d11/f85 x:0 0 0 2024-09-19T09:35:25.328 INFO:tasks.workunit.client.0.smithi112.stdout:6/619: mkdir d8/d11/d14/d3c/dd5 0 2024-09-19T09:35:25.329 INFO:tasks.workunit.client.0.smithi112.stdout:6/620: chown d8/cc 1 1 2024-09-19T09:35:25.329 INFO:tasks.workunit.client.0.smithi112.stdout:6/621: creat d8/d11/d13/fd6 x:0 0 0 2024-09-19T09:35:25.329 INFO:tasks.workunit.client.0.smithi112.stdout:9/378: dread df/d11/d14/f2e [0,4194304] 0 2024-09-19T09:35:25.329 INFO:tasks.workunit.client.0.smithi112.stdout:9/379: truncate df/d11/d14/d19/d28/f57 272593 0 2024-09-19T09:35:25.330 INFO:tasks.workunit.client.0.smithi112.stdout:5/645: getdents d4 0 2024-09-19T09:35:25.331 INFO:tasks.workunit.client.0.smithi112.stdout:2/417: mknod d0/d6/c84 0 2024-09-19T09:35:25.331 INFO:tasks.workunit.client.0.smithi112.stdout:2/418: fsync d0/d3e/d50/f71 0 2024-09-19T09:35:25.332 INFO:tasks.workunit.client.0.smithi112.stdout:4/817: unlink d1/d4/d3a/d7a/f103 0 2024-09-19T09:35:25.335 INFO:tasks.workunit.client.0.smithi112.stdout:2/419: truncate d0/d3e/d50/d57/d5a/d4b/f53 936159 0 2024-09-19T09:35:25.336 INFO:tasks.workunit.client.0.smithi112.stdout:4/818: rmdir d1/d31/d51/d89 39 2024-09-19T09:35:25.337 INFO:tasks.workunit.client.0.smithi112.stdout:0/523: dwrite d2/d59/d7a/f9c [0,4194304] 0 2024-09-19T09:35:25.337 INFO:tasks.workunit.client.0.smithi112.stdout:0/524: stat d2/d39/d3b/d44/f69 0 2024-09-19T09:35:25.337 INFO:tasks.workunit.client.0.smithi112.stdout:0/525: creat d2/d59/fa4 x:0 0 0 2024-09-19T09:35:25.337 INFO:tasks.workunit.client.0.smithi112.stdout:5/646: getdents d4/d9/d2a/d39/d88 0 2024-09-19T09:35:25.338 INFO:tasks.workunit.client.0.smithi112.stdout:2/420: symlink d0/d3e/d50/d57/d5a/d4f/l85 0 2024-09-19T09:35:25.338 INFO:tasks.workunit.client.0.smithi112.stdout:2/421: write d0/d1/d28/f10 [1763989,97449] 0 2024-09-19T09:35:25.339 INFO:tasks.workunit.client.0.smithi112.stdout:3/634: write d8/d15/d1b/d1c/d68/d33/f6b [2820057,101703] 0 2024-09-19T09:35:25.339 INFO:tasks.workunit.client.0.smithi112.stdout:3/635: chown d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/f65 44362453 1 2024-09-19T09:35:25.339 INFO:tasks.workunit.client.0.smithi112.stdout:1/391: dwrite dc/d13/f25 [0,4194304] 0 2024-09-19T09:35:25.342 INFO:tasks.workunit.client.0.smithi112.stdout:6/622: read d8/d11/d13/f56 [3901512,38010] 0 2024-09-19T09:35:25.342 INFO:tasks.workunit.client.0.smithi112.stdout:6/623: write d8/f23 [4542933,65263] 0 2024-09-19T09:35:25.346 INFO:tasks.workunit.client.0.smithi112.stdout:0/526: mknod d2/d39/d3b/ca5 0 2024-09-19T09:35:25.348 INFO:tasks.workunit.client.0.smithi112.stdout:2/422: link d0/d3e/d50/d57/d5a/d4f/d72/l6b d0/d3e/d50/d57/d80/l86 0 2024-09-19T09:35:25.351 INFO:tasks.workunit.client.0.smithi112.stdout:5/647: dread d4/d9/d2a/d39/d88/dba/fbe [0,4194304] 0 2024-09-19T09:35:25.358 INFO:tasks.workunit.client.0.smithi112.stdout:1/392: symlink dc/d26/d34/d6f/l75 0 2024-09-19T09:35:25.360 INFO:tasks.workunit.client.0.smithi112.stdout:6/624: link d8/d11/l3b d8/de/d17/d49/ld7 0 2024-09-19T09:35:25.365 INFO:tasks.workunit.client.0.smithi112.stdout:5/648: mkdir d4/d29/ddf 0 2024-09-19T09:35:25.366 INFO:tasks.workunit.client.0.smithi112.stdout:5/649: fdatasync d4/d9/d3e/fd3 0 2024-09-19T09:35:25.367 INFO:tasks.workunit.client.0.smithi112.stdout:0/527: write d2/d39/f9b [6755674,63997] 0 2024-09-19T09:35:25.367 INFO:tasks.workunit.client.0.smithi112.stdout:1/393: mknod dc/d26/d34/d36/c76 0 2024-09-19T09:35:25.367 INFO:tasks.workunit.client.0.smithi112.stdout:1/394: stat dc/f69 0 2024-09-19T09:35:25.368 INFO:tasks.workunit.client.0.smithi112.stdout:6/625: creat d8/d11/d14/d3c/d4b/d63/fd8 x:0 0 0 2024-09-19T09:35:25.368 INFO:tasks.workunit.client.0.smithi112.stdout:6/626: chown d8/d11/d14/d2a/lb3 3890469 1 2024-09-19T09:35:25.369 INFO:tasks.workunit.client.0.smithi112.stdout:5/650: creat d4/d3f/da9/fe0 x:0 0 0 2024-09-19T09:35:25.371 INFO:tasks.workunit.client.0.smithi112.stdout:3/636: rmdir d8/d15/d1b/d1c/d68/d33/d83/d9e 0 2024-09-19T09:35:25.375 INFO:tasks.workunit.client.0.smithi112.stdout:0/528: rename d2/d39/d3b/f4b to d2/d68/d92/fa6 0 2024-09-19T09:35:25.377 INFO:tasks.workunit.client.0.smithi112.stdout:6/627: creat d8/de/d18/d20/d83/fd9 x:0 0 0 2024-09-19T09:35:25.379 INFO:tasks.workunit.client.0.smithi112.stdout:4/819: dwrite d1/f17 [0,4194304] 0 2024-09-19T09:35:25.379 INFO:tasks.workunit.client.0.smithi112.stdout:3/637: mknod d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/cd5 0 2024-09-19T09:35:25.381 INFO:tasks.workunit.client.0.smithi112.stdout:9/380: dwrite df/d11/d14/d19/d1e/f69 [0,4194304] 0 2024-09-19T09:35:25.381 INFO:tasks.workunit.client.0.smithi112.stdout:0/529: dread d2/f38 [0,4194304] 0 2024-09-19T09:35:25.381 INFO:tasks.workunit.client.0.smithi112.stdout:6/628: mkdir d8/d11/d14/d3c/d4b/d63/dd3/dda 0 2024-09-19T09:35:25.381 INFO:tasks.workunit.client.0.smithi112.stdout:6/629: write d8/de/d66/f93 [751008,34108] 0 2024-09-19T09:35:25.382 INFO:tasks.workunit.client.0.smithi112.stdout:6/630: readlink d8/d11/d14/d3c/d4b/d63/l65 0 2024-09-19T09:35:25.383 INFO:tasks.workunit.client.0.smithi112.stdout:4/820: symlink d1/d4/d3a/d7a/l116 0 2024-09-19T09:35:25.383 INFO:tasks.workunit.client.0.smithi112.stdout:4/821: write d1/d5f/dc2/f10f [992501,7321] 0 2024-09-19T09:35:25.386 INFO:tasks.workunit.client.0.smithi112.stdout:3/638: link d8/d15/d1b/d1c/d68/d33/d72/fb6 d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d63/fd6 0 2024-09-19T09:35:25.386 INFO:tasks.workunit.client.0.smithi112.stdout:3/639: read - d8/d15/d1b/d1c/d27/d62/dcf/d44/fbf zero size 2024-09-19T09:35:25.387 INFO:tasks.workunit.client.0.smithi112.stdout:9/381: symlink df/d35/l86 0 2024-09-19T09:35:25.389 INFO:tasks.workunit.client.0.smithi112.stdout:6/631: link d8/de/d66/fd0 d8/d11/d14/d3c/d4b/fdb 0 2024-09-19T09:35:25.391 INFO:tasks.workunit.client.0.smithi112.stdout:3/640: getdents d8/d48 0 2024-09-19T09:35:25.392 INFO:tasks.workunit.client.0.smithi112.stdout:2/423: dwrite d0/d3e/d61/f63 [0,4194304] 0 2024-09-19T09:35:25.393 INFO:tasks.workunit.client.0.smithi112.stdout:9/382: link df/d11/d14/l22 df/d11/d14/d19/d66/d5d/l87 0 2024-09-19T09:35:25.394 INFO:tasks.workunit.client.0.smithi112.stdout:6/632: creat d8/de/d61/d70/db5/fdc x:0 0 0 2024-09-19T09:35:25.395 INFO:tasks.workunit.client.0.smithi112.stdout:3/641: symlink d8/d15/d1b/d1c/db5/ld7 0 2024-09-19T09:35:25.395 INFO:tasks.workunit.client.0.smithi112.stdout:3/642: write d8/d15/d1b/fad [279827,58073] 0 2024-09-19T09:35:25.398 INFO:tasks.workunit.client.0.smithi112.stdout:2/424: link d0/d6/f36 d0/d3e/d50/d57/d5a/f87 0 2024-09-19T09:35:25.399 INFO:tasks.workunit.client.0.smithi112.stdout:4/822: read d1/d31/f50 [2354064,85801] 0 2024-09-19T09:35:25.400 INFO:tasks.workunit.client.0.smithi112.stdout:6/633: link d8/d11/f43 d8/d73/fdd 0 2024-09-19T09:35:25.402 INFO:tasks.workunit.client.0.smithi112.stdout:4/823: dread d1/d4/d3a/f22 [0,4194304] 0 2024-09-19T09:35:25.402 INFO:tasks.workunit.client.0.smithi112.stdout:4/824: chown d1/d5f 7 1 2024-09-19T09:35:25.402 INFO:tasks.workunit.client.0.smithi112.stdout:1/395: dwrite dc/f1f [0,4194304] 0 2024-09-19T09:35:25.402 INFO:tasks.workunit.client.0.smithi112.stdout:4/825: creat d1/d31/d42/f117 x:0 0 0 2024-09-19T09:35:25.402 INFO:tasks.workunit.client.0.smithi112.stdout:1/396: stat dc/f20 0 2024-09-19T09:35:25.402 INFO:tasks.workunit.client.0.smithi112.stdout:4/826: write d1/d31/d43/d48/fdb [799793,34524] 0 2024-09-19T09:35:25.402 INFO:tasks.workunit.client.0.smithi112.stdout:4/827: write d1/f9b [823007,38853] 0 2024-09-19T09:35:25.403 INFO:tasks.workunit.client.0.smithi112.stdout:4/828: chown d1/d31/d42/fc4 1476 1 2024-09-19T09:35:25.403 INFO:tasks.workunit.client.0.smithi112.stdout:6/634: mknod d8/de/d17/d94/cde 0 2024-09-19T09:35:25.403 INFO:tasks.workunit.client.0.smithi112.stdout:5/651: dwrite d4/d9/d3e/fd3 [0,4194304] 0 2024-09-19T09:35:25.403 INFO:tasks.workunit.client.0.smithi112.stdout:5/652: readlink d4/d9/d17/d2f/l51 0 2024-09-19T09:35:25.408 INFO:tasks.workunit.client.0.smithi112.stdout:1/397: truncate dc/f69 2328483 0 2024-09-19T09:35:25.410 INFO:tasks.workunit.client.0.smithi112.stdout:0/530: dwrite d2/d59/d7a/f8b [0,4194304] 0 2024-09-19T09:35:25.410 INFO:tasks.workunit.client.0.smithi112.stdout:9/383: dread f3 [0,4194304] 0 2024-09-19T09:35:25.410 INFO:tasks.workunit.client.0.smithi112.stdout:9/384: chown df/d11/d14/d19/d40/d5c/c7d 7 1 2024-09-19T09:35:25.414 INFO:tasks.workunit.client.0.smithi112.stdout:4/829: mkdir d1/d31/d43/d48/d118 0 2024-09-19T09:35:25.417 INFO:tasks.workunit.client.0.smithi112.stdout:5/653: creat d4/d29/ddf/fe1 x:0 0 0 2024-09-19T09:35:25.420 INFO:tasks.workunit.client.0.smithi112.stdout:1/398: rename dc/ff to dc/d26/d34/f77 0 2024-09-19T09:35:25.420 INFO:tasks.workunit.client.0.smithi112.stdout:1/399: chown l3 9455 1 2024-09-19T09:35:25.426 INFO:tasks.workunit.client.0.smithi112.stdout:3/643: dwrite d8/d15/d1b/d1c/f7c [0,4194304] 0 2024-09-19T09:35:25.426 INFO:tasks.workunit.client.0.smithi112.stdout:3/644: dread - d8/d15/d1b/d1c/d27/d62/fc1 zero size 2024-09-19T09:35:25.429 INFO:tasks.workunit.client.0.smithi112.stdout:2/425: dwrite d0/f5 [0,4194304] 0 2024-09-19T09:35:25.429 INFO:tasks.workunit.client.0.smithi112.stdout:2/426: chown d0/d6/c42 3178 1 2024-09-19T09:35:25.439 INFO:tasks.workunit.client.0.smithi112.stdout:3/645: dread d8/d15/d1b/d1c/d68/f5b [0,4194304] 0 2024-09-19T09:35:25.441 INFO:tasks.workunit.client.0.smithi112.stdout:2/427: write d0/d3e/d50/d57/d5a/d4b/f53 [526069,66664] 0 2024-09-19T09:35:25.443 INFO:tasks.workunit.client.0.smithi112.stdout:9/385: creat df/d11/d14/d19/d1e/f88 x:0 0 0 2024-09-19T09:35:25.444 INFO:tasks.workunit.client.0.smithi112.stdout:4/830: mkdir d1/d31/d43/d48/d118/d119 0 2024-09-19T09:35:25.449 INFO:tasks.workunit.client.0.smithi112.stdout:5/654: mkdir d4/d9/d2a/d46/dde/de2 0 2024-09-19T09:35:25.449 INFO:tasks.workunit.client.0.smithi112.stdout:5/655: stat d4/d9/d17/d2f/d72/f63 0 2024-09-19T09:35:25.451 INFO:tasks.workunit.client.0.smithi112.stdout:0/531: rename d2/d11/l48 to d2/d39/d3b/d44/la7 0 2024-09-19T09:35:25.454 INFO:tasks.workunit.client.0.smithi112.stdout:0/532: dread d2/d6e/da0/f7b [0,4194304] 0 2024-09-19T09:35:25.454 INFO:tasks.workunit.client.0.smithi112.stdout:0/533: truncate d2/d39/d3b/f3f 301131 0 2024-09-19T09:35:25.454 INFO:tasks.workunit.client.0.smithi112.stdout:1/400: mknod dc/d26/c78 0 2024-09-19T09:35:25.457 INFO:tasks.workunit.client.0.smithi112.stdout:4/831: dread d1/d3d/f61 [4194304,4194304] 0 2024-09-19T09:35:25.463 INFO:tasks.workunit.client.0.smithi112.stdout:3/646: symlink d8/d15/d1b/d1c/d68/d33/d66/ld8 0 2024-09-19T09:35:25.463 INFO:tasks.workunit.client.0.smithi112.stdout:3/647: write d8/d15/d1b/d1c/d27/d2b/fc3 [864441,13488] 0 2024-09-19T09:35:25.464 INFO:tasks.workunit.client.0.smithi112.stdout:0/534: dread d2/d59/d7a/f9c [0,4194304] 0 2024-09-19T09:35:25.464 INFO:tasks.workunit.client.0.smithi112.stdout:2/428: mkdir d0/d1/d28/d88 0 2024-09-19T09:35:25.467 INFO:tasks.workunit.client.0.smithi112.stdout:9/386: mkdir df/d11/d14/d19/d28/d89 0 2024-09-19T09:35:25.467 INFO:tasks.workunit.client.0.smithi112.stdout:9/387: fdatasync df/d11/d14/d19/d40/d5c/d6b/f6f 0 2024-09-19T09:35:25.468 INFO:tasks.workunit.client.0.smithi112.stdout:5/656: symlink d4/d9/d2a/d39/d88/dba/le3 0 2024-09-19T09:35:25.468 INFO:tasks.workunit.client.0.smithi112.stdout:5/657: write d4/d29/d36/d70/fd5 [1042915,86276] 0 2024-09-19T09:35:25.472 INFO:tasks.workunit.client.0.smithi112.stdout:1/401: rename dc/d13/d58/f60 to dc/d59/d73/f79 0 2024-09-19T09:35:25.473 INFO:tasks.workunit.client.0.smithi112.stdout:3/648: creat d8/d15/d1b/d1c/db5/fd9 x:0 0 0 2024-09-19T09:35:25.476 INFO:tasks.workunit.client.0.smithi112.stdout:4/832: dwrite d1/d4/d3a/d57/d62/f79 [0,4194304] 0 2024-09-19T09:35:25.476 INFO:tasks.workunit.client.0.smithi112.stdout:4/833: chown d1/d31/d43/f74 1 1 2024-09-19T09:35:25.477 INFO:tasks.workunit.client.0.smithi112.stdout:2/429: dread d0/d6/f36 [0,4194304] 0 2024-09-19T09:35:25.477 INFO:tasks.workunit.client.0.smithi112.stdout:2/430: dread - d0/d1/d28/d67/f77 zero size 2024-09-19T09:35:25.481 INFO:tasks.workunit.client.0.smithi112.stdout:1/402: unlink dc/d13/l3b 0 2024-09-19T09:35:25.485 INFO:tasks.workunit.client.0.smithi112.stdout:4/834: mkdir d1/d31/d51/d89/d11a 0 2024-09-19T09:35:25.486 INFO:tasks.workunit.client.0.smithi112.stdout:4/835: chown d1/d3d/d72 402372 1 2024-09-19T09:35:25.487 INFO:tasks.workunit.client.0.smithi112.stdout:3/649: symlink d8/d15/d1b/d1c/d43/d9b/lda 0 2024-09-19T09:35:25.488 INFO:tasks.workunit.client.0.smithi112.stdout:5/658: dwrite d4/f62 [0,4194304] 0 2024-09-19T09:35:25.489 INFO:tasks.workunit.client.0.smithi112.stdout:4/836: creat d1/d31/d96/d9e/f11b x:0 0 0 2024-09-19T09:35:25.493 INFO:tasks.workunit.client.0.smithi112.stdout:3/650: rename d8/d15/d1b/d1c/d68/d33/c8f to d8/d15/d1b/d1c/d27/d2b/d84/cdb 0 2024-09-19T09:35:25.493 INFO:tasks.workunit.client.0.smithi112.stdout:5/659: mkdir d4/d3f/da9/de4 0 2024-09-19T09:35:25.495 INFO:tasks.workunit.client.0.smithi112.stdout:4/837: mkdir d1/d31/d51/d89/d8b/d11c 0 2024-09-19T09:35:25.498 INFO:tasks.workunit.client.0.smithi112.stdout:4/838: symlink d1/d31/d43/d48/l11d 0 2024-09-19T09:35:25.498 INFO:tasks.workunit.client.0.smithi112.stdout:4/839: write d1/d4/d3a/d57/f114 [209891,127962] 0 2024-09-19T09:35:25.498 INFO:tasks.workunit.client.0.smithi112.stdout:1/403: dwrite dc/f23 [0,4194304] 0 2024-09-19T09:35:25.499 INFO:tasks.workunit.client.0.smithi112.stdout:1/404: rename f2 to dc/d24/d45/f7a 0 2024-09-19T09:35:25.500 INFO:tasks.workunit.client.0.smithi112.stdout:4/840: link d1/d5f/ca9 d1/d4/c11e 0 2024-09-19T09:35:25.501 INFO:tasks.workunit.client.0.smithi112.stdout:1/405: truncate dc/f53 1079812 0 2024-09-19T09:35:25.501 INFO:tasks.workunit.client.0.smithi112.stdout:9/388: rmdir df/d11/d14/d19/d1e 39 2024-09-19T09:35:25.504 INFO:tasks.workunit.client.0.smithi112.stdout:4/841: unlink d1/d3d/d41/c2b 0 2024-09-19T09:35:25.504 INFO:tasks.workunit.client.0.smithi112.stdout:4/842: write d1/d4/d3a/d57/d62/d88/fc9 [497191,25587] 0 2024-09-19T09:35:25.506 INFO:tasks.workunit.client.0.smithi112.stdout:4/843: truncate d1/d4/f59 1348850 0 2024-09-19T09:35:25.511 INFO:tasks.workunit.client.0.smithi112.stdout:9/389: write df/d11/d14/f1f [3963258,11258] 0 2024-09-19T09:35:25.512 INFO:tasks.workunit.client.0.smithi112.stdout:9/390: symlink df/d11/d14/d19/d40/d5c/d6b/l8a 0 2024-09-19T09:35:25.520 INFO:tasks.workunit.client.0.smithi112.stdout:1/406: dwrite dc/d13/f1c [0,4194304] 0 2024-09-19T09:35:25.520 INFO:tasks.workunit.client.0.smithi112.stdout:1/407: truncate dc/d26/d34/d4c/d55/f56 646943 0 2024-09-19T09:35:25.520 INFO:tasks.workunit.client.0.smithi112.stdout:1/408: fsync f6 0 2024-09-19T09:35:25.520 INFO:tasks.workunit.client.0.smithi112.stdout:5/660: dwrite d4/d9/d6b/f6d [0,4194304] 0 2024-09-19T09:35:25.523 INFO:tasks.workunit.client.0.smithi112.stdout:1/409: creat dc/d13/d58/f7b x:0 0 0 2024-09-19T09:35:25.525 INFO:tasks.workunit.client.0.smithi112.stdout:9/391: dread df/d11/d14/f1f [0,4194304] 0 2024-09-19T09:35:25.529 INFO:tasks.workunit.client.0.smithi112.stdout:9/392: mkdir df/d11/d14/d51/d8b 0 2024-09-19T09:35:25.530 INFO:tasks.workunit.client.0.smithi112.stdout:9/393: write df/d11/d14/d19/d66/f4a [419954,29533] 0 2024-09-19T09:35:25.530 INFO:tasks.workunit.client.0.smithi112.stdout:9/394: fsync df/d11/d14/d19/d66/d5d/f7c 0 2024-09-19T09:35:25.531 INFO:tasks.workunit.client.0.smithi112.stdout:9/395: symlink df/l8c 0 2024-09-19T09:35:25.531 INFO:tasks.workunit.client.0.smithi112.stdout:9/396: dread - df/d11/d14/d19/d28/f43 zero size 2024-09-19T09:35:25.531 INFO:tasks.workunit.client.0.smithi112.stdout:9/397: fdatasync df/d11/d14/f62 0 2024-09-19T09:35:25.531 INFO:tasks.workunit.client.0.smithi112.stdout:9/398: rename df/d11/d14 to df/d11/d14/d19/d8d 22 2024-09-19T09:35:25.533 INFO:tasks.workunit.client.0.smithi112.stdout:5/661: write d4/f62 [358215,62451] 0 2024-09-19T09:35:25.533 INFO:tasks.workunit.client.0.smithi112.stdout:0/535: dwrite d2/f10 [4194304,4194304] 0 2024-09-19T09:35:25.535 INFO:tasks.workunit.client.0.smithi112.stdout:0/536: unlink d2/d68/d92/c97 0 2024-09-19T09:35:25.536 INFO:tasks.workunit.client.0.smithi112.stdout:0/537: creat d2/d39/fa8 x:0 0 0 2024-09-19T09:35:25.540 INFO:tasks.workunit.client.0.smithi112.stdout:9/399: dread df/d11/d14/d19/f33 [0,4194304] 0 2024-09-19T09:35:25.541 INFO:tasks.workunit.client.0.smithi112.stdout:9/400: symlink df/d11/d14/l8e 0 2024-09-19T09:35:25.542 INFO:tasks.workunit.client.0.smithi112.stdout:9/401: stat l8 0 2024-09-19T09:35:25.543 INFO:tasks.workunit.client.0.smithi112.stdout:1/410: dwrite dc/d13/f33 [0,4194304] 0 2024-09-19T09:35:25.544 INFO:tasks.workunit.client.0.smithi112.stdout:5/662: write d4/d9/d2a/f49 [3936697,49716] 0 2024-09-19T09:35:25.547 INFO:tasks.workunit.client.0.smithi112.stdout:9/402: unlink df/d11/d14/l22 0 2024-09-19T09:35:25.554 INFO:tasks.workunit.client.0.smithi112.stdout:1/411: dread dc/d26/d34/f3f [0,4194304] 0 2024-09-19T09:35:25.556 INFO:tasks.workunit.client.0.smithi112.stdout:9/403: rename df/d11/d14/d19/d1e/c79 to df/d11/d14/d19/d28/d89/c8f 0 2024-09-19T09:35:25.556 INFO:tasks.workunit.client.0.smithi112.stdout:9/404: truncate df/d11/d14/d19/d40/d5c/d6b/f6f 63157 0 2024-09-19T09:35:25.558 INFO:tasks.workunit.client.0.smithi112.stdout:1/412: mknod dc/d26/d44/c7c 0 2024-09-19T09:35:25.558 INFO:tasks.workunit.client.0.smithi112.stdout:1/413: chown dc/d26/d34/f6d 8907623 1 2024-09-19T09:35:25.558 INFO:tasks.workunit.client.0.smithi112.stdout:1/414: write f6 [3712106,102399] 0 2024-09-19T09:35:25.559 INFO:tasks.workunit.client.0.smithi112.stdout:9/405: truncate df/d11/d14/f3b 1428384 0 2024-09-19T09:35:25.559 INFO:tasks.workunit.client.0.smithi112.stdout:5/663: dwrite d4/d9/d2a/d39/d88/fa1 [0,4194304] 0 2024-09-19T09:35:25.566 INFO:tasks.workunit.client.0.smithi112.stdout:9/406: dread fc [4194304,4194304] 0 2024-09-19T09:35:25.567 INFO:tasks.workunit.client.0.smithi112.stdout:5/664: link d4/d29/d36/d56/l9c d4/d9/d17/da6/db2/dce/le5 0 2024-09-19T09:35:25.577 INFO:tasks.workunit.client.0.smithi112.stdout:9/407: creat df/d11/d14/d19/f90 x:0 0 0 2024-09-19T09:35:25.577 INFO:tasks.workunit.client.0.smithi112.stdout:9/408: write df/d11/d14/f44 [1305533,115055] 0 2024-09-19T09:35:25.577 INFO:tasks.workunit.client.0.smithi112.stdout:9/409: write f3 [4446996,37628] 0 2024-09-19T09:35:25.577 INFO:tasks.workunit.client.0.smithi112.stdout:9/410: stat df/d11/d14/d19/d40/d5c/d6b/l8a 0 2024-09-19T09:35:25.577 INFO:tasks.workunit.client.0.smithi112.stdout:5/665: mkdir d4/d9/d17/dd6/de6 0 2024-09-19T09:35:25.580 INFO:tasks.workunit.client.0.smithi112.stdout:1/415: rename dc/d13/d58 to dc/d26/d34/d36/d68/d7d 0 2024-09-19T09:35:25.582 INFO:tasks.workunit.client.0.smithi112.stdout:9/411: symlink df/d11/d14/d19/l91 0 2024-09-19T09:35:25.583 INFO:tasks.workunit.client.0.smithi112.stdout:5/666: mknod d4/d9/d17/da6/db2/dce/ce7 0 2024-09-19T09:35:25.584 INFO:tasks.workunit.client.0.smithi112.stdout:1/416: link dc/f53 dc/d26/d34/d4c/f7e 0 2024-09-19T09:35:25.584 INFO:tasks.workunit.client.0.smithi112.stdout:1/417: read - dc/d59/f5d zero size 2024-09-19T09:35:25.586 INFO:tasks.workunit.client.0.smithi112.stdout:9/412: rename df/d11/d14/f1d to df/d11/d14/d19/d40/d5c/d6b/f92 0 2024-09-19T09:35:25.587 INFO:tasks.workunit.client.0.smithi112.stdout:5/667: creat d4/d9/fe8 x:0 0 0 2024-09-19T09:35:25.587 INFO:tasks.workunit.client.0.smithi112.stdout:5/668: write d4/d9/d2a/d69/f81 [577771,74337] 0 2024-09-19T09:35:25.589 INFO:tasks.workunit.client.0.smithi112.stdout:1/418: creat dc/d26/d44/d63/f7f x:0 0 0 2024-09-19T09:35:25.589 INFO:tasks.workunit.client.0.smithi112.stdout:1/419: stat dc/d26/d34/d36/d68/d7d 0 2024-09-19T09:35:25.589 INFO:tasks.workunit.client.0.smithi112.stdout:1/420: creat dc/d59/f80 x:0 0 0 2024-09-19T09:35:25.592 INFO:tasks.workunit.client.0.smithi112.stdout:9/413: rename df/d11/d14/l8e to df/d11/d14/d19/d40/d5c/d6b/l93 0 2024-09-19T09:35:25.594 INFO:tasks.workunit.client.0.smithi112.stdout:9/414: rename df/d11/d14/d19/d28/d89/c8f to df/d11/d14/d19/d28/d89/c94 0 2024-09-19T09:35:25.596 INFO:tasks.workunit.client.0.smithi112.stdout:9/415: write df/d11/f25 [4793972,61860] 0 2024-09-19T09:35:25.613 INFO:tasks.workunit.client.0.smithi112.stdout:5/669: dwrite d4/d29/f3c [4194304,4194304] 0 2024-09-19T09:35:25.613 INFO:tasks.workunit.client.0.smithi112.stdout:1/421: dwrite dc/d26/d34/d36/d68/d7d/f7b [0,4194304] 0 2024-09-19T09:35:25.617 INFO:tasks.workunit.client.0.smithi112.stdout:1/422: mknod dc/d26/d34/d4c/c81 0 2024-09-19T09:35:25.617 INFO:tasks.workunit.client.0.smithi112.stdout:1/423: write dc/d13/f18 [48304,18613] 0 2024-09-19T09:35:25.618 INFO:tasks.workunit.client.0.smithi112.stdout:5/670: symlink d4/d9/d17/d30/le9 0 2024-09-19T09:35:25.621 INFO:tasks.workunit.client.0.smithi112.stdout:5/671: dread d4/d29/d36/d5f/f6a [0,4194304] 0 2024-09-19T09:35:25.622 INFO:tasks.workunit.client.0.smithi112.stdout:5/672: mkdir d4/d29/d36/d56/dea 0 2024-09-19T09:35:25.622 INFO:tasks.workunit.client.0.smithi112.stdout:5/673: chown d4/d29/d36/d56 1 1 2024-09-19T09:35:25.624 INFO:tasks.workunit.client.0.smithi112.stdout:5/674: link d4/d9/d17/d2f/fb6 d4/d9/d17/dd6/feb 0 2024-09-19T09:35:25.624 INFO:tasks.workunit.client.0.smithi112.stdout:5/675: stat d4/d9/d17/d7c 0 2024-09-19T09:35:25.624 INFO:tasks.workunit.client.0.smithi112.stdout:1/424: dread dc/d13/f25 [0,4194304] 0 2024-09-19T09:35:25.625 INFO:tasks.workunit.client.0.smithi112.stdout:1/425: mkdir dc/d59/d82 0 2024-09-19T09:35:25.626 INFO:tasks.workunit.client.0.smithi112.stdout:5/676: mkdir d4/d9/d17/d30/dec 0 2024-09-19T09:35:25.627 INFO:tasks.workunit.client.0.smithi112.stdout:1/426: symlink dc/d24/d45/l83 0 2024-09-19T09:35:25.629 INFO:tasks.workunit.client.0.smithi112.stdout:5/677: symlink d4/d9/d17/d7c/led 0 2024-09-19T09:35:25.629 INFO:tasks.workunit.client.0.smithi112.stdout:5/678: creat d4/d3f/fee x:0 0 0 2024-09-19T09:35:25.632 INFO:tasks.workunit.client.0.smithi112.stdout:5/679: rename d4/d9/d2a/d69/c95 to d4/d29/d36/dc9/cef 0 2024-09-19T09:35:25.632 INFO:tasks.workunit.client.0.smithi112.stdout:5/680: dread - d4/d3f/fdd zero size 2024-09-19T09:35:25.632 INFO:tasks.workunit.client.0.smithi112.stdout:5/681: readlink d4/d84/lb1 0 2024-09-19T09:35:25.633 INFO:tasks.workunit.client.0.smithi112.stdout:5/682: unlink d4/d9/f10 0 2024-09-19T09:35:25.633 INFO:tasks.workunit.client.0.smithi112.stdout:5/683: truncate d4/d29/d36/d56/fa8 300370 0 2024-09-19T09:35:25.634 INFO:tasks.workunit.client.0.smithi112.stdout:5/684: link d4/d29/d36/l9e d4/d29/d36/d56/dea/lf0 0 2024-09-19T09:35:25.635 INFO:tasks.workunit.client.0.smithi112.stdout:5/685: truncate d4/d29/d36/da2/fb0 526692 0 2024-09-19T09:35:25.636 INFO:tasks.workunit.client.0.smithi112.stdout:5/686: creat d4/d29/d36/d70/ff1 x:0 0 0 2024-09-19T09:35:25.636 INFO:tasks.workunit.client.0.smithi112.stdout:5/687: stat d4/d9/d17/d2f/d72/dae 0 2024-09-19T09:35:25.637 INFO:tasks.workunit.client.0.smithi112.stdout:5/688: symlink d4/dbf/lf2 0 2024-09-19T09:35:25.637 INFO:tasks.workunit.client.0.smithi112.stdout:5/689: symlink d4/d9/d17/d30/dec/lf3 0 2024-09-19T09:35:25.639 INFO:tasks.workunit.client.0.smithi112.stdout:5/690: rmdir d4/d3f/da9/ddb 0 2024-09-19T09:35:25.639 INFO:tasks.workunit.client.0.smithi112.stdout:5/691: write d4/d84/f99 [521619,93502] 0 2024-09-19T09:35:25.640 INFO:tasks.workunit.client.0.smithi112.stdout:5/692: write d4/d9/d3e/fda [532500,96065] 0 2024-09-19T09:35:25.640 INFO:tasks.workunit.client.0.smithi112.stdout:5/693: truncate d4/d29/d36/d70/ff1 390574 0 2024-09-19T09:35:25.640 INFO:tasks.workunit.client.0.smithi112.stdout:5/694: mkdir d4/d29/ddf/df4 0 2024-09-19T09:35:25.648 INFO:tasks.workunit.client.0.smithi112.stdout:5/695: dread d4/d9/d17/d30/fab [4194304,4194304] 0 2024-09-19T09:35:25.650 INFO:tasks.workunit.client.0.smithi112.stdout:5/696: symlink d4/d9/d17/d30/dec/lf5 0 2024-09-19T09:35:25.880 INFO:tasks.workunit.client.0.smithi112.stdout:8/585: sync 2024-09-19T09:35:25.880 INFO:tasks.workunit.client.0.smithi112.stdout:8/586: readlink d7/db/d21/l6a 0 2024-09-19T09:35:25.900 INFO:tasks.workunit.client.0.smithi112.stdout:8/587: dwrite d7/db/d21/f4e [0,4194304] 0 2024-09-19T09:35:25.908 INFO:tasks.workunit.client.0.smithi112.stdout:8/588: truncate d7/db/f73 943128 0 2024-09-19T09:35:25.909 INFO:tasks.workunit.client.0.smithi112.stdout:8/589: rmdir d7/db/d21/d3b/d56/d3c/d79/d85 39 2024-09-19T09:35:25.909 INFO:tasks.workunit.client.0.smithi112.stdout:8/590: stat d7/db/f73 0 2024-09-19T09:35:25.909 INFO:tasks.workunit.client.0.smithi112.stdout:8/591: write d7/f76 [2159018,123325] 0 2024-09-19T09:35:25.910 INFO:tasks.workunit.client.0.smithi112.stdout:8/592: read - d7/db/d21/d2e/d42/d57/fa9 zero size 2024-09-19T09:35:25.911 INFO:tasks.workunit.client.0.smithi112.stdout:8/593: mknod d7/db/d21/d3b/d56/d3c/d79/d85/cb3 0 2024-09-19T09:35:25.921 INFO:tasks.workunit.client.0.smithi112.stdout:8/594: dread d7/db/d21/f47 [0,4194304] 0 2024-09-19T09:35:26.214 INFO:tasks.workunit.client.0.smithi112.stdout:7/596: sync 2024-09-19T09:35:26.214 INFO:tasks.workunit.client.0.smithi112.stdout:2/431: sync 2024-09-19T09:35:26.215 INFO:tasks.workunit.client.0.smithi112.stdout:6/635: sync 2024-09-19T09:35:26.215 INFO:tasks.workunit.client.0.smithi112.stdout:7/597: truncate d2/d99/f9b 555526 0 2024-09-19T09:35:26.215 INFO:tasks.workunit.client.0.smithi112.stdout:7/598: chown d2/d2c/d54/d18/d8a/d7c/db1 42 1 2024-09-19T09:35:26.216 INFO:tasks.workunit.client.0.smithi112.stdout:6/636: creat d8/de/d17/dae/fdf x:0 0 0 2024-09-19T09:35:26.217 INFO:tasks.workunit.client.0.smithi112.stdout:2/432: creat d0/d3e/d50/d57/d5a/d27/f89 x:0 0 0 2024-09-19T09:35:26.219 INFO:tasks.workunit.client.0.smithi112.stdout:2/433: write d0/d3e/d50/d57/d5a/d27/f2a [231628,64833] 0 2024-09-19T09:35:26.219 INFO:tasks.workunit.client.0.smithi112.stdout:7/599: mknod d2/d2c/d54/cd3 0 2024-09-19T09:35:26.220 INFO:tasks.workunit.client.0.smithi112.stdout:2/434: mkdir d0/d1/d8a 0 2024-09-19T09:35:26.221 INFO:tasks.workunit.client.0.smithi112.stdout:2/435: write d0/d3e/d50/d57/d5a/d56/f68 [704318,34253] 0 2024-09-19T09:35:26.222 INFO:tasks.workunit.client.0.smithi112.stdout:7/600: symlink d2/d2c/d54/d18/d85/dcd/ld4 0 2024-09-19T09:35:26.222 INFO:tasks.workunit.client.0.smithi112.stdout:7/601: chown d2/d2c/d54/d18/l9f 2266635 1 2024-09-19T09:35:26.224 INFO:tasks.workunit.client.0.smithi112.stdout:6/637: write d8/de/d18/f58 [3957792,101785] 0 2024-09-19T09:35:26.230 INFO:tasks.workunit.client.0.smithi112.stdout:2/436: mkdir d0/d3e/d50/d57/d80/d8b 0 2024-09-19T09:35:26.231 INFO:tasks.workunit.client.0.smithi112.stdout:7/602: creat d2/d2c/d54/fd5 x:0 0 0 2024-09-19T09:35:26.235 INFO:tasks.workunit.client.0.smithi112.stdout:6/638: dread d8/de/d17/fa7 [0,4194304] 0 2024-09-19T09:35:26.236 INFO:tasks.workunit.client.0.smithi112.stdout:6/639: symlink d8/dc5/le0 0 2024-09-19T09:35:26.249 INFO:tasks.workunit.client.0.smithi112.stdout:7/603: getdents d2/d2c/d54/d18/d85/dcd 0 2024-09-19T09:35:26.251 INFO:tasks.workunit.client.0.smithi112.stdout:6/640: read d8/de/d66/d6e/fbd [7928861,15069] 0 2024-09-19T09:35:26.251 INFO:tasks.workunit.client.0.smithi112.stdout:6/641: chown d8/d11/d14/d3c 4313800 1 2024-09-19T09:35:26.251 INFO:tasks.workunit.client.0.smithi112.stdout:6/642: creat d8/d11/d14/d3c/d4b/d63/fe1 x:0 0 0 2024-09-19T09:35:26.251 INFO:tasks.workunit.client.0.smithi112.stdout:7/604: mknod d2/cd6 0 2024-09-19T09:35:26.252 INFO:tasks.workunit.client.0.smithi112.stdout:2/437: dwrite d0/d6/f62 [0,4194304] 0 2024-09-19T09:35:26.255 INFO:tasks.workunit.client.0.smithi112.stdout:7/605: mkdir d2/d2c/d54/d18/d8a/dd7 0 2024-09-19T09:35:26.262 INFO:tasks.workunit.client.0.smithi112.stdout:2/438: rename d0/d3e/d50/d57/d5a/f47 to d0/d4a/f8c 0 2024-09-19T09:35:26.263 INFO:tasks.workunit.client.0.smithi112.stdout:6/643: dread d8/d11/d14/d3c/d4b/d63/f5f [0,4194304] 0 2024-09-19T09:35:26.264 INFO:tasks.workunit.client.0.smithi112.stdout:6/644: creat d8/d11/d14/d2a/fe2 x:0 0 0 2024-09-19T09:35:26.264 INFO:tasks.workunit.client.0.smithi112.stdout:6/645: chown d8/de/d66/d6e/f92 39 1 2024-09-19T09:35:26.264 INFO:tasks.workunit.client.0.smithi112.stdout:6/646: chown d8/de/d66/d6e/f92 20638018 1 2024-09-19T09:35:26.265 INFO:tasks.workunit.client.0.smithi112.stdout:7/606: mkdir d2/d99/dd8 0 2024-09-19T09:35:26.265 INFO:tasks.workunit.client.0.smithi112.stdout:7/607: truncate d2/d2c/d54/d18/d39/d21/d71/f78 451239 0 2024-09-19T09:35:26.265 INFO:tasks.workunit.client.0.smithi112.stdout:7/608: chown d2/d99/dd8 38296206 1 2024-09-19T09:35:26.265 INFO:tasks.workunit.client.0.smithi112.stdout:2/439: symlink d0/d1/d28/l8d 0 2024-09-19T09:35:26.265 INFO:tasks.workunit.client.0.smithi112.stdout:2/440: stat d0/d3e/d50/d57/d5a/d4f/d72 0 2024-09-19T09:35:26.270 INFO:tasks.workunit.client.0.smithi112.stdout:2/441: creat d0/d1/d8a/f8e x:0 0 0 2024-09-19T09:35:26.270 INFO:tasks.workunit.client.0.smithi112.stdout:2/442: chown d0/d4a/f8c 409916 1 2024-09-19T09:35:26.270 INFO:tasks.workunit.client.0.smithi112.stdout:2/443: truncate d0/d1/d28/f31 1589940 0 2024-09-19T09:35:26.271 INFO:tasks.workunit.client.0.smithi112.stdout:2/444: stat d0/d1/l25 0 2024-09-19T09:35:26.271 INFO:tasks.workunit.client.0.smithi112.stdout:2/445: fsync d0/d6/fa 0 2024-09-19T09:35:26.271 INFO:tasks.workunit.client.0.smithi112.stdout:2/446: readlink d0/d4a/l5c 0 2024-09-19T09:35:26.271 INFO:tasks.workunit.client.0.smithi112.stdout:2/447: truncate d0/d3e/d50/d57/f79 173295 0 2024-09-19T09:35:26.278 INFO:tasks.workunit.client.0.smithi112.stdout:7/609: dread d2/d2c/f38 [0,4194304] 0 2024-09-19T09:35:26.280 INFO:tasks.workunit.client.0.smithi112.stdout:7/610: write d2/d2c/d54/d18/d8a/d7c/db1/dc8/fd2 [727336,75781] 0 2024-09-19T09:35:26.281 INFO:tasks.workunit.client.0.smithi112.stdout:6/647: dread f5 [4194304,4194304] 0 2024-09-19T09:35:26.281 INFO:tasks.workunit.client.0.smithi112.stdout:6/648: write d8/de/d66/d6e/fbd [5538793,111300] 0 2024-09-19T09:35:26.287 INFO:tasks.workunit.client.0.smithi112.stdout:6/649: truncate d8/d11/f34 5889911 0 2024-09-19T09:35:26.291 INFO:tasks.workunit.client.0.smithi112.stdout:7/611: mknod d2/d2c/d54/d18/d39/d21/cd9 0 2024-09-19T09:35:26.292 INFO:tasks.workunit.client.0.smithi112.stdout:7/612: mkdir d2/d2c/d54/d18/d39/d21/d45/dda 0 2024-09-19T09:35:26.293 INFO:tasks.workunit.client.0.smithi112.stdout:7/613: fdatasync d2/d2c/d54/d18/d39/d21/d71/f81 0 2024-09-19T09:35:26.297 INFO:tasks.workunit.client.0.smithi112.stdout:2/448: dwrite d0/d3e/d50/d57/d5a/d27/f2a [0,4194304] 0 2024-09-19T09:35:26.308 INFO:tasks.workunit.client.0.smithi112.stdout:7/614: write d2/d2c/d54/d1a/f42 [635602,115146] 0 2024-09-19T09:35:26.308 INFO:tasks.workunit.client.0.smithi112.stdout:7/615: read d2/d2c/d54/d18/d85/f92 [7173,60148] 0 2024-09-19T09:35:26.310 INFO:tasks.workunit.client.0.smithi112.stdout:7/616: getdents d2/d2c/d54/d18/d85 0 2024-09-19T09:35:26.310 INFO:tasks.workunit.client.0.smithi112.stdout:7/617: chown d2/d2c/d54/d18/d39/d21/d71/ld0 7 1 2024-09-19T09:35:26.327 INFO:tasks.workunit.client.0.smithi112.stdout:6/650: dwrite d8/de/d17/f46 [0,4194304] 0 2024-09-19T09:35:26.327 INFO:tasks.workunit.client.0.smithi112.stdout:6/651: read f6 [3030155,60696] 0 2024-09-19T09:35:26.327 INFO:tasks.workunit.client.0.smithi112.stdout:6/652: stat d8/d11/d14/d2a/l44 0 2024-09-19T09:35:26.327 INFO:tasks.workunit.client.0.smithi112.stdout:6/653: fsync d8/de/d66/f9e 0 2024-09-19T09:35:26.327 INFO:tasks.workunit.client.0.smithi112.stdout:6/654: write d8/de/d18/d20/f91 [476650,64048] 0 2024-09-19T09:35:26.330 INFO:tasks.workunit.client.0.smithi112.stdout:6/655: rename d8/de/d17/d49/ld1 to d8/d11/d14/d3c/dd5/le3 0 2024-09-19T09:35:26.330 INFO:tasks.workunit.client.0.smithi112.stdout:6/656: readlink d8/de/d17/d49/ld7 0 2024-09-19T09:35:26.331 INFO:tasks.workunit.client.0.smithi112.stdout:2/449: dwrite d0/d1/d28/d67/f77 [0,4194304] 0 2024-09-19T09:35:26.332 INFO:tasks.workunit.client.0.smithi112.stdout:7/618: dwrite d2/d2c/d54/d18/d39/d23/d35/fa7 [0,4194304] 0 2024-09-19T09:35:26.336 INFO:tasks.workunit.client.0.smithi112.stdout:6/657: mkdir d8/dc5/de4 0 2024-09-19T09:35:26.337 INFO:tasks.workunit.client.0.smithi112.stdout:2/450: mkdir d0/d1/d28/d88/d8f 0 2024-09-19T09:35:26.337 INFO:tasks.workunit.client.0.smithi112.stdout:2/451: stat d0/d6/f36 0 2024-09-19T09:35:26.337 INFO:tasks.workunit.client.0.smithi112.stdout:2/452: readlink d0/d3e/d50/d57/d5a/d27/l54 0 2024-09-19T09:35:26.340 INFO:tasks.workunit.client.0.smithi112.stdout:7/619: link d2/d2c/d54/d18/d85/c91 d2/cdb 0 2024-09-19T09:35:26.343 INFO:tasks.workunit.client.0.smithi112.stdout:2/453: mknod d0/d3e/d50/d57/c90 0 2024-09-19T09:35:26.343 INFO:tasks.workunit.client.0.smithi112.stdout:2/454: chown d0/d6/d24/f39 32588 1 2024-09-19T09:35:26.345 INFO:tasks.workunit.client.0.smithi112.stdout:7/620: unlink d2/d2c/d54/d18/d39/d21/f2e 0 2024-09-19T09:35:26.349 INFO:tasks.workunit.client.0.smithi112.stdout:2/455: creat d0/d1/d5f/d78/f91 x:0 0 0 2024-09-19T09:35:26.353 INFO:tasks.workunit.client.0.smithi112.stdout:7/621: symlink d2/d2c/d54/d18/d8a/dd7/ldc 0 2024-09-19T09:35:26.355 INFO:tasks.workunit.client.0.smithi112.stdout:2/456: creat d0/d1/d28/d67/f92 x:0 0 0 2024-09-19T09:35:26.359 INFO:tasks.workunit.client.0.smithi112.stdout:7/622: creat d2/d2c/d54/d18/d39/d21/d45/d4d/fdd x:0 0 0 2024-09-19T09:35:26.366 INFO:tasks.workunit.client.0.smithi112.stdout:7/623: creat d2/d2c/d54/d18/d39/d21/d71/fde x:0 0 0 2024-09-19T09:35:26.366 INFO:tasks.workunit.client.0.smithi112.stdout:7/624: creat d2/d2c/d54/d18/d39/d23/d35/fdf x:0 0 0 2024-09-19T09:35:26.368 INFO:tasks.workunit.client.0.smithi112.stdout:7/625: truncate d2/fe 2077324 0 2024-09-19T09:35:26.369 INFO:tasks.workunit.client.0.smithi112.stdout:7/626: write d2/d2c/d54/d1a/f42 [1176660,121528] 0 2024-09-19T09:35:26.372 INFO:tasks.workunit.client.0.smithi112.stdout:7/627: symlink d2/d2c/d54/d18/da1/le0 0 2024-09-19T09:35:26.372 INFO:tasks.workunit.client.0.smithi112.stdout:7/628: truncate d2/d2c/d54/d18/d39/d21/d71/f81 549180 0 2024-09-19T09:35:26.374 INFO:tasks.workunit.client.0.smithi112.stdout:2/457: dwrite d0/d3e/d50/d57/d5a/d4f/f52 [0,4194304] 0 2024-09-19T09:35:26.374 INFO:tasks.workunit.client.0.smithi112.stdout:2/458: chown d0/d1/fd 683125 1 2024-09-19T09:35:26.376 INFO:tasks.workunit.client.0.smithi112.stdout:7/629: fsync d2/d2c/d54/d1a/f42 0 2024-09-19T09:35:26.376 INFO:tasks.workunit.client.0.smithi112.stdout:7/630: creat d2/d2c/d54/d18/d8a/fe1 x:0 0 0 2024-09-19T09:35:26.389 INFO:tasks.workunit.client.0.smithi112.stdout:7/631: write d2/d2c/d54/d18/d8a/f94 [2062611,46434] 0 2024-09-19T09:35:26.395 INFO:tasks.workunit.client.0.smithi112.stdout:2/459: dwrite d0/d1/f40 [0,4194304] 0 2024-09-19T09:35:26.395 INFO:tasks.workunit.client.0.smithi112.stdout:2/460: read d0/d3e/d50/d57/d5a/f87 [1404245,37226] 0 2024-09-19T09:35:26.395 INFO:tasks.workunit.client.0.smithi112.stdout:2/461: write d0/d6/f36 [1841659,96832] 0 2024-09-19T09:35:26.398 INFO:tasks.workunit.client.0.smithi112.stdout:2/462: unlink d0/d6/d24/f46 0 2024-09-19T09:35:26.471 INFO:tasks.workunit.client.0.smithi112.stdout:4/844: sync 2024-09-19T09:35:26.471 INFO:tasks.workunit.client.0.smithi112.stdout:4/845: getdents d1/d31/d51/d89 0 2024-09-19T09:35:26.472 INFO:tasks.workunit.client.0.smithi112.stdout:0/538: sync 2024-09-19T09:35:26.473 INFO:tasks.workunit.client.0.smithi112.stdout:3/651: sync 2024-09-19T09:35:26.473 INFO:tasks.workunit.client.0.smithi112.stdout:5/697: sync 2024-09-19T09:35:26.473 INFO:tasks.workunit.client.0.smithi112.stdout:9/416: sync 2024-09-19T09:35:26.474 INFO:tasks.workunit.client.0.smithi112.stdout:1/427: sync 2024-09-19T09:35:26.474 INFO:tasks.workunit.client.0.smithi112.stdout:8/595: sync 2024-09-19T09:35:26.474 INFO:tasks.workunit.client.0.smithi112.stdout:1/428: chown dc/f53 151422083 1 2024-09-19T09:35:26.474 INFO:tasks.workunit.client.0.smithi112.stdout:8/596: write d7/d10/d11/f96 [663899,25175] 0 2024-09-19T09:35:26.474 INFO:tasks.workunit.client.0.smithi112.stdout:1/429: write dc/d24/f12 [769960,107212] 0 2024-09-19T09:35:26.474 INFO:tasks.workunit.client.0.smithi112.stdout:1/430: readlink dc/d13/l2f 0 2024-09-19T09:35:26.474 INFO:tasks.workunit.client.0.smithi112.stdout:4/846: rename d1/c45 to d1/d31/d96/d106/c11f 0 2024-09-19T09:35:26.476 INFO:tasks.workunit.client.0.smithi112.stdout:3/652: rmdir d8/d15/d1b/d1c/d27 39 2024-09-19T09:35:26.476 INFO:tasks.workunit.client.0.smithi112.stdout:3/653: write d8/d15/d1b/d1c/d68/d33/d6f/f7f [17354,131068] 0 2024-09-19T09:35:26.476 INFO:tasks.workunit.client.0.smithi112.stdout:1/431: dread dc/d26/f29 [0,4194304] 0 2024-09-19T09:35:26.478 INFO:tasks.workunit.client.0.smithi112.stdout:4/847: unlink d1/d31/d71/d91/fa0 0 2024-09-19T09:35:26.478 INFO:tasks.workunit.client.0.smithi112.stdout:4/848: stat d1/d4/d3a/d7a/d7f/f3c 0 2024-09-19T09:35:26.480 INFO:tasks.workunit.client.0.smithi112.stdout:0/539: rename d2/d11/l2d to d2/d59/d7a/la9 0 2024-09-19T09:35:26.482 INFO:tasks.workunit.client.0.smithi112.stdout:1/432: symlink dc/d24/d45/l84 0 2024-09-19T09:35:26.486 INFO:tasks.workunit.client.0.smithi112.stdout:3/654: write d8/d15/d1b/d1c/d27/d2b/fc3 [587065,107998] 0 2024-09-19T09:35:26.486 INFO:tasks.workunit.client.0.smithi112.stdout:3/655: dread - d8/d48/faf zero size 2024-09-19T09:35:26.486 INFO:tasks.workunit.client.0.smithi112.stdout:3/656: read d8/d15/d1b/d1c/d68/d33/f35 [2954854,18801] 0 2024-09-19T09:35:26.490 INFO:tasks.workunit.client.0.smithi112.stdout:8/597: write d7/d67/f5d [384631,97316] 0 2024-09-19T09:35:26.491 INFO:tasks.workunit.client.0.smithi112.stdout:1/433: rmdir dc/d59/d82 0 2024-09-19T09:35:26.495 INFO:tasks.workunit.client.0.smithi112.stdout:4/849: rename d1/d4/d3a/d57/d60/ca2 to d1/d4/d3a/d57/d60/c120 0 2024-09-19T09:35:26.502 INFO:tasks.workunit.client.0.smithi112.stdout:1/434: symlink dc/d24/l85 0 2024-09-19T09:35:26.502 INFO:tasks.workunit.client.0.smithi112.stdout:1/435: chown dc/d26/l5e 29107 1 2024-09-19T09:35:26.502 INFO:tasks.workunit.client.0.smithi112.stdout:8/598: dread d7/d10/d11/d33/f7a [0,4194304] 0 2024-09-19T09:35:26.502 INFO:tasks.workunit.client.0.smithi112.stdout:8/599: stat d7/d10/d11/d33/c9b 0 2024-09-19T09:35:26.504 INFO:tasks.workunit.client.0.smithi112.stdout:5/698: rename d4/d3f to d4/d9/df6 0 2024-09-19T09:35:26.504 INFO:tasks.workunit.client.0.smithi112.stdout:5/699: chown d4/d29/d36/d5f/l78 24208 1 2024-09-19T09:35:26.504 INFO:tasks.workunit.client.0.smithi112.stdout:5/700: write d4/d29/d36/dc9/fd0 [370394,65194] 0 2024-09-19T09:35:26.507 INFO:tasks.workunit.client.0.smithi112.stdout:8/600: creat d7/db/d21/d3b/d56/d3c/d79/fb4 x:0 0 0 2024-09-19T09:35:26.507 INFO:tasks.workunit.client.0.smithi112.stdout:8/601: write d7/d10/d11/d33/f54 [3859433,105963] 0 2024-09-19T09:35:26.509 INFO:tasks.workunit.client.0.smithi112.stdout:9/417: dwrite df/d11/d14/d19/d1e/f73 [0,4194304] 0 2024-09-19T09:35:26.510 INFO:tasks.workunit.client.0.smithi112.stdout:5/701: mknod d4/d9/d17/d2f/d72/dae/cf7 0 2024-09-19T09:35:26.511 INFO:tasks.workunit.client.0.smithi112.stdout:0/540: dwrite d2/d39/d3b/d44/d95/f98 [0,4194304] 0 2024-09-19T09:35:26.513 INFO:tasks.workunit.client.0.smithi112.stdout:8/602: symlink d7/db/d21/d3b/d56/d3c/d79/d85/lb5 0 2024-09-19T09:35:26.513 INFO:tasks.workunit.client.0.smithi112.stdout:8/603: stat d7/db/d21/f4e 0 2024-09-19T09:35:26.515 INFO:tasks.workunit.client.0.smithi112.stdout:3/657: dwrite d8/d15/d1b/fad [0,4194304] 0 2024-09-19T09:35:26.517 INFO:tasks.workunit.client.0.smithi112.stdout:5/702: fdatasync d4/d29/d36/dc9/fd0 0 2024-09-19T09:35:26.520 INFO:tasks.workunit.client.0.smithi112.stdout:0/541: symlink d2/laa 0 2024-09-19T09:35:26.520 INFO:tasks.workunit.client.0.smithi112.stdout:5/703: dread d4/f73 [0,4194304] 0 2024-09-19T09:35:26.520 INFO:tasks.workunit.client.0.smithi112.stdout:4/850: dwrite d1/d4/d3a/d57/d62/f86 [0,4194304] 0 2024-09-19T09:35:26.521 INFO:tasks.workunit.client.0.smithi112.stdout:8/604: mkdir d7/db/d21/d2e/d8c/d97/db6 0 2024-09-19T09:35:26.521 INFO:tasks.workunit.client.0.smithi112.stdout:8/605: stat d7/db/d21/d3b/d56 0 2024-09-19T09:35:26.526 INFO:tasks.workunit.client.0.smithi112.stdout:3/658: mknod d8/d15/d1b/d1c/d68/d33/d8e/cdc 0 2024-09-19T09:35:26.526 INFO:tasks.workunit.client.0.smithi112.stdout:9/418: dwrite fc [4194304,4194304] 0 2024-09-19T09:35:26.529 INFO:tasks.workunit.client.0.smithi112.stdout:5/704: mknod d4/d9/d17/d30/cf8 0 2024-09-19T09:35:26.529 INFO:tasks.workunit.client.0.smithi112.stdout:5/705: chown d4/d84/c74 95 1 2024-09-19T09:35:26.529 INFO:tasks.workunit.client.0.smithi112.stdout:5/706: truncate d4/d9/d17/d2f/fb6 193065 0 2024-09-19T09:35:26.535 INFO:tasks.workunit.client.0.smithi112.stdout:4/851: symlink d1/d4/l121 0 2024-09-19T09:35:26.535 INFO:tasks.workunit.client.0.smithi112.stdout:4/852: stat d1/d4/d3a/d57/d60/l9d 0 2024-09-19T09:35:26.536 INFO:tasks.workunit.client.0.smithi112.stdout:5/707: mknod d4/d29/d36/cf9 0 2024-09-19T09:35:26.540 INFO:tasks.workunit.client.0.smithi112.stdout:9/419: dread df/d11/f74 [0,4194304] 0 2024-09-19T09:35:26.540 INFO:tasks.workunit.client.0.smithi112.stdout:9/420: stat df/f61 0 2024-09-19T09:35:26.543 INFO:tasks.workunit.client.0.smithi112.stdout:1/436: dwrite dc/d24/f12 [0,4194304] 0 2024-09-19T09:35:26.543 INFO:tasks.workunit.client.0.smithi112.stdout:1/437: creat dc/d26/d34/d4c/d55/f86 x:0 0 0 2024-09-19T09:35:26.543 INFO:tasks.workunit.client.0.smithi112.stdout:1/438: creat dc/d26/d34/d4c/d55/f87 x:0 0 0 2024-09-19T09:35:26.545 INFO:tasks.workunit.client.0.smithi112.stdout:4/853: unlink d1/d3d/fa6 0 2024-09-19T09:35:26.546 INFO:tasks.workunit.client.0.smithi112.stdout:5/708: mkdir d4/d9/d6b/dfa 0 2024-09-19T09:35:26.547 INFO:tasks.workunit.client.0.smithi112.stdout:9/421: mkdir df/d11/d14/d19/d28/d95 0 2024-09-19T09:35:26.551 INFO:tasks.workunit.client.0.smithi112.stdout:3/659: dwrite d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d63/fd6 [0,4194304] 0 2024-09-19T09:35:26.552 INFO:tasks.workunit.client.0.smithi112.stdout:1/439: truncate dc/f21 697813 0 2024-09-19T09:35:26.552 INFO:tasks.workunit.client.0.smithi112.stdout:5/709: mknod d4/d9/d17/dbb/cfb 0 2024-09-19T09:35:26.553 INFO:tasks.workunit.client.0.smithi112.stdout:5/710: write d4/d9/d17/d2f/d72/fb5 [667904,36646] 0 2024-09-19T09:35:26.553 INFO:tasks.workunit.client.0.smithi112.stdout:5/711: fsync d4/d9/d17/dd6/fc2 0 2024-09-19T09:35:26.553 INFO:tasks.workunit.client.0.smithi112.stdout:9/422: stat c6 0 2024-09-19T09:35:26.553 INFO:tasks.workunit.client.0.smithi112.stdout:9/423: stat df/d11/d14/d19/d1e/f69 0 2024-09-19T09:35:26.553 INFO:tasks.workunit.client.0.smithi112.stdout:0/542: dwrite d2/fe [0,4194304] 0 2024-09-19T09:35:26.554 INFO:tasks.workunit.client.0.smithi112.stdout:3/660: rmdir d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d 39 2024-09-19T09:35:26.554 INFO:tasks.workunit.client.0.smithi112.stdout:3/661: write d8/d15/d1b/d1c/d68/d33/d72/fd0 [509578,1015] 0 2024-09-19T09:35:26.555 INFO:tasks.workunit.client.0.smithi112.stdout:1/440: mkdir dc/d59/d73/d88 0 2024-09-19T09:35:26.557 INFO:tasks.workunit.client.0.smithi112.stdout:5/712: creat d4/d29/d36/d56/dea/ffc x:0 0 0 2024-09-19T09:35:26.557 INFO:tasks.workunit.client.0.smithi112.stdout:5/713: chown d4/d29/c71 117036 1 2024-09-19T09:35:26.558 INFO:tasks.workunit.client.0.smithi112.stdout:3/662: symlink d8/d15/d1b/d1c/d68/d33/d83/ldd 0 2024-09-19T09:35:26.558 INFO:tasks.workunit.client.0.smithi112.stdout:3/663: dread - d8/d48/faf zero size 2024-09-19T09:35:26.558 INFO:tasks.workunit.client.0.smithi112.stdout:3/664: read - d8/d48/d67/d7e/f92 zero size 2024-09-19T09:35:26.560 INFO:tasks.workunit.client.0.smithi112.stdout:5/714: rename d4/d84/fcb to d4/d9/d17/d2f/d72/ffd 0 2024-09-19T09:35:26.561 INFO:tasks.workunit.client.0.smithi112.stdout:0/543: getdents d2/d6e/d6f 0 2024-09-19T09:35:26.561 INFO:tasks.workunit.client.0.smithi112.stdout:9/424: dread df/d35/f38 [0,4194304] 0 2024-09-19T09:35:26.561 INFO:tasks.workunit.client.0.smithi112.stdout:4/854: dwrite d1/d4/fb [0,4194304] 0 2024-09-19T09:35:26.562 INFO:tasks.workunit.client.0.smithi112.stdout:3/665: getdents d8/d15/d1b/d1c/d27/d62/dcf/d44/d49 0 2024-09-19T09:35:26.563 INFO:tasks.workunit.client.0.smithi112.stdout:5/715: link d4/d9/d2a/l93 d4/d9/df6/lfe 0 2024-09-19T09:35:26.565 INFO:tasks.workunit.client.0.smithi112.stdout:9/425: getdents df/d11/d14/d19/d40/d5c 0 2024-09-19T09:35:26.567 INFO:tasks.workunit.client.0.smithi112.stdout:5/716: symlink d4/d9/d2a/d46/lff 0 2024-09-19T09:35:26.570 INFO:tasks.workunit.client.0.smithi112.stdout:0/544: rename d2/d68/d92 to d2/d39/d3b/dab 0 2024-09-19T09:35:26.575 INFO:tasks.workunit.client.0.smithi112.stdout:3/666: dread f7 [0,4194304] 0 2024-09-19T09:35:26.575 INFO:tasks.workunit.client.0.smithi112.stdout:5/717: rename d4/d9/d17/da6/db2/fcf to d4/d9/df6/da9/f100 0 2024-09-19T09:35:26.575 INFO:tasks.workunit.client.0.smithi112.stdout:3/667: chown d8/d15/d1b/d1c/d68/d33/d6f/f76 4 1 2024-09-19T09:35:26.575 INFO:tasks.workunit.client.0.smithi112.stdout:3/668: dread - d8/d15/d1b/d1c/d43/fa6 zero size 2024-09-19T09:35:26.575 INFO:tasks.workunit.client.0.smithi112.stdout:3/669: creat d8/d15/d1b/d1c/d43/d4f/fde x:0 0 0 2024-09-19T09:35:26.575 INFO:tasks.workunit.client.0.smithi112.stdout:3/670: chown d8/d48/faf 5 1 2024-09-19T09:35:26.578 INFO:tasks.workunit.client.0.smithi112.stdout:3/671: truncate d8/d15/f5a 285127 0 2024-09-19T09:35:26.586 INFO:tasks.workunit.client.0.smithi112.stdout:5/718: write d4/d29/f3c [3477683,67751] 0 2024-09-19T09:35:26.586 INFO:tasks.workunit.client.0.smithi112.stdout:5/719: dread - d4/d9/df6/fdd zero size 2024-09-19T09:35:26.586 INFO:tasks.workunit.client.0.smithi112.stdout:5/720: creat d4/d29/ddf/f101 x:0 0 0 2024-09-19T09:35:26.588 INFO:tasks.workunit.client.0.smithi112.stdout:5/721: rename d4/d29/d36/d56/f5e to d4/d9/d2a/d46/dde/f102 0 2024-09-19T09:35:26.588 INFO:tasks.workunit.client.0.smithi112.stdout:5/722: readlink d4/d29/d36/d5f/l78 0 2024-09-19T09:35:26.589 INFO:tasks.workunit.client.0.smithi112.stdout:5/723: write d4/d9/d2a/d46/fd4 [486030,37848] 0 2024-09-19T09:35:26.593 INFO:tasks.workunit.client.0.smithi112.stdout:0/545: dwrite d2/fb [0,4194304] 0 2024-09-19T09:35:26.595 INFO:tasks.workunit.client.0.smithi112.stdout:0/546: symlink d2/lac 0 2024-09-19T09:35:26.597 INFO:tasks.workunit.client.0.smithi112.stdout:4/855: dwrite d1/d4/d3a/d57/d62/d88/fd5 [0,4194304] 0 2024-09-19T09:35:26.597 INFO:tasks.workunit.client.0.smithi112.stdout:4/856: dread - d1/d31/d51/fcf zero size 2024-09-19T09:35:26.598 INFO:tasks.workunit.client.0.smithi112.stdout:4/857: dread - d1/d31/d71/f99 zero size 2024-09-19T09:35:26.598 INFO:tasks.workunit.client.0.smithi112.stdout:4/858: readlink d1/d5f/da4/lbd 0 2024-09-19T09:35:26.598 INFO:tasks.workunit.client.0.smithi112.stdout:3/672: dwrite d8/d15/d1b/d1c/d68/d33/d7b/fab [0,4194304] 0 2024-09-19T09:35:26.601 INFO:tasks.workunit.client.0.smithi112.stdout:3/673: rename d8/d15/d1b/d1c/d43/d9b/lda to d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/ldf 0 2024-09-19T09:35:26.603 INFO:tasks.workunit.client.0.smithi112.stdout:3/674: truncate d8/d15/d1b/d1c/d43/d4f/f5f 1179384 0 2024-09-19T09:35:26.603 INFO:tasks.workunit.client.0.smithi112.stdout:3/675: read - d8/d15/d1b/d1c/d68/d8d/fa7 zero size 2024-09-19T09:35:26.608 INFO:tasks.workunit.client.0.smithi112.stdout:3/676: dread d8/d15/d1b/d1c/d27/d2b/fc3 [0,4194304] 0 2024-09-19T09:35:26.609 INFO:tasks.workunit.client.0.smithi112.stdout:0/547: dread d2/d11/f2a [0,4194304] 0 2024-09-19T09:35:26.611 INFO:tasks.workunit.client.0.smithi112.stdout:5/724: dwrite d4/d9/d3e/fda [0,4194304] 0 2024-09-19T09:35:26.611 INFO:tasks.workunit.client.0.smithi112.stdout:0/548: rename d2/lac to d2/d6e/d75/lad 0 2024-09-19T09:35:26.611 INFO:tasks.workunit.client.0.smithi112.stdout:4/859: dread d1/d31/d42/fc4 [0,4194304] 0 2024-09-19T09:35:26.617 INFO:tasks.workunit.client.0.smithi112.stdout:0/549: dread d2/f38 [0,4194304] 0 2024-09-19T09:35:26.620 INFO:tasks.workunit.client.0.smithi112.stdout:3/677: dread d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d63/fd6 [0,4194304] 0 2024-09-19T09:35:26.620 INFO:tasks.workunit.client.0.smithi112.stdout:3/678: chown d8/d15/d1b/d1c/d27/d62/dcf 85590340 1 2024-09-19T09:35:26.620 INFO:tasks.workunit.client.0.smithi112.stdout:3/679: write d8/d15/d1b/d1c/d68/d33/f35 [1295411,109964] 0 2024-09-19T09:35:26.630 INFO:tasks.workunit.client.0.smithi112.stdout:5/725: rename d4/d29/d36/d56/c7a to d4/d9/d17/dd6/de6/c103 0 2024-09-19T09:35:26.632 INFO:tasks.workunit.client.0.smithi112.stdout:4/860: unlink d1/l1b 0 2024-09-19T09:35:26.633 INFO:tasks.workunit.client.0.smithi112.stdout:3/680: mkdir d8/d15/d1b/d1c/d68/d33/d72/de0 0 2024-09-19T09:35:26.636 INFO:tasks.workunit.client.0.smithi112.stdout:0/550: rename d2/d11/l5b to d2/d6e/da0/lae 0 2024-09-19T09:35:26.638 INFO:tasks.workunit.client.0.smithi112.stdout:5/726: symlink d4/d9/d17/dd6/l104 0 2024-09-19T09:35:26.638 INFO:tasks.workunit.client.0.smithi112.stdout:5/727: dread - d4/d9/d2a/d46/fd2 zero size 2024-09-19T09:35:26.638 INFO:tasks.workunit.client.0.smithi112.stdout:5/728: write d4/d29/d36/d56/fa8 [328808,106437] 0 2024-09-19T09:35:26.638 INFO:tasks.workunit.client.0.smithi112.stdout:5/729: write d4/d9/d17/d2f/fb6 [1017808,105571] 0 2024-09-19T09:35:26.642 INFO:tasks.workunit.client.0.smithi112.stdout:0/551: creat d2/faf x:0 0 0 2024-09-19T09:35:26.642 INFO:tasks.workunit.client.0.smithi112.stdout:3/681: read d8/d15/d1b/d1c/d68/f70 [2508288,31768] 0 2024-09-19T09:35:26.643 INFO:tasks.workunit.client.0.smithi112.stdout:5/730: rename d4/d9/d17/d2f/d72/ffd to d4/d9/d2a/d39/f105 0 2024-09-19T09:35:26.645 INFO:tasks.workunit.client.0.smithi112.stdout:3/682: creat d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/dd4/fe1 x:0 0 0 2024-09-19T09:35:26.646 INFO:tasks.workunit.client.0.smithi112.stdout:0/552: dread d2/d39/d3b/d8a/f9f [0,4194304] 0 2024-09-19T09:35:26.648 INFO:tasks.workunit.client.0.smithi112.stdout:3/683: creat d8/d48/fe2 x:0 0 0 2024-09-19T09:35:26.649 INFO:tasks.workunit.client.0.smithi112.stdout:3/684: getdents d8/d15/d1b/d1c/d27/d62/dcf/d44/d49 0 2024-09-19T09:35:26.651 INFO:tasks.workunit.client.0.smithi112.stdout:0/553: link d2/d59/c94 d2/d59/cb0 0 2024-09-19T09:35:26.651 INFO:tasks.workunit.client.0.smithi112.stdout:0/554: readlink d2/laa 0 2024-09-19T09:35:26.651 INFO:tasks.workunit.client.0.smithi112.stdout:0/555: stat d2/cc 0 2024-09-19T09:35:26.651 INFO:tasks.workunit.client.0.smithi112.stdout:4/861: dwrite d1/d3d/d72/dd6/ffa [0,4194304] 0 2024-09-19T09:35:26.652 INFO:tasks.workunit.client.0.smithi112.stdout:5/731: mknod d4/d9/d17/d30/c106 0 2024-09-19T09:35:26.653 INFO:tasks.workunit.client.0.smithi112.stdout:3/685: creat d8/d15/d1b/d1c/d68/d33/d72/de0/fe3 x:0 0 0 2024-09-19T09:35:26.654 INFO:tasks.workunit.client.0.smithi112.stdout:3/686: chown d8/d48/d67/d7e/f92 2764 1 2024-09-19T09:35:26.657 INFO:tasks.workunit.client.0.smithi112.stdout:4/862: rename d1/d4/d3a/d57/d62/df8 to d1/d4/d3a/d57/d60/db3/d122 0 2024-09-19T09:35:26.657 INFO:tasks.workunit.client.0.smithi112.stdout:4/863: stat d1/d4/d3a/d57/fb0 0 2024-09-19T09:35:26.657 INFO:tasks.workunit.client.0.smithi112.stdout:5/732: unlink d4/d9/d2a/d46/c59 0 2024-09-19T09:35:26.659 INFO:tasks.workunit.client.0.smithi112.stdout:0/556: dread d2/fe [0,4194304] 0 2024-09-19T09:35:26.665 INFO:tasks.workunit.client.0.smithi112.stdout:4/864: getdents d1/d31/d51/d89/d8b 0 2024-09-19T09:35:26.666 INFO:tasks.workunit.client.0.smithi112.stdout:4/865: chown d1/d31/d43/d48/f7e 0 1 2024-09-19T09:35:26.666 INFO:tasks.workunit.client.0.smithi112.stdout:4/866: fdatasync d1/d31/d43/d48/f7e 0 2024-09-19T09:35:26.666 INFO:tasks.workunit.client.0.smithi112.stdout:4/867: write d1/d31/d96/d9e/fd4 [214805,67012] 0 2024-09-19T09:35:26.668 INFO:tasks.workunit.client.0.smithi112.stdout:0/557: symlink d2/d6e/d6f/lb1 0 2024-09-19T09:35:26.671 INFO:tasks.workunit.client.0.smithi112.stdout:4/868: mkdir d1/d4/d3a/d7a/d123 0 2024-09-19T09:35:26.674 INFO:tasks.workunit.client.0.smithi112.stdout:5/733: dwrite d4/d9/d17/dd6/feb [0,4194304] 0 2024-09-19T09:35:26.676 INFO:tasks.workunit.client.0.smithi112.stdout:3/687: rename d8/d15/d1b/d1c/d68/d33/d72 to d8/d15/d1b/d1c/d68/d33/d83/de4 0 2024-09-19T09:35:26.677 INFO:tasks.workunit.client.0.smithi112.stdout:3/688: getdents d8/d15/d1b/d1c/d68/d33/d8e/dc8 0 2024-09-19T09:35:26.679 INFO:tasks.workunit.client.0.smithi112.stdout:3/689: rename d8/d15/d1b/d1c/d43/d4f/fde to d8/d15/d1b/d1c/d27/d62/dcf/d44/fe5 0 2024-09-19T09:35:26.679 INFO:tasks.workunit.client.0.smithi112.stdout:3/690: chown d8/d15/d1b/d1c/d68/l87 46610256 1 2024-09-19T09:35:26.697 INFO:tasks.workunit.client.0.smithi112.stdout:3/691: write d8/d15/d1b/d1c/f7c [3697904,117739] 0 2024-09-19T09:35:26.697 INFO:tasks.workunit.client.0.smithi112.stdout:3/692: read - d8/d15/d1b/d1c/d43/f94 zero size 2024-09-19T09:35:26.699 INFO:tasks.workunit.client.0.smithi112.stdout:3/693: creat d8/d15/d1b/d1c/fe6 x:0 0 0 2024-09-19T09:35:26.699 INFO:tasks.workunit.client.0.smithi112.stdout:0/558: dwrite d2/f30 [0,4194304] 0 2024-09-19T09:35:26.701 INFO:tasks.workunit.client.0.smithi112.stdout:0/559: getdents d2/d6e/da0 0 2024-09-19T09:35:26.703 INFO:tasks.workunit.client.0.smithi112.stdout:5/734: dwrite d4/d9/d17/d30/f89 [0,4194304] 0 2024-09-19T09:35:26.703 INFO:tasks.workunit.client.0.smithi112.stdout:4/869: dwrite d1/f9b [0,4194304] 0 2024-09-19T09:35:26.714 INFO:tasks.workunit.client.0.smithi112.stdout:5/735: write d4/d9/d17/d30/fab [8331344,114282] 0 2024-09-19T09:35:26.715 INFO:tasks.workunit.client.0.smithi112.stdout:5/736: mknod d4/d29/d36/d56/c107 0 2024-09-19T09:35:26.715 INFO:tasks.workunit.client.0.smithi112.stdout:5/737: chown d4/d84/l8c 1343 1 2024-09-19T09:35:26.715 INFO:tasks.workunit.client.0.smithi112.stdout:5/738: read d4/d9/f25 [479723,45846] 0 2024-09-19T09:35:26.715 INFO:tasks.workunit.client.0.smithi112.stdout:5/739: stat d4/d9/d17/d2f/fb6 0 2024-09-19T09:35:26.716 INFO:tasks.workunit.client.0.smithi112.stdout:5/740: link d4/dbf/lf2 d4/d9/df6/da9/l108 0 2024-09-19T09:35:26.717 INFO:tasks.workunit.client.0.smithi112.stdout:5/741: symlink d4/d9/d17/da6/l109 0 2024-09-19T09:35:26.726 INFO:tasks.workunit.client.0.smithi112.stdout:3/694: dwrite d8/d15/f5a [0,4194304] 0 2024-09-19T09:35:26.729 INFO:tasks.workunit.client.0.smithi112.stdout:4/870: dwrite d1/d3d/d41/f67 [0,4194304] 0 2024-09-19T09:35:26.729 INFO:tasks.workunit.client.0.smithi112.stdout:4/871: truncate d1/d4/d3a/f6a 1224858 0 2024-09-19T09:35:26.731 INFO:tasks.workunit.client.0.smithi112.stdout:4/872: creat d1/f124 x:0 0 0 2024-09-19T09:35:26.734 INFO:tasks.workunit.client.0.smithi112.stdout:5/742: dread d4/d9/d17/d30/fab [4194304,4194304] 0 2024-09-19T09:35:26.735 INFO:tasks.workunit.client.0.smithi112.stdout:4/873: rename d1/d4/d3a/d7a/fe6 to d1/d5f/da4/de8/f125 0 2024-09-19T09:35:26.737 INFO:tasks.workunit.client.0.smithi112.stdout:5/743: rename d4/d9/d17/dbb/cfb to d4/d9/d17/dd6/de6/c10a 0 2024-09-19T09:35:26.738 INFO:tasks.workunit.client.0.smithi112.stdout:5/744: write d4/d29/d36/d5f/f6a [519042,87604] 0 2024-09-19T09:35:26.738 INFO:tasks.workunit.client.0.smithi112.stdout:5/745: chown d4/d84/c74 21096759 1 2024-09-19T09:35:26.738 INFO:tasks.workunit.client.0.smithi112.stdout:4/874: creat d1/d3d/d72/f126 x:0 0 0 2024-09-19T09:35:26.741 INFO:tasks.workunit.client.0.smithi112.stdout:3/695: dwrite d8/d15/d1b/d1c/d68/d33/f6b [0,4194304] 0 2024-09-19T09:35:26.741 INFO:tasks.workunit.client.0.smithi112.stdout:3/696: write d8/d15/d1b/d1c/d27/d62/dcf/d44/fbf [699858,121664] 0 2024-09-19T09:35:26.743 INFO:tasks.workunit.client.0.smithi112.stdout:3/697: mknod d8/d48/d67/ce7 0 2024-09-19T09:35:26.743 INFO:tasks.workunit.client.0.smithi112.stdout:3/698: fsync d8/d15/d1b/d1c/d68/d33/d66/f97 0 2024-09-19T09:35:26.745 INFO:tasks.workunit.client.0.smithi112.stdout:3/699: mknod d8/d15/d1b/d1c/d27/d2b/d84/ce8 0 2024-09-19T09:35:26.768 INFO:tasks.workunit.client.0.smithi112.stdout:4/875: dwrite d1/d3d/d72/f7b [0,4194304] 0 2024-09-19T09:35:26.768 INFO:tasks.workunit.client.0.smithi112.stdout:5/746: dwrite d4/d9/d17/d2f/fb6 [4194304,4194304] 0 2024-09-19T09:35:26.769 INFO:tasks.workunit.client.0.smithi112.stdout:4/876: write d1/d4/d3a/d57/fef [5231595,27955] 0 2024-09-19T09:35:26.769 INFO:tasks.workunit.client.0.smithi112.stdout:3/700: dwrite d8/d15/d1b/d1c/d68/d33/f35 [4194304,4194304] 0 2024-09-19T09:35:26.770 INFO:tasks.workunit.client.0.smithi112.stdout:4/877: link d1/d31/d51/f2f d1/d4/d3a/d7a/f127 0 2024-09-19T09:35:26.773 INFO:tasks.workunit.client.0.smithi112.stdout:3/701: creat d8/d15/fe9 x:0 0 0 2024-09-19T09:35:26.773 INFO:tasks.workunit.client.0.smithi112.stdout:3/702: dread - d8/d15/d1b/d1c/d68/d33/d8e/fc5 zero size 2024-09-19T09:35:26.775 INFO:tasks.workunit.client.0.smithi112.stdout:4/878: mknod d1/d5f/da4/de8/c128 0 2024-09-19T09:35:26.776 INFO:tasks.workunit.client.0.smithi112.stdout:5/747: dread d4/d9/d17/d30/f44 [0,4194304] 0 2024-09-19T09:35:26.779 INFO:tasks.workunit.client.0.smithi112.stdout:4/879: creat d1/d4/f129 x:0 0 0 2024-09-19T09:35:26.779 INFO:tasks.workunit.client.0.smithi112.stdout:4/880: write d1/d4/f7 [2545401,123203] 0 2024-09-19T09:35:26.780 INFO:tasks.workunit.client.0.smithi112.stdout:5/748: creat d4/d9/d2a/d46/dde/f10b x:0 0 0 2024-09-19T09:35:26.792 INFO:tasks.workunit.client.0.smithi112.stdout:3/703: rmdir d8/d15 39 2024-09-19T09:35:26.794 INFO:tasks.workunit.client.0.smithi112.stdout:4/881: mknod d1/d31/d43/c12a 0 2024-09-19T09:35:26.795 INFO:tasks.workunit.client.0.smithi112.stdout:5/749: link d4/d9/d17/d30/cf8 d4/d9/d17/d2f/c10c 0 2024-09-19T09:35:26.797 INFO:tasks.workunit.client.0.smithi112.stdout:3/704: mknod d8/d15/d1b/d1c/d27/cea 0 2024-09-19T09:35:26.799 INFO:tasks.workunit.client.0.smithi112.stdout:5/750: getdents d4/d9/d17/d2f/d7d 0 2024-09-19T09:35:26.799 INFO:tasks.workunit.client.0.smithi112.stdout:5/751: fdatasync d4/d9/df6/da9/fb8 0 2024-09-19T09:35:26.799 INFO:tasks.workunit.client.0.smithi112.stdout:5/752: chown d4/d9/d17/dd6/feb 0 1 2024-09-19T09:35:26.802 INFO:tasks.workunit.client.0.smithi112.stdout:3/705: mkdir d8/d15/d1b/d1c/d27/d62/dcf/deb 0 2024-09-19T09:35:26.803 INFO:tasks.workunit.client.0.smithi112.stdout:3/706: chown d8/d15/d1b/d1c/d68/d33/d8e 28188481 1 2024-09-19T09:35:26.803 INFO:tasks.workunit.client.0.smithi112.stdout:5/753: symlink d4/dbf/l10d 0 2024-09-19T09:35:26.803 INFO:tasks.workunit.client.0.smithi112.stdout:5/754: truncate d4/d9/d2a/d39/d88/fcd 586661 0 2024-09-19T09:35:26.803 INFO:tasks.workunit.client.0.smithi112.stdout:5/755: truncate d4/d29/f3c 9093950 0 2024-09-19T09:35:26.803 INFO:tasks.workunit.client.0.smithi112.stdout:4/882: dread d1/d4/d3a/d57/d62/d88/fd5 [0,4194304] 0 2024-09-19T09:35:26.803 INFO:tasks.workunit.client.0.smithi112.stdout:4/883: fsync d1/d31/d42/feb 0 2024-09-19T09:35:26.803 INFO:tasks.workunit.client.0.smithi112.stdout:4/884: write d1/d3d/d93/ff6 [643709,63300] 0 2024-09-19T09:35:26.805 INFO:tasks.workunit.client.0.smithi112.stdout:5/756: creat d4/dbf/f10e x:0 0 0 2024-09-19T09:35:26.809 INFO:tasks.workunit.client.0.smithi112.stdout:5/757: link d4/d9/d2a/d39/d88/fc7 d4/d9/d17/da6/db2/dce/f10f 0 2024-09-19T09:35:26.819 INFO:tasks.workunit.client.0.smithi112.stdout:5/758: dread d4/d9/d17/d2f/fb6 [4194304,4194304] 0 2024-09-19T09:35:26.820 INFO:tasks.workunit.client.0.smithi112.stdout:5/759: mknod d4/d9/d17/d30/dec/c110 0 2024-09-19T09:35:26.820 INFO:tasks.workunit.client.0.smithi112.stdout:5/760: write d4/d9/d2a/d39/d88/fc7 [216079,19899] 0 2024-09-19T09:35:26.822 INFO:tasks.workunit.client.0.smithi112.stdout:5/761: mknod d4/d29/d36/d5f/c111 0 2024-09-19T09:35:26.823 INFO:tasks.workunit.client.0.smithi112.stdout:5/762: mknod d4/d9/d17/dd6/c112 0 2024-09-19T09:35:26.823 INFO:tasks.workunit.client.0.smithi112.stdout:5/763: chown d4/d9/d2a/d46 2733454 1 2024-09-19T09:35:26.823 INFO:tasks.workunit.client.0.smithi112.stdout:5/764: truncate d4/d9/d17/f8e 1754349 0 2024-09-19T09:35:26.830 INFO:tasks.workunit.client.0.smithi112.stdout:4/885: dwrite d1/d31/d96/d9e/fd4 [0,4194304] 0 2024-09-19T09:35:26.830 INFO:tasks.workunit.client.0.smithi112.stdout:4/886: fdatasync d1/d31/d71/d77/fb4 0 2024-09-19T09:35:26.833 INFO:tasks.workunit.client.0.smithi112.stdout:4/887: mkdir d1/d4/d3a/d57/d12b 0 2024-09-19T09:35:26.833 INFO:tasks.workunit.client.0.smithi112.stdout:4/888: dread - d1/d31/f9a zero size 2024-09-19T09:35:26.838 INFO:tasks.workunit.client.0.smithi112.stdout:4/889: dread d1/d31/d43/f74 [0,4194304] 0 2024-09-19T09:35:26.838 INFO:tasks.workunit.client.0.smithi112.stdout:5/765: dwrite d4/d9/d17/d30/f44 [0,4194304] 0 2024-09-19T09:35:26.838 INFO:tasks.workunit.client.0.smithi112.stdout:5/766: write d4/d9/d2a/d39/f3a [6734727,57904] 0 2024-09-19T09:35:26.839 INFO:tasks.workunit.client.0.smithi112.stdout:4/890: symlink d1/d5f/da4/d107/l12c 0 2024-09-19T09:35:26.849 INFO:tasks.workunit.client.0.smithi112.stdout:4/891: rmdir d1/d5f/da4 39 2024-09-19T09:35:26.849 INFO:tasks.workunit.client.0.smithi112.stdout:4/892: write d1/d31/f9a [195119,34536] 0 2024-09-19T09:35:26.849 INFO:tasks.workunit.client.0.smithi112.stdout:5/767: dread d4/d9/d3e/f77 [0,4194304] 0 2024-09-19T09:35:26.849 INFO:tasks.workunit.client.0.smithi112.stdout:5/768: dread - d4/d29/d36/d56/dea/ffc zero size 2024-09-19T09:35:26.849 INFO:tasks.workunit.client.0.smithi112.stdout:5/769: creat d4/d9/d2a/d46/f113 x:0 0 0 2024-09-19T09:35:26.850 INFO:tasks.workunit.client.0.smithi112.stdout:4/893: mkdir d1/d31/d43/d48/d118/d12d 0 2024-09-19T09:35:26.850 INFO:tasks.workunit.client.0.smithi112.stdout:5/770: dread d4/d9/d2a/d46/dde/f102 [0,4194304] 0 2024-09-19T09:35:26.852 INFO:tasks.workunit.client.0.smithi112.stdout:4/894: truncate d1/d31/d43/f74 464171 0 2024-09-19T09:35:26.852 INFO:tasks.workunit.client.0.smithi112.stdout:4/895: creat d1/d4/d3a/d57/f12e x:0 0 0 2024-09-19T09:35:26.852 INFO:tasks.workunit.client.0.smithi112.stdout:5/771: rmdir d4/d9/df6 39 2024-09-19T09:35:26.857 INFO:tasks.workunit.client.0.smithi112.stdout:5/772: getdents d4/d29/d36 0 2024-09-19T09:35:26.857 INFO:tasks.workunit.client.0.smithi112.stdout:5/773: fdatasync d4/d9/fa7 0 2024-09-19T09:35:26.858 INFO:tasks.workunit.client.0.smithi112.stdout:5/774: stat d4/d9/df6/da9/l108 0 2024-09-19T09:35:26.858 INFO:tasks.workunit.client.0.smithi112.stdout:5/775: stat d4/d29/d36/d5f/f6a 0 2024-09-19T09:35:26.869 INFO:tasks.workunit.client.0.smithi112.stdout:5/776: write d4/d9/d6b/f6d [1855164,11738] 0 2024-09-19T09:35:26.874 INFO:tasks.workunit.client.0.smithi112.stdout:4/896: dwrite d1/d3d/d41/f10b [0,4194304] 0 2024-09-19T09:35:26.880 INFO:tasks.workunit.client.0.smithi112.stdout:5/777: dread d4/d9/d17/d30/f89 [0,4194304] 0 2024-09-19T09:35:26.881 INFO:tasks.workunit.client.0.smithi112.stdout:5/778: getdents d4/d9/d17/da6/db2/dce 0 2024-09-19T09:35:26.881 INFO:tasks.workunit.client.0.smithi112.stdout:5/779: write d4/d9/fe8 [403730,121776] 0 2024-09-19T09:35:26.881 INFO:tasks.workunit.client.0.smithi112.stdout:5/780: chown d4/d29 0 1 2024-09-19T09:35:26.882 INFO:tasks.workunit.client.0.smithi112.stdout:4/897: read d1/f46 [4120494,60767] 0 2024-09-19T09:35:26.885 INFO:tasks.workunit.client.0.smithi112.stdout:4/898: mknod d1/d31/d43/d48/d118/d12d/c12f 0 2024-09-19T09:35:26.886 INFO:tasks.workunit.client.0.smithi112.stdout:4/899: symlink d1/d31/d96/d106/l130 0 2024-09-19T09:35:26.888 INFO:tasks.workunit.client.0.smithi112.stdout:5/781: rmdir d4/d9/d17/dbb 0 2024-09-19T09:35:26.889 INFO:tasks.workunit.client.0.smithi112.stdout:4/900: link d1/d31/d51/fe1 d1/d31/d71/d77/f131 0 2024-09-19T09:35:26.890 INFO:tasks.workunit.client.0.smithi112.stdout:4/901: creat d1/d31/d43/d48/d118/d119/f132 x:0 0 0 2024-09-19T09:35:26.890 INFO:tasks.workunit.client.0.smithi112.stdout:4/902: write d1/d4/d3a/d57/d62/d88/fc9 [5124258,3921] 0 2024-09-19T09:35:26.892 INFO:tasks.workunit.client.0.smithi112.stdout:5/782: rename d4/d9/d17/d2f/d7d/c87 to d4/d9/d17/d30/c114 0 2024-09-19T09:35:26.892 INFO:tasks.workunit.client.0.smithi112.stdout:4/903: rmdir d1/d31/d71 39 2024-09-19T09:35:26.893 INFO:tasks.workunit.client.0.smithi112.stdout:4/904: dread - d1/d5f/da4/de8/fee zero size 2024-09-19T09:35:26.894 INFO:tasks.workunit.client.0.smithi112.stdout:5/783: rename d4/d9/d17/dd6/fc2 to d4/d29/d36/d70/f115 0 2024-09-19T09:35:26.894 INFO:tasks.workunit.client.0.smithi112.stdout:5/784: fdatasync d4/d9/df6/fee 0 2024-09-19T09:35:26.895 INFO:tasks.workunit.client.0.smithi112.stdout:4/905: symlink d1/d31/d43/d48/d5c/l133 0 2024-09-19T09:35:26.895 INFO:tasks.workunit.client.0.smithi112.stdout:4/906: fsync d1/d4/d3a/d7a/fbb 0 2024-09-19T09:35:26.908 INFO:tasks.workunit.client.0.smithi112.stdout:4/907: dwrite d1/d4/f129 [0,4194304] 0 2024-09-19T09:35:26.908 INFO:tasks.workunit.client.0.smithi112.stdout:4/908: dread - d1/d4/d3a/d57/d60/db3/f109 zero size 2024-09-19T09:35:26.908 INFO:tasks.workunit.client.0.smithi112.stdout:4/909: chown d1/d31/d96/d9e/fd4 400 1 2024-09-19T09:35:26.910 INFO:tasks.workunit.client.0.smithi112.stdout:4/910: rename d1/d5f/da4/de8/cf0 to d1/d4/d3a/d7a/d7f/da8/c134 0 2024-09-19T09:35:26.911 INFO:tasks.workunit.client.0.smithi112.stdout:4/911: rename d1/d4/d3a/d57/fb0 to d1/d3d/d93/f135 0 2024-09-19T09:35:26.912 INFO:tasks.workunit.client.0.smithi112.stdout:4/912: mknod d1/d31/d71/d77/c136 0 2024-09-19T09:35:26.914 INFO:tasks.workunit.client.0.smithi112.stdout:4/913: rename d1/d4/d3a/d57/d60/f66 to d1/d31/d43/d48/f137 0 2024-09-19T09:35:26.930 INFO:tasks.workunit.client.0.smithi112.stdout:4/914: dwrite d1/f6 [0,4194304] 0 2024-09-19T09:35:26.968 INFO:tasks.workunit.client.0.smithi112.stdout:4/915: dwrite d1/d31/d96/fda [0,4194304] 0 2024-09-19T09:35:26.988 INFO:tasks.workunit.client.0.smithi112.stdout:4/916: link d1/d4/d3a/d57/d60/c120 d1/d31/d71/d91/c138 0 2024-09-19T09:35:26.993 INFO:tasks.workunit.client.0.smithi112.stdout:8/606: sync 2024-09-19T09:35:26.993 INFO:tasks.workunit.client.0.smithi112.stdout:2/463: sync 2024-09-19T09:35:26.994 INFO:tasks.workunit.client.0.smithi112.stdout:7/632: sync 2024-09-19T09:35:26.994 INFO:tasks.workunit.client.0.smithi112.stdout:6/658: sync 2024-09-19T09:35:26.994 INFO:tasks.workunit.client.0.smithi112.stdout:6/659: chown d8/d11/d14/d3c/c90 0 1 2024-09-19T09:35:26.994 INFO:tasks.workunit.client.0.smithi112.stdout:6/660: creat d8/de/d17/dae/fe5 x:0 0 0 2024-09-19T09:35:26.996 INFO:tasks.workunit.client.0.smithi112.stdout:4/917: write d1/d4/d3a/d57/fef [616265,44330] 0 2024-09-19T09:35:26.996 INFO:tasks.workunit.client.0.smithi112.stdout:4/918: chown d1/d3d/f68 121172710 1 2024-09-19T09:35:26.997 INFO:tasks.workunit.client.0.smithi112.stdout:7/633: creat d2/d2c/d54/d18/d39/d21/d45/dda/fe2 x:0 0 0 2024-09-19T09:35:26.997 INFO:tasks.workunit.client.0.smithi112.stdout:7/634: getdents d2/d2c 0 2024-09-19T09:35:26.998 INFO:tasks.workunit.client.0.smithi112.stdout:8/607: symlink d7/d10/d11/lb7 0 2024-09-19T09:35:27.002 INFO:tasks.workunit.client.0.smithi112.stdout:6/661: symlink d8/d11/d14/d3c/d4b/d63/dd3/dda/le6 0 2024-09-19T09:35:27.004 INFO:tasks.workunit.client.0.smithi112.stdout:4/919: dread d1/d3d/d41/f27 [0,4194304] 0 2024-09-19T09:35:27.005 INFO:tasks.workunit.client.0.smithi112.stdout:7/635: link d2/d2c/d54/d18/d39/d23/d35/d76/f8d d2/d49/fe3 0 2024-09-19T09:35:27.005 INFO:tasks.workunit.client.0.smithi112.stdout:7/636: readlink d2/d2c/d54/d18/l25 0 2024-09-19T09:35:27.007 INFO:tasks.workunit.client.0.smithi112.stdout:6/662: mknod d8/d73/dc1/ce7 0 2024-09-19T09:35:27.007 INFO:tasks.workunit.client.0.smithi112.stdout:6/663: chown d8/de/d61/d70/d7b 3 1 2024-09-19T09:35:27.007 INFO:tasks.workunit.client.0.smithi112.stdout:8/608: dread d7/db/d21/d3b/d56/d3c/f94 [0,4194304] 0 2024-09-19T09:35:27.008 INFO:tasks.workunit.client.0.smithi112.stdout:7/637: mknod d2/d99/dd8/ce4 0 2024-09-19T09:35:27.010 INFO:tasks.workunit.client.0.smithi112.stdout:7/638: creat d2/d99/dd8/fe5 x:0 0 0 2024-09-19T09:35:27.010 INFO:tasks.workunit.client.0.smithi112.stdout:7/639: fsync d2/d2c/d54/d18/d85/fa3 0 2024-09-19T09:35:27.010 INFO:tasks.workunit.client.0.smithi112.stdout:7/640: symlink d2/d2c/d54/d18/d39/d21/d45/le6 0 2024-09-19T09:35:27.015 INFO:tasks.workunit.client.0.smithi112.stdout:6/664: dread d8/d73/f76 [0,4194304] 0 2024-09-19T09:35:27.025 INFO:tasks.workunit.client.0.smithi112.stdout:2/464: dwrite d0/d3e/d50/d57/d5a/f87 [0,4194304] 0 2024-09-19T09:35:27.025 INFO:tasks.workunit.client.0.smithi112.stdout:2/465: creat d0/d1/d5f/d78/f93 x:0 0 0 2024-09-19T09:35:27.025 INFO:tasks.workunit.client.0.smithi112.stdout:2/466: fsync d0/d1/f38 0 2024-09-19T09:35:27.027 INFO:tasks.workunit.client.0.smithi112.stdout:2/467: link d0/d1/d5f/d78/f91 d0/d3e/d49/f94 0 2024-09-19T09:35:27.028 INFO:tasks.workunit.client.0.smithi112.stdout:2/468: truncate d0/d1/f40 506127 0 2024-09-19T09:35:27.030 INFO:tasks.workunit.client.0.smithi112.stdout:2/469: rename d0/d1/d28/f10 to d0/d1/d28/d67/f95 0 2024-09-19T09:35:27.030 INFO:tasks.workunit.client.0.smithi112.stdout:2/470: write d0/d3e/d50/d57/d5a/d4b/f53 [1706535,106524] 0 2024-09-19T09:35:27.030 INFO:tasks.workunit.client.0.smithi112.stdout:2/471: chown d0/d1/c20 703404634 1 2024-09-19T09:35:27.030 INFO:tasks.workunit.client.0.smithi112.stdout:2/472: mkdir d0/d6/d24/d96 0 2024-09-19T09:35:27.050 INFO:tasks.workunit.client.0.smithi112.stdout:8/609: dwrite d7/db/f73 [0,4194304] 0 2024-09-19T09:35:27.050 INFO:tasks.workunit.client.0.smithi112.stdout:8/610: stat d7/ff 0 2024-09-19T09:35:27.050 INFO:tasks.workunit.client.0.smithi112.stdout:4/920: dwrite d1/f104 [0,4194304] 0 2024-09-19T09:35:27.051 INFO:tasks.workunit.client.0.smithi112.stdout:7/641: dwrite d2/d2c/d54/d18/f3e [0,4194304] 0 2024-09-19T09:35:27.051 INFO:tasks.workunit.client.0.smithi112.stdout:6/665: dwrite d8/d11/d14/d2a/f3d [0,4194304] 0 2024-09-19T09:35:27.051 INFO:tasks.workunit.client.0.smithi112.stdout:2/473: dwrite d0/d1/d28/d67/f81 [0,4194304] 0 2024-09-19T09:35:27.051 INFO:tasks.workunit.client.0.smithi112.stdout:8/611: rmdir d7/db/d21/d3b/d56/d3c/d79/d85 39 2024-09-19T09:35:27.052 INFO:tasks.workunit.client.0.smithi112.stdout:6/666: dread d8/d11/d14/d3c/d4b/d63/f38 [0,4194304] 0 2024-09-19T09:35:27.052 INFO:tasks.workunit.client.0.smithi112.stdout:6/667: stat d8/de/d18/l5d 0 2024-09-19T09:35:27.054 INFO:tasks.workunit.client.0.smithi112.stdout:4/921: symlink d1/d31/d51/d89/d8b/d11c/l139 0 2024-09-19T09:35:27.055 INFO:tasks.workunit.client.0.smithi112.stdout:2/474: dread d0/d3e/d50/d57/d5a/d56/f68 [0,4194304] 0 2024-09-19T09:35:27.058 INFO:tasks.workunit.client.0.smithi112.stdout:6/668: truncate d8/de/d66/fd0 5189255 0 2024-09-19T09:35:27.058 INFO:tasks.workunit.client.0.smithi112.stdout:6/669: chown d8/d73/f76 2 1 2024-09-19T09:35:27.059 INFO:tasks.workunit.client.0.smithi112.stdout:4/922: symlink d1/d31/d43/d48/de9/l13a 0 2024-09-19T09:35:27.059 INFO:tasks.workunit.client.0.smithi112.stdout:4/923: dread - d1/d4/d3a/d57/d60/f6d zero size 2024-09-19T09:35:27.059 INFO:tasks.workunit.client.0.smithi112.stdout:4/924: write d1/d31/d43/d48/fdb [5025375,43768] 0 2024-09-19T09:35:27.060 INFO:tasks.workunit.client.0.smithi112.stdout:2/475: link d0/d1/d28/l12 d0/d1/d28/d88/d8f/l97 0 2024-09-19T09:35:27.063 INFO:tasks.workunit.client.0.smithi112.stdout:7/642: mkdir d2/d2c/d54/d18/db4/de7 0 2024-09-19T09:35:27.065 INFO:tasks.workunit.client.0.smithi112.stdout:6/670: creat d8/de/d66/fe8 x:0 0 0 2024-09-19T09:35:27.065 INFO:tasks.workunit.client.0.smithi112.stdout:6/671: read d8/de/d61/d70/d7b/fc3 [649120,103021] 0 2024-09-19T09:35:27.066 INFO:tasks.workunit.client.0.smithi112.stdout:6/672: stat d8/f23 0 2024-09-19T09:35:27.066 INFO:tasks.workunit.client.0.smithi112.stdout:6/673: chown d8/de/d61/d70/d86 681902 1 2024-09-19T09:35:27.067 INFO:tasks.workunit.client.0.smithi112.stdout:6/674: mkdir d8/de/d61/d70/d7b/d8a/de9 0 2024-09-19T09:35:27.069 INFO:tasks.workunit.client.0.smithi112.stdout:7/643: dread d2/d99/f9b [0,4194304] 0 2024-09-19T09:35:27.069 INFO:tasks.workunit.client.0.smithi112.stdout:4/925: dread d1/d31/d42/fc4 [0,4194304] 0 2024-09-19T09:35:27.069 INFO:tasks.workunit.client.0.smithi112.stdout:8/612: dwrite d7/d10/d11/f2b [0,4194304] 0 2024-09-19T09:35:27.069 INFO:tasks.workunit.client.0.smithi112.stdout:8/613: truncate d7/db/f73 4397476 0 2024-09-19T09:35:27.078 INFO:tasks.workunit.client.0.smithi112.stdout:7/644: mkdir d2/d2c/d54/d18/d39/d21/d71/de8 0 2024-09-19T09:35:27.078 INFO:tasks.workunit.client.0.smithi112.stdout:7/645: read - d2/d2c/d54/d18/d39/d21/d45/d4d/fdd zero size 2024-09-19T09:35:27.081 INFO:tasks.workunit.client.0.smithi112.stdout:4/926: creat d1/d5f/da4/de7/f13b x:0 0 0 2024-09-19T09:35:27.083 INFO:tasks.workunit.client.0.smithi112.stdout:8/614: rmdir d7/db/d21/d2e/d8c 39 2024-09-19T09:35:27.083 INFO:tasks.workunit.client.0.smithi112.stdout:8/615: readlink d7/db/d21/d3b/l41 0 2024-09-19T09:35:27.083 INFO:tasks.workunit.client.0.smithi112.stdout:8/616: fdatasync d7/db/d21/d3b/d56/d48/fa8 0 2024-09-19T09:35:27.083 INFO:tasks.workunit.client.0.smithi112.stdout:8/617: readlink d7/l64 0 2024-09-19T09:35:27.084 INFO:tasks.workunit.client.0.smithi112.stdout:7/646: unlink d2/d2c/d54/d18/d39/c30 0 2024-09-19T09:35:27.090 INFO:tasks.workunit.client.0.smithi112.stdout:6/675: dwrite d8/f23 [0,4194304] 0 2024-09-19T09:35:27.090 INFO:tasks.workunit.client.0.smithi112.stdout:6/676: readlink d8/ld 0 2024-09-19T09:35:27.090 INFO:tasks.workunit.client.0.smithi112.stdout:6/677: write d8/de/d66/d6e/fbd [5891458,98745] 0 2024-09-19T09:35:27.092 INFO:tasks.workunit.client.0.smithi112.stdout:6/678: mknod d8/de/d18/d20/cea 0 2024-09-19T09:35:27.093 INFO:tasks.workunit.client.0.smithi112.stdout:6/679: mkdir d8/de/d17/dae/deb 0 2024-09-19T09:35:27.095 INFO:tasks.workunit.client.0.smithi112.stdout:6/680: symlink d8/dc5/de4/lec 0 2024-09-19T09:35:27.095 INFO:tasks.workunit.client.0.smithi112.stdout:6/681: rmdir d8/dc5 39 2024-09-19T09:35:27.095 INFO:tasks.workunit.client.0.smithi112.stdout:6/682: read d8/d11/d13/f56 [3928751,89561] 0 2024-09-19T09:35:27.095 INFO:tasks.workunit.client.0.smithi112.stdout:6/683: creat d8/de/fed x:0 0 0 2024-09-19T09:35:27.097 INFO:tasks.workunit.client.0.smithi112.stdout:4/927: dread d1/d3d/d72/f7b [0,4194304] 0 2024-09-19T09:35:27.098 INFO:tasks.workunit.client.0.smithi112.stdout:6/684: mknod d8/de/d17/d49/cee 0 2024-09-19T09:35:27.098 INFO:tasks.workunit.client.0.smithi112.stdout:2/476: dwrite d0/d6/f36 [0,4194304] 0 2024-09-19T09:35:27.099 INFO:tasks.workunit.client.0.smithi112.stdout:4/928: symlink d1/d5f/dc2/l13c 0 2024-09-19T09:35:27.099 INFO:tasks.workunit.client.0.smithi112.stdout:4/929: readlink d1/d31/lb6 0 2024-09-19T09:35:27.100 INFO:tasks.workunit.client.0.smithi112.stdout:6/685: creat d8/de/d66/d8f/fef x:0 0 0 2024-09-19T09:35:27.100 INFO:tasks.workunit.client.0.smithi112.stdout:6/686: stat d8/de/d17/dae/deb 0 2024-09-19T09:35:27.102 INFO:tasks.workunit.client.0.smithi112.stdout:2/477: rename d0/l1b to d0/d3e/d61/l98 0 2024-09-19T09:35:27.102 INFO:tasks.workunit.client.0.smithi112.stdout:2/478: readlink d0/d3e/d50/d57/d80/l86 0 2024-09-19T09:35:27.103 INFO:tasks.workunit.client.0.smithi112.stdout:2/479: creat d0/d4a/f99 x:0 0 0 2024-09-19T09:35:27.103 INFO:tasks.workunit.client.0.smithi112.stdout:4/930: truncate d1/d4/f7 1613385 0 2024-09-19T09:35:27.104 INFO:tasks.workunit.client.0.smithi112.stdout:6/687: mknod d8/d11/d14/d3c/dd5/cf0 0 2024-09-19T09:35:27.104 INFO:tasks.workunit.client.0.smithi112.stdout:6/688: read d8/d11/d13/f98 [403375,102752] 0 2024-09-19T09:35:27.107 INFO:tasks.workunit.client.0.smithi112.stdout:2/480: unlink d0/d3e/d50/d57/d5a/d27/f30 0 2024-09-19T09:35:27.107 INFO:tasks.workunit.client.0.smithi112.stdout:2/481: truncate d0/d3e/f66 1039961 0 2024-09-19T09:35:27.108 INFO:tasks.workunit.client.0.smithi112.stdout:4/931: unlink d1/d3d/d41/f69 0 2024-09-19T09:35:27.108 INFO:tasks.workunit.client.0.smithi112.stdout:4/932: write d1/ff7 [1474639,23678] 0 2024-09-19T09:35:27.109 INFO:tasks.workunit.client.0.smithi112.stdout:6/689: mknod d8/de/d18/d20/d83/cf1 0 2024-09-19T09:35:27.109 INFO:tasks.workunit.client.0.smithi112.stdout:6/690: chown d8/de/d66/d6e/f92 14 1 2024-09-19T09:35:27.109 INFO:tasks.workunit.client.0.smithi112.stdout:6/691: write d8/de/d61/d70/d86/f9d [81074,82110] 0 2024-09-19T09:35:27.109 INFO:tasks.workunit.client.0.smithi112.stdout:6/692: fdatasync d8/de/d61/d70/fb1 0 2024-09-19T09:35:27.109 INFO:tasks.workunit.client.0.smithi112.stdout:2/482: mkdir d0/d3e/d50/d57/d5a/d4b/d9a 0 2024-09-19T09:35:27.111 INFO:tasks.workunit.client.0.smithi112.stdout:6/693: rename d8/de/d17/f31 to d8/d11/d14/d3c/dc0/ff2 0 2024-09-19T09:35:27.112 INFO:tasks.workunit.client.0.smithi112.stdout:8/618: dwrite d7/db/fa2 [0,4194304] 0 2024-09-19T09:35:27.114 INFO:tasks.workunit.client.0.smithi112.stdout:7/647: dwrite d2/d2c/d54/d18/d39/d21/fc1 [0,4194304] 0 2024-09-19T09:35:27.114 INFO:tasks.workunit.client.0.smithi112.stdout:7/648: chown d2/d2c/d54/d18/d39/d21/d45/d4d/dbe 1010230135 1 2024-09-19T09:35:27.117 INFO:tasks.workunit.client.0.smithi112.stdout:6/694: symlink d8/de/d61/lf3 0 2024-09-19T09:35:27.117 INFO:tasks.workunit.client.0.smithi112.stdout:6/695: creat d8/de/d18/ff4 x:0 0 0 2024-09-19T09:35:27.125 INFO:tasks.workunit.client.0.smithi112.stdout:6/696: mknod d8/de/d66/d8f/dce/cf5 0 2024-09-19T09:35:27.126 INFO:tasks.workunit.client.0.smithi112.stdout:6/697: creat d8/de/d61/dbf/dc8/ff6 x:0 0 0 2024-09-19T09:35:27.126 INFO:tasks.workunit.client.0.smithi112.stdout:6/698: fsync d8/de/d18/f55 0 2024-09-19T09:35:27.127 INFO:tasks.workunit.client.0.smithi112.stdout:8/619: write d7/db/fa2 [2342084,58601] 0 2024-09-19T09:35:27.135 INFO:tasks.workunit.client.0.smithi112.stdout:6/699: link d8/d73/c75 d8/de/d61/d70/d7b/cf7 0 2024-09-19T09:35:27.135 INFO:tasks.workunit.client.0.smithi112.stdout:4/933: dwrite d1/d5f/da4/de8/f125 [0,4194304] 0 2024-09-19T09:35:27.136 INFO:tasks.workunit.client.0.smithi112.stdout:4/934: chown d1/d31/d42/fc4 165377 1 2024-09-19T09:35:27.136 INFO:tasks.workunit.client.0.smithi112.stdout:4/935: stat d1/d31/d43/fdf 0 2024-09-19T09:35:27.136 INFO:tasks.workunit.client.0.smithi112.stdout:2/483: dwrite d0/d3e/d50/f71 [0,4194304] 0 2024-09-19T09:35:27.136 INFO:tasks.workunit.client.0.smithi112.stdout:2/484: write d0/d1/d5f/d78/f93 [597402,114304] 0 2024-09-19T09:35:27.137 INFO:tasks.workunit.client.0.smithi112.stdout:6/700: rmdir d8/de/d17/d94 39 2024-09-19T09:35:27.137 INFO:tasks.workunit.client.0.smithi112.stdout:6/701: chown d8/de/d61/d70/fb6 376173379 1 2024-09-19T09:35:27.141 INFO:tasks.workunit.client.0.smithi112.stdout:2/485: fsync d0/d1/d5f/d78/f93 0 2024-09-19T09:35:27.143 INFO:tasks.workunit.client.0.smithi112.stdout:8/620: write d7/db/d21/d3b/d56/d4b/f71 [1580329,16942] 0 2024-09-19T09:35:27.143 INFO:tasks.workunit.client.0.smithi112.stdout:8/621: truncate d7/d67/f5d 5032675 0 2024-09-19T09:35:27.146 INFO:tasks.workunit.client.0.smithi112.stdout:2/486: unlink d0/d1/f7 0 2024-09-19T09:35:27.152 INFO:tasks.workunit.client.0.smithi112.stdout:8/622: mkdir d7/d67/d92/db8 0 2024-09-19T09:35:27.153 INFO:tasks.workunit.client.0.smithi112.stdout:8/623: dread - d7/db/d21/d3b/d56/d3c/fae zero size 2024-09-19T09:35:27.153 INFO:tasks.workunit.client.0.smithi112.stdout:8/624: fsync d7/d10/d11/d50/f82 0 2024-09-19T09:35:27.153 INFO:tasks.workunit.client.0.smithi112.stdout:4/936: write d1/d31/d43/d48/f63 [184732,470] 0 2024-09-19T09:35:27.153 INFO:tasks.workunit.client.0.smithi112.stdout:2/487: mkdir d0/d1/d28/d9b 0 2024-09-19T09:35:27.156 INFO:tasks.workunit.client.0.smithi112.stdout:8/625: unlink d7/db/d21/d3b/d56/d3c/fae 0 2024-09-19T09:35:27.156 INFO:tasks.workunit.client.0.smithi112.stdout:8/626: write d7/d10/d11/d33/f27 [969172,7287] 0 2024-09-19T09:35:27.157 INFO:tasks.workunit.client.0.smithi112.stdout:6/702: dwrite d8/d11/d14/d2a/fb9 [0,4194304] 0 2024-09-19T09:35:27.159 INFO:tasks.workunit.client.0.smithi112.stdout:4/937: creat d1/d31/d43/d48/de9/f13d x:0 0 0 2024-09-19T09:35:27.159 INFO:tasks.workunit.client.0.smithi112.stdout:4/938: creat d1/d31/d96/f13e x:0 0 0 2024-09-19T09:35:27.164 INFO:tasks.workunit.client.0.smithi112.stdout:8/627: truncate d7/db/d21/d3b/d56/d3c/d79/fb2 58084 0 2024-09-19T09:35:27.169 INFO:tasks.workunit.client.0.smithi112.stdout:6/703: dread d8/de/d61/dbf/dc8/fd2 [0,4194304] 0 2024-09-19T09:35:27.177 INFO:tasks.workunit.client.0.smithi112.stdout:4/939: creat d1/d31/d43/d48/d118/d12d/f13f x:0 0 0 2024-09-19T09:35:27.177 INFO:tasks.workunit.client.0.smithi112.stdout:4/940: fsync d1/d4/d3a/d57/d62/fac 0 2024-09-19T09:35:27.179 INFO:tasks.workunit.client.0.smithi112.stdout:8/628: rename d7/d10/d11/d55/d9e/la6 to d7/db/d21/d3b/d56/d48/lb9 0 2024-09-19T09:35:27.180 INFO:tasks.workunit.client.0.smithi112.stdout:6/704: mknod d8/de/d66/d6e/cf8 0 2024-09-19T09:35:27.182 INFO:tasks.workunit.client.0.smithi112.stdout:2/488: symlink d0/d3e/d50/l9c 0 2024-09-19T09:35:27.183 INFO:tasks.workunit.client.0.smithi112.stdout:4/941: mkdir d1/d3d/d72/dd6/d140 0 2024-09-19T09:35:27.185 INFO:tasks.workunit.client.0.smithi112.stdout:8/629: creat d7/db/d21/d2e/d8c/d97/fba x:0 0 0 2024-09-19T09:35:27.186 INFO:tasks.workunit.client.0.smithi112.stdout:6/705: creat d8/de/d61/d70/d7b/ff9 x:0 0 0 2024-09-19T09:35:27.186 INFO:tasks.workunit.client.0.smithi112.stdout:2/489: fdatasync d0/d3e/d50/f6a 0 2024-09-19T09:35:27.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:26 smithi112 ceph-mon[27605]: pgmap v25: 65 pgs: 65 active+clean; 1.6 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 95 MiB/s rd, 105 MiB/s wr, 249 op/s 2024-09-19T09:35:27.195 INFO:tasks.workunit.client.0.smithi112.stdout:1/441: sync 2024-09-19T09:35:27.195 INFO:tasks.workunit.client.0.smithi112.stdout:1/442: creat dc/d26/d34/d4c/f89 x:0 0 0 2024-09-19T09:35:27.195 INFO:tasks.workunit.client.0.smithi112.stdout:8/630: mkdir d7/d65/dbb 0 2024-09-19T09:35:27.196 INFO:tasks.workunit.client.0.smithi112.stdout:6/706: mkdir d8/de/d61/dfa 0 2024-09-19T09:35:27.197 INFO:tasks.workunit.client.0.smithi112.stdout:2/490: readlink d0/d3e/d50/d57/d5a/l7a 0 2024-09-19T09:35:27.197 INFO:tasks.workunit.client.0.smithi112.stdout:2/491: chown d0/d3e/d50 427809053 1 2024-09-19T09:35:27.197 INFO:tasks.workunit.client.0.smithi112.stdout:2/492: readlink d0/d3e/d61/l98 0 2024-09-19T09:35:27.200 INFO:tasks.workunit.client.0.smithi112.stdout:1/443: mknod dc/d59/d73/c8a 0 2024-09-19T09:35:27.202 INFO:tasks.workunit.client.0.smithi112.stdout:6/707: symlink d8/d11/d14/d3c/lfb 0 2024-09-19T09:35:27.203 INFO:tasks.workunit.client.0.smithi112.stdout:2/493: symlink d0/d1/d5f/d78/l9d 0 2024-09-19T09:35:27.204 INFO:tasks.workunit.client.0.smithi112.stdout:4/942: dwrite d1/fb9 [0,4194304] 0 2024-09-19T09:35:27.206 INFO:tasks.workunit.client.0.smithi112.stdout:1/444: mknod dc/c8b 0 2024-09-19T09:35:27.210 INFO:tasks.workunit.client.0.smithi112.stdout:8/631: dread d7/db/d21/d2e/f5e [4194304,4194304] 0 2024-09-19T09:35:27.210 INFO:tasks.workunit.client.0.smithi112.stdout:8/632: write d7/db/d21/d3b/d56/d3c/f94 [2532111,112611] 0 2024-09-19T09:35:27.212 INFO:tasks.workunit.client.0.smithi112.stdout:4/943: dread d1/d31/d42/faf [0,4194304] 0 2024-09-19T09:35:27.212 INFO:tasks.workunit.client.0.smithi112.stdout:8/633: rename d7/db/d21/d3b/d56/d3c/d79/d85/cb3 to d7/db/d21/d3b/d56/d48/cbc 0 2024-09-19T09:35:27.215 INFO:tasks.workunit.client.0.smithi112.stdout:4/944: mknod d1/d31/d42/c141 0 2024-09-19T09:35:27.215 INFO:tasks.workunit.client.0.smithi112.stdout:4/945: stat d1/d3d/d72/dd6/ffa 0 2024-09-19T09:35:27.219 INFO:tasks.workunit.client.0.smithi112.stdout:4/946: rename d1/d3d/d72/fb2 to d1/f142 0 2024-09-19T09:35:27.243 INFO:tasks.workunit.client.0.smithi112.stdout:2/494: dwrite d0/d1/f40 [0,4194304] 0 2024-09-19T09:35:27.243 INFO:tasks.workunit.client.0.smithi112.stdout:2/495: fdatasync d0/d3e/d50/d57/d5a/f11 0 2024-09-19T09:35:27.243 INFO:tasks.workunit.client.0.smithi112.stdout:2/496: truncate d0/d4a/f5e 310462 0 2024-09-19T09:35:27.255 INFO:tasks.workunit.client.0.smithi112.stdout:6/708: dwrite d8/f10 [0,4194304] 0 2024-09-19T09:35:27.256 INFO:tasks.workunit.client.0.smithi112.stdout:8/634: dwrite d7/db/d21/d3b/d56/d3c/d79/fb2 [0,4194304] 0 2024-09-19T09:35:27.256 INFO:tasks.workunit.client.0.smithi112.stdout:8/635: chown d7/db/l38 95942 1 2024-09-19T09:35:27.259 INFO:tasks.workunit.client.0.smithi112.stdout:1/445: dwrite dc/d24/f12 [4194304,4194304] 0 2024-09-19T09:35:27.259 INFO:tasks.workunit.client.0.smithi112.stdout:1/446: write dc/d24/f46 [625882,110471] 0 2024-09-19T09:35:27.259 INFO:tasks.workunit.client.0.smithi112.stdout:4/947: dwrite d1/d4/d3a/d57/d60/fc5 [0,4194304] 0 2024-09-19T09:35:27.261 INFO:tasks.workunit.client.0.smithi112.stdout:1/447: mknod dc/d24/d45/c8c 0 2024-09-19T09:35:27.262 INFO:tasks.workunit.client.0.smithi112.stdout:2/497: dwrite d0/d3e/d50/d57/d5a/d56/f68 [0,4194304] 0 2024-09-19T09:35:27.262 INFO:tasks.workunit.client.0.smithi112.stdout:2/498: chown d0/d1/f6f 3030967 1 2024-09-19T09:35:27.262 INFO:tasks.workunit.client.0.smithi112.stdout:2/499: write d0/d3e/d50/d57/d5a/d27/f34 [992451,122850] 0 2024-09-19T09:35:27.263 INFO:tasks.workunit.client.0.smithi112.stdout:1/448: creat dc/d26/d34/d36/d68/d7d/f8d x:0 0 0 2024-09-19T09:35:27.263 INFO:tasks.workunit.client.0.smithi112.stdout:1/449: readlink dc/d24/d45/l67 0 2024-09-19T09:35:27.263 INFO:tasks.workunit.client.0.smithi112.stdout:1/450: dread - dc/d13/f51 zero size 2024-09-19T09:35:27.263 INFO:tasks.workunit.client.0.smithi112.stdout:1/451: chown dc/d26/d44/l47 124 1 2024-09-19T09:35:27.273 INFO:tasks.workunit.client.0.smithi112.stdout:1/452: dread dc/d13/f25 [0,4194304] 0 2024-09-19T09:35:27.273 INFO:tasks.workunit.client.0.smithi112.stdout:4/948: dread d1/d3d/f44 [0,4194304] 0 2024-09-19T09:35:27.273 INFO:tasks.workunit.client.0.smithi112.stdout:4/949: dread - d1/d4/d3a/d7a/fbb zero size 2024-09-19T09:35:27.273 INFO:tasks.workunit.client.0.smithi112.stdout:4/950: chown d1/d31/d43/d48/d118/d12d/c12f 340 1 2024-09-19T09:35:27.274 INFO:tasks.workunit.client.0.smithi112.stdout:1/453: mknod dc/d59/d73/d88/c8e 0 2024-09-19T09:35:27.275 INFO:tasks.workunit.client.0.smithi112.stdout:1/454: readlink dc/d26/d34/l31 0 2024-09-19T09:35:27.275 INFO:tasks.workunit.client.0.smithi112.stdout:1/455: chown dc/d26/d34/d4c/d64/c6c 7682887 1 2024-09-19T09:35:27.276 INFO:tasks.workunit.client.0.smithi112.stdout:6/709: dwrite d8/d11/d14/f3e [0,4194304] 0 2024-09-19T09:35:27.277 INFO:tasks.workunit.client.0.smithi112.stdout:4/951: mknod d1/d5f/c143 0 2024-09-19T09:35:27.277 INFO:tasks.workunit.client.0.smithi112.stdout:2/500: write d0/d3e/d50/f6a [591088,20083] 0 2024-09-19T09:35:27.280 INFO:tasks.workunit.client.0.smithi112.stdout:1/456: symlink dc/d26/d34/d6f/l8f 0 2024-09-19T09:35:27.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:26 smithi191 ceph-mon[34834]: pgmap v25: 65 pgs: 65 active+clean; 1.6 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 95 MiB/s rd, 105 MiB/s wr, 249 op/s 2024-09-19T09:35:27.284 INFO:tasks.workunit.client.0.smithi112.stdout:2/501: mknod d0/d3e/d50/d57/d5a/d4f/d72/c9e 0 2024-09-19T09:35:27.286 INFO:tasks.workunit.client.0.smithi112.stdout:1/457: mknod dc/d26/c90 0 2024-09-19T09:35:27.294 INFO:tasks.workunit.client.0.smithi112.stdout:2/502: rename d0/d6/d24/l76 to d0/d3e/d50/l9f 0 2024-09-19T09:35:27.298 INFO:tasks.workunit.client.0.smithi112.stdout:4/952: dwrite d1/d3d/d41/f4f [0,4194304] 0 2024-09-19T09:35:27.298 INFO:tasks.workunit.client.0.smithi112.stdout:4/953: chown d1/d4/d3a/d57/d60/db3/fc3 847521083 1 2024-09-19T09:35:27.299 INFO:tasks.workunit.client.0.smithi112.stdout:2/503: creat d0/d3e/d50/d57/fa0 x:0 0 0 2024-09-19T09:35:27.303 INFO:tasks.workunit.client.0.smithi112.stdout:2/504: unlink d0/d1/fd 0 2024-09-19T09:35:27.303 INFO:tasks.workunit.client.0.smithi112.stdout:2/505: truncate d0/d3e/d50/d57/d5a/d27/f73 874040 0 2024-09-19T09:35:27.303 INFO:tasks.workunit.client.0.smithi112.stdout:2/506: creat d0/d1/d8a/fa1 x:0 0 0 2024-09-19T09:35:27.303 INFO:tasks.workunit.client.0.smithi112.stdout:2/507: chown d0/d3e/d50/d57/d5a/d27/f89 100106452 1 2024-09-19T09:35:27.309 INFO:tasks.workunit.client.0.smithi112.stdout:2/508: creat d0/d6/fa2 x:0 0 0 2024-09-19T09:35:27.321 INFO:tasks.workunit.client.0.smithi112.stdout:4/954: dwrite d1/d4/fba [0,4194304] 0 2024-09-19T09:35:27.321 INFO:tasks.workunit.client.0.smithi112.stdout:4/955: chown d1/d31/d43/d48/f137 0 1 2024-09-19T09:35:27.326 INFO:tasks.workunit.client.0.smithi112.stdout:4/956: creat d1/d31/f144 x:0 0 0 2024-09-19T09:35:27.326 INFO:tasks.workunit.client.0.smithi112.stdout:4/957: read - d1/d4/d3a/d7a/fbb zero size 2024-09-19T09:35:27.330 INFO:tasks.workunit.client.0.smithi112.stdout:2/509: dwrite d0/d6/fa2 [0,4194304] 0 2024-09-19T09:35:27.331 INFO:tasks.workunit.client.0.smithi112.stdout:2/510: chown d0/d1/d28/l8d 5 1 2024-09-19T09:35:27.337 INFO:tasks.workunit.client.0.smithi112.stdout:2/511: mkdir d0/d1/d28/d88/da3 0 2024-09-19T09:35:27.337 INFO:tasks.workunit.client.0.smithi112.stdout:2/512: creat d0/d1/d5f/d78/fa4 x:0 0 0 2024-09-19T09:35:27.344 INFO:tasks.workunit.client.0.smithi112.stdout:1/458: fsync dc/d26/d34/d36/d68/d7d/f8d 0 2024-09-19T09:35:27.345 INFO:tasks.workunit.client.0.smithi112.stdout:4/958: dwrite d1/d3d/d72/fd7 [0,4194304] 0 2024-09-19T09:35:27.345 INFO:tasks.workunit.client.0.smithi112.stdout:4/959: dread - d1/d4/d3a/d57/d60/db3/f109 zero size 2024-09-19T09:35:27.345 INFO:tasks.workunit.client.0.smithi112.stdout:1/459: truncate dc/d26/d34/d4c/f66 165233 0 2024-09-19T09:35:27.347 INFO:tasks.workunit.client.0.smithi112.stdout:4/960: mkdir d1/d31/d51/d89/d8b/d11c/d145 0 2024-09-19T09:35:27.347 INFO:tasks.workunit.client.0.smithi112.stdout:4/961: fsync d1/d4/f7 0 2024-09-19T09:35:27.348 INFO:tasks.workunit.client.0.smithi112.stdout:4/962: write d1/d3d/f68 [243455,32027] 0 2024-09-19T09:35:27.348 INFO:tasks.workunit.client.0.smithi112.stdout:4/963: fsync d1/d4/d3a/d7a/f127 0 2024-09-19T09:35:27.352 INFO:tasks.workunit.client.0.smithi112.stdout:4/964: symlink d1/d5f/da4/de7/l146 0 2024-09-19T09:35:27.352 INFO:tasks.workunit.client.0.smithi112.stdout:2/513: write d0/d6/d24/f39 [646264,44864] 0 2024-09-19T09:35:27.352 INFO:tasks.workunit.client.0.smithi112.stdout:2/514: read - d0/d1/f6f zero size 2024-09-19T09:35:27.357 INFO:tasks.workunit.client.0.smithi112.stdout:1/460: dread dc/f23 [0,4194304] 0 2024-09-19T09:35:27.361 INFO:tasks.workunit.client.0.smithi112.stdout:1/461: link dc/d24/d45/l67 dc/l91 0 2024-09-19T09:35:27.361 INFO:tasks.workunit.client.0.smithi112.stdout:1/462: creat dc/d26/d34/d36/d68/f92 x:0 0 0 2024-09-19T09:35:27.362 INFO:tasks.workunit.client.0.smithi112.stdout:4/965: write d1/f29 [3413538,43512] 0 2024-09-19T09:35:27.362 INFO:tasks.workunit.client.0.smithi112.stdout:4/966: fsync d1/d4/f7 0 2024-09-19T09:35:27.368 INFO:tasks.workunit.client.0.smithi112.stdout:2/515: dread d0/d1/f40 [0,4194304] 0 2024-09-19T09:35:27.378 INFO:tasks.workunit.client.0.smithi112.stdout:2/516: mknod d0/d3e/d49/ca5 0 2024-09-19T09:35:27.378 INFO:tasks.workunit.client.0.smithi112.stdout:2/517: readlink d0/d6/l74 0 2024-09-19T09:35:27.380 INFO:tasks.workunit.client.0.smithi112.stdout:2/518: creat d0/d1/d28/d9b/fa6 x:0 0 0 2024-09-19T09:35:27.423 INFO:tasks.workunit.client.0.smithi112.stdout:1/463: dwrite dc/d13/f1b [0,4194304] 0 2024-09-19T09:35:27.423 INFO:tasks.workunit.client.0.smithi112.stdout:1/464: fsync dc/d13/f18 0 2024-09-19T09:35:27.424 INFO:tasks.workunit.client.0.smithi112.stdout:2/519: write d0/d1/d28/d67/f77 [1161556,48462] 0 2024-09-19T09:35:27.424 INFO:tasks.workunit.client.0.smithi112.stdout:4/967: dwrite d1/d4/d3a/d57/f12e [0,4194304] 0 2024-09-19T09:35:27.425 INFO:tasks.workunit.client.0.smithi112.stdout:4/968: read d1/f2c [1160211,30324] 0 2024-09-19T09:35:27.426 INFO:tasks.workunit.client.0.smithi112.stdout:4/969: chown d1/ff7 13536 1 2024-09-19T09:35:27.426 INFO:tasks.workunit.client.0.smithi112.stdout:4/970: write d1/d4/d3a/f22 [474954,21252] 0 2024-09-19T09:35:27.426 INFO:tasks.workunit.client.0.smithi112.stdout:4/971: stat d1/d5f/dc2 0 2024-09-19T09:35:27.430 INFO:tasks.workunit.client.0.smithi112.stdout:2/520: mknod d0/d3e/d50/d57/d5a/d56/ca7 0 2024-09-19T09:35:27.430 INFO:tasks.workunit.client.0.smithi112.stdout:2/521: write d0/d1/f38 [310883,92551] 0 2024-09-19T09:35:27.431 INFO:tasks.workunit.client.0.smithi112.stdout:4/972: truncate d1/d4/d3a/d7a/d7f/f3c 7151487 0 2024-09-19T09:35:27.432 INFO:tasks.workunit.client.0.smithi112.stdout:1/465: getdents dc/d59 0 2024-09-19T09:35:27.433 INFO:tasks.workunit.client.0.smithi112.stdout:2/522: getdents d0/d1/d28/d88/d8f 0 2024-09-19T09:35:27.434 INFO:tasks.workunit.client.0.smithi112.stdout:1/466: creat dc/d26/f93 x:0 0 0 2024-09-19T09:35:27.435 INFO:tasks.workunit.client.0.smithi112.stdout:2/523: dread - d0/d3e/d50/f64 zero size 2024-09-19T09:35:27.437 INFO:tasks.workunit.client.0.smithi112.stdout:4/973: dread d1/d31/d42/fc4 [0,4194304] 0 2024-09-19T09:35:27.437 INFO:tasks.workunit.client.0.smithi112.stdout:4/974: creat d1/d4/d3a/d7a/f147 x:0 0 0 2024-09-19T09:35:27.438 INFO:tasks.workunit.client.0.smithi112.stdout:2/524: mkdir d0/d1/da8 0 2024-09-19T09:35:27.438 INFO:tasks.workunit.client.0.smithi112.stdout:2/525: stat d0/d6/d24/c33 0 2024-09-19T09:35:27.448 INFO:tasks.workunit.client.0.smithi112.stdout:2/526: rename d0/d3e/d50/d57/d5a/l2f to d0/d3e/d50/la9 0 2024-09-19T09:35:27.448 INFO:tasks.workunit.client.0.smithi112.stdout:2/527: chown d0/d1/d28/l18 383748365 1 2024-09-19T09:35:27.449 INFO:tasks.workunit.client.0.smithi112.stdout:2/528: link d0/d6/fc d0/d3e/d50/d57/d80/faa 0 2024-09-19T09:35:27.451 INFO:tasks.workunit.client.0.smithi112.stdout:2/529: creat d0/d3e/fab x:0 0 0 2024-09-19T09:35:27.452 INFO:tasks.workunit.client.0.smithi112.stdout:2/530: rename d0/d3e/d50/d57/d5a/d4f/d72 to d0/d3e/d50/d57/dac 0 2024-09-19T09:35:27.465 INFO:tasks.workunit.client.0.smithi112.stdout:2/531: write d0/d3e/d50/d57/d80/faa [2135699,20499] 0 2024-09-19T09:35:27.465 INFO:tasks.workunit.client.0.smithi112.stdout:2/532: fdatasync d0/d3e/d50/d57/fa0 0 2024-09-19T09:35:27.466 INFO:tasks.workunit.client.0.smithi112.stdout:1/467: dwrite f6 [0,4194304] 0 2024-09-19T09:35:27.467 INFO:tasks.workunit.client.0.smithi112.stdout:4/975: dwrite d1/f46 [0,4194304] 0 2024-09-19T09:35:27.472 INFO:tasks.workunit.client.0.smithi112.stdout:4/976: mkdir d1/d4/d3a/d148 0 2024-09-19T09:35:27.474 INFO:tasks.workunit.client.0.smithi112.stdout:4/977: creat d1/d5f/da4/db1/f149 x:0 0 0 2024-09-19T09:35:27.475 INFO:tasks.workunit.client.0.smithi112.stdout:2/533: write d0/d6/fa2 [1730559,24510] 0 2024-09-19T09:35:27.477 INFO:tasks.workunit.client.0.smithi112.stdout:1/468: dread dc/d26/d34/d36/d68/d7d/f7b [0,4194304] 0 2024-09-19T09:35:27.477 INFO:tasks.workunit.client.0.smithi112.stdout:1/469: stat dc/d26/d34/d4c/c81 0 2024-09-19T09:35:27.479 INFO:tasks.workunit.client.0.smithi112.stdout:2/534: getdents d0/d4a 0 2024-09-19T09:35:27.481 INFO:tasks.workunit.client.0.smithi112.stdout:1/470: rmdir dc/d59/d73 39 2024-09-19T09:35:27.486 INFO:tasks.workunit.client.0.smithi112.stdout:4/978: dread d1/d31/d43/d48/fdb [0,4194304] 0 2024-09-19T09:35:27.488 INFO:tasks.workunit.client.0.smithi112.stdout:4/979: creat d1/d4/d3a/d7a/d7f/da8/f14a x:0 0 0 2024-09-19T09:35:27.635 INFO:tasks.workunit.client.0.smithi112.stdout:2/535: dwrite d0/d1/f3d [0,4194304] 0 2024-09-19T09:35:27.635 INFO:tasks.workunit.client.0.smithi112.stdout:2/536: dread - d0/d3e/fab zero size 2024-09-19T09:35:27.635 INFO:tasks.workunit.client.0.smithi112.stdout:2/537: fdatasync d0/d4a/f7d 0 2024-09-19T09:35:27.635 INFO:tasks.workunit.client.0.smithi112.stdout:4/980: dwrite d1/d31/d42/f64 [0,4194304] 0 2024-09-19T09:35:27.635 INFO:tasks.workunit.client.0.smithi112.stdout:4/981: truncate d1/d4/d3a/d57/fce 638665 0 2024-09-19T09:35:27.635 INFO:tasks.workunit.client.0.smithi112.stdout:1/471: dwrite dc/d26/d34/d4c/d55/f56 [0,4194304] 0 2024-09-19T09:35:27.662 INFO:tasks.workunit.client.0.smithi112.stdout:2/538: dwrite d0/d3e/d50/d57/d5a/d4b/f65 [0,4194304] 0 2024-09-19T09:35:27.662 INFO:tasks.workunit.client.0.smithi112.stdout:2/539: getdents d0/d3e/d50/d57/d5a/d4b/d9a 0 2024-09-19T09:35:27.662 INFO:tasks.workunit.client.0.smithi112.stdout:2/540: dread - d0/d3e/d50/f64 zero size 2024-09-19T09:35:27.662 INFO:tasks.workunit.client.0.smithi112.stdout:2/541: stat d0/d6/c84 0 2024-09-19T09:35:27.662 INFO:tasks.workunit.client.0.smithi112.stdout:2/542: fsync d0/d4a/f7d 0 2024-09-19T09:35:27.662 INFO:tasks.workunit.client.0.smithi112.stdout:1/472: dwrite dc/d26/d34/d4c/f54 [0,4194304] 0 2024-09-19T09:35:27.662 INFO:tasks.workunit.client.0.smithi112.stdout:4/982: dwrite d1/d4/d3a/f22 [0,4194304] 0 2024-09-19T09:35:27.664 INFO:tasks.workunit.client.0.smithi112.stdout:2/543: truncate d0/d6/d24/f39 3795121 0 2024-09-19T09:35:27.667 INFO:tasks.workunit.client.0.smithi112.stdout:1/473: unlink f6 0 2024-09-19T09:35:27.667 INFO:tasks.workunit.client.0.smithi112.stdout:1/474: fsync dc/d26/f29 0 2024-09-19T09:35:27.669 INFO:tasks.workunit.client.0.smithi112.stdout:4/983: symlink d1/d31/d51/d89/l14b 0 2024-09-19T09:35:27.672 INFO:tasks.workunit.client.0.smithi112.stdout:1/475: mkdir dc/d24/d45/d94 0 2024-09-19T09:35:27.674 INFO:tasks.workunit.client.0.smithi112.stdout:4/984: truncate d1/d4/d3a/d7a/d7f/f3c 4637129 0 2024-09-19T09:35:27.675 INFO:tasks.workunit.client.0.smithi112.stdout:4/985: read d1/d3d/d72/dd6/ff3 [887568,97652] 0 2024-09-19T09:35:27.675 INFO:tasks.workunit.client.0.smithi112.stdout:4/986: stat d1/d31/d43/d48/f63 0 2024-09-19T09:35:27.675 INFO:tasks.workunit.client.0.smithi112.stdout:4/987: chown d1/d31/d96/d9e/f11b 751194449 1 2024-09-19T09:35:27.677 INFO:tasks.workunit.client.0.smithi112.stdout:2/544: dread d0/d3e/d50/d57/d5a/d27/f2a [0,4194304] 0 2024-09-19T09:35:27.677 INFO:tasks.workunit.client.0.smithi112.stdout:2/545: fdatasync d0/d1/d28/f43 0 2024-09-19T09:35:27.679 INFO:tasks.workunit.client.0.smithi112.stdout:2/546: unlink d0/d4a/l5c 0 2024-09-19T09:35:27.681 INFO:tasks.workunit.client.0.smithi112.stdout:2/547: creat d0/d3e/d49/fad x:0 0 0 2024-09-19T09:35:27.683 INFO:tasks.workunit.client.0.smithi112.stdout:1/476: dread dc/d24/f40 [0,4194304] 0 2024-09-19T09:35:27.685 INFO:tasks.workunit.client.0.smithi112.stdout:2/548: dread d0/d3e/d50/d57/d5a/d4b/f53 [0,4194304] 0 2024-09-19T09:35:27.685 INFO:tasks.workunit.client.0.smithi112.stdout:2/549: dread - d0/d3e/d50/d57/d5a/d27/f89 zero size 2024-09-19T09:35:27.685 INFO:tasks.workunit.client.0.smithi112.stdout:1/477: link dc/d59/d73/c8a dc/d24/c95 0 2024-09-19T09:35:27.699 INFO:tasks.workunit.client.0.smithi112.stdout:1/478: write f8 [3693218,108114] 0 2024-09-19T09:35:27.700 INFO:tasks.workunit.client.0.smithi112.stdout:1/479: write dc/d24/f52 [137444,12999] 0 2024-09-19T09:35:27.710 INFO:tasks.workunit.client.0.smithi112.stdout:2/550: dwrite d0/d3e/d50/d57/d5a/f87 [0,4194304] 0 2024-09-19T09:35:27.710 INFO:tasks.workunit.client.0.smithi112.stdout:2/551: chown d0/d1/d28 1432 1 2024-09-19T09:35:27.713 INFO:tasks.workunit.client.0.smithi112.stdout:2/552: mkdir d0/d3e/d50/d57/d5a/d4b/d9a/dae 0 2024-09-19T09:35:27.716 INFO:tasks.workunit.client.0.smithi112.stdout:2/553: rename d0/d1/d5f/d78/l9d to d0/d6/laf 0 2024-09-19T09:35:27.716 INFO:tasks.workunit.client.0.smithi112.stdout:2/554: truncate d0/d1/f38 563440 0 2024-09-19T09:35:27.717 INFO:tasks.workunit.client.0.smithi112.stdout:1/480: dwrite dc/d13/f51 [0,4194304] 0 2024-09-19T09:35:27.738 INFO:tasks.workunit.client.0.smithi112.stdout:1/481: dwrite dc/d26/f5f [0,4194304] 0 2024-09-19T09:35:27.761 INFO:tasks.workunit.client.0.smithi112.stdout:9/426: sync 2024-09-19T09:35:27.761 INFO:tasks.workunit.client.0.smithi112.stdout:9/427: write df/d11/d14/d19/d40/d5c/d6b/d6c/f80 [451103,97179] 0 2024-09-19T09:35:27.761 INFO:tasks.workunit.client.0.smithi112.stdout:9/428: write df/d11/d14/d19/d28/f57 [131155,104093] 0 2024-09-19T09:35:27.762 INFO:tasks.workunit.client.0.smithi112.stdout:9/429: stat df/l8c 0 2024-09-19T09:35:27.762 INFO:tasks.workunit.client.0.smithi112.stdout:9/430: read df/d11/f5b [1736031,53569] 0 2024-09-19T09:35:27.781 INFO:tasks.workunit.client.0.smithi112.stdout:2/555: rename d0/d3e/d50/d57/d5a/d4b to d0/d1/d5f/d78/db0 0 2024-09-19T09:35:27.781 INFO:tasks.workunit.client.0.smithi112.stdout:2/556: chown d0/d6/d24/l3f 3253 1 2024-09-19T09:35:27.781 INFO:tasks.workunit.client.0.smithi112.stdout:2/557: truncate d0/d3e/d61/f63 4523346 0 2024-09-19T09:35:27.788 INFO:tasks.workunit.client.0.smithi112.stdout:1/482: mknod dc/d26/d34/d36/d68/d7d/c96 0 2024-09-19T09:35:27.790 INFO:tasks.workunit.client.0.smithi112.stdout:9/431: creat df/d11/d14/d19/d40/d5c/f96 x:0 0 0 2024-09-19T09:35:27.795 INFO:tasks.workunit.client.0.smithi112.stdout:1/483: dread dc/fe [0,4194304] 0 2024-09-19T09:35:27.798 INFO:tasks.workunit.client.0.smithi112.stdout:2/558: dwrite d0/d1/d28/d67/f95 [0,4194304] 0 2024-09-19T09:35:27.799 INFO:tasks.workunit.client.0.smithi112.stdout:1/484: rename dc/d26/d34/d4c/d55/f56 to dc/d26/d34/f97 0 2024-09-19T09:35:27.799 INFO:tasks.workunit.client.0.smithi112.stdout:1/485: truncate dc/d26/d44/d63/f7f 402696 0 2024-09-19T09:35:27.800 INFO:tasks.workunit.client.0.smithi112.stdout:9/432: mkdir df/d11/d14/d19/d1e/d97 0 2024-09-19T09:35:27.803 INFO:tasks.workunit.client.0.smithi112.stdout:2/559: link d0/d4a/f5e d0/fb1 0 2024-09-19T09:35:27.804 INFO:tasks.workunit.client.0.smithi112.stdout:1/486: link dc/f23 dc/d59/d73/f98 0 2024-09-19T09:35:27.806 INFO:tasks.workunit.client.0.smithi112.stdout:9/433: stat df/d11/c58 0 2024-09-19T09:35:27.806 INFO:tasks.workunit.client.0.smithi112.stdout:9/434: write df/d11/d14/d19/d40/d5c/d6b/f6f [265035,125753] 0 2024-09-19T09:35:27.808 INFO:tasks.workunit.client.0.smithi112.stdout:2/560: creat d0/d3e/d49/fb2 x:0 0 0 2024-09-19T09:35:27.811 INFO:tasks.workunit.client.0.smithi112.stdout:9/435: mknod df/d11/d14/d19/d28/c98 0 2024-09-19T09:35:27.811 INFO:tasks.workunit.client.0.smithi112.stdout:9/436: getdents df/d11/d14/d51/d8b 0 2024-09-19T09:35:27.812 INFO:tasks.workunit.client.0.smithi112.stdout:1/487: read dc/d26/f5f [1717430,67018] 0 2024-09-19T09:35:27.812 INFO:tasks.workunit.client.0.smithi112.stdout:1/488: chown f1 1070633939 1 2024-09-19T09:35:27.813 INFO:tasks.workunit.client.0.smithi112.stdout:9/437: mkdir df/d11/d14/d19/d66/d99 0 2024-09-19T09:35:27.819 INFO:tasks.workunit.client.0.smithi112.stdout:9/438: rename df/d11/d14/d19/d1e/c31 to df/d11/d14/d19/d1e/c9a 0 2024-09-19T09:35:27.819 INFO:tasks.workunit.client.0.smithi112.stdout:9/439: chown df/l8c 40 1 2024-09-19T09:35:27.821 INFO:tasks.workunit.client.0.smithi112.stdout:1/489: read dc/d26/d34/f6d [3888268,79512] 0 2024-09-19T09:35:27.821 INFO:tasks.workunit.client.0.smithi112.stdout:9/440: creat df/d11/d14/d19/d66/f9b x:0 0 0 2024-09-19T09:35:27.821 INFO:tasks.workunit.client.0.smithi112.stdout:9/441: write df/d11/d14/f2e [261630,118723] 0 2024-09-19T09:35:27.822 INFO:tasks.workunit.client.0.smithi112.stdout:9/442: read df/d11/d14/d19/d40/d5c/d6b/f6f [170934,102095] 0 2024-09-19T09:35:27.824 INFO:tasks.workunit.client.0.smithi112.stdout:1/490: dread dc/d26/d34/f77 [0,4194304] 0 2024-09-19T09:35:27.824 INFO:tasks.workunit.client.0.smithi112.stdout:1/491: write dc/d24/f52 [1122840,42612] 0 2024-09-19T09:35:27.824 INFO:tasks.workunit.client.0.smithi112.stdout:1/492: chown dc/d24/l3a 87437966 1 2024-09-19T09:35:27.828 INFO:tasks.workunit.client.0.smithi112.stdout:0/560: sync 2024-09-19T09:35:27.828 INFO:tasks.workunit.client.0.smithi112.stdout:3/707: sync 2024-09-19T09:35:27.828 INFO:tasks.workunit.client.0.smithi112.stdout:3/708: fdatasync d8/d15/d1b/d1c/d68/f70 0 2024-09-19T09:35:27.830 INFO:tasks.workunit.client.0.smithi112.stdout:3/709: creat d8/d15/d1b/d1c/d68/fec x:0 0 0 2024-09-19T09:35:27.830 INFO:tasks.workunit.client.0.smithi112.stdout:3/710: write d8/d15/d1b/d1c/d68/f5e [2979988,92570] 0 2024-09-19T09:35:27.830 INFO:tasks.workunit.client.0.smithi112.stdout:3/711: creat d8/d15/d1b/d1c/d68/fed x:0 0 0 2024-09-19T09:35:27.830 INFO:tasks.workunit.client.0.smithi112.stdout:3/712: write d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/dd4/fe1 [604199,31600] 0 2024-09-19T09:35:27.830 INFO:tasks.workunit.client.0.smithi112.stdout:3/713: chown d8/d15/d1b/d1c/d68/d33/d66/ld8 0 1 2024-09-19T09:35:27.831 INFO:tasks.workunit.client.0.smithi112.stdout:0/561: dread d2/d6e/d75/f76 [0,4194304] 0 2024-09-19T09:35:27.833 INFO:tasks.workunit.client.0.smithi112.stdout:0/562: rmdir d2/d81 0 2024-09-19T09:35:27.845 INFO:tasks.workunit.client.0.smithi112.stdout:0/563: write d2/f4 [4079835,92907] 0 2024-09-19T09:35:27.845 INFO:tasks.workunit.client.0.smithi112.stdout:0/564: chown d2/d59/d7a/la9 518004 1 2024-09-19T09:35:27.845 INFO:tasks.workunit.client.0.smithi112.stdout:0/565: mknod d2/d59/da1/cb2 0 2024-09-19T09:35:27.853 INFO:tasks.workunit.client.0.smithi112.stdout:9/443: dwrite df/d11/d14/f4c [0,4194304] 0 2024-09-19T09:35:27.854 INFO:tasks.workunit.client.0.smithi112.stdout:3/714: dwrite d8/f93 [0,4194304] 0 2024-09-19T09:35:27.854 INFO:tasks.workunit.client.0.smithi112.stdout:1/493: dwrite dc/d26/d34/d4c/d55/f5a [0,4194304] 0 2024-09-19T09:35:27.854 INFO:tasks.workunit.client.0.smithi112.stdout:1/494: chown dc/d26/l5e 2434 1 2024-09-19T09:35:27.858 INFO:tasks.workunit.client.0.smithi112.stdout:9/444: creat df/d11/d14/d51/d8b/f9c x:0 0 0 2024-09-19T09:35:27.864 INFO:tasks.workunit.client.0.smithi112.stdout:3/715: creat d8/d15/d1b/d1c/d68/d33/fee x:0 0 0 2024-09-19T09:35:27.875 INFO:tasks.workunit.client.0.smithi112.stdout:1/495: rename dc/d26/d34/d6f/l75 to dc/d59/l99 0 2024-09-19T09:35:27.876 INFO:tasks.workunit.client.0.smithi112.stdout:1/496: dread - dc/d59/f80 zero size 2024-09-19T09:35:27.880 INFO:tasks.workunit.client.0.smithi112.stdout:9/445: mkdir df/d35/d9d 0 2024-09-19T09:35:27.880 INFO:tasks.workunit.client.0.smithi112.stdout:3/716: dwrite d8/d15/d1b/d1c/d68/d33/d83/f90 [0,4194304] 0 2024-09-19T09:35:27.882 INFO:tasks.workunit.client.0.smithi112.stdout:1/497: unlink dc/d24/l85 0 2024-09-19T09:35:27.884 INFO:tasks.workunit.client.0.smithi112.stdout:9/446: mkdir df/d11/d14/d51/d8b/d9e 0 2024-09-19T09:35:27.884 INFO:tasks.workunit.client.0.smithi112.stdout:9/447: readlink df/l60 0 2024-09-19T09:35:27.885 INFO:tasks.workunit.client.0.smithi112.stdout:9/448: fsync df/d11/d14/f5f 0 2024-09-19T09:35:27.885 INFO:tasks.workunit.client.0.smithi112.stdout:9/449: write df/d11/d14/d51/f7e [537334,80500] 0 2024-09-19T09:35:27.885 INFO:tasks.workunit.client.0.smithi112.stdout:9/450: creat df/d11/d14/d19/d28/f9f x:0 0 0 2024-09-19T09:35:27.885 INFO:tasks.workunit.client.0.smithi112.stdout:9/451: fdatasync df/d11/d14/f2d 0 2024-09-19T09:35:27.885 INFO:tasks.workunit.client.0.smithi112.stdout:9/452: creat df/d35/fa0 x:0 0 0 2024-09-19T09:35:27.889 INFO:tasks.workunit.client.0.smithi112.stdout:9/453: creat df/d11/d14/d19/d66/d99/fa1 x:0 0 0 2024-09-19T09:35:27.889 INFO:tasks.workunit.client.0.smithi112.stdout:9/454: read - df/d11/d14/d19/f90 zero size 2024-09-19T09:35:27.889 INFO:tasks.workunit.client.0.smithi112.stdout:9/455: dread - df/d11/d14/d51/d8b/f9c zero size 2024-09-19T09:35:27.889 INFO:tasks.workunit.client.0.smithi112.stdout:9/456: dread - df/d11/d14/d19/d1e/f88 zero size 2024-09-19T09:35:27.890 INFO:tasks.workunit.client.0.smithi112.stdout:1/498: getdents dc/d26/d34/d4c 0 2024-09-19T09:35:27.890 INFO:tasks.workunit.client.0.smithi112.stdout:1/499: chown dc/d13/f18 3 1 2024-09-19T09:35:27.890 INFO:tasks.workunit.client.0.smithi112.stdout:1/500: write dc/d26/d34/f6d [1745461,57986] 0 2024-09-19T09:35:27.890 INFO:tasks.workunit.client.0.smithi112.stdout:1/501: chown dc/d59/d73/f98 0 1 2024-09-19T09:35:27.890 INFO:tasks.workunit.client.0.smithi112.stdout:1/502: write f1 [4580467,130499] 0 2024-09-19T09:35:27.902 INFO:tasks.workunit.client.0.smithi112.stdout:3/717: dwrite d8/d15/d1b/f77 [0,4194304] 0 2024-09-19T09:35:27.903 INFO:tasks.workunit.client.0.smithi112.stdout:3/718: stat f6 0 2024-09-19T09:35:27.903 INFO:tasks.workunit.client.0.smithi112.stdout:3/719: write d8/d15/d1b/d1c/d68/d33/d6f/f8a [961089,83023] 0 2024-09-19T09:35:27.906 INFO:tasks.workunit.client.0.smithi112.stdout:3/720: unlink d8/d48/d67/d7e/f92 0 2024-09-19T09:35:27.908 INFO:tasks.workunit.client.0.smithi112.stdout:3/721: mkdir d8/d15/d1b/d1c/d68/d33/d83/def 0 2024-09-19T09:35:27.910 INFO:tasks.workunit.client.0.smithi112.stdout:3/722: mkdir d8/d15/d1b/d1c/d27/d62/dcf/df0 0 2024-09-19T09:35:27.912 INFO:tasks.workunit.client.0.smithi112.stdout:3/723: creat d8/d15/d1b/d1c/d68/d33/d7b/ff1 x:0 0 0 2024-09-19T09:35:27.913 INFO:tasks.workunit.client.0.smithi112.stdout:3/724: rename d8/l60 to d8/d15/d1b/d1c/d27/d62/d99/da0/lf2 0 2024-09-19T09:35:27.915 INFO:tasks.workunit.client.0.smithi112.stdout:3/725: mknod d8/d15/d1b/d1c/db5/cf3 0 2024-09-19T09:35:27.917 INFO:tasks.workunit.client.0.smithi112.stdout:3/726: mknod d8/d48/d67/d7e/cf4 0 2024-09-19T09:35:27.918 INFO:tasks.workunit.client.0.smithi112.stdout:3/727: truncate f7 8086097 0 2024-09-19T09:35:27.920 INFO:tasks.workunit.client.0.smithi112.stdout:1/503: dwrite dc/f20 [0,4194304] 0 2024-09-19T09:35:27.920 INFO:tasks.workunit.client.0.smithi112.stdout:9/457: dwrite df/d11/d14/d19/f33 [0,4194304] 0 2024-09-19T09:35:27.923 INFO:tasks.workunit.client.0.smithi112.stdout:1/504: link dc/d26/d34/l5c dc/d26/d34/l9a 0 2024-09-19T09:35:27.923 INFO:tasks.workunit.client.0.smithi112.stdout:1/505: fdatasync dc/d24/f12 0 2024-09-19T09:35:27.938 INFO:tasks.workunit.client.0.smithi112.stdout:1/506: mknod dc/d26/d34/d36/d68/c9b 0 2024-09-19T09:35:27.938 INFO:tasks.workunit.client.0.smithi112.stdout:1/507: chown dc/d24/d45/c8c 28579 1 2024-09-19T09:35:27.940 INFO:tasks.workunit.client.0.smithi112.stdout:1/508: creat dc/d24/d45/d94/f9c x:0 0 0 2024-09-19T09:35:27.941 INFO:tasks.workunit.client.0.smithi112.stdout:3/728: dwrite d8/f17 [0,4194304] 0 2024-09-19T09:35:27.942 INFO:tasks.workunit.client.0.smithi112.stdout:3/729: truncate d8/d15/d1b/d1c/d68/d8d/fa7 692732 0 2024-09-19T09:35:27.942 INFO:tasks.workunit.client.0.smithi112.stdout:9/458: dwrite df/d11/d14/d19/d66/f4a [0,4194304] 0 2024-09-19T09:35:27.945 INFO:tasks.workunit.client.0.smithi112.stdout:9/459: mknod df/d11/d14/d19/d28/ca2 0 2024-09-19T09:35:27.945 INFO:tasks.workunit.client.0.smithi112.stdout:9/460: stat df/d11/d14/d19/d40/d5c/d6b/d6c/f80 0 2024-09-19T09:35:27.947 INFO:tasks.workunit.client.0.smithi112.stdout:9/461: symlink df/d11/d14/d19/d28/d89/la3 0 2024-09-19T09:35:27.951 INFO:tasks.workunit.client.0.smithi112.stdout:9/462: mknod df/d11/d14/d51/d8b/d9e/ca4 0 2024-09-19T09:35:27.955 INFO:tasks.workunit.client.0.smithi112.stdout:1/509: dread dc/d13/f51 [0,4194304] 0 2024-09-19T09:35:27.956 INFO:tasks.workunit.client.0.smithi112.stdout:1/510: chown dc/d24/d45/l67 2189 1 2024-09-19T09:35:27.956 INFO:tasks.workunit.client.0.smithi112.stdout:1/511: symlink dc/d26/d44/d63/l9d 0 2024-09-19T09:35:27.956 INFO:tasks.workunit.client.0.smithi112.stdout:1/512: fdatasync dc/d13/f1c 0 2024-09-19T09:35:27.959 INFO:tasks.workunit.client.0.smithi112.stdout:3/730: dwrite d8/d15/d1b/d1c/d43/d4f/fbe [0,4194304] 0 2024-09-19T09:35:27.959 INFO:tasks.workunit.client.0.smithi112.stdout:3/731: write d8/d15/d1b/fad [5144284,4762] 0 2024-09-19T09:35:27.960 INFO:tasks.workunit.client.0.smithi112.stdout:5/785: sync 2024-09-19T09:35:27.966 INFO:tasks.workunit.client.0.smithi112.stdout:3/732: rename d8/d15/d1b/fad to d8/d15/d1b/d1c/db5/ff5 0 2024-09-19T09:35:27.986 INFO:tasks.workunit.client.0.smithi112.stdout:9/463: dwrite df/d11/d14/d19/d66/f3d [4194304,4194304] 0 2024-09-19T09:35:27.986 INFO:tasks.workunit.client.0.smithi112.stdout:1/513: dwrite dc/d59/d73/f98 [0,4194304] 0 2024-09-19T09:35:27.988 INFO:tasks.workunit.client.0.smithi112.stdout:9/464: link df/d35/c3a df/d11/d14/d19/d66/ca5 0 2024-09-19T09:35:27.988 INFO:tasks.workunit.client.0.smithi112.stdout:5/786: dwrite d4/d29/d36/d56/fa8 [0,4194304] 0 2024-09-19T09:35:27.990 INFO:tasks.workunit.client.0.smithi112.stdout:9/465: rename f3 to df/d11/d14/d51/d8b/fa6 0 2024-09-19T09:35:27.995 INFO:tasks.workunit.client.0.smithi112.stdout:5/787: dread d4/d9/d3e/fd3 [0,4194304] 0 2024-09-19T09:35:27.998 INFO:tasks.workunit.client.0.smithi112.stdout:1/514: rmdir dc/d24 39 2024-09-19T09:35:27.998 INFO:tasks.workunit.client.0.smithi112.stdout:1/515: fdatasync dc/d26/d34/d4c/f66 0 2024-09-19T09:35:28.000 INFO:tasks.workunit.client.0.smithi112.stdout:9/466: mkdir df/d11/d14/d19/d1e/d97/da7 0 2024-09-19T09:35:28.002 INFO:tasks.workunit.client.0.smithi112.stdout:5/788: rename d4/d29/d36/d70/cb7 to d4/d9/d17/dd6/c116 0 2024-09-19T09:35:28.003 INFO:tasks.workunit.client.0.smithi112.stdout:5/789: dread - d4/d9/df6/fee zero size 2024-09-19T09:35:28.026 INFO:tasks.workunit.client.0.smithi112.stdout:9/467: dwrite df/d11/f85 [0,4194304] 0 2024-09-19T09:35:28.026 INFO:tasks.workunit.client.0.smithi112.stdout:9/468: creat df/d11/d14/d19/d40/d5c/fa8 x:0 0 0 2024-09-19T09:35:28.026 INFO:tasks.workunit.client.0.smithi112.stdout:9/469: stat df/d11/d14/d19/d28/d89/la3 0 2024-09-19T09:35:28.030 INFO:tasks.workunit.client.0.smithi112.stdout:1/516: dwrite dc/d13/f1b [0,4194304] 0 2024-09-19T09:35:28.030 INFO:tasks.workunit.client.0.smithi112.stdout:5/790: dwrite d4/d9/d17/f5b [0,4194304] 0 2024-09-19T09:35:28.030 INFO:tasks.workunit.client.0.smithi112.stdout:5/791: fdatasync d4/d9/d2a/d46/f55 0 2024-09-19T09:35:28.031 INFO:tasks.workunit.client.0.smithi112.stdout:5/792: read d4/d9/d2a/d69/f81 [29639,116799] 0 2024-09-19T09:35:28.032 INFO:tasks.workunit.client.0.smithi112.stdout:5/793: write d4/d29/f2d [1708093,129982] 0 2024-09-19T09:35:28.032 INFO:tasks.workunit.client.0.smithi112.stdout:9/470: link df/d11/d14/f18 df/d11/d14/d51/d8b/d9e/fa9 0 2024-09-19T09:35:28.034 INFO:tasks.workunit.client.0.smithi112.stdout:5/794: dread d4/d9/d2a/d69/f9f [0,4194304] 0 2024-09-19T09:35:28.035 INFO:tasks.workunit.client.0.smithi112.stdout:5/795: creat d4/d9/d2a/d46/dde/f117 x:0 0 0 2024-09-19T09:35:28.035 INFO:tasks.workunit.client.0.smithi112.stdout:5/796: write d4/d9/df6/da9/f100 [1045856,53901] 0 2024-09-19T09:35:28.039 INFO:tasks.workunit.client.0.smithi112.stdout:1/517: rmdir dc/d26/d34/d4c 39 2024-09-19T09:35:28.042 INFO:tasks.workunit.client.0.smithi112.stdout:9/471: mkdir df/daa 0 2024-09-19T09:35:28.051 INFO:tasks.workunit.client.0.smithi112.stdout:9/472: read df/d11/d14/f2d [3991270,68102] 0 2024-09-19T09:35:28.053 INFO:tasks.workunit.client.0.smithi112.stdout:9/473: getdents df/d11/d14/d51/d8b 0 2024-09-19T09:35:28.053 INFO:tasks.workunit.client.0.smithi112.stdout:9/474: getdents df/daa 0 2024-09-19T09:35:28.054 INFO:tasks.workunit.client.0.smithi112.stdout:1/518: dwrite dc/d26/d34/d4c/d55/f86 [0,4194304] 0 2024-09-19T09:35:28.054 INFO:tasks.workunit.client.0.smithi112.stdout:1/519: write dc/d26/d34/d4c/f89 [943653,89067] 0 2024-09-19T09:35:28.054 INFO:tasks.workunit.client.0.smithi112.stdout:1/520: write dc/d26/d34/f77 [3042219,78464] 0 2024-09-19T09:35:28.054 INFO:tasks.workunit.client.0.smithi112.stdout:1/521: chown dc/d24/f40 49845 1 2024-09-19T09:35:28.054 INFO:tasks.workunit.client.0.smithi112.stdout:9/475: read df/d11/d14/d51/d8b/fa6 [4162747,32853] 0 2024-09-19T09:35:28.054 INFO:tasks.workunit.client.0.smithi112.stdout:9/476: fdatasync df/d11/d14/f2d 0 2024-09-19T09:35:28.055 INFO:tasks.workunit.client.0.smithi112.stdout:9/477: dread df/d11/d14/d19/d28/f57 [0,4194304] 0 2024-09-19T09:35:28.081 INFO:tasks.workunit.client.0.smithi112.stdout:1/522: truncate dc/d26/d34/f97 2290360 0 2024-09-19T09:35:28.084 INFO:tasks.workunit.client.0.smithi112.stdout:9/478: getdents df/d11/d14/d19/d1e/d97 0 2024-09-19T09:35:28.086 INFO:tasks.workunit.client.0.smithi112.stdout:1/523: link dc/d24/d45/l83 dc/d26/d34/d4c/l9e 0 2024-09-19T09:35:28.087 INFO:tasks.workunit.client.0.smithi112.stdout:9/479: truncate df/d11/f85 3769531 0 2024-09-19T09:35:28.090 INFO:tasks.workunit.client.0.smithi112.stdout:9/480: unlink f0 0 2024-09-19T09:35:28.094 INFO:tasks.workunit.client.0.smithi112.stdout:9/481: mknod df/d11/d14/cab 0 2024-09-19T09:35:28.094 INFO:tasks.workunit.client.0.smithi112.stdout:9/482: write df/d11/d14/d19/d40/f4e [954896,125710] 0 2024-09-19T09:35:28.096 INFO:tasks.workunit.client.0.smithi112.stdout:9/483: creat df/d11/d14/d19/d1e/d97/da7/fac x:0 0 0 2024-09-19T09:35:28.129 INFO:tasks.workunit.client.0.smithi112.stdout:4/988: sync 2024-09-19T09:35:28.129 INFO:tasks.workunit.client.0.smithi112.stdout:8/636: sync 2024-09-19T09:35:28.129 INFO:tasks.workunit.client.0.smithi112.stdout:7/649: sync 2024-09-19T09:35:28.130 INFO:tasks.workunit.client.0.smithi112.stdout:6/710: sync 2024-09-19T09:35:28.130 INFO:tasks.workunit.client.0.smithi112.stdout:6/711: chown d8/d11/d14/d3c/dd5 178158 1 2024-09-19T09:35:28.130 INFO:tasks.workunit.client.0.smithi112.stdout:4/989: truncate d1/d31/d42/fe4 4847315 0 2024-09-19T09:35:28.131 INFO:tasks.workunit.client.0.smithi112.stdout:8/637: rename d7/db/f73 to d7/db/fbd 0 2024-09-19T09:35:28.132 INFO:tasks.workunit.client.0.smithi112.stdout:7/650: creat d2/d2c/d54/dba/fe9 x:0 0 0 2024-09-19T09:35:28.134 INFO:tasks.workunit.client.0.smithi112.stdout:6/712: rename d8/de/d18/fc7 to d8/de/d17/d49/ffc 0 2024-09-19T09:35:28.134 INFO:tasks.workunit.client.0.smithi112.stdout:7/651: dread d2/d2c/d54/d18/d39/d23/d35/fad [0,4194304] 0 2024-09-19T09:35:28.135 INFO:tasks.workunit.client.0.smithi112.stdout:4/990: creat d1/d4/d3a/d7a/d7f/f14c x:0 0 0 2024-09-19T09:35:28.137 INFO:tasks.workunit.client.0.smithi112.stdout:8/638: link d7/db/d21/d2e/d42/lb1 d7/d10/d11/d55/d9e/lbe 0 2024-09-19T09:35:28.138 INFO:tasks.workunit.client.0.smithi112.stdout:6/713: mknod d8/d11/d14/cfd 0 2024-09-19T09:35:28.139 INFO:tasks.workunit.client.0.smithi112.stdout:6/714: read d8/de/d18/d20/f69 [871,10252] 0 2024-09-19T09:35:28.139 INFO:tasks.workunit.client.0.smithi112.stdout:6/715: chown d8/de/d66/d6e/l7c 138286 1 2024-09-19T09:35:28.139 INFO:tasks.workunit.client.0.smithi112.stdout:6/716: write d8/de/d18/d20/fbe [256531,84543] 0 2024-09-19T09:35:28.142 INFO:tasks.workunit.client.0.smithi112.stdout:7/652: mknod d2/d2c/d54/d18/d39/d21/d71/cea 0 2024-09-19T09:35:28.144 INFO:tasks.workunit.client.0.smithi112.stdout:4/991: write d1/f6 [575859,44054] 0 2024-09-19T09:35:28.144 INFO:tasks.workunit.client.0.smithi112.stdout:8/639: symlink d7/lbf 0 2024-09-19T09:35:28.146 INFO:tasks.workunit.client.0.smithi112.stdout:6/717: truncate d8/d11/d14/d3c/d4b/d63/f5f 1303094 0 2024-09-19T09:35:28.146 INFO:tasks.workunit.client.0.smithi112.stdout:6/718: chown d8/c1d 15975 1 2024-09-19T09:35:28.146 INFO:tasks.workunit.client.0.smithi112.stdout:6/719: readlink d8/d11/d14/d3c/d4b/d63/l65 0 2024-09-19T09:35:28.146 INFO:tasks.workunit.client.0.smithi112.stdout:6/720: stat d8/de/d18/d20/f69 0 2024-09-19T09:35:28.147 INFO:tasks.workunit.client.0.smithi112.stdout:7/653: creat d2/d2c/d54/d18/d39/d23/d35/d76/feb x:0 0 0 2024-09-19T09:35:28.147 INFO:tasks.workunit.client.0.smithi112.stdout:7/654: fdatasync d2/d2c/d54/d18/d39/fb7 0 2024-09-19T09:35:28.147 INFO:tasks.workunit.client.0.smithi112.stdout:7/655: stat d2/d2c/d54/d1a/c93 0 2024-09-19T09:35:28.154 INFO:tasks.workunit.client.0.smithi112.stdout:8/640: dread d7/db/d21/d3b/d56/d3c/d79/fb2 [0,4194304] 0 2024-09-19T09:35:28.155 INFO:tasks.workunit.client.0.smithi112.stdout:8/641: truncate d7/d10/d11/d33/f7a 5043203 0 2024-09-19T09:35:28.156 INFO:tasks.workunit.client.0.smithi112.stdout:7/656: dread d2/d2c/d54/d18/d39/d23/d35/f37 [0,4194304] 0 2024-09-19T09:35:28.167 INFO:tasks.workunit.client.0.smithi112.stdout:4/992: dwrite d1/d4/f129 [0,4194304] 0 2024-09-19T09:35:28.167 INFO:tasks.workunit.client.0.smithi112.stdout:4/993: write d1/d3d/d72/f7b [3666615,73241] 0 2024-09-19T09:35:28.178 INFO:tasks.workunit.client.0.smithi112.stdout:6/721: dwrite d8/de/d66/d6e/f72 [0,4194304] 0 2024-09-19T09:35:28.178 INFO:tasks.workunit.client.0.smithi112.stdout:6/722: read d8/f9 [3298922,20650] 0 2024-09-19T09:35:28.180 INFO:tasks.workunit.client.0.smithi112.stdout:8/642: dwrite d7/db/d21/d2e/f5e [4194304,4194304] 0 2024-09-19T09:35:28.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:27 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:35:28.262 INFO:tasks.workunit.client.0.smithi112.stdout:4/994: symlink d1/d4/d3a/d57/d62/l14d 0 2024-09-19T09:35:28.267 INFO:tasks.workunit.client.0.smithi112.stdout:6/723: creat d8/de/d61/d70/ffe x:0 0 0 2024-09-19T09:35:28.267 INFO:tasks.workunit.client.0.smithi112.stdout:6/724: chown d8/d11/d14/d3c/d4b/d63/dd3/dda/le6 1794 1 2024-09-19T09:35:28.267 INFO:tasks.workunit.client.0.smithi112.stdout:4/995: read d1/d31/d96/fda [2708290,1555] 0 2024-09-19T09:35:28.268 INFO:tasks.workunit.client.0.smithi112.stdout:4/996: chown d1/d5f 53203 1 2024-09-19T09:35:28.268 INFO:tasks.workunit.client.0.smithi112.stdout:4/997: chown d1/fd 5 1 2024-09-19T09:35:28.269 INFO:tasks.workunit.client.0.smithi112.stdout:8/643: mkdir d7/db/d21/d2e/d8c/dc0 0 2024-09-19T09:35:28.279 INFO:tasks.workunit.client.0.smithi112.stdout:6/725: rename d8/de/d61/d70/db5/lcc to d8/d11/d14/d3c/dc0/lff 0 2024-09-19T09:35:28.280 INFO:tasks.workunit.client.0.smithi112.stdout:4/998: creat d1/d4/d3a/d57/d60/f14e x:0 0 0 2024-09-19T09:35:28.280 INFO:tasks.workunit.client.0.smithi112.stdout:4/999: write d1/d4/d3a/d7a/fbb [795747,78492] 0 2024-09-19T09:35:28.282 INFO:tasks.workunit.client.0.smithi112.stdout:8/644: truncate d7/d10/d11/d33/f54 113912 0 2024-09-19T09:35:28.282 INFO:tasks.workunit.client.0.smithi112.stdout:6/726: dread d8/d11/d13/f98 [0,4194304] 0 2024-09-19T09:35:28.284 INFO:tasks.workunit.client.0.smithi112.stdout:8/645: symlink d7/db/d21/d2e/d8c/d97/lc1 0 2024-09-19T09:35:28.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:27 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:35:28.286 INFO:tasks.workunit.client.0.smithi112.stdout:6/727: mkdir d8/de/d17/d94/d100 0 2024-09-19T09:35:28.289 INFO:tasks.workunit.client.0.smithi112.stdout:8/646: symlink d7/d10/d11/d55/d9e/da1/lc2 0 2024-09-19T09:35:28.290 INFO:tasks.workunit.client.0.smithi112.stdout:8/647: truncate d7/ff 2569232 0 2024-09-19T09:35:28.290 INFO:tasks.workunit.client.0.smithi112.stdout:8/648: chown d7/db/d21/d2e/d8c/d97/fba 3680 1 2024-09-19T09:35:28.292 INFO:tasks.workunit.client.0.smithi112.stdout:8/649: mkdir d7/db/d21/d2e/d8c/d97/dc3 0 2024-09-19T09:35:28.295 INFO:tasks.workunit.client.0.smithi112.stdout:6/728: getdents d8/d73 0 2024-09-19T09:35:28.298 INFO:tasks.workunit.client.0.smithi112.stdout:7/657: dwrite d2/d2c/d54/d18/d39/d21/d71/f78 [0,4194304] 0 2024-09-19T09:35:28.302 INFO:tasks.workunit.client.0.smithi112.stdout:8/650: dread d7/db/d21/d3b/d56/d3c/f84 [0,4194304] 0 2024-09-19T09:35:28.305 INFO:tasks.workunit.client.0.smithi112.stdout:7/658: mkdir d2/d2c/d54/d18/d8a/d7c/dec 0 2024-09-19T09:35:28.307 INFO:tasks.workunit.client.0.smithi112.stdout:8/651: creat d7/d10/d11/d33/fc4 x:0 0 0 2024-09-19T09:35:28.308 INFO:tasks.workunit.client.0.smithi112.stdout:7/659: mknod d2/d2c/d54/d18/d85/dcd/ced 0 2024-09-19T09:35:28.310 INFO:tasks.workunit.client.0.smithi112.stdout:8/652: truncate d7/fd 1228580 0 2024-09-19T09:35:28.310 INFO:tasks.workunit.client.0.smithi112.stdout:7/660: mkdir d2/d2c/d54/dba/dee 0 2024-09-19T09:35:28.313 INFO:tasks.workunit.client.0.smithi112.stdout:8/653: mkdir d7/d10/d11/d55/d9e/da1/dc5 0 2024-09-19T09:35:28.314 INFO:tasks.workunit.client.0.smithi112.stdout:7/661: symlink d2/d2c/d54/d18/d8a/dcc/lef 0 2024-09-19T09:35:28.316 INFO:tasks.workunit.client.0.smithi112.stdout:7/662: truncate d2/d49/f58 2464403 0 2024-09-19T09:35:28.316 INFO:tasks.workunit.client.0.smithi112.stdout:7/663: write d2/d2c/f69 [797438,56722] 0 2024-09-19T09:35:28.328 INFO:tasks.workunit.client.0.smithi112.stdout:2/561: sync 2024-09-19T09:35:28.338 INFO:tasks.workunit.client.0.smithi112.stdout:8/654: dwrite d7/db/d21/d3b/d56/d4b/f5f [0,4194304] 0 2024-09-19T09:35:28.338 INFO:tasks.workunit.client.0.smithi112.stdout:7/664: write d2/d2c/d54/d18/d39/d23/f57 [27120,79175] 0 2024-09-19T09:35:28.338 INFO:tasks.workunit.client.0.smithi112.stdout:7/665: chown d2/d2c/d54/d18/d39/d23/c5f 109090208 1 2024-09-19T09:35:28.338 INFO:tasks.workunit.client.0.smithi112.stdout:7/666: fsync d2/d2c/d54/d18/d39/d23/d35/f37 0 2024-09-19T09:35:28.339 INFO:tasks.workunit.client.0.smithi112.stdout:8/655: getdents d7 0 2024-09-19T09:35:28.339 INFO:tasks.workunit.client.0.smithi112.stdout:8/656: write d7/db/d21/f4e [4673423,101640] 0 2024-09-19T09:35:28.341 INFO:tasks.workunit.client.0.smithi112.stdout:7/667: rename d2/d49/c60 to d2/d2c/d54/d18/da1/cf0 0 2024-09-19T09:35:28.341 INFO:tasks.workunit.client.0.smithi112.stdout:7/668: creat d2/d2c/d54/d18/d8a/ff1 x:0 0 0 2024-09-19T09:35:28.342 INFO:tasks.workunit.client.0.smithi112.stdout:2/562: write d0/d1/f22 [609869,81916] 0 2024-09-19T09:35:28.342 INFO:tasks.workunit.client.0.smithi112.stdout:8/657: link d7/d10/d11/d62/c86 d7/db/d21/d2e/cc6 0 2024-09-19T09:35:28.344 INFO:tasks.workunit.client.0.smithi112.stdout:7/669: symlink d2/d2c/d54/lf2 0 2024-09-19T09:35:28.347 INFO:tasks.workunit.client.0.smithi112.stdout:8/658: readlink d7/db/d21/l2d 0 2024-09-19T09:35:28.347 INFO:tasks.workunit.client.0.smithi112.stdout:8/659: rename d7/db/d21/d2e to d7/db/d21/d2e/d8c/d97/dc7 22 2024-09-19T09:35:28.349 INFO:tasks.workunit.client.0.smithi112.stdout:2/563: dread d0/d1/d5f/d78/f7b [0,4194304] 0 2024-09-19T09:35:28.349 INFO:tasks.workunit.client.0.smithi112.stdout:2/564: dread - d0/d1/d8a/fa1 zero size 2024-09-19T09:35:28.349 INFO:tasks.workunit.client.0.smithi112.stdout:2/565: creat d0/d3e/d50/d57/fb3 x:0 0 0 2024-09-19T09:35:28.349 INFO:tasks.workunit.client.0.smithi112.stdout:2/566: fsync d0/d3e/d50/d57/d5a/d27/f34 0 2024-09-19T09:35:28.351 INFO:tasks.workunit.client.0.smithi112.stdout:8/660: mkdir d7/db/d21/d2e/d42/dc8 0 2024-09-19T09:35:28.351 INFO:tasks.workunit.client.0.smithi112.stdout:8/661: chown d7/d10/c3a 2178 1 2024-09-19T09:35:28.351 INFO:tasks.workunit.client.0.smithi112.stdout:8/662: chown d7/db/d21/d3b/d56/d3c/d79/d85 211952 1 2024-09-19T09:35:28.351 INFO:tasks.workunit.client.0.smithi112.stdout:8/663: fsync d7/d10/d11/f37 0 2024-09-19T09:35:28.352 INFO:tasks.workunit.client.0.smithi112.stdout:8/664: read d7/db/d21/d3b/d56/d3c/f9f [896641,124261] 0 2024-09-19T09:35:28.355 INFO:tasks.workunit.client.0.smithi112.stdout:2/567: rename d0/d4a/f5e to d0/d6/d24/d96/fb4 0 2024-09-19T09:35:28.355 INFO:tasks.workunit.client.0.smithi112.stdout:2/568: write d0/d1/d8a/fa1 [68102,70982] 0 2024-09-19T09:35:28.355 INFO:tasks.workunit.client.0.smithi112.stdout:2/569: readlink d0/d1/d28/l12 0 2024-09-19T09:35:28.355 INFO:tasks.workunit.client.0.smithi112.stdout:2/570: write d0/d3e/d49/fad [958668,66492] 0 2024-09-19T09:35:28.362 INFO:tasks.workunit.client.0.smithi112.stdout:8/665: mkdir d7/db/d21/d2e/d8c/d97/dc3/dc9 0 2024-09-19T09:35:28.363 INFO:tasks.workunit.client.0.smithi112.stdout:8/666: truncate d7/db/d21/d2e/d42/d57/fa9 409951 0 2024-09-19T09:35:28.363 INFO:tasks.workunit.client.0.smithi112.stdout:8/667: creat d7/db/d21/d2e/fca x:0 0 0 2024-09-19T09:35:28.363 INFO:tasks.workunit.client.0.smithi112.stdout:2/571: dread d0/d1/f40 [0,4194304] 0 2024-09-19T09:35:28.363 INFO:tasks.workunit.client.0.smithi112.stdout:7/670: dwrite d2/f59 [0,4194304] 0 2024-09-19T09:35:28.369 INFO:tasks.workunit.client.0.smithi112.stdout:8/668: symlink d7/d67/d92/lcb 0 2024-09-19T09:35:28.369 INFO:tasks.workunit.client.0.smithi112.stdout:8/669: fsync d7/db/d21/d3b/d56/d4b/f71 0 2024-09-19T09:35:28.372 INFO:tasks.workunit.client.0.smithi112.stdout:2/572: rename d0/d1/d28/d9b/fa6 to d0/d6/fb5 0 2024-09-19T09:35:28.372 INFO:tasks.workunit.client.0.smithi112.stdout:2/573: dread - d0/d3e/d50/d57/fb3 zero size 2024-09-19T09:35:28.374 INFO:tasks.workunit.client.0.smithi112.stdout:8/670: mknod d7/db/d21/d2e/d8c/d97/dc3/ccc 0 2024-09-19T09:35:28.376 INFO:tasks.workunit.client.0.smithi112.stdout:2/574: creat d0/d3e/d50/d57/dac/fb6 x:0 0 0 2024-09-19T09:35:28.381 INFO:tasks.workunit.client.0.smithi112.stdout:7/671: rename d2/d2c/d54/d18/d39/d21/c6c to d2/d2c/d54/d18/d39/d21/cf3 0 2024-09-19T09:35:28.381 INFO:tasks.workunit.client.0.smithi112.stdout:7/672: write d2/d2c/d54/d18/d8a/d7c/db1/dc8/fd2 [100533,12571] 0 2024-09-19T09:35:28.383 INFO:tasks.workunit.client.0.smithi112.stdout:7/673: rename d2/d2c/d54/fd5 to d2/d2c/d54/d18/db4/de7/ff4 0 2024-09-19T09:35:28.385 INFO:tasks.workunit.client.0.smithi112.stdout:7/674: symlink d2/d2c/d54/d18/d85/lf5 0 2024-09-19T09:35:28.386 INFO:tasks.workunit.client.0.smithi112.stdout:7/675: dread - d2/d2c/d54/d18/d8a/fa6 zero size 2024-09-19T09:35:28.386 INFO:tasks.workunit.client.0.smithi112.stdout:7/676: fsync d2/d2c/d54/d18/d85/f92 0 2024-09-19T09:35:28.387 INFO:tasks.workunit.client.0.smithi112.stdout:7/677: symlink d2/lf6 0 2024-09-19T09:35:28.390 INFO:tasks.workunit.client.0.smithi112.stdout:7/678: truncate d2/d2c/d54/d1a/f3d 2591150 0 2024-09-19T09:35:28.393 INFO:tasks.workunit.client.0.smithi112.stdout:7/679: dread d2/d2c/f5d [0,4194304] 0 2024-09-19T09:35:28.396 INFO:tasks.workunit.client.0.smithi112.stdout:7/680: creat d2/d2c/d54/dba/dee/ff7 x:0 0 0 2024-09-19T09:35:28.400 INFO:tasks.workunit.client.0.smithi112.stdout:8/671: dwrite d7/d67/f4f [0,4194304] 0 2024-09-19T09:35:28.401 INFO:tasks.workunit.client.0.smithi112.stdout:8/672: chown d7/d65/f91 327570811 1 2024-09-19T09:35:28.402 INFO:tasks.workunit.client.0.smithi112.stdout:2/575: dwrite d0/d6/fb5 [0,4194304] 0 2024-09-19T09:35:28.402 INFO:tasks.workunit.client.0.smithi112.stdout:2/576: chown d0/d3e/d50/d57/d80/faa 4 1 2024-09-19T09:35:28.403 INFO:tasks.workunit.client.0.smithi112.stdout:8/673: mkdir d7/db/d21/d2e/d8c/d97/dc3/dc9/dcd 0 2024-09-19T09:35:28.406 INFO:tasks.workunit.client.0.smithi112.stdout:2/577: creat d0/d1/d5f/fb7 x:0 0 0 2024-09-19T09:35:28.408 INFO:tasks.workunit.client.0.smithi112.stdout:8/674: unlink d7/db/d21/d3b/d56/d48/ca3 0 2024-09-19T09:35:28.411 INFO:tasks.workunit.client.0.smithi112.stdout:8/675: mknod d7/db/d21/d2e/d8c/d97/dc3/cce 0 2024-09-19T09:35:28.411 INFO:tasks.workunit.client.0.smithi112.stdout:7/681: dwrite d2/d2c/d54/d18/d39/d23/d35/d76/feb [0,4194304] 0 2024-09-19T09:35:28.418 INFO:tasks.workunit.client.0.smithi112.stdout:8/676: creat d7/db/d21/d2e/d8c/d97/dc3/dc9/dcd/fcf x:0 0 0 2024-09-19T09:35:28.421 INFO:tasks.workunit.client.0.smithi112.stdout:7/682: creat d2/d2c/d54/d18/db4/de7/ff8 x:0 0 0 2024-09-19T09:35:28.421 INFO:tasks.workunit.client.0.smithi112.stdout:7/683: chown d2/d2c/d54/d18/d39/f9e 3933677 1 2024-09-19T09:35:28.421 INFO:tasks.workunit.client.0.smithi112.stdout:7/684: write d2/d2c/d54/d18/d39/d21/d45/fa5 [4526412,106929] 0 2024-09-19T09:35:28.421 INFO:tasks.workunit.client.0.smithi112.stdout:7/685: read - d2/d2c/d54/dba/fe9 zero size 2024-09-19T09:35:28.421 INFO:tasks.workunit.client.0.smithi112.stdout:7/686: chown d2/d2c/d54/d18/f3e 87857 1 2024-09-19T09:35:28.423 INFO:tasks.workunit.client.0.smithi112.stdout:8/677: creat d7/db/d21/d2e/d42/fd0 x:0 0 0 2024-09-19T09:35:28.423 INFO:tasks.workunit.client.0.smithi112.stdout:8/678: stat d7/db/d21/l2d 0 2024-09-19T09:35:28.424 INFO:tasks.workunit.client.0.smithi112.stdout:8/679: write d7/db/d21/d3b/d56/d3c/f94 [63429,62619] 0 2024-09-19T09:35:28.424 INFO:tasks.workunit.client.0.smithi112.stdout:8/680: read - d7/d10/d11/d33/fc4 zero size 2024-09-19T09:35:28.427 INFO:tasks.workunit.client.0.smithi112.stdout:7/687: mknod d2/d2c/d54/d18/d8a/d7c/dec/cf9 0 2024-09-19T09:35:28.431 INFO:tasks.workunit.client.0.smithi112.stdout:7/688: rmdir d2/d99 39 2024-09-19T09:35:28.432 INFO:tasks.workunit.client.0.smithi112.stdout:2/578: dwrite d0/d1/f38 [0,4194304] 0 2024-09-19T09:35:28.433 INFO:tasks.workunit.client.0.smithi112.stdout:2/579: fsync d0/d1/d5f/d78/f7b 0 2024-09-19T09:35:28.433 INFO:tasks.workunit.client.0.smithi112.stdout:2/580: chown d0/d3e/d50/l9f 791509 1 2024-09-19T09:35:28.435 INFO:tasks.workunit.client.0.smithi112.stdout:7/689: truncate d2/d99/f9b 463584 0 2024-09-19T09:35:28.437 INFO:tasks.workunit.client.0.smithi112.stdout:2/581: dread d0/d1/d28/f43 [0,4194304] 0 2024-09-19T09:35:28.443 INFO:tasks.workunit.client.0.smithi112.stdout:7/690: mkdir d2/d2c/d54/d18/db4/de7/dfa 0 2024-09-19T09:35:28.445 INFO:tasks.workunit.client.0.smithi112.stdout:8/681: dwrite d7/d10/d11/f2b [0,4194304] 0 2024-09-19T09:35:28.452 INFO:tasks.workunit.client.0.smithi112.stdout:7/691: rename d2/d49 to d2/d2c/d54/d18/d39/d23/dfb 0 2024-09-19T09:35:28.452 INFO:tasks.workunit.client.0.smithi112.stdout:7/692: chown d2/c7 592841 1 2024-09-19T09:35:28.454 INFO:tasks.workunit.client.0.smithi112.stdout:8/682: write d7/d10/d11/d33/f7a [3527323,34062] 0 2024-09-19T09:35:28.454 INFO:tasks.workunit.client.0.smithi112.stdout:8/683: chown d7/d10/d11/d62/c6e 83 1 2024-09-19T09:35:28.454 INFO:tasks.workunit.client.0.smithi112.stdout:8/684: creat d7/d10/d11/d50/fd1 x:0 0 0 2024-09-19T09:35:28.457 INFO:tasks.workunit.client.0.smithi112.stdout:8/685: mkdir d7/d10/d11/d62/dd2 0 2024-09-19T09:35:28.458 INFO:tasks.workunit.client.0.smithi112.stdout:8/686: symlink d7/db/ld3 0 2024-09-19T09:35:28.458 INFO:tasks.workunit.client.0.smithi112.stdout:8/687: fsync d7/d67/f4c 0 2024-09-19T09:35:28.458 INFO:tasks.workunit.client.0.smithi112.stdout:8/688: rmdir d7/db/d21/d2e/d8c/d97/dc3 39 2024-09-19T09:35:28.460 INFO:tasks.workunit.client.0.smithi112.stdout:2/582: dwrite d0/d3e/d50/f64 [0,4194304] 0 2024-09-19T09:35:28.460 INFO:tasks.workunit.client.0.smithi112.stdout:2/583: write d0/d3e/d50/d57/d5a/d4f/f52 [5205202,125572] 0 2024-09-19T09:35:28.467 INFO:tasks.workunit.client.0.smithi112.stdout:7/693: dread d2/d2c/d54/d18/f3e [0,4194304] 0 2024-09-19T09:35:28.467 INFO:tasks.workunit.client.0.smithi112.stdout:2/584: unlink d0/f5 0 2024-09-19T09:35:28.469 INFO:tasks.workunit.client.0.smithi112.stdout:7/694: mknod d2/d2c/d54/d1a/cfc 0 2024-09-19T09:35:28.471 INFO:tasks.workunit.client.0.smithi112.stdout:2/585: link d0/d6/d24/c33 d0/d6/cb8 0 2024-09-19T09:35:28.473 INFO:tasks.workunit.client.0.smithi112.stdout:8/689: dread d7/db/d21/d3b/d56/d3c/f3d [8388608,4194304] 0 2024-09-19T09:35:28.476 INFO:tasks.workunit.client.0.smithi112.stdout:2/586: symlink d0/d6/lb9 0 2024-09-19T09:35:28.477 INFO:tasks.workunit.client.0.smithi112.stdout:2/587: chown d0/d1/d28/d67/f81 1750425260 1 2024-09-19T09:35:28.477 INFO:tasks.workunit.client.0.smithi112.stdout:8/690: creat d7/d67/d92/db8/fd4 x:0 0 0 2024-09-19T09:35:28.481 INFO:tasks.workunit.client.0.smithi112.stdout:8/691: mkdir d7/d10/d11/d55/d9e/da1/dd5 0 2024-09-19T09:35:28.491 INFO:tasks.workunit.client.0.smithi112.stdout:7/695: dwrite d2/d99/dd8/fe5 [0,4194304] 0 2024-09-19T09:35:28.492 INFO:tasks.workunit.client.0.smithi112.stdout:7/696: chown d2/d2c/d54/d18/d8a/ff1 34665 1 2024-09-19T09:35:28.492 INFO:tasks.workunit.client.0.smithi112.stdout:7/697: dread - d2/d2c/d54/d18/d39/d23/dfb/fbf zero size 2024-09-19T09:35:28.499 INFO:tasks.workunit.client.0.smithi112.stdout:7/698: unlink d2/d2c/d54/d18/d39/d21/fa2 0 2024-09-19T09:35:28.507 INFO:tasks.workunit.client.0.smithi112.stdout:2/588: dwrite d0/d3e/d49/fad [0,4194304] 0 2024-09-19T09:35:28.508 INFO:tasks.workunit.client.0.smithi112.stdout:8/692: dwrite d7/db/d21/d3b/d56/d48/fa8 [0,4194304] 0 2024-09-19T09:35:28.512 INFO:tasks.workunit.client.0.smithi112.stdout:7/699: read d2/d2c/d54/d18/d39/d23/d35/d4c/d70/d7b/fa8 [4098722,60175] 0 2024-09-19T09:35:28.524 INFO:tasks.workunit.client.0.smithi112.stdout:7/700: write d2/d2c/d54/d18/d39/d21/fc1 [1252428,85939] 0 2024-09-19T09:35:28.524 INFO:tasks.workunit.client.0.smithi112.stdout:7/701: write d2/d2c/d54/d18/d39/d23/dfb/f97 [949033,34411] 0 2024-09-19T09:35:28.524 INFO:tasks.workunit.client.0.smithi112.stdout:8/693: write d7/db/d21/d2e/d8c/f8f [513575,9135] 0 2024-09-19T09:35:28.527 INFO:tasks.workunit.client.0.smithi112.stdout:7/702: dread d2/d2c/d54/d18/d8a/f5e [0,4194304] 0 2024-09-19T09:35:28.527 INFO:tasks.workunit.client.0.smithi112.stdout:2/589: dwrite d0/d3e/d50/d57/d5a/d27/f73 [0,4194304] 0 2024-09-19T09:35:28.528 INFO:tasks.workunit.client.0.smithi112.stdout:7/703: mknod d2/d2c/d54/d1a/cfd 0 2024-09-19T09:35:28.529 INFO:tasks.workunit.client.0.smithi112.stdout:2/590: mknod d0/d1/d5f/d78/db0/d9a/dae/cba 0 2024-09-19T09:35:28.593 INFO:tasks.workunit.client.0.smithi112.stdout:3/733: sync 2024-09-19T09:35:28.593 INFO:tasks.workunit.client.0.smithi112.stdout:5/797: sync 2024-09-19T09:35:28.593 INFO:tasks.workunit.client.0.smithi112.stdout:6/729: sync 2024-09-19T09:35:28.594 INFO:tasks.workunit.client.0.smithi112.stdout:3/734: readlink d8/d15/d1b/d1c/d68/d33/d83/l8b 0 2024-09-19T09:35:28.594 INFO:tasks.workunit.client.0.smithi112.stdout:1/524: sync 2024-09-19T09:35:28.594 INFO:tasks.workunit.client.0.smithi112.stdout:0/566: sync 2024-09-19T09:35:28.594 INFO:tasks.workunit.client.0.smithi112.stdout:0/567: stat d2/d39/d3b/c72 0 2024-09-19T09:35:28.594 INFO:tasks.workunit.client.0.smithi112.stdout:9/484: sync 2024-09-19T09:35:28.595 INFO:tasks.workunit.client.0.smithi112.stdout:7/704: link d2/d2c/d54/d18/d39/d21/d45/d4d/fdd d2/d2c/d54/dba/dee/ffe 0 2024-09-19T09:35:28.595 INFO:tasks.workunit.client.0.smithi112.stdout:7/705: write d2/d2c/d54/d18/d39/d21/d45/fc7 [489237,20694] 0 2024-09-19T09:35:28.595 INFO:tasks.workunit.client.0.smithi112.stdout:7/706: stat d2/d2c/d54/d18/d39/d21/d45 0 2024-09-19T09:35:28.600 INFO:tasks.workunit.client.0.smithi112.stdout:2/591: stat d0/d4a/l55 0 2024-09-19T09:35:28.600 INFO:tasks.workunit.client.0.smithi112.stdout:2/592: truncate d0/d1/d28/d67/f70 663681 0 2024-09-19T09:35:28.600 INFO:tasks.workunit.client.0.smithi112.stdout:2/593: write d0/d6/d24/d96/fb4 [924231,60553] 0 2024-09-19T09:35:28.600 INFO:tasks.workunit.client.0.smithi112.stdout:2/594: write d0/d1/d28/d67/f70 [443008,102566] 0 2024-09-19T09:35:28.601 INFO:tasks.workunit.client.0.smithi112.stdout:3/735: write d8/d15/d1b/d1c/d68/d33/d7b/fab [3785977,105806] 0 2024-09-19T09:35:28.606 INFO:tasks.workunit.client.0.smithi112.stdout:6/730: rename d8/d11/d14/d2a/fa5 to d8/de/d61/d70/d86/f101 0 2024-09-19T09:35:28.607 INFO:tasks.workunit.client.0.smithi112.stdout:6/731: write d8/de/d66/d6e/fbd [7373442,105542] 0 2024-09-19T09:35:28.609 INFO:tasks.workunit.client.0.smithi112.stdout:5/798: mknod d4/d9/d2a/d46/dde/de2/c118 0 2024-09-19T09:35:28.612 INFO:tasks.workunit.client.0.smithi112.stdout:1/525: mkdir dc/d26/d34/d36/d68/d9f 0 2024-09-19T09:35:28.613 INFO:tasks.workunit.client.0.smithi112.stdout:9/485: unlink df/d11/d14/c64 0 2024-09-19T09:35:28.614 INFO:tasks.workunit.client.0.smithi112.stdout:9/486: fdatasync df/d11/d14/f3b 0 2024-09-19T09:35:28.616 INFO:tasks.workunit.client.0.smithi112.stdout:7/707: symlink d2/d2c/d54/d18/d8a/lff 0 2024-09-19T09:35:28.622 INFO:tasks.workunit.client.0.smithi112.stdout:5/799: creat d4/d9/d17/d30/dec/f119 x:0 0 0 2024-09-19T09:35:28.622 INFO:tasks.workunit.client.0.smithi112.stdout:5/800: write d4/d9/fe8 [1220884,13765] 0 2024-09-19T09:35:28.623 INFO:tasks.workunit.client.0.smithi112.stdout:5/801: readlink d4/d9/d17/d2f/d72/l24 0 2024-09-19T09:35:28.624 INFO:tasks.workunit.client.0.smithi112.stdout:1/526: symlink dc/d26/d34/d36/d68/d9f/la0 0 2024-09-19T09:35:28.624 INFO:tasks.workunit.client.0.smithi112.stdout:1/527: write dc/d26/f4e [1246308,120145] 0 2024-09-19T09:35:28.624 INFO:tasks.workunit.client.0.smithi112.stdout:1/528: chown dc/l91 12602 1 2024-09-19T09:35:28.626 INFO:tasks.workunit.client.0.smithi112.stdout:0/568: dwrite d2/d59/f83 [0,4194304] 0 2024-09-19T09:35:28.626 INFO:tasks.workunit.client.0.smithi112.stdout:9/487: dread df/d11/d14/f62 [4194304,4194304] 0 2024-09-19T09:35:28.629 INFO:tasks.workunit.client.0.smithi112.stdout:5/802: link d4/d9/d17/da6/db2/dce/f10f d4/d84/f11a 0 2024-09-19T09:35:28.630 INFO:tasks.workunit.client.0.smithi112.stdout:1/529: creat dc/d59/d73/d88/fa1 x:0 0 0 2024-09-19T09:35:28.630 INFO:tasks.workunit.client.0.smithi112.stdout:1/530: write dc/d26/f93 [214850,22095] 0 2024-09-19T09:35:28.635 INFO:tasks.workunit.client.0.smithi112.stdout:0/569: unlink d2/d6e/da0/lae 0 2024-09-19T09:35:28.637 INFO:tasks.workunit.client.0.smithi112.stdout:3/736: dwrite d8/d15/d1b/d1c/d68/d33/d83/f90 [0,4194304] 0 2024-09-19T09:35:28.637 INFO:tasks.workunit.client.0.smithi112.stdout:3/737: fdatasync d8/d15/fe9 0 2024-09-19T09:35:28.637 INFO:tasks.workunit.client.0.smithi112.stdout:9/488: rename df/d11/d14/d19/d28/f57 to df/d11/d14/d19/d28/d95/fad 0 2024-09-19T09:35:28.638 INFO:tasks.workunit.client.0.smithi112.stdout:2/595: dwrite d0/d3e/d50/d57/d80/faa [4194304,4194304] 0 2024-09-19T09:35:28.640 INFO:tasks.workunit.client.0.smithi112.stdout:6/732: dwrite d8/de/d18/f55 [0,4194304] 0 2024-09-19T09:35:28.640 INFO:tasks.workunit.client.0.smithi112.stdout:6/733: write d8/de/d61/d70/fb6 [861075,28340] 0 2024-09-19T09:35:28.640 INFO:tasks.workunit.client.0.smithi112.stdout:7/708: dwrite d2/d2c/d54/d18/f1e [0,4194304] 0 2024-09-19T09:35:28.640 INFO:tasks.workunit.client.0.smithi112.stdout:7/709: stat d2/d2c/d54/d18/d39/d23/l73 0 2024-09-19T09:35:28.640 INFO:tasks.workunit.client.0.smithi112.stdout:7/710: write d2/d2c/d54/d18/d39/d23/dfb/f58 [1297189,103620] 0 2024-09-19T09:35:28.640 INFO:tasks.workunit.client.0.smithi112.stdout:7/711: truncate d2/d2c/d54/d18/d39/d21/d45/f5c 2441088 0 2024-09-19T09:35:28.640 INFO:tasks.workunit.client.0.smithi112.stdout:7/712: chown d2/d2c/d54/d18/d39/d23/d35/d76/c9a 7071335 1 2024-09-19T09:35:28.640 INFO:tasks.workunit.client.0.smithi112.stdout:7/713: write d2/d2c/d54/d18/d39/f9e [1399626,82154] 0 2024-09-19T09:35:28.640 INFO:tasks.workunit.client.0.smithi112.stdout:7/714: write d2/d2c/d54/d18/d39/d21/d71/fde [146213,93548] 0 2024-09-19T09:35:28.641 INFO:tasks.workunit.client.0.smithi112.stdout:7/715: dread - d2/d2c/d54/d18/d8a/d7c/f90 zero size 2024-09-19T09:35:28.641 INFO:tasks.workunit.client.0.smithi112.stdout:5/803: link d4/d9/d17/d2f/c86 d4/d9/d2a/d39/d88/dba/c11b 0 2024-09-19T09:35:28.641 INFO:tasks.workunit.client.0.smithi112.stdout:2/596: dread d0/d1/d5f/d78/f93 [0,4194304] 0 2024-09-19T09:35:28.645 INFO:tasks.workunit.client.0.smithi112.stdout:3/738: mknod d8/d15/d1b/cf6 0 2024-09-19T09:35:28.649 INFO:tasks.workunit.client.0.smithi112.stdout:9/489: truncate df/d11/d14/d19/d1e/f69 1282305 0 2024-09-19T09:35:28.656 INFO:tasks.workunit.client.0.smithi112.stdout:2/597: write d0/d3e/d50/d57/d80/faa [3804356,9428] 0 2024-09-19T09:35:28.656 INFO:tasks.workunit.client.0.smithi112.stdout:2/598: write d0/d1/f6f [429691,23457] 0 2024-09-19T09:35:28.656 INFO:tasks.workunit.client.0.smithi112.stdout:2/599: truncate d0/d1/d5f/d78/fa4 34650 0 2024-09-19T09:35:28.658 INFO:tasks.workunit.client.0.smithi112.stdout:7/716: mknod d2/d2c/d54/d18/d39/d23/d35/d76/c100 0 2024-09-19T09:35:28.658 INFO:tasks.workunit.client.0.smithi112.stdout:7/717: chown d2/d2c/d54/c67 11046360 1 2024-09-19T09:35:28.659 INFO:tasks.workunit.client.0.smithi112.stdout:7/718: write d2/d2c/d54/d18/d39/d23/dfb/f58 [289437,9979] 0 2024-09-19T09:35:28.659 INFO:tasks.workunit.client.0.smithi112.stdout:0/570: getdents d2/d39/d3b/d44 0 2024-09-19T09:35:28.661 INFO:tasks.workunit.client.0.smithi112.stdout:3/739: creat d8/d15/d1b/d1c/d27/d62/ff7 x:0 0 0 2024-09-19T09:35:28.662 INFO:tasks.workunit.client.0.smithi112.stdout:3/740: dread - d8/d15/fe9 zero size 2024-09-19T09:35:28.662 INFO:tasks.workunit.client.0.smithi112.stdout:9/490: symlink df/d11/d14/d19/d40/d5c/d6b/d6c/lae 0 2024-09-19T09:35:28.663 INFO:tasks.workunit.client.0.smithi112.stdout:9/491: fdatasync df/d11/d14/d19/d28/f9f 0 2024-09-19T09:35:28.665 INFO:tasks.workunit.client.0.smithi112.stdout:2/600: mkdir d0/d1/d5f/d78/dbb 0 2024-09-19T09:35:28.665 INFO:tasks.workunit.client.0.smithi112.stdout:2/601: chown d0/d1/d5f/d78/db0 0 1 2024-09-19T09:35:28.665 INFO:tasks.workunit.client.0.smithi112.stdout:2/602: chown d0/d1/d28/l12 25 1 2024-09-19T09:35:28.666 INFO:tasks.workunit.client.0.smithi112.stdout:1/531: dwrite f1 [4194304,4194304] 0 2024-09-19T09:35:28.667 INFO:tasks.workunit.client.0.smithi112.stdout:5/804: dwrite d4/d9/d17/d2f/d72/fb5 [0,4194304] 0 2024-09-19T09:35:28.667 INFO:tasks.workunit.client.0.smithi112.stdout:5/805: stat d4/d9/df6/da9/l108 0 2024-09-19T09:35:28.667 INFO:tasks.workunit.client.0.smithi112.stdout:6/734: dwrite d8/d11/d14/d2a/f32 [0,4194304] 0 2024-09-19T09:35:28.667 INFO:tasks.workunit.client.0.smithi112.stdout:7/719: rename d2/d2c/d54/d18/fc0 to d2/d2c/d54/d18/d39/d23/d35/d4c/f101 0 2024-09-19T09:35:28.669 INFO:tasks.workunit.client.0.smithi112.stdout:3/741: creat d8/d48/d67/ff8 x:0 0 0 2024-09-19T09:35:28.669 INFO:tasks.workunit.client.0.smithi112.stdout:3/742: readlink d8/d15/d1b/d1c/lc7 0 2024-09-19T09:35:28.670 INFO:tasks.workunit.client.0.smithi112.stdout:2/603: truncate d0/d6/fa2 3039770 0 2024-09-19T09:35:28.676 INFO:tasks.workunit.client.0.smithi112.stdout:6/735: dread d8/d11/d14/d2a/fb9 [0,4194304] 0 2024-09-19T09:35:28.676 INFO:tasks.workunit.client.0.smithi112.stdout:1/532: unlink dc/d26/d34/d4c/d55/l74 0 2024-09-19T09:35:28.681 INFO:tasks.workunit.client.0.smithi112.stdout:0/571: rename d2/f38 to d2/d39/fb3 0 2024-09-19T09:35:28.682 INFO:tasks.workunit.client.0.smithi112.stdout:7/720: symlink d2/d2c/d54/d18/d8a/d7c/db1/l102 0 2024-09-19T09:35:28.683 INFO:tasks.workunit.client.0.smithi112.stdout:7/721: creat d2/d2c/d54/d18/d39/f103 x:0 0 0 2024-09-19T09:35:28.683 INFO:tasks.workunit.client.0.smithi112.stdout:5/806: dwrite d4/d9/d17/f5b [0,4194304] 0 2024-09-19T09:35:28.683 INFO:tasks.workunit.client.0.smithi112.stdout:5/807: dread - d4/d9/df6/fdd zero size 2024-09-19T09:35:28.683 INFO:tasks.workunit.client.0.smithi112.stdout:5/808: read d4/d9/d17/d30/fab [256963,39618] 0 2024-09-19T09:35:28.684 INFO:tasks.workunit.client.0.smithi112.stdout:3/743: symlink d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/lf9 0 2024-09-19T09:35:28.684 INFO:tasks.workunit.client.0.smithi112.stdout:3/744: dread - d8/d15/d1b/d1c/d43/d9b/fce zero size 2024-09-19T09:35:28.684 INFO:tasks.workunit.client.0.smithi112.stdout:3/745: chown d8/d15/d1b/d1c 245377 1 2024-09-19T09:35:28.685 INFO:tasks.workunit.client.0.smithi112.stdout:2/604: creat d0/d6/d24/fbc x:0 0 0 2024-09-19T09:35:28.689 INFO:tasks.workunit.client.0.smithi112.stdout:1/533: mkdir dc/d24/da2 0 2024-09-19T09:35:28.693 INFO:tasks.workunit.client.0.smithi112.stdout:2/605: dread d0/d1/f40 [0,4194304] 0 2024-09-19T09:35:28.697 INFO:tasks.workunit.client.0.smithi112.stdout:7/722: creat d2/d2c/d54/d18/d8a/d7c/db1/dc8/f104 x:0 0 0 2024-09-19T09:35:28.697 INFO:tasks.workunit.client.0.smithi112.stdout:6/736: dread d8/de/d66/fd0 [0,4194304] 0 2024-09-19T09:35:28.698 INFO:tasks.workunit.client.0.smithi112.stdout:0/572: dwrite d2/d39/d3b/d44/f71 [0,4194304] 0 2024-09-19T09:35:28.699 INFO:tasks.workunit.client.0.smithi112.stdout:5/809: getdents d4/d29/d36/dc9 0 2024-09-19T09:35:28.702 INFO:tasks.workunit.client.0.smithi112.stdout:3/746: symlink d8/d15/d1b/d1c/d27/d62/dcf/d44/lfa 0 2024-09-19T09:35:28.705 INFO:tasks.workunit.client.0.smithi112.stdout:1/534: creat dc/d59/d73/fa3 x:0 0 0 2024-09-19T09:35:28.705 INFO:tasks.workunit.client.0.smithi112.stdout:1/535: write dc/d24/f52 [1814570,119868] 0 2024-09-19T09:35:28.705 INFO:tasks.workunit.client.0.smithi112.stdout:1/536: stat dc/d26/d44 0 2024-09-19T09:35:28.710 INFO:tasks.workunit.client.0.smithi112.stdout:2/606: symlink d0/d3e/d50/d57/d80/lbd 0 2024-09-19T09:35:28.712 INFO:tasks.workunit.client.0.smithi112.stdout:7/723: getdents d2/d2c/d54/d18/da1 0 2024-09-19T09:35:28.712 INFO:tasks.workunit.client.0.smithi112.stdout:7/724: creat d2/d2c/d54/dba/f105 x:0 0 0 2024-09-19T09:35:28.713 INFO:tasks.workunit.client.0.smithi112.stdout:0/573: dwrite d2/f49 [0,4194304] 0 2024-09-19T09:35:28.713 INFO:tasks.workunit.client.0.smithi112.stdout:0/574: stat d2/d39/d3b/d44/f80 0 2024-09-19T09:35:28.714 INFO:tasks.workunit.client.0.smithi112.stdout:6/737: creat d8/de/d61/f102 x:0 0 0 2024-09-19T09:35:28.718 INFO:tasks.workunit.client.0.smithi112.stdout:5/810: mkdir d4/d9/d17/dd6/de6/d11c 0 2024-09-19T09:35:28.721 INFO:tasks.workunit.client.0.smithi112.stdout:3/747: mkdir d8/d48/d67/dfb 0 2024-09-19T09:35:28.723 INFO:tasks.workunit.client.0.smithi112.stdout:9/492: rename df/d11/d14/d19/d40/d5c/d6b to df/d11/d14/d19/d40/daf 0 2024-09-19T09:35:28.723 INFO:tasks.workunit.client.0.smithi112.stdout:1/537: dwrite dc/d24/d45/d94/f9c [0,4194304] 0 2024-09-19T09:35:28.728 INFO:tasks.workunit.client.0.smithi112.stdout:2/607: link d0/d3e/d50/d57/d5a/d4f/f52 d0/d1/d8a/fbe 0 2024-09-19T09:35:28.728 INFO:tasks.workunit.client.0.smithi112.stdout:2/608: chown d0/d3e/d50/d57/d5a/d27/f34 123 1 2024-09-19T09:35:28.731 INFO:tasks.workunit.client.0.smithi112.stdout:2/609: dread d0/d3e/d50/d57/d5a/d27/f69 [0,4194304] 0 2024-09-19T09:35:28.731 INFO:tasks.workunit.client.0.smithi112.stdout:2/610: chown d0/d1/d5f 233461 1 2024-09-19T09:35:28.731 INFO:tasks.workunit.client.0.smithi112.stdout:2/611: readlink d0/d3e/d50/d57/d5a/d27/l54 0 2024-09-19T09:35:28.731 INFO:tasks.workunit.client.0.smithi112.stdout:1/538: write dc/d26/d34/d36/d68/d7d/f7b [2711291,124353] 0 2024-09-19T09:35:28.732 INFO:tasks.workunit.client.0.smithi112.stdout:7/725: unlink d2/d2c/d54/d18/d85/c91 0 2024-09-19T09:35:28.734 INFO:tasks.workunit.client.0.smithi112.stdout:0/575: mkdir d2/d6e/db4 0 2024-09-19T09:35:28.737 INFO:tasks.workunit.client.0.smithi112.stdout:6/738: mkdir d8/de/d61/dbf/d103 0 2024-09-19T09:35:28.738 INFO:tasks.workunit.client.0.smithi112.stdout:2/612: dread d0/d1/d5f/d78/db0/f53 [0,4194304] 0 2024-09-19T09:35:28.743 INFO:tasks.workunit.client.0.smithi112.stdout:7/726: symlink d2/d2c/d54/d18/d39/d21/l106 0 2024-09-19T09:35:28.745 INFO:tasks.workunit.client.0.smithi112.stdout:0/576: rename d2/d11 to d2/d39/d3b/d44/d95/db5 0 2024-09-19T09:35:28.745 INFO:tasks.workunit.client.0.smithi112.stdout:7/727: mkdir d2/d2c/d54/d18/d39/d23/dfb/d107 0 2024-09-19T09:35:28.748 INFO:tasks.workunit.client.0.smithi112.stdout:7/728: symlink d2/d2c/d54/d18/da1/l108 0 2024-09-19T09:35:28.749 INFO:tasks.workunit.client.0.smithi112.stdout:7/729: symlink d2/d2c/d54/d18/d39/d23/dfb/l109 0 2024-09-19T09:35:28.749 INFO:tasks.workunit.client.0.smithi112.stdout:5/811: dwrite d4/d9/d2a/d46/fd4 [0,4194304] 0 2024-09-19T09:35:28.750 INFO:tasks.workunit.client.0.smithi112.stdout:7/730: unlink d2/d2c/d54/d18/d8a/d7c/c8c 0 2024-09-19T09:35:28.752 INFO:tasks.workunit.client.0.smithi112.stdout:2/613: dread d0/d6/d24/f39 [0,4194304] 0 2024-09-19T09:35:28.753 INFO:tasks.workunit.client.0.smithi112.stdout:7/731: unlink d2/d2c/d54/d18/d39/d23/dfb/l109 0 2024-09-19T09:35:28.753 INFO:tasks.workunit.client.0.smithi112.stdout:7/732: fdatasync d2/d2c/d54/d18/db4/de7/ff4 0 2024-09-19T09:35:28.753 INFO:tasks.workunit.client.0.smithi112.stdout:7/733: getdents d2/d2c/d54/d18/d39/d21/d71/de8 0 2024-09-19T09:35:28.753 INFO:tasks.workunit.client.0.smithi112.stdout:7/734: fdatasync d2/d2c/d54/d18/d8a/fa6 0 2024-09-19T09:35:28.755 INFO:tasks.workunit.client.0.smithi112.stdout:7/735: rmdir d2/d2c/d54/d18/d39/d23 39 2024-09-19T09:35:28.755 INFO:tasks.workunit.client.0.smithi112.stdout:7/736: chown d2/d2c/d54/d18/d39/d21/d45/d4d/f68 15 1 2024-09-19T09:35:28.757 INFO:tasks.workunit.client.0.smithi112.stdout:7/737: mknod d2/d2c/d54/d18/d8a/dcc/c10a 0 2024-09-19T09:35:28.757 INFO:tasks.workunit.client.0.smithi112.stdout:3/748: dwrite d8/d15/d1b/d1c/d68/d33/d6f/f76 [0,4194304] 0 2024-09-19T09:35:28.758 INFO:tasks.workunit.client.0.smithi112.stdout:7/738: symlink d2/d99/dd8/l10b 0 2024-09-19T09:35:28.759 INFO:tasks.workunit.client.0.smithi112.stdout:3/749: dread d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/dd4/fe1 [0,4194304] 0 2024-09-19T09:35:28.762 INFO:tasks.workunit.client.0.smithi112.stdout:3/750: symlink d8/d15/d1b/d1c/d27/d62/d99/lfc 0 2024-09-19T09:35:28.762 INFO:tasks.workunit.client.0.smithi112.stdout:3/751: readlink d8/lb3 0 2024-09-19T09:35:28.762 INFO:tasks.workunit.client.0.smithi112.stdout:3/752: write d8/d15/d1b/fc4 [609797,12483] 0 2024-09-19T09:35:28.762 INFO:tasks.workunit.client.0.smithi112.stdout:2/614: fdatasync d0/d3e/d50/d57/d80/faa 0 2024-09-19T09:35:28.763 INFO:tasks.workunit.client.0.smithi112.stdout:1/539: dwrite dc/d26/d34/d4c/f89 [0,4194304] 0 2024-09-19T09:35:28.764 INFO:tasks.workunit.client.0.smithi112.stdout:9/493: dwrite df/d11/d14/d19/d1e/f88 [0,4194304] 0 2024-09-19T09:35:28.770 INFO:tasks.workunit.client.0.smithi112.stdout:1/540: truncate dc/d24/f12 2048997 0 2024-09-19T09:35:28.772 INFO:tasks.workunit.client.0.smithi112.stdout:2/615: rename d0/d3e/d50/d57/d5a/d27/f69 to d0/d3e/d49/fbf 0 2024-09-19T09:35:28.776 INFO:tasks.workunit.client.0.smithi112.stdout:7/739: dread d2/d2c/d54/d18/d39/d23/d35/f37 [0,4194304] 0 2024-09-19T09:35:28.780 INFO:tasks.workunit.client.0.smithi112.stdout:5/812: dwrite d4/d9/d2a/d69/f58 [0,4194304] 0 2024-09-19T09:35:28.782 INFO:tasks.workunit.client.0.smithi112.stdout:1/541: unlink dc/d26/f3d 0 2024-09-19T09:35:28.782 INFO:tasks.workunit.client.0.smithi112.stdout:1/542: fsync dc/d26/d34/f97 0 2024-09-19T09:35:28.784 INFO:tasks.workunit.client.0.smithi112.stdout:5/813: dread d4/d9/d17/d2f/d72/f9b [0,4194304] 0 2024-09-19T09:35:28.788 INFO:tasks.workunit.client.0.smithi112.stdout:1/543: link dc/l91 dc/d26/d34/d36/d68/d7d/d6a/la4 0 2024-09-19T09:35:28.789 INFO:tasks.workunit.client.0.smithi112.stdout:5/814: link d4/d9/d17/dd6/l104 d4/d9/d17/d2f/l11d 0 2024-09-19T09:35:28.789 INFO:tasks.workunit.client.0.smithi112.stdout:5/815: readlink d4/d9/d17/d2f/l11d 0 2024-09-19T09:35:28.791 INFO:tasks.workunit.client.0.smithi112.stdout:1/544: mkdir dc/d59/d73/d88/da5 0 2024-09-19T09:35:28.791 INFO:tasks.workunit.client.0.smithi112.stdout:1/545: chown dc/d24/f50 120062 1 2024-09-19T09:35:28.791 INFO:tasks.workunit.client.0.smithi112.stdout:1/546: dread - dc/d59/d73/f79 zero size 2024-09-19T09:35:28.793 INFO:tasks.workunit.client.0.smithi112.stdout:7/740: dread d2/d2c/d54/d1a/f3d [0,4194304] 0 2024-09-19T09:35:28.793 INFO:tasks.workunit.client.0.smithi112.stdout:5/816: creat d4/d9/d2a/d39/f11e x:0 0 0 2024-09-19T09:35:28.793 INFO:tasks.workunit.client.0.smithi112.stdout:5/817: chown d4/d29/d36/d5f/f6a 2425589 1 2024-09-19T09:35:28.794 INFO:tasks.workunit.client.0.smithi112.stdout:1/547: creat dc/d24/da2/fa6 x:0 0 0 2024-09-19T09:35:28.794 INFO:tasks.workunit.client.0.smithi112.stdout:9/494: dwrite fc [0,4194304] 0 2024-09-19T09:35:28.794 INFO:tasks.workunit.client.0.smithi112.stdout:9/495: getdents df/d11/d14/d19/d1e/d97 0 2024-09-19T09:35:28.796 INFO:tasks.workunit.client.0.smithi112.stdout:7/741: getdents d2/d2c/d54/d18/d8a/d7c/dec 0 2024-09-19T09:35:28.797 INFO:tasks.workunit.client.0.smithi112.stdout:0/577: dwrite d2/fe [0,4194304] 0 2024-09-19T09:35:28.798 INFO:tasks.workunit.client.0.smithi112.stdout:3/753: dwrite d8/d15/d1b/d1c/d27/d2b/f5c [0,4194304] 0 2024-09-19T09:35:28.798 INFO:tasks.workunit.client.0.smithi112.stdout:7/742: chown d2/d99/fb0 25699944 1 2024-09-19T09:35:28.801 INFO:tasks.workunit.client.0.smithi112.stdout:2/616: dwrite d0/d3e/d50/d57/d5a/d27/f34 [0,4194304] 0 2024-09-19T09:35:28.802 INFO:tasks.workunit.client.0.smithi112.stdout:2/617: getdents d0/d1/da8 0 2024-09-19T09:35:28.802 INFO:tasks.workunit.client.0.smithi112.stdout:2/618: write d0/d6/fa2 [604513,58572] 0 2024-09-19T09:35:28.803 INFO:tasks.workunit.client.0.smithi112.stdout:0/578: creat d2/d39/d3b/dab/fb6 x:0 0 0 2024-09-19T09:35:28.803 INFO:tasks.workunit.client.0.smithi112.stdout:9/496: dread df/d11/d14/f18 [0,4194304] 0 2024-09-19T09:35:28.808 INFO:tasks.workunit.client.0.smithi112.stdout:3/754: creat d8/d15/d1b/d1c/d27/d2b/ffd x:0 0 0 2024-09-19T09:35:28.812 INFO:tasks.workunit.client.0.smithi112.stdout:2/619: mknod d0/d1/d28/d9b/cc0 0 2024-09-19T09:35:28.813 INFO:tasks.workunit.client.0.smithi112.stdout:9/497: symlink df/d11/d14/d19/d28/d89/lb0 0 2024-09-19T09:35:28.816 INFO:tasks.workunit.client.0.smithi112.stdout:2/620: getdents d0/d3e/d50/d57/d5a/d56 0 2024-09-19T09:35:28.820 INFO:tasks.workunit.client.0.smithi112.stdout:5/818: dwrite d4/d29/f2d [0,4194304] 0 2024-09-19T09:35:28.821 INFO:tasks.workunit.client.0.smithi112.stdout:2/621: getdents d0/d1/d5f/d78 0 2024-09-19T09:35:28.822 INFO:tasks.workunit.client.0.smithi112.stdout:2/622: write d0/d3e/d49/fb2 [274801,130968] 0 2024-09-19T09:35:28.822 INFO:tasks.workunit.client.0.smithi112.stdout:2/623: truncate d0/d3e/d50/d57/fb3 869523 0 2024-09-19T09:35:28.822 INFO:tasks.workunit.client.0.smithi112.stdout:1/548: dwrite dc/d26/f29 [0,4194304] 0 2024-09-19T09:35:28.828 INFO:tasks.workunit.client.0.smithi112.stdout:1/549: rename dc/d13/c2c to dc/d26/d34/d36/d68/d7d/d6a/ca7 0 2024-09-19T09:35:28.828 INFO:tasks.workunit.client.0.smithi112.stdout:1/550: chown dc/d26/d34/d36/d68/d9f 4605 1 2024-09-19T09:35:28.831 INFO:tasks.workunit.client.0.smithi112.stdout:1/551: mknod dc/d26/d34/d36/ca8 0 2024-09-19T09:35:28.833 INFO:tasks.workunit.client.0.smithi112.stdout:1/552: getdents dc/d24 0 2024-09-19T09:35:28.833 INFO:tasks.workunit.client.0.smithi112.stdout:1/553: chown f8 1 1 2024-09-19T09:35:28.834 INFO:tasks.workunit.client.0.smithi112.stdout:9/498: dread df/d11/f85 [0,4194304] 0 2024-09-19T09:35:28.836 INFO:tasks.workunit.client.0.smithi112.stdout:2/624: dread d0/d1/f40 [0,4194304] 0 2024-09-19T09:35:28.837 INFO:tasks.workunit.client.0.smithi112.stdout:1/554: rmdir dc/d26/d34/d36 39 2024-09-19T09:35:28.838 INFO:tasks.workunit.client.0.smithi112.stdout:9/499: creat df/d11/d14/d19/d28/d95/fb1 x:0 0 0 2024-09-19T09:35:28.840 INFO:tasks.workunit.client.0.smithi112.stdout:3/755: dwrite d8/f7d [0,4194304] 0 2024-09-19T09:35:28.840 INFO:tasks.workunit.client.0.smithi112.stdout:3/756: truncate d8/d15/d1b/d1c/d68/fb4 1062304 0 2024-09-19T09:35:28.840 INFO:tasks.workunit.client.0.smithi112.stdout:0/579: dwrite d2/f56 [0,4194304] 0 2024-09-19T09:35:28.840 INFO:tasks.workunit.client.0.smithi112.stdout:2/625: unlink d0/d6/d24/d96/fb4 0 2024-09-19T09:35:28.841 INFO:tasks.workunit.client.0.smithi112.stdout:1/555: mknod dc/d26/d34/d36/d68/ca9 0 2024-09-19T09:35:28.844 INFO:tasks.workunit.client.0.smithi112.stdout:3/757: rmdir d8/d15/d1b/d1c/d27/d62/dcf/df0 0 2024-09-19T09:35:28.844 INFO:tasks.workunit.client.0.smithi112.stdout:5/819: dwrite d4/d9/d2a/d46/dde/f117 [0,4194304] 0 2024-09-19T09:35:28.844 INFO:tasks.workunit.client.0.smithi112.stdout:5/820: creat d4/dbf/f11f x:0 0 0 2024-09-19T09:35:28.847 INFO:tasks.workunit.client.0.smithi112.stdout:0/580: link d2/f30 d2/d39/fb7 0 2024-09-19T09:35:28.847 INFO:tasks.workunit.client.0.smithi112.stdout:0/581: fdatasync d2/f28 0 2024-09-19T09:35:28.847 INFO:tasks.workunit.client.0.smithi112.stdout:0/582: write d2/d39/f7d [1452761,100448] 0 2024-09-19T09:35:28.848 INFO:tasks.workunit.client.0.smithi112.stdout:2/626: symlink d0/d1/d5f/d78/lc1 0 2024-09-19T09:35:28.849 INFO:tasks.workunit.client.0.smithi112.stdout:1/556: rename dc/d13/c49 to dc/d26/d34/d36/d68/caa 0 2024-09-19T09:35:28.849 INFO:tasks.workunit.client.0.smithi112.stdout:1/557: write dc/d24/da2/fa6 [987181,50952] 0 2024-09-19T09:35:28.851 INFO:tasks.workunit.client.0.smithi112.stdout:3/758: symlink d8/d15/d1b/d1c/d27/d62/d99/lfe 0 2024-09-19T09:35:28.853 INFO:tasks.workunit.client.0.smithi112.stdout:5/821: truncate d4/f62 4180508 0 2024-09-19T09:35:28.853 INFO:tasks.workunit.client.0.smithi112.stdout:0/583: dread d2/f22 [0,4194304] 0 2024-09-19T09:35:28.855 INFO:tasks.workunit.client.0.smithi112.stdout:2/627: mknod d0/cc2 0 2024-09-19T09:35:28.855 INFO:tasks.workunit.client.0.smithi112.stdout:2/628: readlink d0/d1/d28/l12 0 2024-09-19T09:35:28.858 INFO:tasks.workunit.client.0.smithi112.stdout:1/558: rename dc/d13/f33 to dc/d59/d73/d88/da5/fab 0 2024-09-19T09:35:28.859 INFO:tasks.workunit.client.0.smithi112.stdout:9/500: dwrite df/d11/d14/d19/f33 [0,4194304] 0 2024-09-19T09:35:28.859 INFO:tasks.workunit.client.0.smithi112.stdout:9/501: readlink df/l8c 0 2024-09-19T09:35:28.859 INFO:tasks.workunit.client.0.smithi112.stdout:3/759: mknod d8/d15/d1b/d1c/d27/d62/cff 0 2024-09-19T09:35:28.861 INFO:tasks.workunit.client.0.smithi112.stdout:5/822: unlink d4/d9/d17/da6/db2/dce/le5 0 2024-09-19T09:35:28.864 INFO:tasks.workunit.client.0.smithi112.stdout:1/559: mkdir dc/d26/d34/d36/d68/d7d/d6a/dac 0 2024-09-19T09:35:28.864 INFO:tasks.workunit.client.0.smithi112.stdout:1/560: chown dc/d26/d34/d36/d68/d9f/la0 0 1 2024-09-19T09:35:28.868 INFO:tasks.workunit.client.0.smithi112.stdout:9/502: rmdir df/d11/d14/d19/d28/d89 39 2024-09-19T09:35:28.873 INFO:tasks.workunit.client.0.smithi112.stdout:3/760: symlink d8/d15/d1b/d1c/d27/d62/dcf/deb/l100 0 2024-09-19T09:35:28.875 INFO:tasks.workunit.client.0.smithi112.stdout:5/823: mknod d4/d29/d36/d70/c120 0 2024-09-19T09:35:28.875 INFO:tasks.workunit.client.0.smithi112.stdout:5/824: truncate d4/d9/d17/f8e 2434858 0 2024-09-19T09:35:28.877 INFO:tasks.workunit.client.0.smithi112.stdout:1/561: rename dc/d26/d34/l31 to dc/d26/d44/lad 0 2024-09-19T09:35:28.879 INFO:tasks.workunit.client.0.smithi112.stdout:9/503: creat df/d11/d14/d19/d1e/d97/fb2 x:0 0 0 2024-09-19T09:35:28.884 INFO:tasks.workunit.client.0.smithi112.stdout:0/584: dwrite d2/f22 [0,4194304] 0 2024-09-19T09:35:28.884 INFO:tasks.workunit.client.0.smithi112.stdout:5/825: dread d4/d9/d2a/d46/f55 [0,4194304] 0 2024-09-19T09:35:28.884 INFO:tasks.workunit.client.0.smithi112.stdout:5/826: write d4/d9/d17/da6/db2/dce/f10f [548700,104178] 0 2024-09-19T09:35:28.886 INFO:tasks.workunit.client.0.smithi112.stdout:1/562: mknod dc/d59/d73/d88/da5/cae 0 2024-09-19T09:35:28.889 INFO:tasks.workunit.client.0.smithi112.stdout:9/504: rename df/d11/d14/d51/d8b to df/d11/d14/d19/d40/daf/d6c/db3 0 2024-09-19T09:35:28.890 INFO:tasks.workunit.client.0.smithi112.stdout:3/761: rmdir d8/d15/d1b/d1c/d27/d2b 39 2024-09-19T09:35:28.895 INFO:tasks.workunit.client.0.smithi112.stdout:1/563: read dc/f69 [703663,109534] 0 2024-09-19T09:35:28.896 INFO:tasks.workunit.client.0.smithi112.stdout:5/827: mknod d4/d9/d17/d2f/c121 0 2024-09-19T09:35:28.896 INFO:tasks.workunit.client.0.smithi112.stdout:5/828: stat d4/d9/d17/dd6/lc5 0 2024-09-19T09:35:28.898 INFO:tasks.workunit.client.0.smithi112.stdout:9/505: creat df/d11/d14/d19/d40/fb4 x:0 0 0 2024-09-19T09:35:28.902 INFO:tasks.workunit.client.0.smithi112.stdout:0/585: dwrite d2/d59/fa4 [0,4194304] 0 2024-09-19T09:35:28.903 INFO:tasks.workunit.client.0.smithi112.stdout:5/829: rmdir d4/d9/d2a/d39/d88/dba 39 2024-09-19T09:35:28.903 INFO:tasks.workunit.client.0.smithi112.stdout:5/830: getdents d4/d9/d6b/dfa 0 2024-09-19T09:35:28.915 INFO:tasks.workunit.client.0.smithi112.stdout:5/831: symlink d4/d9/d2a/d39/d88/dba/l122 0 2024-09-19T09:35:28.915 INFO:tasks.workunit.client.0.smithi112.stdout:0/586: read d2/f30 [1986290,25533] 0 2024-09-19T09:35:28.916 INFO:tasks.workunit.client.0.smithi112.stdout:1/564: dwrite dc/d59/d73/f79 [0,4194304] 0 2024-09-19T09:35:28.916 INFO:tasks.workunit.client.0.smithi112.stdout:1/565: stat dc/d26/f70 0 2024-09-19T09:35:28.916 INFO:tasks.workunit.client.0.smithi112.stdout:9/506: dwrite df/d11/d14/d19/d40/daf/d6c/db3/d9e/fa9 [4194304,4194304] 0 2024-09-19T09:35:28.916 INFO:tasks.workunit.client.0.smithi112.stdout:9/507: fsync df/d11/d14/d51/f54 0 2024-09-19T09:35:28.917 INFO:tasks.workunit.client.0.smithi112.stdout:9/508: write df/d11/f5b [2082945,126993] 0 2024-09-19T09:35:28.917 INFO:tasks.workunit.client.0.smithi112.stdout:9/509: chown df/d11/d14/d51 0 1 2024-09-19T09:35:28.917 INFO:tasks.workunit.client.0.smithi112.stdout:3/762: rename d8/d48/d67 to d8/d15/d1b/d1c/db5/d101 0 2024-09-19T09:35:28.917 INFO:tasks.workunit.client.0.smithi112.stdout:9/510: rename df to df/d11/d14/d19/d66/db5 22 2024-09-19T09:35:28.917 INFO:tasks.workunit.client.0.smithi112.stdout:9/511: dread - df/d11/d14/d19/d66/d99/fa1 zero size 2024-09-19T09:35:28.918 INFO:tasks.workunit.client.0.smithi112.stdout:5/832: symlink d4/d9/d2a/d46/dde/l123 0 2024-09-19T09:35:28.918 INFO:tasks.workunit.client.0.smithi112.stdout:5/833: truncate d4/d9/fa7 4303250 0 2024-09-19T09:35:28.918 INFO:tasks.workunit.client.0.smithi112.stdout:5/834: truncate d4/d84/f99 914609 0 2024-09-19T09:35:28.918 INFO:tasks.workunit.client.0.smithi112.stdout:5/835: chown d4/d9/df6/da9/fe0 23 1 2024-09-19T09:35:28.919 INFO:tasks.workunit.client.0.smithi112.stdout:0/587: mkdir d2/d39/d3b/d44/db8 0 2024-09-19T09:35:28.922 INFO:tasks.workunit.client.0.smithi112.stdout:1/566: write dc/f53 [922264,129869] 0 2024-09-19T09:35:28.923 INFO:tasks.workunit.client.0.smithi112.stdout:0/588: link d2/d39/d3b/d44/d95/db5/l2f d2/d39/d3b/d8a/lb9 0 2024-09-19T09:35:28.926 INFO:tasks.workunit.client.0.smithi112.stdout:3/763: rename d8/d15/d1b/d1c/d43/d4f/f5f to d8/f102 0 2024-09-19T09:35:28.928 INFO:tasks.workunit.client.0.smithi112.stdout:5/836: write d4/d9/d17/d2f/d72/f42 [3467439,30923] 0 2024-09-19T09:35:28.928 INFO:tasks.workunit.client.0.smithi112.stdout:5/837: dread - d4/d9/d2a/d39/f105 zero size 2024-09-19T09:35:28.928 INFO:tasks.workunit.client.0.smithi112.stdout:0/589: unlink d2/d39/d3b/d44/f71 0 2024-09-19T09:35:28.932 INFO:tasks.workunit.client.0.smithi112.stdout:3/764: mkdir d8/d15/d1b/d1c/d27/d62/d99/d103 0 2024-09-19T09:35:28.932 INFO:tasks.workunit.client.0.smithi112.stdout:3/765: chown d8/d15/d1b/d1c/d68/d8d/fa7 1 1 2024-09-19T09:35:28.933 INFO:tasks.workunit.client.0.smithi112.stdout:0/590: getdents d2/d68 0 2024-09-19T09:35:28.933 INFO:tasks.workunit.client.0.smithi112.stdout:0/591: chown d2/f10 11 1 2024-09-19T09:35:28.934 INFO:tasks.workunit.client.0.smithi112.stdout:9/512: rename df/d11/d14/d51/f54 to df/d11/fb6 0 2024-09-19T09:35:28.934 INFO:tasks.workunit.client.0.smithi112.stdout:3/766: creat d8/d15/d1b/d1c/d68/d33/d8e/dc8/f104 x:0 0 0 2024-09-19T09:35:28.995 INFO:tasks.workunit.client.0.smithi112.stdout:0/592: mknod d2/d6e/d6f/cba 0 2024-09-19T09:35:28.995 INFO:tasks.workunit.client.0.smithi112.stdout:0/593: chown d2/d59/d7a 44633 1 2024-09-19T09:35:28.995 INFO:tasks.workunit.client.0.smithi112.stdout:0/594: write d2/f1f [1398916,2040] 0 2024-09-19T09:35:28.996 INFO:tasks.workunit.client.0.smithi112.stdout:1/567: rename dc/f1f to dc/d26/d44/faf 0 2024-09-19T09:35:28.996 INFO:tasks.workunit.client.0.smithi112.stdout:9/513: getdents df/d11/d14/d19/d40/daf/d6c 0 2024-09-19T09:35:29.079 INFO:tasks.workunit.client.0.smithi112.stdout:0/595: creat d2/d6e/d6f/fbb x:0 0 0 2024-09-19T09:35:29.082 INFO:tasks.workunit.client.0.smithi112.stdout:1/568: truncate f8 2784655 0 2024-09-19T09:35:29.082 INFO:tasks.workunit.client.0.smithi112.stdout:1/569: fsync dc/d26/d34/d36/d68/d7d/f8d 0 2024-09-19T09:35:29.082 INFO:tasks.workunit.client.0.smithi112.stdout:1/570: chown dc/d59/f80 408 1 2024-09-19T09:35:29.082 INFO:tasks.workunit.client.0.smithi112.stdout:1/571: fsync dc/d26/d34/d4c/f54 0 2024-09-19T09:35:29.082 INFO:tasks.workunit.client.0.smithi112.stdout:1/572: write dc/d59/d73/fa3 [590467,46668] 0 2024-09-19T09:35:29.082 INFO:tasks.workunit.client.0.smithi112.stdout:9/514: mkdir df/d35/d9d/db7 0 2024-09-19T09:35:29.085 INFO:tasks.workunit.client.0.smithi112.stdout:3/767: mkdir d8/d105 0 2024-09-19T09:35:29.086 INFO:tasks.workunit.client.0.smithi112.stdout:0/596: creat d2/d39/d3b/d44/fbc x:0 0 0 2024-09-19T09:35:29.090 INFO:tasks.workunit.client.0.smithi112.stdout:9/515: symlink df/d11/d14/d19/d66/d99/lb8 0 2024-09-19T09:35:29.093 INFO:tasks.workunit.client.0.smithi112.stdout:1/573: write dc/f20 [788993,95898] 0 2024-09-19T09:35:29.094 INFO:tasks.workunit.client.0.smithi112.stdout:3/768: creat d8/d15/d1b/d1c/d68/d33/d83/de4/f106 x:0 0 0 2024-09-19T09:35:29.095 INFO:tasks.workunit.client.0.smithi112.stdout:1/574: dread dc/d24/f46 [0,4194304] 0 2024-09-19T09:35:29.117 INFO:tasks.workunit.client.0.smithi112.stdout:5/838: rename d4/d29/d36/d70 to d4/d9/d3e/d124 0 2024-09-19T09:35:29.117 INFO:tasks.workunit.client.0.smithi112.stdout:5/839: chown d4/d9/fa3 57202 1 2024-09-19T09:35:29.117 INFO:tasks.workunit.client.0.smithi112.stdout:5/840: read - d4/d9/d2a/d39/f11e zero size 2024-09-19T09:35:29.117 INFO:tasks.workunit.client.0.smithi112.stdout:5/841: chown d4/d9/d2a/d39/f3a 22684 1 2024-09-19T09:35:29.118 INFO:tasks.workunit.client.0.smithi112.stdout:5/842: dread d4/d9/d17/dd6/fbd [0,4194304] 0 2024-09-19T09:35:29.119 INFO:tasks.workunit.client.0.smithi112.stdout:9/516: truncate df/f61 1205688 0 2024-09-19T09:35:29.120 INFO:tasks.workunit.client.0.smithi112.stdout:3/769: mkdir d8/d15/d1b/d1c/d107 0 2024-09-19T09:35:29.124 INFO:tasks.workunit.client.0.smithi112.stdout:5/843: dread d4/d9/d17/d30/fab [4194304,4194304] 0 2024-09-19T09:35:29.124 INFO:tasks.workunit.client.0.smithi112.stdout:5/844: chown d4/d29/d36/d56/c107 7734078 1 2024-09-19T09:35:29.124 INFO:tasks.workunit.client.0.smithi112.stdout:5/845: chown d4/d9/d17/d7c/led 6424642 1 2024-09-19T09:35:29.126 INFO:tasks.workunit.client.0.smithi112.stdout:0/597: rename d2/d39/d3b/d44/d95/db5/c8c to d2/d6e/db4/cbd 0 2024-09-19T09:35:29.129 INFO:tasks.workunit.client.0.smithi112.stdout:3/770: unlink d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/ldf 0 2024-09-19T09:35:29.129 INFO:tasks.workunit.client.0.smithi112.stdout:3/771: write d8/d15/d1b/d1c/d27/d2b/fc3 [735507,87450] 0 2024-09-19T09:35:29.129 INFO:tasks.workunit.client.0.smithi112.stdout:3/772: fdatasync d8/d15/fe9 0 2024-09-19T09:35:29.133 INFO:tasks.workunit.client.0.smithi112.stdout:0/598: dread d2/d68/f74 [0,4194304] 0 2024-09-19T09:35:29.134 INFO:tasks.workunit.client.0.smithi112.stdout:9/517: truncate df/f61 1507093 0 2024-09-19T09:35:29.138 INFO:tasks.workunit.client.0.smithi112.stdout:1/575: rmdir dc/d26 39 2024-09-19T09:35:29.138 INFO:tasks.workunit.client.0.smithi112.stdout:1/576: readlink dc/l91 0 2024-09-19T09:35:29.141 INFO:tasks.workunit.client.0.smithi112.stdout:1/577: dread dc/d24/f50 [0,4194304] 0 2024-09-19T09:35:29.142 INFO:tasks.workunit.client.0.smithi112.stdout:5/846: rename d4/d9/d17/d2f/d72/f9b to d4/d9/d17/db4/f125 0 2024-09-19T09:35:29.142 INFO:tasks.workunit.client.0.smithi112.stdout:5/847: stat d4/d9/d17/d2f/d7d/l65 0 2024-09-19T09:35:29.143 INFO:tasks.workunit.client.0.smithi112.stdout:0/599: dread d2/f4e [0,4194304] 0 2024-09-19T09:35:29.144 INFO:tasks.workunit.client.0.smithi112.stdout:0/600: fdatasync d2/d59/f5c 0 2024-09-19T09:35:29.144 INFO:tasks.workunit.client.0.smithi112.stdout:0/601: rename d2/d39 to d2/d39/d3b/d44/d95/dbe 22 2024-09-19T09:35:29.146 INFO:tasks.workunit.client.0.smithi112.stdout:3/773: unlink c5 0 2024-09-19T09:35:29.147 INFO:tasks.workunit.client.0.smithi112.stdout:9/518: mkdir df/db9 0 2024-09-19T09:35:29.148 INFO:tasks.workunit.client.0.smithi112.stdout:0/602: stat d2/d45/c86 0 2024-09-19T09:35:29.149 INFO:tasks.workunit.client.0.smithi112.stdout:3/774: symlink d8/d15/d1b/d1c/d27/d62/d99/da0/l108 0 2024-09-19T09:35:29.149 INFO:tasks.workunit.client.0.smithi112.stdout:3/775: creat d8/d15/d1b/d1c/d68/d33/d7b/f109 x:0 0 0 2024-09-19T09:35:29.150 INFO:tasks.workunit.client.0.smithi112.stdout:0/603: getdents d2/d39/d3b/d8a 0 2024-09-19T09:35:29.151 INFO:tasks.workunit.client.0.smithi112.stdout:9/519: symlink df/d11/lba 0 2024-09-19T09:35:29.152 INFO:tasks.workunit.client.0.smithi112.stdout:3/776: write d8/d15/d1b/f53 [427970,96605] 0 2024-09-19T09:35:29.152 INFO:tasks.workunit.client.0.smithi112.stdout:3/777: dread - d8/d15/d1b/d1c/d43/f94 zero size 2024-09-19T09:35:29.152 INFO:tasks.workunit.client.0.smithi112.stdout:9/520: rename df/c71 to df/d11/d14/d19/d28/cbb 0 2024-09-19T09:35:29.164 INFO:tasks.workunit.client.0.smithi112.stdout:0/604: write d2/d6e/da0/f7b [2690193,946] 0 2024-09-19T09:35:29.167 INFO:tasks.workunit.client.0.smithi112.stdout:0/605: truncate d2/f12 584351 0 2024-09-19T09:35:29.168 INFO:tasks.workunit.client.0.smithi112.stdout:5/848: dread d4/d9/d2a/d39/f3a [4194304,4194304] 0 2024-09-19T09:35:29.170 INFO:tasks.workunit.client.0.smithi112.stdout:5/849: creat d4/d9/d17/da6/f126 x:0 0 0 2024-09-19T09:35:29.171 INFO:tasks.workunit.client.0.smithi112.stdout:1/578: dwrite dc/d13/f1b [4194304,4194304] 0 2024-09-19T09:35:29.172 INFO:tasks.workunit.client.0.smithi112.stdout:5/850: mkdir d4/d29/d127 0 2024-09-19T09:35:29.177 INFO:tasks.workunit.client.0.smithi112.stdout:0/606: dread d2/f21 [0,4194304] 0 2024-09-19T09:35:29.178 INFO:tasks.workunit.client.0.smithi112.stdout:0/607: symlink d2/d39/d3b/lbf 0 2024-09-19T09:35:29.180 INFO:tasks.workunit.client.0.smithi112.stdout:3/778: dwrite f7 [4194304,4194304] 0 2024-09-19T09:35:29.184 INFO:tasks.workunit.client.0.smithi112.stdout:3/779: mknod d8/d15/d1b/d1c/d68/d33/d66/c10a 0 2024-09-19T09:35:29.186 INFO:tasks.workunit.client.0.smithi112.stdout:9/521: dwrite df/d11/d14/d19/d28/d95/fad [0,4194304] 0 2024-09-19T09:35:29.186 INFO:tasks.workunit.client.0.smithi112.stdout:9/522: chown df/d11/d14/d51 2994934 1 2024-09-19T09:35:29.186 INFO:tasks.workunit.client.0.smithi112.stdout:1/579: dread dc/d24/d45/f7a [0,4194304] 0 2024-09-19T09:35:29.186 INFO:tasks.workunit.client.0.smithi112.stdout:5/851: dread d4/d29/d36/d5f/f8b [4194304,4194304] 0 2024-09-19T09:35:29.186 INFO:tasks.workunit.client.0.smithi112.stdout:5/852: write d4/d9/d3e/d124/fd1 [1712535,12172] 0 2024-09-19T09:35:29.186 INFO:tasks.workunit.client.0.smithi112.stdout:5/853: write d4/d9/d2a/d46/dde/f10b [803613,57498] 0 2024-09-19T09:35:29.187 INFO:tasks.workunit.client.0.smithi112.stdout:3/780: write d8/d15/d1b/fc4 [84191,129065] 0 2024-09-19T09:35:29.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:28 smithi112 ceph-mon[27605]: pgmap v26: 65 pgs: 65 active+clean; 1.6 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 95 MiB/s rd, 105 MiB/s wr, 249 op/s 2024-09-19T09:35:29.191 INFO:tasks.workunit.client.0.smithi112.stdout:0/608: write d2/d59/d7a/f8b [1287130,51507] 0 2024-09-19T09:35:29.193 INFO:tasks.workunit.client.0.smithi112.stdout:1/580: read dc/d24/f12 [1766784,14075] 0 2024-09-19T09:35:29.206 INFO:tasks.workunit.client.0.smithi112.stdout:9/523: truncate df/d11/f74 2534210 0 2024-09-19T09:35:29.206 INFO:tasks.workunit.client.0.smithi112.stdout:9/524: write df/d35/fa0 [71618,105487] 0 2024-09-19T09:35:29.206 INFO:tasks.workunit.client.0.smithi112.stdout:9/525: dread - df/d11/d14/d19/d66/f9b zero size 2024-09-19T09:35:29.206 INFO:tasks.workunit.client.0.smithi112.stdout:9/526: creat df/d11/d14/d19/d40/d5c/fbc x:0 0 0 2024-09-19T09:35:29.207 INFO:tasks.workunit.client.0.smithi112.stdout:5/854: mkdir d4/d29/d128 0 2024-09-19T09:35:29.208 INFO:tasks.workunit.client.0.smithi112.stdout:5/855: write d4/d9/df6/da9/f100 [587638,51212] 0 2024-09-19T09:35:29.209 INFO:tasks.workunit.client.0.smithi112.stdout:5/856: readlink d4/d29/d36/l48 0 2024-09-19T09:35:29.209 INFO:tasks.workunit.client.0.smithi112.stdout:5/857: chown d4/d9/d3e/fda 3998029 1 2024-09-19T09:35:29.209 INFO:tasks.workunit.client.0.smithi112.stdout:5/858: chown d4/d9/d17/d30/f89 1389556 1 2024-09-19T09:35:29.211 INFO:tasks.workunit.client.0.smithi112.stdout:7/743: sync 2024-09-19T09:35:29.211 INFO:tasks.workunit.client.0.smithi112.stdout:2/629: sync 2024-09-19T09:35:29.211 INFO:tasks.workunit.client.0.smithi112.stdout:8/694: sync 2024-09-19T09:35:29.211 INFO:tasks.workunit.client.0.smithi112.stdout:6/739: sync 2024-09-19T09:35:29.211 INFO:tasks.workunit.client.0.smithi112.stdout:8/695: truncate d7/db/d21/d2e/fca 370785 0 2024-09-19T09:35:29.212 INFO:tasks.workunit.client.0.smithi112.stdout:6/740: dread d8/de/d18/f35 [0,4194304] 0 2024-09-19T09:35:29.212 INFO:tasks.workunit.client.0.smithi112.stdout:6/741: creat d8/de/d61/d70/db5/f104 x:0 0 0 2024-09-19T09:35:29.215 INFO:tasks.workunit.client.0.smithi112.stdout:9/527: write df/d11/f85 [2277538,95884] 0 2024-09-19T09:35:29.215 INFO:tasks.workunit.client.0.smithi112.stdout:0/609: mknod d2/d59/da1/cc0 0 2024-09-19T09:35:29.218 INFO:tasks.workunit.client.0.smithi112.stdout:1/581: getdents dc/d26/d34/d4c/d64 0 2024-09-19T09:35:29.218 INFO:tasks.workunit.client.0.smithi112.stdout:1/582: dread - dc/d26/d34/d36/d68/f92 zero size 2024-09-19T09:35:29.219 INFO:tasks.workunit.client.0.smithi112.stdout:1/583: creat dc/d24/da2/fb0 x:0 0 0 2024-09-19T09:35:29.228 INFO:tasks.workunit.client.0.smithi112.stdout:7/744: symlink d2/d2c/d54/d18/d39/d21/d71/l10c 0 2024-09-19T09:35:29.230 INFO:tasks.workunit.client.0.smithi112.stdout:5/859: dwrite d4/d29/ddf/f101 [0,4194304] 0 2024-09-19T09:35:29.230 INFO:tasks.workunit.client.0.smithi112.stdout:5/860: chown d4/d9/d17/dd6/lc5 1684148 1 2024-09-19T09:35:29.231 INFO:tasks.workunit.client.0.smithi112.stdout:6/742: rmdir d8/de/d17/d94 39 2024-09-19T09:35:29.234 INFO:tasks.workunit.client.0.smithi112.stdout:9/528: rmdir df/d11/d14/d19/d66/d5d 39 2024-09-19T09:35:29.236 INFO:tasks.workunit.client.0.smithi112.stdout:0/610: mkdir d2/d39/d3b/d44/db8/dc1 0 2024-09-19T09:35:29.236 INFO:tasks.workunit.client.0.smithi112.stdout:0/611: read d2/d59/f5c [120556,23554] 0 2024-09-19T09:35:29.238 INFO:tasks.workunit.client.0.smithi112.stdout:2/630: dread d0/d3e/d49/fad [0,4194304] 0 2024-09-19T09:35:29.239 INFO:tasks.workunit.client.0.smithi112.stdout:7/745: rename d2/d99/dd8/ce4 to d2/d2c/d54/d18/d8a/d7c/c10d 0 2024-09-19T09:35:29.239 INFO:tasks.workunit.client.0.smithi112.stdout:7/746: write d2/d2c/d54/d18/d39/d23/d35/d4c/f101 [3947316,105955] 0 2024-09-19T09:35:29.240 INFO:tasks.workunit.client.0.smithi112.stdout:0/612: dread d2/d39/d3b/d8a/f9f [0,4194304] 0 2024-09-19T09:35:29.240 INFO:tasks.workunit.client.0.smithi112.stdout:0/613: stat d2/f1f 0 2024-09-19T09:35:29.241 INFO:tasks.workunit.client.0.smithi112.stdout:0/614: dread d2/d39/d3b/d44/d95/db5/f47 [0,4194304] 0 2024-09-19T09:35:29.242 INFO:tasks.workunit.client.0.smithi112.stdout:5/861: mkdir d4/d9/d3e/d129 0 2024-09-19T09:35:29.243 INFO:tasks.workunit.client.0.smithi112.stdout:6/743: symlink d8/d11/d13/l105 0 2024-09-19T09:35:29.246 INFO:tasks.workunit.client.0.smithi112.stdout:9/529: symlink df/d35/d9d/lbd 0 2024-09-19T09:35:29.246 INFO:tasks.workunit.client.0.smithi112.stdout:9/530: chown df/d11/d14/d19/d40/daf/d6c/db3/d9e/ca4 15343789 1 2024-09-19T09:35:29.250 INFO:tasks.workunit.client.0.smithi112.stdout:7/747: mknod d2/d2c/d54/d18/da1/c10e 0 2024-09-19T09:35:29.250 INFO:tasks.workunit.client.0.smithi112.stdout:7/748: write d2/d2c/d54/d1a/f42 [1010926,124063] 0 2024-09-19T09:35:29.250 INFO:tasks.workunit.client.0.smithi112.stdout:7/749: fdatasync d2/d2c/d54/d18/d39/d23/d35/fc5 0 2024-09-19T09:35:29.251 INFO:tasks.workunit.client.0.smithi112.stdout:8/696: dwrite d7/db/d21/d2e/f7e [0,4194304] 0 2024-09-19T09:35:29.252 INFO:tasks.workunit.client.0.smithi112.stdout:1/584: dwrite f8 [0,4194304] 0 2024-09-19T09:35:29.253 INFO:tasks.workunit.client.0.smithi112.stdout:0/615: symlink d2/d6e/d75/lc2 0 2024-09-19T09:35:29.253 INFO:tasks.workunit.client.0.smithi112.stdout:0/616: write d2/fe [4897827,8997] 0 2024-09-19T09:35:29.256 INFO:tasks.workunit.client.0.smithi112.stdout:5/862: unlink d4/d9/d17/c64 0 2024-09-19T09:35:29.257 INFO:tasks.workunit.client.0.smithi112.stdout:5/863: readlink d4/d9/df6/da9/l108 0 2024-09-19T09:35:29.257 INFO:tasks.workunit.client.0.smithi112.stdout:9/531: dread fc [0,4194304] 0 2024-09-19T09:35:29.264 INFO:tasks.workunit.client.0.smithi112.stdout:7/750: dwrite d2/d2c/d54/d18/d39/d23/d35/d4c/f9d [4194304,4194304] 0 2024-09-19T09:35:29.264 INFO:tasks.workunit.client.0.smithi112.stdout:7/751: chown d2/d2c/d54/d18/d39/d23/d35/d76/feb 23317804 1 2024-09-19T09:35:29.266 INFO:tasks.workunit.client.0.smithi112.stdout:6/744: mknod d8/de/d18/c106 0 2024-09-19T09:35:29.268 INFO:tasks.workunit.client.0.smithi112.stdout:2/631: unlink d0/d6/c19 0 2024-09-19T09:35:29.274 INFO:tasks.workunit.client.0.smithi112.stdout:8/697: truncate d7/d65/f83 2576502 0 2024-09-19T09:35:29.274 INFO:tasks.workunit.client.0.smithi112.stdout:8/698: chown d7/d10/f1e 36159811 1 2024-09-19T09:35:29.277 INFO:tasks.workunit.client.0.smithi112.stdout:1/585: link dc/d26/l38 dc/d24/lb1 0 2024-09-19T09:35:29.278 INFO:tasks.workunit.client.0.smithi112.stdout:1/586: chown dc/d26/d34/d36/d68/f92 70079 1 2024-09-19T09:35:29.278 INFO:tasks.workunit.client.0.smithi112.stdout:1/587: write dc/d24/f52 [2406823,66819] 0 2024-09-19T09:35:29.279 INFO:tasks.workunit.client.0.smithi112.stdout:0/617: unlink d2/d39/d3b/d44/d95/db5/f33 0 2024-09-19T09:35:29.282 INFO:tasks.workunit.client.0.smithi112.stdout:5/864: creat d4/d9/d17/dd6/f12a x:0 0 0 2024-09-19T09:35:29.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:28 smithi191 ceph-mon[34834]: pgmap v26: 65 pgs: 65 active+clean; 1.6 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 95 MiB/s rd, 105 MiB/s wr, 249 op/s 2024-09-19T09:35:29.287 INFO:tasks.workunit.client.0.smithi112.stdout:7/752: fdatasync d2/f13 0 2024-09-19T09:35:29.287 INFO:tasks.workunit.client.0.smithi112.stdout:7/753: creat d2/d2c/d54/d18/d8a/f10f x:0 0 0 2024-09-19T09:35:29.290 INFO:tasks.workunit.client.0.smithi112.stdout:7/754: dread d2/d2c/d54/d1a/f72 [0,4194304] 0 2024-09-19T09:35:29.291 INFO:tasks.workunit.client.0.smithi112.stdout:6/745: symlink d8/de/d61/d70/d7b/d8a/l107 0 2024-09-19T09:35:29.291 INFO:tasks.workunit.client.0.smithi112.stdout:6/746: write d8/de/d61/d70/db5/f104 [966299,14464] 0 2024-09-19T09:35:29.292 INFO:tasks.workunit.client.0.smithi112.stdout:2/632: chown d0/d1/f1f 17633 1 2024-09-19T09:35:29.295 INFO:tasks.workunit.client.0.smithi112.stdout:8/699: mkdir d7/d65/dbb/dd6 0 2024-09-19T09:35:29.295 INFO:tasks.workunit.client.0.smithi112.stdout:8/700: chown d7/d10/d11/d50/l9d 0 1 2024-09-19T09:35:29.296 INFO:tasks.workunit.client.0.smithi112.stdout:0/618: dwrite d2/f90 [0,4194304] 0 2024-09-19T09:35:29.296 INFO:tasks.workunit.client.0.smithi112.stdout:0/619: readlink d2/d39/d3b/d44/l70 0 2024-09-19T09:35:29.298 INFO:tasks.workunit.client.0.smithi112.stdout:1/588: mknod dc/d59/d73/d88/cb2 0 2024-09-19T09:35:29.299 INFO:tasks.workunit.client.0.smithi112.stdout:1/589: dread - dc/d59/d73/d88/fa1 zero size 2024-09-19T09:35:29.300 INFO:tasks.workunit.client.0.smithi112.stdout:5/865: creat d4/d9/d3e/d124/f12b x:0 0 0 2024-09-19T09:35:29.307 INFO:tasks.workunit.client.0.smithi112.stdout:6/747: mkdir d8/de/d17/d94/d108 0 2024-09-19T09:35:29.308 INFO:tasks.workunit.client.0.smithi112.stdout:2/633: dwrite d0/d3e/d50/d57/fb3 [0,4194304] 0 2024-09-19T09:35:29.308 INFO:tasks.workunit.client.0.smithi112.stdout:2/634: truncate d0/d3e/fab 106306 0 2024-09-19T09:35:29.312 INFO:tasks.workunit.client.0.smithi112.stdout:8/701: creat d7/d10/d11/d55/d9e/fd7 x:0 0 0 2024-09-19T09:35:29.316 INFO:tasks.workunit.client.0.smithi112.stdout:0/620: creat d2/d6e/da0/fc3 x:0 0 0 2024-09-19T09:35:29.316 INFO:tasks.workunit.client.0.smithi112.stdout:0/621: creat d2/d39/d3b/dab/fc4 x:0 0 0 2024-09-19T09:35:29.321 INFO:tasks.workunit.client.0.smithi112.stdout:5/866: dwrite d4/d9/d3e/f77 [4194304,4194304] 0 2024-09-19T09:35:29.325 INFO:tasks.workunit.client.0.smithi112.stdout:9/532: rmdir df/daa 0 2024-09-19T09:35:29.334 INFO:tasks.workunit.client.0.smithi112.stdout:8/702: rmdir d7/d10/d11/d55/d9e/da1/dc5 0 2024-09-19T09:35:29.334 INFO:tasks.workunit.client.0.smithi112.stdout:8/703: getdents d7/db/d21/d2e/d42/dc8 0 2024-09-19T09:35:29.337 INFO:tasks.workunit.client.0.smithi112.stdout:0/622: unlink d2/d6e/da0/l96 0 2024-09-19T09:35:29.339 INFO:tasks.workunit.client.0.smithi112.stdout:5/867: dwrite d4/d9/d3e/fda [0,4194304] 0 2024-09-19T09:35:29.339 INFO:tasks.workunit.client.0.smithi112.stdout:5/868: write d4/d9/d2a/d39/f105 [953356,72811] 0 2024-09-19T09:35:29.339 INFO:tasks.workunit.client.0.smithi112.stdout:1/590: rmdir dc/d13 39 2024-09-19T09:35:29.343 INFO:tasks.workunit.client.0.smithi112.stdout:0/623: dread d2/f4 [0,4194304] 0 2024-09-19T09:35:29.349 INFO:tasks.workunit.client.0.smithi112.stdout:1/591: write dc/d26/d34/d4c/f89 [4011366,77058] 0 2024-09-19T09:35:29.349 INFO:tasks.workunit.client.0.smithi112.stdout:1/592: readlink dc/d24/d45/l83 0 2024-09-19T09:35:29.351 INFO:tasks.workunit.client.0.smithi112.stdout:2/635: creat d0/d1/d28/d88/da3/fc3 x:0 0 0 2024-09-19T09:35:29.352 INFO:tasks.workunit.client.0.smithi112.stdout:8/704: mkdir d7/db/d21/d3b/dd8 0 2024-09-19T09:35:29.352 INFO:tasks.workunit.client.0.smithi112.stdout:8/705: getdents d7/db/d21/d2e/d8c/dc0 0 2024-09-19T09:35:29.352 INFO:tasks.workunit.client.0.smithi112.stdout:8/706: fdatasync d7/db/d21/d3b/d56/d3c/f94 0 2024-09-19T09:35:29.352 INFO:tasks.workunit.client.0.smithi112.stdout:8/707: read - d7/db/d21/d3b/d56/d3c/fa4 zero size 2024-09-19T09:35:29.353 INFO:tasks.workunit.client.0.smithi112.stdout:8/708: dread - d7/d10/d11/d50/f82 zero size 2024-09-19T09:35:29.353 INFO:tasks.workunit.client.0.smithi112.stdout:0/624: mknod d2/d39/d3b/d44/db8/cc5 0 2024-09-19T09:35:29.357 INFO:tasks.workunit.client.0.smithi112.stdout:1/593: mknod dc/d59/d73/cb3 0 2024-09-19T09:35:29.360 INFO:tasks.workunit.client.0.smithi112.stdout:8/709: creat d7/d10/fd9 x:0 0 0 2024-09-19T09:35:29.360 INFO:tasks.workunit.client.0.smithi112.stdout:8/710: fdatasync d7/db/d21/d3b/d56/d3c/d79/fb4 0 2024-09-19T09:35:29.360 INFO:tasks.workunit.client.0.smithi112.stdout:8/711: fdatasync d7/db/d21/d3b/d56/d48/f95 0 2024-09-19T09:35:29.360 INFO:tasks.workunit.client.0.smithi112.stdout:8/712: creat d7/d10/d11/d62/fda x:0 0 0 2024-09-19T09:35:29.360 INFO:tasks.workunit.client.0.smithi112.stdout:8/713: creat d7/db/d21/d2e/d42/d57/fdb x:0 0 0 2024-09-19T09:35:29.366 INFO:tasks.workunit.client.0.smithi112.stdout:7/755: rename d2/d2c/d54/d18/d8a to d2/d2c/d54/d18/db4/d110 0 2024-09-19T09:35:29.367 INFO:tasks.workunit.client.0.smithi112.stdout:1/594: mkdir dc/d26/d34/d36/d68/d7d/d6a/db4 0 2024-09-19T09:35:29.367 INFO:tasks.workunit.client.0.smithi112.stdout:1/595: readlink dc/d13/l2f 0 2024-09-19T09:35:29.370 INFO:tasks.workunit.client.0.smithi112.stdout:9/533: rename l8 to df/d11/d14/d19/d66/d99/lbe 0 2024-09-19T09:35:29.372 INFO:tasks.workunit.client.0.smithi112.stdout:7/756: creat d2/d2c/d54/d18/db4/d110/dcc/f111 x:0 0 0 2024-09-19T09:35:29.372 INFO:tasks.workunit.client.0.smithi112.stdout:7/757: creat d2/d2c/d54/d18/d39/d23/d35/f112 x:0 0 0 2024-09-19T09:35:29.372 INFO:tasks.workunit.client.0.smithi112.stdout:7/758: write d2/d2c/d54/d18/d39/d23/d35/fad [1597058,70162] 0 2024-09-19T09:35:29.375 INFO:tasks.workunit.client.0.smithi112.stdout:7/759: mknod d2/d2c/d54/c113 0 2024-09-19T09:35:29.377 INFO:tasks.workunit.client.0.smithi112.stdout:7/760: write d2/d99/f9b [692712,30399] 0 2024-09-19T09:35:29.377 INFO:tasks.workunit.client.0.smithi112.stdout:7/761: fsync d2/d2c/d54/d18/f3e 0 2024-09-19T09:35:29.378 INFO:tasks.workunit.client.0.smithi112.stdout:7/762: rmdir d2/d99 39 2024-09-19T09:35:29.379 INFO:tasks.workunit.client.0.smithi112.stdout:7/763: read - d2/d2c/d54/d18/d39/d23/dfb/fc6 zero size 2024-09-19T09:35:29.379 INFO:tasks.workunit.client.0.smithi112.stdout:7/764: stat d2/d2c/d54/d18/d39/d21/d45/d4d/l61 0 2024-09-19T09:35:29.386 INFO:tasks.workunit.client.0.smithi112.stdout:2/636: dwrite d0/d3e/d49/f94 [0,4194304] 0 2024-09-19T09:35:29.390 INFO:tasks.workunit.client.0.smithi112.stdout:8/714: dwrite d7/db/d21/d3b/d56/d48/fa8 [0,4194304] 0 2024-09-19T09:35:29.391 INFO:tasks.workunit.client.0.smithi112.stdout:2/637: symlink d0/d1/d5f/d78/db0/lc4 0 2024-09-19T09:35:29.395 INFO:tasks.workunit.client.0.smithi112.stdout:1/596: dwrite dc/f53 [0,4194304] 0 2024-09-19T09:35:29.395 INFO:tasks.workunit.client.0.smithi112.stdout:1/597: fdatasync dc/d26/f29 0 2024-09-19T09:35:29.396 INFO:tasks.workunit.client.0.smithi112.stdout:2/638: dread d0/d3e/d50/f6a [0,4194304] 0 2024-09-19T09:35:29.396 INFO:tasks.workunit.client.0.smithi112.stdout:7/765: dwrite d2/d2c/d54/d1a/f42 [4194304,4194304] 0 2024-09-19T09:35:29.396 INFO:tasks.workunit.client.0.smithi112.stdout:1/598: creat dc/d26/d34/d36/d68/d7d/d6a/db4/fb5 x:0 0 0 2024-09-19T09:35:29.396 INFO:tasks.workunit.client.0.smithi112.stdout:1/599: fdatasync dc/d26/d34/f97 0 2024-09-19T09:35:29.400 INFO:tasks.workunit.client.0.smithi112.stdout:2/639: symlink d0/d3e/d61/lc5 0 2024-09-19T09:35:29.400 INFO:tasks.workunit.client.0.smithi112.stdout:7/766: rmdir d2/d2c/d54/d18/d39/d23 39 2024-09-19T09:35:29.401 INFO:tasks.workunit.client.0.smithi112.stdout:2/640: mkdir d0/d1/d5f/dc6 0 2024-09-19T09:35:29.401 INFO:tasks.workunit.client.0.smithi112.stdout:2/641: readlink d0/d1/d28/l8d 0 2024-09-19T09:35:29.401 INFO:tasks.workunit.client.0.smithi112.stdout:7/767: mknod d2/d2c/d54/d18/d39/d23/d35/c114 0 2024-09-19T09:35:29.402 INFO:tasks.workunit.client.0.smithi112.stdout:7/768: chown d2/d2c/d54/d18/db4/de7/dfa 2814692 1 2024-09-19T09:35:29.403 INFO:tasks.workunit.client.0.smithi112.stdout:2/642: mknod d0/d3e/d50/d57/d80/cc7 0 2024-09-19T09:35:29.403 INFO:tasks.workunit.client.0.smithi112.stdout:2/643: fsync d0/d3e/f66 0 2024-09-19T09:35:29.404 INFO:tasks.workunit.client.0.smithi112.stdout:7/769: truncate d2/d2c/d54/d1a/f62 3202245 0 2024-09-19T09:35:29.406 INFO:tasks.workunit.client.0.smithi112.stdout:2/644: unlink d0/d1/d28/d67/f92 0 2024-09-19T09:35:29.407 INFO:tasks.workunit.client.0.smithi112.stdout:7/770: creat d2/d2c/d54/d18/db4/d110/f115 x:0 0 0 2024-09-19T09:35:29.408 INFO:tasks.workunit.client.0.smithi112.stdout:2/645: unlink d0/d3e/d61/c75 0 2024-09-19T09:35:29.409 INFO:tasks.workunit.client.0.smithi112.stdout:8/715: dwrite d7/db/d21/d2e/f5e [0,4194304] 0 2024-09-19T09:35:29.410 INFO:tasks.workunit.client.0.smithi112.stdout:7/771: rename d2/d2c/d54/d18/d39/d23/dfb/f58 to d2/d2c/d54/d18/db4/d110/dd7/f116 0 2024-09-19T09:35:29.411 INFO:tasks.workunit.client.0.smithi112.stdout:2/646: mkdir d0/d1/d5f/dc6/dc8 0 2024-09-19T09:35:29.416 INFO:tasks.workunit.client.0.smithi112.stdout:8/716: rename d7/d67/d92 to d7/d65/dbb/ddc 0 2024-09-19T09:35:29.419 INFO:tasks.workunit.client.0.smithi112.stdout:7/772: rename d2/d2c/d54/d18/d85/lf5 to d2/d2c/l117 0 2024-09-19T09:35:29.420 INFO:tasks.workunit.client.0.smithi112.stdout:8/717: truncate d7/d67/f4c 2048604 0 2024-09-19T09:35:29.420 INFO:tasks.workunit.client.0.smithi112.stdout:8/718: write d7/d10/d11/f96 [1158184,52899] 0 2024-09-19T09:35:29.433 INFO:tasks.workunit.client.0.smithi112.stdout:2/647: dwrite d0/d3e/d49/f94 [0,4194304] 0 2024-09-19T09:35:29.433 INFO:tasks.workunit.client.0.smithi112.stdout:2/648: fdatasync d0/d3e/fab 0 2024-09-19T09:35:29.437 INFO:tasks.workunit.client.0.smithi112.stdout:2/649: rmdir d0/d1/d5f/dc6 39 2024-09-19T09:35:29.437 INFO:tasks.workunit.client.0.smithi112.stdout:2/650: creat d0/d3e/fc9 x:0 0 0 2024-09-19T09:35:29.438 INFO:tasks.workunit.client.0.smithi112.stdout:8/719: write d7/db/fbd [3579669,88789] 0 2024-09-19T09:35:29.438 INFO:tasks.workunit.client.0.smithi112.stdout:8/720: chown d7/d67/f5d 7574172 1 2024-09-19T09:35:29.438 INFO:tasks.workunit.client.0.smithi112.stdout:8/721: write d7/d10/d11/d33/f54 [191711,29234] 0 2024-09-19T09:35:29.440 INFO:tasks.workunit.client.0.smithi112.stdout:2/651: truncate d0/d1/d28/d67/f95 3837043 0 2024-09-19T09:35:29.440 INFO:tasks.workunit.client.0.smithi112.stdout:2/652: readlink d0/d3e/d61/lc5 0 2024-09-19T09:35:29.441 INFO:tasks.workunit.client.0.smithi112.stdout:2/653: creat d0/d3e/d50/d57/d5a/d56/fca x:0 0 0 2024-09-19T09:35:29.443 INFO:tasks.workunit.client.0.smithi112.stdout:2/654: link d0/d1/d5f/d78/db0/f53 d0/d6/d24/d96/fcb 0 2024-09-19T09:35:29.449 INFO:tasks.workunit.client.0.smithi112.stdout:7/773: dwrite d2/d2c/d54/d18/d39/d23/f7a [0,4194304] 0 2024-09-19T09:35:29.468 INFO:tasks.workunit.client.0.smithi112.stdout:8/722: rename d7/d65/dbb/ddc to d7/d10/d11/d50/ddd 0 2024-09-19T09:35:29.470 INFO:tasks.workunit.client.0.smithi112.stdout:8/723: link d7/db/d21/d2e/d8c/d97/dc3/cce d7/db/d21/d3b/d56/d48/cde 0 2024-09-19T09:35:29.471 INFO:tasks.workunit.client.0.smithi112.stdout:8/724: mkdir d7/db/d21/d3b/d56/d3c/d79/ddf 0 2024-09-19T09:35:29.472 INFO:tasks.workunit.client.0.smithi112.stdout:7/774: dwrite d2/d2c/d54/d18/db4/de7/ff4 [0,4194304] 0 2024-09-19T09:35:29.473 INFO:tasks.workunit.client.0.smithi112.stdout:2/655: dwrite d0/d3e/d50/f64 [0,4194304] 0 2024-09-19T09:35:29.480 INFO:tasks.workunit.client.0.smithi112.stdout:7/775: mknod d2/c118 0 2024-09-19T09:35:29.483 INFO:tasks.workunit.client.0.smithi112.stdout:7/776: creat d2/d2c/d54/d18/d39/d23/f119 x:0 0 0 2024-09-19T09:35:29.485 INFO:tasks.workunit.client.0.smithi112.stdout:7/777: creat d2/d2c/d54/d18/d39/d21/f11a x:0 0 0 2024-09-19T09:35:29.487 INFO:tasks.workunit.client.0.smithi112.stdout:7/778: mknod d2/d2c/d54/d18/d39/d23/c11b 0 2024-09-19T09:35:29.492 INFO:tasks.workunit.client.0.smithi112.stdout:7/779: link d2/c7 d2/d2c/d54/d18/d39/d23/dfb/c11c 0 2024-09-19T09:35:29.494 INFO:tasks.workunit.client.0.smithi112.stdout:7/780: mkdir d2/d2c/d11d 0 2024-09-19T09:35:29.495 INFO:tasks.workunit.client.0.smithi112.stdout:7/781: truncate d2/d2c/d54/d18/db4/d110/ff1 829756 0 2024-09-19T09:35:29.498 INFO:tasks.workunit.client.0.smithi112.stdout:7/782: rename d2/d2c/d54/d18/d39/d21/d71/de8 to d2/d2c/d54/d18/d11e 0 2024-09-19T09:35:29.501 INFO:tasks.workunit.client.0.smithi112.stdout:7/783: truncate d2/f59 851941 0 2024-09-19T09:35:29.503 INFO:tasks.workunit.client.0.smithi112.stdout:2/656: dwrite d0/d3e/d50/d57/d5a/d27/f73 [0,4194304] 0 2024-09-19T09:35:29.503 INFO:tasks.workunit.client.0.smithi112.stdout:8/725: dwrite d7/db/d21/d3b/d56/d48/f95 [0,4194304] 0 2024-09-19T09:35:29.503 INFO:tasks.workunit.client.0.smithi112.stdout:7/784: link d2/d2c/d54/d18/d39/d23/l4f d2/d2c/d54/d18/db4/d110/dd7/l11f 0 2024-09-19T09:35:29.504 INFO:tasks.workunit.client.0.smithi112.stdout:7/785: creat d2/d2c/d54/d18/d39/d21/d71/f120 x:0 0 0 2024-09-19T09:35:29.504 INFO:tasks.workunit.client.0.smithi112.stdout:7/786: chown d2/d2c/d54/d18/d39/d23/d35/d76/cb3 28 1 2024-09-19T09:35:29.507 INFO:tasks.workunit.client.0.smithi112.stdout:8/726: link d7/d10/d11/d62/laf d7/db/d21/d3b/d56/d3c/le0 0 2024-09-19T09:35:29.511 INFO:tasks.workunit.client.0.smithi112.stdout:7/787: mknod d2/d2c/d54/d18/db4/d110/d7c/dec/c121 0 2024-09-19T09:35:29.511 INFO:tasks.workunit.client.0.smithi112.stdout:7/788: truncate d2/d2c/d54/d18/d39/d21/d45/dda/fe2 435496 0 2024-09-19T09:35:29.517 INFO:tasks.workunit.client.0.smithi112.stdout:2/657: write d0/d3e/d50/f64 [3866910,86284] 0 2024-09-19T09:35:29.518 INFO:tasks.workunit.client.0.smithi112.stdout:7/789: dread d2/d2c/d54/d18/d39/d21/d71/f81 [0,4194304] 0 2024-09-19T09:35:29.520 INFO:tasks.workunit.client.0.smithi112.stdout:7/790: mkdir d2/d2c/d54/d18/d39/d23/d35/d4c/d122 0 2024-09-19T09:35:29.523 INFO:tasks.workunit.client.0.smithi112.stdout:7/791: getdents d2/d2c 0 2024-09-19T09:35:29.525 INFO:tasks.workunit.client.0.smithi112.stdout:8/727: dwrite d7/db/fa2 [4194304,4194304] 0 2024-09-19T09:35:29.527 INFO:tasks.workunit.client.0.smithi112.stdout:2/658: dread d0/d6/d24/f39 [0,4194304] 0 2024-09-19T09:35:29.531 INFO:tasks.workunit.client.0.smithi112.stdout:7/792: dread d2/d99/fb0 [0,4194304] 0 2024-09-19T09:35:29.531 INFO:tasks.workunit.client.0.smithi112.stdout:7/793: chown d2/d2c/f69 237 1 2024-09-19T09:35:29.532 INFO:tasks.workunit.client.0.smithi112.stdout:7/794: read - d2/d2c/d54/d18/d39/d23/dfb/fc6 zero size 2024-09-19T09:35:29.532 INFO:tasks.workunit.client.0.smithi112.stdout:7/795: chown d2/d2c/d54/d18/db4/d110/dd7/l11f 14 1 2024-09-19T09:35:29.535 INFO:tasks.workunit.client.0.smithi112.stdout:8/728: dread d7/d67/f5d [0,4194304] 0 2024-09-19T09:35:29.539 INFO:tasks.workunit.client.0.smithi112.stdout:8/729: rmdir d7/db/d21/d3b/d56/d48 39 2024-09-19T09:35:29.539 INFO:tasks.workunit.client.0.smithi112.stdout:8/730: dread - d7/d10/fd9 zero size 2024-09-19T09:35:29.551 INFO:tasks.workunit.client.0.smithi112.stdout:8/731: write d7/db/f45 [1239764,26735] 0 2024-09-19T09:35:29.552 INFO:tasks.workunit.client.0.smithi112.stdout:8/732: creat d7/db/d21/d3b/d56/d3c/d79/d85/fe1 x:0 0 0 2024-09-19T09:35:29.558 INFO:tasks.workunit.client.0.smithi112.stdout:2/659: dwrite d0/d1/f1f [0,4194304] 0 2024-09-19T09:35:29.559 INFO:tasks.workunit.client.0.smithi112.stdout:7/796: dwrite d2/d2c/d54/d18/d39/d23/d35/d76/f8d [0,4194304] 0 2024-09-19T09:35:29.562 INFO:tasks.workunit.client.0.smithi112.stdout:7/797: mknod d2/d2c/d54/d18/d39/d23/d35/d4c/d70/dcf/c123 0 2024-09-19T09:35:29.564 INFO:tasks.workunit.client.0.smithi112.stdout:2/660: rmdir d0/d6 39 2024-09-19T09:35:29.575 INFO:tasks.workunit.client.0.smithi112.stdout:2/661: write d0/d3e/d50/d57/d5a/d56/f68 [3394604,27404] 0 2024-09-19T09:35:29.575 INFO:tasks.workunit.client.0.smithi112.stdout:8/733: dwrite d7/db/d21/d3b/d56/d48/f95 [0,4194304] 0 2024-09-19T09:35:29.575 INFO:tasks.workunit.client.0.smithi112.stdout:2/662: write d0/d1/d5f/d78/fa4 [848654,118676] 0 2024-09-19T09:35:29.577 INFO:tasks.workunit.client.0.smithi112.stdout:8/734: mknod d7/ce2 0 2024-09-19T09:35:29.578 INFO:tasks.workunit.client.0.smithi112.stdout:7/798: dwrite d2/d2c/d54/d18/db4/fbd [0,4194304] 0 2024-09-19T09:35:29.578 INFO:tasks.workunit.client.0.smithi112.stdout:7/799: fsync d2/d2c/d54/d18/d39/d21/d45/d4d/f68 0 2024-09-19T09:35:29.578 INFO:tasks.workunit.client.0.smithi112.stdout:7/800: chown d2/d2c/d54/d18/d39/d23/d35/d4c/d70/l77 29 1 2024-09-19T09:35:29.579 INFO:tasks.workunit.client.0.smithi112.stdout:2/663: symlink d0/d1/d5f/d78/db0/d9a/dae/lcc 0 2024-09-19T09:35:29.579 INFO:tasks.workunit.client.0.smithi112.stdout:8/735: symlink d7/d10/d11/d55/d9e/da1/le3 0 2024-09-19T09:35:29.581 INFO:tasks.workunit.client.0.smithi112.stdout:7/801: dread d2/d2c/d54/d18/d39/d21/d71/fde [0,4194304] 0 2024-09-19T09:35:29.581 INFO:tasks.workunit.client.0.smithi112.stdout:2/664: mkdir d0/d1/d28/d88/dcd 0 2024-09-19T09:35:29.582 INFO:tasks.workunit.client.0.smithi112.stdout:2/665: write d0/d3e/d50/d57/f79 [657659,24210] 0 2024-09-19T09:35:29.582 INFO:tasks.workunit.client.0.smithi112.stdout:8/736: symlink d7/d10/d11/d50/ddd/db8/le4 0 2024-09-19T09:35:29.584 INFO:tasks.workunit.client.0.smithi112.stdout:7/802: getdents d2/d2c/d54/d18/db4/d110/d7c 0 2024-09-19T09:35:29.588 INFO:tasks.workunit.client.0.smithi112.stdout:2/666: fsync d0/d1/f22 0 2024-09-19T09:35:29.588 INFO:tasks.workunit.client.0.smithi112.stdout:2/667: stat d0/d1/d28/d67/f70 0 2024-09-19T09:35:29.591 INFO:tasks.workunit.client.0.smithi112.stdout:8/737: rename d7/db/fbd to d7/db/d21/d2e/d42/d57/fe5 0 2024-09-19T09:35:29.594 INFO:tasks.workunit.client.0.smithi112.stdout:7/803: rmdir d2/d2c/d54/d18/db4/d110/d7c/db1/dc8 39 2024-09-19T09:35:29.594 INFO:tasks.workunit.client.0.smithi112.stdout:7/804: fdatasync d2/d99/dd8/fe5 0 2024-09-19T09:35:29.595 INFO:tasks.workunit.client.0.smithi112.stdout:2/668: write d0/d1/f6f [1001127,74466] 0 2024-09-19T09:35:29.595 INFO:tasks.workunit.client.0.smithi112.stdout:2/669: creat d0/d1/d28/d67/fce x:0 0 0 2024-09-19T09:35:29.595 INFO:tasks.workunit.client.0.smithi112.stdout:2/670: fsync d0/d3e/d50/d57/d5a/f11 0 2024-09-19T09:35:29.595 INFO:tasks.workunit.client.0.smithi112.stdout:2/671: fdatasync d0/d3e/d50/d57/d5a/d27/f89 0 2024-09-19T09:35:29.597 INFO:tasks.workunit.client.0.smithi112.stdout:7/805: truncate d2/d2c/d54/d18/d39/d23/dfb/fe3 1060244 0 2024-09-19T09:35:29.599 INFO:tasks.workunit.client.0.smithi112.stdout:7/806: mknod d2/d2c/d54/d18/db4/d110/d7c/dec/c124 0 2024-09-19T09:35:29.599 INFO:tasks.workunit.client.0.smithi112.stdout:7/807: chown d2/d2c/d54/d18/d39/d23/dfb/d107 16632864 1 2024-09-19T09:35:29.600 INFO:tasks.workunit.client.0.smithi112.stdout:7/808: creat d2/d2c/d54/d18/d39/d23/d35/d4c/d70/dcf/f125 x:0 0 0 2024-09-19T09:35:29.605 INFO:tasks.workunit.client.0.smithi112.stdout:7/809: mkdir d2/d2c/d54/d18/d39/d23/d35/d4c/d70/dcf/d126 0 2024-09-19T09:35:29.605 INFO:tasks.workunit.client.0.smithi112.stdout:7/810: mkdir d2/d2c/d54/d18/db4/de7/d127 0 2024-09-19T09:35:29.605 INFO:tasks.workunit.client.0.smithi112.stdout:8/738: dwrite d7/d10/d11/d55/d9e/fd7 [0,4194304] 0 2024-09-19T09:35:29.605 INFO:tasks.workunit.client.0.smithi112.stdout:2/672: write d0/d3e/d50/d57/fb3 [1422572,60930] 0 2024-09-19T09:35:29.606 INFO:tasks.workunit.client.0.smithi112.stdout:7/811: mkdir d2/d2c/d54/dba/dee/d128 0 2024-09-19T09:35:29.606 INFO:tasks.workunit.client.0.smithi112.stdout:7/812: readlink d2/d2c/d54/d18/d85/dcd/ld4 0 2024-09-19T09:35:29.612 INFO:tasks.workunit.client.0.smithi112.stdout:2/673: symlink d0/d1/d28/d88/da3/lcf 0 2024-09-19T09:35:29.613 INFO:tasks.workunit.client.0.smithi112.stdout:2/674: write d0/d3e/d50/d57/d80/faa [1285817,65219] 0 2024-09-19T09:35:29.614 INFO:tasks.workunit.client.0.smithi112.stdout:8/739: dread d7/d10/d11/f2b [0,4194304] 0 2024-09-19T09:35:29.614 INFO:tasks.workunit.client.0.smithi112.stdout:8/740: fsync d7/d10/d11/d50/ddd/db8/fd4 0 2024-09-19T09:35:29.621 INFO:tasks.workunit.client.0.smithi112.stdout:8/741: dread d7/d67/f5d [0,4194304] 0 2024-09-19T09:35:29.624 INFO:tasks.workunit.client.0.smithi112.stdout:8/742: mkdir d7/db/d21/d2e/d8c/d97/dc3/dc9/de6 0 2024-09-19T09:35:29.624 INFO:tasks.workunit.client.0.smithi112.stdout:8/743: chown d7/d10/d11/d33/c9b 7713 1 2024-09-19T09:35:29.625 INFO:tasks.workunit.client.0.smithi112.stdout:8/744: mknod d7/db/d21/d72/ce7 0 2024-09-19T09:35:29.632 INFO:tasks.workunit.client.0.smithi112.stdout:7/813: dwrite d2/d2c/d54/d18/d39/d23/dfb/fbf [0,4194304] 0 2024-09-19T09:35:29.632 INFO:tasks.workunit.client.0.smithi112.stdout:7/814: creat d2/d2c/d54/d1a/f129 x:0 0 0 2024-09-19T09:35:29.636 INFO:tasks.workunit.client.0.smithi112.stdout:8/745: dread d7/d67/f5d [0,4194304] 0 2024-09-19T09:35:29.636 INFO:tasks.workunit.client.0.smithi112.stdout:2/675: dwrite d0/d6/d24/fbc [0,4194304] 0 2024-09-19T09:35:29.636 INFO:tasks.workunit.client.0.smithi112.stdout:8/746: creat d7/d10/fe8 x:0 0 0 2024-09-19T09:35:29.640 INFO:tasks.workunit.client.0.smithi112.stdout:7/815: rename d2/d2c/d54/d18/d39/d23/d35/d4c/d70/l77 to d2/d2c/d54/d18/d39/d23/d35/d4c/l12a 0 2024-09-19T09:35:29.649 INFO:tasks.workunit.client.0.smithi112.stdout:2/676: rename d0/d6/d24/fbc to d0/d6/d24/fd0 0 2024-09-19T09:35:29.650 INFO:tasks.workunit.client.0.smithi112.stdout:8/747: link d7/d10/d11/d33/f7a d7/d10/d11/d50/fe9 0 2024-09-19T09:35:29.651 INFO:tasks.workunit.client.0.smithi112.stdout:7/816: rename d2/d2c/d54/d18/d39/d21/d45/fa5 to d2/d2c/d54/d18/db4/d110/f12b 0 2024-09-19T09:35:29.651 INFO:tasks.workunit.client.0.smithi112.stdout:7/817: fsync d2/d2c/d54/d18/d39/d23/dfb/f5a 0 2024-09-19T09:35:29.651 INFO:tasks.workunit.client.0.smithi112.stdout:7/818: write d2/d2c/d54/dba/dee/ff7 [835756,3185] 0 2024-09-19T09:35:29.652 INFO:tasks.workunit.client.0.smithi112.stdout:2/677: creat d0/d3e/d61/fd1 x:0 0 0 2024-09-19T09:35:29.652 INFO:tasks.workunit.client.0.smithi112.stdout:7/819: mkdir d2/d2c/d54/d18/db4/d110/d12c 0 2024-09-19T09:35:29.671 INFO:tasks.workunit.client.0.smithi112.stdout:7/820: dread d2/d2c/d54/d18/db4/d110/f8b [0,4194304] 0 2024-09-19T09:35:29.671 INFO:tasks.workunit.client.0.smithi112.stdout:7/821: read d2/d2c/d54/d18/db4/d110/d7c/db1/dc8/fd2 [740144,124788] 0 2024-09-19T09:35:29.671 INFO:tasks.workunit.client.0.smithi112.stdout:7/822: truncate d2/d2c/d54/d18/d39/d23/d35/fdf 495251 0 2024-09-19T09:35:29.672 INFO:tasks.workunit.client.0.smithi112.stdout:7/823: symlink d2/d2c/d54/d18/d39/d21/d45/d4d/l12d 0 2024-09-19T09:35:29.676 INFO:tasks.workunit.client.0.smithi112.stdout:8/748: dwrite d7/d10/f16 [8388608,4194304] 0 2024-09-19T09:35:29.677 INFO:tasks.workunit.client.0.smithi112.stdout:2/678: dwrite d0/d1/f22 [0,4194304] 0 2024-09-19T09:35:29.679 INFO:tasks.workunit.client.0.smithi112.stdout:8/749: mkdir d7/db/d21/d2e/d42/d57/dea 0 2024-09-19T09:35:29.683 INFO:tasks.workunit.client.0.smithi112.stdout:8/750: unlink d7/db/d21/d2e/d42/c5c 0 2024-09-19T09:35:29.683 INFO:tasks.workunit.client.0.smithi112.stdout:8/751: chown d7/db/d21/laa 183 1 2024-09-19T09:35:29.689 INFO:tasks.workunit.client.0.smithi112.stdout:2/679: read d0/d6/d24/fd0 [93520,77178] 0 2024-09-19T09:35:29.690 INFO:tasks.workunit.client.0.smithi112.stdout:7/824: dwrite d2/d2c/d54/d18/db4/d110/fe1 [0,4194304] 0 2024-09-19T09:35:29.699 INFO:tasks.workunit.client.0.smithi112.stdout:7/825: mknod d2/d2c/d54/d18/d11e/c12e 0 2024-09-19T09:35:29.699 INFO:tasks.workunit.client.0.smithi112.stdout:8/752: dwrite d7/db/d21/d2e/d42/d57/fdb [0,4194304] 0 2024-09-19T09:35:29.702 INFO:tasks.workunit.client.0.smithi112.stdout:2/680: getdents d0/d3e/d49 0 2024-09-19T09:35:29.709 INFO:tasks.workunit.client.0.smithi112.stdout:2/681: getdents d0/d6/d24/d96 0 2024-09-19T09:35:29.713 INFO:tasks.workunit.client.0.smithi112.stdout:7/826: mknod d2/d2c/d54/d18/d39/d21/c12f 0 2024-09-19T09:35:29.713 INFO:tasks.workunit.client.0.smithi112.stdout:2/682: symlink d0/d3e/d50/d57/d5a/ld2 0 2024-09-19T09:35:29.716 INFO:tasks.workunit.client.0.smithi112.stdout:7/827: rmdir d2/d2c/d54/d1a 39 2024-09-19T09:35:29.717 INFO:tasks.workunit.client.0.smithi112.stdout:8/753: dwrite d7/d67/f4f [4194304,4194304] 0 2024-09-19T09:35:29.718 INFO:tasks.workunit.client.0.smithi112.stdout:2/683: mkdir d0/d1/dd3 0 2024-09-19T09:35:29.720 INFO:tasks.workunit.client.0.smithi112.stdout:7/828: link d2/d2c/d54/d1a/f42 d2/d2c/d54/d18/d39/f130 0 2024-09-19T09:35:29.720 INFO:tasks.workunit.client.0.smithi112.stdout:7/829: stat d2/d2c/d54/d18/db4/d110/d7c/db1/dc8/fd2 0 2024-09-19T09:35:29.721 INFO:tasks.workunit.client.0.smithi112.stdout:8/754: creat d7/db/d21/d3b/feb x:0 0 0 2024-09-19T09:35:29.721 INFO:tasks.workunit.client.0.smithi112.stdout:8/755: creat d7/db/d21/d3b/fec x:0 0 0 2024-09-19T09:35:29.722 INFO:tasks.workunit.client.0.smithi112.stdout:7/830: getdents d2/d99/dd8 0 2024-09-19T09:35:29.724 INFO:tasks.workunit.client.0.smithi112.stdout:8/756: rename d7/d67/c69 to d7/ced 0 2024-09-19T09:35:29.725 INFO:tasks.workunit.client.0.smithi112.stdout:8/757: chown d7/db/d21/d3b/feb 2 1 2024-09-19T09:35:29.726 INFO:tasks.workunit.client.0.smithi112.stdout:8/758: symlink d7/db/d21/d3b/d56/d4b/d5b/lee 0 2024-09-19T09:35:29.728 INFO:tasks.workunit.client.0.smithi112.stdout:8/759: mkdir d7/db/d21/d2e/def 0 2024-09-19T09:35:29.728 INFO:tasks.workunit.client.0.smithi112.stdout:8/760: fsync d7/d10/d11/d33/fc4 0 2024-09-19T09:35:29.728 INFO:tasks.workunit.client.0.smithi112.stdout:8/761: truncate d7/d10/fe8 656290 0 2024-09-19T09:35:29.729 INFO:tasks.workunit.client.0.smithi112.stdout:8/762: mknod d7/db/d21/d3b/d56/d4b/d5b/cf0 0 2024-09-19T09:35:29.729 INFO:tasks.workunit.client.0.smithi112.stdout:8/763: chown d7/d10/d11/d62/laf 38508831 1 2024-09-19T09:35:29.730 INFO:tasks.workunit.client.0.smithi112.stdout:8/764: truncate d7/d67/f5d 2687335 0 2024-09-19T09:35:29.734 INFO:tasks.workunit.client.0.smithi112.stdout:3/781: sync 2024-09-19T09:35:29.734 INFO:tasks.workunit.client.0.smithi112.stdout:3/782: chown d8/d15/d1b/d1c/d68/d33/d8e/fc5 32072 1 2024-09-19T09:35:29.735 INFO:tasks.workunit.client.0.smithi112.stdout:2/684: write d0/d1/d5f/d78/db0/f65 [5902440,56486] 0 2024-09-19T09:35:29.736 INFO:tasks.workunit.client.0.smithi112.stdout:8/765: rmdir d7/d10/d11/d55 39 2024-09-19T09:35:29.737 INFO:tasks.workunit.client.0.smithi112.stdout:8/766: write d7/d10/d11/d33/f27 [1391394,56737] 0 2024-09-19T09:35:29.744 INFO:tasks.workunit.client.0.smithi112.stdout:2/685: read d0/d1/f22 [2128696,105513] 0 2024-09-19T09:35:29.751 INFO:tasks.workunit.client.0.smithi112.stdout:8/767: mknod d7/d10/d11/d50/cf1 0 2024-09-19T09:35:29.754 INFO:tasks.workunit.client.0.smithi112.stdout:3/783: rmdir d8/d15/d1b/d1c/d27/d62 39 2024-09-19T09:35:29.756 INFO:tasks.workunit.client.0.smithi112.stdout:8/768: symlink d7/db/d21/d2e/d8c/d97/lf2 0 2024-09-19T09:35:29.760 INFO:tasks.workunit.client.0.smithi112.stdout:2/686: rename d0/l83 to d0/d1/dd3/ld4 0 2024-09-19T09:35:29.761 INFO:tasks.workunit.client.0.smithi112.stdout:8/769: getdents d7/db 0 2024-09-19T09:35:29.762 INFO:tasks.workunit.client.0.smithi112.stdout:2/687: dread d0/d1/d28/d67/f70 [0,4194304] 0 2024-09-19T09:35:29.765 INFO:tasks.workunit.client.0.smithi112.stdout:3/784: rename d8/d15/d1b/d1c/d68/l87 to d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d63/db0/l10b 0 2024-09-19T09:35:29.766 INFO:tasks.workunit.client.0.smithi112.stdout:2/688: creat d0/d1/d28/fd5 x:0 0 0 2024-09-19T09:35:29.771 INFO:tasks.workunit.client.0.smithi112.stdout:8/770: write d7/db/d21/d3b/d56/d4b/fa0 [2858323,59046] 0 2024-09-19T09:35:29.784 INFO:tasks.workunit.client.0.smithi112.stdout:8/771: dread d7/db/d21/f47 [0,4194304] 0 2024-09-19T09:35:29.784 INFO:tasks.workunit.client.0.smithi112.stdout:8/772: getdents d7/db/d21/d3b/d56 0 2024-09-19T09:35:29.787 INFO:tasks.workunit.client.0.smithi112.stdout:8/773: mknod d7/db/d21/d3b/cf3 0 2024-09-19T09:35:29.787 INFO:tasks.workunit.client.0.smithi112.stdout:8/774: write d7/d10/d11/f37 [4595057,44923] 0 2024-09-19T09:35:29.787 INFO:tasks.workunit.client.0.smithi112.stdout:8/775: write d7/db/d21/d3b/d56/d3c/f9f [840156,115821] 0 2024-09-19T09:35:29.787 INFO:tasks.workunit.client.0.smithi112.stdout:8/776: chown d7/db/d21/d3b/d56/l7c 111 1 2024-09-19T09:35:29.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.787+0000 7f8464aee640 1 -- 172.21.15.112:0/4182966223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84600fe580 msgr2=0x7f84600fa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:29.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.787+0000 7f8464aee640 1 --2- 172.21.15.112:0/4182966223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84600fe580 0x7f84600fa6e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f84540048d0 tx=0x7f8454009da0 comp rx=0 tx=0).stop 2024-09-19T09:35:29.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.787+0000 7f8464aee640 1 -- 172.21.15.112:0/4182966223 shutdown_connections 2024-09-19T09:35:29.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.787+0000 7f8464aee640 1 --2- 172.21.15.112:0/4182966223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84600fe580 0x7f84600fa6e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.787+0000 7f8464aee640 1 --2- 172.21.15.112:0/4182966223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84600fdc30 0x7f84600fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.787+0000 7f8464aee640 1 -- 172.21.15.112:0/4182966223 >> 172.21.15.112:0/4182966223 conn(0x7f84600f6390 msgr2=0x7f84600f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.788+0000 7f8464aee640 1 -- 172.21.15.112:0/4182966223 shutdown_connections 2024-09-19T09:35:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.788+0000 7f8464aee640 1 -- 172.21.15.112:0/4182966223 wait complete. 2024-09-19T09:35:29.790 INFO:tasks.workunit.client.0.smithi112.stdout:2/689: dwrite d0/d1/f40 [0,4194304] 0 2024-09-19T09:35:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.788+0000 7f8464aee640 1 Processor -- start 2024-09-19T09:35:29.791 INFO:tasks.workunit.client.0.smithi112.stdout:2/690: dread - d0/d3e/d61/fd1 zero size 2024-09-19T09:35:29.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.789+0000 7f8464aee640 1 -- start start 2024-09-19T09:35:29.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.789+0000 7f8464aee640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84600fdc30 0x7f846010d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:29.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.789+0000 7f8464aee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84600fe580 0x7f846010d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:29.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.789+0000 7f8464aee640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846010dc30 con 0x7f84600fe580 2024-09-19T09:35:29.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.789+0000 7f8464aee640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846010e450 con 0x7f84600fdc30 2024-09-19T09:35:29.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.789+0000 7f845dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84600fe580 0x7f846010d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:29.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.789+0000 7f845e59c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84600fdc30 0x7f846010d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:29.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.789+0000 7f845dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84600fe580 0x7f846010d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47342/0 (socket says 172.21.15.112:47342) 2024-09-19T09:35:29.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.789+0000 7f845dd9b640 1 -- 172.21.15.112:0/2897379922 learned_addr learned my addr 172.21.15.112:0/2897379922 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:35:29.793 INFO:tasks.workunit.client.0.smithi112.stdout:8/777: creat d7/d10/d11/d50/ddd/ff4 x:0 0 0 2024-09-19T09:35:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.789+0000 7f845e59c640 1 -- 172.21.15.112:0/2897379922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84600fe580 msgr2=0x7f846010d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.789+0000 7f845e59c640 1 --2- 172.21.15.112:0/2897379922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84600fe580 0x7f846010d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.789+0000 7f845e59c640 1 -- 172.21.15.112:0/2897379922 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8450005040 con 0x7f84600fdc30 2024-09-19T09:35:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.789+0000 7f845dd9b640 1 --2- 172.21.15.112:0/2897379922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84600fe580 0x7f846010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:35:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.790+0000 7f845e59c640 1 --2- 172.21.15.112:0/2897379922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84600fdc30 0x7f846010d0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8450009380 tx=0x7f8450009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.790+0000 7f844effd640 1 -- 172.21.15.112:0/2897379922 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f845000e6c0 con 0x7f84600fdc30 2024-09-19T09:35:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.790+0000 7f844effd640 1 -- 172.21.15.112:0/2897379922 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f845000f040 con 0x7f84600fdc30 2024-09-19T09:35:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.790+0000 7f8464aee640 1 -- 172.21.15.112:0/2897379922 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8454005040 con 0x7f84600fdc30 2024-09-19T09:35:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.790+0000 7f844effd640 1 -- 172.21.15.112:0/2897379922 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8450013ca0 con 0x7f84600fdc30 2024-09-19T09:35:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.790+0000 7f8464aee640 1 -- 172.21.15.112:0/2897379922 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846010ea90 con 0x7f84600fdc30 2024-09-19T09:35:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.791+0000 7f8464aee640 1 -- 172.21.15.112:0/2897379922 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8460105780 con 0x7f84600fdc30 2024-09-19T09:35:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.792+0000 7f844effd640 1 -- 172.21.15.112:0/2897379922 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f845000e820 con 0x7f84600fdc30 2024-09-19T09:35:29.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.793+0000 7f844effd640 1 --2- 172.21.15.112:0/2897379922 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f844806e6e0 0x7f8448070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:29.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.793+0000 7f844effd640 1 -- 172.21.15.112:0/2897379922 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f845008ddf0 con 0x7f84600fdc30 2024-09-19T09:35:29.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.793+0000 7f845dd9b640 1 --2- 172.21.15.112:0/2897379922 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f844806e6e0 0x7f8448070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:29.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.794+0000 7f845dd9b640 1 --2- 172.21.15.112:0/2897379922 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f844806e6e0 0x7f8448070b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f846010ce50 tx=0x7f8454035040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:29.796 INFO:tasks.workunit.client.0.smithi112.stdout:2/691: rmdir d0/d1/d5f/d78/dbb 0 2024-09-19T09:35:29.802 INFO:tasks.workunit.client.0.smithi112.stdout:2/692: dread d0/d3e/d50/d57/d5a/d56/f68 [0,4194304] 0 2024-09-19T09:35:29.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:29.801+0000 7f844effd640 1 -- 172.21.15.112:0/2897379922 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f84500575f0 con 0x7f84600fdc30 2024-09-19T09:35:29.803 INFO:tasks.workunit.client.0.smithi112.stdout:2/693: mknod d0/d1/d28/cd6 0 2024-09-19T09:35:29.805 INFO:tasks.workunit.client.0.smithi112.stdout:2/694: mkdir d0/d1/d5f/dd7 0 2024-09-19T09:35:29.808 INFO:tasks.workunit.client.0.smithi112.stdout:8/778: dwrite d7/db/d21/d2e/d8c/d97/dc3/dc9/dcd/fcf [0,4194304] 0 2024-09-19T09:35:29.813 INFO:tasks.workunit.client.0.smithi112.stdout:8/779: dread d7/ff [0,4194304] 0 2024-09-19T09:35:29.814 INFO:tasks.workunit.client.0.smithi112.stdout:8/780: creat d7/db/d21/d3b/d56/d3c/d79/ff5 x:0 0 0 2024-09-19T09:35:29.816 INFO:tasks.workunit.client.0.smithi112.stdout:2/695: write d0/d1/d28/d67/f81 [405682,40413] 0 2024-09-19T09:35:29.816 INFO:tasks.workunit.client.0.smithi112.stdout:2/696: write d0/d1/d28/d88/da3/fc3 [42049,56889] 0 2024-09-19T09:35:29.841 INFO:tasks.workunit.client.0.smithi112.stdout:2/697: dwrite d0/d3e/d50/d57/d5a/d27/f34 [4194304,4194304] 0 2024-09-19T09:35:29.853 INFO:tasks.workunit.client.0.smithi112.stdout:2/698: dread d0/d6/fa [0,4194304] 0 2024-09-19T09:35:29.854 INFO:tasks.workunit.client.0.smithi112.stdout:2/699: link d0/d1/d28/l12 d0/d3e/d50/d57/d80/d8b/ld8 0 2024-09-19T09:35:29.862 INFO:tasks.workunit.client.0.smithi112.stdout:2/700: dread d0/d3e/d50/d57/d5a/d27/f34 [0,4194304] 0 2024-09-19T09:35:29.863 INFO:tasks.workunit.client.0.smithi112.stdout:2/701: symlink d0/d3e/d50/d57/d5a/d56/ld9 0 2024-09-19T09:35:29.863 INFO:tasks.workunit.client.0.smithi112.stdout:2/702: stat d0/d1/d28/cd6 0 2024-09-19T09:35:29.882 INFO:tasks.workunit.client.0.smithi112.stdout:2/703: dwrite d0/d1/d28/d67/f81 [0,4194304] 0 2024-09-19T09:35:29.884 INFO:tasks.workunit.client.0.smithi112.stdout:2/704: creat d0/d3e/d50/fda x:0 0 0 2024-09-19T09:35:29.885 INFO:tasks.workunit.client.0.smithi112.stdout:2/705: link d0/d1/d5f/d78/db0/f53 d0/d1/d28/d9b/fdb 0 2024-09-19T09:35:29.885 INFO:tasks.workunit.client.0.smithi112.stdout:2/706: creat d0/d3e/fdc x:0 0 0 2024-09-19T09:35:29.885 INFO:tasks.workunit.client.0.smithi112.stdout:2/707: truncate d0/d1/d28/fd5 539766 0 2024-09-19T09:35:29.901 INFO:tasks.workunit.client.0.smithi112.stdout:2/708: dwrite d0/d3e/d50/d57/dac/fb6 [0,4194304] 0 2024-09-19T09:35:29.926 INFO:tasks.workunit.client.0.smithi112.stdout:2/709: dwrite d0/d1/d5f/d78/fa4 [0,4194304] 0 2024-09-19T09:35:29.929 INFO:tasks.workunit.client.0.smithi112.stdout:2/710: dread - d0/d4a/f7d zero size 2024-09-19T09:35:29.946 INFO:tasks.workunit.client.0.smithi112.stdout:2/711: dwrite d0/d3e/d61/fd1 [0,4194304] 0 2024-09-19T09:35:29.946 INFO:tasks.workunit.client.0.smithi112.stdout:2/712: chown d0/d1/d28/d67/f95 97 1 2024-09-19T09:35:29.951 INFO:tasks.workunit.client.0.smithi112.stdout:2/713: mkdir d0/d1/d8a/ddd 0 2024-09-19T09:35:29.960 INFO:tasks.workunit.client.0.smithi112.stdout:2/714: dread d0/d1/f3d [0,4194304] 0 2024-09-19T09:35:29.964 INFO:tasks.workunit.client.0.smithi112.stdout:2/715: link d0/d1/f22 d0/d1/fde 0 2024-09-19T09:35:29.966 INFO:tasks.workunit.client.0.smithi112.stdout:2/716: symlink d0/d1/d28/ldf 0 2024-09-19T09:35:29.967 INFO:tasks.workunit.client.0.smithi112.stdout:2/717: symlink d0/d1/d5f/d78/le0 0 2024-09-19T09:35:29.975 INFO:tasks.workunit.client.0.smithi112.stdout:2/718: dread d0/d1/d28/d67/f95 [0,4194304] 0 2024-09-19T09:35:29.975 INFO:tasks.workunit.client.0.smithi112.stdout:2/719: chown d0/d6/l16 580844023 1 2024-09-19T09:35:29.977 INFO:tasks.workunit.client.0.smithi112.stdout:2/720: link d0/cc2 d0/d1/d5f/d78/db0/d9a/ce1 0 2024-09-19T09:35:29.979 INFO:tasks.workunit.client.0.smithi112.stdout:2/721: link d0/d6/c3c d0/d6/d24/ce2 0 2024-09-19T09:35:29.979 INFO:tasks.workunit.client.0.smithi112.stdout:2/722: write d0/d3e/fc9 [99707,2373] 0 2024-09-19T09:35:29.980 INFO:tasks.workunit.client.0.smithi112.stdout:2/723: rename d0/d6/c3c to d0/d1/d28/d88/dcd/ce3 0 2024-09-19T09:35:29.981 INFO:tasks.workunit.client.0.smithi112.stdout:2/724: mknod d0/d6/d24/ce4 0 2024-09-19T09:35:29.997 INFO:tasks.workunit.client.0.smithi112.stdout:2/725: dwrite d0/d3e/d50/d57/d5a/d4f/f52 [0,4194304] 0 2024-09-19T09:35:29.999 INFO:tasks.workunit.client.0.smithi112.stdout:2/726: symlink d0/d3e/d50/d57/d5a/d4f/le5 0 2024-09-19T09:35:30.002 INFO:tasks.workunit.client.0.smithi112.stdout:2/727: creat d0/d1/d5f/dc6/fe6 x:0 0 0 2024-09-19T09:35:30.004 INFO:tasks.workunit.client.0.smithi112.stdout:2/728: creat d0/d1/d8a/ddd/fe7 x:0 0 0 2024-09-19T09:35:30.012 INFO:tasks.workunit.client.0.smithi112.stdout:2/729: rmdir d0/d1/d28 39 2024-09-19T09:35:30.028 INFO:tasks.workunit.client.0.smithi112.stdout:2/730: dwrite d0/d3e/d50/d57/f79 [0,4194304] 0 2024-09-19T09:35:30.040 INFO:tasks.workunit.client.0.smithi112.stdout:2/731: getdents d0/d1/d28 0 2024-09-19T09:35:30.040 INFO:tasks.workunit.client.0.smithi112.stdout:2/732: chown d0/d3e/fdc 246 1 2024-09-19T09:35:30.053 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:29 smithi112 ceph-mon[27605]: pgmap v27: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 161 MiB/s rd, 184 MiB/s wr, 405 op/s 2024-09-19T09:35:30.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.051+0000 7f8464aee640 1 -- 172.21.15.112:0/2897379922 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f846010ee80 con 0x7f844806e6e0 2024-09-19T09:35:30.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.053+0000 7f844effd640 1 -- 172.21.15.112:0/2897379922 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f846010ee80 con 0x7f844806e6e0 2024-09-19T09:35:30.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.055+0000 7f8464aee640 1 -- 172.21.15.112:0/2897379922 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f844806e6e0 msgr2=0x7f8448070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.055+0000 7f8464aee640 1 --2- 172.21.15.112:0/2897379922 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f844806e6e0 0x7f8448070b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f846010ce50 tx=0x7f8454035040 comp rx=0 tx=0).stop 2024-09-19T09:35:30.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.055+0000 7f8464aee640 1 -- 172.21.15.112:0/2897379922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84600fdc30 msgr2=0x7f846010d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.055+0000 7f8464aee640 1 --2- 172.21.15.112:0/2897379922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84600fdc30 0x7f846010d0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8450009380 tx=0x7f8450009da0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.055+0000 7f8464aee640 1 -- 172.21.15.112:0/2897379922 shutdown_connections 2024-09-19T09:35:30.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.055+0000 7f8464aee640 1 --2- 172.21.15.112:0/2897379922 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f844806e6e0 0x7f8448070b90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.055+0000 7f8464aee640 1 --2- 172.21.15.112:0/2897379922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84600fe580 0x7f846010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.055+0000 7f8464aee640 1 --2- 172.21.15.112:0/2897379922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84600fdc30 0x7f846010d0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.055+0000 7f8464aee640 1 -- 172.21.15.112:0/2897379922 >> 172.21.15.112:0/2897379922 conn(0x7f84600f6390 msgr2=0x7f84600f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:30.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.055+0000 7f8464aee640 1 -- 172.21.15.112:0/2897379922 shutdown_connections 2024-09-19T09:35:30.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.055+0000 7f8464aee640 1 -- 172.21.15.112:0/2897379922 wait complete. 2024-09-19T09:35:30.057 INFO:tasks.workunit.client.0.smithi112.stdout:2/733: dwrite d0/d3e/d49/f94 [0,4194304] 0 2024-09-19T09:35:30.064 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:35:30.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.134+0000 7f1b2c88b640 1 -- 172.21.15.112:0/1939474070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b280fd800 msgr2=0x7f1b280fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.134+0000 7f1b2c88b640 1 --2- 172.21.15.112:0/1939474070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b280fd800 0x7f1b280fdc70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1b100048d0 tx=0x7f1b10009da0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.135+0000 7f1b2c88b640 1 -- 172.21.15.112:0/1939474070 shutdown_connections 2024-09-19T09:35:30.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.135+0000 7f1b2c88b640 1 --2- 172.21.15.112:0/1939474070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b280fd800 0x7f1b280fdc70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.135+0000 7f1b2c88b640 1 --2- 172.21.15.112:0/1939474070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b280fc530 0x7f1b280fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.135+0000 7f1b2c88b640 1 -- 172.21.15.112:0/1939474070 >> 172.21.15.112:0/1939474070 conn(0x7f1b280f7d10 msgr2=0x7f1b280fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:30.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.135+0000 7f1b2c88b640 1 -- 172.21.15.112:0/1939474070 shutdown_connections 2024-09-19T09:35:30.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.135+0000 7f1b2c88b640 1 -- 172.21.15.112:0/1939474070 wait complete. 2024-09-19T09:35:30.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.135+0000 7f1b2c88b640 1 Processor -- start 2024-09-19T09:35:30.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.135+0000 7f1b2c88b640 1 -- start start 2024-09-19T09:35:30.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.135+0000 7f1b2c88b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b280fc530 0x7f1b2810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:30.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.135+0000 7f1b2c88b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b280fd800 0x7f1b2810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:30.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.135+0000 7f1b2c88b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2810dc00 con 0x7f1b280fc530 2024-09-19T09:35:30.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.135+0000 7f1b2c88b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2810e420 con 0x7f1b280fd800 2024-09-19T09:35:30.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.136+0000 7f1b2659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b280fc530 0x7f1b2810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:30.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.136+0000 7f1b2659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b280fc530 0x7f1b2810d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47360/0 (socket says 172.21.15.112:47360) 2024-09-19T09:35:30.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.136+0000 7f1b2659c640 1 -- 172.21.15.112:0/2144970462 learned_addr learned my addr 172.21.15.112:0/2144970462 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:35:30.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.136+0000 7f1b25d9b640 1 --2- 172.21.15.112:0/2144970462 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b280fd800 0x7f1b2810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:30.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.136+0000 7f1b2659c640 1 -- 172.21.15.112:0/2144970462 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b280fd800 msgr2=0x7f1b2810d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.136+0000 7f1b2659c640 1 --2- 172.21.15.112:0/2144970462 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b280fd800 0x7f1b2810d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.136+0000 7f1b2659c640 1 -- 172.21.15.112:0/2144970462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b10005040 con 0x7f1b280fc530 2024-09-19T09:35:30.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.136+0000 7f1b2659c640 1 --2- 172.21.15.112:0/2144970462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b280fc530 0x7f1b2810d070 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000ecb0 tx=0x7f1b2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:30.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.136+0000 7f1b1effd640 1 -- 172.21.15.112:0/2144970462 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b2000cab0 con 0x7f1b280fc530 2024-09-19T09:35:30.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.136+0000 7f1b1effd640 1 -- 172.21.15.112:0/2144970462 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1b2000f040 con 0x7f1b280fc530 2024-09-19T09:35:30.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.136+0000 7f1b2c88b640 1 -- 172.21.15.112:0/2144970462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2810e6b0 con 0x7f1b280fc530 2024-09-19T09:35:30.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.136+0000 7f1b1effd640 1 -- 172.21.15.112:0/2144970462 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b200096b0 con 0x7f1b280fc530 2024-09-19T09:35:30.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.136+0000 7f1b2c88b640 1 -- 172.21.15.112:0/2144970462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2810ec50 con 0x7f1b280fc530 2024-09-19T09:35:30.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.137+0000 7f1b2c88b640 1 -- 172.21.15.112:0/2144970462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b280fb990 con 0x7f1b280fc530 2024-09-19T09:35:30.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.138+0000 7f1b1effd640 1 -- 172.21.15.112:0/2144970462 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f1b20007890 con 0x7f1b280fc530 2024-09-19T09:35:30.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.138+0000 7f1b1effd640 1 --2- 172.21.15.112:0/2144970462 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f1b1406e6e0 0x7f1b14070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:30.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.138+0000 7f1b1effd640 1 -- 172.21.15.112:0/2144970462 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1b2008e560 con 0x7f1b280fc530 2024-09-19T09:35:30.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.139+0000 7f1b25d9b640 1 --2- 172.21.15.112:0/2144970462 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f1b1406e6e0 0x7f1b14070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:30.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.139+0000 7f1b25d9b640 1 --2- 172.21.15.112:0/2144970462 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f1b1406e6e0 0x7f1b14070b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1b10007ac0 tx=0x7f1b10035040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:30.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.143+0000 7f1b1effd640 1 -- 172.21.15.112:0/2144970462 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f1b20057de0 con 0x7f1b280fc530 2024-09-19T09:35:30.150 INFO:tasks.workunit.client.0.smithi112.stdout:2/734: mknod d0/d3e/d50/d57/d80/d8b/ce8 0 2024-09-19T09:35:30.153 INFO:tasks.workunit.client.0.smithi112.stdout:2/735: creat d0/d3e/d50/d57/d5a/d4f/fe9 x:0 0 0 2024-09-19T09:35:30.155 INFO:tasks.workunit.client.0.smithi112.stdout:2/736: unlink d0/d3e/d50/d57/d5a/d4f/le5 0 2024-09-19T09:35:30.155 INFO:tasks.workunit.client.0.smithi112.stdout:2/737: creat d0/d4a/fea x:0 0 0 2024-09-19T09:35:30.157 INFO:tasks.workunit.client.0.smithi112.stdout:2/738: link d0/d3e/d50/d57/d5a/d56/ld9 d0/d1/d28/d88/leb 0 2024-09-19T09:35:30.159 INFO:tasks.workunit.client.0.smithi112.stdout:5/869: sync 2024-09-19T09:35:30.159 INFO:tasks.workunit.client.0.smithi112.stdout:6/748: sync 2024-09-19T09:35:30.159 INFO:tasks.workunit.client.0.smithi112.stdout:6/749: fdatasync d8/d11/d14/f57 0 2024-09-19T09:35:30.161 INFO:tasks.workunit.client.0.smithi112.stdout:6/750: getdents d8/de/d61 0 2024-09-19T09:35:30.162 INFO:tasks.workunit.client.0.smithi112.stdout:5/870: dread d4/d9/d17/f8e [0,4194304] 0 2024-09-19T09:35:30.162 INFO:tasks.workunit.client.0.smithi112.stdout:5/871: chown d4/d84/l85 12 1 2024-09-19T09:35:30.163 INFO:tasks.workunit.client.0.smithi112.stdout:6/751: truncate d8/d11/d14/f24 1086477 0 2024-09-19T09:35:30.163 INFO:tasks.workunit.client.0.smithi112.stdout:6/752: stat d8/dc5 0 2024-09-19T09:35:30.163 INFO:tasks.workunit.client.0.smithi112.stdout:5/872: truncate d4/d29/ddf/fe1 387321 0 2024-09-19T09:35:30.165 INFO:tasks.workunit.client.0.smithi112.stdout:6/753: mkdir d8/d11/d14/d3c/d109 0 2024-09-19T09:35:30.165 INFO:tasks.workunit.client.0.smithi112.stdout:2/739: dread d0/d6/f62 [0,4194304] 0 2024-09-19T09:35:30.165 INFO:tasks.workunit.client.0.smithi112.stdout:6/754: creat d8/de/d61/d70/d86/f10a x:0 0 0 2024-09-19T09:35:30.166 INFO:tasks.workunit.client.0.smithi112.stdout:6/755: chown d8/d11/d14/l50 15116 1 2024-09-19T09:35:30.170 INFO:tasks.workunit.client.0.smithi112.stdout:5/873: getdents d4/d9/d17 0 2024-09-19T09:35:30.173 INFO:tasks.workunit.client.0.smithi112.stdout:5/874: truncate d4/d9/d17/d2f/f8a 2563888 0 2024-09-19T09:35:30.175 INFO:tasks.workunit.client.0.smithi112.stdout:5/875: mknod d4/d9/d3e/d129/c12c 0 2024-09-19T09:35:30.176 INFO:tasks.workunit.client.0.smithi112.stdout:5/876: truncate d4/d9/d2a/d46/f55 3858542 0 2024-09-19T09:35:30.178 INFO:tasks.workunit.client.0.smithi112.stdout:5/877: creat d4/d9/d3e/d129/f12d x:0 0 0 2024-09-19T09:35:30.179 INFO:tasks.workunit.client.0.smithi112.stdout:5/878: truncate d4/d9/df6/da9/f100 669534 0 2024-09-19T09:35:30.181 INFO:tasks.workunit.client.0.smithi112.stdout:6/756: dwrite d8/de/fcd [0,4194304] 0 2024-09-19T09:35:30.181 INFO:tasks.workunit.client.0.smithi112.stdout:5/879: getdents d4/d9/d17/d2f 0 2024-09-19T09:35:30.188 INFO:tasks.workunit.client.0.smithi112.stdout:6/757: symlink d8/dc5/de4/l10b 0 2024-09-19T09:35:30.193 INFO:tasks.workunit.client.0.smithi112.stdout:6/758: symlink d8/d11/d14/d3c/dd5/l10c 0 2024-09-19T09:35:30.196 INFO:tasks.workunit.client.0.smithi112.stdout:6/759: mknod d8/de/d61/d70/d7b/d8a/c10d 0 2024-09-19T09:35:30.198 INFO:tasks.workunit.client.0.smithi112.stdout:6/760: dread d8/de/d18/d20/fbe [0,4194304] 0 2024-09-19T09:35:30.198 INFO:tasks.workunit.client.0.smithi112.stdout:6/761: chown d8/de/d17/l9c 14 1 2024-09-19T09:35:30.199 INFO:tasks.workunit.client.0.smithi112.stdout:6/762: symlink d8/de/d17/d49/l10e 0 2024-09-19T09:35:30.200 INFO:tasks.workunit.client.0.smithi112.stdout:6/763: readlink d8/d11/d14/d3c/dd5/le3 0 2024-09-19T09:35:30.202 INFO:tasks.workunit.client.0.smithi112.stdout:6/764: mkdir d8/d73/dc1/d10f 0 2024-09-19T09:35:30.204 INFO:tasks.workunit.client.0.smithi112.stdout:6/765: creat d8/de/d17/d94/d108/f110 x:0 0 0 2024-09-19T09:35:30.205 INFO:tasks.workunit.client.0.smithi112.stdout:5/880: dwrite d4/d29/f3c [4194304,4194304] 0 2024-09-19T09:35:30.207 INFO:tasks.workunit.client.0.smithi112.stdout:6/766: truncate d8/d11/d14/d3c/d4b/fdb 3564930 0 2024-09-19T09:35:30.207 INFO:tasks.workunit.client.0.smithi112.stdout:6/767: creat d8/de/d18/d20/d83/f111 x:0 0 0 2024-09-19T09:35:30.207 INFO:tasks.workunit.client.0.smithi112.stdout:6/768: chown d8/de/d61/d70/d7b/fc3 166688 1 2024-09-19T09:35:30.207 INFO:tasks.workunit.client.0.smithi112.stdout:6/769: fdatasync d8/d11/d14/d3c/d4b/d63/f38 0 2024-09-19T09:35:30.209 INFO:tasks.workunit.client.0.smithi112.stdout:6/770: mknod d8/de/d61/d70/db5/c112 0 2024-09-19T09:35:30.209 INFO:tasks.workunit.client.0.smithi112.stdout:6/771: chown d8/de/d17/d49/cee 3859765 1 2024-09-19T09:35:30.211 INFO:tasks.workunit.client.0.smithi112.stdout:6/772: rename d8/d11/d14/d2a/f7d to d8/d11/d14/d3c/f113 0 2024-09-19T09:35:30.212 INFO:tasks.workunit.client.0.smithi112.stdout:6/773: truncate d8/de/d66/d6e/f92 3696143 0 2024-09-19T09:35:30.215 INFO:tasks.workunit.client.0.smithi112.stdout:5/881: write d4/d9/d2a/d46/fd4 [3899752,101237] 0 2024-09-19T09:35:30.215 INFO:tasks.workunit.client.0.smithi112.stdout:5/882: write d4/d9/d2a/d39/d88/fc7 [693699,7607] 0 2024-09-19T09:35:30.216 INFO:tasks.workunit.client.0.smithi112.stdout:6/774: dread d8/de/d17/dae/fba [0,4194304] 0 2024-09-19T09:35:30.221 INFO:tasks.workunit.client.0.smithi112.stdout:6/775: write d8/f10 [566299,109791] 0 2024-09-19T09:35:30.221 INFO:tasks.workunit.client.0.smithi112.stdout:6/776: mknod d8/de/d66/d8f/dce/c114 0 2024-09-19T09:35:30.223 INFO:tasks.workunit.client.0.smithi112.stdout:6/777: symlink d8/d11/d14/d3c/d4b/d63/dd3/dda/l115 0 2024-09-19T09:35:30.223 INFO:tasks.workunit.client.0.smithi112.stdout:6/778: creat d8/de/d61/d70/f116 x:0 0 0 2024-09-19T09:35:30.227 INFO:tasks.workunit.client.0.smithi112.stdout:6/779: rename d8/d11/d13/l36 to d8/de/d17/l117 0 2024-09-19T09:35:30.234 INFO:tasks.workunit.client.0.smithi112.stdout:5/883: dwrite d4/d9/d17/dd6/feb [4194304,4194304] 0 2024-09-19T09:35:30.235 INFO:tasks.workunit.client.0.smithi112.stdout:6/780: rmdir d8/de/d17/d94/d108 39 2024-09-19T09:35:30.235 INFO:tasks.workunit.client.0.smithi112.stdout:6/781: chown d8/de/d61/d70/d7b/fc3 2947130 1 2024-09-19T09:35:30.237 INFO:tasks.workunit.client.0.smithi112.stdout:5/884: creat d4/d9/d17/d7c/f12e x:0 0 0 2024-09-19T09:35:30.238 INFO:tasks.workunit.client.0.smithi112.stdout:6/782: mknod d8/d11/d14/d3c/c118 0 2024-09-19T09:35:30.240 INFO:tasks.workunit.client.0.smithi112.stdout:6/783: link d8/de/d18/la3 d8/de/d61/d70/d7b/d8a/de9/l119 0 2024-09-19T09:35:30.243 INFO:tasks.workunit.client.0.smithi112.stdout:6/784: rename d8/d11/d13/l105 to d8/d11/d14/d3c/d4b/d63/dd3/l11a 0 2024-09-19T09:35:30.243 INFO:tasks.workunit.client.0.smithi112.stdout:6/785: chown d8/d11/d14/d3c/lfb 3060 1 2024-09-19T09:35:30.243 INFO:tasks.workunit.client.0.smithi112.stdout:6/786: truncate d8/d11/d14/d2a/f3d 5615686 0 2024-09-19T09:35:30.246 INFO:tasks.workunit.client.0.smithi112.stdout:5/885: dread d4/d9/d17/d30/f89 [0,4194304] 0 2024-09-19T09:35:30.250 INFO:tasks.workunit.client.0.smithi112.stdout:5/886: symlink d4/d9/d2a/d39/d88/dba/l12f 0 2024-09-19T09:35:30.255 INFO:tasks.workunit.client.0.smithi112.stdout:5/887: dread d4/d9/d3e/d124/fd1 [0,4194304] 0 2024-09-19T09:35:30.255 INFO:tasks.workunit.client.0.smithi112.stdout:5/888: creat d4/d9/d3e/d129/f130 x:0 0 0 2024-09-19T09:35:30.259 INFO:tasks.workunit.client.0.smithi112.stdout:6/787: dwrite d8/de/d66/d6e/fbd [4194304,4194304] 0 2024-09-19T09:35:30.259 INFO:tasks.workunit.client.0.smithi112.stdout:6/788: dread - d8/de/d61/d70/d86/f101 zero size 2024-09-19T09:35:30.263 INFO:tasks.workunit.client.0.smithi112.stdout:6/789: link d8/de/d18/d20/d83/f111 d8/d11/d14/d3c/dc0/f11b 0 2024-09-19T09:35:30.264 INFO:tasks.workunit.client.0.smithi112.stdout:5/889: mknod d4/d29/d36/c131 0 2024-09-19T09:35:30.265 INFO:tasks.workunit.client.0.smithi112.stdout:6/790: mknod d8/dc5/c11c 0 2024-09-19T09:35:30.266 INFO:tasks.workunit.client.0.smithi112.stdout:5/890: symlink d4/d9/d3e/d129/l132 0 2024-09-19T09:35:30.266 INFO:tasks.workunit.client.0.smithi112.stdout:6/791: dread d8/de/d66/d8f/dce/fd4 [0,4194304] 0 2024-09-19T09:35:30.276 INFO:tasks.workunit.client.0.smithi112.stdout:5/891: link d4/d9/df6/da9/f100 d4/d9/d17/d7c/f133 0 2024-09-19T09:35:30.278 INFO:tasks.workunit.client.0.smithi112.stdout:6/792: unlink d8/de/d66/d6e/lca 0 2024-09-19T09:35:30.279 INFO:tasks.workunit.client.0.smithi112.stdout:5/892: link d4/d9/d2a/d46/caa d4/d9/d2a/d39/c134 0 2024-09-19T09:35:30.279 INFO:tasks.workunit.client.0.smithi112.stdout:5/893: chown d4/dbf/lf2 0 1 2024-09-19T09:35:30.281 INFO:tasks.workunit.client.0.smithi112.stdout:6/793: link d8/de/d17/l117 d8/d11/d14/d3c/d109/l11d 0 2024-09-19T09:35:30.283 INFO:tasks.workunit.client.0.smithi112.stdout:6/794: dread d8/de/d17/dae/fba [0,4194304] 0 2024-09-19T09:35:30.283 INFO:tasks.workunit.client.0.smithi112.stdout:6/795: write d8/de/d61/d70/d7b/ff9 [388898,101580] 0 2024-09-19T09:35:30.283 INFO:tasks.workunit.client.0.smithi112.stdout:6/796: dread - d8/de/d66/f9e zero size 2024-09-19T09:35:30.283 INFO:tasks.workunit.client.0.smithi112.stdout:6/797: write d8/de/d66/d8f/dce/fd4 [1312642,50106] 0 2024-09-19T09:35:30.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:29 smithi191 ceph-mon[34834]: pgmap v27: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 161 MiB/s rd, 184 MiB/s wr, 405 op/s 2024-09-19T09:35:30.287 INFO:tasks.workunit.client.0.smithi112.stdout:6/798: unlink d8/de/d18/d20/d83/f111 0 2024-09-19T09:35:30.287 INFO:tasks.workunit.client.0.smithi112.stdout:6/799: chown d8/de/d61/caa 0 1 2024-09-19T09:35:30.287 INFO:tasks.workunit.client.0.smithi112.stdout:6/800: truncate d8/de/d18/d20/fbe 574686 0 2024-09-19T09:35:30.288 INFO:tasks.workunit.client.0.smithi112.stdout:6/801: fdatasync d8/de/d17/d49/ffc 0 2024-09-19T09:35:30.288 INFO:tasks.workunit.client.0.smithi112.stdout:6/802: write d8/d11/d13/f98 [537729,30964] 0 2024-09-19T09:35:30.291 INFO:tasks.workunit.client.0.smithi112.stdout:6/803: unlink d8/d11/d14/d3c/d4b/d63/dd3/l11a 0 2024-09-19T09:35:30.295 INFO:tasks.workunit.client.0.smithi112.stdout:6/804: creat d8/d11/d14/d3c/d4b/d63/dd3/f11e x:0 0 0 2024-09-19T09:35:30.295 INFO:tasks.workunit.client.0.smithi112.stdout:5/894: dwrite d4/d9/d2a/d39/f11e [0,4194304] 0 2024-09-19T09:35:30.295 INFO:tasks.workunit.client.0.smithi112.stdout:5/895: dread - d4/dbf/f10e zero size 2024-09-19T09:35:30.300 INFO:tasks.workunit.client.0.smithi112.stdout:6/805: rename d8/d11/d14/l50 to d8/de/d61/dbf/d103/l11f 0 2024-09-19T09:35:30.300 INFO:tasks.workunit.client.0.smithi112.stdout:6/806: readlink d8/de/d61/d70/d86/lbb 0 2024-09-19T09:35:30.308 INFO:tasks.workunit.client.0.smithi112.stdout:5/896: creat d4/d29/f135 x:0 0 0 2024-09-19T09:35:30.311 INFO:tasks.workunit.client.0.smithi112.stdout:6/807: creat d8/d73/dc1/d10f/f120 x:0 0 0 2024-09-19T09:35:30.313 INFO:tasks.workunit.client.0.smithi112.stdout:5/897: getdents d4/d9/d17/d2f/d72 0 2024-09-19T09:35:30.348 INFO:tasks.workunit.client.0.smithi112.stdout:6/808: dwrite d8/de/d17/dae/fba [0,4194304] 0 2024-09-19T09:35:30.348 INFO:tasks.workunit.client.0.smithi112.stdout:6/809: creat d8/d73/dc1/d10f/f121 x:0 0 0 2024-09-19T09:35:30.348 INFO:tasks.workunit.client.0.smithi112.stdout:5/898: dwrite d4/d9/d3e/fd3 [0,4194304] 0 2024-09-19T09:35:30.348 INFO:tasks.workunit.client.0.smithi112.stdout:5/899: stat d4/d29/d36/dc9/cef 0 2024-09-19T09:35:30.356 INFO:tasks.workunit.client.0.smithi112.stdout:5/900: rename d4/d9/d2a/d39/d88/fa1 to d4/dbf/f136 0 2024-09-19T09:35:30.356 INFO:tasks.workunit.client.0.smithi112.stdout:5/901: truncate d4/d9/d2a/d46/fd2 413901 0 2024-09-19T09:35:30.356 INFO:tasks.workunit.client.0.smithi112.stdout:5/902: dread - d4/d9/df6/fdd zero size 2024-09-19T09:35:30.359 INFO:tasks.workunit.client.0.smithi112.stdout:5/903: creat d4/d9/d17/da6/db2/dce/f137 x:0 0 0 2024-09-19T09:35:30.360 INFO:tasks.workunit.client.0.smithi112.stdout:5/904: mkdir d4/d9/d17/da6/d138 0 2024-09-19T09:35:30.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.407+0000 7f1b2c88b640 1 -- 172.21.15.112:0/2144970462 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b2810efd0 con 0x7f1b1406e6e0 2024-09-19T09:35:30.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.408+0000 7f1b1effd640 1 -- 172.21.15.112:0/2144970462 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f1b2810efd0 con 0x7f1b1406e6e0 2024-09-19T09:35:30.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.410+0000 7f1b2c88b640 1 -- 172.21.15.112:0/2144970462 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f1b1406e6e0 msgr2=0x7f1b14070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.410+0000 7f1b2c88b640 1 --2- 172.21.15.112:0/2144970462 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f1b1406e6e0 0x7f1b14070b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1b10007ac0 tx=0x7f1b10035040 comp rx=0 tx=0).stop 2024-09-19T09:35:30.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.410+0000 7f1b2c88b640 1 -- 172.21.15.112:0/2144970462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b280fc530 msgr2=0x7f1b2810d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.410+0000 7f1b2c88b640 1 --2- 172.21.15.112:0/2144970462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b280fc530 0x7f1b2810d070 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000ecb0 tx=0x7f1b2000b040 comp rx=0 tx=0).stop 2024-09-19T09:35:30.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.410+0000 7f1b2c88b640 1 -- 172.21.15.112:0/2144970462 shutdown_connections 2024-09-19T09:35:30.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.410+0000 7f1b2c88b640 1 --2- 172.21.15.112:0/2144970462 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f1b1406e6e0 0x7f1b14070b90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.410+0000 7f1b2c88b640 1 --2- 172.21.15.112:0/2144970462 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b280fd800 0x7f1b2810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.410+0000 7f1b2c88b640 1 --2- 172.21.15.112:0/2144970462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b280fc530 0x7f1b2810d070 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.410+0000 7f1b2c88b640 1 -- 172.21.15.112:0/2144970462 >> 172.21.15.112:0/2144970462 conn(0x7f1b280f7d10 msgr2=0x7f1b280f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.410+0000 7f1b2c88b640 1 -- 172.21.15.112:0/2144970462 shutdown_connections 2024-09-19T09:35:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.410+0000 7f1b2c88b640 1 -- 172.21.15.112:0/2144970462 wait complete. 2024-09-19T09:35:30.452 INFO:tasks.workunit.client.0.smithi112.stdout:9/534: sync 2024-09-19T09:35:30.483 INFO:tasks.workunit.client.0.smithi112.stdout:0/625: sync 2024-09-19T09:35:30.484 INFO:tasks.workunit.client.0.smithi112.stdout:9/535: getdents df/d11/d14/d19/d40/daf 0 2024-09-19T09:35:30.484 INFO:tasks.workunit.client.0.smithi112.stdout:9/536: creat df/d11/d14/d19/d40/d5c/fbf x:0 0 0 2024-09-19T09:35:30.497 INFO:tasks.workunit.client.0.smithi112.stdout:9/537: dread fc [4194304,4194304] 0 2024-09-19T09:35:30.497 INFO:tasks.workunit.client.0.smithi112.stdout:9/538: dread - df/d11/d14/d19/f90 zero size 2024-09-19T09:35:30.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.500+0000 7f489b011640 1 -- 172.21.15.112:0/566464242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48940fbcd0 msgr2=0x7f48940fc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.500+0000 7f489b011640 1 --2- 172.21.15.112:0/566464242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48940fbcd0 0x7f48940fc140 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f48840048d0 tx=0x7f4884009da0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.501+0000 7f489b011640 1 -- 172.21.15.112:0/566464242 shutdown_connections 2024-09-19T09:35:30.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.501+0000 7f489b011640 1 --2- 172.21.15.112:0/566464242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48940fbcd0 0x7f48940fc140 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.501+0000 7f489b011640 1 --2- 172.21.15.112:0/566464242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48940faa00 0x7f48940fae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.501+0000 7f489b011640 1 -- 172.21.15.112:0/566464242 >> 172.21.15.112:0/566464242 conn(0x7f48940f61c0 msgr2=0x7f48940f85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:30.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.501+0000 7f489b011640 1 -- 172.21.15.112:0/566464242 shutdown_connections 2024-09-19T09:35:30.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.501+0000 7f489b011640 1 -- 172.21.15.112:0/566464242 wait complete. 2024-09-19T09:35:30.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.501+0000 7f489b011640 1 Processor -- start 2024-09-19T09:35:30.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.502+0000 7f489b011640 1 -- start start 2024-09-19T09:35:30.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.502+0000 7f489b011640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48940faa00 0x7f489410bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:30.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.502+0000 7f489b011640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48940fbcd0 0x7f489410c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:30.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.502+0000 7f489b011640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489410c9b0 con 0x7f48940faa00 2024-09-19T09:35:30.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.502+0000 7f489b011640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489410d0f0 con 0x7f48940fbcd0 2024-09-19T09:35:30.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.502+0000 7f489980e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48940fbcd0 0x7f489410c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:30.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.502+0000 7f489a00f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48940faa00 0x7f489410bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:30.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.502+0000 7f489a00f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48940faa00 0x7f489410bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47368/0 (socket says 172.21.15.112:47368) 2024-09-19T09:35:30.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.502+0000 7f489a00f640 1 -- 172.21.15.112:0/2765802976 learned_addr learned my addr 172.21.15.112:0/2765802976 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:35:30.505 INFO:tasks.workunit.client.0.smithi112.stdout:3/785: sync 2024-09-19T09:35:30.505 INFO:tasks.workunit.client.0.smithi112.stdout:1/600: sync 2024-09-19T09:35:30.505 INFO:tasks.workunit.client.0.smithi112.stdout:3/786: dread - d8/d15/d1b/d1c/d27/d62/fc1 zero size 2024-09-19T09:35:30.505 INFO:tasks.workunit.client.0.smithi112.stdout:3/787: fsync d8/d15/d1b/d1c/d68/f5e 0 2024-09-19T09:35:30.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.502+0000 7f489a00f640 1 -- 172.21.15.112:0/2765802976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48940fbcd0 msgr2=0x7f489410c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.502+0000 7f489a00f640 1 --2- 172.21.15.112:0/2765802976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48940fbcd0 0x7f489410c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.502+0000 7f489a00f640 1 -- 172.21.15.112:0/2765802976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4884005040 con 0x7f48940faa00 2024-09-19T09:35:30.506 INFO:tasks.workunit.client.0.smithi112.stdout:0/626: dwrite d2/f5d [0,4194304] 0 2024-09-19T09:35:30.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.505+0000 7f489a00f640 1 --2- 172.21.15.112:0/2765802976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48940faa00 0x7f489410bdf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f489000eb70 tx=0x7f489000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:30.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.506+0000 7f488affd640 1 -- 172.21.15.112:0/2765802976 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4890007c30 con 0x7f48940faa00 2024-09-19T09:35:30.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.506+0000 7f488affd640 1 -- 172.21.15.112:0/2765802976 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f489000f040 con 0x7f48940faa00 2024-09-19T09:35:30.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.506+0000 7f488affd640 1 -- 172.21.15.112:0/2765802976 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4890009550 con 0x7f48940faa00 2024-09-19T09:35:30.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.507+0000 7f489b011640 1 -- 172.21.15.112:0/2765802976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489410d310 con 0x7f48940faa00 2024-09-19T09:35:30.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.507+0000 7f489b011640 1 -- 172.21.15.112:0/2765802976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489410d8b0 con 0x7f48940faa00 2024-09-19T09:35:30.509 INFO:tasks.workunit.client.0.smithi112.stdout:9/539: read df/d35/f38 [4152718,71767] 0 2024-09-19T09:35:30.509 INFO:tasks.workunit.client.0.smithi112.stdout:5/905: dwrite d4/d9/d17/d7c/f133 [0,4194304] 0 2024-09-19T09:35:30.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.508+0000 7f4888ff9640 1 -- 172.21.15.112:0/2765802976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489405ed70 con 0x7f48940faa00 2024-09-19T09:35:30.511 INFO:tasks.workunit.client.0.smithi112.stdout:1/601: mknod dc/d26/d34/d36/d68/d7d/d6a/cb6 0 2024-09-19T09:35:30.511 INFO:tasks.workunit.client.0.smithi112.stdout:7/831: sync 2024-09-19T09:35:30.512 INFO:tasks.workunit.client.0.smithi112.stdout:0/627: dread d2/d39/fb3 [0,4194304] 0 2024-09-19T09:35:30.512 INFO:tasks.workunit.client.0.smithi112.stdout:5/906: unlink d4/d9/d17/d2f/l11d 0 2024-09-19T09:35:30.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.512+0000 7f488affd640 1 -- 172.21.15.112:0/2765802976 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f48900096b0 con 0x7f48940faa00 2024-09-19T09:35:30.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.513+0000 7f488affd640 1 --2- 172.21.15.112:0/2765802976 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f488006e870 0x7f4880070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:30.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.513+0000 7f488affd640 1 -- 172.21.15.112:0/2765802976 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f489008ddf0 con 0x7f48940faa00 2024-09-19T09:35:30.515 INFO:tasks.workunit.client.0.smithi112.stdout:9/540: mkdir df/d11/d14/d19/dc0 0 2024-09-19T09:35:30.515 INFO:tasks.workunit.client.0.smithi112.stdout:9/541: chown df/d11/d14/f2e 1530620977 1 2024-09-19T09:35:30.515 INFO:tasks.workunit.client.0.smithi112.stdout:9/542: truncate df/d11/d14/d19/f42 630189 0 2024-09-19T09:35:30.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.514+0000 7f489980e640 1 --2- 172.21.15.112:0/2765802976 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f488006e870 0x7f4880070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:30.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.516+0000 7f489980e640 1 --2- 172.21.15.112:0/2765802976 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f488006e870 0x7f4880070d20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4884007ac0 tx=0x7f4884035040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:30.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.518+0000 7f488affd640 1 -- 172.21.15.112:0/2765802976 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f48900577a0 con 0x7f48940faa00 2024-09-19T09:35:30.520 INFO:tasks.workunit.client.0.smithi112.stdout:1/602: mkdir dc/d26/d34/d36/d68/db7 0 2024-09-19T09:35:30.521 INFO:tasks.workunit.client.0.smithi112.stdout:7/832: mknod d2/d2c/d54/d18/d39/d21/d45/d4d/dbe/c131 0 2024-09-19T09:35:30.524 INFO:tasks.workunit.client.0.smithi112.stdout:0/628: mknod d2/d59/da1/cc6 0 2024-09-19T09:35:30.524 INFO:tasks.workunit.client.0.smithi112.stdout:0/629: creat d2/d39/fc7 x:0 0 0 2024-09-19T09:35:30.527 INFO:tasks.workunit.client.0.smithi112.stdout:5/907: link d4/d9/d2a/d46/fd4 d4/d29/d36/f139 0 2024-09-19T09:35:30.527 INFO:tasks.workunit.client.0.smithi112.stdout:5/908: chown d4/d9/d17/d2f/l51 0 1 2024-09-19T09:35:30.529 INFO:tasks.workunit.client.0.smithi112.stdout:9/543: mkdir df/dc1 0 2024-09-19T09:35:30.532 INFO:tasks.workunit.client.0.smithi112.stdout:1/603: symlink dc/d59/d73/d88/lb8 0 2024-09-19T09:35:30.534 INFO:tasks.workunit.client.0.smithi112.stdout:7/833: rmdir d2/d2c/d11d 0 2024-09-19T09:35:30.538 INFO:tasks.workunit.client.0.smithi112.stdout:5/909: mkdir d4/d29/d36/dc9/d13a 0 2024-09-19T09:35:30.538 INFO:tasks.workunit.client.0.smithi112.stdout:5/910: readlink d4/d9/d17/d2f/d72/l24 0 2024-09-19T09:35:30.540 INFO:tasks.workunit.client.0.smithi112.stdout:9/544: write df/d11/d14/d19/f33 [2658959,80140] 0 2024-09-19T09:35:30.544 INFO:tasks.workunit.client.0.smithi112.stdout:1/604: dread dc/d26/d34/d36/d68/f72 [0,4194304] 0 2024-09-19T09:35:30.544 INFO:tasks.workunit.client.0.smithi112.stdout:5/911: dread d4/d9/d17/d2f/d72/f41 [0,4194304] 0 2024-09-19T09:35:30.544 INFO:tasks.workunit.client.0.smithi112.stdout:5/912: chown d4/d9/df6/cac 6047792 1 2024-09-19T09:35:30.548 INFO:tasks.workunit.client.0.smithi112.stdout:8/781: sync 2024-09-19T09:35:30.548 INFO:tasks.workunit.client.0.smithi112.stdout:2/740: sync 2024-09-19T09:35:30.548 INFO:tasks.workunit.client.0.smithi112.stdout:0/630: dwrite d2/d39/fc7 [0,4194304] 0 2024-09-19T09:35:30.552 INFO:tasks.workunit.client.0.smithi112.stdout:1/605: read dc/d26/d34/d4c/d55/f5a [996341,125945] 0 2024-09-19T09:35:30.553 INFO:tasks.workunit.client.0.smithi112.stdout:5/913: write d4/d9/d2a/d69/f58 [1953106,83252] 0 2024-09-19T09:35:30.561 INFO:tasks.workunit.client.0.smithi112.stdout:7/834: rename d2/d2c/d54/d18 to d2/d2c/d54/d1a/d132 0 2024-09-19T09:35:30.561 INFO:tasks.workunit.client.0.smithi112.stdout:1/606: write dc/d26/d34/d4c/f54 [4101024,116459] 0 2024-09-19T09:35:30.563 INFO:tasks.workunit.client.0.smithi112.stdout:9/545: creat df/d11/d14/d19/d28/d89/fc2 x:0 0 0 2024-09-19T09:35:30.563 INFO:tasks.workunit.client.0.smithi112.stdout:1/607: fsync dc/d24/f40 0 2024-09-19T09:35:30.565 INFO:tasks.workunit.client.0.smithi112.stdout:2/741: symlink d0/d1/d28/d88/da3/lec 0 2024-09-19T09:35:30.567 INFO:tasks.workunit.client.0.smithi112.stdout:9/546: dread df/d11/d14/d19/d40/f4e [0,4194304] 0 2024-09-19T09:35:30.568 INFO:tasks.workunit.client.0.smithi112.stdout:9/547: write df/d11/d14/d19/d40/daf/d6c/db3/fa6 [4456357,66490] 0 2024-09-19T09:35:30.568 INFO:tasks.workunit.client.0.smithi112.stdout:9/548: write df/d11/d14/f44 [8632300,89564] 0 2024-09-19T09:35:30.569 INFO:tasks.workunit.client.0.smithi112.stdout:0/631: link d2/d39/f4f d2/d68/fc8 0 2024-09-19T09:35:30.572 INFO:tasks.workunit.client.0.smithi112.stdout:5/914: creat d4/d9/d17/d30/f13b x:0 0 0 2024-09-19T09:35:30.572 INFO:tasks.workunit.client.0.smithi112.stdout:5/915: write d4/d9/d3e/d124/f115 [1930062,17121] 0 2024-09-19T09:35:30.572 INFO:tasks.workunit.client.0.smithi112.stdout:5/916: fsync d4/d9/d3e/d124/f12b 0 2024-09-19T09:35:30.573 INFO:tasks.workunit.client.0.smithi112.stdout:8/782: rename d7/db/d21/d2e/c7f to d7/d65/cf6 0 2024-09-19T09:35:30.573 INFO:tasks.workunit.client.0.smithi112.stdout:8/783: fdatasync d7/db/d21/d3b/d56/d3c/d79/fb2 0 2024-09-19T09:35:30.575 INFO:tasks.workunit.client.0.smithi112.stdout:7/835: getdents d2/d2c/d54/d1a/d132/d39/d21/d45/d4d/dbe 0 2024-09-19T09:35:30.575 INFO:tasks.workunit.client.0.smithi112.stdout:7/836: write d2/d2c/d54/d1a/d132/d39/d23/dfb/fc2 [664674,53028] 0 2024-09-19T09:35:30.577 INFO:tasks.workunit.client.0.smithi112.stdout:9/549: creat df/d11/d14/d19/d40/daf/d6c/db3/fc3 x:0 0 0 2024-09-19T09:35:30.579 INFO:tasks.workunit.client.0.smithi112.stdout:0/632: symlink d2/d39/d3b/d44/db8/dc1/lc9 0 2024-09-19T09:35:30.579 INFO:tasks.workunit.client.0.smithi112.stdout:0/633: write d2/d39/f7d [1033589,92206] 0 2024-09-19T09:35:30.580 INFO:tasks.workunit.client.0.smithi112.stdout:5/917: symlink d4/d29/d36/d5f/l13c 0 2024-09-19T09:35:30.580 INFO:tasks.workunit.client.0.smithi112.stdout:5/918: write d4/d9/df6/fdd [511942,93567] 0 2024-09-19T09:35:30.581 INFO:tasks.workunit.client.0.smithi112.stdout:5/919: chown d4/d29/d36/f139 125 1 2024-09-19T09:35:30.582 INFO:tasks.workunit.client.0.smithi112.stdout:1/608: rename dc/d59/f5d to dc/d24/d45/d94/fb9 0 2024-09-19T09:35:30.583 INFO:tasks.workunit.client.0.smithi112.stdout:8/784: mknod d7/db/cf7 0 2024-09-19T09:35:30.586 INFO:tasks.workunit.client.0.smithi112.stdout:2/742: unlink d0/d3e/d50/d57/dac/l6b 0 2024-09-19T09:35:30.586 INFO:tasks.workunit.client.0.smithi112.stdout:2/743: stat d0/d1/d28 0 2024-09-19T09:35:30.586 INFO:tasks.workunit.client.0.smithi112.stdout:2/744: chown d0/d6/d24/c33 40 1 2024-09-19T09:35:30.586 INFO:tasks.workunit.client.0.smithi112.stdout:0/634: mknod d2/d68/cca 0 2024-09-19T09:35:30.586 INFO:tasks.workunit.client.0.smithi112.stdout:0/635: fsync d2/d6e/d75/f8e 0 2024-09-19T09:35:30.589 INFO:tasks.workunit.client.0.smithi112.stdout:7/837: rename d2/d2c/d54/d1a/d132/d39/d23/d35/d4c/d70/dcf/f125 to d2/d2c/d54/d1a/d132/d39/f133 0 2024-09-19T09:35:30.589 INFO:tasks.workunit.client.0.smithi112.stdout:7/838: read d2/d2c/d54/d1a/d132/d39/d23/f57 [3771540,64557] 0 2024-09-19T09:35:30.589 INFO:tasks.workunit.client.0.smithi112.stdout:7/839: stat d2/d2c/d54/d1a/d132/db4/d110/d12c 0 2024-09-19T09:35:30.590 INFO:tasks.workunit.client.0.smithi112.stdout:1/609: symlink dc/d26/d34/d36/d68/db7/lba 0 2024-09-19T09:35:30.590 INFO:tasks.workunit.client.0.smithi112.stdout:1/610: fdatasync dc/d26/f5f 0 2024-09-19T09:35:30.592 INFO:tasks.workunit.client.0.smithi112.stdout:8/785: unlink d7/db/d21/d2e/d42/d57/fa9 0 2024-09-19T09:35:30.593 INFO:tasks.workunit.client.0.smithi112.stdout:9/550: dwrite df/d11/f74 [0,4194304] 0 2024-09-19T09:35:30.593 INFO:tasks.workunit.client.0.smithi112.stdout:9/551: readlink df/d11/d14/d19/d1e/l83 0 2024-09-19T09:35:30.594 INFO:tasks.workunit.client.0.smithi112.stdout:0/636: mknod d2/d39/d3b/d44/db8/ccb 0 2024-09-19T09:35:30.594 INFO:tasks.workunit.client.0.smithi112.stdout:0/637: fsync d2/d39/d3b/d44/d95/db5/f37 0 2024-09-19T09:35:30.595 INFO:tasks.workunit.client.0.smithi112.stdout:5/920: rename d4/d9/d2a/d39/f3a to d4/d9/d17/d2f/f13d 0 2024-09-19T09:35:30.596 INFO:tasks.workunit.client.0.smithi112.stdout:7/840: creat d2/d2c/d54/d1a/d132/db4/d110/dd7/f134 x:0 0 0 2024-09-19T09:35:30.596 INFO:tasks.workunit.client.0.smithi112.stdout:7/841: chown d2/d2c/d54/d1a/d132/db4/d110/ff1 98885 1 2024-09-19T09:35:30.597 INFO:tasks.workunit.client.0.smithi112.stdout:1/611: symlink dc/d26/d34/d36/d68/db7/lbb 0 2024-09-19T09:35:30.598 INFO:tasks.workunit.client.0.smithi112.stdout:2/745: mkdir d0/d1/ded 0 2024-09-19T09:35:30.598 INFO:tasks.workunit.client.0.smithi112.stdout:7/842: creat d2/d2c/d54/d1a/f135 x:0 0 0 2024-09-19T09:35:30.600 INFO:tasks.workunit.client.0.smithi112.stdout:1/612: mkdir dc/d24/d45/d94/dbc 0 2024-09-19T09:35:30.603 INFO:tasks.workunit.client.0.smithi112.stdout:7/843: rename d2/d2c/d54/d1a/d132/db4/d110/d7c/db1/dc8/fd2 to d2/d2c/d54/d1a/d132/d85/dcd/f136 0 2024-09-19T09:35:30.603 INFO:tasks.workunit.client.0.smithi112.stdout:7/844: chown d2/d2c/d54/d1a/d132/db4/d110/dd7/f134 7 1 2024-09-19T09:35:30.603 INFO:tasks.workunit.client.0.smithi112.stdout:7/845: write d2/d2c/d54/d1a/f135 [999390,106676] 0 2024-09-19T09:35:30.603 INFO:tasks.workunit.client.0.smithi112.stdout:7/846: truncate d2/d2c/d54/d1a/d132/db4/d110/ff1 861287 0 2024-09-19T09:35:30.603 INFO:tasks.workunit.client.0.smithi112.stdout:7/847: chown d2/d2c/d54/d1a/d132/d39/c2a 48 1 2024-09-19T09:35:30.606 INFO:tasks.workunit.client.0.smithi112.stdout:1/613: mknod dc/d26/d34/d36/d68/cbd 0 2024-09-19T09:35:30.606 INFO:tasks.workunit.client.0.smithi112.stdout:1/614: creat dc/d59/d73/fbe x:0 0 0 2024-09-19T09:35:30.606 INFO:tasks.workunit.client.0.smithi112.stdout:1/615: truncate dc/d13/f18 1316749 0 2024-09-19T09:35:30.608 INFO:tasks.workunit.client.0.smithi112.stdout:7/848: creat d2/d2c/d54/d1a/d132/d39/d21/d71/f137 x:0 0 0 2024-09-19T09:35:30.615 INFO:tasks.workunit.client.0.smithi112.stdout:2/746: write d0/d3e/d50/d57/d5a/f11 [482168,106896] 0 2024-09-19T09:35:30.615 INFO:tasks.workunit.client.0.smithi112.stdout:2/747: getdents d0/d1/d5f/dd7 0 2024-09-19T09:35:30.620 INFO:tasks.workunit.client.0.smithi112.stdout:0/638: write d2/d59/f83 [697926,103095] 0 2024-09-19T09:35:30.624 INFO:tasks.workunit.client.0.smithi112.stdout:1/616: dread dc/d26/d34/d36/d68/f72 [0,4194304] 0 2024-09-19T09:35:30.624 INFO:tasks.workunit.client.0.smithi112.stdout:2/748: symlink d0/d1/d5f/dc6/lee 0 2024-09-19T09:35:30.624 INFO:tasks.workunit.client.0.smithi112.stdout:2/749: chown d0/d3e/fc9 0 1 2024-09-19T09:35:30.630 INFO:tasks.workunit.client.0.smithi112.stdout:0/639: rename d2/f5d to d2/fcc 0 2024-09-19T09:35:30.630 INFO:tasks.workunit.client.0.smithi112.stdout:0/640: stat d2/d59 0 2024-09-19T09:35:30.632 INFO:tasks.workunit.client.0.smithi112.stdout:1/617: link dc/d26/c62 dc/d26/d34/d36/d68/d9f/cbf 0 2024-09-19T09:35:30.633 INFO:tasks.workunit.client.0.smithi112.stdout:0/641: mknod d2/d39/d3b/d44/ccd 0 2024-09-19T09:35:30.635 INFO:tasks.workunit.client.0.smithi112.stdout:8/786: dwrite d7/db/f45 [0,4194304] 0 2024-09-19T09:35:30.635 INFO:tasks.workunit.client.0.smithi112.stdout:9/552: dwrite df/d11/f5b [0,4194304] 0 2024-09-19T09:35:30.635 INFO:tasks.workunit.client.0.smithi112.stdout:1/618: unlink dc/d26/f5f 0 2024-09-19T09:35:30.635 INFO:tasks.workunit.client.0.smithi112.stdout:1/619: stat dc/d26/d44/faf 0 2024-09-19T09:35:30.636 INFO:tasks.workunit.client.0.smithi112.stdout:5/921: dwrite d4/d9/d17/d30/f13b [0,4194304] 0 2024-09-19T09:35:30.637 INFO:tasks.workunit.client.0.smithi112.stdout:0/642: creat d2/d68/fce x:0 0 0 2024-09-19T09:35:30.643 INFO:tasks.workunit.client.0.smithi112.stdout:8/787: truncate d7/db/d21/d2e/f5e 7201229 0 2024-09-19T09:35:30.645 INFO:tasks.workunit.client.0.smithi112.stdout:9/553: mkdir df/d11/d14/d19/d66/d99/dc4 0 2024-09-19T09:35:30.645 INFO:tasks.workunit.client.0.smithi112.stdout:9/554: readlink df/l2b 0 2024-09-19T09:35:30.645 INFO:tasks.workunit.client.0.smithi112.stdout:5/922: dread d4/d29/ddf/f101 [0,4194304] 0 2024-09-19T09:35:30.646 INFO:tasks.workunit.client.0.smithi112.stdout:7/849: rmdir d2/d2c/d54 39 2024-09-19T09:35:30.646 INFO:tasks.workunit.client.0.smithi112.stdout:7/850: chown d2/d2c/d54/dba/dee/ffe 0 1 2024-09-19T09:35:30.652 INFO:tasks.workunit.client.0.smithi112.stdout:0/643: rename d2/d59/fa4 to d2/d39/d3b/d44/db8/dc1/fcf 0 2024-09-19T09:35:30.655 INFO:tasks.workunit.client.0.smithi112.stdout:8/788: dread d7/d10/d11/d55/d9e/fd7 [0,4194304] 0 2024-09-19T09:35:30.656 INFO:tasks.workunit.client.0.smithi112.stdout:8/789: chown d7/db/d21/d2e/d42/d57/fe5 7808 1 2024-09-19T09:35:30.657 INFO:tasks.workunit.client.0.smithi112.stdout:5/923: dread d4/d9/d17/d30/f92 [0,4194304] 0 2024-09-19T09:35:30.661 INFO:tasks.workunit.client.0.smithi112.stdout:1/620: dwrite dc/d24/d45/d94/f9c [4194304,4194304] 0 2024-09-19T09:35:30.661 INFO:tasks.workunit.client.0.smithi112.stdout:1/621: fsync dc/fd 0 2024-09-19T09:35:30.665 INFO:tasks.workunit.client.0.smithi112.stdout:9/555: link df/l60 df/d11/d14/d19/d40/lc5 0 2024-09-19T09:35:30.669 INFO:tasks.workunit.client.0.smithi112.stdout:9/556: creat df/db9/fc6 x:0 0 0 2024-09-19T09:35:30.671 INFO:tasks.workunit.client.0.smithi112.stdout:1/622: write dc/d26/f29 [2752093,18750] 0 2024-09-19T09:35:30.672 INFO:tasks.workunit.client.0.smithi112.stdout:1/623: write dc/f21 [329526,59924] 0 2024-09-19T09:35:30.672 INFO:tasks.workunit.client.0.smithi112.stdout:1/624: chown dc/d24/f40 143 1 2024-09-19T09:35:30.672 INFO:tasks.workunit.client.0.smithi112.stdout:9/557: mkdir df/d11/d14/d19/d40/dc7 0 2024-09-19T09:35:30.672 INFO:tasks.workunit.client.0.smithi112.stdout:9/558: chown df/d11/d14/d19/d40/daf/f92 1059865854 1 2024-09-19T09:35:30.675 INFO:tasks.workunit.client.0.smithi112.stdout:7/851: dwrite d2/d2c/d54/d1a/d132/d39/f133 [0,4194304] 0 2024-09-19T09:35:30.679 INFO:tasks.workunit.client.0.smithi112.stdout:1/625: truncate dc/fe 6107222 0 2024-09-19T09:35:30.680 INFO:tasks.workunit.client.0.smithi112.stdout:9/559: mknod df/dc1/cc8 0 2024-09-19T09:35:30.680 INFO:tasks.workunit.client.0.smithi112.stdout:7/852: read d2/d2c/d54/d1a/d132/d39/d23/dfb/fe3 [102696,67268] 0 2024-09-19T09:35:30.681 INFO:tasks.workunit.client.0.smithi112.stdout:7/853: read d2/d2c/d54/d1a/f3d [476285,5738] 0 2024-09-19T09:35:30.681 INFO:tasks.workunit.client.0.smithi112.stdout:7/854: write d2/d2c/d54/d1a/d132/d39/d21/fc1 [1308551,34089] 0 2024-09-19T09:35:30.686 INFO:tasks.workunit.client.0.smithi112.stdout:1/626: mknod dc/d59/d73/d88/cc0 0 2024-09-19T09:35:30.686 INFO:tasks.workunit.client.0.smithi112.stdout:1/627: write dc/d26/d34/d36/d68/f72 [4546308,37909] 0 2024-09-19T09:35:30.686 INFO:tasks.workunit.client.0.smithi112.stdout:1/628: write dc/d24/f46 [720031,56529] 0 2024-09-19T09:35:30.688 INFO:tasks.workunit.client.0.smithi112.stdout:9/560: mknod df/d11/d14/d19/d66/cc9 0 2024-09-19T09:35:30.691 INFO:tasks.workunit.client.0.smithi112.stdout:5/924: dwrite d4/d9/fe8 [0,4194304] 0 2024-09-19T09:35:30.691 INFO:tasks.workunit.client.0.smithi112.stdout:5/925: readlink d4/d29/d36/l54 0 2024-09-19T09:35:30.691 INFO:tasks.workunit.client.0.smithi112.stdout:5/926: stat d4/d84 0 2024-09-19T09:35:30.691 INFO:tasks.workunit.client.0.smithi112.stdout:5/927: chown d4/d9/df6/c4e 149687 1 2024-09-19T09:35:30.691 INFO:tasks.workunit.client.0.smithi112.stdout:0/644: dwrite d2/d6e/d75/f8e [0,4194304] 0 2024-09-19T09:35:30.692 INFO:tasks.workunit.client.0.smithi112.stdout:8/790: dwrite d7/d67/f4c [0,4194304] 0 2024-09-19T09:35:30.693 INFO:tasks.workunit.client.0.smithi112.stdout:1/629: mkdir dc/d26/d34/d36/d68/dc1 0 2024-09-19T09:35:30.693 INFO:tasks.workunit.client.0.smithi112.stdout:1/630: chown dc/c8b 4719 1 2024-09-19T09:35:30.701 INFO:tasks.workunit.client.0.smithi112.stdout:7/855: dwrite d2/d2c/d54/d1a/d132/f3e [0,4194304] 0 2024-09-19T09:35:30.715 INFO:tasks.workunit.client.0.smithi112.stdout:8/791: dwrite d7/db/d21/f22 [4194304,4194304] 0 2024-09-19T09:35:30.722 INFO:tasks.workunit.client.0.smithi112.stdout:9/561: link df/d11/d14/d19/l45 df/d11/d14/lca 0 2024-09-19T09:35:30.725 INFO:tasks.workunit.client.0.smithi112.stdout:8/792: dread d7/f76 [0,4194304] 0 2024-09-19T09:35:30.733 INFO:tasks.workunit.client.0.smithi112.stdout:1/631: mknod dc/d26/d34/d4c/d64/cc2 0 2024-09-19T09:35:30.733 INFO:tasks.workunit.client.0.smithi112.stdout:1/632: stat dc/d26/d34/d36/ca8 0 2024-09-19T09:35:30.740 INFO:tasks.workunit.client.0.smithi112.stdout:7/856: rmdir d2/d2c/d54/d1a/d132/db4/de7 39 2024-09-19T09:35:30.755 INFO:tasks.workunit.client.0.smithi112.stdout:7/857: dwrite d2/d2c/d54/d1a/d132/d39/d21/d45/d4d/f68 [0,4194304] 0 2024-09-19T09:35:30.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.809+0000 7f4888ff9640 1 -- 172.21.15.112:0/2765802976 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f489404b720 con 0x7f488006e870 2024-09-19T09:35:30.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.817+0000 7f488affd640 1 -- 172.21.15.112:0/2765802976 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f489404b720 con 0x7f488006e870 2024-09-19T09:35:30.819 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:35:30.819 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (7m) 37s ago 8m 25.1M - 0.25.0 c8568f914cd2 bc75f08f7e02 2024-09-19T09:35:30.819 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (8m) 37s ago 8m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1513f1075df5 2024-09-19T09:35:30.819 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (7m) 40s ago 7m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6c313b300b35 2024-09-19T09:35:30.819 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (6m) 37s ago 8m 87.2M - 9.4.7 954c08fa6188 aeb5727c19ca 2024-09-19T09:35:30.819 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (2m) 37s ago 2m 170M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:35:30.819 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (3m) 37s ago 3m 96.1M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:35:30.819 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (2m) 40s ago 2m 11.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:35:30.820 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (2m) 40s ago 2m 14.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:35:30.820 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:9283,8765,8443 running (9m) 37s ago 9m 189M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a963c39d50ce 2024-09-19T09:35:30.820 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283 running (63s) 40s ago 7m 482M - 19.1.1-361-g2f599a46 d2baa855c067 b9c59e3583b1 2024-09-19T09:35:30.820 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (9m) 37s ago 9m 50.4M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 34676d67b669 2024-09-19T09:35:30.820 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (7m) 40s ago 7m 39.9M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 35690ef0929b 2024-09-19T09:35:30.820 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 starting - - - - 2024-09-19T09:35:30.820 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (7m) 40s ago 7m 16.8M - 1.5.0 0da6a335fe13 6b6c7c67cf29 2024-09-19T09:35:30.820 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (6m) 37s ago 6m 108M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 621693067dce 2024-09-19T09:35:30.820 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (6m) 37s ago 6m 115M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1742e5964367 2024-09-19T09:35:30.820 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (5m) 37s ago 5m 104M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 4dcca18af229 2024-09-19T09:35:30.820 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (5m) 40s ago 5m 116M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:35:30.820 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (4m) 40s ago 4m 111M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:35:30.820 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (4m) 40s ago 4m 109M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:35:30.821 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (6m) 37s ago 7m 56.2M - 2.43.0 a07b618ecd1d 9499df984e6a 2024-09-19T09:35:30.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.820+0000 7f4888ff9640 1 -- 172.21.15.112:0/2765802976 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f488006e870 msgr2=0x7f4880070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.820+0000 7f4888ff9640 1 --2- 172.21.15.112:0/2765802976 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f488006e870 0x7f4880070d20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4884007ac0 tx=0x7f4884035040 comp rx=0 tx=0).stop 2024-09-19T09:35:30.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.820+0000 7f4888ff9640 1 -- 172.21.15.112:0/2765802976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48940faa00 msgr2=0x7f489410bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.820+0000 7f4888ff9640 1 --2- 172.21.15.112:0/2765802976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48940faa00 0x7f489410bdf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f489000eb70 tx=0x7f489000b040 comp rx=0 tx=0).stop 2024-09-19T09:35:30.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.820+0000 7f4888ff9640 1 -- 172.21.15.112:0/2765802976 shutdown_connections 2024-09-19T09:35:30.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.820+0000 7f4888ff9640 1 --2- 172.21.15.112:0/2765802976 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f488006e870 0x7f4880070d20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.820+0000 7f4888ff9640 1 --2- 172.21.15.112:0/2765802976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48940fbcd0 0x7f489410c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.820+0000 7f4888ff9640 1 --2- 172.21.15.112:0/2765802976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48940faa00 0x7f489410bdf0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.820+0000 7f4888ff9640 1 -- 172.21.15.112:0/2765802976 >> 172.21.15.112:0/2765802976 conn(0x7f48940f61c0 msgr2=0x7f4894100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:30.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.820+0000 7f4888ff9640 1 -- 172.21.15.112:0/2765802976 shutdown_connections 2024-09-19T09:35:30.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.820+0000 7f4888ff9640 1 -- 172.21.15.112:0/2765802976 wait complete. 2024-09-19T09:35:30.864 INFO:tasks.workunit.client.0.smithi112.stdout:5/928: rmdir d4/d9/d17/d2f/d7d 39 2024-09-19T09:35:30.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.922+0000 7f62e7925640 1 -- 172.21.15.112:0/654013367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e006dbf0 msgr2=0x7f62e006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.922+0000 7f62e7925640 1 --2- 172.21.15.112:0/654013367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e006dbf0 0x7f62e006e000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009ca0 tx=0x7f62d8004c50 comp rx=0 tx=0).stop 2024-09-19T09:35:30.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.922+0000 7f62e7925640 1 -- 172.21.15.112:0/654013367 shutdown_connections 2024-09-19T09:35:30.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.922+0000 7f62e7925640 1 --2- 172.21.15.112:0/654013367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62e006e540 0x7f62e010cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.922+0000 7f62e7925640 1 --2- 172.21.15.112:0/654013367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e006dbf0 0x7f62e006e000 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.922+0000 7f62e7925640 1 -- 172.21.15.112:0/654013367 >> 172.21.15.112:0/654013367 conn(0x7f62e0069560 msgr2=0x7f62e006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:30.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.922+0000 7f62e7925640 1 -- 172.21.15.112:0/654013367 shutdown_connections 2024-09-19T09:35:30.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.922+0000 7f62e7925640 1 -- 172.21.15.112:0/654013367 wait complete. 2024-09-19T09:35:30.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.923+0000 7f62e7925640 1 Processor -- start 2024-09-19T09:35:30.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.923+0000 7f62e7925640 1 -- start start 2024-09-19T09:35:30.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.923+0000 7f62e7925640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e006dbf0 0x7f62e011bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:30.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.923+0000 7f62e7925640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62e006e540 0x7f62e011c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:30.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.923+0000 7f62e7925640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e011cab0 con 0x7f62e006e540 2024-09-19T09:35:30.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.923+0000 7f62e7925640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e011d280 con 0x7f62e006dbf0 2024-09-19T09:35:30.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.923+0000 7f62e56c1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e006dbf0 0x7f62e011bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:30.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.923+0000 7f62e4ec0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62e006e540 0x7f62e011c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:30.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.923+0000 7f62e56c1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e006dbf0 0x7f62e011bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.112:37454/0 (socket says 172.21.15.112:37454) 2024-09-19T09:35:30.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.923+0000 7f62e56c1640 1 -- 172.21.15.112:0/2964993883 learned_addr learned my addr 172.21.15.112:0/2964993883 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:35:30.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.924+0000 7f62e56c1640 1 -- 172.21.15.112:0/2964993883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62e006e540 msgr2=0x7f62e011c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.924+0000 7f62e56c1640 1 --2- 172.21.15.112:0/2964993883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62e006e540 0x7f62e011c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.924+0000 7f62e56c1640 1 -- 172.21.15.112:0/2964993883 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d4005040 con 0x7f62e006dbf0 2024-09-19T09:35:30.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.924+0000 7f62e56c1640 1 --2- 172.21.15.112:0/2964993883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e006dbf0 0x7f62e011bf20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009bc0 tx=0x7f62d8004c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:30.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.924+0000 7f62ddffb640 1 -- 172.21.15.112:0/2964993883 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62d8038070 con 0x7f62e006dbf0 2024-09-19T09:35:30.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.925+0000 7f62e7925640 1 -- 172.21.15.112:0/2964993883 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d80098b0 con 0x7f62e006dbf0 2024-09-19T09:35:30.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.925+0000 7f62e7925640 1 -- 172.21.15.112:0/2964993883 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e011d7e0 con 0x7f62e006dbf0 2024-09-19T09:35:30.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.925+0000 7f62ddffb640 1 -- 172.21.15.112:0/2964993883 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f62d803c410 con 0x7f62e006dbf0 2024-09-19T09:35:30.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.925+0000 7f62ddffb640 1 -- 172.21.15.112:0/2964993883 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62d803b5b0 con 0x7f62e006dbf0 2024-09-19T09:35:30.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.927+0000 7f62e7925640 1 -- 172.21.15.112:0/2964993883 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62cc005240 con 0x7f62e006dbf0 2024-09-19T09:35:30.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.927+0000 7f62ddffb640 1 -- 172.21.15.112:0/2964993883 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f62d8030070 con 0x7f62e006dbf0 2024-09-19T09:35:30.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.928+0000 7f62ddffb640 1 --2- 172.21.15.112:0/2964993883 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f62c806e730 0x7f62c8070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:30.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.928+0000 7f62ddffb640 1 -- 172.21.15.112:0/2964993883 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f62d80ae180 con 0x7f62e006dbf0 2024-09-19T09:35:30.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.928+0000 7f62e4ec0640 1 --2- 172.21.15.112:0/2964993883 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f62c806e730 0x7f62c8070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:30.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.929+0000 7f62e4ec0640 1 --2- 172.21.15.112:0/2964993883 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f62c806e730 0x7f62c8070be0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f62d4007fd0 tx=0x7f62d400b040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:30.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:30.932+0000 7f62ddffb640 1 -- 172.21.15.112:0/2964993883 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f62d8077bd0 con 0x7f62e006dbf0 2024-09-19T09:35:30.934 INFO:tasks.workunit.client.0.smithi112.stdout:1/633: link dc/d26/d34/d36/d68/c9b dc/d59/d73/cc3 0 2024-09-19T09:35:30.935 INFO:tasks.workunit.client.0.smithi112.stdout:7/858: creat d2/d2c/d54/d1a/f138 x:0 0 0 2024-09-19T09:35:30.936 INFO:tasks.workunit.client.0.smithi112.stdout:1/634: dread dc/d26/f4e [0,4194304] 0 2024-09-19T09:35:30.949 INFO:tasks.workunit.client.0.smithi112.stdout:7/859: dread d2/d2c/d54/d1a/d132/d39/d23/d35/f4b [0,4194304] 0 2024-09-19T09:35:30.955 INFO:tasks.workunit.client.0.smithi112.stdout:8/793: creat d7/d10/d11/ff8 x:0 0 0 2024-09-19T09:35:30.957 INFO:tasks.workunit.client.0.smithi112.stdout:8/794: creat d7/db/d21/d3b/d56/d4b/ff9 x:0 0 0 2024-09-19T09:35:30.958 INFO:tasks.workunit.client.0.smithi112.stdout:1/635: dwrite dc/d26/d34/d4c/f89 [0,4194304] 0 2024-09-19T09:35:30.969 INFO:tasks.workunit.client.0.smithi112.stdout:9/562: creat df/d11/d14/d19/d66/fcb x:0 0 0 2024-09-19T09:35:30.969 INFO:tasks.workunit.client.0.smithi112.stdout:7/860: dwrite d2/d2c/d54/d1a/d132/d39/f9e [0,4194304] 0 2024-09-19T09:35:30.970 INFO:tasks.workunit.client.0.smithi112.stdout:9/563: truncate df/d11/f85 3743192 0 2024-09-19T09:35:30.973 INFO:tasks.workunit.client.0.smithi112.stdout:5/929: mknod d4/d9/d17/da6/c13e 0 2024-09-19T09:35:30.973 INFO:tasks.workunit.client.0.smithi112.stdout:5/930: read d4/d29/d36/f139 [553764,81256] 0 2024-09-19T09:35:30.973 INFO:tasks.workunit.client.0.smithi112.stdout:5/931: fdatasync d4/d9/d17/d2f/d72/f63 0 2024-09-19T09:35:30.976 INFO:tasks.workunit.client.0.smithi112.stdout:9/564: symlink df/dc1/lcc 0 2024-09-19T09:35:30.978 INFO:tasks.workunit.client.0.smithi112.stdout:5/932: creat d4/f13f x:0 0 0 2024-09-19T09:35:30.978 INFO:tasks.workunit.client.0.smithi112.stdout:5/933: stat d4/d9/d2a/d46/dde/f117 0 2024-09-19T09:35:30.978 INFO:tasks.workunit.client.0.smithi112.stdout:5/934: chown d4/dbf/lc0 4 1 2024-09-19T09:35:30.980 INFO:tasks.workunit.client.0.smithi112.stdout:5/935: truncate d4/d9/d2a/d46/dde/f10b 802755 0 2024-09-19T09:35:30.980 INFO:tasks.workunit.client.0.smithi112.stdout:5/936: chown d4/dbf/lc0 1 1 2024-09-19T09:35:30.982 INFO:tasks.workunit.client.0.smithi112.stdout:0/645: rename d2/d39/d3b/d44/ccd to d2/d39/d3b/d8a/cd0 0 2024-09-19T09:35:30.982 INFO:tasks.workunit.client.0.smithi112.stdout:0/646: chown d2/d39/d3b/dab/fb6 0 1 2024-09-19T09:35:30.982 INFO:tasks.workunit.client.0.smithi112.stdout:0/647: truncate d2/d59/f60 660460 0 2024-09-19T09:35:30.982 INFO:tasks.workunit.client.0.smithi112.stdout:0/648: write d2/d39/d3b/dab/fc4 [816959,86775] 0 2024-09-19T09:35:30.982 INFO:tasks.workunit.client.0.smithi112.stdout:0/649: stat d2/d39/d3b/d44/d95/db5/f47 0 2024-09-19T09:35:30.983 INFO:tasks.workunit.client.0.smithi112.stdout:5/937: getdents d4/d9 0 2024-09-19T09:35:30.984 INFO:tasks.workunit.client.0.smithi112.stdout:0/650: write d2/f28 [115041,9016] 0 2024-09-19T09:35:30.984 INFO:tasks.workunit.client.0.smithi112.stdout:5/938: chown d4/d29/d36/l54 13828 1 2024-09-19T09:35:30.988 INFO:tasks.workunit.client.0.smithi112.stdout:7/861: dwrite d2/d2c/d54/d1a/d132/d39/d23/d35/d4c/f101 [0,4194304] 0 2024-09-19T09:35:30.988 INFO:tasks.workunit.client.0.smithi112.stdout:7/862: stat d2/d2c/d54/d1a/d132/d39/f130 0 2024-09-19T09:35:30.994 INFO:tasks.workunit.client.0.smithi112.stdout:7/863: mknod d2/d2c/d54/d1a/d132/db4/c139 0 2024-09-19T09:35:31.004 INFO:tasks.workunit.client.0.smithi112.stdout:0/651: dwrite d2/f90 [0,4194304] 0 2024-09-19T09:35:31.004 INFO:tasks.workunit.client.0.smithi112.stdout:0/652: creat d2/d39/d3b/dab/fd1 x:0 0 0 2024-09-19T09:35:31.007 INFO:tasks.workunit.client.0.smithi112.stdout:5/939: dwrite d4/d9/df6/fee [0,4194304] 0 2024-09-19T09:35:31.007 INFO:tasks.workunit.client.0.smithi112.stdout:5/940: fdatasync d4/d29/d36/da2/fb0 0 2024-09-19T09:35:31.009 INFO:tasks.workunit.client.0.smithi112.stdout:1/636: truncate dc/d24/f46 370586 0 2024-09-19T09:35:31.010 INFO:tasks.workunit.client.0.smithi112.stdout:0/653: creat d2/d39/d3b/fd2 x:0 0 0 2024-09-19T09:35:31.016 INFO:tasks.workunit.client.0.smithi112.stdout:5/941: rename d4/d9/l18 to d4/d9/l140 0 2024-09-19T09:35:31.016 INFO:tasks.workunit.client.0.smithi112.stdout:5/942: fdatasync d4/d9/df6/da9/fb8 0 2024-09-19T09:35:31.030 INFO:tasks.workunit.client.0.smithi112.stdout:8/795: rename d7/db/d21/d3b/feb to d7/d10/d11/ffa 0 2024-09-19T09:35:31.031 INFO:tasks.workunit.client.0.smithi112.stdout:1/637: dwrite dc/d24/f50 [0,4194304] 0 2024-09-19T09:35:31.031 INFO:tasks.workunit.client.0.smithi112.stdout:1/638: write dc/f21 [164601,112639] 0 2024-09-19T09:35:31.036 INFO:tasks.workunit.client.0.smithi112.stdout:7/864: rename d2/d2c/d54/d1a/d132/d39/d21/d45/d4d/f68 to d2/d2c/d54/d1a/d132/db4/de7/dfa/f13a 0 2024-09-19T09:35:31.037 INFO:tasks.workunit.client.0.smithi112.stdout:1/639: dread dc/d26/d34/f77 [0,4194304] 0 2024-09-19T09:35:31.037 INFO:tasks.workunit.client.0.smithi112.stdout:5/943: dwrite d4/d9/d3e/d129/f12d [0,4194304] 0 2024-09-19T09:35:31.040 INFO:tasks.workunit.client.0.smithi112.stdout:8/796: unlink d7/db/d21/d3b/d56/d3c/l8e 0 2024-09-19T09:35:31.045 INFO:tasks.workunit.client.0.smithi112.stdout:7/865: creat d2/d2c/d54/d1a/d132/d39/d23/d35/d4c/d70/dcf/d126/f13b x:0 0 0 2024-09-19T09:35:31.045 INFO:tasks.workunit.client.0.smithi112.stdout:7/866: dread - d2/d2c/d54/dba/dee/ffe zero size 2024-09-19T09:35:31.047 INFO:tasks.workunit.client.0.smithi112.stdout:1/640: truncate dc/d26/d34/d4c/f54 536569 0 2024-09-19T09:35:31.049 INFO:tasks.workunit.client.0.smithi112.stdout:9/565: write df/d11/f85 [149750,123434] 0 2024-09-19T09:35:31.049 INFO:tasks.workunit.client.0.smithi112.stdout:9/566: chown df/d11/d14/d19/d1e 247856166 1 2024-09-19T09:35:31.058 INFO:tasks.workunit.client.0.smithi112.stdout:8/797: truncate d7/db/d21/f4e 2913124 0 2024-09-19T09:35:31.058 INFO:tasks.workunit.client.0.smithi112.stdout:1/641: dread dc/f69 [0,4194304] 0 2024-09-19T09:35:31.060 INFO:tasks.workunit.client.0.smithi112.stdout:9/567: write df/d11/d14/d19/d40/f4b [2211956,58488] 0 2024-09-19T09:35:31.060 INFO:tasks.workunit.client.0.smithi112.stdout:1/642: link dc/d26/d34/d4c/f66 dc/d26/d34/d36/d68/fc4 0 2024-09-19T09:35:31.061 INFO:tasks.workunit.client.0.smithi112.stdout:1/643: chown dc/d13/c61 24410912 1 2024-09-19T09:35:31.064 INFO:tasks.workunit.client.0.smithi112.stdout:5/944: dwrite d4/dbf/f10e [0,4194304] 0 2024-09-19T09:35:31.064 INFO:tasks.workunit.client.0.smithi112.stdout:9/568: symlink df/d11/d14/d19/d28/d89/lcd 0 2024-09-19T09:35:31.065 INFO:tasks.workunit.client.0.smithi112.stdout:9/569: chown df/d11/d14/d19/d66/d99/dc4 208247555 1 2024-09-19T09:35:31.065 INFO:tasks.workunit.client.0.smithi112.stdout:1/644: symlink dc/d26/lc5 0 2024-09-19T09:35:31.068 INFO:tasks.workunit.client.0.smithi112.stdout:7/867: dwrite d2/d2c/d54/d1a/d132/d39/d21/f51 [4194304,4194304] 0 2024-09-19T09:35:31.069 INFO:tasks.workunit.client.0.smithi112.stdout:7/868: truncate d2/d2c/d54/d1a/d132/d39/d21/d71/f137 556538 0 2024-09-19T09:35:31.069 INFO:tasks.workunit.client.0.smithi112.stdout:7/869: chown d2/d2c/d54/dba/dee/ff7 472 1 2024-09-19T09:35:31.069 INFO:tasks.workunit.client.0.smithi112.stdout:7/870: dread - d2/d2c/d54/d1a/d132/db4/d110/f115 zero size 2024-09-19T09:35:31.069 INFO:tasks.workunit.client.0.smithi112.stdout:5/945: mknod d4/d9/df6/c141 0 2024-09-19T09:35:31.069 INFO:tasks.workunit.client.0.smithi112.stdout:5/946: readlink d4/d9/d17/d30/le9 0 2024-09-19T09:35:31.069 INFO:tasks.workunit.client.0.smithi112.stdout:5/947: chown d4/d9/d17/d30/dec/lf5 1121910532 1 2024-09-19T09:35:31.069 INFO:tasks.workunit.client.0.smithi112.stdout:9/570: fdatasync df/d11/d14/d19/d66/d5d/f7c 0 2024-09-19T09:35:31.070 INFO:tasks.workunit.client.0.smithi112.stdout:1/645: symlink dc/d26/d44/lc6 0 2024-09-19T09:35:31.071 INFO:tasks.workunit.client.0.smithi112.stdout:8/798: dread d7/db/d21/f22 [0,4194304] 0 2024-09-19T09:35:31.071 INFO:tasks.workunit.client.0.smithi112.stdout:7/871: creat d2/d2c/d54/d1a/d132/da1/f13c x:0 0 0 2024-09-19T09:35:31.071 INFO:tasks.workunit.client.0.smithi112.stdout:7/872: creat d2/d2c/d54/d1a/f13d x:0 0 0 2024-09-19T09:35:31.072 INFO:tasks.workunit.client.0.smithi112.stdout:9/571: rmdir df 39 2024-09-19T09:35:31.074 INFO:tasks.workunit.client.0.smithi112.stdout:1/646: symlink dc/d26/d34/d36/d68/dc1/lc7 0 2024-09-19T09:35:31.075 INFO:tasks.workunit.client.0.smithi112.stdout:8/799: symlink d7/db/d21/d2e/d8c/d97/dc3/dc9/lfb 0 2024-09-19T09:35:31.078 INFO:tasks.workunit.client.0.smithi112.stdout:7/873: creat d2/d99/dd8/f13e x:0 0 0 2024-09-19T09:35:31.079 INFO:tasks.workunit.client.0.smithi112.stdout:9/572: truncate df/d11/d14/d51/f7e 738157 0 2024-09-19T09:35:31.081 INFO:tasks.workunit.client.0.smithi112.stdout:1/647: rename dc/d26/d34/d36/d68/f72 to dc/d26/d34/d4c/d64/fc8 0 2024-09-19T09:35:31.081 INFO:tasks.workunit.client.0.smithi112.stdout:1/648: chown dc/d59/d73/f98 3614 1 2024-09-19T09:35:31.082 INFO:tasks.workunit.client.0.smithi112.stdout:7/874: creat d2/d2c/f13f x:0 0 0 2024-09-19T09:35:31.085 INFO:tasks.workunit.client.0.smithi112.stdout:9/573: rename df/d11/d14/d19/d40/daf/l8a to df/d11/d14/d19/d40/daf/d6c/db3/d9e/lce 0 2024-09-19T09:35:31.086 INFO:tasks.workunit.client.0.smithi112.stdout:1/649: mknod dc/d59/cc9 0 2024-09-19T09:35:31.088 INFO:tasks.workunit.client.0.smithi112.stdout:7/875: creat d2/d2c/d54/d1a/d132/d39/d23/d35/d4c/f140 x:0 0 0 2024-09-19T09:35:31.088 INFO:tasks.workunit.client.0.smithi112.stdout:5/948: dwrite d4/d9/df6/da9/f100 [4194304,4194304] 0 2024-09-19T09:35:31.091 INFO:tasks.workunit.client.0.smithi112.stdout:7/876: unlink d2/d2c/d54/d1a/f135 0 2024-09-19T09:35:31.091 INFO:tasks.workunit.client.0.smithi112.stdout:7/877: read - d2/d2c/d54/d1a/d132/d39/d23/d35/d4c/f140 zero size 2024-09-19T09:35:31.092 INFO:tasks.workunit.client.0.smithi112.stdout:7/878: stat d2/d2c/d54/d1a/d132/d39/d21/d45/d4d/l61 0 2024-09-19T09:35:31.092 INFO:tasks.workunit.client.0.smithi112.stdout:7/879: stat d2/d2c/d54/d1a/d132/d39/d21/c12f 0 2024-09-19T09:35:31.094 INFO:tasks.workunit.client.0.smithi112.stdout:9/574: rmdir df/db9 39 2024-09-19T09:35:31.096 INFO:tasks.workunit.client.0.smithi112.stdout:1/650: dread dc/d26/d34/d4c/d55/f86 [0,4194304] 0 2024-09-19T09:35:31.096 INFO:tasks.workunit.client.0.smithi112.stdout:1/651: fsync dc/d26/f4e 0 2024-09-19T09:35:31.096 INFO:tasks.workunit.client.0.smithi112.stdout:1/652: stat dc/d24/d45/c8c 0 2024-09-19T09:35:31.096 INFO:tasks.workunit.client.0.smithi112.stdout:7/880: getdents d2/d2c/d54/d1a/d132 0 2024-09-19T09:35:31.098 INFO:tasks.workunit.client.0.smithi112.stdout:1/653: unlink dc/d26/d34/d36/d68/db7/lbb 0 2024-09-19T09:35:31.098 INFO:tasks.workunit.client.0.smithi112.stdout:1/654: chown dc/d26/d34/d36/d68 5842102 1 2024-09-19T09:35:31.100 INFO:tasks.workunit.client.0.smithi112.stdout:7/881: creat d2/d2c/d54/dba/dee/f141 x:0 0 0 2024-09-19T09:35:31.102 INFO:tasks.workunit.client.0.smithi112.stdout:9/575: link df/d11/d14/d19/d1e/f7b df/d11/d14/d19/d28/d95/fcf 0 2024-09-19T09:35:31.102 INFO:tasks.workunit.client.0.smithi112.stdout:9/576: readlink df/d11/d14/d19/l45 0 2024-09-19T09:35:31.102 INFO:tasks.workunit.client.0.smithi112.stdout:9/577: fdatasync df/d11/d14/d19/d40/d5c/fa8 0 2024-09-19T09:35:31.102 INFO:tasks.workunit.client.0.smithi112.stdout:9/578: chown df/d11/d14/d19/d66/l29 21778484 1 2024-09-19T09:35:31.102 INFO:tasks.workunit.client.0.smithi112.stdout:9/579: creat df/d11/d14/d19/d40/daf/d6c/db3/fd0 x:0 0 0 2024-09-19T09:35:31.103 INFO:tasks.workunit.client.0.smithi112.stdout:7/882: creat d2/d2c/d54/d1a/d132/db4/f142 x:0 0 0 2024-09-19T09:35:31.105 INFO:tasks.workunit.client.0.smithi112.stdout:7/883: mknod d2/d2c/d54/d1a/d132/db4/d110/dcc/c143 0 2024-09-19T09:35:31.106 INFO:tasks.workunit.client.0.smithi112.stdout:5/949: dwrite d4/d9/d17/d30/f92 [0,4194304] 0 2024-09-19T09:35:31.107 INFO:tasks.workunit.client.0.smithi112.stdout:1/655: dread dc/f53 [0,4194304] 0 2024-09-19T09:35:31.108 INFO:tasks.workunit.client.0.smithi112.stdout:5/950: mknod d4/d29/ddf/df4/c142 0 2024-09-19T09:35:31.108 INFO:tasks.workunit.client.0.smithi112.stdout:5/951: creat d4/d9/d17/dd6/f143 x:0 0 0 2024-09-19T09:35:31.109 INFO:tasks.workunit.client.0.smithi112.stdout:1/656: symlink dc/d26/d34/d36/d68/dc1/lca 0 2024-09-19T09:35:31.110 INFO:tasks.workunit.client.0.smithi112.stdout:5/952: truncate d4/d9/d2a/d69/f9f 439261 0 2024-09-19T09:35:31.111 INFO:tasks.workunit.client.0.smithi112.stdout:1/657: getdents dc/d26/d44/d63 0 2024-09-19T09:35:31.114 INFO:tasks.workunit.client.0.smithi112.stdout:5/953: unlink d4/d29/d36/d5f/l13c 0 2024-09-19T09:35:31.116 INFO:tasks.workunit.client.0.smithi112.stdout:7/884: read d2/d2c/d54/f2f [991477,94031] 0 2024-09-19T09:35:31.118 INFO:tasks.workunit.client.0.smithi112.stdout:7/885: rmdir d2/d2c/d54/d1a/d132/db4/de7/dfa 39 2024-09-19T09:35:31.121 INFO:tasks.workunit.client.0.smithi112.stdout:7/886: creat d2/d2c/d54/d1a/d132/db4/f144 x:0 0 0 2024-09-19T09:35:31.121 INFO:tasks.workunit.client.0.smithi112.stdout:7/887: chown d2/d2c/d54/d1a/f138 1890 1 2024-09-19T09:35:31.125 INFO:tasks.workunit.client.0.smithi112.stdout:7/888: mkdir d2/d2c/d54/d1a/d132/d39/d21/d45/d145 0 2024-09-19T09:35:31.125 INFO:tasks.workunit.client.0.smithi112.stdout:7/889: fdatasync d2/d2c/d54/d1a/d132/d39/fb7 0 2024-09-19T09:35:31.129 INFO:tasks.workunit.client.0.smithi112.stdout:7/890: dread d2/d2c/d54/d1a/d132/d39/d23/dfb/fc2 [0,4194304] 0 2024-09-19T09:35:31.129 INFO:tasks.workunit.client.0.smithi112.stdout:7/891: read d2/d2c/f69 [803059,25434] 0 2024-09-19T09:35:31.133 INFO:tasks.workunit.client.0.smithi112.stdout:1/658: dwrite dc/d26/d44/d63/f7f [0,4194304] 0 2024-09-19T09:35:31.133 INFO:tasks.workunit.client.0.smithi112.stdout:1/659: write dc/d26/d44/faf [4311332,78940] 0 2024-09-19T09:35:31.135 INFO:tasks.workunit.client.0.smithi112.stdout:5/954: dwrite d4/d9/d17/d30/f92 [0,4194304] 0 2024-09-19T09:35:31.139 INFO:tasks.workunit.client.0.smithi112.stdout:1/660: creat dc/d26/d34/d36/d68/fcb x:0 0 0 2024-09-19T09:35:31.143 INFO:tasks.workunit.client.0.smithi112.stdout:7/892: rename d2/d2c/d54/d1a/d132/d39/d23/d35 to d2/d2c/d54/d1a/d132/d146 0 2024-09-19T09:35:31.145 INFO:tasks.workunit.client.0.smithi112.stdout:7/893: truncate d2/d2c/d54/d1a/d132/f1e 3221284 0 2024-09-19T09:35:31.147 INFO:tasks.workunit.client.0.smithi112.stdout:1/661: dread dc/d59/d73/f98 [0,4194304] 0 2024-09-19T09:35:31.151 INFO:tasks.workunit.client.0.smithi112.stdout:7/894: rename d2/cb to d2/d2c/d54/d1a/d132/db4/d110/d12c/c147 0 2024-09-19T09:35:31.156 INFO:tasks.workunit.client.0.smithi112.stdout:7/895: mkdir d2/d148 0 2024-09-19T09:35:31.158 INFO:tasks.workunit.client.0.smithi112.stdout:7/896: mkdir d2/d2c/d54/d1a/d132/db4/de7/dfa/d149 0 2024-09-19T09:35:31.161 INFO:tasks.workunit.client.0.smithi112.stdout:1/662: dwrite dc/d24/f52 [0,4194304] 0 2024-09-19T09:35:31.166 INFO:tasks.workunit.client.0.smithi112.stdout:1/663: rename dc/d26/f4e to dc/d26/d34/d36/d68/fcc 0 2024-09-19T09:35:31.168 INFO:tasks.workunit.client.0.smithi112.stdout:1/664: mknod dc/d24/da2/ccd 0 2024-09-19T09:35:31.169 INFO:tasks.workunit.client.0.smithi112.stdout:1/665: rmdir dc/d24 39 2024-09-19T09:35:31.169 INFO:tasks.workunit.client.0.smithi112.stdout:1/666: creat dc/d59/d73/fce x:0 0 0 2024-09-19T09:35:31.173 INFO:tasks.workunit.client.0.smithi112.stdout:1/667: dread dc/d24/f12 [0,4194304] 0 2024-09-19T09:35:31.179 INFO:tasks.workunit.client.0.smithi112.stdout:7/897: dwrite d2/d2c/f5d [0,4194304] 0 2024-09-19T09:35:31.184 INFO:tasks.workunit.client.0.smithi112.stdout:7/898: creat d2/f14a x:0 0 0 2024-09-19T09:35:31.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:30 smithi112 ceph-mon[27605]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:31.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:30 smithi112 ceph-mon[27605]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:31.191 INFO:tasks.workunit.client.0.smithi112.stdout:1/668: dwrite dc/d59/d73/d88/fa1 [0,4194304] 0 2024-09-19T09:35:31.195 INFO:tasks.workunit.client.0.smithi112.stdout:6/810: sync 2024-09-19T09:35:31.196 INFO:tasks.workunit.client.0.smithi112.stdout:6/811: write d8/de/d61/dbf/dc8/ff6 [994417,45873] 0 2024-09-19T09:35:31.196 INFO:tasks.workunit.client.0.smithi112.stdout:6/812: creat d8/de/d61/d70/d86/f122 x:0 0 0 2024-09-19T09:35:31.196 INFO:tasks.workunit.client.0.smithi112.stdout:6/813: write d8/d11/d14/d3c/d4b/d63/f38 [62944,79040] 0 2024-09-19T09:35:31.200 INFO:tasks.workunit.client.0.smithi112.stdout:6/814: rename d8/de/d18/f55 to d8/de/d61/dbf/dc8/f123 0 2024-09-19T09:35:31.200 INFO:tasks.workunit.client.0.smithi112.stdout:6/815: chown d8/d11/d14/d3c/d4b/d63/l4c 2556 1 2024-09-19T09:35:31.201 INFO:tasks.workunit.client.0.smithi112.stdout:7/899: dwrite d2/d2c/d54/d1a/d132/db4/d110/d7c/db1/dc8/f104 [0,4194304] 0 2024-09-19T09:35:31.201 INFO:tasks.workunit.client.0.smithi112.stdout:6/816: symlink d8/d11/d14/d3c/dd5/l124 0 2024-09-19T09:35:31.207 INFO:tasks.workunit.client.0.smithi112.stdout:7/900: getdents d2/d2c/d54/d1a/d132/d146/d4c 0 2024-09-19T09:35:31.217 INFO:tasks.workunit.client.0.smithi112.stdout:7/901: write d2/d2c/d54/d1a/d132/d146/d4c/f9d [1710565,59738] 0 2024-09-19T09:35:31.217 INFO:tasks.workunit.client.0.smithi112.stdout:7/902: write d2/d2c/d54/d1a/d132/da1/f13c [894489,32469] 0 2024-09-19T09:35:31.219 INFO:tasks.workunit.client.0.smithi112.stdout:6/817: creat d8/d73/f125 x:0 0 0 2024-09-19T09:35:31.219 INFO:tasks.workunit.client.0.smithi112.stdout:6/818: fdatasync d8/d11/d14/f57 0 2024-09-19T09:35:31.219 INFO:tasks.workunit.client.0.smithi112.stdout:6/819: chown d8/d11/d14/d2a/f32 614472 1 2024-09-19T09:35:31.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:30 smithi191 ceph-mon[34834]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:31.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:30 smithi191 ceph-mon[34834]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:31.308 INFO:tasks.workunit.client.0.smithi112.stdout:2/750: sync 2024-09-19T09:35:31.309 INFO:tasks.workunit.client.0.smithi112.stdout:3/788: sync 2024-09-19T09:35:31.310 INFO:tasks.workunit.client.0.smithi112.stdout:2/751: getdents d0/d3e/d50 0 2024-09-19T09:35:31.311 INFO:tasks.workunit.client.0.smithi112.stdout:3/789: symlink d8/d105/l10c 0 2024-09-19T09:35:31.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.321+0000 7f62e7925640 1 -- 172.21.15.112:0/2964993883 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f62cc0057c0 con 0x7f62e006dbf0 2024-09-19T09:35:31.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.322+0000 7f62ddffb640 1 -- 172.21.15.112:0/2964993883 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f62d807b290 con 0x7f62e006dbf0 2024-09-19T09:35:31.324 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:35:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:35:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T09:35:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:35:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:35:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 1, 2024-09-19T09:35:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T09:35:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:35:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:35:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T09:35:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:35:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:35:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:35:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:35:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:35:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 13, 2024-09-19T09:35:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T09:35:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:35:31.325 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:35:31.325 INFO:tasks.workunit.client.0.smithi112.stdout:2/752: dwrite d0/d6/d24/d96/fcb [0,4194304] 0 2024-09-19T09:35:31.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.324+0000 7f62e7925640 1 -- 172.21.15.112:0/2964993883 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f62c806e730 msgr2=0x7f62c8070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:31.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.324+0000 7f62e7925640 1 --2- 172.21.15.112:0/2964993883 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f62c806e730 0x7f62c8070be0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f62d4007fd0 tx=0x7f62d400b040 comp rx=0 tx=0).stop 2024-09-19T09:35:31.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.324+0000 7f62e7925640 1 -- 172.21.15.112:0/2964993883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e006dbf0 msgr2=0x7f62e011bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:31.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.324+0000 7f62e7925640 1 --2- 172.21.15.112:0/2964993883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e006dbf0 0x7f62e011bf20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009bc0 tx=0x7f62d8004c50 comp rx=0 tx=0).stop 2024-09-19T09:35:31.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.324+0000 7f62e7925640 1 -- 172.21.15.112:0/2964993883 shutdown_connections 2024-09-19T09:35:31.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.324+0000 7f62e7925640 1 --2- 172.21.15.112:0/2964993883 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f62c806e730 0x7f62c8070be0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:31.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.324+0000 7f62e7925640 1 --2- 172.21.15.112:0/2964993883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62e006e540 0x7f62e011c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:31.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.324+0000 7f62e7925640 1 --2- 172.21.15.112:0/2964993883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e006dbf0 0x7f62e011bf20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:31.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.324+0000 7f62e7925640 1 -- 172.21.15.112:0/2964993883 >> 172.21.15.112:0/2964993883 conn(0x7f62e0069560 msgr2=0x7f62e0108d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:31.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.325+0000 7f62e7925640 1 -- 172.21.15.112:0/2964993883 shutdown_connections 2024-09-19T09:35:31.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.325+0000 7f62e7925640 1 -- 172.21.15.112:0/2964993883 wait complete. 2024-09-19T09:35:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.402+0000 7f97e4844640 1 -- 172.21.15.112:0/7749222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97e00fc720 msgr2=0x7f97e00fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.402+0000 7f97e4844640 1 --2- 172.21.15.112:0/7749222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97e00fc720 0x7f97e00fcb90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f97d40048d0 tx=0x7f97d4009da0 comp rx=0 tx=0).stop 2024-09-19T09:35:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.402+0000 7f97e4844640 1 -- 172.21.15.112:0/7749222 shutdown_connections 2024-09-19T09:35:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.402+0000 7f97e4844640 1 --2- 172.21.15.112:0/7749222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97e00fc720 0x7f97e00fcb90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.402+0000 7f97e4844640 1 --2- 172.21.15.112:0/7749222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97e00fb450 0x7f97e00fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.403+0000 7f97e4844640 1 -- 172.21.15.112:0/7749222 >> 172.21.15.112:0/7749222 conn(0x7f97e00f6c10 msgr2=0x7f97e00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.403+0000 7f97e4844640 1 -- 172.21.15.112:0/7749222 shutdown_connections 2024-09-19T09:35:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.403+0000 7f97e4844640 1 -- 172.21.15.112:0/7749222 wait complete. 2024-09-19T09:35:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.403+0000 7f97e4844640 1 Processor -- start 2024-09-19T09:35:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.403+0000 7f97e4844640 1 -- start start 2024-09-19T09:35:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.403+0000 7f97e4844640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97e00fb450 0x7f97e010f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.403+0000 7f97e4844640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97e00fc720 0x7f97e010f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.403+0000 7f97e4844640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e010fe40 con 0x7f97e00fc720 2024-09-19T09:35:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.403+0000 7f97e4844640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e0110660 con 0x7f97e00fb450 2024-09-19T09:35:31.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.404+0000 7f97ddd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97e00fc720 0x7f97e010f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:31.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.404+0000 7f97ddd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97e00fc720 0x7f97e010f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47412/0 (socket says 172.21.15.112:47412) 2024-09-19T09:35:31.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.404+0000 7f97ddd9b640 1 -- 172.21.15.112:0/3881783569 learned_addr learned my addr 172.21.15.112:0/3881783569 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:35:31.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.404+0000 7f97de59c640 1 --2- 172.21.15.112:0/3881783569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97e00fb450 0x7f97e010f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:31.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.404+0000 7f97ddd9b640 1 -- 172.21.15.112:0/3881783569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97e00fb450 msgr2=0x7f97e010f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:31.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.404+0000 7f97ddd9b640 1 --2- 172.21.15.112:0/3881783569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97e00fb450 0x7f97e010f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:31.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.404+0000 7f97ddd9b640 1 -- 172.21.15.112:0/3881783569 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d4005040 con 0x7f97e00fc720 2024-09-19T09:35:31.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.404+0000 7f97ddd9b640 1 --2- 172.21.15.112:0/3881783569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97e00fc720 0x7f97e010f7f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f97d4003080 tx=0x7f97d4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:31.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.404+0000 7f97ceffd640 1 -- 172.21.15.112:0/3881783569 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d4038070 con 0x7f97e00fc720 2024-09-19T09:35:31.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.404+0000 7f97e4844640 1 -- 172.21.15.112:0/3881783569 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e0110890 con 0x7f97e00fc720 2024-09-19T09:35:31.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.404+0000 7f97ceffd640 1 -- 172.21.15.112:0/3881783569 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f97d402abd0 con 0x7f97e00fc720 2024-09-19T09:35:31.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.404+0000 7f97ceffd640 1 -- 172.21.15.112:0/3881783569 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d403e670 con 0x7f97e00fc720 2024-09-19T09:35:31.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.404+0000 7f97e4844640 1 -- 172.21.15.112:0/3881783569 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e0110e30 con 0x7f97e00fc720 2024-09-19T09:35:31.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.405+0000 7f97e4844640 1 -- 172.21.15.112:0/3881783569 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e00fa8b0 con 0x7f97e00fc720 2024-09-19T09:35:31.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.406+0000 7f97ceffd640 1 -- 172.21.15.112:0/3881783569 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f97d4030020 con 0x7f97e00fc720 2024-09-19T09:35:31.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.406+0000 7f97ceffd640 1 --2- 172.21.15.112:0/3881783569 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f97c806e6e0 0x7f97c8070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:31.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.406+0000 7f97ceffd640 1 -- 172.21.15.112:0/3881783569 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f97d40ae190 con 0x7f97e00fc720 2024-09-19T09:35:31.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.407+0000 7f97de59c640 1 --2- 172.21.15.112:0/3881783569 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f97c806e6e0 0x7f97c8070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:31.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.407+0000 7f97de59c640 1 --2- 172.21.15.112:0/3881783569 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f97c806e6e0 0x7f97c8070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f97d0007fd0 tx=0x7f97d0009040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:31.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.411+0000 7f97ceffd640 1 -- 172.21.15.112:0/3881783569 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f97d4077bd0 con 0x7f97e00fc720 2024-09-19T09:35:31.452 INFO:tasks.workunit.client.0.smithi112.stdout:2/753: symlink d0/d3e/d50/d57/d80/d8b/lef 0 2024-09-19T09:35:31.456 INFO:tasks.workunit.client.0.smithi112.stdout:2/754: dread d0/fb1 [0,4194304] 0 2024-09-19T09:35:31.456 INFO:tasks.workunit.client.0.smithi112.stdout:2/755: write d0/d3e/fdc [571352,52258] 0 2024-09-19T09:35:31.458 INFO:tasks.workunit.client.0.smithi112.stdout:2/756: dread d0/d4a/f8c [0,4194304] 0 2024-09-19T09:35:31.475 INFO:tasks.workunit.client.0.smithi112.stdout:2/757: dwrite d0/d6/d24/fd0 [0,4194304] 0 2024-09-19T09:35:31.475 INFO:tasks.workunit.client.0.smithi112.stdout:2/758: readlink d0/d3e/d61/l98 0 2024-09-19T09:35:31.476 INFO:tasks.workunit.client.0.smithi112.stdout:2/759: symlink d0/d1/d5f/dd7/lf0 0 2024-09-19T09:35:31.520 INFO:tasks.workunit.client.0.smithi112.stdout:0/654: sync 2024-09-19T09:35:31.521 INFO:tasks.workunit.client.0.smithi112.stdout:0/655: truncate d2/d39/d3b/dab/fa6 290862 0 2024-09-19T09:35:31.521 INFO:tasks.workunit.client.0.smithi112.stdout:0/656: creat d2/d39/d3b/fd3 x:0 0 0 2024-09-19T09:35:31.530 INFO:tasks.workunit.client.0.smithi112.stdout:0/657: rename d2/d39/d3b/d44 to d2/d59/da1/dd4 0 2024-09-19T09:35:31.530 INFO:tasks.workunit.client.0.smithi112.stdout:0/658: truncate d2/faf 761378 0 2024-09-19T09:35:31.530 INFO:tasks.workunit.client.0.smithi112.stdout:0/659: chown d2/d59/da1/cc6 38117925 1 2024-09-19T09:35:31.534 INFO:tasks.workunit.client.0.smithi112.stdout:0/660: rename d2/d39/d3b/fd3 to d2/d59/da1/dd4/d95/db5/fd5 0 2024-09-19T09:35:31.537 INFO:tasks.workunit.client.0.smithi112.stdout:0/661: rename d2/d59/da1/dd4/la7 to d2/d6e/da0/ld6 0 2024-09-19T09:35:31.537 INFO:tasks.workunit.client.0.smithi112.stdout:0/662: chown d2/d6e/d6f 30752 1 2024-09-19T09:35:31.539 INFO:tasks.workunit.client.0.smithi112.stdout:0/663: truncate d2/d59/d7a/f8b 4027270 0 2024-09-19T09:35:31.539 INFO:tasks.workunit.client.0.smithi112.stdout:0/664: readlink d2/d6e/d6f/lb1 0 2024-09-19T09:35:31.558 INFO:tasks.workunit.client.0.smithi112.stdout:0/665: dwrite d2/d59/da1/dd4/d95/db5/fd5 [0,4194304] 0 2024-09-19T09:35:31.575 INFO:tasks.workunit.client.0.smithi112.stdout:0/666: dwrite d2/f30 [0,4194304] 0 2024-09-19T09:35:31.576 INFO:tasks.workunit.client.0.smithi112.stdout:0/667: mknod d2/d59/da1/cd7 0 2024-09-19T09:35:31.576 INFO:tasks.workunit.client.0.smithi112.stdout:0/668: read - d2/d6e/da0/fc3 zero size 2024-09-19T09:35:31.578 INFO:tasks.workunit.client.0.smithi112.stdout:0/669: dread d2/d59/da1/dd4/d95/db5/f29 [0,4194304] 0 2024-09-19T09:35:31.579 INFO:tasks.workunit.client.0.smithi112.stdout:0/670: mknod d2/d39/d3b/cd8 0 2024-09-19T09:35:31.580 INFO:tasks.workunit.client.0.smithi112.stdout:0/671: fsync d2/d59/da1/dd4/d95/db5/f99 0 2024-09-19T09:35:31.581 INFO:tasks.workunit.client.0.smithi112.stdout:0/672: symlink d2/d59/ld9 0 2024-09-19T09:35:31.582 INFO:tasks.workunit.client.0.smithi112.stdout:0/673: mknod d2/d59/da1/dd4/db8/dc1/cda 0 2024-09-19T09:35:31.583 INFO:tasks.workunit.client.0.smithi112.stdout:0/674: symlink d2/d59/da1/dd4/d95/ldb 0 2024-09-19T09:35:31.584 INFO:tasks.workunit.client.0.smithi112.stdout:0/675: symlink d2/d6e/db4/ldc 0 2024-09-19T09:35:31.585 INFO:tasks.workunit.client.0.smithi112.stdout:0/676: truncate d2/d59/da1/dd4/d95/db5/fd5 3677740 0 2024-09-19T09:35:31.585 INFO:tasks.workunit.client.0.smithi112.stdout:0/677: creat d2/d6e/d6f/fdd x:0 0 0 2024-09-19T09:35:31.585 INFO:tasks.workunit.client.0.smithi112.stdout:0/678: write d2/d39/fb3 [1011285,122521] 0 2024-09-19T09:35:31.587 INFO:tasks.workunit.client.0.smithi112.stdout:0/679: mknod d2/d39/d3b/dab/cde 0 2024-09-19T09:35:31.600 INFO:tasks.workunit.client.0.smithi112.stdout:0/680: link d2/f3c d2/d59/da1/fdf 0 2024-09-19T09:35:31.600 INFO:tasks.workunit.client.0.smithi112.stdout:0/681: chown d2/d6e/db4/cbd 5 1 2024-09-19T09:35:31.601 INFO:tasks.workunit.client.0.smithi112.stdout:0/682: dread d2/d59/f60 [0,4194304] 0 2024-09-19T09:35:31.602 INFO:tasks.workunit.client.0.smithi112.stdout:0/683: write d2/d45/f54 [399357,88362] 0 2024-09-19T09:35:31.611 INFO:tasks.workunit.client.0.smithi112.stdout:0/684: dread d2/d59/d7a/f9c [0,4194304] 0 2024-09-19T09:35:31.611 INFO:tasks.workunit.client.0.smithi112.stdout:0/685: chown d2/d59/d7a/la9 332 1 2024-09-19T09:35:31.611 INFO:tasks.workunit.client.0.smithi112.stdout:0/686: truncate d2/d39/f6d 82487 0 2024-09-19T09:35:31.618 INFO:tasks.workunit.client.0.smithi112.stdout:0/687: write d2/f57 [735743,57805] 0 2024-09-19T09:35:31.634 INFO:tasks.workunit.client.0.smithi112.stdout:0/688: dwrite d2/d6e/d75/f76 [0,4194304] 0 2024-09-19T09:35:31.634 INFO:tasks.workunit.client.0.smithi112.stdout:0/689: fdatasync d2/d68/fce 0 2024-09-19T09:35:31.634 INFO:tasks.workunit.client.0.smithi112.stdout:0/690: write d2/d39/d3b/dab/fb6 [990028,53148] 0 2024-09-19T09:35:31.648 INFO:tasks.workunit.client.0.smithi112.stdout:0/691: dwrite d2/d59/da1/dd4/f69 [0,4194304] 0 2024-09-19T09:35:31.652 INFO:tasks.workunit.client.0.smithi112.stdout:0/692: creat d2/d59/da1/dd4/d95/fe0 x:0 0 0 2024-09-19T09:35:31.657 INFO:tasks.workunit.client.0.smithi112.stdout:0/693: dread d2/d45/f54 [0,4194304] 0 2024-09-19T09:35:31.657 INFO:tasks.workunit.client.0.smithi112.stdout:0/694: read d2/d68/fc8 [3735793,48800] 0 2024-09-19T09:35:31.657 INFO:tasks.workunit.client.0.smithi112.stdout:0/695: fdatasync d2/d6e/d6f/fdd 0 2024-09-19T09:35:31.664 INFO:tasks.workunit.client.0.smithi112.stdout:0/696: write d2/d59/da1/fdf [4895227,12088] 0 2024-09-19T09:35:31.665 INFO:tasks.workunit.client.0.smithi112.stdout:0/697: rename d2/d39/fc7 to d2/d59/da1/dd4/db8/dc1/fe1 0 2024-09-19T09:35:31.666 INFO:tasks.workunit.client.0.smithi112.stdout:0/698: symlink d2/d68/le2 0 2024-09-19T09:35:31.672 INFO:tasks.workunit.client.0.smithi112.stdout:8/800: sync 2024-09-19T09:35:31.675 INFO:tasks.workunit.client.0.smithi112.stdout:8/801: creat d7/db/d21/d2e/d8c/d97/db6/ffc x:0 0 0 2024-09-19T09:35:31.677 INFO:tasks.workunit.client.0.smithi112.stdout:8/802: creat d7/db/d21/d3b/d56/d3c/d79/ffd x:0 0 0 2024-09-19T09:35:31.678 INFO:tasks.workunit.client.0.smithi112.stdout:8/803: mkdir d7/db/d21/d2e/d8c/dc0/dfe 0 2024-09-19T09:35:31.678 INFO:tasks.workunit.client.0.smithi112.stdout:8/804: chown d7/db/d21/d3b/d56/d3c/ca5 122246 1 2024-09-19T09:35:31.678 INFO:tasks.workunit.client.0.smithi112.stdout:8/805: truncate d7/db/d21/d3b/d56/d3c/d79/ffd 833017 0 2024-09-19T09:35:31.679 INFO:tasks.workunit.client.0.smithi112.stdout:8/806: mknod d7/d10/d11/d50/cff 0 2024-09-19T09:35:31.681 INFO:tasks.workunit.client.0.smithi112.stdout:8/807: rename d7/db/d21/d3b/d56/l7c to d7/db/d21/d3b/d56/d3c/d79/ddf/l100 0 2024-09-19T09:35:31.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.680+0000 7f97e4844640 1 -- 172.21.15.112:0/3881783569 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f97e0103f60 con 0x7f97c806e6e0 2024-09-19T09:35:31.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.682+0000 7f97ceffd640 1 -- 172.21.15.112:0/3881783569 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f97e0103f60 con 0x7f97c806e6e0 2024-09-19T09:35:31.684 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:35:31.684 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:35:31.684 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:35:31.684 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-19T09:35:31.684 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [], 2024-09-19T09:35:31.684 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "1/2 daemons upgraded", 2024-09-19T09:35:31.684 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "", 2024-09-19T09:35:31.684 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:35:31.684 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:35:31.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.684+0000 7f97e4844640 1 -- 172.21.15.112:0/3881783569 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f97c806e6e0 msgr2=0x7f97c8070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:31.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.684+0000 7f97e4844640 1 --2- 172.21.15.112:0/3881783569 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f97c806e6e0 0x7f97c8070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f97d0007fd0 tx=0x7f97d0009040 comp rx=0 tx=0).stop 2024-09-19T09:35:31.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.684+0000 7f97e4844640 1 -- 172.21.15.112:0/3881783569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97e00fc720 msgr2=0x7f97e010f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:31.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.684+0000 7f97e4844640 1 --2- 172.21.15.112:0/3881783569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97e00fc720 0x7f97e010f7f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f97d4003080 tx=0x7f97d4009da0 comp rx=0 tx=0).stop 2024-09-19T09:35:31.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.685+0000 7f97e4844640 1 -- 172.21.15.112:0/3881783569 shutdown_connections 2024-09-19T09:35:31.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.685+0000 7f97e4844640 1 --2- 172.21.15.112:0/3881783569 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f97c806e6e0 0x7f97c8070b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:31.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.685+0000 7f97e4844640 1 --2- 172.21.15.112:0/3881783569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97e00fc720 0x7f97e010f7f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:31.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.685+0000 7f97e4844640 1 --2- 172.21.15.112:0/3881783569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97e00fb450 0x7f97e010f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:31.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.685+0000 7f97e4844640 1 -- 172.21.15.112:0/3881783569 >> 172.21.15.112:0/3881783569 conn(0x7f97e00f6c10 msgr2=0x7f97e00661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:31.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.685+0000 7f97e4844640 1 -- 172.21.15.112:0/3881783569 shutdown_connections 2024-09-19T09:35:31.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:35:31.685+0000 7f97e4844640 1 -- 172.21.15.112:0/3881783569 wait complete. 2024-09-19T09:35:31.690 INFO:tasks.workunit.client.0.smithi112.stdout:0/699: dwrite d2/d59/da1/fdf [4194304,4194304] 0 2024-09-19T09:35:31.692 INFO:tasks.workunit.client.0.smithi112.stdout:0/700: creat d2/d45/fe3 x:0 0 0 2024-09-19T09:35:31.692 INFO:tasks.workunit.client.0.smithi112.stdout:0/701: creat d2/d59/da1/dd4/d95/fe4 x:0 0 0 2024-09-19T09:35:31.692 INFO:tasks.workunit.client.0.smithi112.stdout:0/702: chown d2/f28 1630 1 2024-09-19T09:35:31.696 INFO:tasks.workunit.client.0.smithi112.stdout:0/703: link d2/d39/d3b/l73 d2/d6e/le5 0 2024-09-19T09:35:31.697 INFO:tasks.workunit.client.0.smithi112.stdout:8/808: dwrite d7/db/d21/d3b/d56/d3c/d79/ffd [0,4194304] 0 2024-09-19T09:35:31.697 INFO:tasks.workunit.client.0.smithi112.stdout:0/704: mkdir d2/d6e/da0/de6 0 2024-09-19T09:35:31.698 INFO:tasks.workunit.client.0.smithi112.stdout:0/705: write d2/d59/da1/dd4/d95/db5/f37 [490154,11071] 0 2024-09-19T09:35:31.701 INFO:tasks.workunit.client.0.smithi112.stdout:8/809: unlink d7/db/d21/d3b/cf3 0 2024-09-19T09:35:31.714 INFO:tasks.workunit.client.0.smithi112.stdout:0/706: dwrite d2/d59/d7a/f9c [0,4194304] 0 2024-09-19T09:35:31.719 INFO:tasks.workunit.client.0.smithi112.stdout:0/707: symlink d2/d68/le7 0 2024-09-19T09:35:31.719 INFO:tasks.workunit.client.0.smithi112.stdout:0/708: creat d2/d45/fe8 x:0 0 0 2024-09-19T09:35:31.719 INFO:tasks.workunit.client.0.smithi112.stdout:0/709: dread - d2/d68/fce zero size 2024-09-19T09:35:31.724 INFO:tasks.workunit.client.0.smithi112.stdout:0/710: mkdir d2/de9 0 2024-09-19T09:35:31.730 INFO:tasks.workunit.client.0.smithi112.stdout:0/711: dread d2/f4 [0,4194304] 0 2024-09-19T09:35:31.730 INFO:tasks.workunit.client.0.smithi112.stdout:0/712: write d2/d68/fc8 [3537912,98821] 0 2024-09-19T09:35:31.736 INFO:tasks.workunit.client.0.smithi112.stdout:0/713: truncate d2/d68/fc8 7613844 0 2024-09-19T09:35:31.738 INFO:tasks.workunit.client.0.smithi112.stdout:0/714: symlink d2/d6e/lea 0 2024-09-19T09:35:31.793 INFO:tasks.workunit.client.0.smithi112.stdout:5/955: sync 2024-09-19T09:35:31.793 INFO:tasks.workunit.client.0.smithi112.stdout:7/903: sync 2024-09-19T09:35:31.793 INFO:tasks.workunit.client.0.smithi112.stdout:9/580: sync 2024-09-19T09:35:31.796 INFO:tasks.workunit.client.0.smithi112.stdout:5/956: mkdir d4/d29/ddf/d144 0 2024-09-19T09:35:31.806 INFO:tasks.workunit.client.0.smithi112.stdout:5/957: dread d4/d9/d17/d30/f44 [4194304,4194304] 0 2024-09-19T09:35:31.807 INFO:tasks.workunit.client.0.smithi112.stdout:5/958: mknod d4/d9/df6/da9/de4/c145 0 2024-09-19T09:35:31.809 INFO:tasks.workunit.client.0.smithi112.stdout:5/959: mkdir d4/d29/ddf/d144/d146 0 2024-09-19T09:35:31.810 INFO:tasks.workunit.client.0.smithi112.stdout:7/904: dwrite d2/d2c/d54/d1a/d132/d39/d21/d45/fc7 [0,4194304] 0 2024-09-19T09:35:31.816 INFO:tasks.workunit.client.0.smithi112.stdout:7/905: rename d2/d2c/d54/d1a/d132/d39/d21/cf3 to d2/d2c/d54/d1a/d132/db4/de7/dfa/d149/c14b 0 2024-09-19T09:35:31.819 INFO:tasks.workunit.client.0.smithi112.stdout:7/906: creat d2/d99/f14c x:0 0 0 2024-09-19T09:35:31.821 INFO:tasks.workunit.client.0.smithi112.stdout:7/907: mkdir d2/d2c/d54/dba/dee/d14d 0 2024-09-19T09:35:31.822 INFO:tasks.workunit.client.0.smithi112.stdout:5/960: dwrite d4/d9/d2a/d46/dde/f102 [0,4194304] 0 2024-09-19T09:35:31.822 INFO:tasks.workunit.client.0.smithi112.stdout:5/961: write d4/d29/d36/d5f/f6a [1654387,52596] 0 2024-09-19T09:35:31.825 INFO:tasks.workunit.client.0.smithi112.stdout:7/908: rename d2/d2c/d54/d1a/d132/db4/d110/lff to d2/d2c/d54/d1a/l14e 0 2024-09-19T09:35:31.833 INFO:tasks.workunit.client.0.smithi112.stdout:5/962: dread d4/d9/d2a/d39/d88/dba/fbe [0,4194304] 0 2024-09-19T09:35:31.836 INFO:tasks.workunit.client.0.smithi112.stdout:5/963: truncate d4/d29/f2d 2238426 0 2024-09-19T09:35:31.839 INFO:tasks.workunit.client.0.smithi112.stdout:5/964: unlink d4/d9/l12 0 2024-09-19T09:35:31.840 INFO:tasks.workunit.client.0.smithi112.stdout:5/965: mkdir d4/d9/d17/d2f/d72/dae/d147 0 2024-09-19T09:35:31.842 INFO:tasks.workunit.client.0.smithi112.stdout:5/966: truncate d4/d9/d2a/d39/d88/fc7 655781 0 2024-09-19T09:35:31.842 INFO:tasks.workunit.client.0.smithi112.stdout:5/967: chown d4/d9/d2a/d46/dde/f117 93224948 1 2024-09-19T09:35:31.844 INFO:tasks.workunit.client.0.smithi112.stdout:7/909: dwrite d2/d2c/d54/d1a/d132/d146/d4c/f101 [0,4194304] 0 2024-09-19T09:35:31.844 INFO:tasks.workunit.client.0.smithi112.stdout:5/968: mkdir d4/d9/df6/da9/de4/d148 0 2024-09-19T09:35:31.846 INFO:tasks.workunit.client.0.smithi112.stdout:7/910: dread d2/d2c/d54/d1a/d132/d146/d76/f8d [0,4194304] 0 2024-09-19T09:35:31.849 INFO:tasks.workunit.client.0.smithi112.stdout:7/911: rename d2/d2c/d54/d1a/d132/d146/d76/feb to d2/d2c/d54/d1a/d132/d146/d4c/d122/f14f 0 2024-09-19T09:35:31.849 INFO:tasks.workunit.client.0.smithi112.stdout:7/912: write d2/f14a [489078,48614] 0 2024-09-19T09:35:31.850 INFO:tasks.workunit.client.0.smithi112.stdout:7/913: read d2/d2c/d54/d1a/d132/d39/d21/d71/f81 [120932,80896] 0 2024-09-19T09:35:31.853 INFO:tasks.workunit.client.0.smithi112.stdout:7/914: stat d2/d2c/d54/d1a/d132/d39/ca4 0 2024-09-19T09:35:31.862 INFO:tasks.workunit.client.0.smithi112.stdout:7/915: dread d2/d2c/d54/d1a/fbc [0,4194304] 0 2024-09-19T09:35:31.863 INFO:tasks.workunit.client.0.smithi112.stdout:5/969: dwrite d4/d9/d6b/f6d [0,4194304] 0 2024-09-19T09:35:31.864 INFO:tasks.workunit.client.0.smithi112.stdout:7/916: rename d2/d2c/d54/d1a/d132/d39/d23/dfb/fc6 to d2/d2c/d54/d1a/d132/da1/f150 0 2024-09-19T09:35:31.866 INFO:tasks.workunit.client.0.smithi112.stdout:5/970: getdents d4/d9/d17/da6/db2 0 2024-09-19T09:35:31.869 INFO:tasks.workunit.client.0.smithi112.stdout:5/971: mkdir d4/d29/d149 0 2024-09-19T09:35:31.871 INFO:tasks.workunit.client.0.smithi112.stdout:5/972: creat d4/d9/d3e/f14a x:0 0 0 2024-09-19T09:35:31.871 INFO:tasks.workunit.client.0.smithi112.stdout:5/973: write d4/d9/df6/fee [4326781,48264] 0 2024-09-19T09:35:31.871 INFO:tasks.workunit.client.0.smithi112.stdout:5/974: creat d4/d9/d6b/f14b x:0 0 0 2024-09-19T09:35:31.873 INFO:tasks.workunit.client.0.smithi112.stdout:5/975: getdents d4/d9/d17/d2f/d72/dae 0 2024-09-19T09:35:31.877 INFO:tasks.workunit.client.0.smithi112.stdout:7/917: write d2/d2c/d54/d1a/d132/db4/d110/d7c/db1/dc8/f104 [1637232,49283] 0 2024-09-19T09:35:31.877 INFO:tasks.workunit.client.0.smithi112.stdout:7/918: readlink d2/d2c/d54/d1a/d132/l9f 0 2024-09-19T09:35:31.877 INFO:tasks.workunit.client.0.smithi112.stdout:7/919: stat d2/d2c/d54/d1a/d132/d39/d21 0 2024-09-19T09:35:31.880 INFO:tasks.workunit.client.0.smithi112.stdout:7/920: creat d2/d2c/d54/d1a/d132/d146/d4c/d70/dcf/d126/f151 x:0 0 0 2024-09-19T09:35:31.883 INFO:tasks.workunit.client.0.smithi112.stdout:7/921: rename d2/d2c/d54/d1a/d132/d39/d21/d45/d4d/c6b to d2/d2c/d54/d1a/d132/db4/d110/dd7/c152 0 2024-09-19T09:35:31.883 INFO:tasks.workunit.client.0.smithi112.stdout:7/922: chown d2/d2c/d54/d1a/d132/da1/laa 541 1 2024-09-19T09:35:31.885 INFO:tasks.workunit.client.0.smithi112.stdout:7/923: unlink d2/d2c/d54/d1a/d132/da1/l108 0 2024-09-19T09:35:31.887 INFO:tasks.workunit.client.0.smithi112.stdout:7/924: mkdir d2/d2c/d54/d1a/d132/da1/d153 0 2024-09-19T09:35:31.901 INFO:tasks.workunit.client.0.smithi112.stdout:7/925: dwrite d2/d2c/d54/d1a/d132/d39/fb7 [0,4194304] 0 2024-09-19T09:35:31.902 INFO:tasks.workunit.client.0.smithi112.stdout:7/926: truncate d2/d2c/d54/d1a/d132/db4/f144 871692 0 2024-09-19T09:35:31.905 INFO:tasks.workunit.client.0.smithi112.stdout:7/927: creat d2/d148/f154 x:0 0 0 2024-09-19T09:35:31.909 INFO:tasks.workunit.client.0.smithi112.stdout:7/928: link d2/d2c/d54/cbb d2/d2c/c155 0 2024-09-19T09:35:31.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:31 smithi112 ceph-mon[27605]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:31.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:31 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2964993883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:35:31.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:31 smithi112 ceph-mon[27605]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:31.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:31 smithi112 ceph-mon[27605]: pgmap v28: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 121 MiB/s rd, 143 MiB/s wr, 284 op/s 2024-09-19T09:35:31.980 INFO:tasks.workunit.client.0.smithi112.stdout:6/820: sync 2024-09-19T09:35:31.980 INFO:tasks.workunit.client.0.smithi112.stdout:2/760: sync 2024-09-19T09:35:31.980 INFO:tasks.workunit.client.0.smithi112.stdout:3/790: sync 2024-09-19T09:35:31.980 INFO:tasks.workunit.client.0.smithi112.stdout:1/669: sync 2024-09-19T09:35:31.980 INFO:tasks.workunit.client.0.smithi112.stdout:3/791: chown d8/d105 15 1 2024-09-19T09:35:31.980 INFO:tasks.workunit.client.0.smithi112.stdout:2/761: fsync d0/d1/d28/d67/f70 0 2024-09-19T09:35:31.980 INFO:tasks.workunit.client.0.smithi112.stdout:3/792: chown d8/d15/d1b/d1c/d68/d33/d66/c91 0 1 2024-09-19T09:35:31.980 INFO:tasks.workunit.client.0.smithi112.stdout:2/762: readlink d0/d3e/d50/d57/d5a/l7a 0 2024-09-19T09:35:31.983 INFO:tasks.workunit.client.0.smithi112.stdout:1/670: mknod dc/d26/ccf 0 2024-09-19T09:35:31.983 INFO:tasks.workunit.client.0.smithi112.stdout:1/671: chown dc/d26/d44/faf 18244 1 2024-09-19T09:35:31.983 INFO:tasks.workunit.client.0.smithi112.stdout:1/672: chown dc/d26/d34/d4c/d55/f87 821 1 2024-09-19T09:35:31.983 INFO:tasks.workunit.client.0.smithi112.stdout:1/673: chown dc/d26/d34/d36/c3e 266074 1 2024-09-19T09:35:31.983 INFO:tasks.workunit.client.0.smithi112.stdout:1/674: write dc/d26/d44/faf [4790412,41211] 0 2024-09-19T09:35:31.983 INFO:tasks.workunit.client.0.smithi112.stdout:6/821: dread d8/de/d61/d70/db5/f104 [0,4194304] 0 2024-09-19T09:35:31.984 INFO:tasks.workunit.client.0.smithi112.stdout:2/763: mknod d0/d1/d5f/dd7/cf1 0 2024-09-19T09:35:31.984 INFO:tasks.workunit.client.0.smithi112.stdout:2/764: fsync d0/d1/d28/d9b/fdb 0 2024-09-19T09:35:31.986 INFO:tasks.workunit.client.0.smithi112.stdout:1/675: mkdir dc/d26/dd0 0 2024-09-19T09:35:31.986 INFO:tasks.workunit.client.0.smithi112.stdout:1/676: stat dc/d59 0 2024-09-19T09:35:31.987 INFO:tasks.workunit.client.0.smithi112.stdout:1/677: mkdir dc/d26/d34/d36/d68/d9f/dd1 0 2024-09-19T09:35:31.987 INFO:tasks.workunit.client.0.smithi112.stdout:1/678: fdatasync dc/d26/d34/d4c/d55/f5a 0 2024-09-19T09:35:31.989 INFO:tasks.workunit.client.0.smithi112.stdout:1/679: unlink dc/d24/d45/c6b 0 2024-09-19T09:35:31.991 INFO:tasks.workunit.client.0.smithi112.stdout:6/822: dread d8/d11/d14/d2a/f32 [0,4194304] 0 2024-09-19T09:35:31.991 INFO:tasks.workunit.client.0.smithi112.stdout:6/823: creat d8/de/d66/f126 x:0 0 0 2024-09-19T09:35:31.995 INFO:tasks.workunit.client.0.smithi112.stdout:1/680: dread dc/d59/d73/f98 [0,4194304] 0 2024-09-19T09:35:31.995 INFO:tasks.workunit.client.0.smithi112.stdout:6/824: creat d8/dc5/f127 x:0 0 0 2024-09-19T09:35:31.998 INFO:tasks.workunit.client.0.smithi112.stdout:3/793: dwrite d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d63/f71 [0,4194304] 0 2024-09-19T09:35:31.998 INFO:tasks.workunit.client.0.smithi112.stdout:6/825: link d8/d73/f76 d8/de/d61/d70/d7b/f128 0 2024-09-19T09:35:31.998 INFO:tasks.workunit.client.0.smithi112.stdout:3/794: dread - d8/d15/d1b/d1c/d27/d62/fc1 zero size 2024-09-19T09:35:31.999 INFO:tasks.workunit.client.0.smithi112.stdout:6/826: creat d8/de/d18/d20/d83/f129 x:0 0 0 2024-09-19T09:35:31.999 INFO:tasks.workunit.client.0.smithi112.stdout:6/827: dread - d8/de/d61/d70/d86/f122 zero size 2024-09-19T09:35:31.999 INFO:tasks.workunit.client.0.smithi112.stdout:3/795: write d8/d15/d1b/d1c/d43/fa6 [964179,107027] 0 2024-09-19T09:35:31.999 INFO:tasks.workunit.client.0.smithi112.stdout:3/796: write d8/d15/d1b/d1c/d43/d4f/f95 [1737921,122384] 0 2024-09-19T09:35:31.999 INFO:tasks.workunit.client.0.smithi112.stdout:3/797: stat d8/d15/d1b/d1c/d68/d33/d83/de4/fd0 0 2024-09-19T09:35:31.999 INFO:tasks.workunit.client.0.smithi112.stdout:3/798: write d8/d15/d1b/d1c/d27/d62/ff7 [203735,97136] 0 2024-09-19T09:35:32.006 INFO:tasks.workunit.client.0.smithi112.stdout:3/799: rename d8/d15/d1b/f6d to d8/d15/d1b/d1c/d68/db9/f10d 0 2024-09-19T09:35:32.009 INFO:tasks.workunit.client.0.smithi112.stdout:3/800: symlink d8/d15/d1b/d1c/d68/d33/d83/de4/de0/l10e 0 2024-09-19T09:35:32.019 INFO:tasks.workunit.client.0.smithi112.stdout:1/681: dwrite dc/d26/f70 [0,4194304] 0 2024-09-19T09:35:32.020 INFO:tasks.workunit.client.0.smithi112.stdout:6/828: dwrite d8/de/d18/f29 [0,4194304] 0 2024-09-19T09:35:32.021 INFO:tasks.workunit.client.0.smithi112.stdout:1/682: getdents dc/d13 0 2024-09-19T09:35:32.022 INFO:tasks.workunit.client.0.smithi112.stdout:6/829: symlink d8/de/d17/d94/l12a 0 2024-09-19T09:35:32.023 INFO:tasks.workunit.client.0.smithi112.stdout:6/830: read d8/de/d66/d8f/f97 [379444,95779] 0 2024-09-19T09:35:32.025 INFO:tasks.workunit.client.0.smithi112.stdout:6/831: mkdir d8/de/d18/d12b 0 2024-09-19T09:35:32.026 INFO:tasks.workunit.client.0.smithi112.stdout:6/832: fdatasync d8/de/fa0 0 2024-09-19T09:35:32.027 INFO:tasks.workunit.client.0.smithi112.stdout:6/833: rename d8/de/d17/d94/cde to d8/c12c 0 2024-09-19T09:35:32.031 INFO:tasks.workunit.client.0.smithi112.stdout:6/834: link d8/de/d18/l1a d8/de/d61/d70/d7b/d8a/l12d 0 2024-09-19T09:35:32.034 INFO:tasks.workunit.client.0.smithi112.stdout:6/835: mknod d8/de/d18/d20/c12e 0 2024-09-19T09:35:32.037 INFO:tasks.workunit.client.0.smithi112.stdout:6/836: rename d8/d11/d14/c9a to d8/de/d61/d70/db5/c12f 0 2024-09-19T09:35:32.040 INFO:tasks.workunit.client.0.smithi112.stdout:6/837: truncate d8/d11/d13/f98 2408299 0 2024-09-19T09:35:32.042 INFO:tasks.workunit.client.0.smithi112.stdout:3/801: dwrite d8/d15/d1b/d1c/d68/d33/d6f/f76 [0,4194304] 0 2024-09-19T09:35:32.042 INFO:tasks.workunit.client.0.smithi112.stdout:1/683: dwrite dc/d26/d34/d36/d68/d7d/f8d [0,4194304] 0 2024-09-19T09:35:32.047 INFO:tasks.workunit.client.0.smithi112.stdout:6/838: rename d8/de/d61/d70/d86 to d8/de/d61/dbf/d130 0 2024-09-19T09:35:32.048 INFO:tasks.workunit.client.0.smithi112.stdout:6/839: write d8/de/d66/fe8 [128996,117175] 0 2024-09-19T09:35:32.048 INFO:tasks.workunit.client.0.smithi112.stdout:6/840: read - d8/f8b zero size 2024-09-19T09:35:32.050 INFO:tasks.workunit.client.0.smithi112.stdout:1/684: rename dc/d26/d44/faf to dc/d13/fd2 0 2024-09-19T09:35:32.052 INFO:tasks.workunit.client.0.smithi112.stdout:6/841: rename d8/de/d18/l5d to d8/de/d61/dbf/l131 0 2024-09-19T09:35:32.052 INFO:tasks.workunit.client.0.smithi112.stdout:6/842: read - d8/de/d61/d70/db5/fdc zero size 2024-09-19T09:35:32.052 INFO:tasks.workunit.client.0.smithi112.stdout:6/843: fsync d8/d11/d14/d3c/d4b/d63/fe1 0 2024-09-19T09:35:32.053 INFO:tasks.workunit.client.0.smithi112.stdout:1/685: rename dc/d59/d73/f98 to dc/d24/d45/d94/dbc/fd3 0 2024-09-19T09:35:32.054 INFO:tasks.workunit.client.0.smithi112.stdout:6/844: mkdir d8/de/d18/d132 0 2024-09-19T09:35:32.056 INFO:tasks.workunit.client.0.smithi112.stdout:1/686: creat dc/d59/d73/d88/da5/fd4 x:0 0 0 2024-09-19T09:35:32.058 INFO:tasks.workunit.client.0.smithi112.stdout:6/845: creat d8/de/d17/d49/f133 x:0 0 0 2024-09-19T09:35:32.058 INFO:tasks.workunit.client.0.smithi112.stdout:6/846: truncate d8/d11/d13/fd6 196038 0 2024-09-19T09:35:32.059 INFO:tasks.workunit.client.0.smithi112.stdout:1/687: rmdir dc/d24/d45/d94 39 2024-09-19T09:35:32.059 INFO:tasks.workunit.client.0.smithi112.stdout:1/688: write dc/d24/da2/fb0 [1048105,43033] 0 2024-09-19T09:35:32.061 INFO:tasks.workunit.client.0.smithi112.stdout:6/847: dread d8/d11/d14/f24 [0,4194304] 0 2024-09-19T09:35:32.062 INFO:tasks.workunit.client.0.smithi112.stdout:6/848: write d8/d11/d13/f7f [3929889,125439] 0 2024-09-19T09:35:32.062 INFO:tasks.workunit.client.0.smithi112.stdout:6/849: chown d8/d11/d14/d3c/d4b/d63/f5f 254435 1 2024-09-19T09:35:32.062 INFO:tasks.workunit.client.0.smithi112.stdout:6/850: readlink d8/de/d17/l117 0 2024-09-19T09:35:32.062 INFO:tasks.workunit.client.0.smithi112.stdout:6/851: fdatasync d8/d11/d13/f98 0 2024-09-19T09:35:32.062 INFO:tasks.workunit.client.0.smithi112.stdout:6/852: dread - d8/de/d17/dae/fe5 zero size 2024-09-19T09:35:32.062 INFO:tasks.workunit.client.0.smithi112.stdout:1/689: mkdir dc/d26/d34/d36/d68/d7d/dd5 0 2024-09-19T09:35:32.062 INFO:tasks.workunit.client.0.smithi112.stdout:1/690: creat dc/d59/d73/fd6 x:0 0 0 2024-09-19T09:35:32.063 INFO:tasks.workunit.client.0.smithi112.stdout:6/853: getdents d8/de/d61/d70/d7b/d8a/de9 0 2024-09-19T09:35:32.068 INFO:tasks.workunit.client.0.smithi112.stdout:6/854: rename d8/de/d17/dae/fba to d8/d11/d14/d3c/d109/f134 0 2024-09-19T09:35:32.071 INFO:tasks.workunit.client.0.smithi112.stdout:1/691: dread dc/d24/d45/d94/f9c [0,4194304] 0 2024-09-19T09:35:32.071 INFO:tasks.workunit.client.0.smithi112.stdout:1/692: chown dc/c4f 13 1 2024-09-19T09:35:32.071 INFO:tasks.workunit.client.0.smithi112.stdout:1/693: write dc/d26/d34/d36/d68/fc4 [1030039,17445] 0 2024-09-19T09:35:32.071 INFO:tasks.workunit.client.0.smithi112.stdout:1/694: chown dc/d26/d34/d4c 389858 1 2024-09-19T09:35:32.071 INFO:tasks.workunit.client.0.smithi112.stdout:1/695: truncate dc/d26/d34/d36/d68/fcb 834149 0 2024-09-19T09:35:32.072 INFO:tasks.workunit.client.0.smithi112.stdout:6/855: mkdir d8/de/d61/d135 0 2024-09-19T09:35:32.075 INFO:tasks.workunit.client.0.smithi112.stdout:6/856: symlink d8/de/d66/l136 0 2024-09-19T09:35:32.075 INFO:tasks.workunit.client.0.smithi112.stdout:6/857: write d8/de/fa0 [1227004,18850] 0 2024-09-19T09:35:32.075 INFO:tasks.workunit.client.0.smithi112.stdout:6/858: stat d8/de/d66/d6e/cad 0 2024-09-19T09:35:32.079 INFO:tasks.workunit.client.0.smithi112.stdout:6/859: truncate d8/de/d61/dbf/dc8/fd2 2499176 0 2024-09-19T09:35:32.082 INFO:tasks.workunit.client.0.smithi112.stdout:6/860: creat d8/de/d61/d135/f137 x:0 0 0 2024-09-19T09:35:32.082 INFO:tasks.workunit.client.0.smithi112.stdout:6/861: write d8/d11/d14/d3c/d4b/d63/fd8 [926402,53609] 0 2024-09-19T09:35:32.084 INFO:tasks.workunit.client.0.smithi112.stdout:6/862: mknod d8/dc5/c138 0 2024-09-19T09:35:32.084 INFO:tasks.workunit.client.0.smithi112.stdout:6/863: write d8/de/d66/f126 [23376,124901] 0 2024-09-19T09:35:32.084 INFO:tasks.workunit.client.0.smithi112.stdout:6/864: chown d8/f23 83109 1 2024-09-19T09:35:32.087 INFO:tasks.workunit.client.0.smithi112.stdout:6/865: link d8/de/d18/l37 d8/de/d61/dbf/l139 0 2024-09-19T09:35:32.087 INFO:tasks.workunit.client.0.smithi112.stdout:1/696: dwrite dc/d26/d34/d4c/d64/fc8 [4194304,4194304] 0 2024-09-19T09:35:32.089 INFO:tasks.workunit.client.0.smithi112.stdout:1/697: link dc/d59/d73/cb3 dc/d26/d44/d63/cd7 0 2024-09-19T09:35:32.089 INFO:tasks.workunit.client.0.smithi112.stdout:1/698: chown l3 18 1 2024-09-19T09:35:32.090 INFO:tasks.workunit.client.0.smithi112.stdout:1/699: chown dc/d26/d44/d63/cd7 8477 1 2024-09-19T09:35:32.090 INFO:tasks.workunit.client.0.smithi112.stdout:1/700: creat dc/d59/d73/d88/da5/fd8 x:0 0 0 2024-09-19T09:35:32.096 INFO:tasks.workunit.client.0.smithi112.stdout:1/701: dread dc/d24/da2/fb0 [0,4194304] 0 2024-09-19T09:35:32.101 INFO:tasks.workunit.client.0.smithi112.stdout:1/702: write dc/f23 [3521125,19761] 0 2024-09-19T09:35:32.105 INFO:tasks.workunit.client.0.smithi112.stdout:6/866: dwrite d8/d11/d14/d3c/d4b/d63/fd8 [0,4194304] 0 2024-09-19T09:35:32.121 INFO:tasks.workunit.client.0.smithi112.stdout:6/867: dwrite d8/de/d61/dbf/dc8/f123 [4194304,4194304] 0 2024-09-19T09:35:32.121 INFO:tasks.workunit.client.0.smithi112.stdout:6/868: fsync d8/d11/d14/f3e 0 2024-09-19T09:35:32.125 INFO:tasks.workunit.client.0.smithi112.stdout:6/869: unlink d8/de/d66/d8f/lb2 0 2024-09-19T09:35:32.128 INFO:tasks.workunit.client.0.smithi112.stdout:6/870: mkdir d8/de/d61/d135/d13a 0 2024-09-19T09:35:32.131 INFO:tasks.workunit.client.0.smithi112.stdout:6/871: link d8/de/d61/dbf/d130/f10a d8/de/d61/d135/d13a/f13b 0 2024-09-19T09:35:32.134 INFO:tasks.workunit.client.0.smithi112.stdout:6/872: creat d8/de/d18/f13c x:0 0 0 2024-09-19T09:35:32.175 INFO:tasks.workunit.client.0.smithi112.stdout:8/810: sync 2024-09-19T09:35:32.175 INFO:tasks.workunit.client.0.smithi112.stdout:8/811: dread - d7/d10/d11/d50/fd1 zero size 2024-09-19T09:35:32.175 INFO:tasks.workunit.client.0.smithi112.stdout:8/812: chown d7/db/d21/d3b/d56/d3c/d79/fb2 110561230 1 2024-09-19T09:35:32.175 INFO:tasks.workunit.client.0.smithi112.stdout:8/813: truncate d7/db/d21/d2e/d8c/f8f 4423096 0 2024-09-19T09:35:32.175 INFO:tasks.workunit.client.0.smithi112.stdout:8/814: getdents d7/d10/d11/d55/d9e/da1/dd5 0 2024-09-19T09:35:32.175 INFO:tasks.workunit.client.0.smithi112.stdout:8/815: creat d7/d10/d11/d50/ddd/f101 x:0 0 0 2024-09-19T09:35:32.178 INFO:tasks.workunit.client.0.smithi112.stdout:8/816: creat d7/d10/d11/d55/d9e/da1/f102 x:0 0 0 2024-09-19T09:35:32.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:31 smithi191 ceph-mon[34834]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:32.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:31 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2964993883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:35:32.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:31 smithi191 ceph-mon[34834]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:32.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:31 smithi191 ceph-mon[34834]: pgmap v28: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 121 MiB/s rd, 143 MiB/s wr, 284 op/s 2024-09-19T09:35:32.479 INFO:tasks.workunit.client.0.smithi112.stdout:0/715: sync 2024-09-19T09:35:32.598 INFO:tasks.workunit.client.0.smithi112.stdout:9/581: sync 2024-09-19T09:35:32.598 INFO:tasks.workunit.client.0.smithi112.stdout:9/582: write df/d11/d14/d19/d40/d5c/f96 [17580,64558] 0 2024-09-19T09:35:32.620 INFO:tasks.workunit.client.0.smithi112.stdout:9/583: dwrite df/db9/fc6 [0,4194304] 0 2024-09-19T09:35:32.631 INFO:tasks.workunit.client.0.smithi112.stdout:9/584: write df/d11/f25 [3116106,71662] 0 2024-09-19T09:35:32.632 INFO:tasks.workunit.client.0.smithi112.stdout:9/585: mkdir df/d35/dd1 0 2024-09-19T09:35:32.634 INFO:tasks.workunit.client.0.smithi112.stdout:9/586: mknod df/d11/d14/d19/d40/daf/d6c/db3/d9e/cd2 0 2024-09-19T09:35:32.636 INFO:tasks.workunit.client.0.smithi112.stdout:9/587: mknod df/d11/d14/d19/d66/d5d/cd3 0 2024-09-19T09:35:32.637 INFO:tasks.workunit.client.0.smithi112.stdout:9/588: mkdir df/d11/d14/d19/d28/d95/dd4 0 2024-09-19T09:35:32.637 INFO:tasks.workunit.client.0.smithi112.stdout:9/589: truncate df/d11/d14/d19/d66/f9b 615215 0 2024-09-19T09:35:32.638 INFO:tasks.workunit.client.0.smithi112.stdout:9/590: mkdir df/d11/d14/d19/d28/d95/dd5 0 2024-09-19T09:35:32.638 INFO:tasks.workunit.client.0.smithi112.stdout:9/591: chown df/d11/d14/d19/d28/c52 15 1 2024-09-19T09:35:32.641 INFO:tasks.workunit.client.0.smithi112.stdout:9/592: symlink df/d11/d14/d19/dc0/ld6 0 2024-09-19T09:35:32.641 INFO:tasks.workunit.client.0.smithi112.stdout:9/593: truncate df/d11/d14/d19/d40/d5c/fbc 205213 0 2024-09-19T09:35:32.641 INFO:tasks.workunit.client.0.smithi112.stdout:9/594: creat df/d11/d14/d19/d28/d95/fd7 x:0 0 0 2024-09-19T09:35:32.641 INFO:tasks.workunit.client.0.smithi112.stdout:9/595: chown df/d11/d14/f5f 1843 1 2024-09-19T09:35:32.644 INFO:tasks.workunit.client.0.smithi112.stdout:9/596: rmdir df/d11/d14/d19/d28/d95/dd4 0 2024-09-19T09:35:32.660 INFO:tasks.workunit.client.0.smithi112.stdout:9/597: dwrite df/d11/d14/d19/d1e/f88 [4194304,4194304] 0 2024-09-19T09:35:32.660 INFO:tasks.workunit.client.0.smithi112.stdout:9/598: fsync df/d11/d14/d19/d1e/f69 0 2024-09-19T09:35:32.661 INFO:tasks.workunit.client.0.smithi112.stdout:9/599: fsync df/d11/d14/d19/d66/fcb 0 2024-09-19T09:35:32.663 INFO:tasks.workunit.client.0.smithi112.stdout:9/600: creat df/d11/d14/d19/d28/fd8 x:0 0 0 2024-09-19T09:35:32.665 INFO:tasks.workunit.client.0.smithi112.stdout:9/601: creat df/d11/d14/d19/d28/d95/dd5/fd9 x:0 0 0 2024-09-19T09:35:32.674 INFO:tasks.workunit.client.0.smithi112.stdout:9/602: write df/d11/d14/d19/d66/f3d [7245800,10438] 0 2024-09-19T09:35:32.674 INFO:tasks.workunit.client.0.smithi112.stdout:9/603: fdatasync df/d11/d14/d19/d1e/d97/fb2 0 2024-09-19T09:35:32.674 INFO:tasks.workunit.client.0.smithi112.stdout:9/604: write df/d11/f85 [4487976,87918] 0 2024-09-19T09:35:32.693 INFO:tasks.workunit.client.0.smithi112.stdout:9/605: dwrite df/d11/d14/d19/d28/fd8 [0,4194304] 0 2024-09-19T09:35:32.695 INFO:tasks.workunit.client.0.smithi112.stdout:9/606: unlink df/d11/d14/d19/d40/daf/d6c/db3/d9e/ca4 0 2024-09-19T09:35:32.696 INFO:tasks.workunit.client.0.smithi112.stdout:9/607: creat df/d11/d14/d19/d66/d99/dc4/fda x:0 0 0 2024-09-19T09:35:32.698 INFO:tasks.workunit.client.0.smithi112.stdout:9/608: creat df/d11/d14/d19/d40/daf/d6c/db3/d9e/fdb x:0 0 0 2024-09-19T09:35:32.698 INFO:tasks.workunit.client.0.smithi112.stdout:9/609: stat df/d11/d14/d19/d40/daf/d6c/db3/d9e/cd2 0 2024-09-19T09:35:32.698 INFO:tasks.workunit.client.0.smithi112.stdout:9/610: stat df/c56 0 2024-09-19T09:35:32.707 INFO:tasks.workunit.client.0.smithi112.stdout:9/611: rmdir df/d11/d14/d19/d66/d99/dc4 39 2024-09-19T09:35:32.709 INFO:tasks.workunit.client.0.smithi112.stdout:9/612: truncate df/d11/d14/d19/d66/f27 2672406 0 2024-09-19T09:35:32.711 INFO:tasks.workunit.client.0.smithi112.stdout:9/613: creat df/d11/d14/d19/fdc x:0 0 0 2024-09-19T09:35:32.711 INFO:tasks.workunit.client.0.smithi112.stdout:9/614: creat df/d11/d14/d51/fdd x:0 0 0 2024-09-19T09:35:32.714 INFO:tasks.workunit.client.0.smithi112.stdout:9/615: write df/f61 [279120,94573] 0 2024-09-19T09:35:32.714 INFO:tasks.workunit.client.0.smithi112.stdout:9/616: write df/d11/d14/d19/d28/f43 [1006774,90078] 0 2024-09-19T09:35:32.714 INFO:tasks.workunit.client.0.smithi112.stdout:9/617: creat df/d11/d14/d19/d28/d89/fde x:0 0 0 2024-09-19T09:35:32.715 INFO:tasks.workunit.client.0.smithi112.stdout:9/618: truncate df/d11/d14/d19/f90 361460 0 2024-09-19T09:35:32.716 INFO:tasks.workunit.client.0.smithi112.stdout:9/619: mknod df/d35/dd1/cdf 0 2024-09-19T09:35:32.719 INFO:tasks.workunit.client.0.smithi112.stdout:9/620: mkdir df/d11/d14/d19/de0 0 2024-09-19T09:35:32.732 INFO:tasks.workunit.client.0.smithi112.stdout:9/621: dwrite df/d11/d14/d19/d28/d89/fc2 [0,4194304] 0 2024-09-19T09:35:32.749 INFO:tasks.workunit.client.0.smithi112.stdout:9/622: dwrite df/d11/d14/d51/fdd [0,4194304] 0 2024-09-19T09:35:32.751 INFO:tasks.workunit.client.0.smithi112.stdout:9/623: fdatasync df/f61 0 2024-09-19T09:35:32.753 INFO:tasks.workunit.client.0.smithi112.stdout:9/624: symlink df/d11/d14/d19/dc0/le1 0 2024-09-19T09:35:32.755 INFO:tasks.workunit.client.0.smithi112.stdout:9/625: readlink df/d11/d14/d19/d1e/l55 0 2024-09-19T09:35:32.764 INFO:tasks.workunit.client.0.smithi112.stdout:7/929: sync 2024-09-19T09:35:32.764 INFO:tasks.workunit.client.0.smithi112.stdout:5/976: sync 2024-09-19T09:35:32.769 INFO:tasks.workunit.client.0.smithi112.stdout:7/930: rmdir d2/d2c/d54/d1a/d132/da1 39 2024-09-19T09:35:32.769 INFO:tasks.workunit.client.0.smithi112.stdout:7/931: fdatasync d2/d2c/d54/d1a/d132/d146/d4c/d70/dcf/d126/f13b 0 2024-09-19T09:35:32.769 INFO:tasks.workunit.client.0.smithi112.stdout:7/932: dread - d2/d2c/d54/d1a/d132/db4/d110/dcc/f111 zero size 2024-09-19T09:35:32.770 INFO:tasks.workunit.client.0.smithi112.stdout:3/802: sync 2024-09-19T09:35:32.770 INFO:tasks.workunit.client.0.smithi112.stdout:8/817: sync 2024-09-19T09:35:32.770 INFO:tasks.workunit.client.0.smithi112.stdout:6/873: sync 2024-09-19T09:35:32.771 INFO:tasks.workunit.client.0.smithi112.stdout:0/716: sync 2024-09-19T09:35:32.771 INFO:tasks.workunit.client.0.smithi112.stdout:2/765: sync 2024-09-19T09:35:32.771 INFO:tasks.workunit.client.0.smithi112.stdout:1/703: sync 2024-09-19T09:35:32.771 INFO:tasks.workunit.client.0.smithi112.stdout:2/766: chown d0/d1/d5f/d78/db0/f65 5660258 1 2024-09-19T09:35:32.771 INFO:tasks.workunit.client.0.smithi112.stdout:1/704: fdatasync dc/d26/d34/d36/d68/d7d/f7b 0 2024-09-19T09:35:32.771 INFO:tasks.workunit.client.0.smithi112.stdout:2/767: chown d0/d6/d24/c33 54225967 1 2024-09-19T09:35:32.772 INFO:tasks.workunit.client.0.smithi112.stdout:3/803: getdents d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d63 0 2024-09-19T09:35:32.775 INFO:tasks.workunit.client.0.smithi112.stdout:0/717: mkdir d2/d59/da1/dd4/db8/deb 0 2024-09-19T09:35:32.775 INFO:tasks.workunit.client.0.smithi112.stdout:0/718: chown d2/d59/l62 822439269 1 2024-09-19T09:35:32.775 INFO:tasks.workunit.client.0.smithi112.stdout:0/719: chown d2/d39/d3b/d8a 705139420 1 2024-09-19T09:35:32.778 INFO:tasks.workunit.client.0.smithi112.stdout:8/818: rename d7/d10/d11/d50/ddd/ff4 to d7/db/d21/d3b/d56/d3c/f103 0 2024-09-19T09:35:32.782 INFO:tasks.workunit.client.0.smithi112.stdout:6/874: write d8/d11/d14/d2a/f32 [1199086,68207] 0 2024-09-19T09:35:32.782 INFO:tasks.workunit.client.0.smithi112.stdout:7/933: write d2/d2c/d54/d1a/d132/d146/fa7 [1008966,77511] 0 2024-09-19T09:35:32.784 INFO:tasks.workunit.client.0.smithi112.stdout:1/705: creat dc/d26/d34/d36/d68/d7d/d6a/dac/fd9 x:0 0 0 2024-09-19T09:35:32.787 INFO:tasks.workunit.client.0.smithi112.stdout:3/804: creat d8/d15/d1b/d1c/d27/d62/d99/f10f x:0 0 0 2024-09-19T09:35:32.788 INFO:tasks.workunit.client.0.smithi112.stdout:3/805: getdents d8/d15/d1b/d1c/d27/d62/d99/d103 0 2024-09-19T09:35:32.788 INFO:tasks.workunit.client.0.smithi112.stdout:5/977: dwrite d4/d9/d2a/d39/f105 [0,4194304] 0 2024-09-19T09:35:32.789 INFO:tasks.workunit.client.0.smithi112.stdout:2/768: dwrite d0/d1/fde [0,4194304] 0 2024-09-19T09:35:32.789 INFO:tasks.workunit.client.0.smithi112.stdout:0/720: mknod d2/d6e/cec 0 2024-09-19T09:35:32.792 INFO:tasks.workunit.client.0.smithi112.stdout:6/875: creat d8/de/d18/d132/f13d x:0 0 0 2024-09-19T09:35:32.792 INFO:tasks.workunit.client.0.smithi112.stdout:6/876: chown d8/de/d18 61 1 2024-09-19T09:35:32.792 INFO:tasks.workunit.client.0.smithi112.stdout:6/877: stat d8/de/d66/d8f 0 2024-09-19T09:35:32.792 INFO:tasks.workunit.client.0.smithi112.stdout:6/878: write d8/d11/d14/d3c/d4b/d63/fe1 [112374,87141] 0 2024-09-19T09:35:32.792 INFO:tasks.workunit.client.0.smithi112.stdout:6/879: readlink d8/l12 0 2024-09-19T09:35:32.793 INFO:tasks.workunit.client.0.smithi112.stdout:1/706: unlink dc/d59/l6e 0 2024-09-19T09:35:32.795 INFO:tasks.workunit.client.0.smithi112.stdout:3/806: creat d8/d15/d1b/d1c/d68/f110 x:0 0 0 2024-09-19T09:35:32.800 INFO:tasks.workunit.client.0.smithi112.stdout:5/978: symlink d4/d9/d17/da6/db2/l14c 0 2024-09-19T09:35:32.801 INFO:tasks.workunit.client.0.smithi112.stdout:3/807: mkdir d8/d15/d1b/d1c/d68/d33/d8e/d111 0 2024-09-19T09:35:32.801 INFO:tasks.workunit.client.0.smithi112.stdout:3/808: chown d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/c9a 70455 1 2024-09-19T09:35:32.804 INFO:tasks.workunit.client.0.smithi112.stdout:5/979: link d4/d9/d6b/laf d4/d9/d17/d2f/d7d/l14d 0 2024-09-19T09:35:32.805 INFO:tasks.workunit.client.0.smithi112.stdout:3/809: creat d8/d15/d1b/d1c/d27/d62/f112 x:0 0 0 2024-09-19T09:35:32.805 INFO:tasks.workunit.client.0.smithi112.stdout:3/810: write d8/d48/fe2 [744033,97838] 0 2024-09-19T09:35:32.805 INFO:tasks.workunit.client.0.smithi112.stdout:3/811: dread - d8/d15/d1b/d1c/d27/d62/fc1 zero size 2024-09-19T09:35:32.805 INFO:tasks.workunit.client.0.smithi112.stdout:3/812: readlink d8/d15/d1b/d1c/d27/d62/d99/da0/lf2 0 2024-09-19T09:35:32.805 INFO:tasks.workunit.client.0.smithi112.stdout:3/813: write d8/d15/d1b/d1c/d68/d33/d83/de4/f106 [1037064,108645] 0 2024-09-19T09:35:32.806 INFO:tasks.workunit.client.0.smithi112.stdout:5/980: symlink d4/d9/d17/l14e 0 2024-09-19T09:35:32.816 INFO:tasks.workunit.client.0.smithi112.stdout:7/934: dwrite d2/d2c/d54/d1a/d132/d146/d4c/d70/d7b/fa8 [0,4194304] 0 2024-09-19T09:35:32.816 INFO:tasks.workunit.client.0.smithi112.stdout:3/814: dread d8/d15/d1b/d1c/db5/ff5 [0,4194304] 0 2024-09-19T09:35:32.819 INFO:tasks.workunit.client.0.smithi112.stdout:8/819: dwrite d7/db/d21/d3b/d56/d3c/d79/ffd [0,4194304] 0 2024-09-19T09:35:32.819 INFO:tasks.workunit.client.0.smithi112.stdout:8/820: fdatasync d7/d10/d11/ffa 0 2024-09-19T09:35:32.820 INFO:tasks.workunit.client.0.smithi112.stdout:3/815: unlink d8/d15/d1b/d1c/d68/d33/d7b/fab 0 2024-09-19T09:35:32.820 INFO:tasks.workunit.client.0.smithi112.stdout:5/981: write d4/d9/d3e/fd3 [2484437,125052] 0 2024-09-19T09:35:32.823 INFO:tasks.workunit.client.0.smithi112.stdout:7/935: creat d2/d2c/d54/d1a/d132/d39/d21/d71/f156 x:0 0 0 2024-09-19T09:35:32.824 INFO:tasks.workunit.client.0.smithi112.stdout:2/769: dwrite d0/d6/d24/fd0 [4194304,4194304] 0 2024-09-19T09:35:32.824 INFO:tasks.workunit.client.0.smithi112.stdout:0/721: dwrite d2/d59/da1/dd4/d95/db5/f1c [0,4194304] 0 2024-09-19T09:35:32.824 INFO:tasks.workunit.client.0.smithi112.stdout:6/880: dwrite d8/d11/d13/f56 [0,4194304] 0 2024-09-19T09:35:32.825 INFO:tasks.workunit.client.0.smithi112.stdout:8/821: symlink d7/db/d21/d3b/d56/d3c/d79/ddf/l104 0 2024-09-19T09:35:32.827 INFO:tasks.workunit.client.0.smithi112.stdout:3/816: rmdir d8/d15/d1b 39 2024-09-19T09:35:32.834 INFO:tasks.workunit.client.0.smithi112.stdout:7/936: creat d2/d2c/d54/d1a/d132/d39/d21/f157 x:0 0 0 2024-09-19T09:35:32.837 INFO:tasks.workunit.client.0.smithi112.stdout:2/770: rename d0/d1/d28/d88/da3 to d0/d1/d28/d88/dcd/df2 0 2024-09-19T09:35:32.837 INFO:tasks.workunit.client.0.smithi112.stdout:2/771: truncate d0/d4a/f7d 436330 0 2024-09-19T09:35:32.840 INFO:tasks.workunit.client.0.smithi112.stdout:6/881: creat d8/d11/d14/d3c/f13e x:0 0 0 2024-09-19T09:35:32.842 INFO:tasks.workunit.client.0.smithi112.stdout:8/822: symlink d7/d10/d11/d50/ddd/l105 0 2024-09-19T09:35:32.842 INFO:tasks.workunit.client.0.smithi112.stdout:8/823: truncate d7/d10/d11/ffa 81955 0 2024-09-19T09:35:32.844 INFO:tasks.workunit.client.0.smithi112.stdout:3/817: mkdir d8/d15/d1b/d1c/d68/d33/d66/d113 0 2024-09-19T09:35:32.844 INFO:tasks.workunit.client.0.smithi112.stdout:3/818: chown d8/d15/d1b/d1c/d68/f70 144 1 2024-09-19T09:35:32.844 INFO:tasks.workunit.client.0.smithi112.stdout:3/819: truncate d8/d15/d1b/d1c/db5/d101/f80 4330264 0 2024-09-19T09:35:32.844 INFO:tasks.workunit.client.0.smithi112.stdout:3/820: write d8/d15/d1b/d1c/db5/fd9 [428,84349] 0 2024-09-19T09:35:32.844 INFO:tasks.workunit.client.0.smithi112.stdout:3/821: write d8/f4d [1618634,88680] 0 2024-09-19T09:35:32.845 INFO:tasks.workunit.client.0.smithi112.stdout:3/822: write d8/d15/d1b/d1c/d68/d33/d83/f9c [933835,25386] 0 2024-09-19T09:35:32.845 INFO:tasks.workunit.client.0.smithi112.stdout:3/823: truncate d8/d15/d1b/d1c/d68/d33/f57 4344455 0 2024-09-19T09:35:32.847 INFO:tasks.workunit.client.0.smithi112.stdout:7/937: link d2/d2c/d54/d1a/d132/d39/f130 d2/d2c/d54/d1a/d132/da1/d153/f158 0 2024-09-19T09:35:32.849 INFO:tasks.workunit.client.0.smithi112.stdout:2/772: link d0/d1/d5f/d78/le0 d0/d1/d5f/d78/db0/d9a/dae/lf3 0 2024-09-19T09:35:32.850 INFO:tasks.workunit.client.0.smithi112.stdout:6/882: creat d8/de/d17/dae/deb/f13f x:0 0 0 2024-09-19T09:35:32.853 INFO:tasks.workunit.client.0.smithi112.stdout:2/773: symlink d0/d1/dd3/lf4 0 2024-09-19T09:35:32.853 INFO:tasks.workunit.client.0.smithi112.stdout:6/883: truncate d8/d11/d14/d2a/f4d 3758053 0 2024-09-19T09:35:32.855 INFO:tasks.workunit.client.0.smithi112.stdout:7/938: mknod d2/d2c/d54/d1a/d132/db4/c159 0 2024-09-19T09:35:32.856 INFO:tasks.workunit.client.0.smithi112.stdout:2/774: mkdir d0/d4a/df5 0 2024-09-19T09:35:32.857 INFO:tasks.workunit.client.0.smithi112.stdout:7/939: dread d2/d2c/d54/d1a/d132/d85/f92 [0,4194304] 0 2024-09-19T09:35:32.858 INFO:tasks.workunit.client.0.smithi112.stdout:2/775: creat d0/d3e/d50/ff6 x:0 0 0 2024-09-19T09:35:32.858 INFO:tasks.workunit.client.0.smithi112.stdout:2/776: write d0/d3e/d49/fb2 [1359197,69963] 0 2024-09-19T09:35:32.860 INFO:tasks.workunit.client.0.smithi112.stdout:8/824: dwrite d7/db/d21/d3b/d56/d3c/f94 [0,4194304] 0 2024-09-19T09:35:32.860 INFO:tasks.workunit.client.0.smithi112.stdout:2/777: creat d0/d3e/d50/d57/d80/d8b/ff7 x:0 0 0 2024-09-19T09:35:32.866 INFO:tasks.workunit.client.0.smithi112.stdout:7/940: dread d2/d2c/f38 [0,4194304] 0 2024-09-19T09:35:32.869 INFO:tasks.workunit.client.0.smithi112.stdout:6/884: dread d8/de/d61/d70/fb1 [0,4194304] 0 2024-09-19T09:35:32.869 INFO:tasks.workunit.client.0.smithi112.stdout:6/885: chown d8/d11/d14/d3c/d4b/d63/dd3/dda 177875 1 2024-09-19T09:35:32.887 INFO:tasks.workunit.client.0.smithi112.stdout:8/825: dwrite d7/db/d21/d2e/d8c/d97/db6/ffc [0,4194304] 0 2024-09-19T09:35:32.890 INFO:tasks.workunit.client.0.smithi112.stdout:8/826: creat d7/f106 x:0 0 0 2024-09-19T09:35:32.890 INFO:tasks.workunit.client.0.smithi112.stdout:8/827: dread - d7/d10/d11/d33/fc4 zero size 2024-09-19T09:35:32.891 INFO:tasks.workunit.client.0.smithi112.stdout:8/828: chown d7/db/d21/d3b/d56/d3c/d79/ddf/l104 16559 1 2024-09-19T09:35:32.891 INFO:tasks.workunit.client.0.smithi112.stdout:8/829: mkdir d7/db/d21/d2e/d8c/d97/d107 0 2024-09-19T09:35:32.896 INFO:tasks.workunit.client.0.smithi112.stdout:7/941: dwrite d2/d2c/d54/dba/dee/f141 [0,4194304] 0 2024-09-19T09:35:32.897 INFO:tasks.workunit.client.0.smithi112.stdout:6/886: dwrite d8/d11/d14/d2a/f32 [0,4194304] 0 2024-09-19T09:35:32.897 INFO:tasks.workunit.client.0.smithi112.stdout:2/778: dwrite d0/d3e/d50/d57/d5a/d27/f2a [0,4194304] 0 2024-09-19T09:35:32.899 INFO:tasks.workunit.client.0.smithi112.stdout:7/942: stat d2/d2c/d54/d1a/d132/d146/d4c/d70/c80 0 2024-09-19T09:35:32.900 INFO:tasks.workunit.client.0.smithi112.stdout:6/887: stat d8/d11/d13/l33 0 2024-09-19T09:35:32.900 INFO:tasks.workunit.client.0.smithi112.stdout:6/888: read d8/d11/d14/d3c/d4b/d63/f38 [11591,12472] 0 2024-09-19T09:35:32.900 INFO:tasks.workunit.client.0.smithi112.stdout:6/889: readlink l4 0 2024-09-19T09:35:32.900 INFO:tasks.workunit.client.0.smithi112.stdout:6/890: readlink d8/d11/d14/d3c/d4b/d63/l4c 0 2024-09-19T09:35:32.901 INFO:tasks.workunit.client.0.smithi112.stdout:7/943: creat d2/d2c/d54/d1a/d132/d39/d21/d45/f15a x:0 0 0 2024-09-19T09:35:32.901 INFO:tasks.workunit.client.0.smithi112.stdout:7/944: chown d2/d2c/d54/d1a/d132/d39/d21/d71/l10c 14771 1 2024-09-19T09:35:32.901 INFO:tasks.workunit.client.0.smithi112.stdout:7/945: fsync d2/d2c/d54/d1a/d132/db4/d110/fe1 0 2024-09-19T09:35:32.902 INFO:tasks.workunit.client.0.smithi112.stdout:8/830: dread d7/db/d21/f22 [0,4194304] 0 2024-09-19T09:35:32.902 INFO:tasks.workunit.client.0.smithi112.stdout:8/831: chown d7/c34 3116 1 2024-09-19T09:35:32.903 INFO:tasks.workunit.client.0.smithi112.stdout:6/891: symlink d8/de/d17/dae/l140 0 2024-09-19T09:35:32.903 INFO:tasks.workunit.client.0.smithi112.stdout:6/892: chown d8/de/d61/dbf/l139 199183243 1 2024-09-19T09:35:32.903 INFO:tasks.workunit.client.0.smithi112.stdout:6/893: creat d8/de/d61/dbf/dc8/f141 x:0 0 0 2024-09-19T09:35:32.903 INFO:tasks.workunit.client.0.smithi112.stdout:8/832: mknod d7/db/c108 0 2024-09-19T09:35:32.908 INFO:tasks.workunit.client.0.smithi112.stdout:6/894: creat d8/de/d61/f142 x:0 0 0 2024-09-19T09:35:33.465 INFO:tasks.workunit.client.0.smithi112.stdout:9/626: sync 2024-09-19T09:35:33.465 INFO:tasks.workunit.client.0.smithi112.stdout:1/707: sync 2024-09-19T09:35:33.488 INFO:tasks.workunit.client.0.smithi112.stdout:1/708: dwrite dc/f21 [0,4194304] 0 2024-09-19T09:35:33.489 INFO:tasks.workunit.client.0.smithi112.stdout:9/627: dwrite df/d11/d14/d19/d40/d5c/f96 [0,4194304] 0 2024-09-19T09:35:33.493 INFO:tasks.workunit.client.0.smithi112.stdout:1/709: link dc/d26/d34/d4c/d64/cc2 dc/d26/d34/d36/d68/d7d/d6a/dac/cda 0 2024-09-19T09:35:33.503 INFO:tasks.workunit.client.0.smithi112.stdout:9/628: symlink df/d11/d14/d19/d1e/le2 0 2024-09-19T09:35:33.512 INFO:tasks.workunit.client.0.smithi112.stdout:1/710: rmdir dc/d59 39 2024-09-19T09:35:33.515 INFO:tasks.workunit.client.0.smithi112.stdout:1/711: dread dc/d26/d34/d36/d68/fcc [0,4194304] 0 2024-09-19T09:35:33.515 INFO:tasks.workunit.client.0.smithi112.stdout:1/712: truncate dc/d26/d34/d36/d68/f92 835570 0 2024-09-19T09:35:33.519 INFO:tasks.workunit.client.0.smithi112.stdout:1/713: unlink dc/d26/d34/d36/d68/d7d/d6a/ca7 0 2024-09-19T09:35:33.521 INFO:tasks.workunit.client.0.smithi112.stdout:1/714: truncate dc/d26/d34/d4c/d55/f5a 2933053 0 2024-09-19T09:35:33.532 INFO:tasks.workunit.client.0.smithi112.stdout:9/629: dwrite df/d11/fb6 [0,4194304] 0 2024-09-19T09:35:33.552 INFO:tasks.workunit.client.0.smithi112.stdout:1/715: dwrite dc/d26/d34/d4c/f7e [0,4194304] 0 2024-09-19T09:35:33.552 INFO:tasks.workunit.client.0.smithi112.stdout:1/716: fdatasync dc/d13/f42 0 2024-09-19T09:35:33.562 INFO:tasks.workunit.client.0.smithi112.stdout:1/717: dread dc/d26/d34/f97 [0,4194304] 0 2024-09-19T09:35:33.568 INFO:tasks.workunit.client.0.smithi112.stdout:1/718: getdents dc/d26/d34/d36/d68/d7d/d6a/db4 0 2024-09-19T09:35:33.570 INFO:tasks.workunit.client.0.smithi112.stdout:6/895: sync 2024-09-19T09:35:33.570 INFO:tasks.workunit.client.0.smithi112.stdout:2/779: sync 2024-09-19T09:35:33.570 INFO:tasks.workunit.client.0.smithi112.stdout:2/780: stat d0/d1/f40 0 2024-09-19T09:35:33.571 INFO:tasks.workunit.client.0.smithi112.stdout:3/824: sync 2024-09-19T09:35:33.571 INFO:tasks.workunit.client.0.smithi112.stdout:3/825: chown d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/c64 94740096 1 2024-09-19T09:35:33.571 INFO:tasks.workunit.client.0.smithi112.stdout:3/826: chown d8/d15/d1b/d1c/d68/d33/d8e/dc8/f104 272624 1 2024-09-19T09:35:33.571 INFO:tasks.workunit.client.0.smithi112.stdout:3/827: write d8/d15/d1b/d1c/d27/d62/d99/fbb [545718,121660] 0 2024-09-19T09:35:33.571 INFO:tasks.workunit.client.0.smithi112.stdout:3/828: read - d8/d15/d1b/d1c/d68/d33/d7b/f109 zero size 2024-09-19T09:35:33.571 INFO:tasks.workunit.client.0.smithi112.stdout:1/719: creat dc/d26/d34/d4c/d64/fdb x:0 0 0 2024-09-19T09:35:33.571 INFO:tasks.workunit.client.0.smithi112.stdout:8/833: sync 2024-09-19T09:35:33.571 INFO:tasks.workunit.client.0.smithi112.stdout:8/834: dread - d7/db/d21/d3b/d56/d3c/fa4 zero size 2024-09-19T09:35:33.571 INFO:tasks.workunit.client.0.smithi112.stdout:5/982: sync 2024-09-19T09:35:33.573 INFO:tasks.workunit.client.0.smithi112.stdout:7/946: sync 2024-09-19T09:35:33.573 INFO:tasks.workunit.client.0.smithi112.stdout:7/947: stat d2/d2c/d54/dba/dee/f141 0 2024-09-19T09:35:33.573 INFO:tasks.workunit.client.0.smithi112.stdout:0/722: sync 2024-09-19T09:35:33.573 INFO:tasks.workunit.client.0.smithi112.stdout:0/723: creat d2/d45/fed x:0 0 0 2024-09-19T09:35:33.573 INFO:tasks.workunit.client.0.smithi112.stdout:2/781: rename d0/d1/d28/fd5 to d0/d3e/d50/d57/d5a/d56/ff8 0 2024-09-19T09:35:33.574 INFO:tasks.workunit.client.0.smithi112.stdout:1/720: mknod dc/d24/d45/d94/cdc 0 2024-09-19T09:35:33.578 INFO:tasks.workunit.client.0.smithi112.stdout:2/782: dread d0/d1/d28/f43 [0,4194304] 0 2024-09-19T09:35:33.579 INFO:tasks.workunit.client.0.smithi112.stdout:5/983: unlink d4/d9/d17/dd6/l104 0 2024-09-19T09:35:33.584 INFO:tasks.workunit.client.0.smithi112.stdout:1/721: rmdir dc/d26/d34/d36/d68/dc1 39 2024-09-19T09:35:33.585 INFO:tasks.workunit.client.0.smithi112.stdout:1/722: chown dc/d26/d34/d36/l43 312698 1 2024-09-19T09:35:33.587 INFO:tasks.workunit.client.0.smithi112.stdout:7/948: dread d2/d2c/d54/d1a/d132/d146/fc5 [0,4194304] 0 2024-09-19T09:35:33.587 INFO:tasks.workunit.client.0.smithi112.stdout:5/984: creat d4/d9/d2a/d46/dde/de2/f14f x:0 0 0 2024-09-19T09:35:33.590 INFO:tasks.workunit.client.0.smithi112.stdout:1/723: mknod dc/d59/d73/cdd 0 2024-09-19T09:35:33.591 INFO:tasks.workunit.client.0.smithi112.stdout:6/896: write d8/d11/d13/f56 [1811763,46944] 0 2024-09-19T09:35:33.591 INFO:tasks.workunit.client.0.smithi112.stdout:1/724: dread - dc/d59/f80 zero size 2024-09-19T09:35:33.593 INFO:tasks.workunit.client.0.smithi112.stdout:7/949: truncate d2/d2c/d54/d1a/f42 1945540 0 2024-09-19T09:35:33.594 INFO:tasks.workunit.client.0.smithi112.stdout:3/829: write d8/d15/d1b/d1c/d68/d33/d83/de4/fb6 [1005766,51140] 0 2024-09-19T09:35:33.598 INFO:tasks.workunit.client.0.smithi112.stdout:8/835: dwrite d7/d10/d11/f2b [0,4194304] 0 2024-09-19T09:35:33.603 INFO:tasks.workunit.client.0.smithi112.stdout:1/725: mknod dc/d13/cde 0 2024-09-19T09:35:33.605 INFO:tasks.workunit.client.0.smithi112.stdout:0/724: write d2/d59/f60 [700199,106971] 0 2024-09-19T09:35:33.608 INFO:tasks.workunit.client.0.smithi112.stdout:8/836: symlink d7/db/d21/d72/l109 0 2024-09-19T09:35:33.610 INFO:tasks.workunit.client.0.smithi112.stdout:8/837: write d7/d10/d11/d33/f27 [68367,64039] 0 2024-09-19T09:35:33.610 INFO:tasks.workunit.client.0.smithi112.stdout:2/783: dwrite d0/d3e/d61/f6c [0,4194304] 0 2024-09-19T09:35:33.610 INFO:tasks.workunit.client.0.smithi112.stdout:2/784: chown d0/d1/d5f/dc6 732468389 1 2024-09-19T09:35:33.613 INFO:tasks.workunit.client.0.smithi112.stdout:1/726: creat dc/d24/d45/d94/dbc/fdf x:0 0 0 2024-09-19T09:35:33.616 INFO:tasks.workunit.client.0.smithi112.stdout:0/725: rename d2/d6e/d75/lad to d2/d6e/db4/lee 0 2024-09-19T09:35:33.623 INFO:tasks.workunit.client.0.smithi112.stdout:8/838: rename d7/db/d21/d2e/d8c/d97/dc3/dc9/dcd/fcf to d7/db/d21/d3b/f10a 0 2024-09-19T09:35:33.626 INFO:tasks.workunit.client.0.smithi112.stdout:5/985: dwrite d4/d9/d17/d2f/d72/f63 [4194304,4194304] 0 2024-09-19T09:35:33.626 INFO:tasks.workunit.client.0.smithi112.stdout:1/727: dread dc/d26/d44/d63/f7f [0,4194304] 0 2024-09-19T09:35:33.626 INFO:tasks.workunit.client.0.smithi112.stdout:0/726: link d2/d6e/d75/f76 d2/d59/da1/dd4/d95/fef 0 2024-09-19T09:35:33.626 INFO:tasks.workunit.client.0.smithi112.stdout:7/950: dwrite d2/d2c/d54/d1a/f72 [0,4194304] 0 2024-09-19T09:35:33.629 INFO:tasks.workunit.client.0.smithi112.stdout:2/785: rmdir d0/d3e/d50/d57/d5a/d4f 39 2024-09-19T09:35:33.631 INFO:tasks.workunit.client.0.smithi112.stdout:8/839: unlink d7/db/fa2 0 2024-09-19T09:35:33.635 INFO:tasks.workunit.client.0.smithi112.stdout:0/727: symlink d2/d39/d3b/dab/lf0 0 2024-09-19T09:35:33.636 INFO:tasks.workunit.client.0.smithi112.stdout:1/728: dread f8 [0,4194304] 0 2024-09-19T09:35:33.637 INFO:tasks.workunit.client.0.smithi112.stdout:7/951: creat d2/d2c/d54/d1a/d132/db4/de7/d127/f15b x:0 0 0 2024-09-19T09:35:33.640 INFO:tasks.workunit.client.0.smithi112.stdout:8/840: unlink d7/f76 0 2024-09-19T09:35:33.642 INFO:tasks.workunit.client.0.smithi112.stdout:0/728: creat d2/d6e/ff1 x:0 0 0 2024-09-19T09:35:33.643 INFO:tasks.workunit.client.0.smithi112.stdout:1/729: symlink dc/d26/d34/d4c/le0 0 2024-09-19T09:35:33.643 INFO:tasks.workunit.client.0.smithi112.stdout:1/730: readlink dc/d26/d34/d4c/l9e 0 2024-09-19T09:35:33.643 INFO:tasks.workunit.client.0.smithi112.stdout:1/731: fdatasync dc/d24/f12 0 2024-09-19T09:35:33.645 INFO:tasks.workunit.client.0.smithi112.stdout:7/952: creat d2/d2c/d54/d1a/d132/db4/de7/f15c x:0 0 0 2024-09-19T09:35:33.645 INFO:tasks.workunit.client.0.smithi112.stdout:5/986: dwrite d4/d9/d2a/d39/f11e [4194304,4194304] 0 2024-09-19T09:35:33.645 INFO:tasks.workunit.client.0.smithi112.stdout:5/987: dread - d4/f13f zero size 2024-09-19T09:35:33.647 INFO:tasks.workunit.client.0.smithi112.stdout:6/897: dwrite d8/d11/d13/fd6 [0,4194304] 0 2024-09-19T09:35:33.647 INFO:tasks.workunit.client.0.smithi112.stdout:6/898: dread - d8/d73/f125 zero size 2024-09-19T09:35:33.647 INFO:tasks.workunit.client.0.smithi112.stdout:6/899: getdents d8/de/d18/d12b 0 2024-09-19T09:35:33.647 INFO:tasks.workunit.client.0.smithi112.stdout:0/729: mknod d2/d6e/da0/cf2 0 2024-09-19T09:35:33.649 INFO:tasks.workunit.client.0.smithi112.stdout:1/732: creat dc/d26/d34/d6f/fe1 x:0 0 0 2024-09-19T09:35:33.656 INFO:tasks.workunit.client.0.smithi112.stdout:2/786: dwrite d0/d3e/d49/f4c [4194304,4194304] 0 2024-09-19T09:35:33.656 INFO:tasks.workunit.client.0.smithi112.stdout:7/953: write d2/d2c/d54/d1a/d132/d85/fb2 [503422,63155] 0 2024-09-19T09:35:33.656 INFO:tasks.workunit.client.0.smithi112.stdout:7/954: write d2/d2c/d54/d1a/d132/d146/d4c/d70/dcf/d126/f151 [232549,72962] 0 2024-09-19T09:35:33.657 INFO:tasks.workunit.client.0.smithi112.stdout:7/955: dread d2/d2c/d54/d1a/d132/d39/d23/f52 [0,4194304] 0 2024-09-19T09:35:33.660 INFO:tasks.workunit.client.0.smithi112.stdout:5/988: rename d4/d9/d2a/d39/d88/l6f to d4/d29/d36/d5f/l150 0 2024-09-19T09:35:33.662 INFO:tasks.workunit.client.0.smithi112.stdout:8/841: getdents d7/db/d21/d2e/d42/d57 0 2024-09-19T09:35:33.663 INFO:tasks.workunit.client.0.smithi112.stdout:5/989: dread d4/d9/d17/f8e [0,4194304] 0 2024-09-19T09:35:33.668 INFO:tasks.workunit.client.0.smithi112.stdout:0/730: creat d2/d59/da1/ff3 x:0 0 0 2024-09-19T09:35:33.668 INFO:tasks.workunit.client.0.smithi112.stdout:0/731: stat d2/fb 0 2024-09-19T09:35:33.668 INFO:tasks.workunit.client.0.smithi112.stdout:0/732: stat d2/f21 0 2024-09-19T09:35:33.668 INFO:tasks.workunit.client.0.smithi112.stdout:1/733: creat dc/d26/d34/d4c/fe2 x:0 0 0 2024-09-19T09:35:33.671 INFO:tasks.workunit.client.0.smithi112.stdout:7/956: rmdir d2/d2c/d54/d1a/d132/d39/d21/d45/d4d/dbe 39 2024-09-19T09:35:33.676 INFO:tasks.workunit.client.0.smithi112.stdout:6/900: rename d8/d11/d14/d3c/d4b/d63/l65 to d8/l143 0 2024-09-19T09:35:33.679 INFO:tasks.workunit.client.0.smithi112.stdout:8/842: symlink d7/db/d21/d2e/d8c/d97/db6/l10b 0 2024-09-19T09:35:33.682 INFO:tasks.workunit.client.0.smithi112.stdout:0/733: getdents d2/d59 0 2024-09-19T09:35:33.683 INFO:tasks.workunit.client.0.smithi112.stdout:2/787: mknod d0/d1/cf9 0 2024-09-19T09:35:33.684 INFO:tasks.workunit.client.0.smithi112.stdout:7/957: creat d2/d2c/d54/dba/f15d x:0 0 0 2024-09-19T09:35:33.684 INFO:tasks.workunit.client.0.smithi112.stdout:7/958: stat d2/d2c/d54/d1a/d132/d146/d4c/d70 0 2024-09-19T09:35:33.685 INFO:tasks.workunit.client.0.smithi112.stdout:7/959: fdatasync d2/d2c/d54/d1a/d132/f1e 0 2024-09-19T09:35:33.686 INFO:tasks.workunit.client.0.smithi112.stdout:0/734: symlink d2/d6e/da0/de6/lf4 0 2024-09-19T09:35:33.688 INFO:tasks.workunit.client.0.smithi112.stdout:7/960: mknod d2/d2c/d54/d1a/d132/d39/d21/d71/c15e 0 2024-09-19T09:35:33.690 INFO:tasks.workunit.client.0.smithi112.stdout:5/990: dwrite d4/d9/d2a/d46/dde/f10b [0,4194304] 0 2024-09-19T09:35:33.690 INFO:tasks.workunit.client.0.smithi112.stdout:0/735: mknod d2/d59/da1/dd4/cf5 0 2024-09-19T09:35:33.692 INFO:tasks.workunit.client.0.smithi112.stdout:2/788: rmdir d0/d3e/d50/d57/d5a/d27 39 2024-09-19T09:35:33.694 INFO:tasks.workunit.client.0.smithi112.stdout:0/736: dread d2/f31 [0,4194304] 0 2024-09-19T09:35:33.696 INFO:tasks.workunit.client.0.smithi112.stdout:5/991: mkdir d4/d9/d2a/d46/dde/de2/d151 0 2024-09-19T09:35:33.697 INFO:tasks.workunit.client.0.smithi112.stdout:7/961: dread d2/d2c/d54/d1a/d132/db4/d110/f8b [0,4194304] 0 2024-09-19T09:35:33.697 INFO:tasks.workunit.client.0.smithi112.stdout:2/789: creat d0/d1/d5f/ffa x:0 0 0 2024-09-19T09:35:33.698 INFO:tasks.workunit.client.0.smithi112.stdout:0/737: truncate d2/d59/d7a/f8b 3937225 0 2024-09-19T09:35:33.699 INFO:tasks.workunit.client.0.smithi112.stdout:5/992: mknod d4/d9/d2a/d39/d88/dba/c152 0 2024-09-19T09:35:33.699 INFO:tasks.workunit.client.0.smithi112.stdout:5/993: readlink d4/d9/d17/d30/dec/lf3 0 2024-09-19T09:35:33.700 INFO:tasks.workunit.client.0.smithi112.stdout:7/962: truncate d2/d99/dd8/fe5 3493271 0 2024-09-19T09:35:33.700 INFO:tasks.workunit.client.0.smithi112.stdout:7/963: dread - d2/d2c/d54/d1a/d132/da1/f150 zero size 2024-09-19T09:35:33.701 INFO:tasks.workunit.client.0.smithi112.stdout:0/738: symlink d2/d39/lf6 0 2024-09-19T09:35:33.702 INFO:tasks.workunit.client.0.smithi112.stdout:5/994: creat d4/d9/d2a/d46/dde/de2/d151/f153 x:0 0 0 2024-09-19T09:35:33.702 INFO:tasks.workunit.client.0.smithi112.stdout:5/995: write d4/d9/f25 [558513,86418] 0 2024-09-19T09:35:33.704 INFO:tasks.workunit.client.0.smithi112.stdout:7/964: creat d2/d2c/d54/d1a/d132/d146/f15f x:0 0 0 2024-09-19T09:35:33.704 INFO:tasks.workunit.client.0.smithi112.stdout:7/965: stat d2/d2c/d54/d1a/d132/d146/d76 0 2024-09-19T09:35:33.705 INFO:tasks.workunit.client.0.smithi112.stdout:2/790: mknod d0/d3e/d50/d57/d80/cfb 0 2024-09-19T09:35:33.706 INFO:tasks.workunit.client.0.smithi112.stdout:1/734: dwrite dc/d26/d34/d36/d68/d7d/d6a/dac/fd9 [0,4194304] 0 2024-09-19T09:35:33.707 INFO:tasks.workunit.client.0.smithi112.stdout:5/996: symlink d4/d9/df6/da9/de4/d148/l154 0 2024-09-19T09:35:33.709 INFO:tasks.workunit.client.0.smithi112.stdout:7/966: creat d2/d2c/d54/d1a/d132/db4/d110/d7c/db1/dc8/f160 x:0 0 0 2024-09-19T09:35:33.710 INFO:tasks.workunit.client.0.smithi112.stdout:2/791: rename d0/d1/d5f/dd7 to d0/d1/d5f/d78/db0/dfc 0 2024-09-19T09:35:33.712 INFO:tasks.workunit.client.0.smithi112.stdout:6/901: dwrite d8/de/d18/d20/f69 [0,4194304] 0 2024-09-19T09:35:33.713 INFO:tasks.workunit.client.0.smithi112.stdout:8/843: dwrite d7/db/d21/f47 [8388608,4194304] 0 2024-09-19T09:35:33.713 INFO:tasks.workunit.client.0.smithi112.stdout:1/735: creat dc/d26/fe3 x:0 0 0 2024-09-19T09:35:33.713 INFO:tasks.workunit.client.0.smithi112.stdout:1/736: chown dc/c1a 48 1 2024-09-19T09:35:33.717 INFO:tasks.workunit.client.0.smithi112.stdout:7/967: mknod d2/d2c/d54/d1a/d132/d146/d4c/d70/d7b/c161 0 2024-09-19T09:35:33.719 INFO:tasks.workunit.client.0.smithi112.stdout:2/792: truncate d0/d3e/d49/fb2 587622 0 2024-09-19T09:35:33.721 INFO:tasks.workunit.client.0.smithi112.stdout:0/739: getdents d2/d59/da1/dd4/d95/db5 0 2024-09-19T09:35:33.728 INFO:tasks.workunit.client.0.smithi112.stdout:6/902: symlink d8/de/d17/d94/l144 0 2024-09-19T09:35:33.730 INFO:tasks.workunit.client.0.smithi112.stdout:7/968: getdents d2/d2c/d54/d1a/d132/d39/d23/dfb 0 2024-09-19T09:35:33.730 INFO:tasks.workunit.client.0.smithi112.stdout:7/969: write d2/d2c/d54/d1a/d132/d146/f9c [615895,15911] 0 2024-09-19T09:35:33.730 INFO:tasks.workunit.client.0.smithi112.stdout:7/970: read d2/d2c/d54/d1a/f3d [938400,101053] 0 2024-09-19T09:35:33.731 INFO:tasks.workunit.client.0.smithi112.stdout:7/971: readlink d2/d2c/d54/d1a/d132/d39/d23/l73 0 2024-09-19T09:35:33.731 INFO:tasks.workunit.client.0.smithi112.stdout:1/737: dwrite dc/d26/d34/d36/d68/fcc [0,4194304] 0 2024-09-19T09:35:33.733 INFO:tasks.workunit.client.0.smithi112.stdout:2/793: symlink d0/d3e/d50/d57/lfd 0 2024-09-19T09:35:33.735 INFO:tasks.workunit.client.0.smithi112.stdout:0/740: rename d2/d59/da1/dd4/f80 to d2/d59/da1/dd4/db8/deb/ff7 0 2024-09-19T09:35:33.735 INFO:tasks.workunit.client.0.smithi112.stdout:0/741: truncate d2/d59/da1/dd4/d95/db5/f2a 4937846 0 2024-09-19T09:35:33.735 INFO:tasks.workunit.client.0.smithi112.stdout:0/742: stat d2/d6e/d6f/lb1 0 2024-09-19T09:35:33.747 INFO:tasks.workunit.client.0.smithi112.stdout:0/743: dread d2/d6e/d75/f8e [0,4194304] 0 2024-09-19T09:35:33.750 INFO:tasks.workunit.client.0.smithi112.stdout:1/738: dwrite dc/d59/d73/d88/da5/fd8 [0,4194304] 0 2024-09-19T09:35:33.757 INFO:tasks.workunit.client.0.smithi112.stdout:8/844: rmdir d7/d10/d11/d50 39 2024-09-19T09:35:33.757 INFO:tasks.workunit.client.0.smithi112.stdout:8/845: write d7/d10/d11/d33/fc4 [122572,116316] 0 2024-09-19T09:35:33.758 INFO:tasks.workunit.client.0.smithi112.stdout:5/997: rmdir d4/d9/d6b/dfa 0 2024-09-19T09:35:33.760 INFO:tasks.workunit.client.0.smithi112.stdout:7/972: creat d2/d2c/d54/d1a/d132/d39/d21/d45/dda/f162 x:0 0 0 2024-09-19T09:35:33.760 INFO:tasks.workunit.client.0.smithi112.stdout:7/973: dread - d2/d2c/d54/d1a/d132/d39/d21/d45/dda/f162 zero size 2024-09-19T09:35:33.762 INFO:tasks.workunit.client.0.smithi112.stdout:2/794: mknod d0/d4a/cfe 0 2024-09-19T09:35:33.762 INFO:tasks.workunit.client.0.smithi112.stdout:2/795: creat d0/d1/d5f/fff x:0 0 0 2024-09-19T09:35:33.765 INFO:tasks.workunit.client.0.smithi112.stdout:1/739: dwrite dc/fd [0,4194304] 0 2024-09-19T09:35:33.765 INFO:tasks.workunit.client.0.smithi112.stdout:6/903: rename d8/de/d61/d70/d7b/d8a/c10d to d8/d11/d14/d2a/c145 0 2024-09-19T09:35:33.767 INFO:tasks.workunit.client.0.smithi112.stdout:0/744: unlink d2/d68/cca 0 2024-09-19T09:35:33.770 INFO:tasks.workunit.client.0.smithi112.stdout:8/846: mkdir d7/db/d21/d3b/d56/d10c 0 2024-09-19T09:35:33.771 INFO:tasks.workunit.client.0.smithi112.stdout:7/974: mkdir d2/d2c/d54/d1a/d132/d146/d4c/d70/dcf/d126/d163 0 2024-09-19T09:35:33.771 INFO:tasks.workunit.client.0.smithi112.stdout:7/975: truncate d2/d2c/d54/d1a/d132/d146/d4c/d70/dcf/d126/f151 1017541 0 2024-09-19T09:35:33.775 INFO:tasks.workunit.client.0.smithi112.stdout:0/745: mkdir d2/d39/d3b/dab/df8 0 2024-09-19T09:35:33.776 INFO:tasks.workunit.client.0.smithi112.stdout:8/847: link d7/d10/d11/l3e d7/d10/d11/d33/l10d 0 2024-09-19T09:35:33.777 INFO:tasks.workunit.client.0.smithi112.stdout:6/904: getdents d8/de/d17/dae/deb 0 2024-09-19T09:35:33.782 INFO:tasks.workunit.client.0.smithi112.stdout:6/905: creat d8/de/d66/d8f/f146 x:0 0 0 2024-09-19T09:35:33.785 INFO:tasks.workunit.client.0.smithi112.stdout:6/906: rename d8/de/d18/d20/l42 to d8/d73/dc1/l147 0 2024-09-19T09:35:33.785 INFO:tasks.workunit.client.0.smithi112.stdout:6/907: readlink d8/d73/dc1/l147 0 2024-09-19T09:35:33.788 INFO:tasks.workunit.client.0.smithi112.stdout:0/746: read d2/d39/fb7 [2422652,105402] 0 2024-09-19T09:35:33.790 INFO:tasks.workunit.client.0.smithi112.stdout:7/976: dread d2/d2c/d54/d1a/d132/d39/d21/d45/f5c [0,4194304] 0 2024-09-19T09:35:33.792 INFO:tasks.workunit.client.0.smithi112.stdout:7/977: mknod d2/d2c/d54/d1a/d132/d39/d23/dfb/c164 0 2024-09-19T09:35:33.794 INFO:tasks.workunit.client.0.smithi112.stdout:2/796: dwrite d0/d3e/d49/fb2 [0,4194304] 0 2024-09-19T09:35:33.795 INFO:tasks.workunit.client.0.smithi112.stdout:1/740: dwrite dc/d24/d45/d94/dbc/fd3 [4194304,4194304] 0 2024-09-19T09:35:33.795 INFO:tasks.workunit.client.0.smithi112.stdout:8/848: write d7/d10/d11/f2b [3516398,116441] 0 2024-09-19T09:35:33.801 INFO:tasks.workunit.client.0.smithi112.stdout:7/978: dread d2/d2c/d54/d1a/d132/d39/d21/fc1 [0,4194304] 0 2024-09-19T09:35:33.804 INFO:tasks.workunit.client.0.smithi112.stdout:8/849: rename d7/fa to d7/f10e 0 2024-09-19T09:35:33.805 INFO:tasks.workunit.client.0.smithi112.stdout:1/741: dread dc/d24/d45/d94/f9c [4194304,4194304] 0 2024-09-19T09:35:33.806 INFO:tasks.workunit.client.0.smithi112.stdout:7/979: mkdir d2/d2c/d54/d1a/d132/db4/de7/d165 0 2024-09-19T09:35:33.809 INFO:tasks.workunit.client.0.smithi112.stdout:8/850: mknod d7/db/d21/d2e/d42/d57/dea/c10f 0 2024-09-19T09:35:33.809 INFO:tasks.workunit.client.0.smithi112.stdout:8/851: stat d7/db/f45 0 2024-09-19T09:35:33.810 INFO:tasks.workunit.client.0.smithi112.stdout:1/742: creat dc/d26/d34/d36/d68/d9f/fe4 x:0 0 0 2024-09-19T09:35:33.814 INFO:tasks.workunit.client.0.smithi112.stdout:7/980: rename d2/d2c/d54/d1a/d132/db4/d110/d7c/c10d to d2/d2c/d54/d1a/d132/db4/c166 0 2024-09-19T09:35:33.815 INFO:tasks.workunit.client.0.smithi112.stdout:8/852: dread d7/d10/d11/d33/f27 [0,4194304] 0 2024-09-19T09:35:33.816 INFO:tasks.workunit.client.0.smithi112.stdout:1/743: rename dc/d13/f25 to dc/d26/d34/d36/d68/d7d/fe5 0 2024-09-19T09:35:33.817 INFO:tasks.workunit.client.0.smithi112.stdout:7/981: mkdir d2/d2c/d54/d1a/d132/d39/d167 0 2024-09-19T09:35:33.818 INFO:tasks.workunit.client.0.smithi112.stdout:8/853: symlink d7/db/d21/d3b/d56/d48/l110 0 2024-09-19T09:35:33.821 INFO:tasks.workunit.client.0.smithi112.stdout:1/744: rename dc/d59/d73/d88/da5/fd4 to dc/d26/d34/d36/d68/d7d/fe6 0 2024-09-19T09:35:33.821 INFO:tasks.workunit.client.0.smithi112.stdout:7/982: mknod d2/d2c/d54/d1a/d132/d39/d167/c168 0 2024-09-19T09:35:33.822 INFO:tasks.workunit.client.0.smithi112.stdout:6/908: dwrite d8/d11/f34 [4194304,4194304] 0 2024-09-19T09:35:33.824 INFO:tasks.workunit.client.0.smithi112.stdout:6/909: write d8/de/d61/dbf/dc8/ff6 [733444,17089] 0 2024-09-19T09:35:33.824 INFO:tasks.workunit.client.0.smithi112.stdout:7/983: creat d2/d2c/d54/d1a/d132/d146/d4c/d70/d7b/f169 x:0 0 0 2024-09-19T09:35:33.824 INFO:tasks.workunit.client.0.smithi112.stdout:6/910: readlink d8/de/d61/l78 0 2024-09-19T09:35:33.824 INFO:tasks.workunit.client.0.smithi112.stdout:7/984: dread - d2/d2c/d54/d1a/d132/d39/d21/d71/f120 zero size 2024-09-19T09:35:33.825 INFO:tasks.workunit.client.0.smithi112.stdout:6/911: rmdir d8/de/d61/dbf 39 2024-09-19T09:35:33.827 INFO:tasks.workunit.client.0.smithi112.stdout:6/912: creat d8/de/d17/d94/d108/f148 x:0 0 0 2024-09-19T09:35:33.828 INFO:tasks.workunit.client.0.smithi112.stdout:6/913: fsync d8/d11/d14/d3c/dc0/f11b 0 2024-09-19T09:35:33.828 INFO:tasks.workunit.client.0.smithi112.stdout:7/985: dread d2/d2c/d54/d1a/d132/d146/fad [0,4194304] 0 2024-09-19T09:35:33.829 INFO:tasks.workunit.client.0.smithi112.stdout:7/986: creat d2/d2c/d54/d1a/d132/db4/de7/dfa/d149/f16a x:0 0 0 2024-09-19T09:35:33.830 INFO:tasks.workunit.client.0.smithi112.stdout:0/747: dwrite d2/f1b [4194304,4194304] 0 2024-09-19T09:35:33.832 INFO:tasks.workunit.client.0.smithi112.stdout:7/987: rename d2/d2c/d54/d1a/d132/da1/c10e to d2/d2c/d54/d1a/d132/d39/c16b 0 2024-09-19T09:35:33.832 INFO:tasks.workunit.client.0.smithi112.stdout:2/797: dwrite d0/d6/fa2 [0,4194304] 0 2024-09-19T09:35:33.832 INFO:tasks.workunit.client.0.smithi112.stdout:2/798: creat d0/d1/d5f/f100 x:0 0 0 2024-09-19T09:35:33.833 INFO:tasks.workunit.client.0.smithi112.stdout:6/914: dread d8/de/d66/d8f/f97 [0,4194304] 0 2024-09-19T09:35:33.833 INFO:tasks.workunit.client.0.smithi112.stdout:6/915: chown d8/de/d61/f142 7053 1 2024-09-19T09:35:33.833 INFO:tasks.workunit.client.0.smithi112.stdout:0/748: symlink d2/d39/lf9 0 2024-09-19T09:35:33.834 INFO:tasks.workunit.client.0.smithi112.stdout:8/854: dread d7/db/d21/f47 [0,4194304] 0 2024-09-19T09:35:33.838 INFO:tasks.workunit.client.0.smithi112.stdout:2/799: rename d0/d1/d28/d88/dcd to d0/d1/d5f/dc6/d101 0 2024-09-19T09:35:33.838 INFO:tasks.workunit.client.0.smithi112.stdout:2/800: write d0/d3e/d61/f63 [4615404,67683] 0 2024-09-19T09:35:33.838 INFO:tasks.workunit.client.0.smithi112.stdout:0/749: creat d2/d68/ffa x:0 0 0 2024-09-19T09:35:33.842 INFO:tasks.workunit.client.0.smithi112.stdout:2/801: creat d0/d1/f102 x:0 0 0 2024-09-19T09:35:33.844 INFO:tasks.workunit.client.0.smithi112.stdout:6/916: link d8/d11/d14/d3c/dc0/ff2 d8/de/d61/dbf/d103/f149 0 2024-09-19T09:35:33.844 INFO:tasks.workunit.client.0.smithi112.stdout:6/917: creat d8/de/d61/d135/f14a x:0 0 0 2024-09-19T09:35:33.845 INFO:tasks.workunit.client.0.smithi112.stdout:2/802: unlink d0/d1/d5f/d78/db0/d9a/dae/cba 0 2024-09-19T09:35:33.846 INFO:tasks.workunit.client.0.smithi112.stdout:1/745: dwrite dc/d24/da2/fb0 [0,4194304] 0 2024-09-19T09:35:33.847 INFO:tasks.workunit.client.0.smithi112.stdout:2/803: mkdir d0/d1/d28/d9b/d103 0 2024-09-19T09:35:33.849 INFO:tasks.workunit.client.0.smithi112.stdout:7/988: dread d2/d2c/d54/d1a/d132/db4/d110/f94 [0,4194304] 0 2024-09-19T09:35:33.851 INFO:tasks.workunit.client.0.smithi112.stdout:1/746: mkdir dc/d59/de7 0 2024-09-19T09:35:33.852 INFO:tasks.workunit.client.0.smithi112.stdout:1/747: chown dc/d26/d44/c7c 1376488 1 2024-09-19T09:35:33.855 INFO:tasks.workunit.client.0.smithi112.stdout:0/750: dread d2/d6e/da0/f7b [0,4194304] 0 2024-09-19T09:35:33.855 INFO:tasks.workunit.client.0.smithi112.stdout:2/804: symlink d0/d4a/l104 0 2024-09-19T09:35:33.855 INFO:tasks.workunit.client.0.smithi112.stdout:2/805: write d0/d1/d5f/ffa [997620,23163] 0 2024-09-19T09:35:33.857 INFO:tasks.workunit.client.0.smithi112.stdout:7/989: link d2/d2c/d54/d1a/d132/d39/d23/c11b d2/d2c/d54/c16c 0 2024-09-19T09:35:33.858 INFO:tasks.workunit.client.0.smithi112.stdout:0/751: mknod d2/d6e/da0/cfb 0 2024-09-19T09:35:33.859 INFO:tasks.workunit.client.0.smithi112.stdout:2/806: rmdir d0/d1/d28/d88 39 2024-09-19T09:35:33.861 INFO:tasks.workunit.client.0.smithi112.stdout:7/990: rmdir d2/d2c/d54/d1a/d132/d39/d23/dfb/d107 0 2024-09-19T09:35:33.862 INFO:tasks.workunit.client.0.smithi112.stdout:0/752: dread d2/d59/da1/dd4/d95/db5/f37 [0,4194304] 0 2024-09-19T09:35:33.862 INFO:tasks.workunit.client.0.smithi112.stdout:0/753: truncate d2/f49 4765021 0 2024-09-19T09:35:33.863 INFO:tasks.workunit.client.0.smithi112.stdout:2/807: creat d0/d1/d5f/dc6/dc8/f105 x:0 0 0 2024-09-19T09:35:33.863 INFO:tasks.workunit.client.0.smithi112.stdout:2/808: truncate d0/d3e/d49/fbf 1256230 0 2024-09-19T09:35:33.864 INFO:tasks.workunit.client.0.smithi112.stdout:8/855: dwrite d7/d10/d11/f2b [0,4194304] 0 2024-09-19T09:35:33.864 INFO:tasks.workunit.client.0.smithi112.stdout:8/856: fsync d7/d10/fe8 0 2024-09-19T09:35:33.864 INFO:tasks.workunit.client.0.smithi112.stdout:8/857: write d7/d10/d11/d33/f27 [1692638,10552] 0 2024-09-19T09:35:33.866 INFO:tasks.workunit.client.0.smithi112.stdout:0/754: mkdir d2/d59/da1/dd4/db8/dc1/dfc 0 2024-09-19T09:35:33.868 INFO:tasks.workunit.client.0.smithi112.stdout:6/918: dwrite d8/d11/d14/d2a/f32 [0,4194304] 0 2024-09-19T09:35:33.869 INFO:tasks.workunit.client.0.smithi112.stdout:6/919: truncate d8/de/d61/f102 236206 0 2024-09-19T09:35:33.872 INFO:tasks.workunit.client.0.smithi112.stdout:6/920: creat d8/de/d61/dbf/d130/f14b x:0 0 0 2024-09-19T09:35:33.879 INFO:tasks.workunit.client.0.smithi112.stdout:0/755: dread d2/d68/f74 [0,4194304] 0 2024-09-19T09:35:33.880 INFO:tasks.workunit.client.0.smithi112.stdout:0/756: chown d2/d6e/d75 8235288 1 2024-09-19T09:35:33.881 INFO:tasks.workunit.client.0.smithi112.stdout:0/757: creat d2/d6e/da0/de6/ffd x:0 0 0 2024-09-19T09:35:33.881 INFO:tasks.workunit.client.0.smithi112.stdout:0/758: readlink d2/l3a 0 2024-09-19T09:35:33.881 INFO:tasks.workunit.client.0.smithi112.stdout:0/759: chown d2/d39/d3b/dab/cde 2047513 1 2024-09-19T09:35:33.892 INFO:tasks.workunit.client.0.smithi112.stdout:1/748: dwrite dc/d26/d34/d36/d68/fcb [0,4194304] 0 2024-09-19T09:35:33.892 INFO:tasks.workunit.client.0.smithi112.stdout:1/749: dread - dc/d26/fe3 zero size 2024-09-19T09:35:33.893 INFO:tasks.workunit.client.0.smithi112.stdout:1/750: read dc/d26/d34/d36/d68/f92 [102019,36575] 0 2024-09-19T09:35:33.897 INFO:tasks.workunit.client.0.smithi112.stdout:2/809: dwrite d0/d4a/f99 [0,4194304] 0 2024-09-19T09:35:33.897 INFO:tasks.workunit.client.0.smithi112.stdout:0/760: dread d2/d59/da1/dd4/db8/dc1/fe1 [0,4194304] 0 2024-09-19T09:35:33.897 INFO:tasks.workunit.client.0.smithi112.stdout:0/761: fsync d2/d59/da1/dd4/f69 0 2024-09-19T09:35:33.897 INFO:tasks.workunit.client.0.smithi112.stdout:7/991: dwrite d2/d148/f154 [0,4194304] 0 2024-09-19T09:35:33.898 INFO:tasks.workunit.client.0.smithi112.stdout:6/921: dwrite d8/d11/d14/d3c/d4b/d63/fe1 [0,4194304] 0 2024-09-19T09:35:33.898 INFO:tasks.workunit.client.0.smithi112.stdout:2/810: mkdir d0/d1/d28/d88/d8f/d106 0 2024-09-19T09:35:33.899 INFO:tasks.workunit.client.0.smithi112.stdout:0/762: unlink d2/d39/d3b/dab/ca3 0 2024-09-19T09:35:33.901 INFO:tasks.workunit.client.0.smithi112.stdout:1/751: dread dc/d24/f52 [0,4194304] 0 2024-09-19T09:35:33.903 INFO:tasks.workunit.client.0.smithi112.stdout:7/992: rename d2/d2c/d54/d1a/d132/db4/de7/d127/f15b to d2/d2c/d54/d1a/d132/db4/de7/dfa/f16d 0 2024-09-19T09:35:33.905 INFO:tasks.workunit.client.0.smithi112.stdout:6/922: truncate d8/de/d61/dbf/dc8/fd2 1117949 0 2024-09-19T09:35:33.906 INFO:tasks.workunit.client.0.smithi112.stdout:2/811: write d0/d6/fa [776490,122065] 0 2024-09-19T09:35:33.907 INFO:tasks.workunit.client.0.smithi112.stdout:0/763: rename d2/d59/ld9 to d2/d59/lfe 0 2024-09-19T09:35:33.907 INFO:tasks.workunit.client.0.smithi112.stdout:0/764: write d2/d68/fce [2179,81999] 0 2024-09-19T09:35:33.907 INFO:tasks.workunit.client.0.smithi112.stdout:0/765: chown d2/d59/da1/dd4/db8/dc1/cda 0 1 2024-09-19T09:35:33.909 INFO:tasks.workunit.client.0.smithi112.stdout:1/752: unlink dc/d24/da2/ccd 0 2024-09-19T09:35:33.910 INFO:tasks.workunit.client.0.smithi112.stdout:7/993: creat d2/d2c/d54/d1a/d132/d85/f16e x:0 0 0 2024-09-19T09:35:33.911 INFO:tasks.workunit.client.0.smithi112.stdout:1/753: dread dc/d26/f93 [0,4194304] 0 2024-09-19T09:35:33.912 INFO:tasks.workunit.client.0.smithi112.stdout:2/812: mkdir d0/d1/d5f/d78/db0/d9a/d107 0 2024-09-19T09:35:33.912 INFO:tasks.workunit.client.0.smithi112.stdout:2/813: fdatasync d0/d1/f6f 0 2024-09-19T09:35:33.915 INFO:tasks.workunit.client.0.smithi112.stdout:7/994: link d2/d2c/d54/d1a/d132/d146/d4c/d70/d7b/fa8 d2/d2c/d54/d1a/f16f 0 2024-09-19T09:35:33.916 INFO:tasks.workunit.client.0.smithi112.stdout:7/995: unlink d2/d2c/d54/d1a/d132/d39/d23/f57 0 2024-09-19T09:35:33.918 INFO:tasks.workunit.client.0.smithi112.stdout:7/996: symlink d2/d2c/d54/d1a/d132/d85/l170 0 2024-09-19T09:35:33.919 INFO:tasks.workunit.client.0.smithi112.stdout:1/754: dread dc/d26/d34/d36/d68/d7d/fe5 [0,4194304] 0 2024-09-19T09:35:33.919 INFO:tasks.workunit.client.0.smithi112.stdout:1/755: fsync dc/d59/d73/fd6 0 2024-09-19T09:35:33.919 INFO:tasks.workunit.client.0.smithi112.stdout:1/756: write dc/f69 [1882850,106016] 0 2024-09-19T09:35:33.919 INFO:tasks.workunit.client.0.smithi112.stdout:1/757: write dc/d59/d73/d88/da5/fd8 [4371286,3582] 0 2024-09-19T09:35:33.920 INFO:tasks.workunit.client.0.smithi112.stdout:1/758: read dc/d24/f46 [53047,98156] 0 2024-09-19T09:35:33.920 INFO:tasks.workunit.client.0.smithi112.stdout:7/997: creat d2/d2c/d54/d1a/d132/d39/d23/dfb/f171 x:0 0 0 2024-09-19T09:35:33.922 INFO:tasks.workunit.client.0.smithi112.stdout:2/814: dread d0/d6/fb5 [0,4194304] 0 2024-09-19T09:35:33.926 INFO:tasks.workunit.client.0.smithi112.stdout:6/923: dwrite d8/de/d61/d70/fb6 [0,4194304] 0 2024-09-19T09:35:33.932 INFO:tasks.workunit.client.0.smithi112.stdout:7/998: write d2/d2c/d54/d1a/f72 [1605321,126842] 0 2024-09-19T09:35:33.932 INFO:tasks.workunit.client.0.smithi112.stdout:7/999: read - d2/d2c/d54/dba/dee/ffe zero size 2024-09-19T09:35:33.935 INFO:tasks.workunit.client.0.smithi112.stdout:6/924: rmdir d8/de/d66/d8f 39 2024-09-19T09:35:33.938 INFO:tasks.workunit.client.0.smithi112.stdout:6/925: symlink d8/d11/d13/l14c 0 2024-09-19T09:35:33.941 INFO:tasks.workunit.client.0.smithi112.stdout:6/926: mkdir d8/de/d18/d14d 0 2024-09-19T09:35:33.941 INFO:tasks.workunit.client.0.smithi112.stdout:6/927: dread - d8/de/d17/d94/d108/f110 zero size 2024-09-19T09:35:33.945 INFO:tasks.workunit.client.0.smithi112.stdout:1/759: dwrite dc/d24/f40 [0,4194304] 0 2024-09-19T09:35:33.945 INFO:tasks.workunit.client.0.smithi112.stdout:2/815: dwrite d0/d3e/d50/d57/d5a/d4f/f52 [4194304,4194304] 0 2024-09-19T09:35:33.948 INFO:tasks.workunit.client.0.smithi112.stdout:1/760: unlink dc/d26/d34/d36/d68/d9f/la0 0 2024-09-19T09:35:33.958 INFO:tasks.workunit.client.0.smithi112.stdout:6/928: dwrite d8/de/d61/d70/db5/f104 [0,4194304] 0 2024-09-19T09:35:33.958 INFO:tasks.workunit.client.0.smithi112.stdout:6/929: chown d8/d11/d14/d3c/d109/l11d 827197963 1 2024-09-19T09:35:33.960 INFO:tasks.workunit.client.0.smithi112.stdout:6/930: creat d8/d11/d14/d3c/dc0/f14e x:0 0 0 2024-09-19T09:35:33.961 INFO:tasks.workunit.client.0.smithi112.stdout:6/931: symlink d8/de/d61/dfa/l14f 0 2024-09-19T09:35:33.961 INFO:tasks.workunit.client.0.smithi112.stdout:6/932: fdatasync d8/de/d66/f9e 0 2024-09-19T09:35:33.969 INFO:tasks.workunit.client.0.smithi112.stdout:6/933: dread d8/de/d61/dbf/dc8/f123 [4194304,4194304] 0 2024-09-19T09:35:33.969 INFO:tasks.workunit.client.0.smithi112.stdout:6/934: chown d8/de/c9b 1760711 1 2024-09-19T09:35:33.970 INFO:tasks.workunit.client.0.smithi112.stdout:6/935: creat d8/de/d66/d8f/dce/f150 x:0 0 0 2024-09-19T09:35:33.985 INFO:tasks.workunit.client.0.smithi112.stdout:6/936: dwrite d8/de/d18/f28 [4194304,4194304] 0 2024-09-19T09:35:33.987 INFO:tasks.workunit.client.0.smithi112.stdout:6/937: mknod d8/de/d17/dae/c151 0 2024-09-19T09:35:33.988 INFO:tasks.workunit.client.0.smithi112.stdout:6/938: creat d8/de/d61/d70/d7b/f152 x:0 0 0 2024-09-19T09:35:34.005 INFO:tasks.workunit.client.0.smithi112.stdout:6/939: dwrite d8/de/d17/d49/f6a [0,4194304] 0 2024-09-19T09:35:34.009 INFO:tasks.workunit.client.0.smithi112.stdout:6/940: rename d8/d11/d14/d3c/dd5/l10c to d8/d11/d14/d3c/l153 0 2024-09-19T09:35:34.016 INFO:tasks.workunit.client.0.smithi112.stdout:6/941: write d8/d11/d14/f3e [2354614,75259] 0 2024-09-19T09:35:34.020 INFO:tasks.workunit.client.0.smithi112.stdout:6/942: unlink d8/de/d61/dbf/l139 0 2024-09-19T09:35:34.027 INFO:tasks.workunit.client.0.smithi112.stdout:6/943: write d8/de/d66/d6e/fbd [338416,74016] 0 2024-09-19T09:35:34.028 INFO:tasks.workunit.client.0.smithi112.stdout:6/944: symlink d8/de/d17/dae/l154 0 2024-09-19T09:35:34.036 INFO:tasks.workunit.client.0.smithi112.stdout:6/945: rename d8/d11/d14/d3c/dc0 to d8/d11/d14/d3c/d4b/d63/d155 0 2024-09-19T09:35:34.036 INFO:tasks.workunit.client.0.smithi112.stdout:6/946: read d8/f9 [1637941,88001] 0 2024-09-19T09:35:34.036 INFO:tasks.workunit.client.0.smithi112.stdout:6/947: readlink d8/dc5/le0 0 2024-09-19T09:35:34.038 INFO:tasks.workunit.client.0.smithi112.stdout:6/948: creat d8/d11/d14/d3c/d4b/f156 x:0 0 0 2024-09-19T09:35:34.038 INFO:tasks.workunit.client.0.smithi112.stdout:6/949: dread - d8/de/d61/d135/d13a/f13b zero size 2024-09-19T09:35:34.038 INFO:tasks.workunit.client.0.smithi112.stdout:6/950: readlink d8/d11/d14/d3c/laf 0 2024-09-19T09:35:34.040 INFO:tasks.workunit.client.0.smithi112.stdout:6/951: creat d8/de/d66/d8f/f157 x:0 0 0 2024-09-19T09:35:34.040 INFO:tasks.workunit.client.0.smithi112.stdout:6/952: chown d8/d11/d14/d3c/l153 4869455 1 2024-09-19T09:35:34.040 INFO:tasks.workunit.client.0.smithi112.stdout:6/953: write d8/de/d17/f46 [5130521,115560] 0 2024-09-19T09:35:34.040 INFO:tasks.workunit.client.0.smithi112.stdout:6/954: chown d8/de/d17/l9c 174253 1 2024-09-19T09:35:34.041 INFO:tasks.workunit.client.0.smithi112.stdout:6/955: rmdir d8/de/d61/d135/d13a 39 2024-09-19T09:35:34.044 INFO:tasks.workunit.client.0.smithi112.stdout:6/956: unlink d8/de/d17/d49/l10e 0 2024-09-19T09:35:34.045 INFO:tasks.workunit.client.0.smithi112.stdout:6/957: write d8/de/d61/d70/fb6 [4414545,114771] 0 2024-09-19T09:35:34.053 INFO:tasks.workunit.client.0.smithi112.stdout:6/958: write d8/d11/d14/d3c/d4b/fdb [2458029,55150] 0 2024-09-19T09:35:34.071 INFO:tasks.workunit.client.0.smithi112.stdout:6/959: dwrite d8/de/d18/f29 [4194304,4194304] 0 2024-09-19T09:35:34.071 INFO:tasks.workunit.client.0.smithi112.stdout:6/960: chown d8/de/d18/d20 33652 1 2024-09-19T09:35:34.072 INFO:tasks.workunit.client.0.smithi112.stdout:9/630: sync 2024-09-19T09:35:34.074 INFO:tasks.workunit.client.0.smithi112.stdout:6/961: unlink d8/d11/d13/c27 0 2024-09-19T09:35:34.075 INFO:tasks.workunit.client.0.smithi112.stdout:9/631: creat df/d11/d14/fe3 x:0 0 0 2024-09-19T09:35:34.078 INFO:tasks.workunit.client.0.smithi112.stdout:9/632: mkdir df/d11/d14/d19/d40/daf/d6c/de4 0 2024-09-19T09:35:34.079 INFO:tasks.workunit.client.0.smithi112.stdout:9/633: write df/d11/d14/d19/fdc [852442,78573] 0 2024-09-19T09:35:34.079 INFO:tasks.workunit.client.0.smithi112.stdout:9/634: fdatasync df/d11/d14/d19/d66/f4a 0 2024-09-19T09:35:34.095 INFO:tasks.workunit.client.0.smithi112.stdout:6/962: dwrite d8/d11/d13/fd6 [0,4194304] 0 2024-09-19T09:35:34.101 INFO:tasks.workunit.client.0.smithi112.stdout:6/963: link d8/de/d17/fa7 d8/de/d61/d135/f158 0 2024-09-19T09:35:34.101 INFO:tasks.workunit.client.0.smithi112.stdout:6/964: chown d8/de/d61/d70 4 1 2024-09-19T09:35:34.101 INFO:tasks.workunit.client.0.smithi112.stdout:6/965: dread - d8/d11/d14/d3c/d4b/d63/d155/f11b zero size 2024-09-19T09:35:34.101 INFO:tasks.workunit.client.0.smithi112.stdout:6/966: mknod d8/d11/d14/d3c/dd5/c159 0 2024-09-19T09:35:34.101 INFO:tasks.workunit.client.0.smithi112.stdout:6/967: symlink d8/de/l15a 0 2024-09-19T09:35:34.110 INFO:tasks.workunit.client.0.smithi112.stdout:6/968: read d8/de/d66/d6e/f92 [1681365,84263] 0 2024-09-19T09:35:34.111 INFO:tasks.workunit.client.0.smithi112.stdout:6/969: mknod d8/de/d66/d8f/c15b 0 2024-09-19T09:35:34.113 INFO:tasks.workunit.client.0.smithi112.stdout:6/970: mknod d8/de/d61/dfa/c15c 0 2024-09-19T09:35:34.130 INFO:tasks.workunit.client.0.smithi112.stdout:6/971: dwrite d8/de/d61/dbf/d130/f14b [0,4194304] 0 2024-09-19T09:35:34.130 INFO:tasks.workunit.client.0.smithi112.stdout:6/972: creat d8/de/d17/d49/f15d x:0 0 0 2024-09-19T09:35:34.130 INFO:tasks.workunit.client.0.smithi112.stdout:6/973: write d8/de/d61/dbf/d130/f10a [605852,55092] 0 2024-09-19T09:35:34.133 INFO:tasks.workunit.client.0.smithi112.stdout:6/974: creat d8/f15e x:0 0 0 2024-09-19T09:35:34.134 INFO:tasks.workunit.client.0.smithi112.stdout:6/975: readlink d8/d11/l3b 0 2024-09-19T09:35:34.152 INFO:tasks.workunit.client.0.smithi112.stdout:6/976: dwrite d8/de/d17/d49/f6a [0,4194304] 0 2024-09-19T09:35:34.152 INFO:tasks.workunit.client.0.smithi112.stdout:6/977: fsync d8/f10 0 2024-09-19T09:35:34.153 INFO:tasks.workunit.client.0.smithi112.stdout:6/978: symlink d8/de/d17/d94/l15f 0 2024-09-19T09:35:34.153 INFO:tasks.workunit.client.0.smithi112.stdout:6/979: fdatasync d8/de/d61/dbf/d130/f14b 0 2024-09-19T09:35:34.153 INFO:tasks.workunit.client.0.smithi112.stdout:6/980: write d8/de/f52 [1292437,69447] 0 2024-09-19T09:35:34.154 INFO:tasks.workunit.client.0.smithi112.stdout:6/981: mknod d8/de/d61/dfa/c160 0 2024-09-19T09:35:34.155 INFO:tasks.workunit.client.0.smithi112.stdout:6/982: stat d8/d73/fdd 0 2024-09-19T09:35:34.253 INFO:tasks.workunit.client.0.smithi112.stdout:3/830: sync 2024-09-19T09:35:34.253 INFO:tasks.workunit.client.0.smithi112.stdout:3/831: truncate d8/d15/d1b/d1c/d68/d33/d83/de4/de0/fe3 672625 0 2024-09-19T09:35:34.255 INFO:tasks.workunit.client.0.smithi112.stdout:3/832: rename d8/d15/d1b/d1c/d43/d9b/fce to d8/d15/d1b/d1c/d68/db9/f114 0 2024-09-19T09:35:34.257 INFO:tasks.workunit.client.0.smithi112.stdout:3/833: link d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/c64 d8/d15/d1b/d1c/d43/c115 0 2024-09-19T09:35:34.258 INFO:tasks.workunit.client.0.smithi112.stdout:3/834: creat d8/d15/d1b/d1c/d68/db9/f116 x:0 0 0 2024-09-19T09:35:34.260 INFO:tasks.workunit.client.0.smithi112.stdout:3/835: link d8/d15/d1b/d1c/d68/d33/f35 d8/d105/f117 0 2024-09-19T09:35:34.265 INFO:tasks.workunit.client.0.smithi112.stdout:3/836: mkdir d8/d15/d1b/d1c/db5/d118 0 2024-09-19T09:35:34.272 INFO:tasks.workunit.client.0.smithi112.stdout:3/837: dread d8/d15/d1b/d1c/d68/d33/d66/f97 [0,4194304] 0 2024-09-19T09:35:34.272 INFO:tasks.workunit.client.0.smithi112.stdout:3/838: chown c1 2 1 2024-09-19T09:35:34.273 INFO:tasks.workunit.client.0.smithi112.stdout:3/839: write d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/dd4/fe1 [504172,50822] 0 2024-09-19T09:35:34.276 INFO:tasks.workunit.client.0.smithi112.stdout:3/840: dread d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/dd4/fe1 [0,4194304] 0 2024-09-19T09:35:34.278 INFO:tasks.workunit.client.0.smithi112.stdout:3/841: unlink d8/d15/f5a 0 2024-09-19T09:35:34.287 INFO:tasks.workunit.client.0.smithi112.stdout:3/842: write d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d63/f71 [3857977,43203] 0 2024-09-19T09:35:34.288 INFO:tasks.workunit.client.0.smithi112.stdout:3/843: rename d8/d15/d1b/d1c/d68/d8d/lb1 to d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/l119 0 2024-09-19T09:35:34.290 INFO:tasks.workunit.client.0.smithi112.stdout:3/844: unlink d8/d15/d1b/d1c/d27/d62/d99/fbb 0 2024-09-19T09:35:34.292 INFO:tasks.workunit.client.0.smithi112.stdout:3/845: link d8/d15/d1b/d1c/d27/f86 d8/d15/d1b/d1c/d68/d33/d66/f11a 0 2024-09-19T09:35:34.293 INFO:tasks.workunit.client.0.smithi112.stdout:3/846: creat d8/d15/d1b/d1c/db5/d101/d7e/f11b x:0 0 0 2024-09-19T09:35:34.294 INFO:tasks.workunit.client.0.smithi112.stdout:3/847: mkdir d8/d15/d1b/d1c/d68/d33/d66/d113/d11c 0 2024-09-19T09:35:34.296 INFO:tasks.workunit.client.0.smithi112.stdout:3/848: creat d8/d15/d1b/d1c/db5/d101/dfb/f11d x:0 0 0 2024-09-19T09:35:34.296 INFO:tasks.workunit.client.0.smithi112.stdout:3/849: dread - d8/d48/faf zero size 2024-09-19T09:35:34.297 INFO:tasks.workunit.client.0.smithi112.stdout:3/850: getdents d8/d15/d1b/d1c/d27/d62/d99/da0 0 2024-09-19T09:35:34.298 INFO:tasks.workunit.client.0.smithi112.stdout:3/851: getdents d8/d15/d1b/d1c/d27/d2b/d84 0 2024-09-19T09:35:34.299 INFO:tasks.workunit.client.0.smithi112.stdout:3/852: symlink d8/d15/d1b/d1c/d68/d33/d83/def/l11e 0 2024-09-19T09:35:34.306 INFO:tasks.workunit.client.0.smithi112.stdout:3/853: dread d8/d15/d1b/d1c/d68/d33/d6f/f76 [0,4194304] 0 2024-09-19T09:35:34.306 INFO:tasks.workunit.client.0.smithi112.stdout:3/854: stat d8/d48/c51 0 2024-09-19T09:35:34.307 INFO:tasks.workunit.client.0.smithi112.stdout:3/855: mknod d8/d15/d1b/d1c/db5/d101/dfb/c11f 0 2024-09-19T09:35:34.309 INFO:tasks.workunit.client.0.smithi112.stdout:3/856: creat d8/d15/d1b/d1c/d27/f120 x:0 0 0 2024-09-19T09:35:34.309 INFO:tasks.workunit.client.0.smithi112.stdout:3/857: write d8/d15/d1b/d1c/d68/d33/f85 [855453,10153] 0 2024-09-19T09:35:34.310 INFO:tasks.workunit.client.0.smithi112.stdout:3/858: creat d8/d15/d1b/d1c/d68/d33/d83/f121 x:0 0 0 2024-09-19T09:35:34.311 INFO:tasks.workunit.client.0.smithi112.stdout:3/859: mknod d8/d15/d1b/d1c/d27/d2b/c122 0 2024-09-19T09:35:34.312 INFO:tasks.workunit.client.0.smithi112.stdout:3/860: dread d8/d15/d1b/d1c/db5/fd9 [0,4194304] 0 2024-09-19T09:35:34.313 INFO:tasks.workunit.client.0.smithi112.stdout:3/861: truncate d8/d15/d1b/d1c/d68/d33/d66/f97 1234292 0 2024-09-19T09:35:34.313 INFO:tasks.workunit.client.0.smithi112.stdout:3/862: dread - d8/d15/d1b/d1c/d27/d62/fc1 zero size 2024-09-19T09:35:34.314 INFO:tasks.workunit.client.0.smithi112.stdout:3/863: mkdir d8/d15/d1b/d1c/d68/d33/d66/d123 0 2024-09-19T09:35:34.314 INFO:tasks.workunit.client.0.smithi112.stdout:3/864: chown d8/d15/d1b/d1c/d68/fec 294158 1 2024-09-19T09:35:34.315 INFO:tasks.workunit.client.0.smithi112.stdout:3/865: creat d8/d15/d1b/d1c/d107/f124 x:0 0 0 2024-09-19T09:35:34.315 INFO:tasks.workunit.client.0.smithi112.stdout:3/866: mknod d8/d15/d1b/d1c/d68/d33/d7b/c125 0 2024-09-19T09:35:34.317 INFO:tasks.workunit.client.0.smithi112.stdout:3/867: link d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/c64 d8/d15/d1b/d1c/d68/db9/c126 0 2024-09-19T09:35:34.317 INFO:tasks.workunit.client.0.smithi112.stdout:3/868: stat d8/d15/d1b/d1c/d68/d33/d8e/dc8/ccd 0 2024-09-19T09:35:34.318 INFO:tasks.workunit.client.0.smithi112.stdout:3/869: mkdir d8/d15/d1b/d1c/db5/d101/dfb/d127 0 2024-09-19T09:35:34.342 INFO:tasks.workunit.client.0.smithi112.stdout:3/870: dwrite d8/d15/d1b/d1c/d27/d62/ff7 [0,4194304] 0 2024-09-19T09:35:34.350 INFO:tasks.workunit.client.0.smithi112.stdout:3/871: creat d8/d15/d1b/d1c/d43/d4f/f128 x:0 0 0 2024-09-19T09:35:34.382 INFO:tasks.workunit.client.0.smithi112.stdout:3/872: rename d8/d15/d1b/d1c/d68/fc9 to d8/d15/d1b/d1c/d43/f129 0 2024-09-19T09:35:34.384 INFO:tasks.workunit.client.0.smithi112.stdout:3/873: dread d8/d15/d1b/d1c/d68/d33/d83/de4/fd0 [0,4194304] 0 2024-09-19T09:35:34.384 INFO:tasks.workunit.client.0.smithi112.stdout:3/874: creat d8/d15/d1b/d1c/d27/d62/d99/f12a x:0 0 0 2024-09-19T09:35:34.384 INFO:tasks.workunit.client.0.smithi112.stdout:3/875: chown d8/d15/d1b/d1c/d68/d33/d8e 6862780 1 2024-09-19T09:35:34.384 INFO:tasks.workunit.client.0.smithi112.stdout:3/876: chown d8/d15/d1b/d1c/d27/cea 26173040 1 2024-09-19T09:35:34.384 INFO:tasks.workunit.client.0.smithi112.stdout:3/877: truncate d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/dd4/fe1 884106 0 2024-09-19T09:35:34.385 INFO:tasks.workunit.client.0.smithi112.stdout:3/878: mknod d8/d15/d1b/d1c/d68/d33/d6f/c12b 0 2024-09-19T09:35:34.394 INFO:tasks.workunit.client.0.smithi112.stdout:3/879: dread d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/f65 [4194304,4194304] 0 2024-09-19T09:35:34.395 INFO:tasks.workunit.client.0.smithi112.stdout:3/880: rename d8/d15/d1b/d1c/d68/d33/f35 to d8/d15/d1b/d1c/db5/f12c 0 2024-09-19T09:35:34.411 INFO:tasks.workunit.client.0.smithi112.stdout:3/881: dwrite d8/d15/d1b/d1c/d27/d62/d99/f12a [0,4194304] 0 2024-09-19T09:35:34.411 INFO:tasks.workunit.client.0.smithi112.stdout:3/882: readlink d8/d15/d1b/d1c/d27/d62/dcf/l89 0 2024-09-19T09:35:34.413 INFO:tasks.workunit.client.0.smithi112.stdout:3/883: symlink d8/d15/d1b/d1c/d27/d62/d99/d103/l12d 0 2024-09-19T09:35:34.413 INFO:tasks.workunit.client.0.smithi112.stdout:3/884: chown d8/d15/d1b/d1c/d27/d2b/f5c 19 1 2024-09-19T09:35:34.413 INFO:tasks.workunit.client.0.smithi112.stdout:3/885: fsync d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d63/f71 0 2024-09-19T09:35:34.413 INFO:tasks.workunit.client.0.smithi112.stdout:3/886: dread - d8/d15/d1b/d1c/d68/fed zero size 2024-09-19T09:35:34.429 INFO:tasks.workunit.client.0.smithi112.stdout:3/887: dwrite d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/f65 [0,4194304] 0 2024-09-19T09:35:34.429 INFO:tasks.workunit.client.0.smithi112.stdout:3/888: chown d8/d15/d1b/d1c/d27/d62/d99/f12a 122 1 2024-09-19T09:35:34.434 INFO:tasks.workunit.client.0.smithi112.stdout:8/858: sync 2024-09-19T09:35:34.435 INFO:tasks.workunit.client.0.smithi112.stdout:5/998: sync 2024-09-19T09:35:34.438 INFO:tasks.workunit.client.0.smithi112.stdout:3/889: rename d8/d15/d1b/d1c/d68/d33/d6f/c12b to d8/d15/d1b/d1c/c12e 0 2024-09-19T09:35:34.439 INFO:tasks.workunit.client.0.smithi112.stdout:3/890: write d8/d15/d1b/d1c/d68/d33/d6f/f8a [1788844,85776] 0 2024-09-19T09:35:34.443 INFO:tasks.workunit.client.0.smithi112.stdout:3/891: rename d8/d15/d1b/d1c/d68/d33/d83/cac to d8/d15/d1b/d1c/d27/d62/d99/da0/c12f 0 2024-09-19T09:35:34.443 INFO:tasks.workunit.client.0.smithi112.stdout:3/892: fsync d8/f30 0 2024-09-19T09:35:34.447 INFO:tasks.workunit.client.0.smithi112.stdout:3/893: creat d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/f130 x:0 0 0 2024-09-19T09:35:34.451 INFO:tasks.workunit.client.0.smithi112.stdout:5/999: dwrite d4/d9/fe8 [0,4194304] 0 2024-09-19T09:35:34.643 INFO:tasks.workunit.client.0.smithi112.stdout:9/635: sync 2024-09-19T09:35:34.644 INFO:tasks.workunit.client.0.smithi112.stdout:6/983: sync 2024-09-19T09:35:34.644 INFO:tasks.workunit.client.0.smithi112.stdout:1/761: sync 2024-09-19T09:35:34.644 INFO:tasks.workunit.client.0.smithi112.stdout:2/816: sync 2024-09-19T09:35:34.644 INFO:tasks.workunit.client.0.smithi112.stdout:0/766: sync 2024-09-19T09:35:34.644 INFO:tasks.workunit.client.0.smithi112.stdout:1/762: stat dc/d24/d45/d94/dbc/fd3 0 2024-09-19T09:35:34.644 INFO:tasks.workunit.client.0.smithi112.stdout:0/767: chown d2/d39/d3b/ca5 6 1 2024-09-19T09:35:34.644 INFO:tasks.workunit.client.0.smithi112.stdout:6/984: write d8/dc5/f127 [37366,39238] 0 2024-09-19T09:35:34.645 INFO:tasks.workunit.client.0.smithi112.stdout:9/636: creat df/d11/d14/d19/fe5 x:0 0 0 2024-09-19T09:35:34.646 INFO:tasks.workunit.client.0.smithi112.stdout:6/985: mkdir d8/d11/d14/d3c/dd5/d161 0 2024-09-19T09:35:34.651 INFO:tasks.workunit.client.0.smithi112.stdout:9/637: getdents df/d11/d14 0 2024-09-19T09:35:34.651 INFO:tasks.workunit.client.0.smithi112.stdout:9/638: write df/d11/d14/d19/d40/fb4 [290353,101309] 0 2024-09-19T09:35:34.651 INFO:tasks.workunit.client.0.smithi112.stdout:9/639: write df/d35/f38 [2558308,63643] 0 2024-09-19T09:35:34.652 INFO:tasks.workunit.client.0.smithi112.stdout:2/817: dread d0/d3e/d50/f64 [0,4194304] 0 2024-09-19T09:35:34.655 INFO:tasks.workunit.client.0.smithi112.stdout:6/986: read d8/d11/d14/f57 [7720138,60333] 0 2024-09-19T09:35:34.655 INFO:tasks.workunit.client.0.smithi112.stdout:6/987: fsync d8/de/d66/f126 0 2024-09-19T09:35:34.655 INFO:tasks.workunit.client.0.smithi112.stdout:2/818: creat d0/d1/d28/d9b/f108 x:0 0 0 2024-09-19T09:35:34.662 INFO:tasks.workunit.client.0.smithi112.stdout:0/768: dwrite d2/d59/da1/dd4/fbc [0,4194304] 0 2024-09-19T09:35:34.662 INFO:tasks.workunit.client.0.smithi112.stdout:0/769: chown d2/d59/da1/fdf 410 1 2024-09-19T09:35:34.665 INFO:tasks.workunit.client.0.smithi112.stdout:0/770: rename d2/d6e/da0/c78 to d2/d6e/d6f/cff 0 2024-09-19T09:35:34.665 INFO:tasks.workunit.client.0.smithi112.stdout:0/771: readlink d2/d6e/da0/de6/lf4 0 2024-09-19T09:35:34.666 INFO:tasks.workunit.client.0.smithi112.stdout:0/772: mknod d2/d6e/d6f/c100 0 2024-09-19T09:35:34.666 INFO:tasks.workunit.client.0.smithi112.stdout:2/819: dread d0/d1/f22 [0,4194304] 0 2024-09-19T09:35:34.668 INFO:tasks.workunit.client.0.smithi112.stdout:2/820: rename d0/d1/d28/d88/d8f to d0/d3e/d50/d57/d5a/d56/d109 0 2024-09-19T09:35:34.669 INFO:tasks.workunit.client.0.smithi112.stdout:2/821: unlink d0/d3e/d50/c7c 0 2024-09-19T09:35:34.670 INFO:tasks.workunit.client.0.smithi112.stdout:2/822: write d0/d1/d5f/d78/f93 [557457,25943] 0 2024-09-19T09:35:34.670 INFO:tasks.workunit.client.0.smithi112.stdout:2/823: fdatasync d0/d6/fa2 0 2024-09-19T09:35:34.672 INFO:tasks.workunit.client.0.smithi112.stdout:2/824: creat d0/d1/d28/f10a x:0 0 0 2024-09-19T09:35:34.673 INFO:tasks.workunit.client.0.smithi112.stdout:2/825: link d0/d3e/d50/d57/dac/c9e d0/d4a/c10b 0 2024-09-19T09:35:34.674 INFO:tasks.workunit.client.0.smithi112.stdout:6/988: dwrite d8/de/d61/d70/d7b/ff9 [0,4194304] 0 2024-09-19T09:35:34.675 INFO:tasks.workunit.client.0.smithi112.stdout:6/989: chown d8/de/fcd 5 1 2024-09-19T09:35:34.681 INFO:tasks.workunit.client.0.smithi112.stdout:0/773: dread d2/d59/f85 [0,4194304] 0 2024-09-19T09:35:34.682 INFO:tasks.workunit.client.0.smithi112.stdout:0/774: truncate d2/d6e/ff1 692321 0 2024-09-19T09:35:34.682 INFO:tasks.workunit.client.0.smithi112.stdout:0/775: chown d2/d6e/da0 297288 1 2024-09-19T09:35:34.684 INFO:tasks.workunit.client.0.smithi112.stdout:2/826: dread d0/d1/d5f/d78/f7b [4194304,4194304] 0 2024-09-19T09:35:34.684 INFO:tasks.workunit.client.0.smithi112.stdout:2/827: readlink d0/d3e/d50/l6d 0 2024-09-19T09:35:34.684 INFO:tasks.workunit.client.0.smithi112.stdout:2/828: chown d0/d3e/d50/d57/d5a/d27 302126 1 2024-09-19T09:35:34.684 INFO:tasks.workunit.client.0.smithi112.stdout:2/829: write d0/d1/d5f/fff [610677,35665] 0 2024-09-19T09:35:34.686 INFO:tasks.workunit.client.0.smithi112.stdout:2/830: symlink d0/d1/d28/d9b/d103/l10c 0 2024-09-19T09:35:34.688 INFO:tasks.workunit.client.0.smithi112.stdout:2/831: rmdir d0/d3e/d50/d57 39 2024-09-19T09:35:34.690 INFO:tasks.workunit.client.0.smithi112.stdout:2/832: truncate d0/d1/d5f/d78/f7b 1784989 0 2024-09-19T09:35:34.692 INFO:tasks.workunit.client.0.smithi112.stdout:2/833: chown d0/d3e/d50/d57/d80/lbd 0 1 2024-09-19T09:35:34.694 INFO:tasks.workunit.client.0.smithi112.stdout:0/776: dread d2/f49 [0,4194304] 0 2024-09-19T09:35:34.695 INFO:tasks.workunit.client.0.smithi112.stdout:0/777: fdatasync d2/d39/d3b/dab/fb6 0 2024-09-19T09:35:34.695 INFO:tasks.workunit.client.0.smithi112.stdout:6/990: dwrite d8/de/d18/f58 [0,4194304] 0 2024-09-19T09:35:34.697 INFO:tasks.workunit.client.0.smithi112.stdout:0/778: unlink d2/d59/da1/dd4/d95/db5/f40 0 2024-09-19T09:35:34.697 INFO:tasks.workunit.client.0.smithi112.stdout:0/779: symlink d2/d6e/da0/l101 0 2024-09-19T09:35:34.701 INFO:tasks.workunit.client.0.smithi112.stdout:0/780: rmdir d2/d39/d3b 39 2024-09-19T09:35:34.704 INFO:tasks.workunit.client.0.smithi112.stdout:0/781: rename d2/d6e/da0/cfb to d2/d59/da1/dd4/db8/dc1/dfc/c102 0 2024-09-19T09:35:34.704 INFO:tasks.workunit.client.0.smithi112.stdout:2/834: dread d0/d3e/d61/f6c [0,4194304] 0 2024-09-19T09:35:34.704 INFO:tasks.workunit.client.0.smithi112.stdout:2/835: readlink d0/d3e/d50/d57/d80/d8b/ld8 0 2024-09-19T09:35:34.706 INFO:tasks.workunit.client.0.smithi112.stdout:0/782: rename d2/d39/d3b/dab/cde to d2/d59/c103 0 2024-09-19T09:35:34.707 INFO:tasks.workunit.client.0.smithi112.stdout:2/836: creat d0/d1/d28/d67/f10d x:0 0 0 2024-09-19T09:35:34.707 INFO:tasks.workunit.client.0.smithi112.stdout:2/837: write d0/d3e/d50/ff6 [983890,56465] 0 2024-09-19T09:35:34.708 INFO:tasks.workunit.client.0.smithi112.stdout:0/783: mkdir d2/d45/d104 0 2024-09-19T09:35:34.714 INFO:tasks.workunit.client.0.smithi112.stdout:6/991: dwrite d8/de/d61/d70/d7b/fc3 [0,4194304] 0 2024-09-19T09:35:34.714 INFO:tasks.workunit.client.0.smithi112.stdout:6/992: read d8/f9 [3609535,29576] 0 2024-09-19T09:35:34.714 INFO:tasks.workunit.client.0.smithi112.stdout:6/993: creat d8/de/d61/f162 x:0 0 0 2024-09-19T09:35:34.721 INFO:tasks.workunit.client.0.smithi112.stdout:6/994: rmdir d8/de/d17/d94/d108 39 2024-09-19T09:35:34.725 INFO:tasks.workunit.client.0.smithi112.stdout:2/838: dwrite d0/d4a/f8c [0,4194304] 0 2024-09-19T09:35:34.725 INFO:tasks.workunit.client.0.smithi112.stdout:6/995: unlink d8/d11/d14/d3c/l5c 0 2024-09-19T09:35:34.725 INFO:tasks.workunit.client.0.smithi112.stdout:6/996: chown d8/de/d61/dbf/d130/f122 14998209 1 2024-09-19T09:35:34.734 INFO:tasks.workunit.client.0.smithi112.stdout:2/839: mkdir d0/d3e/d49/d10e 0 2024-09-19T09:35:34.740 INFO:tasks.workunit.client.0.smithi112.stdout:6/997: rmdir d8/de/d18 39 2024-09-19T09:35:34.742 INFO:tasks.workunit.client.0.smithi112.stdout:2/840: mkdir d0/d3e/d50/d57/d5a/d10f 0 2024-09-19T09:35:34.743 INFO:tasks.workunit.client.0.smithi112.stdout:2/841: dread d0/d3e/fc9 [0,4194304] 0 2024-09-19T09:35:34.744 INFO:tasks.workunit.client.0.smithi112.stdout:2/842: symlink d0/d1/d5f/d78/db0/d9a/l110 0 2024-09-19T09:35:34.744 INFO:tasks.workunit.client.0.smithi112.stdout:2/843: write d0/d1/d8a/f8e [87962,94315] 0 2024-09-19T09:35:34.745 INFO:tasks.workunit.client.0.smithi112.stdout:2/844: creat d0/d1/d5f/d78/db0/dfc/f111 x:0 0 0 2024-09-19T09:35:34.749 INFO:tasks.workunit.client.0.smithi112.stdout:2/845: link d0/d1/d5f/d78/f93 d0/d1/ded/f112 0 2024-09-19T09:35:34.749 INFO:tasks.workunit.client.0.smithi112.stdout:2/846: fdatasync d0/d3e/d50/d57/d5a/f11 0 2024-09-19T09:35:34.756 INFO:tasks.workunit.client.0.smithi112.stdout:2/847: dread d0/d3e/d50/d57/f79 [0,4194304] 0 2024-09-19T09:35:34.758 INFO:tasks.workunit.client.0.smithi112.stdout:6/998: dwrite d8/d11/d14/d2a/fb9 [0,4194304] 0 2024-09-19T09:35:34.758 INFO:tasks.workunit.client.0.smithi112.stdout:6/999: fsync d8/de/d18/f13c 0 2024-09-19T09:35:34.758 INFO:tasks.workunit.client.0.smithi112.stdout:2/848: rename d0/d1/d28/d9b/f108 to d0/d3e/d50/d57/f113 0 2024-09-19T09:35:34.758 INFO:tasks.workunit.client.0.smithi112.stdout:2/849: chown d0/d1/d8a/f8e 20158356 1 2024-09-19T09:35:34.759 INFO:tasks.workunit.client.0.smithi112.stdout:2/850: mknod d0/d3e/d50/d57/d5a/d4f/c114 0 2024-09-19T09:35:34.759 INFO:tasks.workunit.client.0.smithi112.stdout:2/851: chown d0/d1/d5f/d78/fa4 1474084484 1 2024-09-19T09:35:34.761 INFO:tasks.workunit.client.0.smithi112.stdout:2/852: mkdir d0/d1/d115 0 2024-09-19T09:35:34.762 INFO:tasks.workunit.client.0.smithi112.stdout:2/853: dread d0/d3e/fab [0,4194304] 0 2024-09-19T09:35:34.762 INFO:tasks.workunit.client.0.smithi112.stdout:2/854: write d0/d6/fc [2232069,84560] 0 2024-09-19T09:35:34.764 INFO:tasks.workunit.client.0.smithi112.stdout:2/855: creat d0/d1/d5f/d78/f116 x:0 0 0 2024-09-19T09:35:34.764 INFO:tasks.workunit.client.0.smithi112.stdout:2/856: stat d0/d3e/d61/f6c 0 2024-09-19T09:35:34.764 INFO:tasks.workunit.client.0.smithi112.stdout:2/857: chown d0/d3e/d50/d57/d5a/d56/d109/l97 0 1 2024-09-19T09:35:34.764 INFO:tasks.workunit.client.0.smithi112.stdout:2/858: rmdir d0/d6 39 2024-09-19T09:35:34.765 INFO:tasks.workunit.client.0.smithi112.stdout:2/859: symlink d0/d3e/d50/d57/d5a/d56/l117 0 2024-09-19T09:35:34.778 INFO:tasks.workunit.client.0.smithi112.stdout:2/860: dwrite d0/d3e/d50/d57/d5a/d56/fca [0,4194304] 0 2024-09-19T09:35:34.778 INFO:tasks.workunit.client.0.smithi112.stdout:2/861: stat d0/d4a/l5d 0 2024-09-19T09:35:34.781 INFO:tasks.workunit.client.0.smithi112.stdout:2/862: mknod d0/d6/c118 0 2024-09-19T09:35:34.782 INFO:tasks.workunit.client.0.smithi112.stdout:2/863: mknod d0/d1/d5f/d78/db0/dfc/c119 0 2024-09-19T09:35:34.783 INFO:tasks.workunit.client.0.smithi112.stdout:2/864: mkdir d0/d1/d5f/d78/db0/d9a/dae/d11a 0 2024-09-19T09:35:34.785 INFO:tasks.workunit.client.0.smithi112.stdout:2/865: unlink d0/d3e/fab 0 2024-09-19T09:35:34.956 INFO:tasks.workunit.client.0.smithi112.stdout:3/894: sync 2024-09-19T09:35:34.957 INFO:tasks.workunit.client.0.smithi112.stdout:8/859: sync 2024-09-19T09:35:34.964 INFO:tasks.workunit.client.0.smithi112.stdout:3/895: write d8/f93 [2557658,47525] 0 2024-09-19T09:35:34.964 INFO:tasks.workunit.client.0.smithi112.stdout:3/896: chown d8/d15/d1b/d28/c98 251514850 1 2024-09-19T09:35:34.964 INFO:tasks.workunit.client.0.smithi112.stdout:3/897: fdatasync d8/d15/d1b/d1c/d68/fec 0 2024-09-19T09:35:34.966 INFO:tasks.workunit.client.0.smithi112.stdout:3/898: creat d8/d15/d1b/d1c/d68/d33/d8e/d111/f131 x:0 0 0 2024-09-19T09:35:34.966 INFO:tasks.workunit.client.0.smithi112.stdout:3/899: dread - d8/d15/d1b/d1c/d27/d62/f112 zero size 2024-09-19T09:35:34.966 INFO:tasks.workunit.client.0.smithi112.stdout:3/900: dread - d8/d15/d1b/d1c/d68/d33/d8e/fc5 zero size 2024-09-19T09:35:34.967 INFO:tasks.workunit.client.0.smithi112.stdout:3/901: mkdir d8/d15/d1b/d1c/db5/d101/dfb/d132 0 2024-09-19T09:35:34.967 INFO:tasks.workunit.client.0.smithi112.stdout:3/902: readlink d8/d15/d1b/d1c/db5/ld7 0 2024-09-19T09:35:34.982 INFO:tasks.workunit.client.0.smithi112.stdout:3/903: dwrite d8/f10 [4194304,4194304] 0 2024-09-19T09:35:34.982 INFO:tasks.workunit.client.0.smithi112.stdout:8/860: dwrite d7/db/d21/d3b/d56/d3c/f103 [0,4194304] 0 2024-09-19T09:35:34.982 INFO:tasks.workunit.client.0.smithi112.stdout:8/861: write d7/d10/d11/f96 [1715248,126969] 0 2024-09-19T09:35:34.982 INFO:tasks.workunit.client.0.smithi112.stdout:8/862: readlink d7/db/d21/d3b/d56/d4b/l8a 0 2024-09-19T09:35:34.987 INFO:tasks.workunit.client.0.smithi112.stdout:3/904: symlink d8/d15/d1b/d1c/d27/d62/l133 0 2024-09-19T09:35:34.988 INFO:tasks.workunit.client.0.smithi112.stdout:8/863: rename d7/d10/d11/d33/c9b to d7/db/d21/d3b/d56/d4b/d5b/c111 0 2024-09-19T09:35:34.988 INFO:tasks.workunit.client.0.smithi112.stdout:8/864: chown d7/d10/d11/d50/ddd/db8 98742098 1 2024-09-19T09:35:34.990 INFO:tasks.workunit.client.0.smithi112.stdout:3/905: mknod d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d63/db0/c134 0 2024-09-19T09:35:34.991 INFO:tasks.workunit.client.0.smithi112.stdout:3/906: mknod d8/d15/d1b/d1c/d27/d62/d99/da0/c135 0 2024-09-19T09:35:34.993 INFO:tasks.workunit.client.0.smithi112.stdout:3/907: link d8/d15/d1b/d1c/d68/d33/d66/fa2 d8/d15/d1b/d1c/d68/d33/d66/d113/f136 0 2024-09-19T09:35:34.995 INFO:tasks.workunit.client.0.smithi112.stdout:3/908: mknod d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d63/db0/c137 0 2024-09-19T09:35:34.995 INFO:tasks.workunit.client.0.smithi112.stdout:3/909: chown d8/d15/d1b/d1c/d107 68407522 1 2024-09-19T09:35:34.995 INFO:tasks.workunit.client.0.smithi112.stdout:8/865: read d7/d10/d11/d33/f54 [3173831,42314] 0 2024-09-19T09:35:34.996 INFO:tasks.workunit.client.0.smithi112.stdout:3/910: creat d8/d15/d1b/d1c/db5/d118/f138 x:0 0 0 2024-09-19T09:35:35.000 INFO:tasks.workunit.client.0.smithi112.stdout:8/866: dread d7/db/d21/d3b/d56/d3c/f94 [0,4194304] 0 2024-09-19T09:35:35.000 INFO:tasks.workunit.client.0.smithi112.stdout:8/867: stat d7/db/d21/d2e/d8c/d97/db6/l10b 0 2024-09-19T09:35:35.000 INFO:tasks.workunit.client.0.smithi112.stdout:3/911: creat d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d63/db0/f139 x:0 0 0 2024-09-19T09:35:35.000 INFO:tasks.workunit.client.0.smithi112.stdout:3/912: readlink d8/l50 0 2024-09-19T09:35:35.001 INFO:tasks.workunit.client.0.smithi112.stdout:8/868: symlink d7/db/d21/d3b/d56/d3c/d79/l112 0 2024-09-19T09:35:35.001 INFO:tasks.workunit.client.0.smithi112.stdout:8/869: readlink d7/d10/d11/d50/ddd/l105 0 2024-09-19T09:35:35.008 INFO:tasks.workunit.client.0.smithi112.stdout:3/913: dread d8/f7d [0,4194304] 0 2024-09-19T09:35:35.010 INFO:tasks.workunit.client.0.smithi112.stdout:8/870: dread d7/d10/d11/f2b [0,4194304] 0 2024-09-19T09:35:35.013 INFO:tasks.workunit.client.0.smithi112.stdout:8/871: mknod d7/db/d21/d2e/d8c/d97/d107/c113 0 2024-09-19T09:35:35.015 INFO:tasks.workunit.client.0.smithi112.stdout:8/872: creat d7/db/d21/f114 x:0 0 0 2024-09-19T09:35:35.018 INFO:tasks.workunit.client.0.smithi112.stdout:8/873: mkdir d7/db/d115 0 2024-09-19T09:35:35.018 INFO:tasks.workunit.client.0.smithi112.stdout:8/874: dread - d7/db/d21/d3b/d56/d3c/d79/fb4 zero size 2024-09-19T09:35:35.020 INFO:tasks.workunit.client.0.smithi112.stdout:8/875: creat d7/db/d21/d2e/d42/d57/dea/f116 x:0 0 0 2024-09-19T09:35:35.024 INFO:tasks.workunit.client.0.smithi112.stdout:3/914: dwrite d8/d15/d1b/d1c/d68/d33/d66/f11a [0,4194304] 0 2024-09-19T09:35:35.031 INFO:tasks.workunit.client.0.smithi112.stdout:8/876: dread d7/db/d21/d3b/d56/d3c/f94 [0,4194304] 0 2024-09-19T09:35:35.033 INFO:tasks.workunit.client.0.smithi112.stdout:8/877: rename d7/db/d21/d3b/d56/d3c/f3d to d7/f117 0 2024-09-19T09:35:35.033 INFO:tasks.workunit.client.0.smithi112.stdout:8/878: chown d7/db/d21/d2e/d8c/d97/lf2 436 1 2024-09-19T09:35:35.033 INFO:tasks.workunit.client.0.smithi112.stdout:8/879: creat d7/db/d21/d2e/d8c/d97/f118 x:0 0 0 2024-09-19T09:35:35.035 INFO:tasks.workunit.client.0.smithi112.stdout:8/880: creat d7/db/d21/d3b/dd8/f119 x:0 0 0 2024-09-19T09:35:35.036 INFO:tasks.workunit.client.0.smithi112.stdout:8/881: rmdir d7/db/d21/d3b/d56/d3c/d79/ddf 39 2024-09-19T09:35:35.036 INFO:tasks.workunit.client.0.smithi112.stdout:8/882: write d7/f117 [7442885,65816] 0 2024-09-19T09:35:35.038 INFO:tasks.workunit.client.0.smithi112.stdout:8/883: getdents d7/db/d21/d3b/d56/d3c/d79/ddf 0 2024-09-19T09:35:35.041 INFO:tasks.workunit.client.0.smithi112.stdout:3/915: dwrite d8/d15/d1b/d1c/d68/d33/d8e/d111/f131 [0,4194304] 0 2024-09-19T09:35:35.041 INFO:tasks.workunit.client.0.smithi112.stdout:3/916: readlink d8/d15/l1a 0 2024-09-19T09:35:35.049 INFO:tasks.workunit.client.0.smithi112.stdout:3/917: dread d8/d15/d1b/d1c/d27/f86 [0,4194304] 0 2024-09-19T09:35:35.050 INFO:tasks.workunit.client.0.smithi112.stdout:3/918: mknod d8/d15/d1b/d1c/db5/c13a 0 2024-09-19T09:35:35.051 INFO:tasks.workunit.client.0.smithi112.stdout:3/919: chown d8/d48/faf 19 1 2024-09-19T09:35:35.052 INFO:tasks.workunit.client.0.smithi112.stdout:3/920: creat d8/d105/f13b x:0 0 0 2024-09-19T09:35:35.052 INFO:tasks.workunit.client.0.smithi112.stdout:3/921: chown d8/d15/d1b/d1c/d27/d2b/ffd 450105063 1 2024-09-19T09:35:35.052 INFO:tasks.workunit.client.0.smithi112.stdout:3/922: write d8/d15/d1b/d1c/db5/d101/ff8 [785284,73999] 0 2024-09-19T09:35:35.052 INFO:tasks.workunit.client.0.smithi112.stdout:3/923: chown d8/d15/d1b/d1c/d68/l34 55407 1 2024-09-19T09:35:35.052 INFO:tasks.workunit.client.0.smithi112.stdout:3/924: chown d8/d15/d1b/d1c/d68/d33/d83/f121 0 1 2024-09-19T09:35:35.054 INFO:tasks.workunit.client.0.smithi112.stdout:3/925: link d8/d15/d1b/d28/l2d d8/d15/d1b/d1c/d27/d62/dcf/d44/l13c 0 2024-09-19T09:35:35.054 INFO:tasks.workunit.client.0.smithi112.stdout:3/926: chown d8/d15/d1b/d1c/d27/d62/dcf/l96 1898 1 2024-09-19T09:35:35.070 INFO:tasks.workunit.client.0.smithi112.stdout:3/927: dwrite d8/d15/d1b/d1c/d27/d62/d99/f10f [0,4194304] 0 2024-09-19T09:35:35.072 INFO:tasks.workunit.client.0.smithi112.stdout:3/928: symlink d8/d105/l13d 0 2024-09-19T09:35:35.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:34 smithi112 ceph-mon[27605]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 165 MiB/s rd, 203 MiB/s wr, 442 op/s 2024-09-19T09:35:35.256 INFO:tasks.workunit.client.0.smithi112.stdout:1/763: sync 2024-09-19T09:35:35.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:34 smithi191 ceph-mon[34834]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 165 MiB/s rd, 203 MiB/s wr, 442 op/s 2024-09-19T09:35:35.291 INFO:tasks.workunit.client.0.smithi112.stdout:1/764: mkdir dc/d26/d34/d4c/de8 0 2024-09-19T09:35:35.293 INFO:tasks.workunit.client.0.smithi112.stdout:1/765: creat dc/d26/d34/d36/fe9 x:0 0 0 2024-09-19T09:35:35.301 INFO:tasks.workunit.client.0.smithi112.stdout:1/766: write dc/d24/d45/d94/dbc/fd3 [6294528,34907] 0 2024-09-19T09:35:35.303 INFO:tasks.workunit.client.0.smithi112.stdout:1/767: unlink dc/d26/d34/d36/d68/cbd 0 2024-09-19T09:35:35.305 INFO:tasks.workunit.client.0.smithi112.stdout:1/768: dread dc/d13/fd2 [4194304,4194304] 0 2024-09-19T09:35:35.306 INFO:tasks.workunit.client.0.smithi112.stdout:1/769: symlink dc/d26/d34/d36/d68/d7d/dd5/lea 0 2024-09-19T09:35:35.308 INFO:tasks.workunit.client.0.smithi112.stdout:1/770: mkdir dc/d24/d45/d94/deb 0 2024-09-19T09:35:35.325 INFO:tasks.workunit.client.0.smithi112.stdout:1/771: dwrite dc/d26/d44/d63/f7f [0,4194304] 0 2024-09-19T09:35:35.325 INFO:tasks.workunit.client.0.smithi112.stdout:1/772: write dc/d24/d45/f7a [369112,29734] 0 2024-09-19T09:35:35.326 INFO:tasks.workunit.client.0.smithi112.stdout:1/773: rmdir dc/d24 39 2024-09-19T09:35:35.327 INFO:tasks.workunit.client.0.smithi112.stdout:1/774: rmdir dc/d24/d45/d94 39 2024-09-19T09:35:35.346 INFO:tasks.workunit.client.0.smithi112.stdout:1/775: dwrite dc/d26/d34/d4c/f89 [0,4194304] 0 2024-09-19T09:35:35.347 INFO:tasks.workunit.client.0.smithi112.stdout:1/776: fsync dc/d13/fd2 0 2024-09-19T09:35:35.349 INFO:tasks.workunit.client.0.smithi112.stdout:1/777: symlink dc/d26/d34/d4c/d55/lec 0 2024-09-19T09:35:35.349 INFO:tasks.workunit.client.0.smithi112.stdout:1/778: write dc/fe [5967876,55695] 0 2024-09-19T09:35:35.349 INFO:tasks.workunit.client.0.smithi112.stdout:1/779: write dc/d24/f46 [1164215,104118] 0 2024-09-19T09:35:35.363 INFO:tasks.workunit.client.0.smithi112.stdout:1/780: dwrite dc/d59/d73/d88/da5/fab [0,4194304] 0 2024-09-19T09:35:35.373 INFO:tasks.workunit.client.0.smithi112.stdout:1/781: dread dc/d59/d73/d88/da5/fab [0,4194304] 0 2024-09-19T09:35:35.381 INFO:tasks.workunit.client.0.smithi112.stdout:1/782: write f8 [2486465,103663] 0 2024-09-19T09:35:35.384 INFO:tasks.workunit.client.0.smithi112.stdout:1/783: truncate dc/d26/d34/d4c/d64/fc8 5190828 0 2024-09-19T09:35:35.384 INFO:tasks.workunit.client.0.smithi112.stdout:1/784: chown dc/d26/d44/d63 23694 1 2024-09-19T09:35:35.392 INFO:tasks.workunit.client.0.smithi112.stdout:1/785: dread dc/d24/f40 [0,4194304] 0 2024-09-19T09:35:35.394 INFO:tasks.workunit.client.0.smithi112.stdout:1/786: creat dc/d59/d73/d88/da5/fed x:0 0 0 2024-09-19T09:35:35.395 INFO:tasks.workunit.client.0.smithi112.stdout:1/787: getdents dc/d13 0 2024-09-19T09:35:35.397 INFO:tasks.workunit.client.0.smithi112.stdout:1/788: unlink dc/d13/l2f 0 2024-09-19T09:35:35.411 INFO:tasks.workunit.client.0.smithi112.stdout:1/789: dwrite dc/d26/d34/d36/d68/fc4 [0,4194304] 0 2024-09-19T09:35:35.414 INFO:tasks.workunit.client.0.smithi112.stdout:1/790: mkdir dc/d26/d44/d63/dee 0 2024-09-19T09:35:35.430 INFO:tasks.workunit.client.0.smithi112.stdout:1/791: dwrite dc/f69 [0,4194304] 0 2024-09-19T09:35:35.434 INFO:tasks.workunit.client.0.smithi112.stdout:1/792: dread dc/d24/f46 [0,4194304] 0 2024-09-19T09:35:35.449 INFO:tasks.workunit.client.0.smithi112.stdout:1/793: dwrite dc/fd [0,4194304] 0 2024-09-19T09:35:35.451 INFO:tasks.workunit.client.0.smithi112.stdout:1/794: mknod dc/d26/d34/cef 0 2024-09-19T09:35:35.452 INFO:tasks.workunit.client.0.smithi112.stdout:1/795: write dc/d59/f80 [772090,3525] 0 2024-09-19T09:35:35.452 INFO:tasks.workunit.client.0.smithi112.stdout:1/796: readlink dc/d26/lc5 0 2024-09-19T09:35:35.453 INFO:tasks.workunit.client.0.smithi112.stdout:1/797: symlink dc/d59/d73/d88/da5/lf0 0 2024-09-19T09:35:35.453 INFO:tasks.workunit.client.0.smithi112.stdout:1/798: dread - dc/d26/d34/d36/d68/d9f/fe4 zero size 2024-09-19T09:35:35.455 INFO:tasks.workunit.client.0.smithi112.stdout:1/799: link dc/d24/c4d dc/cf1 0 2024-09-19T09:35:35.455 INFO:tasks.workunit.client.0.smithi112.stdout:1/800: creat dc/d24/da2/ff2 x:0 0 0 2024-09-19T09:35:35.457 INFO:tasks.workunit.client.0.smithi112.stdout:1/801: creat dc/d26/d44/d63/dee/ff3 x:0 0 0 2024-09-19T09:35:35.457 INFO:tasks.workunit.client.0.smithi112.stdout:1/802: readlink dc/l16 0 2024-09-19T09:35:35.460 INFO:tasks.workunit.client.0.smithi112.stdout:9/640: sync 2024-09-19T09:35:35.460 INFO:tasks.workunit.client.0.smithi112.stdout:0/784: sync 2024-09-19T09:35:35.462 INFO:tasks.workunit.client.0.smithi112.stdout:9/641: rmdir df/d11/d14/d19/d40/daf/d6c/de4 0 2024-09-19T09:35:35.463 INFO:tasks.workunit.client.0.smithi112.stdout:9/642: truncate df/d11/d14/d19/f90 991394 0 2024-09-19T09:35:35.463 INFO:tasks.workunit.client.0.smithi112.stdout:9/643: creat df/d35/fe6 x:0 0 0 2024-09-19T09:35:35.464 INFO:tasks.workunit.client.0.smithi112.stdout:0/785: rename d2/l3a to d2/d6e/da0/de6/l105 0 2024-09-19T09:35:35.467 INFO:tasks.workunit.client.0.smithi112.stdout:0/786: rename d2/d59/f83 to d2/d39/f106 0 2024-09-19T09:35:35.469 INFO:tasks.workunit.client.0.smithi112.stdout:0/787: rename d2/fb to d2/f107 0 2024-09-19T09:35:35.485 INFO:tasks.workunit.client.0.smithi112.stdout:1/803: dwrite dc/d13/f1b [0,4194304] 0 2024-09-19T09:35:35.485 INFO:tasks.workunit.client.0.smithi112.stdout:9/644: dwrite df/d11/d14/d19/d28/d95/fb1 [0,4194304] 0 2024-09-19T09:35:35.489 INFO:tasks.workunit.client.0.smithi112.stdout:0/788: rmdir d2/d6e/da0/de6 39 2024-09-19T09:35:35.489 INFO:tasks.workunit.client.0.smithi112.stdout:0/789: dread - d2/d45/fed zero size 2024-09-19T09:35:35.490 INFO:tasks.workunit.client.0.smithi112.stdout:1/804: fdatasync dc/d13/f1c 0 2024-09-19T09:35:35.492 INFO:tasks.workunit.client.0.smithi112.stdout:9/645: symlink df/le7 0 2024-09-19T09:35:35.492 INFO:tasks.workunit.client.0.smithi112.stdout:9/646: creat df/d11/d14/d19/d28/fe8 x:0 0 0 2024-09-19T09:35:35.492 INFO:tasks.workunit.client.0.smithi112.stdout:9/647: creat df/d35/fe9 x:0 0 0 2024-09-19T09:35:35.494 INFO:tasks.workunit.client.0.smithi112.stdout:0/790: creat d2/d39/d3b/f108 x:0 0 0 2024-09-19T09:35:35.498 INFO:tasks.workunit.client.0.smithi112.stdout:9/648: mkdir df/d11/d14/d19/d40/dea 0 2024-09-19T09:35:35.500 INFO:tasks.workunit.client.0.smithi112.stdout:9/649: write df/d11/d14/d19/d40/daf/d6c/f80 [261033,43460] 0 2024-09-19T09:35:35.500 INFO:tasks.workunit.client.0.smithi112.stdout:9/650: chown df/d11/d14/d19/d66/l5a 249196070 1 2024-09-19T09:35:35.500 INFO:tasks.workunit.client.0.smithi112.stdout:9/651: write df/d11/d14/d19/d28/d95/fd7 [402274,113707] 0 2024-09-19T09:35:35.501 INFO:tasks.workunit.client.0.smithi112.stdout:0/791: link d2/d39/lf6 d2/d59/d7a/l109 0 2024-09-19T09:35:35.502 INFO:tasks.workunit.client.0.smithi112.stdout:0/792: symlink d2/d6e/db4/l10a 0 2024-09-19T09:35:35.504 INFO:tasks.workunit.client.0.smithi112.stdout:0/793: creat d2/d39/d3b/d8a/f10b x:0 0 0 2024-09-19T09:35:35.513 INFO:tasks.workunit.client.0.smithi112.stdout:1/805: dwrite dc/d26/d34/f6d [0,4194304] 0 2024-09-19T09:35:35.513 INFO:tasks.workunit.client.0.smithi112.stdout:1/806: chown dc/d24/c95 480 1 2024-09-19T09:35:35.513 INFO:tasks.workunit.client.0.smithi112.stdout:1/807: chown dc/d26/d34/d4c/le0 2324358 1 2024-09-19T09:35:35.518 INFO:tasks.workunit.client.0.smithi112.stdout:9/652: dread df/d11/d14/d19/d40/daf/f92 [0,4194304] 0 2024-09-19T09:35:35.518 INFO:tasks.workunit.client.0.smithi112.stdout:9/653: chown df/d35/f38 13 1 2024-09-19T09:35:35.521 INFO:tasks.workunit.client.0.smithi112.stdout:1/808: getdents dc/d26/d34/d36/d68/d7d/d6a 0 2024-09-19T09:35:35.521 INFO:tasks.workunit.client.0.smithi112.stdout:1/809: creat dc/d26/ff4 x:0 0 0 2024-09-19T09:35:35.524 INFO:tasks.workunit.client.0.smithi112.stdout:1/810: symlink dc/d24/da2/lf5 0 2024-09-19T09:35:35.524 INFO:tasks.workunit.client.0.smithi112.stdout:1/811: write dc/d24/f12 [2073784,70177] 0 2024-09-19T09:35:35.524 INFO:tasks.workunit.client.0.smithi112.stdout:1/812: stat f1 0 2024-09-19T09:35:35.526 INFO:tasks.workunit.client.0.smithi112.stdout:0/794: dwrite d2/d39/fb3 [0,4194304] 0 2024-09-19T09:35:35.526 INFO:tasks.workunit.client.0.smithi112.stdout:0/795: stat d2/f12 0 2024-09-19T09:35:35.526 INFO:tasks.workunit.client.0.smithi112.stdout:0/796: creat d2/d39/d3b/d8a/f10c x:0 0 0 2024-09-19T09:35:35.554 INFO:tasks.workunit.client.0.smithi112.stdout:8/884: sync 2024-09-19T09:35:35.555 INFO:tasks.workunit.client.0.smithi112.stdout:2/866: sync 2024-09-19T09:35:35.556 INFO:tasks.workunit.client.0.smithi112.stdout:8/885: creat d7/d10/d11/d62/dd2/f11a x:0 0 0 2024-09-19T09:35:35.559 INFO:tasks.workunit.client.0.smithi112.stdout:2/867: rmdir d0/d1/d28 39 2024-09-19T09:35:35.559 INFO:tasks.workunit.client.0.smithi112.stdout:2/868: fdatasync d0/d3e/d50/d57/d5a/d27/f73 0 2024-09-19T09:35:35.562 INFO:tasks.workunit.client.0.smithi112.stdout:8/886: creat d7/d10/d11/d50/ddd/f11b x:0 0 0 2024-09-19T09:35:35.562 INFO:tasks.workunit.client.0.smithi112.stdout:8/887: write d7/f10e [199403,53392] 0 2024-09-19T09:35:35.562 INFO:tasks.workunit.client.0.smithi112.stdout:9/654: dwrite df/d11/d14/d19/d40/daf/d6c/f80 [0,4194304] 0 2024-09-19T09:35:35.562 INFO:tasks.workunit.client.0.smithi112.stdout:1/813: dwrite dc/d24/f46 [0,4194304] 0 2024-09-19T09:35:35.562 INFO:tasks.workunit.client.0.smithi112.stdout:0/797: dwrite d2/f22 [4194304,4194304] 0 2024-09-19T09:35:35.564 INFO:tasks.workunit.client.0.smithi112.stdout:3/929: sync 2024-09-19T09:35:35.569 INFO:tasks.workunit.client.0.smithi112.stdout:8/888: read d7/d67/f4c [89710,14990] 0 2024-09-19T09:35:35.572 INFO:tasks.workunit.client.0.smithi112.stdout:0/798: creat d2/d59/da1/dd4/db8/dc1/dfc/f10d x:0 0 0 2024-09-19T09:35:35.573 INFO:tasks.workunit.client.0.smithi112.stdout:3/930: getdents d8/d15/d1b/d1c/d68/d33/d66/d113 0 2024-09-19T09:35:35.573 INFO:tasks.workunit.client.0.smithi112.stdout:3/931: chown d8/d15/d1b/c42 0 1 2024-09-19T09:35:35.573 INFO:tasks.workunit.client.0.smithi112.stdout:3/932: stat d8/f102 0 2024-09-19T09:35:35.575 INFO:tasks.workunit.client.0.smithi112.stdout:9/655: rename df/l8c to df/d11/d14/d19/d66/d5d/leb 0 2024-09-19T09:35:35.575 INFO:tasks.workunit.client.0.smithi112.stdout:1/814: dread dc/d24/f52 [0,4194304] 0 2024-09-19T09:35:35.576 INFO:tasks.workunit.client.0.smithi112.stdout:1/815: dread - dc/d26/ff4 zero size 2024-09-19T09:35:35.577 INFO:tasks.workunit.client.0.smithi112.stdout:0/799: creat d2/d59/f10e x:0 0 0 2024-09-19T09:35:35.578 INFO:tasks.workunit.client.0.smithi112.stdout:3/933: creat d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/f13e x:0 0 0 2024-09-19T09:35:35.579 INFO:tasks.workunit.client.0.smithi112.stdout:3/934: chown d8/d15/l1a 191554 1 2024-09-19T09:35:35.579 INFO:tasks.workunit.client.0.smithi112.stdout:3/935: stat d8/d15/d1b/d1c/d68/db9/f116 0 2024-09-19T09:35:35.581 INFO:tasks.workunit.client.0.smithi112.stdout:1/816: link dc/d26/d34/d36/d68/d7d/f7b dc/d26/d44/ff6 0 2024-09-19T09:35:35.582 INFO:tasks.workunit.client.0.smithi112.stdout:0/800: truncate d2/d59/da1/dd4/db8/dc1/fcf 3349286 0 2024-09-19T09:35:35.584 INFO:tasks.workunit.client.0.smithi112.stdout:1/817: creat dc/d26/d34/d36/d68/db7/ff7 x:0 0 0 2024-09-19T09:35:35.584 INFO:tasks.workunit.client.0.smithi112.stdout:1/818: truncate dc/d26/d34/d4c/d55/f87 42491 0 2024-09-19T09:35:35.584 INFO:tasks.workunit.client.0.smithi112.stdout:1/819: creat dc/d26/d44/d63/dee/ff8 x:0 0 0 2024-09-19T09:35:35.586 INFO:tasks.workunit.client.0.smithi112.stdout:0/801: creat d2/d59/da1/dd4/d95/db5/f10f x:0 0 0 2024-09-19T09:35:35.586 INFO:tasks.workunit.client.0.smithi112.stdout:3/936: getdents d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d63/db0 0 2024-09-19T09:35:35.588 INFO:tasks.workunit.client.0.smithi112.stdout:1/820: creat dc/d59/d73/d88/ff9 x:0 0 0 2024-09-19T09:35:35.589 INFO:tasks.workunit.client.0.smithi112.stdout:3/937: mknod d8/d15/d1b/d1c/d27/da1/c13f 0 2024-09-19T09:35:35.589 INFO:tasks.workunit.client.0.smithi112.stdout:3/938: chown d8/d15/d1b/d1c/d27/d62/d99/f10f 753 1 2024-09-19T09:35:35.589 INFO:tasks.workunit.client.0.smithi112.stdout:1/821: mknod dc/d24/d45/d94/deb/cfa 0 2024-09-19T09:35:35.591 INFO:tasks.workunit.client.0.smithi112.stdout:3/939: link d8/d15/d1b/d1c/d68/d33/d83/def/l11e d8/d15/d1b/d1c/d27/d62/dcf/l140 0 2024-09-19T09:35:35.592 INFO:tasks.workunit.client.0.smithi112.stdout:1/822: link dc/d24/da2/fa6 dc/d26/d34/d36/d68/ffb 0 2024-09-19T09:35:35.594 INFO:tasks.workunit.client.0.smithi112.stdout:3/940: write d8/d15/d1b/d1c/d68/d33/d66/d113/f136 [538704,42661] 0 2024-09-19T09:35:35.595 INFO:tasks.workunit.client.0.smithi112.stdout:3/941: symlink d8/d15/d1b/d1c/d27/l141 0 2024-09-19T09:35:35.595 INFO:tasks.workunit.client.0.smithi112.stdout:3/942: dread - d8/d15/d1b/d1c/d43/d9b/fc0 zero size 2024-09-19T09:35:35.599 INFO:tasks.workunit.client.0.smithi112.stdout:9/656: dwrite df/d11/d14/d19/d28/fe8 [0,4194304] 0 2024-09-19T09:35:35.599 INFO:tasks.workunit.client.0.smithi112.stdout:8/889: dwrite d7/d10/d11/d50/fd1 [0,4194304] 0 2024-09-19T09:35:35.599 INFO:tasks.workunit.client.0.smithi112.stdout:8/890: chown d7/db/d21/d2e/d8c/d97/dc3/dc9 1495420763 1 2024-09-19T09:35:35.605 INFO:tasks.workunit.client.0.smithi112.stdout:8/891: creat d7/db/d21/d2e/d8c/d97/dc3/dc9/de6/f11c x:0 0 0 2024-09-19T09:35:35.605 INFO:tasks.workunit.client.0.smithi112.stdout:8/892: fdatasync d7/d10/d11/f37 0 2024-09-19T09:35:35.605 INFO:tasks.workunit.client.0.smithi112.stdout:8/893: read d7/db/d21/d2e/d8c/f8f [564286,68906] 0 2024-09-19T09:35:35.605 INFO:tasks.workunit.client.0.smithi112.stdout:8/894: dread - d7/d10/d11/d50/ddd/f101 zero size 2024-09-19T09:35:35.607 INFO:tasks.workunit.client.0.smithi112.stdout:0/802: dwrite d2/d59/da1/dd4/d95/db5/f1c [0,4194304] 0 2024-09-19T09:35:35.608 INFO:tasks.workunit.client.0.smithi112.stdout:0/803: getdents d2/d59/da1/dd4/db8 0 2024-09-19T09:35:35.608 INFO:tasks.workunit.client.0.smithi112.stdout:0/804: creat d2/f110 x:0 0 0 2024-09-19T09:35:35.608 INFO:tasks.workunit.client.0.smithi112.stdout:0/805: truncate d2/d6e/d6f/fdd 711314 0 2024-09-19T09:35:35.612 INFO:tasks.workunit.client.0.smithi112.stdout:9/657: dread df/d11/d14/f2e [0,4194304] 0 2024-09-19T09:35:35.612 INFO:tasks.workunit.client.0.smithi112.stdout:9/658: chown df/d11/d14/d19/d1e/l55 299 1 2024-09-19T09:35:35.613 INFO:tasks.workunit.client.0.smithi112.stdout:9/659: mkdir df/d11/d14/d19/d40/daf/dec 0 2024-09-19T09:35:35.623 INFO:tasks.workunit.client.0.smithi112.stdout:1/823: dwrite dc/f20 [0,4194304] 0 2024-09-19T09:35:35.624 INFO:tasks.workunit.client.0.smithi112.stdout:3/943: dwrite d8/d15/d1b/d1c/d68/d33/d7b/ff1 [0,4194304] 0 2024-09-19T09:35:35.628 INFO:tasks.workunit.client.0.smithi112.stdout:9/660: read df/d11/d14/f2d [4169926,91048] 0 2024-09-19T09:35:35.628 INFO:tasks.workunit.client.0.smithi112.stdout:9/661: readlink df/d11/d14/d19/d66/l46 0 2024-09-19T09:35:35.648 INFO:tasks.workunit.client.0.smithi112.stdout:3/944: dwrite d8/d48/faf [0,4194304] 0 2024-09-19T09:35:35.649 INFO:tasks.workunit.client.0.smithi112.stdout:1/824: dwrite dc/d26/d34/d4c/f54 [0,4194304] 0 2024-09-19T09:35:35.654 INFO:tasks.workunit.client.0.smithi112.stdout:3/945: mkdir d8/d15/d1b/d1c/d68/d33/d83/de4/de0/d142 0 2024-09-19T09:35:35.656 INFO:tasks.workunit.client.0.smithi112.stdout:1/825: truncate dc/d13/f1b 257124 0 2024-09-19T09:35:35.657 INFO:tasks.workunit.client.0.smithi112.stdout:3/946: mkdir d8/d15/d1b/d1c/d68/d33/d6f/d143 0 2024-09-19T09:35:35.666 INFO:tasks.workunit.client.0.smithi112.stdout:8/895: truncate d7/d10/d11/d50/fd1 2525673 0 2024-09-19T09:35:35.671 INFO:tasks.workunit.client.0.smithi112.stdout:1/826: write dc/d59/d73/f79 [4121792,14511] 0 2024-09-19T09:35:35.672 INFO:tasks.workunit.client.0.smithi112.stdout:1/827: mkdir dc/d59/de7/dfc 0 2024-09-19T09:35:35.672 INFO:tasks.workunit.client.0.smithi112.stdout:1/828: dread - dc/d26/d34/d36/d68/d7d/d6a/db4/fb5 zero size 2024-09-19T09:35:35.678 INFO:tasks.workunit.client.0.smithi112.stdout:3/947: dwrite d8/d15/d1b/d1c/d68/d33/d66/fa2 [0,4194304] 0 2024-09-19T09:35:35.678 INFO:tasks.workunit.client.0.smithi112.stdout:3/948: chown d8/d105/f117 146460904 1 2024-09-19T09:35:35.852 INFO:tasks.workunit.client.0.smithi112.stdout:8/896: rename d7/d10/d11/d50/fd1 to d7/db/d21/f11d 0 2024-09-19T09:35:35.853 INFO:tasks.workunit.client.0.smithi112.stdout:1/829: rename dc/l91 to dc/d26/d34/d36/d68/d7d/d6a/dac/lfd 0 2024-09-19T09:35:35.855 INFO:tasks.workunit.client.0.smithi112.stdout:3/949: rename d8/d15/d1b/d1c/d68/db9/c126 to d8/d15/d1b/d1c/d43/d4f/c144 0 2024-09-19T09:35:35.857 INFO:tasks.workunit.client.0.smithi112.stdout:3/950: getdents d8/d15/d1b/d1c 0 2024-09-19T09:35:35.859 INFO:tasks.workunit.client.0.smithi112.stdout:3/951: link d8/f93 d8/d15/d1b/d1c/d68/d33/d83/de4/de0/f145 0 2024-09-19T09:35:35.860 INFO:tasks.workunit.client.0.smithi112.stdout:3/952: mknod d8/d15/d1b/d1c/d43/c146 0 2024-09-19T09:35:35.861 INFO:tasks.workunit.client.0.smithi112.stdout:3/953: write d8/d15/d1b/d1c/d68/d33/d6f/fd2 [781791,44047] 0 2024-09-19T09:35:35.861 INFO:tasks.workunit.client.0.smithi112.stdout:1/830: write dc/fd [3473155,21868] 0 2024-09-19T09:35:35.861 INFO:tasks.workunit.client.0.smithi112.stdout:3/954: creat d8/d15/d1b/d1c/d68/d33/d6f/f147 x:0 0 0 2024-09-19T09:35:35.862 INFO:tasks.workunit.client.0.smithi112.stdout:1/831: rename dc/d26/d34/d36/d68/dc1/lca to dc/d26/d34/d4c/d55/lfe 0 2024-09-19T09:35:35.862 INFO:tasks.workunit.client.0.smithi112.stdout:1/832: write dc/d13/f1b [1065219,42611] 0 2024-09-19T09:35:35.863 INFO:tasks.workunit.client.0.smithi112.stdout:3/955: mkdir d8/d15/d1b/d1c/db5/d101/dfb/d132/d148 0 2024-09-19T09:35:35.871 INFO:tasks.workunit.client.0.smithi112.stdout:8/897: dwrite d7/db/d21/d3b/d56/d48/fa8 [0,4194304] 0 2024-09-19T09:35:35.871 INFO:tasks.workunit.client.0.smithi112.stdout:8/898: dread - d7/d10/d11/d50/f82 zero size 2024-09-19T09:35:35.892 INFO:tasks.workunit.client.0.smithi112.stdout:1/833: dwrite dc/d26/d34/d4c/fe2 [0,4194304] 0 2024-09-19T09:35:35.892 INFO:tasks.workunit.client.0.smithi112.stdout:3/956: dwrite f7 [0,4194304] 0 2024-09-19T09:35:35.892 INFO:tasks.workunit.client.0.smithi112.stdout:3/957: stat d8/d15/d1b/d1c/d27 0 2024-09-19T09:35:36.021 INFO:tasks.workunit.client.0.smithi112.stdout:1/834: symlink dc/d24/lff 0 2024-09-19T09:35:36.023 INFO:tasks.workunit.client.0.smithi112.stdout:3/958: truncate d8/d15/d1b/d1c/d68/d33/f57 3620451 0 2024-09-19T09:35:36.023 INFO:tasks.workunit.client.0.smithi112.stdout:3/959: chown d8/d15/d1b/d1c/d68/d33/d83/de4/fb6 4525782 1 2024-09-19T09:35:36.029 INFO:tasks.workunit.client.0.smithi112.stdout:1/835: write dc/d13/f51 [4486416,28130] 0 2024-09-19T09:35:36.033 INFO:tasks.workunit.client.0.smithi112.stdout:3/960: unlink d8/f93 0 2024-09-19T09:35:36.033 INFO:tasks.workunit.client.0.smithi112.stdout:3/961: chown d8/d15/d1b/d1c/d27/d62/d99/lfe 0 1 2024-09-19T09:35:36.049 INFO:tasks.workunit.client.0.smithi112.stdout:1/836: rename dc/d24/d45/f7a to dc/d26/d34/d4c/de8/f100 0 2024-09-19T09:35:36.051 INFO:tasks.workunit.client.0.smithi112.stdout:1/837: rmdir dc/d13 39 2024-09-19T09:35:36.051 INFO:tasks.workunit.client.0.smithi112.stdout:1/838: truncate dc/d26/d34/f97 2914346 0 2024-09-19T09:35:36.052 INFO:tasks.workunit.client.0.smithi112.stdout:1/839: creat dc/d26/d34/d36/d68/d9f/dd1/f101 x:0 0 0 2024-09-19T09:35:36.061 INFO:tasks.workunit.client.0.smithi112.stdout:1/840: dread dc/d26/d34/d36/d68/fcb [0,4194304] 0 2024-09-19T09:35:36.063 INFO:tasks.workunit.client.0.smithi112.stdout:1/841: creat dc/d59/d73/d88/f102 x:0 0 0 2024-09-19T09:35:36.063 INFO:tasks.workunit.client.0.smithi112.stdout:1/842: fsync dc/d24/f50 0 2024-09-19T09:35:36.069 INFO:tasks.workunit.client.0.smithi112.stdout:1/843: rmdir dc/d59/d73/d88 39 2024-09-19T09:35:36.071 INFO:tasks.workunit.client.0.smithi112.stdout:1/844: creat dc/d26/d34/d36/d68/d7d/d6a/db4/f103 x:0 0 0 2024-09-19T09:35:36.072 INFO:tasks.workunit.client.0.smithi112.stdout:1/845: mknod dc/d26/d34/d36/d68/d7d/d6a/dac/c104 0 2024-09-19T09:35:36.074 INFO:tasks.workunit.client.0.smithi112.stdout:1/846: creat dc/d24/d45/d94/f105 x:0 0 0 2024-09-19T09:35:36.074 INFO:tasks.workunit.client.0.smithi112.stdout:1/847: read - dc/d59/d73/d88/da5/fed zero size 2024-09-19T09:35:36.076 INFO:tasks.workunit.client.0.smithi112.stdout:1/848: rename dc/d24/da2/fb0 to dc/d26/d34/d36/d68/d9f/f106 0 2024-09-19T09:35:36.076 INFO:tasks.workunit.client.0.smithi112.stdout:1/849: read - dc/d26/fe3 zero size 2024-09-19T09:35:36.076 INFO:tasks.workunit.client.0.smithi112.stdout:1/850: dread - dc/d59/d73/d88/da5/fed zero size 2024-09-19T09:35:36.077 INFO:tasks.workunit.client.0.smithi112.stdout:1/851: symlink dc/d26/d34/l107 0 2024-09-19T09:35:36.078 INFO:tasks.workunit.client.0.smithi112.stdout:1/852: mknod dc/d24/d45/d94/deb/c108 0 2024-09-19T09:35:36.080 INFO:tasks.workunit.client.0.smithi112.stdout:1/853: rmdir dc/d59 39 2024-09-19T09:35:36.080 INFO:tasks.workunit.client.0.smithi112.stdout:1/854: readlink dc/d26/l38 0 2024-09-19T09:35:36.081 INFO:tasks.workunit.client.0.smithi112.stdout:1/855: mknod dc/d26/d34/d36/d68/d7d/d6a/db4/c109 0 2024-09-19T09:35:36.081 INFO:tasks.workunit.client.0.smithi112.stdout:1/856: chown dc/d26/d34/l35 5 1 2024-09-19T09:35:36.081 INFO:tasks.workunit.client.0.smithi112.stdout:1/857: truncate dc/d24/d45/d94/dbc/fdf 513285 0 2024-09-19T09:35:36.082 INFO:tasks.workunit.client.0.smithi112.stdout:1/858: getdents dc/d26/d34/d36/d68/db7 0 2024-09-19T09:35:36.082 INFO:tasks.workunit.client.0.smithi112.stdout:1/859: dread - dc/d26/d44/d63/dee/ff3 zero size 2024-09-19T09:35:36.098 INFO:tasks.workunit.client.0.smithi112.stdout:1/860: dwrite dc/d26/fe3 [0,4194304] 0 2024-09-19T09:35:36.100 INFO:tasks.workunit.client.0.smithi112.stdout:1/861: rmdir dc/d26/d34/d4c/de8 39 2024-09-19T09:35:36.102 INFO:tasks.workunit.client.0.smithi112.stdout:1/862: rename dc/d26/ccf to dc/d26/d34/d6f/c10a 0 2024-09-19T09:35:36.104 INFO:tasks.workunit.client.0.smithi112.stdout:1/863: unlink dc/d26/d44/d63/l9d 0 2024-09-19T09:35:36.119 INFO:tasks.workunit.client.0.smithi112.stdout:1/864: dwrite dc/d26/d34/f77 [0,4194304] 0 2024-09-19T09:35:36.120 INFO:tasks.workunit.client.0.smithi112.stdout:1/865: dread dc/d24/d45/d94/dbc/fdf [0,4194304] 0 2024-09-19T09:35:36.121 INFO:tasks.workunit.client.0.smithi112.stdout:1/866: chown dc/c1a 4 1 2024-09-19T09:35:36.121 INFO:tasks.workunit.client.0.smithi112.stdout:1/867: truncate dc/fe 5620306 0 2024-09-19T09:35:36.122 INFO:tasks.workunit.client.0.smithi112.stdout:1/868: creat dc/d24/d45/d94/deb/f10b x:0 0 0 2024-09-19T09:35:36.142 INFO:tasks.workunit.client.0.smithi112.stdout:1/869: dwrite dc/d26/d44/ff6 [0,4194304] 0 2024-09-19T09:35:36.155 INFO:tasks.workunit.client.0.smithi112.stdout:1/870: dwrite dc/d24/d45/d94/fb9 [0,4194304] 0 2024-09-19T09:35:36.164 INFO:tasks.workunit.client.0.smithi112.stdout:1/871: dread dc/d26/f29 [0,4194304] 0 2024-09-19T09:35:36.164 INFO:tasks.workunit.client.0.smithi112.stdout:1/872: fdatasync dc/d26/f29 0 2024-09-19T09:35:36.164 INFO:tasks.workunit.client.0.smithi112.stdout:1/873: chown dc/d26/d34/d36/d68/ffb 254112 1 2024-09-19T09:35:36.164 INFO:tasks.workunit.client.0.smithi112.stdout:1/874: getdents dc/d59 0 2024-09-19T09:35:36.180 INFO:tasks.workunit.client.0.smithi112.stdout:1/875: dwrite dc/d26/d34/d36/fe9 [0,4194304] 0 2024-09-19T09:35:36.183 INFO:tasks.workunit.client.0.smithi112.stdout:1/876: creat dc/f10c x:0 0 0 2024-09-19T09:35:36.186 INFO:tasks.workunit.client.0.smithi112.stdout:1/877: link dc/d24/f46 dc/d59/f10d 0 2024-09-19T09:35:36.187 INFO:tasks.workunit.client.0.smithi112.stdout:1/878: symlink dc/d24/l10e 0 2024-09-19T09:35:36.188 INFO:tasks.workunit.client.0.smithi112.stdout:1/879: creat dc/d26/d34/d4c/f10f x:0 0 0 2024-09-19T09:35:36.188 INFO:tasks.workunit.client.0.smithi112.stdout:1/880: readlink dc/d26/d34/d36/d68/db7/lba 0 2024-09-19T09:35:36.190 INFO:tasks.workunit.client.0.smithi112.stdout:1/881: getdents dc/d59/d73/d88/da5 0 2024-09-19T09:35:36.191 INFO:tasks.workunit.client.0.smithi112.stdout:1/882: mkdir dc/d110 0 2024-09-19T09:35:36.192 INFO:tasks.workunit.client.0.smithi112.stdout:1/883: getdents dc/d26/d34/d36/d68/d7d/dd5 0 2024-09-19T09:35:36.193 INFO:tasks.workunit.client.0.smithi112.stdout:1/884: readlink dc/d24/lff 0 2024-09-19T09:35:36.200 INFO:tasks.workunit.client.0.smithi112.stdout:1/885: dread dc/d26/d34/d36/d68/fc4 [0,4194304] 0 2024-09-19T09:35:36.200 INFO:tasks.workunit.client.0.smithi112.stdout:1/886: write dc/d24/d45/d94/f105 [302065,76246] 0 2024-09-19T09:35:36.200 INFO:tasks.workunit.client.0.smithi112.stdout:1/887: chown dc/d24/d45 2 1 2024-09-19T09:35:36.207 INFO:tasks.workunit.client.0.smithi112.stdout:1/888: read dc/d26/d34/d4c/f7e [1044030,25396] 0 2024-09-19T09:35:36.207 INFO:tasks.workunit.client.0.smithi112.stdout:1/889: symlink dc/d59/de7/l111 0 2024-09-19T09:35:36.213 INFO:tasks.workunit.client.0.smithi112.stdout:9/662: sync 2024-09-19T09:35:36.214 INFO:tasks.workunit.client.0.smithi112.stdout:0/806: sync 2024-09-19T09:35:36.214 INFO:tasks.workunit.client.0.smithi112.stdout:9/663: chown df/d11/d14/d19/d66/d99/lbe 589915 1 2024-09-19T09:35:36.214 INFO:tasks.workunit.client.0.smithi112.stdout:2/869: sync 2024-09-19T09:35:36.215 INFO:tasks.workunit.client.0.smithi112.stdout:0/807: rename d2/faf to d2/d59/da1/dd4/db8/deb/f111 0 2024-09-19T09:35:36.216 INFO:tasks.workunit.client.0.smithi112.stdout:1/890: dread dc/d26/d34/d36/d68/d7d/f7b [0,4194304] 0 2024-09-19T09:35:36.216 INFO:tasks.workunit.client.0.smithi112.stdout:2/870: creat d0/d1/d28/d9b/f11b x:0 0 0 2024-09-19T09:35:36.217 INFO:tasks.workunit.client.0.smithi112.stdout:9/664: mknod df/d11/d14/d19/dc0/ced 0 2024-09-19T09:35:36.217 INFO:tasks.workunit.client.0.smithi112.stdout:1/891: dread dc/d26/d34/d36/d68/f92 [0,4194304] 0 2024-09-19T09:35:36.220 INFO:tasks.workunit.client.0.smithi112.stdout:2/871: mknod d0/d3e/d50/d57/d80/d8b/c11c 0 2024-09-19T09:35:36.220 INFO:tasks.workunit.client.0.smithi112.stdout:2/872: truncate d0/d3e/d50/d57/d80/d8b/ff7 744143 0 2024-09-19T09:35:36.220 INFO:tasks.workunit.client.0.smithi112.stdout:2/873: chown d0/d1/d8a/f8e 909741381 1 2024-09-19T09:35:36.220 INFO:tasks.workunit.client.0.smithi112.stdout:2/874: dread - d0/d1/d28/f10a zero size 2024-09-19T09:35:36.221 INFO:tasks.workunit.client.0.smithi112.stdout:1/892: mkdir dc/d26/d44/d112 0 2024-09-19T09:35:36.221 INFO:tasks.workunit.client.0.smithi112.stdout:1/893: creat dc/d26/d34/d36/d68/d9f/dd1/f113 x:0 0 0 2024-09-19T09:35:36.222 INFO:tasks.workunit.client.0.smithi112.stdout:9/665: symlink df/d11/d14/d19/d40/daf/dec/lee 0 2024-09-19T09:35:36.222 INFO:tasks.workunit.client.0.smithi112.stdout:9/666: dread - df/d11/d14/d19/d40/daf/d6c/db3/fc3 zero size 2024-09-19T09:35:36.222 INFO:tasks.workunit.client.0.smithi112.stdout:9/667: write df/d11/f74 [5233667,63398] 0 2024-09-19T09:35:36.223 INFO:tasks.workunit.client.0.smithi112.stdout:9/668: chown df/d11/d14/d19/d40/daf/d6c/db3/f9c 8150225 1 2024-09-19T09:35:36.223 INFO:tasks.workunit.client.0.smithi112.stdout:2/875: dread d0/d1/d5f/fff [0,4194304] 0 2024-09-19T09:35:36.225 INFO:tasks.workunit.client.0.smithi112.stdout:1/894: truncate dc/d24/f52 902103 0 2024-09-19T09:35:36.226 INFO:tasks.workunit.client.0.smithi112.stdout:1/895: dread dc/d24/d45/d94/dbc/fdf [0,4194304] 0 2024-09-19T09:35:36.226 INFO:tasks.workunit.client.0.smithi112.stdout:9/669: symlink df/dc1/lef 0 2024-09-19T09:35:36.228 INFO:tasks.workunit.client.0.smithi112.stdout:9/670: mknod df/d11/d14/d19/d40/daf/d6c/db3/cf0 0 2024-09-19T09:35:36.230 INFO:tasks.workunit.client.0.smithi112.stdout:9/671: truncate fc 4793928 0 2024-09-19T09:35:36.230 INFO:tasks.workunit.client.0.smithi112.stdout:9/672: creat df/d11/d14/d19/d40/d5c/ff1 x:0 0 0 2024-09-19T09:35:36.233 INFO:tasks.workunit.client.0.smithi112.stdout:2/876: dread d0/d3e/d50/f6a [0,4194304] 0 2024-09-19T09:35:36.233 INFO:tasks.workunit.client.0.smithi112.stdout:2/877: write d0/d1/d28/d67/fce [252866,19396] 0 2024-09-19T09:35:36.236 INFO:tasks.workunit.client.0.smithi112.stdout:1/896: dread dc/d13/f18 [0,4194304] 0 2024-09-19T09:35:36.237 INFO:tasks.workunit.client.0.smithi112.stdout:1/897: link dc/d26/d34/d36/d68/db7/ff7 dc/d26/d34/d4c/d55/f114 0 2024-09-19T09:35:36.238 INFO:tasks.workunit.client.0.smithi112.stdout:1/898: link dc/d24/d45/d94/deb/c108 dc/d26/d34/d4c/d64/c115 0 2024-09-19T09:35:36.242 INFO:tasks.workunit.client.0.smithi112.stdout:0/808: dwrite d2/d6e/da0/f7b [0,4194304] 0 2024-09-19T09:35:36.244 INFO:tasks.workunit.client.0.smithi112.stdout:0/809: link d2/d39/d3b/dab/fb6 d2/d39/d3b/d8a/f112 0 2024-09-19T09:35:36.245 INFO:tasks.workunit.client.0.smithi112.stdout:0/810: mkdir d2/d39/d3b/d8a/d113 0 2024-09-19T09:35:36.245 INFO:tasks.workunit.client.0.smithi112.stdout:1/899: dread dc/d13/f1c [0,4194304] 0 2024-09-19T09:35:36.247 INFO:tasks.workunit.client.0.smithi112.stdout:0/811: creat d2/d59/da1/dd4/db8/deb/f114 x:0 0 0 2024-09-19T09:35:36.250 INFO:tasks.workunit.client.0.smithi112.stdout:2/878: read d0/d1/f1f [735381,122434] 0 2024-09-19T09:35:36.250 INFO:tasks.workunit.client.0.smithi112.stdout:2/879: getdents d0/d6/d24/d96 0 2024-09-19T09:35:36.252 INFO:tasks.workunit.client.0.smithi112.stdout:2/880: symlink d0/d1/d5f/d78/db0/d9a/dae/d11a/l11d 0 2024-09-19T09:35:36.255 INFO:tasks.workunit.client.0.smithi112.stdout:2/881: truncate d0/d3e/d50/d57/d5a/f87 958054 0 2024-09-19T09:35:36.255 INFO:tasks.workunit.client.0.smithi112.stdout:2/882: chown d0/d1/d28/ldf 32634886 1 2024-09-19T09:35:36.256 INFO:tasks.workunit.client.0.smithi112.stdout:2/883: creat d0/d4a/f11e x:0 0 0 2024-09-19T09:35:36.256 INFO:tasks.workunit.client.0.smithi112.stdout:9/673: dwrite df/d11/d14/d19/d40/daf/d6c/db3/d9e/fa9 [0,4194304] 0 2024-09-19T09:35:36.256 INFO:tasks.workunit.client.0.smithi112.stdout:9/674: write df/d11/d14/d19/d40/daf/d6c/f80 [5186356,104915] 0 2024-09-19T09:35:36.261 INFO:tasks.workunit.client.0.smithi112.stdout:2/884: creat d0/d1/f11f x:0 0 0 2024-09-19T09:35:36.267 INFO:tasks.workunit.client.0.smithi112.stdout:9/675: dread df/d11/d14/d19/d40/daf/f92 [0,4194304] 0 2024-09-19T09:35:36.287 INFO:tasks.workunit.client.0.smithi112.stdout:9/676: dwrite df/d11/d14/d19/d40/daf/f6f [0,4194304] 0 2024-09-19T09:35:36.287 INFO:tasks.workunit.client.0.smithi112.stdout:2/885: dwrite d0/d1/d5f/fff [0,4194304] 0 2024-09-19T09:35:36.298 INFO:tasks.workunit.client.0.smithi112.stdout:2/886: dread d0/d1/d28/f31 [0,4194304] 0 2024-09-19T09:35:36.298 INFO:tasks.workunit.client.0.smithi112.stdout:2/887: write d0/d1/ded/f112 [411944,64905] 0 2024-09-19T09:35:36.302 INFO:tasks.workunit.client.0.smithi112.stdout:9/677: dwrite df/d11/d14/d19/d1e/f88 [4194304,4194304] 0 2024-09-19T09:35:36.302 INFO:tasks.workunit.client.0.smithi112.stdout:9/678: write df/d11/d14/d19/d40/d5c/fbc [503738,36547] 0 2024-09-19T09:35:36.310 INFO:tasks.workunit.client.0.smithi112.stdout:9/679: mkdir df/d11/d14/d19/d40/daf/d6c/db3/d9e/df2 0 2024-09-19T09:35:36.310 INFO:tasks.workunit.client.0.smithi112.stdout:9/680: dread - df/d11/d14/d19/d1e/d97/fb2 zero size 2024-09-19T09:35:36.317 INFO:tasks.workunit.client.0.smithi112.stdout:2/888: dwrite d0/d1/f11f [0,4194304] 0 2024-09-19T09:35:36.322 INFO:tasks.workunit.client.0.smithi112.stdout:2/889: symlink d0/d3e/d50/d57/d5a/d56/d109/l120 0 2024-09-19T09:35:36.324 INFO:tasks.workunit.client.0.smithi112.stdout:2/890: symlink d0/d1/d5f/dc6/l121 0 2024-09-19T09:35:36.324 INFO:tasks.workunit.client.0.smithi112.stdout:2/891: write d0/d1/d28/d67/f70 [1293165,27717] 0 2024-09-19T09:35:36.325 INFO:tasks.workunit.client.0.smithi112.stdout:2/892: readlink d0/d3e/d50/d57/d80/lbd 0 2024-09-19T09:35:36.325 INFO:tasks.workunit.client.0.smithi112.stdout:2/893: fsync d0/d3e/d50/d57/d5a/d56/fca 0 2024-09-19T09:35:36.325 INFO:tasks.workunit.client.0.smithi112.stdout:2/894: fsync d0/d1/d8a/ddd/fe7 0 2024-09-19T09:35:36.325 INFO:tasks.workunit.client.0.smithi112.stdout:8/899: sync 2024-09-19T09:35:36.325 INFO:tasks.workunit.client.0.smithi112.stdout:3/962: sync 2024-09-19T09:35:36.325 INFO:tasks.workunit.client.0.smithi112.stdout:8/900: write d7/d10/d11/d62/dd2/f11a [127454,25783] 0 2024-09-19T09:35:36.327 INFO:tasks.workunit.client.0.smithi112.stdout:2/895: rmdir d0/d6 39 2024-09-19T09:35:36.327 INFO:tasks.workunit.client.0.smithi112.stdout:2/896: write d0/d3e/fdc [812199,25565] 0 2024-09-19T09:35:36.327 INFO:tasks.workunit.client.0.smithi112.stdout:2/897: chown d0/d6/c1a 26 1 2024-09-19T09:35:36.327 INFO:tasks.workunit.client.0.smithi112.stdout:2/898: write d0/d3e/d50/d57/d5a/d27/f89 [661022,114023] 0 2024-09-19T09:35:36.327 INFO:tasks.workunit.client.0.smithi112.stdout:2/899: chown d0/d3e/d50/d57/d5a/d56/ff8 6736436 1 2024-09-19T09:35:36.327 INFO:tasks.workunit.client.0.smithi112.stdout:8/901: mknod d7/db/d21/d3b/d56/d4b/d5b/c11e 0 2024-09-19T09:35:36.329 INFO:tasks.workunit.client.0.smithi112.stdout:2/900: creat d0/d1/f122 x:0 0 0 2024-09-19T09:35:36.329 INFO:tasks.workunit.client.0.smithi112.stdout:2/901: truncate d0/d1/d5f/fb7 675406 0 2024-09-19T09:35:36.333 INFO:tasks.workunit.client.0.smithi112.stdout:8/902: unlink d7/d10/d11/d50/ddd/lcb 0 2024-09-19T09:35:36.333 INFO:tasks.workunit.client.0.smithi112.stdout:8/903: chown d7/d10/fe8 16235997 1 2024-09-19T09:35:36.334 INFO:tasks.workunit.client.0.smithi112.stdout:8/904: chown d7/db/d21/d3b/d56/d4b/d5b/c11e 31977 1 2024-09-19T09:35:36.334 INFO:tasks.workunit.client.0.smithi112.stdout:8/905: stat d7/db/d21/d3b/d56/d3c/d79/ff5 0 2024-09-19T09:35:36.335 INFO:tasks.workunit.client.0.smithi112.stdout:2/902: rename d0/d3e/d50/d57/d80/lbd to d0/d1/d5f/l123 0 2024-09-19T09:35:36.335 INFO:tasks.workunit.client.0.smithi112.stdout:2/903: truncate d0/d1/d8a/f8e 683569 0 2024-09-19T09:35:36.335 INFO:tasks.workunit.client.0.smithi112.stdout:2/904: write d0/d3e/d50/d57/f113 [332615,130335] 0 2024-09-19T09:35:36.336 INFO:tasks.workunit.client.0.smithi112.stdout:8/906: mkdir d7/db/d21/d2e/d8c/dc0/d11f 0 2024-09-19T09:35:36.336 INFO:tasks.workunit.client.0.smithi112.stdout:8/907: truncate d7/db/d21/d3b/dd8/f119 965836 0 2024-09-19T09:35:36.336 INFO:tasks.workunit.client.0.smithi112.stdout:8/908: fsync d7/db/d21/d3b/d56/d3c/d79/ffd 0 2024-09-19T09:35:36.337 INFO:tasks.workunit.client.0.smithi112.stdout:2/905: symlink d0/d3e/d61/l124 0 2024-09-19T09:35:36.337 INFO:tasks.workunit.client.0.smithi112.stdout:8/909: truncate d7/d10/d11/f96 344224 0 2024-09-19T09:35:36.339 INFO:tasks.workunit.client.0.smithi112.stdout:2/906: rmdir d0/d3e/d49 39 2024-09-19T09:35:36.340 INFO:tasks.workunit.client.0.smithi112.stdout:2/907: mknod d0/d1/dd3/c125 0 2024-09-19T09:35:36.342 INFO:tasks.workunit.client.0.smithi112.stdout:2/908: mkdir d0/d3e/d50/d57/d80/d8b/d126 0 2024-09-19T09:35:36.342 INFO:tasks.workunit.client.0.smithi112.stdout:2/909: stat d0/d3e/d50/d57/dac/fb6 0 2024-09-19T09:35:36.342 INFO:tasks.workunit.client.0.smithi112.stdout:2/910: read d0/d3e/d49/fbf [668082,60388] 0 2024-09-19T09:35:36.344 INFO:tasks.workunit.client.0.smithi112.stdout:2/911: unlink d0/d1/d28/ldf 0 2024-09-19T09:35:36.356 INFO:tasks.workunit.client.0.smithi112.stdout:8/910: dwrite d7/db/d21/f24 [0,4194304] 0 2024-09-19T09:35:36.359 INFO:tasks.workunit.client.0.smithi112.stdout:8/911: mkdir d7/d10/d120 0 2024-09-19T09:35:36.361 INFO:tasks.workunit.client.0.smithi112.stdout:8/912: mkdir d7/db/d21/d3b/d56/d48/d121 0 2024-09-19T09:35:36.363 INFO:tasks.workunit.client.0.smithi112.stdout:8/913: rename d7/db/d21/d72/c80 to d7/db/d21/d3b/d56/d10c/c122 0 2024-09-19T09:35:36.364 INFO:tasks.workunit.client.0.smithi112.stdout:2/912: dwrite d0/d1/f1f [0,4194304] 0 2024-09-19T09:35:36.365 INFO:tasks.workunit.client.0.smithi112.stdout:8/914: unlink d7/d67/f5d 0 2024-09-19T09:35:36.366 INFO:tasks.workunit.client.0.smithi112.stdout:2/913: creat d0/d3e/d50/d57/d80/d8b/d126/f127 x:0 0 0 2024-09-19T09:35:36.367 INFO:tasks.workunit.client.0.smithi112.stdout:8/915: truncate d7/ff 2192426 0 2024-09-19T09:35:36.369 INFO:tasks.workunit.client.0.smithi112.stdout:2/914: mkdir d0/d6/d128 0 2024-09-19T09:35:36.369 INFO:tasks.workunit.client.0.smithi112.stdout:2/915: creat d0/d4a/f129 x:0 0 0 2024-09-19T09:35:36.370 INFO:tasks.workunit.client.0.smithi112.stdout:8/916: creat d7/db/d21/d3b/f123 x:0 0 0 2024-09-19T09:35:36.370 INFO:tasks.workunit.client.0.smithi112.stdout:8/917: dread - d7/db/d21/d2e/d8c/d97/dc3/dc9/de6/f11c zero size 2024-09-19T09:35:36.372 INFO:tasks.workunit.client.0.smithi112.stdout:2/916: rename d0/d1/d28/d67 to d0/d1/d5f/d12a 0 2024-09-19T09:35:36.373 INFO:tasks.workunit.client.0.smithi112.stdout:2/917: mkdir d0/d3e/d50/d57/d5a/d12b 0 2024-09-19T09:35:36.373 INFO:tasks.workunit.client.0.smithi112.stdout:2/918: fsync d0/d1/d5f/d78/f91 0 2024-09-19T09:35:36.385 INFO:tasks.workunit.client.0.smithi112.stdout:8/918: dwrite d7/d10/d11/ff8 [0,4194304] 0 2024-09-19T09:35:36.389 INFO:tasks.workunit.client.0.smithi112.stdout:2/919: write d0/d3e/d50/f71 [1979332,19609] 0 2024-09-19T09:35:36.389 INFO:tasks.workunit.client.0.smithi112.stdout:2/920: readlink d0/d1/d5f/d78/db0/d9a/dae/lf3 0 2024-09-19T09:35:36.407 INFO:tasks.workunit.client.0.smithi112.stdout:8/919: dwrite d7/db/d21/f4e [0,4194304] 0 2024-09-19T09:35:36.407 INFO:tasks.workunit.client.0.smithi112.stdout:2/921: write d0/d3e/d50/d57/dac/fb6 [3341672,129374] 0 2024-09-19T09:35:36.409 INFO:tasks.workunit.client.0.smithi112.stdout:8/920: link d7/db/d21/d3b/d56/d48/cbc d7/d10/d11/c124 0 2024-09-19T09:35:36.422 INFO:tasks.workunit.client.0.smithi112.stdout:2/922: dwrite d0/d1/d28/d9b/fdb [0,4194304] 0 2024-09-19T09:35:36.423 INFO:tasks.workunit.client.0.smithi112.stdout:2/923: mkdir d0/d3e/d50/d57/d5a/d56/d109/d106/d12c 0 2024-09-19T09:35:36.424 INFO:tasks.workunit.client.0.smithi112.stdout:2/924: creat d0/d1/d5f/d78/db0/d9a/d107/f12d x:0 0 0 2024-09-19T09:35:36.425 INFO:tasks.workunit.client.0.smithi112.stdout:2/925: write d0/d4a/f11e [427401,43920] 0 2024-09-19T09:35:36.425 INFO:tasks.workunit.client.0.smithi112.stdout:2/926: getdents d0/d1/d28/d88 0 2024-09-19T09:35:36.427 INFO:tasks.workunit.client.0.smithi112.stdout:2/927: truncate d0/d3e/d50/d57/d5a/d56/f68 3544717 0 2024-09-19T09:35:36.427 INFO:tasks.workunit.client.0.smithi112.stdout:2/928: fdatasync d0/d3e/d61/f6c 0 2024-09-19T09:35:36.429 INFO:tasks.workunit.client.0.smithi112.stdout:2/929: mknod d0/d1/c12e 0 2024-09-19T09:35:36.429 INFO:tasks.workunit.client.0.smithi112.stdout:2/930: stat d0/d3e/d50/l9c 0 2024-09-19T09:35:36.429 INFO:tasks.workunit.client.0.smithi112.stdout:2/931: readlink d0/d1/d5f/d78/le0 0 2024-09-19T09:35:36.436 INFO:tasks.workunit.client.0.smithi112.stdout:2/932: write d0/d3e/d50/d57/d5a/d56/fca [1725857,83074] 0 2024-09-19T09:35:36.439 INFO:tasks.workunit.client.0.smithi112.stdout:2/933: creat d0/d3e/d50/d57/d5a/d27/f12f x:0 0 0 2024-09-19T09:35:36.448 INFO:tasks.workunit.client.0.smithi112.stdout:2/934: dread d0/d1/d5f/d78/db0/f53 [0,4194304] 0 2024-09-19T09:35:36.465 INFO:tasks.workunit.client.0.smithi112.stdout:2/935: dwrite d0/d6/d24/fd0 [4194304,4194304] 0 2024-09-19T09:35:36.465 INFO:tasks.workunit.client.0.smithi112.stdout:2/936: write d0/d3e/d61/f63 [5339699,19401] 0 2024-09-19T09:35:36.466 INFO:tasks.workunit.client.0.smithi112.stdout:2/937: link d0/d1/d5f/d78/f7b d0/d1/d5f/d12a/f130 0 2024-09-19T09:35:36.468 INFO:tasks.workunit.client.0.smithi112.stdout:2/938: symlink d0/d1/d5f/dc6/d101/df2/l131 0 2024-09-19T09:35:36.468 INFO:tasks.workunit.client.0.smithi112.stdout:2/939: creat d0/d3e/d50/f132 x:0 0 0 2024-09-19T09:35:36.469 INFO:tasks.workunit.client.0.smithi112.stdout:2/940: creat d0/d3e/d50/d57/d5a/d4f/f133 x:0 0 0 2024-09-19T09:35:36.470 INFO:tasks.workunit.client.0.smithi112.stdout:2/941: stat d0/d3e/d50/d57/d5a/d27/l54 0 2024-09-19T09:35:36.471 INFO:tasks.workunit.client.0.smithi112.stdout:2/942: rmdir d0/d6/d24 39 2024-09-19T09:35:36.471 INFO:tasks.workunit.client.0.smithi112.stdout:2/943: readlink d0/d1/d5f/d78/lc1 0 2024-09-19T09:35:36.473 INFO:tasks.workunit.client.0.smithi112.stdout:2/944: rename d0/d6/d24/d96/fcb to d0/d1/dd3/f134 0 2024-09-19T09:35:36.473 INFO:tasks.workunit.client.0.smithi112.stdout:2/945: stat d0/d1/d5f/d12a/f95 0 2024-09-19T09:35:36.473 INFO:tasks.workunit.client.0.smithi112.stdout:2/946: getdents d0/d3e/d50/d57/d5a/d10f 0 2024-09-19T09:35:36.473 INFO:tasks.workunit.client.0.smithi112.stdout:2/947: truncate d0/d3e/f66 1510247 0 2024-09-19T09:35:36.474 INFO:tasks.workunit.client.0.smithi112.stdout:2/948: creat d0/d3e/d50/d57/d5a/f135 x:0 0 0 2024-09-19T09:35:36.498 INFO:tasks.workunit.client.0.smithi112.stdout:2/949: dwrite d0/d1/d8a/fa1 [0,4194304] 0 2024-09-19T09:35:36.506 INFO:tasks.workunit.client.0.smithi112.stdout:2/950: rename d0/d1/f40 to d0/d6/d24/d96/f136 0 2024-09-19T09:35:36.508 INFO:tasks.workunit.client.0.smithi112.stdout:2/951: symlink d0/d1/d8a/ddd/l137 0 2024-09-19T09:35:36.510 INFO:tasks.workunit.client.0.smithi112.stdout:2/952: mkdir d0/d1/d8a/d138 0 2024-09-19T09:35:36.510 INFO:tasks.workunit.client.0.smithi112.stdout:2/953: creat d0/d3e/d50/d57/d80/d8b/d126/f139 x:0 0 0 2024-09-19T09:35:36.510 INFO:tasks.workunit.client.0.smithi112.stdout:2/954: chown d0/d3e/d50/d57/lfd 0 1 2024-09-19T09:35:36.514 INFO:tasks.workunit.client.0.smithi112.stdout:2/955: rmdir d0/d3e/d50/d57/dac 39 2024-09-19T09:35:36.515 INFO:tasks.workunit.client.0.smithi112.stdout:2/956: creat d0/d1/ded/f13a x:0 0 0 2024-09-19T09:35:36.516 INFO:tasks.workunit.client.0.smithi112.stdout:2/957: getdents d0/d6 0 2024-09-19T09:35:36.522 INFO:tasks.workunit.client.0.smithi112.stdout:2/958: dread d0/d1/dd3/f134 [0,4194304] 0 2024-09-19T09:35:36.530 INFO:tasks.workunit.client.0.smithi112.stdout:2/959: dread d0/d1/d5f/fff [0,4194304] 0 2024-09-19T09:35:36.539 INFO:tasks.workunit.client.0.smithi112.stdout:2/960: write d0/d1/d8a/fa1 [1391027,86200] 0 2024-09-19T09:35:36.539 INFO:tasks.workunit.client.0.smithi112.stdout:2/961: chown d0/d6/fb5 240254197 1 2024-09-19T09:35:36.539 INFO:tasks.workunit.client.0.smithi112.stdout:2/962: stat d0/d4a/cfe 0 2024-09-19T09:35:36.540 INFO:tasks.workunit.client.0.smithi112.stdout:2/963: rename d0/d1/d28/d9b/cc0 to d0/d3e/d50/d57/c13b 0 2024-09-19T09:35:36.541 INFO:tasks.workunit.client.0.smithi112.stdout:2/964: creat d0/d1/ded/f13c x:0 0 0 2024-09-19T09:35:36.541 INFO:tasks.workunit.client.0.smithi112.stdout:2/965: fdatasync d0/d3e/d50/d57/d5a/d27/f73 0 2024-09-19T09:35:36.541 INFO:tasks.workunit.client.0.smithi112.stdout:2/966: read - d0/d3e/d50/f132 zero size 2024-09-19T09:35:36.545 INFO:tasks.workunit.client.0.smithi112.stdout:2/967: creat d0/d1/d5f/d78/db0/f13d x:0 0 0 2024-09-19T09:35:36.545 INFO:tasks.workunit.client.0.smithi112.stdout:2/968: symlink d0/d3e/l13e 0 2024-09-19T09:35:36.545 INFO:tasks.workunit.client.0.smithi112.stdout:2/969: unlink d0/d1/d5f/d78/db0/d9a/d107/f12d 0 2024-09-19T09:35:36.560 INFO:tasks.workunit.client.0.smithi112.stdout:2/970: dwrite d0/d4a/f8c [0,4194304] 0 2024-09-19T09:35:36.563 INFO:tasks.workunit.client.0.smithi112.stdout:2/971: creat d0/d6/d128/f13f x:0 0 0 2024-09-19T09:35:36.563 INFO:tasks.workunit.client.0.smithi112.stdout:2/972: readlink d0/d6/l21 0 2024-09-19T09:35:36.566 INFO:tasks.workunit.client.0.smithi112.stdout:2/973: dread d0/d3e/d49/fbf [0,4194304] 0 2024-09-19T09:35:36.568 INFO:tasks.workunit.client.0.smithi112.stdout:2/974: rename d0/d1/d8a/ddd/fe7 to d0/d1/d5f/d78/db0/d9a/dae/d11a/f140 0 2024-09-19T09:35:36.569 INFO:tasks.workunit.client.0.smithi112.stdout:2/975: symlink d0/d6/d24/d96/l141 0 2024-09-19T09:35:36.569 INFO:tasks.workunit.client.0.smithi112.stdout:2/976: truncate d0/d6/d128/f13f 651655 0 2024-09-19T09:35:36.584 INFO:tasks.workunit.client.0.smithi112.stdout:2/977: dwrite d0/d4a/f11e [0,4194304] 0 2024-09-19T09:35:36.586 INFO:tasks.workunit.client.0.smithi112.stdout:2/978: symlink d0/d3e/d50/d57/d5a/l142 0 2024-09-19T09:35:36.586 INFO:tasks.workunit.client.0.smithi112.stdout:2/979: truncate d0/d1/ded/f112 959163 0 2024-09-19T09:35:36.587 INFO:tasks.workunit.client.0.smithi112.stdout:2/980: symlink d0/d1/d5f/d78/db0/d9a/l143 0 2024-09-19T09:35:36.587 INFO:tasks.workunit.client.0.smithi112.stdout:2/981: creat d0/d1/d5f/f144 x:0 0 0 2024-09-19T09:35:36.588 INFO:tasks.workunit.client.0.smithi112.stdout:2/982: mkdir d0/d1/d5f/d78/db0/d9a/dae/d145 0 2024-09-19T09:35:36.588 INFO:tasks.workunit.client.0.smithi112.stdout:2/983: creat d0/d1/d5f/d78/db0/dfc/f146 x:0 0 0 2024-09-19T09:35:36.593 INFO:tasks.workunit.client.0.smithi112.stdout:2/984: dread d0/d3e/d50/f71 [0,4194304] 0 2024-09-19T09:35:36.594 INFO:tasks.workunit.client.0.smithi112.stdout:2/985: creat d0/d1/d5f/d78/f147 x:0 0 0 2024-09-19T09:35:36.594 INFO:tasks.workunit.client.0.smithi112.stdout:2/986: dread - d0/d3e/d50/d57/d5a/d27/f12f zero size 2024-09-19T09:35:36.594 INFO:tasks.workunit.client.0.smithi112.stdout:2/987: write d0/d1/d5f/d78/db0/dfc/f111 [706597,83795] 0 2024-09-19T09:35:36.594 INFO:tasks.workunit.client.0.smithi112.stdout:2/988: fdatasync d0/d3e/d50/d57/d80/d8b/ff7 0 2024-09-19T09:35:36.595 INFO:tasks.workunit.client.0.smithi112.stdout:2/989: creat d0/d1/d5f/dc6/d101/f148 x:0 0 0 2024-09-19T09:35:36.595 INFO:tasks.workunit.client.0.smithi112.stdout:2/990: creat d0/d1/d5f/dc6/f149 x:0 0 0 2024-09-19T09:35:36.595 INFO:tasks.workunit.client.0.smithi112.stdout:2/991: read d0/d3e/d50/d57/f113 [455046,2183] 0 2024-09-19T09:35:36.597 INFO:tasks.workunit.client.0.smithi112.stdout:2/992: creat d0/d3e/d50/d57/d5a/d56/d109/f14a x:0 0 0 2024-09-19T09:35:36.619 INFO:tasks.workunit.client.0.smithi112.stdout:2/993: dwrite d0/d1/d8a/fa1 [0,4194304] 0 2024-09-19T09:35:36.621 INFO:tasks.workunit.client.0.smithi112.stdout:2/994: rename d0/d6/f62 to d0/d3e/d50/d57/d5a/d56/d109/d106/f14b 0 2024-09-19T09:35:36.622 INFO:tasks.workunit.client.0.smithi112.stdout:2/995: rename d0/d4a/f11e to d0/d4a/df5/f14c 0 2024-09-19T09:35:36.622 INFO:tasks.workunit.client.0.smithi112.stdout:2/996: write d0/d1/d5f/dc6/d101/f148 [802662,110566] 0 2024-09-19T09:35:36.624 INFO:tasks.workunit.client.0.smithi112.stdout:2/997: rename d0/d6/d24/fd0 to d0/d1/d8a/d138/f14d 0 2024-09-19T09:35:36.634 INFO:tasks.workunit.client.0.smithi112.stdout:2/998: write d0/d3e/d49/f4c [8238136,42093] 0 2024-09-19T09:35:36.634 INFO:tasks.workunit.client.0.smithi112.stdout:2/999: dread - d0/d1/f122 zero size 2024-09-19T09:35:36.803 INFO:tasks.workunit.client.0.smithi112.stdout:3/963: sync 2024-09-19T09:35:36.803 INFO:tasks.workunit.client.0.smithi112.stdout:8/921: sync 2024-09-19T09:35:36.804 INFO:tasks.workunit.client.0.smithi112.stdout:0/812: sync 2024-09-19T09:35:36.804 INFO:tasks.workunit.client.0.smithi112.stdout:1/900: sync 2024-09-19T09:35:36.804 INFO:tasks.workunit.client.0.smithi112.stdout:9/681: sync 2024-09-19T09:35:36.804 INFO:tasks.workunit.client.0.smithi112.stdout:8/922: chown d7/db/d21/d3b 1514 1 2024-09-19T09:35:36.804 INFO:tasks.workunit.client.0.smithi112.stdout:1/901: truncate dc/d59/d73/d88/da5/fab 4583394 0 2024-09-19T09:35:36.804 INFO:tasks.workunit.client.0.smithi112.stdout:0/813: creat d2/d59/da1/dd4/db8/deb/f115 x:0 0 0 2024-09-19T09:35:36.804 INFO:tasks.workunit.client.0.smithi112.stdout:0/814: readlink d2/d59/da1/dd4/d95/db5/l19 0 2024-09-19T09:35:36.804 INFO:tasks.workunit.client.0.smithi112.stdout:3/964: link d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/laa d8/d15/d1b/d1c/d27/d62/d99/l149 0 2024-09-19T09:35:36.805 INFO:tasks.workunit.client.0.smithi112.stdout:0/815: write d2/d45/f4d [207985,71911] 0 2024-09-19T09:35:36.806 INFO:tasks.workunit.client.0.smithi112.stdout:3/965: dread d8/d15/d1b/d1c/d68/d33/d6f/f7f [0,4194304] 0 2024-09-19T09:35:36.806 INFO:tasks.workunit.client.0.smithi112.stdout:3/966: dread - d8/d15/d1b/d1c/db5/d118/f138 zero size 2024-09-19T09:35:36.808 INFO:tasks.workunit.client.0.smithi112.stdout:9/682: mkdir df/d11/d14/d19/df3 0 2024-09-19T09:35:36.808 INFO:tasks.workunit.client.0.smithi112.stdout:9/683: read - df/d11/d14/d19/d66/d5d/f7c zero size 2024-09-19T09:35:36.809 INFO:tasks.workunit.client.0.smithi112.stdout:0/816: mkdir d2/d39/d116 0 2024-09-19T09:35:36.811 INFO:tasks.workunit.client.0.smithi112.stdout:9/684: dread df/d11/f3c [0,4194304] 0 2024-09-19T09:35:36.811 INFO:tasks.workunit.client.0.smithi112.stdout:1/902: dread dc/d59/d73/f79 [0,4194304] 0 2024-09-19T09:35:36.813 INFO:tasks.workunit.client.0.smithi112.stdout:9/685: chown c2 197102 1 2024-09-19T09:35:36.815 INFO:tasks.workunit.client.0.smithi112.stdout:9/686: mknod df/db9/cf4 0 2024-09-19T09:35:36.815 INFO:tasks.workunit.client.0.smithi112.stdout:0/817: dread d2/f31 [0,4194304] 0 2024-09-19T09:35:36.815 INFO:tasks.workunit.client.0.smithi112.stdout:0/818: write d2/d59/d7a/f8b [1907690,8342] 0 2024-09-19T09:35:36.817 INFO:tasks.workunit.client.0.smithi112.stdout:0/819: mkdir d2/d6e/d75/d117 0 2024-09-19T09:35:36.819 INFO:tasks.workunit.client.0.smithi112.stdout:0/820: truncate d2/f21 6811166 0 2024-09-19T09:35:36.819 INFO:tasks.workunit.client.0.smithi112.stdout:0/821: write d2/d68/fce [940546,106794] 0 2024-09-19T09:35:36.819 INFO:tasks.workunit.client.0.smithi112.stdout:0/822: write d2/d59/da1/dd4/f69 [4808588,9972] 0 2024-09-19T09:35:36.822 INFO:tasks.workunit.client.0.smithi112.stdout:0/823: link d2/d59/f85 d2/d39/d116/f118 0 2024-09-19T09:35:36.822 INFO:tasks.workunit.client.0.smithi112.stdout:0/824: chown d2/d45/f54 18 1 2024-09-19T09:35:36.822 INFO:tasks.workunit.client.0.smithi112.stdout:0/825: creat d2/d45/f119 x:0 0 0 2024-09-19T09:35:36.825 INFO:tasks.workunit.client.0.smithi112.stdout:9/687: read df/d11/d14/f2e [541938,97776] 0 2024-09-19T09:35:36.826 INFO:tasks.workunit.client.0.smithi112.stdout:9/688: unlink df/d11/f25 0 2024-09-19T09:35:36.827 INFO:tasks.workunit.client.0.smithi112.stdout:9/689: write df/f61 [2141477,27018] 0 2024-09-19T09:35:36.828 INFO:tasks.workunit.client.0.smithi112.stdout:9/690: creat df/d11/d14/d19/de0/ff5 x:0 0 0 2024-09-19T09:35:36.828 INFO:tasks.workunit.client.0.smithi112.stdout:9/691: readlink df/d11/d14/d19/d40/l7f 0 2024-09-19T09:35:36.833 INFO:tasks.workunit.client.0.smithi112.stdout:8/923: dwrite d7/d10/d11/d55/d9e/fd7 [0,4194304] 0 2024-09-19T09:35:36.834 INFO:tasks.workunit.client.0.smithi112.stdout:0/826: dread d2/f22 [4194304,4194304] 0 2024-09-19T09:35:36.835 INFO:tasks.workunit.client.0.smithi112.stdout:0/827: dread - d2/d6e/da0/de6/ffd zero size 2024-09-19T09:35:36.836 INFO:tasks.workunit.client.0.smithi112.stdout:3/967: dwrite d8/d15/d1b/d1c/d27/d62/d99/f12a [0,4194304] 0 2024-09-19T09:35:36.836 INFO:tasks.workunit.client.0.smithi112.stdout:3/968: stat d8/d15/d1b/d1c/d68/d33/f6b 0 2024-09-19T09:35:36.836 INFO:tasks.workunit.client.0.smithi112.stdout:1/903: dwrite dc/d26/d34/d36/d68/fc4 [0,4194304] 0 2024-09-19T09:35:36.839 INFO:tasks.workunit.client.0.smithi112.stdout:3/969: write d8/f102 [1113040,6050] 0 2024-09-19T09:35:36.840 INFO:tasks.workunit.client.0.smithi112.stdout:0/828: creat d2/d6e/da0/de6/f11a x:0 0 0 2024-09-19T09:35:36.850 INFO:tasks.workunit.client.0.smithi112.stdout:1/904: dread dc/f69 [0,4194304] 0 2024-09-19T09:35:36.852 INFO:tasks.workunit.client.0.smithi112.stdout:1/905: symlink dc/d59/de7/l116 0 2024-09-19T09:35:36.854 INFO:tasks.workunit.client.0.smithi112.stdout:3/970: dread d8/d15/d1b/d1c/d68/db9/f10d [0,4194304] 0 2024-09-19T09:35:36.854 INFO:tasks.workunit.client.0.smithi112.stdout:9/692: dwrite df/d11/d14/d19/d66/f9b [0,4194304] 0 2024-09-19T09:35:36.854 INFO:tasks.workunit.client.0.smithi112.stdout:9/693: getdents df/d11/d14 0 2024-09-19T09:35:36.854 INFO:tasks.workunit.client.0.smithi112.stdout:9/694: write df/d35/fe9 [898381,76485] 0 2024-09-19T09:35:36.854 INFO:tasks.workunit.client.0.smithi112.stdout:9/695: write df/d11/d14/d19/d28/f9f [83929,101725] 0 2024-09-19T09:35:36.857 INFO:tasks.workunit.client.0.smithi112.stdout:1/906: link dc/d24/d45/d94/dbc/fd3 dc/d26/d34/f117 0 2024-09-19T09:35:36.860 INFO:tasks.workunit.client.0.smithi112.stdout:9/696: creat df/ff6 x:0 0 0 2024-09-19T09:35:36.860 INFO:tasks.workunit.client.0.smithi112.stdout:9/697: creat df/d11/d14/d19/de0/ff7 x:0 0 0 2024-09-19T09:35:36.861 INFO:tasks.workunit.client.0.smithi112.stdout:8/924: dwrite d7/db/d21/d2e/d8c/d97/fba [0,4194304] 0 2024-09-19T09:35:36.861 INFO:tasks.workunit.client.0.smithi112.stdout:8/925: chown d7/d10/d11/d55/d9e/da1/dd5 24170 1 2024-09-19T09:35:36.862 INFO:tasks.workunit.client.0.smithi112.stdout:0/829: dwrite d2/d59/da1/dd4/d95/db5/f1e [0,4194304] 0 2024-09-19T09:35:36.863 INFO:tasks.workunit.client.0.smithi112.stdout:9/698: symlink df/d11/d14/d19/d40/daf/lf8 0 2024-09-19T09:35:36.873 INFO:tasks.workunit.client.0.smithi112.stdout:0/830: mknod d2/d6e/c11b 0 2024-09-19T09:35:36.874 INFO:tasks.workunit.client.0.smithi112.stdout:9/699: mknod df/d11/d14/d51/cf9 0 2024-09-19T09:35:36.874 INFO:tasks.workunit.client.0.smithi112.stdout:9/700: fsync df/d11/d14/d19/d40/daf/f6f 0 2024-09-19T09:35:36.874 INFO:tasks.workunit.client.0.smithi112.stdout:9/701: creat df/d11/d14/d19/d66/ffa x:0 0 0 2024-09-19T09:35:36.875 INFO:tasks.workunit.client.0.smithi112.stdout:0/831: rmdir d2/d39/d3b/dab 39 2024-09-19T09:35:36.876 INFO:tasks.workunit.client.0.smithi112.stdout:9/702: write df/d11/d14/d19/d40/f4e [556925,76586] 0 2024-09-19T09:35:36.879 INFO:tasks.workunit.client.0.smithi112.stdout:8/926: dwrite d7/d10/d11/ffa [0,4194304] 0 2024-09-19T09:35:36.879 INFO:tasks.workunit.client.0.smithi112.stdout:1/907: dwrite dc/d59/d73/fce [0,4194304] 0 2024-09-19T09:35:36.879 INFO:tasks.workunit.client.0.smithi112.stdout:8/927: stat d7/d10/c18 0 2024-09-19T09:35:36.879 INFO:tasks.workunit.client.0.smithi112.stdout:1/908: creat dc/d26/d34/d36/d68/d7d/d6a/db4/f118 x:0 0 0 2024-09-19T09:35:36.888 INFO:tasks.workunit.client.0.smithi112.stdout:8/928: write d7/d10/d11/ffa [3761879,61324] 0 2024-09-19T09:35:36.889 INFO:tasks.workunit.client.0.smithi112.stdout:8/929: creat d7/db/d21/d2e/d42/d57/dea/f125 x:0 0 0 2024-09-19T09:35:36.889 INFO:tasks.workunit.client.0.smithi112.stdout:8/930: stat d7/d10/d11/d55/d9e/da1/dd5 0 2024-09-19T09:35:36.892 INFO:tasks.workunit.client.0.smithi112.stdout:8/931: mknod d7/db/d21/d2e/d8c/c126 0 2024-09-19T09:35:36.892 INFO:tasks.workunit.client.0.smithi112.stdout:1/909: write dc/d26/d34/d4c/fe2 [448487,47116] 0 2024-09-19T09:35:36.892 INFO:tasks.workunit.client.0.smithi112.stdout:9/703: dwrite df/d11/d14/d19/fe5 [0,4194304] 0 2024-09-19T09:35:36.894 INFO:tasks.workunit.client.0.smithi112.stdout:8/932: symlink d7/d10/d11/d50/l127 0 2024-09-19T09:35:36.896 INFO:tasks.workunit.client.0.smithi112.stdout:8/933: dread d7/f10e [0,4194304] 0 2024-09-19T09:35:36.896 INFO:tasks.workunit.client.0.smithi112.stdout:8/934: truncate d7/db/d21/d2e/d8c/d97/dc3/dc9/de6/f11c 632669 0 2024-09-19T09:35:36.897 INFO:tasks.workunit.client.0.smithi112.stdout:8/935: fdatasync d7/db/d21/f4e 0 2024-09-19T09:35:36.900 INFO:tasks.workunit.client.0.smithi112.stdout:9/704: symlink df/d11/d14/d19/d40/dea/lfb 0 2024-09-19T09:35:36.901 INFO:tasks.workunit.client.0.smithi112.stdout:1/910: dread dc/f23 [4194304,4194304] 0 2024-09-19T09:35:36.901 INFO:tasks.workunit.client.0.smithi112.stdout:0/832: dwrite d2/d39/d3b/f3f [0,4194304] 0 2024-09-19T09:35:36.904 INFO:tasks.workunit.client.0.smithi112.stdout:9/705: rename df/d11/d14/d19/d66/l29 to df/d11/d14/d19/d40/daf/d6c/lfc 0 2024-09-19T09:35:36.906 INFO:tasks.workunit.client.0.smithi112.stdout:1/911: symlink dc/d59/l119 0 2024-09-19T09:35:36.912 INFO:tasks.workunit.client.0.smithi112.stdout:9/706: write df/db9/fc6 [3297009,5061] 0 2024-09-19T09:35:36.912 INFO:tasks.workunit.client.0.smithi112.stdout:9/707: write df/d11/d14/d19/d66/fcb [27074,61751] 0 2024-09-19T09:35:36.912 INFO:tasks.workunit.client.0.smithi112.stdout:0/833: creat d2/d39/d116/f11c x:0 0 0 2024-09-19T09:35:36.915 INFO:tasks.workunit.client.0.smithi112.stdout:8/936: getdents d7/d10/d11/d33 0 2024-09-19T09:35:36.915 INFO:tasks.workunit.client.0.smithi112.stdout:1/912: write dc/d59/d73/fce [2658125,33379] 0 2024-09-19T09:35:36.916 INFO:tasks.workunit.client.0.smithi112.stdout:1/913: chown dc/d26/d44/d63 27 1 2024-09-19T09:35:36.916 INFO:tasks.workunit.client.0.smithi112.stdout:1/914: write dc/d24/d45/d94/f105 [413376,68199] 0 2024-09-19T09:35:36.916 INFO:tasks.workunit.client.0.smithi112.stdout:1/915: truncate dc/d26/d34/d36/d68/fcb 4718739 0 2024-09-19T09:35:36.916 INFO:tasks.workunit.client.0.smithi112.stdout:1/916: chown dc/d26/d34/d36/ca8 193717 1 2024-09-19T09:35:36.916 INFO:tasks.workunit.client.0.smithi112.stdout:9/708: creat df/d35/d9d/ffd x:0 0 0 2024-09-19T09:35:36.919 INFO:tasks.workunit.client.0.smithi112.stdout:0/834: mkdir d2/d59/da1/dd4/d11d 0 2024-09-19T09:35:36.919 INFO:tasks.workunit.client.0.smithi112.stdout:0/835: chown d2/d59/da1/dd4/l55 200393342 1 2024-09-19T09:35:36.919 INFO:tasks.workunit.client.0.smithi112.stdout:0/836: stat d2/d39/d3b/c64 0 2024-09-19T09:35:36.920 INFO:tasks.workunit.client.0.smithi112.stdout:1/917: symlink dc/d26/d34/d36/d68/d9f/l11a 0 2024-09-19T09:35:36.923 INFO:tasks.workunit.client.0.smithi112.stdout:9/709: link df/d11/d14/d19/d28/c84 df/d11/d14/d19/d40/daf/d6c/cfe 0 2024-09-19T09:35:36.923 INFO:tasks.workunit.client.0.smithi112.stdout:9/710: fsync df/d11/d14/f44 0 2024-09-19T09:35:36.923 INFO:tasks.workunit.client.0.smithi112.stdout:9/711: chown df/d35/l86 197460 1 2024-09-19T09:35:36.923 INFO:tasks.workunit.client.0.smithi112.stdout:8/937: write d7/d10/d11/d55/d9e/fd7 [666603,122545] 0 2024-09-19T09:35:36.924 INFO:tasks.workunit.client.0.smithi112.stdout:0/837: mkdir d2/d59/d7a/d11e 0 2024-09-19T09:35:36.924 INFO:tasks.workunit.client.0.smithi112.stdout:8/938: dread d7/d10/fe8 [0,4194304] 0 2024-09-19T09:35:36.924 INFO:tasks.workunit.client.0.smithi112.stdout:8/939: read d7/d10/d11/d33/f54 [667016,49345] 0 2024-09-19T09:35:36.927 INFO:tasks.workunit.client.0.smithi112.stdout:0/838: mknod d2/d59/da1/dd4/d11d/c11f 0 2024-09-19T09:35:36.927 INFO:tasks.workunit.client.0.smithi112.stdout:0/839: chown d2/d39/c51 12 1 2024-09-19T09:35:36.927 INFO:tasks.workunit.client.0.smithi112.stdout:0/840: write d2/d45/fed [143400,130999] 0 2024-09-19T09:35:36.927 INFO:tasks.workunit.client.0.smithi112.stdout:0/841: readlink d2/d6e/lea 0 2024-09-19T09:35:36.927 INFO:tasks.workunit.client.0.smithi112.stdout:0/842: creat d2/d6e/d75/f120 x:0 0 0 2024-09-19T09:35:36.929 INFO:tasks.workunit.client.0.smithi112.stdout:1/918: dread dc/f23 [0,4194304] 0 2024-09-19T09:35:36.929 INFO:tasks.workunit.client.0.smithi112.stdout:1/919: chown dc/d24/da2 9084277 1 2024-09-19T09:35:36.929 INFO:tasks.workunit.client.0.smithi112.stdout:1/920: fsync dc/d59/d73/d88/f102 0 2024-09-19T09:35:36.933 INFO:tasks.workunit.client.0.smithi112.stdout:9/712: dread df/d11/d14/d51/fdd [0,4194304] 0 2024-09-19T09:35:36.933 INFO:tasks.workunit.client.0.smithi112.stdout:8/940: creat d7/db/f128 x:0 0 0 2024-09-19T09:35:36.933 INFO:tasks.workunit.client.0.smithi112.stdout:9/713: write df/d11/d14/d19/d40/f4b [4430265,72141] 0 2024-09-19T09:35:36.935 INFO:tasks.workunit.client.0.smithi112.stdout:1/921: creat dc/d59/d73/d88/f11b x:0 0 0 2024-09-19T09:35:36.946 INFO:tasks.workunit.client.0.smithi112.stdout:9/714: truncate df/d11/d14/d19/d28/d89/fc2 3979591 0 2024-09-19T09:35:36.948 INFO:tasks.workunit.client.0.smithi112.stdout:9/715: unlink df/d11/d14/d19/d40/l7f 0 2024-09-19T09:35:36.948 INFO:tasks.workunit.client.0.smithi112.stdout:1/922: mknod dc/d13/c11c 0 2024-09-19T09:35:36.950 INFO:tasks.workunit.client.0.smithi112.stdout:9/716: rmdir df/d11/d14/d19/d40/daf/d6c/db3/d9e 39 2024-09-19T09:35:36.954 INFO:tasks.workunit.client.0.smithi112.stdout:8/941: dwrite d7/db/f45 [0,4194304] 0 2024-09-19T09:35:36.955 INFO:tasks.workunit.client.0.smithi112.stdout:8/942: write d7/db/d21/d3b/fec [177485,82479] 0 2024-09-19T09:35:36.956 INFO:tasks.workunit.client.0.smithi112.stdout:8/943: rmdir d7/db/d21/d2e/d42/d57/dea 39 2024-09-19T09:35:36.958 INFO:tasks.workunit.client.0.smithi112.stdout:8/944: rmdir d7/d10/d11/d55 39 2024-09-19T09:35:36.959 INFO:tasks.workunit.client.0.smithi112.stdout:8/945: rename d7/d10/c18 to d7/db/d21/d3b/d56/d4b/c129 0 2024-09-19T09:35:36.959 INFO:tasks.workunit.client.0.smithi112.stdout:8/946: readlink d7/db/d21/d2e/d42/lb1 0 2024-09-19T09:35:36.960 INFO:tasks.workunit.client.0.smithi112.stdout:8/947: rmdir d7/db/d21/d3b/d56/d48 39 2024-09-19T09:35:36.960 INFO:tasks.workunit.client.0.smithi112.stdout:8/948: readlink d7/db/d21/d2e/d42/l51 0 2024-09-19T09:35:36.960 INFO:tasks.workunit.client.0.smithi112.stdout:8/949: truncate d7/d65/f91 491822 0 2024-09-19T09:35:36.978 INFO:tasks.workunit.client.0.smithi112.stdout:9/717: dwrite df/d11/d14/d19/d1e/f88 [8388608,4194304] 0 2024-09-19T09:35:36.979 INFO:tasks.workunit.client.0.smithi112.stdout:1/923: dwrite dc/d26/d34/d36/d68/d9f/f106 [0,4194304] 0 2024-09-19T09:35:36.980 INFO:tasks.workunit.client.0.smithi112.stdout:9/718: mknod df/d11/d14/d19/d40/daf/d6c/cff 0 2024-09-19T09:35:36.984 INFO:tasks.workunit.client.0.smithi112.stdout:1/924: link dc/d26/d34/l9a dc/d24/da2/l11d 0 2024-09-19T09:35:36.985 INFO:tasks.workunit.client.0.smithi112.stdout:9/719: rmdir df/d11/d14/d19/d40/daf/d6c/db3 39 2024-09-19T09:35:36.992 INFO:tasks.workunit.client.0.smithi112.stdout:1/925: dread dc/d26/d34/d4c/f7e [0,4194304] 0 2024-09-19T09:35:36.995 INFO:tasks.workunit.client.0.smithi112.stdout:1/926: rename dc/d59/de7/dfc to dc/d24/d45/d94/d11e 0 2024-09-19T09:35:36.995 INFO:tasks.workunit.client.0.smithi112.stdout:1/927: readlink dc/d24/l3a 0 2024-09-19T09:35:36.995 INFO:tasks.workunit.client.0.smithi112.stdout:1/928: write dc/d26/d34/d36/d68/d9f/dd1/f101 [1017120,30989] 0 2024-09-19T09:35:36.995 INFO:tasks.workunit.client.0.smithi112.stdout:1/929: write dc/d26/d34/f3f [4724599,6500] 0 2024-09-19T09:35:36.995 INFO:tasks.workunit.client.0.smithi112.stdout:1/930: chown dc/d26/d34/d36/d68/ffb 0 1 2024-09-19T09:35:37.004 INFO:tasks.workunit.client.0.smithi112.stdout:1/931: write dc/d24/f46 [3155631,68448] 0 2024-09-19T09:35:37.005 INFO:tasks.workunit.client.0.smithi112.stdout:1/932: unlink dc/d26/d34/d36/d68/d7d/fe6 0 2024-09-19T09:35:37.006 INFO:tasks.workunit.client.0.smithi112.stdout:1/933: dread dc/d24/d45/d94/dbc/fdf [0,4194304] 0 2024-09-19T09:35:37.025 INFO:tasks.workunit.client.0.smithi112.stdout:1/934: dwrite dc/d26/d44/d63/dee/ff8 [0,4194304] 0 2024-09-19T09:35:37.028 INFO:tasks.workunit.client.0.smithi112.stdout:1/935: mkdir dc/d59/de7/d11f 0 2024-09-19T09:35:37.040 INFO:tasks.workunit.client.0.smithi112.stdout:1/936: symlink dc/d26/d44/d112/l120 0 2024-09-19T09:35:37.042 INFO:tasks.workunit.client.0.smithi112.stdout:1/937: rename dc/d13/f1c to dc/d26/d34/d36/d68/d7d/f121 0 2024-09-19T09:35:37.044 INFO:tasks.workunit.client.0.smithi112.stdout:1/938: write dc/d26/d34/d36/d68/d9f/dd1/f101 [997619,74091] 0 2024-09-19T09:35:37.045 INFO:tasks.workunit.client.0.smithi112.stdout:1/939: mknod dc/d26/d34/c122 0 2024-09-19T09:35:37.047 INFO:tasks.workunit.client.0.smithi112.stdout:1/940: getdents dc/d26/d44/d63 0 2024-09-19T09:35:37.047 INFO:tasks.workunit.client.0.smithi112.stdout:1/941: creat dc/d59/d73/d88/f123 x:0 0 0 2024-09-19T09:35:37.054 INFO:tasks.workunit.client.0.smithi112.stdout:1/942: dread dc/fd [0,4194304] 0 2024-09-19T09:35:37.056 INFO:tasks.workunit.client.0.smithi112.stdout:1/943: rename dc/d24/da2/fa6 to dc/d26/d34/d36/d68/d7d/d6a/dac/f124 0 2024-09-19T09:35:37.064 INFO:tasks.workunit.client.0.smithi112.stdout:1/944: dread dc/d26/d34/d4c/f66 [0,4194304] 0 2024-09-19T09:35:37.064 INFO:tasks.workunit.client.0.smithi112.stdout:1/945: dread - dc/d26/d34/d36/d68/d7d/d6a/db4/fb5 zero size 2024-09-19T09:35:37.064 INFO:tasks.workunit.client.0.smithi112.stdout:1/946: write dc/d26/d34/f6d [4570996,70187] 0 2024-09-19T09:35:37.064 INFO:tasks.workunit.client.0.smithi112.stdout:1/947: fdatasync f1 0 2024-09-19T09:35:37.066 INFO:tasks.workunit.client.0.smithi112.stdout:1/948: creat dc/d26/d34/d4c/de8/f125 x:0 0 0 2024-09-19T09:35:37.068 INFO:tasks.workunit.client.0.smithi112.stdout:1/949: creat dc/d26/d34/d36/d68/d7d/d6a/f126 x:0 0 0 2024-09-19T09:35:37.068 INFO:tasks.workunit.client.0.smithi112.stdout:1/950: write dc/f23 [3412352,89995] 0 2024-09-19T09:35:37.068 INFO:tasks.workunit.client.0.smithi112.stdout:1/951: write dc/d26/f29 [3713815,58456] 0 2024-09-19T09:35:37.069 INFO:tasks.workunit.client.0.smithi112.stdout:1/952: mkdir dc/d26/dd0/d127 0 2024-09-19T09:35:37.070 INFO:tasks.workunit.client.0.smithi112.stdout:1/953: symlink dc/d26/d44/d112/l128 0 2024-09-19T09:35:37.070 INFO:tasks.workunit.client.0.smithi112.stdout:1/954: chown dc/c4f 21 1 2024-09-19T09:35:37.071 INFO:tasks.workunit.client.0.smithi112.stdout:1/955: fdatasync dc/d24/f12 0 2024-09-19T09:35:37.072 INFO:tasks.workunit.client.0.smithi112.stdout:1/956: link dc/d24/f40 dc/d26/d34/d36/d68/d9f/f129 0 2024-09-19T09:35:37.072 INFO:tasks.workunit.client.0.smithi112.stdout:1/957: creat dc/d26/d34/d36/d68/d7d/d6a/f12a x:0 0 0 2024-09-19T09:35:37.074 INFO:tasks.workunit.client.0.smithi112.stdout:1/958: creat dc/d13/f12b x:0 0 0 2024-09-19T09:35:37.074 INFO:tasks.workunit.client.0.smithi112.stdout:1/959: chown dc/d26/d34/d36/d68/d7d/d6a/la4 740032711 1 2024-09-19T09:35:37.074 INFO:tasks.workunit.client.0.smithi112.stdout:1/960: truncate dc/d26/d44/d63/dee/ff8 4951717 0 2024-09-19T09:35:37.075 INFO:tasks.workunit.client.0.smithi112.stdout:1/961: rmdir dc/d26/d44/d63 39 2024-09-19T09:35:37.076 INFO:tasks.workunit.client.0.smithi112.stdout:1/962: getdents dc/d24/da2 0 2024-09-19T09:35:37.087 INFO:tasks.workunit.client.0.smithi112.stdout:1/963: write dc/d26/d44/d63/f7f [1695776,49021] 0 2024-09-19T09:35:37.090 INFO:tasks.workunit.client.0.smithi112.stdout:1/964: mknod dc/d26/d34/c12c 0 2024-09-19T09:35:37.092 INFO:tasks.workunit.client.0.smithi112.stdout:1/965: link dc/d26/d44/l57 dc/d26/d34/d36/d68/d9f/dd1/l12d 0 2024-09-19T09:35:37.092 INFO:tasks.workunit.client.0.smithi112.stdout:1/966: read - dc/d26/d34/d36/d68/d7d/d6a/db4/f118 zero size 2024-09-19T09:35:37.092 INFO:tasks.workunit.client.0.smithi112.stdout:1/967: chown dc/d59/d73/d88/cb2 53 1 2024-09-19T09:35:37.093 INFO:tasks.workunit.client.0.smithi112.stdout:1/968: fdatasync dc/d13/f51 0 2024-09-19T09:35:37.094 INFO:tasks.workunit.client.0.smithi112.stdout:1/969: unlink l3 0 2024-09-19T09:35:37.095 INFO:tasks.workunit.client.0.smithi112.stdout:1/970: creat dc/d26/d34/d36/d68/d7d/d6a/f12e x:0 0 0 2024-09-19T09:35:37.097 INFO:tasks.workunit.client.0.smithi112.stdout:1/971: unlink dc/d26/d44/d63/cd7 0 2024-09-19T09:35:37.181 INFO:tasks.workunit.client.0.smithi112.stdout:1/972: symlink dc/d26/d34/d36/d68/d7d/dd5/l12f 0 2024-09-19T09:35:37.183 INFO:tasks.workunit.client.0.smithi112.stdout:1/973: dread dc/d59/f80 [0,4194304] 0 2024-09-19T09:35:37.184 INFO:tasks.workunit.client.0.smithi112.stdout:1/974: creat dc/d26/d34/d4c/d55/f130 x:0 0 0 2024-09-19T09:35:37.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:36 smithi112 ceph-mon[27605]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 109 MiB/s rd, 140 MiB/s wr, 314 op/s 2024-09-19T09:35:37.197 INFO:tasks.workunit.client.0.smithi112.stdout:1/975: rmdir dc/d26/d34/d36/d68 39 2024-09-19T09:35:37.197 INFO:tasks.workunit.client.0.smithi112.stdout:1/976: write dc/fe [3850814,26088] 0 2024-09-19T09:35:37.197 INFO:tasks.workunit.client.0.smithi112.stdout:1/977: stat dc/d26/dd0/d127 0 2024-09-19T09:35:37.199 INFO:tasks.workunit.client.0.smithi112.stdout:1/978: creat dc/d26/d44/f131 x:0 0 0 2024-09-19T09:35:37.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:36 smithi191 ceph-mon[34834]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 109 MiB/s rd, 140 MiB/s wr, 314 op/s 2024-09-19T09:35:37.314 INFO:tasks.workunit.client.0.smithi112.stdout:0/843: sync 2024-09-19T09:35:37.314 INFO:tasks.workunit.client.0.smithi112.stdout:3/971: sync 2024-09-19T09:35:37.315 INFO:tasks.workunit.client.0.smithi112.stdout:3/972: symlink d8/d15/d1b/d1c/db5/l14a 0 2024-09-19T09:35:37.315 INFO:tasks.workunit.client.0.smithi112.stdout:3/973: chown f6 13 1 2024-09-19T09:35:37.324 INFO:tasks.workunit.client.0.smithi112.stdout:3/974: write d8/d15/d1b/d1c/d27/d2b/f5c [4106012,75443] 0 2024-09-19T09:35:37.324 INFO:tasks.workunit.client.0.smithi112.stdout:3/975: chown d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d63/lb7 24594 1 2024-09-19T09:35:37.326 INFO:tasks.workunit.client.0.smithi112.stdout:3/976: mkdir d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/dd4/d14b 0 2024-09-19T09:35:37.329 INFO:tasks.workunit.client.0.smithi112.stdout:0/844: dwrite d2/d59/da1/dd4/d95/fe0 [0,4194304] 0 2024-09-19T09:35:37.333 INFO:tasks.workunit.client.0.smithi112.stdout:0/845: link d2/d59/da1/dd4/db8/deb/f111 d2/d59/d7a/d11e/f121 0 2024-09-19T09:35:37.338 INFO:tasks.workunit.client.0.smithi112.stdout:0/846: mkdir d2/d59/d7a/d11e/d122 0 2024-09-19T09:35:37.338 INFO:tasks.workunit.client.0.smithi112.stdout:0/847: chown d2/d39/fb7 742 1 2024-09-19T09:35:37.341 INFO:tasks.workunit.client.0.smithi112.stdout:0/848: mknod d2/d59/da1/dd4/d11d/c123 0 2024-09-19T09:35:37.341 INFO:tasks.workunit.client.0.smithi112.stdout:0/849: fsync d2/d6e/d75/f120 0 2024-09-19T09:35:37.343 INFO:tasks.workunit.client.0.smithi112.stdout:3/977: dwrite d8/d15/d1b/d1c/d68/d33/d6f/fd2 [0,4194304] 0 2024-09-19T09:35:37.343 INFO:tasks.workunit.client.0.smithi112.stdout:3/978: chown d8/d15/d1b/d1c/d43/fa6 4065 1 2024-09-19T09:35:37.352 INFO:tasks.workunit.client.0.smithi112.stdout:3/979: dread d8/d15/d1b/d1c/db5/f12c [4194304,4194304] 0 2024-09-19T09:35:37.352 INFO:tasks.workunit.client.0.smithi112.stdout:3/980: write d8/d15/d1b/d1c/d68/d33/d83/de4/fb6 [817844,9674] 0 2024-09-19T09:35:37.354 INFO:tasks.workunit.client.0.smithi112.stdout:0/850: dwrite d2/d68/fce [0,4194304] 0 2024-09-19T09:35:37.354 INFO:tasks.workunit.client.0.smithi112.stdout:0/851: dread - d2/d59/da1/dd4/d95/db5/f53 zero size 2024-09-19T09:35:37.382 INFO:tasks.workunit.client.0.smithi112.stdout:3/981: rmdir d8/d15 39 2024-09-19T09:35:37.383 INFO:tasks.workunit.client.0.smithi112.stdout:3/982: chown d8/d15/d1b/d1c/d27/d62/d99/da0/c135 377271 1 2024-09-19T09:35:37.385 INFO:tasks.workunit.client.0.smithi112.stdout:3/983: creat d8/d15/d1b/d1c/d68/d33/d83/def/f14c x:0 0 0 2024-09-19T09:35:37.386 INFO:tasks.workunit.client.0.smithi112.stdout:3/984: getdents d8/d15/d1b/d1c/d68/d33/d83/de4/de0 0 2024-09-19T09:35:37.388 INFO:tasks.workunit.client.0.smithi112.stdout:3/985: truncate d8/d15/d1b/f77 637429 0 2024-09-19T09:35:37.395 INFO:tasks.workunit.client.0.smithi112.stdout:0/852: dwrite d2/d59/da1/dd4/db8/dc1/fcf [0,4194304] 0 2024-09-19T09:35:37.395 INFO:tasks.workunit.client.0.smithi112.stdout:0/853: truncate d2/d39/d3b/d8a/f9f 2614646 0 2024-09-19T09:35:37.398 INFO:tasks.workunit.client.0.smithi112.stdout:0/854: rename d2/d59/f10e to d2/d68/f124 0 2024-09-19T09:35:37.403 INFO:tasks.workunit.client.0.smithi112.stdout:3/986: dread d8/ff [0,4194304] 0 2024-09-19T09:35:37.406 INFO:tasks.workunit.client.0.smithi112.stdout:3/987: creat d8/d15/d1b/d1c/d27/d62/dcf/d44/f14d x:0 0 0 2024-09-19T09:35:37.409 INFO:tasks.workunit.client.0.smithi112.stdout:3/988: getdents d8/d15/d1b/d1c/db5 0 2024-09-19T09:35:37.413 INFO:tasks.workunit.client.0.smithi112.stdout:3/989: mknod d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/dd4/d14b/c14e 0 2024-09-19T09:35:37.413 INFO:tasks.workunit.client.0.smithi112.stdout:3/990: readlink d8/d15/d1b/d1c/d68/d33/d66/ld8 0 2024-09-19T09:35:37.413 INFO:tasks.workunit.client.0.smithi112.stdout:3/991: write d8/d15/fe9 [413774,82385] 0 2024-09-19T09:35:37.416 INFO:tasks.workunit.client.0.smithi112.stdout:3/992: truncate d8/d15/d1b/d1c/d68/d33/d83/f90 4104167 0 2024-09-19T09:35:37.417 INFO:tasks.workunit.client.0.smithi112.stdout:0/855: dwrite d2/d39/fa8 [0,4194304] 0 2024-09-19T09:35:37.417 INFO:tasks.workunit.client.0.smithi112.stdout:0/856: fdatasync d2/d59/d7a/f7f 0 2024-09-19T09:35:37.418 INFO:tasks.workunit.client.0.smithi112.stdout:3/993: rename d8/d15/d1b/d1c/f37 to d8/d15/d1b/d1c/d68/d33/f14f 0 2024-09-19T09:35:37.421 INFO:tasks.workunit.client.0.smithi112.stdout:0/857: symlink d2/d59/da1/dd4/db8/l125 0 2024-09-19T09:35:37.421 INFO:tasks.workunit.client.0.smithi112.stdout:0/858: dread - d2/f110 zero size 2024-09-19T09:35:37.423 INFO:tasks.workunit.client.0.smithi112.stdout:3/994: creat d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d63/db0/f150 x:0 0 0 2024-09-19T09:35:37.423 INFO:tasks.workunit.client.0.smithi112.stdout:8/950: sync 2024-09-19T09:35:37.423 INFO:tasks.workunit.client.0.smithi112.stdout:8/951: fdatasync d7/db/d21/f11d 0 2024-09-19T09:35:37.425 INFO:tasks.workunit.client.0.smithi112.stdout:8/952: creat d7/db/d21/d2e/d8c/d97/dc3/dc9/f12a x:0 0 0 2024-09-19T09:35:37.426 INFO:tasks.workunit.client.0.smithi112.stdout:8/953: getdents d7/d65 0 2024-09-19T09:35:37.426 INFO:tasks.workunit.client.0.smithi112.stdout:8/954: chown d7/db/d21/d3b/d56/d3c/d79/l8b 0 1 2024-09-19T09:35:37.426 INFO:tasks.workunit.client.0.smithi112.stdout:8/955: write d7/db/d21/d3b/d56/d3c/d79/ff5 [726875,91552] 0 2024-09-19T09:35:37.430 INFO:tasks.workunit.client.0.smithi112.stdout:3/995: fsync d8/d15/d1b/d1c/d27/d62/dcf/d44/f14d 0 2024-09-19T09:35:37.433 INFO:tasks.workunit.client.0.smithi112.stdout:3/996: rename d8/d15/d1b/d1c/d68/d33/d8e/lb2 to d8/d15/d1b/d1c/d27/d62/dcf/d44/d49/d5d/dd4/d14b/l151 0 2024-09-19T09:35:37.433 INFO:tasks.workunit.client.0.smithi112.stdout:3/997: dread - d8/d15/d1b/d1c/d68/d33/fee zero size 2024-09-19T09:35:37.434 INFO:tasks.workunit.client.0.smithi112.stdout:3/998: write d8/d15/d1b/fc4 [387610,42412] 0 2024-09-19T09:35:37.435 INFO:tasks.workunit.client.0.smithi112.stdout:3/999: mkdir d8/d15/d1b/d1c/db5/d118/d152 0 2024-09-19T09:35:37.444 INFO:tasks.workunit.client.0.smithi112.stdout:0/859: dwrite d2/d39/fb7 [0,4194304] 0 2024-09-19T09:35:37.444 INFO:tasks.workunit.client.0.smithi112.stdout:8/956: dwrite d7/db/d21/d3b/d56/d3c/f9f [0,4194304] 0 2024-09-19T09:35:37.453 INFO:tasks.workunit.client.0.smithi112.stdout:0/860: rmdir d2/d59/d7a/d11e/d122 0 2024-09-19T09:35:37.453 INFO:tasks.workunit.client.0.smithi112.stdout:0/861: fdatasync d2/d59/da1/dd4/d95/db5/f1e 0 2024-09-19T09:35:37.453 INFO:tasks.workunit.client.0.smithi112.stdout:0/862: truncate d2/d6e/da0/fc3 83933 0 2024-09-19T09:35:37.453 INFO:tasks.workunit.client.0.smithi112.stdout:0/863: creat d2/d45/f126 x:0 0 0 2024-09-19T09:35:37.458 INFO:tasks.workunit.client.0.smithi112.stdout:8/957: dwrite d7/db/d21/d2e/d42/fd0 [0,4194304] 0 2024-09-19T09:35:37.458 INFO:tasks.workunit.client.0.smithi112.stdout:8/958: dread - d7/db/d21/d3b/d56/d4b/ff9 zero size 2024-09-19T09:35:37.463 INFO:tasks.workunit.client.0.smithi112.stdout:8/959: dread d7/db/d21/d3b/d56/d3c/d79/ff5 [0,4194304] 0 2024-09-19T09:35:37.470 INFO:tasks.workunit.client.0.smithi112.stdout:0/864: symlink d2/de9/l127 0 2024-09-19T09:35:37.471 INFO:tasks.workunit.client.0.smithi112.stdout:0/865: read d2/d59/da1/dd4/db8/deb/f111 [432164,58705] 0 2024-09-19T09:35:37.471 INFO:tasks.workunit.client.0.smithi112.stdout:0/866: chown d2/d6e/d6f/l9d 35801953 1 2024-09-19T09:35:37.481 INFO:tasks.workunit.client.0.smithi112.stdout:8/960: symlink d7/d10/d11/d55/l12b 0 2024-09-19T09:35:37.486 INFO:tasks.workunit.client.0.smithi112.stdout:0/867: getdents d2/de9 0 2024-09-19T09:35:37.486 INFO:tasks.workunit.client.0.smithi112.stdout:0/868: chown d2/d39/f46 0 1 2024-09-19T09:35:37.487 INFO:tasks.workunit.client.0.smithi112.stdout:0/869: symlink d2/d59/da1/dd4/d95/db5/l128 0 2024-09-19T09:35:37.489 INFO:tasks.workunit.client.0.smithi112.stdout:0/870: link d2/d59/da1/dd4/d95/db5/l19 d2/d39/d3b/l129 0 2024-09-19T09:35:37.490 INFO:tasks.workunit.client.0.smithi112.stdout:8/961: write d7/d10/d11/f2b [3580197,117506] 0 2024-09-19T09:35:37.497 INFO:tasks.workunit.client.0.smithi112.stdout:0/871: dread d2/d39/f106 [0,4194304] 0 2024-09-19T09:35:37.497 INFO:tasks.workunit.client.0.smithi112.stdout:0/872: dread - d2/d39/d3b/d8a/f10c zero size 2024-09-19T09:35:37.498 INFO:tasks.workunit.client.0.smithi112.stdout:8/962: dread d7/db/d21/d3b/d56/d3c/f9f [0,4194304] 0 2024-09-19T09:35:37.499 INFO:tasks.workunit.client.0.smithi112.stdout:0/873: write d2/d39/d3b/f84 [406180,63401] 0 2024-09-19T09:35:37.500 INFO:tasks.workunit.client.0.smithi112.stdout:0/874: symlink d2/d39/d3b/d8a/d113/l12a 0 2024-09-19T09:35:37.502 INFO:tasks.workunit.client.0.smithi112.stdout:9/720: sync 2024-09-19T09:35:37.502 INFO:tasks.workunit.client.0.smithi112.stdout:9/721: truncate df/d11/d14/d19/d28/d95/fcf 388650 0 2024-09-19T09:35:37.502 INFO:tasks.workunit.client.0.smithi112.stdout:1/979: sync 2024-09-19T09:35:37.505 INFO:tasks.workunit.client.0.smithi112.stdout:9/722: creat df/d11/d14/d19/d40/dc7/f100 x:0 0 0 2024-09-19T09:35:37.508 INFO:tasks.workunit.client.0.smithi112.stdout:1/980: dread dc/d26/d34/d4c/fe2 [0,4194304] 0 2024-09-19T09:35:37.508 INFO:tasks.workunit.client.0.smithi112.stdout:9/723: link df/d11/d14/d19/d40/daf/lf8 df/d35/dd1/l101 0 2024-09-19T09:35:37.508 INFO:tasks.workunit.client.0.smithi112.stdout:9/724: fsync df/d11/f74 0 2024-09-19T09:35:37.511 INFO:tasks.workunit.client.0.smithi112.stdout:1/981: rename dc/d59/d73/d88/cb2 to dc/d26/d34/d4c/d55/c132 0 2024-09-19T09:35:37.511 INFO:tasks.workunit.client.0.smithi112.stdout:1/982: fsync dc/d26/d34/d4c/d55/f130 0 2024-09-19T09:35:37.512 INFO:tasks.workunit.client.0.smithi112.stdout:9/725: truncate df/d11/f5b 245308 0 2024-09-19T09:35:37.514 INFO:tasks.workunit.client.0.smithi112.stdout:8/963: dwrite d7/d10/d11/d55/d9e/fd7 [0,4194304] 0 2024-09-19T09:35:37.514 INFO:tasks.workunit.client.0.smithi112.stdout:1/983: rmdir dc/d26/d34/d36/d68/d7d/dd5 39 2024-09-19T09:35:37.516 INFO:tasks.workunit.client.0.smithi112.stdout:9/726: creat df/d11/d14/d19/d40/f102 x:0 0 0 2024-09-19T09:35:37.520 INFO:tasks.workunit.client.0.smithi112.stdout:8/964: mkdir d7/db/d21/d12c 0 2024-09-19T09:35:37.520 INFO:tasks.workunit.client.0.smithi112.stdout:8/965: getdents d7/d65/dbb/dd6 0 2024-09-19T09:35:37.521 INFO:tasks.workunit.client.0.smithi112.stdout:8/966: read - d7/d10/d11/d55/d9e/da1/f102 zero size 2024-09-19T09:35:37.521 INFO:tasks.workunit.client.0.smithi112.stdout:8/967: chown d7/d10/d11/d33/c1b 693 1 2024-09-19T09:35:37.522 INFO:tasks.workunit.client.0.smithi112.stdout:8/968: rename d7/db/d21/d3b/d56/d3c/d79/d85/cab to d7/db/d21/d2e/def/c12d 0 2024-09-19T09:35:37.522 INFO:tasks.workunit.client.0.smithi112.stdout:1/984: dread dc/d26/d34/d4c/f66 [0,4194304] 0 2024-09-19T09:35:37.524 INFO:tasks.workunit.client.0.smithi112.stdout:8/969: creat d7/d67/f12e x:0 0 0 2024-09-19T09:35:37.533 INFO:tasks.workunit.client.0.smithi112.stdout:8/970: dread d7/db/d21/d2e/d8c/d97/fba [0,4194304] 0 2024-09-19T09:35:37.535 INFO:tasks.workunit.client.0.smithi112.stdout:8/971: link d7/db/d21/d3b/d56/d4b/l8a d7/d10/d11/d50/ddd/l12f 0 2024-09-19T09:35:37.536 INFO:tasks.workunit.client.0.smithi112.stdout:8/972: read d7/d10/d11/f96 [259273,2248] 0 2024-09-19T09:35:37.536 INFO:tasks.workunit.client.0.smithi112.stdout:8/973: dread - d7/db/d21/d3b/d56/d3c/d79/fb4 zero size 2024-09-19T09:35:37.552 INFO:tasks.workunit.client.0.smithi112.stdout:8/974: dwrite d7/db/d21/d3b/d56/d4b/f71 [0,4194304] 0 2024-09-19T09:35:37.554 INFO:tasks.workunit.client.0.smithi112.stdout:8/975: rmdir d7/db/d21/d3b/d56/d48 39 2024-09-19T09:35:37.554 INFO:tasks.workunit.client.0.smithi112.stdout:8/976: chown d7/d10/d11/d33/c39 5628 1 2024-09-19T09:35:37.554 INFO:tasks.workunit.client.0.smithi112.stdout:8/977: chown d7/db/d21/l2d 793417732 1 2024-09-19T09:35:37.554 INFO:tasks.workunit.client.0.smithi112.stdout:8/978: write d7/db/d21/f114 [721035,39298] 0 2024-09-19T09:35:37.555 INFO:tasks.workunit.client.0.smithi112.stdout:8/979: truncate d7/db/d21/f22 8181155 0 2024-09-19T09:35:37.555 INFO:tasks.workunit.client.0.smithi112.stdout:8/980: creat d7/db/d21/d3b/d56/d3c/d79/d85/f130 x:0 0 0 2024-09-19T09:35:37.558 INFO:tasks.workunit.client.0.smithi112.stdout:8/981: link d7/d10/d11/c8d d7/db/d21/d2e/d42/d57/dea/c131 0 2024-09-19T09:35:37.558 INFO:tasks.workunit.client.0.smithi112.stdout:8/982: fdatasync d7/f106 0 2024-09-19T09:35:37.558 INFO:tasks.workunit.client.0.smithi112.stdout:8/983: fsync d7/db/d21/d3b/d56/d48/f95 0 2024-09-19T09:35:37.577 INFO:tasks.workunit.client.0.smithi112.stdout:8/984: dwrite d7/d10/d11/d50/f99 [0,4194304] 0 2024-09-19T09:35:37.577 INFO:tasks.workunit.client.0.smithi112.stdout:8/985: write d7/d10/d11/d50/fac [904815,128724] 0 2024-09-19T09:35:37.577 INFO:tasks.workunit.client.0.smithi112.stdout:8/986: chown d7/d10/d11/lb7 786 1 2024-09-19T09:35:37.598 INFO:tasks.workunit.client.0.smithi112.stdout:8/987: dwrite d7/d10/fd9 [0,4194304] 0 2024-09-19T09:35:37.604 INFO:tasks.workunit.client.0.smithi112.stdout:8/988: mkdir d7/d10/d11/d55/d132 0 2024-09-19T09:35:37.604 INFO:tasks.workunit.client.0.smithi112.stdout:8/989: truncate d7/d10/d11/d50/ddd/db8/fd4 377165 0 2024-09-19T09:35:37.604 INFO:tasks.workunit.client.0.smithi112.stdout:8/990: chown d7/db/d21/d72/ce7 3836 1 2024-09-19T09:35:37.604 INFO:tasks.workunit.client.0.smithi112.stdout:8/991: write d7/d67/f12e [940585,60083] 0 2024-09-19T09:35:37.607 INFO:tasks.workunit.client.0.smithi112.stdout:8/992: stat d7/d10/d11/d55/d9e/lbe 0 2024-09-19T09:35:37.609 INFO:tasks.workunit.client.0.smithi112.stdout:8/993: getdents d7/db/d21/d2e/d8c 0 2024-09-19T09:35:37.635 INFO:tasks.workunit.client.0.smithi112.stdout:8/994: dwrite d7/db/d21/d3b/d56/d48/fa8 [0,4194304] 0 2024-09-19T09:35:38.143 INFO:tasks.workunit.client.0.smithi112.stdout:0/875: sync 2024-09-19T09:35:38.143 INFO:tasks.workunit.client.0.smithi112.stdout:0/876: chown d2/d59/da1/dd4/db8/dc1/dfc/f10d 120 1 2024-09-19T09:35:38.165 INFO:tasks.workunit.client.0.smithi112.stdout:0/877: dwrite d2/f3c [4194304,4194304] 0 2024-09-19T09:35:38.165 INFO:tasks.workunit.client.0.smithi112.stdout:0/878: creat d2/d6e/da0/de6/f12b x:0 0 0 2024-09-19T09:35:38.190 INFO:tasks.workunit.client.0.smithi112.stdout:0/879: dwrite d2/d39/d3b/f3f [0,4194304] 0 2024-09-19T09:35:38.192 INFO:tasks.workunit.client.0.smithi112.stdout:0/880: getdents d2/d59/d7a/d11e 0 2024-09-19T09:35:38.192 INFO:tasks.workunit.client.0.smithi112.stdout:0/881: write d2/d45/fe3 [967090,108381] 0 2024-09-19T09:35:38.193 INFO:tasks.workunit.client.0.smithi112.stdout:0/882: truncate d2/d39/d3b/d8a/f9f 88378 0 2024-09-19T09:35:38.195 INFO:tasks.workunit.client.0.smithi112.stdout:0/883: dread d2/d39/d3b/dab/fb6 [0,4194304] 0 2024-09-19T09:35:38.197 INFO:tasks.workunit.client.0.smithi112.stdout:0/884: getdents d2/d59/da1/dd4/db8/dc1/dfc 0 2024-09-19T09:35:38.200 INFO:tasks.workunit.client.0.smithi112.stdout:0/885: dread d2/f31 [0,4194304] 0 2024-09-19T09:35:38.420 INFO:tasks.workunit.client.0.smithi112.stdout:9/727: sync 2024-09-19T09:35:38.420 INFO:tasks.workunit.client.0.smithi112.stdout:1/985: sync 2024-09-19T09:35:38.420 INFO:tasks.workunit.client.0.smithi112.stdout:8/995: sync 2024-09-19T09:35:38.420 INFO:tasks.workunit.client.0.smithi112.stdout:0/886: sync 2024-09-19T09:35:38.420 INFO:tasks.workunit.client.0.smithi112.stdout:0/887: fdatasync d2/f22 0 2024-09-19T09:35:38.422 INFO:tasks.workunit.client.0.smithi112.stdout:1/986: unlink dc/d26/d34/cef 0 2024-09-19T09:35:38.425 INFO:tasks.workunit.client.0.smithi112.stdout:8/996: creat d7/db/d21/d3b/d56/d3c/f133 x:0 0 0 2024-09-19T09:35:38.429 INFO:tasks.workunit.client.0.smithi112.stdout:1/987: symlink dc/d26/d34/d36/d68/d7d/d6a/db4/l133 0 2024-09-19T09:35:38.429 INFO:tasks.workunit.client.0.smithi112.stdout:8/997: mknod d7/db/d21/d3b/d56/c134 0 2024-09-19T09:35:38.430 INFO:tasks.workunit.client.0.smithi112.stdout:0/888: read d2/d59/d7a/f9c [3192482,4564] 0 2024-09-19T09:35:38.430 INFO:tasks.workunit.client.0.smithi112.stdout:0/889: truncate d2/d39/d116/f118 4695701 0 2024-09-19T09:35:38.432 INFO:tasks.workunit.client.0.smithi112.stdout:1/988: creat dc/d26/d34/d36/d68/d7d/dd5/f134 x:0 0 0 2024-09-19T09:35:38.432 INFO:tasks.workunit.client.0.smithi112.stdout:1/989: chown dc/d24/c22 12919676 1 2024-09-19T09:35:38.432 INFO:tasks.workunit.client.0.smithi112.stdout:1/990: creat dc/d26/d34/d4c/d55/f135 x:0 0 0 2024-09-19T09:35:38.435 INFO:tasks.workunit.client.0.smithi112.stdout:1/991: dread dc/d26/d34/d4c/d55/f87 [0,4194304] 0 2024-09-19T09:35:38.435 INFO:tasks.workunit.client.0.smithi112.stdout:1/992: chown dc/d24/lff 76 1 2024-09-19T09:35:38.436 INFO:tasks.workunit.client.0.smithi112.stdout:8/998: symlink d7/db/d21/l135 0 2024-09-19T09:35:38.437 INFO:tasks.workunit.client.0.smithi112.stdout:8/999: mknod d7/d10/d11/d55/d9e/da1/c136 0 2024-09-19T09:35:38.443 INFO:tasks.workunit.client.0.smithi112.stdout:0/890: write d2/f107 [4150766,10764] 0 2024-09-19T09:35:38.443 INFO:tasks.workunit.client.0.smithi112.stdout:0/891: write d2/d6e/da0/de6/f11a [767394,54403] 0 2024-09-19T09:35:38.447 INFO:tasks.workunit.client.0.smithi112.stdout:1/993: write dc/d26/d34/d4c/f54 [3386639,76196] 0 2024-09-19T09:35:38.447 INFO:tasks.workunit.client.0.smithi112.stdout:9/728: dwrite df/d11/d14/d19/d66/d5d/f7c [0,4194304] 0 2024-09-19T09:35:38.452 INFO:tasks.workunit.client.0.smithi112.stdout:0/892: dread d2/d59/da1/dd4/d95/db5/f1c [0,4194304] 0 2024-09-19T09:35:38.452 INFO:tasks.workunit.client.0.smithi112.stdout:0/893: fsync d2/d45/f126 0 2024-09-19T09:35:38.453 INFO:tasks.workunit.client.0.smithi112.stdout:1/994: mknod dc/d24/da2/c136 0 2024-09-19T09:35:38.457 INFO:tasks.workunit.client.0.smithi112.stdout:0/894: creat d2/d45/d104/f12c x:0 0 0 2024-09-19T09:35:38.460 INFO:tasks.workunit.client.0.smithi112.stdout:1/995: symlink dc/d26/dd0/l137 0 2024-09-19T09:35:38.462 INFO:tasks.workunit.client.0.smithi112.stdout:0/895: rename d2/d39/d3b/d8a/lb9 to d2/de9/l12d 0 2024-09-19T09:35:38.464 INFO:tasks.workunit.client.0.smithi112.stdout:0/896: dread d2/d39/d3b/f84 [0,4194304] 0 2024-09-19T09:35:38.466 INFO:tasks.workunit.client.0.smithi112.stdout:1/996: mkdir dc/d26/d44/d112/d138 0 2024-09-19T09:35:38.466 INFO:tasks.workunit.client.0.smithi112.stdout:1/997: truncate dc/d59/d73/d88/f123 166496 0 2024-09-19T09:35:38.468 INFO:tasks.workunit.client.0.smithi112.stdout:0/897: getdents d2 0 2024-09-19T09:35:38.475 INFO:tasks.workunit.client.0.smithi112.stdout:1/998: dread dc/d24/f50 [0,4194304] 0 2024-09-19T09:35:38.492 INFO:tasks.workunit.client.0.smithi112.stdout:0/898: mknod d2/d59/da1/dd4/d11d/c12e 0 2024-09-19T09:35:38.496 INFO:tasks.workunit.client.0.smithi112.stdout:1/999: unlink dc/d26/d34/d4c/f66 0 2024-09-19T09:35:38.501 INFO:tasks.workunit.client.0.smithi112.stdout:0/899: rename d2/d59/da1/dd4/d95/db5/c23 to d2/d59/da1/dd4/d95/c12f 0 2024-09-19T09:35:38.523 INFO:tasks.workunit.client.0.smithi112.stdout:0/900: dwrite d2/d59/da1/dd4/db8/deb/f111 [0,4194304] 0 2024-09-19T09:35:38.524 INFO:tasks.workunit.client.0.smithi112.stdout:0/901: creat d2/d39/d116/f130 x:0 0 0 2024-09-19T09:35:38.524 INFO:tasks.workunit.client.0.smithi112.stdout:0/902: write d2/d39/f106 [1666508,129485] 0 2024-09-19T09:35:38.524 INFO:tasks.workunit.client.0.smithi112.stdout:0/903: write d2/d59/da1/dd4/d95/db5/f99 [492093,117643] 0 2024-09-19T09:35:38.524 INFO:tasks.workunit.client.0.smithi112.stdout:0/904: write d2/d59/d7a/f8b [2906999,91770] 0 2024-09-19T09:35:38.531 INFO:tasks.workunit.client.0.smithi112.stdout:0/905: mkdir d2/d59/da1/dd4/db8/d131 0 2024-09-19T09:35:38.857 INFO:tasks.workunit.client.0.smithi112.stdout:9/729: write df/d11/d14/d19/d66/f27 [19881,37099] 0 2024-09-19T09:35:38.861 INFO:tasks.workunit.client.0.smithi112.stdout:9/730: symlink df/d11/d14/d19/d66/d99/l103 0 2024-09-19T09:35:38.891 INFO:tasks.workunit.client.0.smithi112.stdout:9/731: dwrite df/d11/d14/d19/d66/f3d [0,4194304] 0 2024-09-19T09:35:38.901 INFO:tasks.workunit.client.0.smithi112.stdout:9/732: dread df/d11/f85 [0,4194304] 0 2024-09-19T09:35:38.901 INFO:tasks.workunit.client.0.smithi112.stdout:9/733: chown df/d11/d14/d19/d40/daf/d6c/c6d 148054 1 2024-09-19T09:35:39.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:38 smithi112 ceph-mon[27605]: pgmap v31: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 120 MiB/s rd, 158 MiB/s wr, 373 op/s 2024-09-19T09:35:39.090 INFO:tasks.workunit.client.0.smithi112.stdout:9/734: sync 2024-09-19T09:35:39.090 INFO:tasks.workunit.client.0.smithi112.stdout:0/906: sync 2024-09-19T09:35:39.091 INFO:tasks.workunit.client.0.smithi112.stdout:0/907: link d2/d45/f119 d2/d59/d7a/f132 0 2024-09-19T09:35:39.095 INFO:tasks.workunit.client.0.smithi112.stdout:0/908: rename d2/l61 to d2/d59/da1/dd4/d95/l133 0 2024-09-19T09:35:39.117 INFO:tasks.workunit.client.0.smithi112.stdout:9/735: dwrite df/d11/f3c [0,4194304] 0 2024-09-19T09:35:39.120 INFO:tasks.workunit.client.0.smithi112.stdout:9/736: mkdir df/d11/d14/d19/d28/d95/d104 0 2024-09-19T09:35:39.121 INFO:tasks.workunit.client.0.smithi112.stdout:0/909: dwrite d2/f56 [0,4194304] 0 2024-09-19T09:35:39.124 INFO:tasks.workunit.client.0.smithi112.stdout:9/737: symlink df/d11/d14/d19/d40/daf/d6c/db3/d9e/l105 0 2024-09-19T09:35:39.126 INFO:tasks.workunit.client.0.smithi112.stdout:9/738: creat df/d11/d14/f106 x:0 0 0 2024-09-19T09:35:39.129 INFO:tasks.workunit.client.0.smithi112.stdout:9/739: creat df/d11/d14/d51/f107 x:0 0 0 2024-09-19T09:35:39.129 INFO:tasks.workunit.client.0.smithi112.stdout:9/740: truncate df/d11/d14/d51/f7e 1758061 0 2024-09-19T09:35:39.138 INFO:tasks.workunit.client.0.smithi112.stdout:0/910: dwrite d2/d39/d3b/d8a/f10b [0,4194304] 0 2024-09-19T09:35:39.143 INFO:tasks.workunit.client.0.smithi112.stdout:0/911: rename d2/d59/da1/dd4/fbc to d2/d39/d3b/d8a/f134 0 2024-09-19T09:35:39.143 INFO:tasks.workunit.client.0.smithi112.stdout:0/912: fdatasync d2/f4e 0 2024-09-19T09:35:39.143 INFO:tasks.workunit.client.0.smithi112.stdout:0/913: mkdir d2/d59/da1/dd4/db8/dc1/d135 0 2024-09-19T09:35:39.148 INFO:tasks.workunit.client.0.smithi112.stdout:9/741: dwrite df/d11/d14/d19/d40/daf/f6f [0,4194304] 0 2024-09-19T09:35:39.152 INFO:tasks.workunit.client.0.smithi112.stdout:0/914: dread d2/d59/d7a/f8b [0,4194304] 0 2024-09-19T09:35:39.166 INFO:tasks.workunit.client.0.smithi112.stdout:0/915: dwrite d2/d59/da1/dd4/f69 [0,4194304] 0 2024-09-19T09:35:39.166 INFO:tasks.workunit.client.0.smithi112.stdout:0/916: chown d2/d59/lfe 245 1 2024-09-19T09:35:39.168 INFO:tasks.workunit.client.0.smithi112.stdout:9/742: rmdir df/d11 39 2024-09-19T09:35:39.168 INFO:tasks.workunit.client.0.smithi112.stdout:9/743: chown df/d11/d14/d19/d40/daf/c70 123 1 2024-09-19T09:35:39.168 INFO:tasks.workunit.client.0.smithi112.stdout:9/744: truncate df/d35/fe9 1822126 0 2024-09-19T09:35:39.169 INFO:tasks.workunit.client.0.smithi112.stdout:9/745: dread - df/d11/d14/d19/de0/ff5 zero size 2024-09-19T09:35:39.169 INFO:tasks.workunit.client.0.smithi112.stdout:9/746: chown df/d11/d14/d19/l45 255621 1 2024-09-19T09:35:39.169 INFO:tasks.workunit.client.0.smithi112.stdout:0/917: creat d2/d59/da1/dd4/d11d/f136 x:0 0 0 2024-09-19T09:35:39.169 INFO:tasks.workunit.client.0.smithi112.stdout:0/918: readlink d2/d59/da1/dd4/d95/db5/l2b 0 2024-09-19T09:35:39.169 INFO:tasks.workunit.client.0.smithi112.stdout:0/919: stat d2/d39 0 2024-09-19T09:35:39.169 INFO:tasks.workunit.client.0.smithi112.stdout:9/747: creat df/d11/d14/d19/df3/f108 x:0 0 0 2024-09-19T09:35:39.171 INFO:tasks.workunit.client.0.smithi112.stdout:0/920: dread d2/d45/f4d [0,4194304] 0 2024-09-19T09:35:39.171 INFO:tasks.workunit.client.0.smithi112.stdout:0/921: dread - d2/f36 zero size 2024-09-19T09:35:39.171 INFO:tasks.workunit.client.0.smithi112.stdout:9/748: rename df/d11/d14/d19/d1e/d97/da7 to df/d11/d14/d109 0 2024-09-19T09:35:39.172 INFO:tasks.workunit.client.0.smithi112.stdout:0/922: link d2/d45/c86 d2/d59/da1/dd4/c137 0 2024-09-19T09:35:39.173 INFO:tasks.workunit.client.0.smithi112.stdout:0/923: dread - d2/d59/da1/dd4/d95/db5/f53 zero size 2024-09-19T09:35:39.174 INFO:tasks.workunit.client.0.smithi112.stdout:0/924: mknod d2/d59/d7a/c138 0 2024-09-19T09:35:39.174 INFO:tasks.workunit.client.0.smithi112.stdout:0/925: write d2/d39/d116/f130 [715374,13972] 0 2024-09-19T09:35:39.175 INFO:tasks.workunit.client.0.smithi112.stdout:0/926: read d2/f28 [170688,8315] 0 2024-09-19T09:35:39.177 INFO:tasks.workunit.client.0.smithi112.stdout:0/927: dread d2/f31 [0,4194304] 0 2024-09-19T09:35:39.178 INFO:tasks.workunit.client.0.smithi112.stdout:0/928: truncate d2/d59/da1/dd4/db8/dc1/fcf 3220187 0 2024-09-19T09:35:39.180 INFO:tasks.workunit.client.0.smithi112.stdout:0/929: mknod d2/d59/da1/dd4/db8/c139 0 2024-09-19T09:35:39.180 INFO:tasks.workunit.client.0.smithi112.stdout:0/930: readlink d2/d59/l6b 0 2024-09-19T09:35:39.181 INFO:tasks.workunit.client.0.smithi112.stdout:0/931: rmdir d2/d39/d3b/dab 39 2024-09-19T09:35:39.184 INFO:tasks.workunit.client.0.smithi112.stdout:0/932: truncate d2/d39/f9b 1358386 0 2024-09-19T09:35:39.184 INFO:tasks.workunit.client.0.smithi112.stdout:0/933: write d2/d39/d3b/dab/fd1 [213467,106040] 0 2024-09-19T09:35:39.189 INFO:tasks.workunit.client.0.smithi112.stdout:0/934: dread d2/d39/d3b/dab/fc4 [0,4194304] 0 2024-09-19T09:35:39.191 INFO:tasks.workunit.client.0.smithi112.stdout:0/935: creat d2/d39/d3b/d8a/d113/f13a x:0 0 0 2024-09-19T09:35:39.191 INFO:tasks.workunit.client.0.smithi112.stdout:0/936: chown d2/d6e/da0/f7b 1795514 1 2024-09-19T09:35:39.191 INFO:tasks.workunit.client.0.smithi112.stdout:0/937: readlink d2/d59/l9e 0 2024-09-19T09:35:39.193 INFO:tasks.workunit.client.0.smithi112.stdout:9/749: dwrite df/d11/d14/d19/d28/d89/fde [0,4194304] 0 2024-09-19T09:35:39.193 INFO:tasks.workunit.client.0.smithi112.stdout:0/938: truncate d2/f4 511311 0 2024-09-19T09:35:39.193 INFO:tasks.workunit.client.0.smithi112.stdout:0/939: chown d2/d59/da1/dd4 1652172 1 2024-09-19T09:35:39.193 INFO:tasks.workunit.client.0.smithi112.stdout:0/940: creat d2/d68/f13b x:0 0 0 2024-09-19T09:35:39.194 INFO:tasks.workunit.client.0.smithi112.stdout:0/941: chown d2/d59/da1/dd4/d95/fe0 968 1 2024-09-19T09:35:39.196 INFO:tasks.workunit.client.0.smithi112.stdout:9/750: rmdir df/d11/d14/d19/d28/d95/d104 0 2024-09-19T09:35:39.199 INFO:tasks.workunit.client.0.smithi112.stdout:0/942: truncate d2/d6e/d75/f8e 2390256 0 2024-09-19T09:35:39.199 INFO:tasks.workunit.client.0.smithi112.stdout:0/943: chown d2/d59/da1/dd4/d95/db5/f9a 1 1 2024-09-19T09:35:39.224 INFO:tasks.workunit.client.0.smithi112.stdout:9/751: dwrite df/d35/d9d/ffd [0,4194304] 0 2024-09-19T09:35:39.225 INFO:tasks.workunit.client.0.smithi112.stdout:0/944: dwrite d2/d59/da1/dd4/d11d/f136 [0,4194304] 0 2024-09-19T09:35:39.228 INFO:tasks.workunit.client.0.smithi112.stdout:9/752: creat df/db9/f10a x:0 0 0 2024-09-19T09:35:39.231 INFO:tasks.workunit.client.0.smithi112.stdout:9/753: rmdir df/d11/d14/d19/d40/daf/dec 39 2024-09-19T09:35:39.232 INFO:tasks.workunit.client.0.smithi112.stdout:9/754: write df/d35/fe9 [2397632,25323] 0 2024-09-19T09:35:39.233 INFO:tasks.workunit.client.0.smithi112.stdout:9/755: rename df/d11/d14/d19/d40/f4b to df/d35/dd1/f10b 0 2024-09-19T09:35:39.234 INFO:tasks.workunit.client.0.smithi112.stdout:9/756: truncate df/d11/d14/d19/d66/d99/fa1 91823 0 2024-09-19T09:35:39.242 INFO:tasks.workunit.client.0.smithi112.stdout:9/757: dread df/d11/d14/d19/d28/d89/fde [0,4194304] 0 2024-09-19T09:35:39.243 INFO:tasks.workunit.client.0.smithi112.stdout:9/758: symlink df/d35/dd1/l10c 0 2024-09-19T09:35:39.245 INFO:tasks.workunit.client.0.smithi112.stdout:9/759: link df/d11/d14/d19/d28/c84 df/d11/d14/d19/d1e/d97/c10d 0 2024-09-19T09:35:39.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:38 smithi191 ceph-mon[34834]: pgmap v31: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 120 MiB/s rd, 158 MiB/s wr, 373 op/s 2024-09-19T09:35:39.531 INFO:tasks.workunit.client.0.smithi112.stdout:0/945: sync 2024-09-19T09:35:39.532 INFO:tasks.workunit.client.0.smithi112.stdout:9/760: sync 2024-09-19T09:35:39.532 INFO:tasks.workunit.client.0.smithi112.stdout:9/761: write df/d35/f38 [3678860,122817] 0 2024-09-19T09:35:39.532 INFO:tasks.workunit.client.0.smithi112.stdout:9/762: write df/d11/d14/d19/d28/d95/fd7 [424113,5274] 0 2024-09-19T09:35:39.532 INFO:tasks.workunit.client.0.smithi112.stdout:9/763: fdatasync df/d11/d14/f2d 0 2024-09-19T09:35:39.533 INFO:tasks.workunit.client.0.smithi112.stdout:0/946: unlink d2/l2c 0 2024-09-19T09:35:39.534 INFO:tasks.workunit.client.0.smithi112.stdout:0/947: mkdir d2/d59/da1/dd4/d95/db5/d13c 0 2024-09-19T09:35:39.537 INFO:tasks.workunit.client.0.smithi112.stdout:0/948: symlink d2/d59/l13d 0 2024-09-19T09:35:39.557 INFO:tasks.workunit.client.0.smithi112.stdout:9/764: dwrite df/d11/d14/d19/fdc [0,4194304] 0 2024-09-19T09:35:39.557 INFO:tasks.workunit.client.0.smithi112.stdout:9/765: write df/d11/d14/d19/d66/d99/dc4/fda [269808,888] 0 2024-09-19T09:35:39.559 INFO:tasks.workunit.client.0.smithi112.stdout:0/949: dwrite d2/f3c [0,4194304] 0 2024-09-19T09:35:39.561 INFO:tasks.workunit.client.0.smithi112.stdout:0/950: read d2/d39/d116/f130 [588040,92653] 0 2024-09-19T09:35:39.563 INFO:tasks.workunit.client.0.smithi112.stdout:9/766: creat df/d11/d14/d19/d28/d95/dd5/f10e x:0 0 0 2024-09-19T09:35:39.563 INFO:tasks.workunit.client.0.smithi112.stdout:9/767: truncate df/d11/d14/d19/de0/ff7 763181 0 2024-09-19T09:35:39.564 INFO:tasks.workunit.client.0.smithi112.stdout:0/951: mkdir d2/d6e/da0/d13e 0 2024-09-19T09:35:39.568 INFO:tasks.workunit.client.0.smithi112.stdout:9/768: truncate df/d11/d14/d19/d28/f43 653247 0 2024-09-19T09:35:39.573 INFO:tasks.workunit.client.0.smithi112.stdout:9/769: getdents df/d11/d14/d19/d66/d99 0 2024-09-19T09:35:39.590 INFO:tasks.workunit.client.0.smithi112.stdout:9/770: dwrite df/d11/d14/d19/d40/d5c/fbf [0,4194304] 0 2024-09-19T09:35:39.590 INFO:tasks.workunit.client.0.smithi112.stdout:9/771: dread - df/d11/d14/d51/f107 zero size 2024-09-19T09:35:39.603 INFO:tasks.workunit.client.0.smithi112.stdout:9/772: write df/d11/d14/d19/d66/f9b [2476426,85294] 0 2024-09-19T09:35:39.608 INFO:tasks.workunit.client.0.smithi112.stdout:9/773: rename df/d11/d14/d19/d28/d89/c94 to df/c10f 0 2024-09-19T09:35:39.609 INFO:tasks.workunit.client.0.smithi112.stdout:9/774: getdents df/d11/d14 0 2024-09-19T09:35:39.610 INFO:tasks.workunit.client.0.smithi112.stdout:9/775: rmdir df/d11/d14/d19/d40/daf/dec 39 2024-09-19T09:35:39.613 INFO:tasks.workunit.client.0.smithi112.stdout:9/776: mknod df/d11/d14/d19/d28/d95/c110 0 2024-09-19T09:35:39.613 INFO:tasks.workunit.client.0.smithi112.stdout:9/777: write df/d11/d14/d19/d66/f4a [3404871,219] 0 2024-09-19T09:35:39.613 INFO:tasks.workunit.client.0.smithi112.stdout:9/778: chown df/d11/d14/d19/d28/d89/lb0 1 1 2024-09-19T09:35:39.613 INFO:tasks.workunit.client.0.smithi112.stdout:9/779: chown df/d11/d14/d19/d28/c98 1 1 2024-09-19T09:35:39.625 INFO:tasks.workunit.client.0.smithi112.stdout:9/780: read df/d11/d14/d19/d28/d95/fb1 [247568,4723] 0 2024-09-19T09:35:39.625 INFO:tasks.workunit.client.0.smithi112.stdout:9/781: write df/d11/d14/d19/d28/d95/dd5/f10e [947691,27525] 0 2024-09-19T09:35:39.629 INFO:tasks.workunit.client.0.smithi112.stdout:9/782: mkdir df/d11/d14/d19/d66/d5d/d111 0 2024-09-19T09:35:39.630 INFO:tasks.workunit.client.0.smithi112.stdout:9/783: chown df/d11/d14/d19/d40/d5c/c7d 2 1 2024-09-19T09:35:39.634 INFO:tasks.workunit.client.0.smithi112.stdout:9/784: mkdir df/d11/d14/d19/d40/daf/d6c/db3/d9e/df2/d112 0 2024-09-19T09:35:39.637 INFO:tasks.workunit.client.0.smithi112.stdout:9/785: creat df/d11/d14/d19/d1e/d97/f113 x:0 0 0 2024-09-19T09:35:39.641 INFO:tasks.workunit.client.0.smithi112.stdout:9/786: creat df/d11/d14/d19/d1e/f114 x:0 0 0 2024-09-19T09:35:40.107 INFO:tasks.workunit.client.0.smithi112.stdout:9/787: sync 2024-09-19T09:35:40.108 INFO:tasks.workunit.client.0.smithi112.stdout:0/952: sync 2024-09-19T09:35:40.108 INFO:tasks.workunit.client.0.smithi112.stdout:0/953: chown d2/d59/da1/dd4/d95/c12f 164937460 1 2024-09-19T09:35:40.108 INFO:tasks.workunit.client.0.smithi112.stdout:9/788: mknod df/d11/d14/d19/d66/d5d/d111/c115 0 2024-09-19T09:35:40.108 INFO:tasks.workunit.client.0.smithi112.stdout:0/954: stat d2/d59/c103 0 2024-09-19T09:35:40.110 INFO:tasks.workunit.client.0.smithi112.stdout:9/789: creat df/d11/d14/d19/d40/daf/d6c/f116 x:0 0 0 2024-09-19T09:35:40.110 INFO:tasks.workunit.client.0.smithi112.stdout:9/790: write df/d11/d14/d19/df3/f108 [854774,66312] 0 2024-09-19T09:35:40.112 INFO:tasks.workunit.client.0.smithi112.stdout:0/955: dread d2/f4 [0,4194304] 0 2024-09-19T09:35:40.117 INFO:tasks.workunit.client.0.smithi112.stdout:0/956: rename d2/f31 to d2/f13f 0 2024-09-19T09:35:40.117 INFO:tasks.workunit.client.0.smithi112.stdout:0/957: fsync d2/d45/f54 0 2024-09-19T09:35:40.467 INFO:tasks.workunit.client.0.smithi112.stdout:0/958: sync 2024-09-19T09:35:40.468 INFO:tasks.workunit.client.0.smithi112.stdout:9/791: sync 2024-09-19T09:35:40.477 INFO:tasks.workunit.client.0.smithi112.stdout:9/792: write df/d11/d14/d19/d66/f3d [1634677,30795] 0 2024-09-19T09:35:40.477 INFO:tasks.workunit.client.0.smithi112.stdout:0/959: dread d2/f1f [0,4194304] 0 2024-09-19T09:35:40.478 INFO:tasks.workunit.client.0.smithi112.stdout:0/960: truncate d2/d39/f46 3906110 0 2024-09-19T09:35:40.479 INFO:tasks.workunit.client.0.smithi112.stdout:0/961: chown d2/d68/fce 1 1 2024-09-19T09:35:40.482 INFO:tasks.workunit.client.0.smithi112.stdout:0/962: unlink d2/d59/da1/dd4/d95/f98 0 2024-09-19T09:35:40.484 INFO:tasks.workunit.client.0.smithi112.stdout:0/963: mkdir d2/d45/d140 0 2024-09-19T09:35:40.494 INFO:tasks.workunit.client.0.smithi112.stdout:0/964: read d2/d6e/d75/f8e [1200544,113790] 0 2024-09-19T09:35:40.505 INFO:tasks.workunit.client.0.smithi112.stdout:0/965: symlink d2/d59/da1/dd4/l141 0 2024-09-19T09:35:40.507 INFO:tasks.workunit.client.0.smithi112.stdout:0/966: creat d2/d6e/da0/d13e/f142 x:0 0 0 2024-09-19T09:35:40.507 INFO:tasks.workunit.client.0.smithi112.stdout:0/967: chown d2/d6e/d75/f120 1009 1 2024-09-19T09:35:40.526 INFO:tasks.workunit.client.0.smithi112.stdout:0/968: dwrite d2/d59/da1/dd4/d95/db5/f1c [0,4194304] 0 2024-09-19T09:35:40.527 INFO:tasks.workunit.client.0.smithi112.stdout:0/969: symlink d2/d6e/d6f/l143 0 2024-09-19T09:35:40.527 INFO:tasks.workunit.client.0.smithi112.stdout:0/970: dread - d2/d59/da1/dd4/d95/db5/f10f zero size 2024-09-19T09:35:40.527 INFO:tasks.workunit.client.0.smithi112.stdout:0/971: creat d2/d59/da1/f144 x:0 0 0 2024-09-19T09:35:40.529 INFO:tasks.workunit.client.0.smithi112.stdout:0/972: creat d2/d59/da1/dd4/f145 x:0 0 0 2024-09-19T09:35:40.532 INFO:tasks.workunit.client.0.smithi112.stdout:0/973: rmdir d2/d59/d7a 39 2024-09-19T09:35:40.532 INFO:tasks.workunit.client.0.smithi112.stdout:0/974: getdents d2/d59/d7a/d11e 0 2024-09-19T09:35:40.535 INFO:tasks.workunit.client.0.smithi112.stdout:0/975: getdents d2/d59/da1/dd4/d95 0 2024-09-19T09:35:40.535 INFO:tasks.workunit.client.0.smithi112.stdout:0/976: chown d2/d59/da1/dd4/l141 6915127 1 2024-09-19T09:35:40.538 INFO:tasks.workunit.client.0.smithi112.stdout:0/977: rename d2/d59/f85 to d2/d6e/da0/de6/f146 0 2024-09-19T09:35:40.538 INFO:tasks.workunit.client.0.smithi112.stdout:0/978: fdatasync d2/d59/da1/dd4/d95/fef 0 2024-09-19T09:35:40.538 INFO:tasks.workunit.client.0.smithi112.stdout:0/979: fdatasync d2/d6e/da0/de6/f12b 0 2024-09-19T09:35:40.539 INFO:tasks.workunit.client.0.smithi112.stdout:0/980: mkdir d2/d6e/d75/d147 0 2024-09-19T09:35:40.541 INFO:tasks.workunit.client.0.smithi112.stdout:0/981: mknod d2/d59/da1/dd4/db8/dc1/d135/c148 0 2024-09-19T09:35:40.541 INFO:tasks.workunit.client.0.smithi112.stdout:0/982: write d2/d39/d116/f130 [529261,23556] 0 2024-09-19T09:35:40.545 INFO:tasks.workunit.client.0.smithi112.stdout:0/983: rename d2/f28 to d2/d68/f149 0 2024-09-19T09:35:40.547 INFO:tasks.workunit.client.0.smithi112.stdout:0/984: symlink d2/d39/d3b/dab/df8/l14a 0 2024-09-19T09:35:40.547 INFO:tasks.workunit.client.0.smithi112.stdout:0/985: creat d2/d39/d116/f14b x:0 0 0 2024-09-19T09:35:40.563 INFO:tasks.workunit.client.0.smithi112.stdout:0/986: dwrite d2/d39/d3b/dab/fd1 [0,4194304] 0 2024-09-19T09:35:40.566 INFO:tasks.workunit.client.0.smithi112.stdout:0/987: unlink d2/d39/f9b 0 2024-09-19T09:35:40.566 INFO:tasks.workunit.client.0.smithi112.stdout:0/988: chown d2/d59/da1/dd4/d11d 110051555 1 2024-09-19T09:35:40.566 INFO:tasks.workunit.client.0.smithi112.stdout:0/989: stat d2/d59/da1/ff3 0 2024-09-19T09:35:40.567 INFO:tasks.workunit.client.0.smithi112.stdout:0/990: creat d2/f14c x:0 0 0 2024-09-19T09:35:40.567 INFO:tasks.workunit.client.0.smithi112.stdout:0/991: creat d2/d45/d140/f14d x:0 0 0 2024-09-19T09:35:40.568 INFO:tasks.workunit.client.0.smithi112.stdout:0/992: chown d2/d68/f124 22901818 1 2024-09-19T09:35:40.571 INFO:tasks.workunit.client.0.smithi112.stdout:0/993: rename d2/d59/da1/dd4/d95 to d2/d59/da1/d14e 0 2024-09-19T09:35:40.571 INFO:tasks.workunit.client.0.smithi112.stdout:0/994: stat d2/f110 0 2024-09-19T09:35:40.572 INFO:tasks.workunit.client.0.smithi112.stdout:0/995: fdatasync d2/d39/d116/f130 0 2024-09-19T09:35:40.573 INFO:tasks.workunit.client.0.smithi112.stdout:0/996: stat d2/d39/d3b/dab 0 2024-09-19T09:35:40.573 INFO:tasks.workunit.client.0.smithi112.stdout:0/997: fsync d2/d59/da1/dd4/db8/dc1/dfc/f10d 0 2024-09-19T09:35:40.576 INFO:tasks.workunit.client.0.smithi112.stdout:0/998: link d2/d59/da1/dd4/d11d/c123 d2/de9/c14f 0 2024-09-19T09:35:40.577 INFO:tasks.workunit.client.0.smithi112.stdout:0/999: truncate d2/d68/f149 382973 0 2024-09-19T09:35:40.849 INFO:tasks.workunit.client.0.smithi112.stdout:9/793: sync 2024-09-19T09:35:40.853 INFO:tasks.workunit.client.0.smithi112.stdout:9/794: symlink df/d35/d9d/l117 0 2024-09-19T09:35:40.853 INFO:tasks.workunit.client.0.smithi112.stdout:9/795: creat df/d11/d14/d19/de0/f118 x:0 0 0 2024-09-19T09:35:40.853 INFO:tasks.workunit.client.0.smithi112.stdout:9/796: creat df/d35/d9d/f119 x:0 0 0 2024-09-19T09:35:40.853 INFO:tasks.workunit.client.0.smithi112.stdout:9/797: creat df/d11/d14/d19/d66/d99/f11a x:0 0 0 2024-09-19T09:35:40.854 INFO:tasks.workunit.client.0.smithi112.stdout:9/798: write df/d11/d14/f44 [3651641,75252] 0 2024-09-19T09:35:40.855 INFO:tasks.workunit.client.0.smithi112.stdout:9/799: mkdir df/d11/d14/d19/d40/daf/dec/d11b 0 2024-09-19T09:35:40.856 INFO:tasks.workunit.client.0.smithi112.stdout:9/800: unlink df/d35/dd1/l10c 0 2024-09-19T09:35:40.887 INFO:tasks.workunit.client.0.smithi112.stdout:9/801: dwrite df/d11/d14/d19/d66/d99/fa1 [0,4194304] 0 2024-09-19T09:35:40.889 INFO:tasks.workunit.client.0.smithi112.stdout:9/802: chown df/d11/c17 23088 1 2024-09-19T09:35:40.889 INFO:tasks.workunit.client.0.smithi112.stdout:9/803: fsync df/f61 0 2024-09-19T09:35:40.889 INFO:tasks.workunit.client.0.smithi112.stdout:9/804: chown df/d11/d14/d19/d1e/f69 13125227 1 2024-09-19T09:35:40.895 INFO:tasks.workunit.client.0.smithi112.stdout:9/805: dread df/d11/d14/d19/d66/f3d [0,4194304] 0 2024-09-19T09:35:40.896 INFO:tasks.workunit.client.0.smithi112.stdout:9/806: creat df/d11/f11c x:0 0 0 2024-09-19T09:35:40.896 INFO:tasks.workunit.client.0.smithi112.stdout:9/807: write df/d11/d14/d19/de0/ff5 [83731,74085] 0 2024-09-19T09:35:40.914 INFO:tasks.workunit.client.0.smithi112.stdout:9/808: dwrite df/d11/d14/d51/fdd [0,4194304] 0 2024-09-19T09:35:40.915 INFO:tasks.workunit.client.0.smithi112.stdout:9/809: chown df/d11/d14/d19/d40/daf/d6c/db3/d9e/l105 30 1 2024-09-19T09:35:40.922 INFO:tasks.workunit.client.0.smithi112.stdout:9/810: dread df/d11/d14/d19/d66/f9b [0,4194304] 0 2024-09-19T09:35:40.923 INFO:tasks.workunit.client.0.smithi112.stdout:9/811: symlink df/d11/d14/d19/d40/daf/dec/d11b/l11d 0 2024-09-19T09:35:40.925 INFO:tasks.workunit.client.0.smithi112.stdout:9/812: symlink df/d35/l11e 0 2024-09-19T09:35:40.925 INFO:tasks.workunit.client.0.smithi112.stdout:9/813: write df/d11/d14/d19/de0/ff5 [634177,115652] 0 2024-09-19T09:35:40.934 INFO:tasks.workunit.client.0.smithi112.stdout:9/814: dread df/d11/d14/d19/d66/d99/fa1 [0,4194304] 0 2024-09-19T09:35:40.934 INFO:tasks.workunit.client.0.smithi112.stdout:9/815: readlink df/d11/d14/d19/d40/l67 0 2024-09-19T09:35:40.934 INFO:tasks.workunit.client.0.smithi112.stdout:9/816: write df/d11/d14/f106 [114887,83346] 0 2024-09-19T09:35:40.934 INFO:tasks.workunit.client.0.smithi112.stdout:9/817: readlink df/dc1/lcc 0 2024-09-19T09:35:40.948 INFO:tasks.workunit.client.0.smithi112.stdout:9/818: dwrite df/d11/d14/d19/d28/d95/dd5/fd9 [0,4194304] 0 2024-09-19T09:35:40.953 INFO:tasks.workunit.client.0.smithi112.stdout:9/819: rmdir df/d11/d14/d19/d28/d95/dd5 39 2024-09-19T09:35:40.955 INFO:tasks.workunit.client.0.smithi112.stdout:9/820: creat df/d11/d14/d19/d66/f11f x:0 0 0 2024-09-19T09:35:40.956 INFO:tasks.workunit.client.0.smithi112.stdout:9/821: link df/d11/d14/d19/d28/d95/fd7 df/d11/d14/d19/d28/d95/f120 0 2024-09-19T09:35:40.956 INFO:tasks.workunit.client.0.smithi112.stdout:9/822: fsync df/d11/d14/d19/d28/d95/fb1 0 2024-09-19T09:35:40.957 INFO:tasks.workunit.client.0.smithi112.stdout:9/823: symlink df/d11/d14/d19/l121 0 2024-09-19T09:35:40.957 INFO:tasks.workunit.client.0.smithi112.stdout:9/824: write df/d11/d14/d19/d66/f3d [9177763,109424] 0 2024-09-19T09:35:40.958 INFO:tasks.workunit.client.0.smithi112.stdout:9/825: unlink df/d11/d14/d19/d66/d99/l103 0 2024-09-19T09:35:40.959 INFO:tasks.workunit.client.0.smithi112.stdout:9/826: mknod df/d11/d14/d19/d40/c122 0 2024-09-19T09:35:40.960 INFO:tasks.workunit.client.0.smithi112.stdout:9/827: creat df/d11/d14/d19/d28/f123 x:0 0 0 2024-09-19T09:35:40.975 INFO:tasks.workunit.client.0.smithi112.stdout:9/828: dwrite df/d11/d14/d19/d40/daf/d6c/db3/fc3 [0,4194304] 0 2024-09-19T09:35:40.977 INFO:tasks.workunit.client.0.smithi112.stdout:9/829: mknod df/d11/d14/d19/d28/d95/dd5/c124 0 2024-09-19T09:35:40.979 INFO:tasks.workunit.client.0.smithi112.stdout:9/830: unlink df/d11/d14/d19/d28/d95/c110 0 2024-09-19T09:35:40.987 INFO:tasks.workunit.client.0.smithi112.stdout:9/831: read df/d11/d14/d19/d28/d95/dd5/fd9 [372876,74137] 0 2024-09-19T09:35:40.988 INFO:tasks.workunit.client.0.smithi112.stdout:9/832: mknod df/d11/d14/d19/d40/c125 0 2024-09-19T09:35:40.988 INFO:tasks.workunit.client.0.smithi112.stdout:9/833: write df/d11/d14/d19/d40/f4e [2078175,18644] 0 2024-09-19T09:35:40.989 INFO:tasks.workunit.client.0.smithi112.stdout:9/834: mkdir df/d11/d14/d19/d126 0 2024-09-19T09:35:40.990 INFO:tasks.workunit.client.0.smithi112.stdout:9/835: rename df/d11/d14/d19/d40/d5c/ff1 to df/db9/f127 0 2024-09-19T09:35:40.991 INFO:tasks.workunit.client.0.smithi112.stdout:9/836: fsync df/d11/d14/d19/d40/dc7/f100 0 2024-09-19T09:35:40.991 INFO:tasks.workunit.client.0.smithi112.stdout:9/837: creat df/d35/d9d/f128 x:0 0 0 2024-09-19T09:35:40.993 INFO:tasks.workunit.client.0.smithi112.stdout:9/838: dread df/d11/f5b [0,4194304] 0 2024-09-19T09:35:40.993 INFO:tasks.workunit.client.0.smithi112.stdout:9/839: write df/d11/d14/d19/d40/daf/d6c/db3/f9c [233595,20616] 0 2024-09-19T09:35:40.994 INFO:tasks.workunit.client.0.smithi112.stdout:9/840: symlink df/l129 0 2024-09-19T09:35:41.010 INFO:tasks.workunit.client.0.smithi112.stdout:9/841: dwrite df/d11/d14/d19/d28/fe8 [0,4194304] 0 2024-09-19T09:35:41.011 INFO:tasks.workunit.client.0.smithi112.stdout:9/842: truncate df/d11/d14/d19/d66/f4a 40830 0 2024-09-19T09:35:41.013 INFO:tasks.workunit.client.0.smithi112.stdout:9/843: rename df/d11/d14/d19/d28/d95 to df/d11/d14/d19/d40/d5c/d12a 0 2024-09-19T09:35:41.015 INFO:tasks.workunit.client.0.smithi112.stdout:9/844: link df/d11/d14/d19/d1e/l50 df/d11/d14/d19/d66/d99/dc4/l12b 0 2024-09-19T09:35:41.016 INFO:tasks.workunit.client.0.smithi112.stdout:9/845: truncate df/d11/d14/d19/d40/daf/d6c/db3/fa6 4280216 0 2024-09-19T09:35:41.016 INFO:tasks.workunit.client.0.smithi112.stdout:9/846: stat df/d11/d14/d19/d40/daf/d6c/db3/cf0 0 2024-09-19T09:35:41.018 INFO:tasks.workunit.client.0.smithi112.stdout:9/847: creat df/d11/d14/d19/d66/d5d/f12c x:0 0 0 2024-09-19T09:35:41.019 INFO:tasks.workunit.client.0.smithi112.stdout:9/848: mkdir df/d11/d14/d19/de0/d12d 0 2024-09-19T09:35:41.020 INFO:tasks.workunit.client.0.smithi112.stdout:9/849: mkdir df/d11/d14/d19/d12e 0 2024-09-19T09:35:41.020 INFO:tasks.workunit.client.0.smithi112.stdout:9/850: fsync df/d11/d14/d51/f7e 0 2024-09-19T09:35:41.021 INFO:tasks.workunit.client.0.smithi112.stdout:9/851: truncate df/d11/d14/d19/d40/daf/d6c/db3/fc3 247513 0 2024-09-19T09:35:41.023 INFO:tasks.workunit.client.0.smithi112.stdout:9/852: truncate df/d11/d14/f3b 1394917 0 2024-09-19T09:35:41.025 INFO:tasks.workunit.client.0.smithi112.stdout:9/853: rename df/d11/d14/d19/d40/c122 to df/d11/d14/d19/d66/d99/dc4/c12f 0 2024-09-19T09:35:41.025 INFO:tasks.workunit.client.0.smithi112.stdout:9/854: chown df/d11/d14/d19/d40/daf/d6c/c6d 49404505 1 2024-09-19T09:35:41.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:40 smithi112 ceph-mon[27605]: pgmap v32: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 149 MiB/s rd, 188 MiB/s wr, 499 op/s 2024-09-19T09:35:41.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:40 smithi191 ceph-mon[34834]: pgmap v32: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 149 MiB/s rd, 188 MiB/s wr, 499 op/s 2024-09-19T09:35:41.571 INFO:tasks.workunit.client.0.smithi112.stdout:9/855: sync 2024-09-19T09:35:41.571 INFO:tasks.workunit.client.0.smithi112.stdout:9/856: chown df/d11/d14/f44 63171996 1 2024-09-19T09:35:41.571 INFO:tasks.workunit.client.0.smithi112.stdout:9/857: chown df/d11/d14/d19/d40/daf/c76 3 1 2024-09-19T09:35:41.573 INFO:tasks.workunit.client.0.smithi112.stdout:9/858: truncate df/d11/d14/f18 8223089 0 2024-09-19T09:35:41.574 INFO:tasks.workunit.client.0.smithi112.stdout:9/859: truncate df/d11/d14/d19/d40/f4e 2915883 0 2024-09-19T09:35:41.576 INFO:tasks.workunit.client.0.smithi112.stdout:9/860: creat df/d11/d14/d19/d40/f130 x:0 0 0 2024-09-19T09:35:41.576 INFO:tasks.workunit.client.0.smithi112.stdout:9/861: stat df/d11/d14/d19/d40/d5c/d12a 0 2024-09-19T09:35:41.577 INFO:tasks.workunit.client.0.smithi112.stdout:9/862: creat df/d11/d14/d19/de0/d12d/f131 x:0 0 0 2024-09-19T09:35:41.580 INFO:tasks.workunit.client.0.smithi112.stdout:9/863: rename df/l129 to df/d11/d14/d19/dc0/l132 0 2024-09-19T09:35:41.583 INFO:tasks.workunit.client.0.smithi112.stdout:9/864: rename df/dc1/lcc to df/d11/d14/d19/de0/l133 0 2024-09-19T09:35:41.584 INFO:tasks.workunit.client.0.smithi112.stdout:9/865: readlink df/d11/d14/d19/l45 0 2024-09-19T09:35:41.591 INFO:tasks.workunit.client.0.smithi112.stdout:9/866: rename df/d11/f85 to df/d11/d14/d19/d12e/f134 0 2024-09-19T09:35:41.595 INFO:tasks.workunit.client.0.smithi112.stdout:9/867: creat df/d11/d14/d19/d40/d5c/f135 x:0 0 0 2024-09-19T09:35:41.597 INFO:tasks.workunit.client.0.smithi112.stdout:9/868: creat df/d11/d14/d19/dc0/f136 x:0 0 0 2024-09-19T09:35:41.600 INFO:tasks.workunit.client.0.smithi112.stdout:9/869: mknod df/d11/d14/d19/d40/daf/d6c/db3/d9e/df2/c137 0 2024-09-19T09:35:41.601 INFO:tasks.workunit.client.0.smithi112.stdout:9/870: symlink df/d35/dd1/l138 0 2024-09-19T09:35:41.620 INFO:tasks.workunit.client.0.smithi112.stdout:9/871: getdents df/d11/d14/d19/d40/d5c 0 2024-09-19T09:35:41.620 INFO:tasks.workunit.client.0.smithi112.stdout:9/872: dread - df/d11/d14/d19/d40/f102 zero size 2024-09-19T09:35:41.622 INFO:tasks.workunit.client.0.smithi112.stdout:9/873: creat df/d11/d14/d19/d40/dea/f139 x:0 0 0 2024-09-19T09:35:41.625 INFO:tasks.workunit.client.0.smithi112.stdout:9/874: mkdir df/d11/d14/d19/d28/d89/d13a 0 2024-09-19T09:35:41.644 INFO:tasks.workunit.client.0.smithi112.stdout:9/875: dwrite df/d11/d14/d19/d40/d5c/f135 [0,4194304] 0 2024-09-19T09:35:41.648 INFO:tasks.workunit.client.0.smithi112.stdout:9/876: symlink df/d11/d14/d19/d40/d5c/d12a/dd5/l13b 0 2024-09-19T09:35:42.155 INFO:tasks.workunit.client.0.smithi112.stdout:9/877: sync 2024-09-19T09:35:42.420 INFO:tasks.workunit.client.0.smithi112.stdout:9/878: sync 2024-09-19T09:35:42.420 INFO:tasks.workunit.client.0.smithi112.stdout:9/879: fdatasync df/d11/d14/f4c 0 2024-09-19T09:35:42.420 INFO:tasks.workunit.client.0.smithi112.stdout:9/880: readlink df/d11/d14/d19/d40/lc5 0 2024-09-19T09:35:42.420 INFO:tasks.workunit.client.0.smithi112.stdout:9/881: readlink df/d35/l86 0 2024-09-19T09:35:42.421 INFO:tasks.workunit.client.0.smithi112.stdout:9/882: mknod df/d11/d14/d19/d40/daf/dec/c13c 0 2024-09-19T09:35:42.422 INFO:tasks.workunit.client.0.smithi112.stdout:9/883: mknod df/d11/d14/d19/d66/d5d/c13d 0 2024-09-19T09:35:42.423 INFO:tasks.workunit.client.0.smithi112.stdout:9/884: creat df/d11/d14/d19/d126/f13e x:0 0 0 2024-09-19T09:35:42.428 INFO:tasks.workunit.client.0.smithi112.stdout:9/885: dread df/d11/d14/d19/d40/f4e [0,4194304] 0 2024-09-19T09:35:42.446 INFO:tasks.workunit.client.0.smithi112.stdout:9/886: dwrite df/d35/dd1/f10b [4194304,4194304] 0 2024-09-19T09:35:42.450 INFO:tasks.workunit.client.0.smithi112.stdout:9/887: unlink df/d11/d14/d19/d40/daf/c76 0 2024-09-19T09:35:42.454 INFO:tasks.workunit.client.0.smithi112.stdout:9/888: creat df/d11/d14/d19/d40/d5c/f13f x:0 0 0 2024-09-19T09:35:42.454 INFO:tasks.workunit.client.0.smithi112.stdout:9/889: stat df/d11/d14/d19/d1e/f88 0 2024-09-19T09:35:42.454 INFO:tasks.workunit.client.0.smithi112.stdout:9/890: write df/d11/d14/d19/d66/f27 [3704262,128374] 0 2024-09-19T09:35:42.463 INFO:tasks.workunit.client.0.smithi112.stdout:9/891: write df/d11/d14/d19/d40/daf/d6c/f80 [2307143,66351] 0 2024-09-19T09:35:42.465 INFO:tasks.workunit.client.0.smithi112.stdout:9/892: truncate df/d11/d14/d19/d40/d5c/d12a/dd5/fd9 1643143 0 2024-09-19T09:35:42.467 INFO:tasks.workunit.client.0.smithi112.stdout:9/893: mkdir df/d11/d14/d109/d140 0 2024-09-19T09:35:42.467 INFO:tasks.workunit.client.0.smithi112.stdout:9/894: truncate df/d11/d14/d19/d40/daf/d6c/db3/fc3 1270998 0 2024-09-19T09:35:42.468 INFO:tasks.workunit.client.0.smithi112.stdout:9/895: readlink df/d11/d14/d19/de0/l133 0 2024-09-19T09:35:42.468 INFO:tasks.workunit.client.0.smithi112.stdout:9/896: write df/d11/f3c [4900725,4578] 0 2024-09-19T09:35:42.485 INFO:tasks.workunit.client.0.smithi112.stdout:9/897: dwrite df/d11/d14/d19/d40/fb4 [0,4194304] 0 2024-09-19T09:35:42.501 INFO:tasks.workunit.client.0.smithi112.stdout:9/898: dwrite df/d11/d14/d19/d28/d89/fc2 [4194304,4194304] 0 2024-09-19T09:35:42.501 INFO:tasks.workunit.client.0.smithi112.stdout:9/899: write df/d11/d14/d109/fac [638244,70127] 0 2024-09-19T09:35:42.509 INFO:tasks.workunit.client.0.smithi112.stdout:9/900: dread df/d35/d9d/ffd [0,4194304] 0 2024-09-19T09:35:42.511 INFO:tasks.workunit.client.0.smithi112.stdout:9/901: rename df/d35/d9d/l117 to df/d11/d14/l141 0 2024-09-19T09:35:42.511 INFO:tasks.workunit.client.0.smithi112.stdout:9/902: fdatasync df/d11/d14/d19/d66/f11f 0 2024-09-19T09:35:42.511 INFO:tasks.workunit.client.0.smithi112.stdout:9/903: write df/d11/d14/fe3 [408161,69734] 0 2024-09-19T09:35:42.511 INFO:tasks.workunit.client.0.smithi112.stdout:9/904: chown df/d35/fa0 97408944 1 2024-09-19T09:35:42.512 INFO:tasks.workunit.client.0.smithi112.stdout:9/905: creat df/d35/d9d/db7/f142 x:0 0 0 2024-09-19T09:35:42.513 INFO:tasks.workunit.client.0.smithi112.stdout:9/906: creat df/d11/d14/d19/d40/dc7/f143 x:0 0 0 2024-09-19T09:35:42.531 INFO:tasks.workunit.client.0.smithi112.stdout:9/907: mknod df/d11/d14/d19/d40/daf/d6c/db3/d9e/df2/d112/c144 0 2024-09-19T09:35:42.557 INFO:tasks.workunit.client.0.smithi112.stdout:9/908: dwrite df/d11/d14/d19/d1e/f7b [0,4194304] 0 2024-09-19T09:35:42.560 INFO:tasks.workunit.client.0.smithi112.stdout:9/909: mkdir df/d35/d9d/db7/d145 0 2024-09-19T09:35:42.563 INFO:tasks.workunit.client.0.smithi112.stdout:9/910: unlink df/d11/c1b 0 2024-09-19T09:35:42.563 INFO:tasks.workunit.client.0.smithi112.stdout:9/911: fdatasync df/d11/d14/f2d 0 2024-09-19T09:35:42.564 INFO:tasks.workunit.client.0.smithi112.stdout:9/912: rename df/d11/d14/l4f to df/d11/d14/d19/d40/daf/d6c/l146 0 2024-09-19T09:35:42.564 INFO:tasks.workunit.client.0.smithi112.stdout:9/913: chown df/d11/d14/d19/d28/cbb 25 1 2024-09-19T09:35:42.565 INFO:tasks.workunit.client.0.smithi112.stdout:9/914: creat df/d11/d14/d19/d66/d5d/f147 x:0 0 0 2024-09-19T09:35:42.565 INFO:tasks.workunit.client.0.smithi112.stdout:9/915: readlink df/d35/l47 0 2024-09-19T09:35:42.565 INFO:tasks.workunit.client.0.smithi112.stdout:9/916: mknod df/d11/d14/d19/d40/daf/c148 0 2024-09-19T09:35:42.565 INFO:tasks.workunit.client.0.smithi112.stdout:9/917: chown df/d11/d14/d19/d126/f13e 21 1 2024-09-19T09:35:42.566 INFO:tasks.workunit.client.0.smithi112.stdout:9/918: creat df/db9/f149 x:0 0 0 2024-09-19T09:35:42.566 INFO:tasks.workunit.client.0.smithi112.stdout:9/919: creat df/d11/d14/d19/de0/d12d/f14a x:0 0 0 2024-09-19T09:35:42.567 INFO:tasks.workunit.client.0.smithi112.stdout:9/920: link df/d11/d14/d109/fac df/d11/d14/d19/d28/d89/f14b 0 2024-09-19T09:35:42.588 INFO:tasks.workunit.client.0.smithi112.stdout:9/921: dwrite df/d11/d14/d19/d40/daf/d6c/f80 [4194304,4194304] 0 2024-09-19T09:35:42.588 INFO:tasks.workunit.client.0.smithi112.stdout:9/922: chown df/d35/c78 120684182 1 2024-09-19T09:35:42.593 INFO:tasks.workunit.client.0.smithi112.stdout:9/923: rename df/d11/d14/d19/d66/d5d/cd3 to df/d11/d14/d19/df3/c14c 0 2024-09-19T09:35:42.593 INFO:tasks.workunit.client.0.smithi112.stdout:9/924: creat df/d11/d14/d19/d40/d5c/f14d x:0 0 0 2024-09-19T09:35:42.593 INFO:tasks.workunit.client.0.smithi112.stdout:9/925: link df/d11/d14/d19/d40/daf/c148 df/d11/d14/d19/d40/daf/dec/d11b/c14e 0 2024-09-19T09:35:42.611 INFO:tasks.workunit.client.0.smithi112.stdout:9/926: dwrite df/d11/d14/d19/d40/fb4 [0,4194304] 0 2024-09-19T09:35:42.625 INFO:tasks.workunit.client.0.smithi112.stdout:9/927: dwrite df/d11/d14/d19/d28/fe8 [4194304,4194304] 0 2024-09-19T09:35:42.628 INFO:tasks.workunit.client.0.smithi112.stdout:9/928: rmdir df/d11/d14/d19/d1e/d97 39 2024-09-19T09:35:42.630 INFO:tasks.workunit.client.0.smithi112.stdout:9/929: getdents df/d11/d14/d19/d40/daf/d6c/db3/d9e/df2/d112 0 2024-09-19T09:35:42.630 INFO:tasks.workunit.client.0.smithi112.stdout:9/930: creat df/d11/d14/d19/d40/d5c/f14f x:0 0 0 2024-09-19T09:35:42.639 INFO:tasks.workunit.client.0.smithi112.stdout:9/931: dread df/d11/d14/d19/d40/d5c/d12a/fad [0,4194304] 0 2024-09-19T09:35:42.640 INFO:tasks.workunit.client.0.smithi112.stdout:9/932: symlink df/d11/d14/d19/de0/l150 0 2024-09-19T09:35:42.641 INFO:tasks.workunit.client.0.smithi112.stdout:9/933: symlink df/d11/d14/d19/d40/daf/d6c/db3/d9e/l151 0 2024-09-19T09:35:42.927 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:42 smithi112 ceph-mon[27605]: pgmap v33: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 83 MiB/s rd, 108 MiB/s wr, 343 op/s 2024-09-19T09:35:42.928 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:35:43.077 INFO:tasks.workunit.client.0.smithi112.stdout:9/934: sync 2024-09-19T09:35:43.078 INFO:tasks.workunit.client.0.smithi112.stdout:9/935: mknod df/d11/d14/d19/de0/c152 0 2024-09-19T09:35:43.079 INFO:tasks.workunit.client.0.smithi112.stdout:9/936: read - df/d11/d14/d19/d126/f13e zero size 2024-09-19T09:35:43.079 INFO:tasks.workunit.client.0.smithi112.stdout:9/937: symlink df/l153 0 2024-09-19T09:35:43.081 INFO:tasks.workunit.client.0.smithi112.stdout:9/938: creat df/d11/d14/d19/d40/daf/dec/d11b/f154 x:0 0 0 2024-09-19T09:35:43.081 INFO:tasks.workunit.client.0.smithi112.stdout:9/939: chown df/d11/d14/d19/f90 28332546 1 2024-09-19T09:35:43.081 INFO:tasks.workunit.client.0.smithi112.stdout:9/940: dread - df/d11/d14/d19/d1e/d97/f113 zero size 2024-09-19T09:35:43.082 INFO:tasks.workunit.client.0.smithi112.stdout:9/941: creat df/d11/d14/d19/d28/d89/f155 x:0 0 0 2024-09-19T09:35:43.108 INFO:tasks.workunit.client.0.smithi112.stdout:9/942: dwrite df/d11/d14/d19/d66/d99/fa1 [0,4194304] 0 2024-09-19T09:35:43.109 INFO:tasks.workunit.client.0.smithi112.stdout:9/943: symlink df/d11/d14/d19/d40/daf/dec/d11b/l156 0 2024-09-19T09:35:43.111 INFO:tasks.workunit.client.0.smithi112.stdout:9/944: symlink df/d35/d9d/l157 0 2024-09-19T09:35:43.113 INFO:tasks.workunit.client.0.smithi112.stdout:9/945: truncate df/d11/d14/d19/d40/d5c/d12a/fb1 3091522 0 2024-09-19T09:35:43.113 INFO:tasks.workunit.client.0.smithi112.stdout:9/946: fsync df/d11/d14/d19/d40/daf/d6c/db3/fd0 0 2024-09-19T09:35:43.114 INFO:tasks.workunit.client.0.smithi112.stdout:9/947: mkdir df/d11/d14/d19/d40/daf/dec/d158 0 2024-09-19T09:35:43.116 INFO:tasks.workunit.client.0.smithi112.stdout:9/948: read df/d11/d14/d109/fac [36453,70201] 0 2024-09-19T09:35:43.117 INFO:tasks.workunit.client.0.smithi112.stdout:9/949: creat df/d11/d14/d19/dc0/f159 x:0 0 0 2024-09-19T09:35:43.119 INFO:tasks.workunit.client.0.smithi112.stdout:9/950: link df/d11/d14/d19/d66/d5d/leb df/l15a 0 2024-09-19T09:35:43.125 INFO:tasks.workunit.client.0.smithi112.stdout:9/951: dread df/d11/d14/d19/d66/f9b [0,4194304] 0 2024-09-19T09:35:43.127 INFO:tasks.workunit.client.0.smithi112.stdout:9/952: creat df/d11/d14/d109/f15b x:0 0 0 2024-09-19T09:35:43.128 INFO:tasks.workunit.client.0.smithi112.stdout:9/953: write df/d11/d14/d19/df3/f108 [320057,23424] 0 2024-09-19T09:35:43.128 INFO:tasks.workunit.client.0.smithi112.stdout:9/954: read - df/d11/d14/d19/d1e/f114 zero size 2024-09-19T09:35:43.146 INFO:tasks.workunit.client.0.smithi112.stdout:9/955: dwrite df/d11/f11c [0,4194304] 0 2024-09-19T09:35:43.155 INFO:tasks.workunit.client.0.smithi112.stdout:9/956: write df/d11/d14/d19/d40/daf/f92 [3440389,106554] 0 2024-09-19T09:35:43.177 INFO:tasks.workunit.client.0.smithi112.stdout:9/957: write df/d11/d14/d19/d40/daf/d6c/db3/d9e/fa9 [7457083,121461] 0 2024-09-19T09:35:43.184 INFO:tasks.workunit.client.0.smithi112.stdout:9/958: dread df/d11/d14/d19/d1e/f88 [0,4194304] 0 2024-09-19T09:35:43.191 INFO:tasks.workunit.client.0.smithi112.stdout:9/959: write df/d11/d14/d19/fe5 [643483,3388] 0 2024-09-19T09:35:43.205 INFO:tasks.workunit.client.0.smithi112.stdout:9/960: dwrite df/d11/d14/d19/d40/daf/d6c/db3/f9c [0,4194304] 0 2024-09-19T09:35:43.207 INFO:tasks.workunit.client.0.smithi112.stdout:9/961: mknod df/d11/d14/d51/c15c 0 2024-09-19T09:35:43.207 INFO:tasks.workunit.client.0.smithi112.stdout:9/962: creat df/d11/d14/d19/d40/dea/f15d x:0 0 0 2024-09-19T09:35:43.218 INFO:tasks.workunit.client.0.smithi112.stdout:9/963: write df/d11/f5b [593643,36562] 0 2024-09-19T09:35:43.219 INFO:tasks.workunit.client.0.smithi112.stdout:9/964: chown df/d11/d14/d19/d40/daf/d6c/db3/cf0 244081551 1 2024-09-19T09:35:43.219 INFO:tasks.workunit.client.0.smithi112.stdout:9/965: creat df/f15e x:0 0 0 2024-09-19T09:35:43.220 INFO:tasks.workunit.client.0.smithi112.stdout:9/966: chown df/d11/d14/d19/d1e/d97/c10d 125819 1 2024-09-19T09:35:43.220 INFO:tasks.workunit.client.0.smithi112.stdout:9/967: write df/d11/d14/f5f [894546,127306] 0 2024-09-19T09:35:43.220 INFO:tasks.workunit.client.0.smithi112.stdout:9/968: creat df/d11/d14/d19/d40/dea/f15f x:0 0 0 2024-09-19T09:35:43.220 INFO:tasks.workunit.client.0.smithi112.stdout:9/969: truncate df/d11/d14/d19/d40/f130 331904 0 2024-09-19T09:35:43.244 INFO:tasks.workunit.client.0.smithi112.stdout:9/970: dwrite df/d11/d14/d19/d66/f27 [0,4194304] 0 2024-09-19T09:35:43.246 INFO:tasks.workunit.client.0.smithi112.stdout:9/971: rmdir df/d11/d14/d19/d40/daf/dec/d11b 39 2024-09-19T09:35:43.251 INFO:tasks.workunit.client.0.smithi112.stdout:9/972: dread df/d11/d14/d19/d1e/f69 [0,4194304] 0 2024-09-19T09:35:43.271 INFO:tasks.workunit.client.0.smithi112.stdout:9/973: dwrite df/d11/d14/d19/d28/d89/f14b [0,4194304] 0 2024-09-19T09:35:43.279 INFO:tasks.workunit.client.0.smithi112.stdout:9/974: write df/d11/d14/d19/d66/d5d/f7c [2058728,95160] 0 2024-09-19T09:35:43.279 INFO:tasks.workunit.client.0.smithi112.stdout:9/975: creat df/db9/f160 x:0 0 0 2024-09-19T09:35:43.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:42 smithi191 ceph-mon[34834]: pgmap v33: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 83 MiB/s rd, 108 MiB/s wr, 343 op/s 2024-09-19T09:35:43.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:35:43.288 INFO:tasks.workunit.client.0.smithi112.stdout:9/976: read df/d11/d14/d19/d1e/f88 [9025573,125474] 0 2024-09-19T09:35:43.314 INFO:tasks.workunit.client.0.smithi112.stdout:9/977: rmdir df/d11 39 2024-09-19T09:35:43.315 INFO:tasks.workunit.client.0.smithi112.stdout:9/978: mkdir df/d11/d14/d19/d40/daf/d6c/db3/d9e/df2/d112/d161 0 2024-09-19T09:35:43.315 INFO:tasks.workunit.client.0.smithi112.stdout:9/979: write df/d11/d14/d19/d66/d5d/f147 [384760,126316] 0 2024-09-19T09:35:43.316 INFO:tasks.workunit.client.0.smithi112.stdout:9/980: chown df/d11/d14/d19/f90 48738 1 2024-09-19T09:35:43.316 INFO:tasks.workunit.client.0.smithi112.stdout:9/981: write df/d11/d14/d19/d40/d5c/f14d [234651,112334] 0 2024-09-19T09:35:43.318 INFO:tasks.workunit.client.0.smithi112.stdout:9/982: mknod df/d11/c162 0 2024-09-19T09:35:43.336 INFO:tasks.workunit.client.0.smithi112.stdout:9/983: dwrite df/d11/f5b [0,4194304] 0 2024-09-19T09:35:43.354 INFO:tasks.workunit.client.0.smithi112.stdout:9/984: dwrite df/d11/d14/d19/fe5 [0,4194304] 0 2024-09-19T09:35:43.354 INFO:tasks.workunit.client.0.smithi112.stdout:9/985: write df/d11/d14/d19/dc0/f159 [979456,21117] 0 2024-09-19T09:35:43.373 INFO:tasks.workunit.client.0.smithi112.stdout:9/986: dwrite df/d11/d14/d19/d66/f4a [0,4194304] 0 2024-09-19T09:35:43.373 INFO:tasks.workunit.client.0.smithi112.stdout:9/987: truncate df/d11/d14/d19/d1e/d97/f113 413738 0 2024-09-19T09:35:43.373 INFO:tasks.workunit.client.0.smithi112.stdout:9/988: readlink df/d11/lba 0 2024-09-19T09:35:43.390 INFO:tasks.workunit.client.0.smithi112.stdout:9/989: dwrite df/d11/d14/d19/d40/d5c/d12a/fd7 [0,4194304] 0 2024-09-19T09:35:43.392 INFO:tasks.workunit.client.0.smithi112.stdout:9/990: stat df/d11/d14/d19/d28/f43 0 2024-09-19T09:35:43.392 INFO:tasks.workunit.client.0.smithi112.stdout:9/991: fsync df/d11/d14/d19/d40/daf/dec/d11b/f154 0 2024-09-19T09:35:43.393 INFO:tasks.workunit.client.0.smithi112.stdout:9/992: creat df/d11/d14/d19/de0/d12d/f163 x:0 0 0 2024-09-19T09:35:43.394 INFO:tasks.workunit.client.0.smithi112.stdout:9/993: creat df/d11/d14/d51/f164 x:0 0 0 2024-09-19T09:35:43.395 INFO:tasks.workunit.client.0.smithi112.stdout:9/994: mkdir df/d11/d14/d19/d40/daf/d165 0 2024-09-19T09:35:43.411 INFO:tasks.workunit.client.0.smithi112.stdout:9/995: dwrite df/d11/d14/d19/d66/f9b [0,4194304] 0 2024-09-19T09:35:43.412 INFO:tasks.workunit.client.0.smithi112.stdout:9/996: symlink df/d11/d14/d109/d140/l166 0 2024-09-19T09:35:43.413 INFO:tasks.workunit.client.0.smithi112.stdout:9/997: fdatasync df/db9/f10a 0 2024-09-19T09:35:43.414 INFO:tasks.workunit.client.0.smithi112.stdout:9/998: symlink df/d11/d14/d19/d66/d5d/d111/l167 0 2024-09-19T09:35:43.430 INFO:tasks.workunit.client.0.smithi112.stdout:9/999: dwrite df/d11/d14/f44 [4194304,4194304] 0 2024-09-19T09:35:43.434 INFO:tasks.workunit.client.0.smithi112.stderr:+ rm -rf -- ./tmp.ZMKU71bKrT 2024-09-19T09:35:45.084 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:44 smithi112 ceph-mon[27605]: pgmap v34: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 91 MiB/s rd, 120 MiB/s wr, 512 op/s 2024-09-19T09:35:45.084 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:44 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:45.085 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:44 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:45.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:44 smithi191 ceph-mon[34834]: pgmap v34: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 91 MiB/s rd, 120 MiB/s wr, 512 op/s 2024-09-19T09:35:45.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:44 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:45.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:44 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:46.088 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:45 smithi112 ceph-mon[27605]: Reconfiguring grafana.smithi112 (dependencies changed)... 2024-09-19T09:35:46.088 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:45 smithi112 ceph-mon[27605]: Reconfiguring daemon grafana.smithi112 on smithi112 2024-09-19T09:35:46.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:45 smithi191 ceph-mon[34834]: Reconfiguring grafana.smithi112 (dependencies changed)... 2024-09-19T09:35:46.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:45 smithi191 ceph-mon[34834]: Reconfiguring daemon grafana.smithi112 on smithi112 2024-09-19T09:35:47.088 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:46 smithi112 ceph-mon[27605]: pgmap v35: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 48 MiB/s rd, 59 MiB/s wr, 355 op/s 2024-09-19T09:35:47.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:46 smithi191 ceph-mon[34834]: pgmap v35: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 48 MiB/s rd, 59 MiB/s wr, 355 op/s 2024-09-19T09:35:48.986 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:48 smithi112 ceph-mon[27605]: pgmap v36: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 48 MiB/s rd, 61 MiB/s wr, 415 op/s 2024-09-19T09:35:49.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:48 smithi191 ceph-mon[34834]: pgmap v36: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 48 MiB/s rd, 61 MiB/s wr, 415 op/s 2024-09-19T09:35:50.731 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:50 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:50.731 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:50 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:50.731 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:50 smithi112 ceph-mon[27605]: Reconfiguring prometheus.smithi112 (dependencies changed)... 2024-09-19T09:35:50.731 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:50 smithi112 ceph-mon[27605]: Deploying daemon prometheus.smithi112 on smithi112 2024-09-19T09:35:50.731 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:50 smithi112 ceph-mon[27605]: pgmap v37: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 40 MiB/s rd, 46 MiB/s wr, 448 op/s 2024-09-19T09:35:50.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:50 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:50.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:50 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:50.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:50 smithi191 ceph-mon[34834]: Reconfiguring prometheus.smithi112 (dependencies changed)... 2024-09-19T09:35:50.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:50 smithi191 ceph-mon[34834]: Deploying daemon prometheus.smithi112 on smithi112 2024-09-19T09:35:50.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:50 smithi191 ceph-mon[34834]: pgmap v37: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 40 MiB/s rd, 46 MiB/s wr, 448 op/s 2024-09-19T09:35:53.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:52 smithi112 ceph-mon[27605]: pgmap v38: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 12 MiB/s rd, 16 MiB/s wr, 322 op/s 2024-09-19T09:35:53.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:52 smithi191 ceph-mon[34834]: pgmap v38: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 12 MiB/s rd, 16 MiB/s wr, 322 op/s 2024-09-19T09:35:54.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:54 smithi112 ceph-mon[27605]: pgmap v39: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 12 MiB/s rd, 17 MiB/s wr, 503 op/s 2024-09-19T09:35:55.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:54 smithi191 ceph-mon[34834]: pgmap v39: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 12 MiB/s rd, 17 MiB/s wr, 503 op/s 2024-09-19T09:35:57.177 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:56 smithi191 ceph-mon[34834]: pgmap v40: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 4.2 MiB/s rd, 5.3 MiB/s wr, 333 op/s 2024-09-19T09:35:57.177 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:56 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:57.177 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:56 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:57.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:56 smithi112 ceph-mon[27605]: pgmap v40: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 4.2 MiB/s rd, 5.3 MiB/s wr, 333 op/s 2024-09-19T09:35:57.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:56 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:57.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:56 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:35:58.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:57 smithi191 ceph-mon[34834]: Reconfiguring node-exporter.smithi191 (dependencies changed)... 2024-09-19T09:35:58.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:57 smithi191 ceph-mon[34834]: Deploying daemon node-exporter.smithi191 on smithi191 2024-09-19T09:35:58.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:57 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:35:58.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:57 smithi112 ceph-mon[27605]: Reconfiguring node-exporter.smithi191 (dependencies changed)... 2024-09-19T09:35:58.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:57 smithi112 ceph-mon[27605]: Deploying daemon node-exporter.smithi191 on smithi191 2024-09-19T09:35:58.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:57 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:35:59.073 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:35:58 smithi191 ceph-mon[34834]: pgmap v41: 65 pgs: 65 active+clean; 1.3 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 4.5 MiB/s rd, 5.7 MiB/s wr, 396 op/s 2024-09-19T09:35:59.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:35:58 smithi112 ceph-mon[27605]: pgmap v41: 65 pgs: 65 active+clean; 1.3 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 4.5 MiB/s rd, 5.7 MiB/s wr, 396 op/s 2024-09-19T09:36:00.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:00 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:00.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:00 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:00.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:00 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T09:36:00.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:00 smithi191 ceph-mon[34834]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T09:36:00.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:00 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:36:00.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:00 smithi191 ceph-mon[34834]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:36:00.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:00 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:36:00.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:00 smithi191 ceph-mon[34834]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:36:00.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:00 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:00.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:00 smithi191 ceph-mon[34834]: Upgrade: Need to upgrade myself (mgr.smithi191.xjpplx) 2024-09-19T09:36:00.536 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:00 smithi191 ceph-mon[34834]: Upgrade: Need to upgrade myself (mgr.smithi191.xjpplx) 2024-09-19T09:36:00.536 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:00 smithi191 ceph-mon[34834]: pgmap v42: 65 pgs: 65 active+clean; 879 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 4.5 MiB/s rd, 4.6 MiB/s wr, 411 op/s 2024-09-19T09:36:00.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:00 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:00.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:00 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:00.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:00 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T09:36:00.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:00 smithi112 ceph-mon[27605]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T09:36:00.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:00 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:36:00.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:00 smithi112 ceph-mon[27605]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:36:00.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:00 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:36:00.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:00 smithi112 ceph-mon[27605]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:36:00.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:00 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:00.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:00 smithi112 ceph-mon[27605]: Upgrade: Need to upgrade myself (mgr.smithi191.xjpplx) 2024-09-19T09:36:00.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:00 smithi112 ceph-mon[27605]: Upgrade: Need to upgrade myself (mgr.smithi191.xjpplx) 2024-09-19T09:36:00.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:00 smithi112 ceph-mon[27605]: pgmap v42: 65 pgs: 65 active+clean; 879 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 4.5 MiB/s rd, 4.6 MiB/s wr, 411 op/s 2024-09-19T09:36:01.185 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:36:01.185 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T09:36:01.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.788+0000 7fe060025640 1 -- 172.21.15.112:0/3158804952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe058065c40 msgr2=0x7fe0580ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.788+0000 7fe060025640 1 --2- 172.21.15.112:0/3158804952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe058065c40 0x7fe0580ff140 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe0540048d0 tx=0x7fe054009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.788+0000 7fe060025640 1 -- 172.21.15.112:0/3158804952 shutdown_connections 2024-09-19T09:36:01.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.788+0000 7fe060025640 1 --2- 172.21.15.112:0/3158804952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0580ff680 0x7fe058101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.788+0000 7fe060025640 1 --2- 172.21.15.112:0/3158804952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe058065c40 0x7fe0580ff140 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.788+0000 7fe060025640 1 -- 172.21.15.112:0/3158804952 >> 172.21.15.112:0/3158804952 conn(0x7fe0580f6c10 msgr2=0x7fe0580f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:01.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.788+0000 7fe060025640 1 -- 172.21.15.112:0/3158804952 shutdown_connections 2024-09-19T09:36:01.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.788+0000 7fe060025640 1 -- 172.21.15.112:0/3158804952 wait complete. 2024-09-19T09:36:01.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.789+0000 7fe060025640 1 Processor -- start 2024-09-19T09:36:01.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.789+0000 7fe060025640 1 -- start start 2024-09-19T09:36:01.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.789+0000 7fe060025640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe058065c40 0x7fe05810d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.789+0000 7fe060025640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0580ff680 0x7fe05810d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.789+0000 7fe060025640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05810dca0 con 0x7fe058065c40 2024-09-19T09:36:01.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.789+0000 7fe060025640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05810e470 con 0x7fe0580ff680 2024-09-19T09:36:01.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.789+0000 7fe05ddc1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe058065c40 0x7fe05810d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.789+0000 7fe05ddc1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe058065c40 0x7fe05810d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53914/0 (socket says 172.21.15.112:53914) 2024-09-19T09:36:01.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.789+0000 7fe05ddc1640 1 -- 172.21.15.112:0/2663761277 learned_addr learned my addr 172.21.15.112:0/2663761277 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:36:01.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.789+0000 7fe05d5c0640 1 --2- 172.21.15.112:0/2663761277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0580ff680 0x7fe05810d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.790+0000 7fe05ddc1640 1 -- 172.21.15.112:0/2663761277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0580ff680 msgr2=0x7fe05810d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.790+0000 7fe05ddc1640 1 --2- 172.21.15.112:0/2663761277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0580ff680 0x7fe05810d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.790+0000 7fe05ddc1640 1 -- 172.21.15.112:0/2663761277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe054005040 con 0x7fe058065c40 2024-09-19T09:36:01.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.790+0000 7fe05d5c0640 1 --2- 172.21.15.112:0/2663761277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0580ff680 0x7fe05810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:01.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.790+0000 7fe05ddc1640 1 --2- 172.21.15.112:0/2663761277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe058065c40 0x7fe05810d110 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe05402d040 tx=0x7fe054009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:01.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.790+0000 7fe04e7fc640 1 -- 172.21.15.112:0/2663761277 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe054038070 con 0x7fe058065c40 2024-09-19T09:36:01.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.790+0000 7fe060025640 1 -- 172.21.15.112:0/2663761277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05810e6a0 con 0x7fe058065c40 2024-09-19T09:36:01.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.790+0000 7fe04e7fc640 1 -- 172.21.15.112:0/2663761277 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe05402ae90 con 0x7fe058065c40 2024-09-19T09:36:01.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.790+0000 7fe04e7fc640 1 -- 172.21.15.112:0/2663761277 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe05403e670 con 0x7fe058065c40 2024-09-19T09:36:01.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.790+0000 7fe060025640 1 -- 172.21.15.112:0/2663761277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05810ec40 con 0x7fe058065c40 2024-09-19T09:36:01.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.791+0000 7fe060025640 1 -- 172.21.15.112:0/2663761277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0580fa890 con 0x7fe058065c40 2024-09-19T09:36:01.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.792+0000 7fe04e7fc640 1 -- 172.21.15.112:0/2663761277 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fe054030020 con 0x7fe058065c40 2024-09-19T09:36:01.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.792+0000 7fe04e7fc640 1 --2- 172.21.15.112:0/2663761277 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fe04406e6e0 0x7fe044070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.793+0000 7fe04e7fc640 1 -- 172.21.15.112:0/2663761277 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe0540adda0 con 0x7fe058065c40 2024-09-19T09:36:01.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.793+0000 7fe05d5c0640 1 --2- 172.21.15.112:0/2663761277 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fe04406e6e0 0x7fe044070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.793+0000 7fe05d5c0640 1 --2- 172.21.15.112:0/2663761277 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fe04406e6e0 0x7fe044070b90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe048004fd0 tx=0x7fe04800b040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:01.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:01.797+0000 7fe04e7fc640 1 -- 172.21.15.112:0/2663761277 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fe054077860 con 0x7fe058065c40 2024-09-19T09:36:02.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:01 smithi191 ceph-mon[34834]: Upgrade: Updating mgr.smithi112.puhuua 2024-09-19T09:36:02.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:01 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:02.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:01 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.puhuua", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:36:02.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:01 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.puhuua", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:36:02.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:01 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:36:02.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:01 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:02.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:01 smithi191 ceph-mon[34834]: Deploying daemon mgr.smithi112.puhuua on smithi112 2024-09-19T09:36:02.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.076+0000 7fe060025640 1 -- 172.21.15.112:0/2663761277 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe05810efc0 con 0x7fe04406e6e0 2024-09-19T09:36:02.078 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:01 smithi112 ceph-mon[27605]: Upgrade: Updating mgr.smithi112.puhuua 2024-09-19T09:36:02.078 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:01 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:02.078 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:01 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.puhuua", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:36:02.078 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:01 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.puhuua", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:36:02.078 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:01 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:36:02.078 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:01 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:02.079 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:01 smithi112 ceph-mon[27605]: Deploying daemon mgr.smithi112.puhuua on smithi112 2024-09-19T09:36:02.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.078+0000 7fe04e7fc640 1 -- 172.21.15.112:0/2663761277 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fe05810efc0 con 0x7fe04406e6e0 2024-09-19T09:36:02.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.082+0000 7fe060025640 1 -- 172.21.15.112:0/2663761277 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fe04406e6e0 msgr2=0x7fe044070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.082+0000 7fe060025640 1 --2- 172.21.15.112:0/2663761277 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fe04406e6e0 0x7fe044070b90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe048004fd0 tx=0x7fe04800b040 comp rx=0 tx=0).stop 2024-09-19T09:36:02.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.082+0000 7fe060025640 1 -- 172.21.15.112:0/2663761277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe058065c40 msgr2=0x7fe05810d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.082+0000 7fe060025640 1 --2- 172.21.15.112:0/2663761277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe058065c40 0x7fe05810d110 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe05402d040 tx=0x7fe054009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.082+0000 7fe060025640 1 -- 172.21.15.112:0/2663761277 shutdown_connections 2024-09-19T09:36:02.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.082+0000 7fe060025640 1 --2- 172.21.15.112:0/2663761277 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7fe04406e6e0 0x7fe044070b90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.082+0000 7fe060025640 1 --2- 172.21.15.112:0/2663761277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0580ff680 0x7fe05810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.082+0000 7fe060025640 1 --2- 172.21.15.112:0/2663761277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe058065c40 0x7fe05810d110 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.082+0000 7fe060025640 1 -- 172.21.15.112:0/2663761277 >> 172.21.15.112:0/2663761277 conn(0x7fe0580f6c10 msgr2=0x7fe0580f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:02.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.082+0000 7fe060025640 1 -- 172.21.15.112:0/2663761277 shutdown_connections 2024-09-19T09:36:02.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.082+0000 7fe060025640 1 -- 172.21.15.112:0/2663761277 wait complete. 2024-09-19T09:36:02.096 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:36:02.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.174+0000 7f58ab854640 1 -- 172.21.15.112:0/593305972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58a40ff680 msgr2=0x7f58a4101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.174+0000 7f58ab854640 1 --2- 172.21.15.112:0/593305972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58a40ff680 0x7f58a4101a60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f58940048d0 tx=0x7f5894009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.174+0000 7f58ab854640 1 -- 172.21.15.112:0/593305972 shutdown_connections 2024-09-19T09:36:02.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.174+0000 7f58ab854640 1 --2- 172.21.15.112:0/593305972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58a40ff680 0x7f58a4101a60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.174+0000 7f58ab854640 1 --2- 172.21.15.112:0/593305972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58a4065c40 0x7f58a40ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.174+0000 7f58ab854640 1 -- 172.21.15.112:0/593305972 >> 172.21.15.112:0/593305972 conn(0x7f58a40f6c10 msgr2=0x7f58a40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:02.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.174+0000 7f58ab854640 1 -- 172.21.15.112:0/593305972 shutdown_connections 2024-09-19T09:36:02.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.174+0000 7f58ab854640 1 -- 172.21.15.112:0/593305972 wait complete. 2024-09-19T09:36:02.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.175+0000 7f58ab854640 1 Processor -- start 2024-09-19T09:36:02.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.175+0000 7f58ab854640 1 -- start start 2024-09-19T09:36:02.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.175+0000 7f58ab854640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58a4065c40 0x7f58a410d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:02.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.175+0000 7f58ab854640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58a40ff680 0x7f58a410d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:02.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.175+0000 7f58ab854640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a410dc00 con 0x7f58a4065c40 2024-09-19T09:36:02.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.175+0000 7f58ab854640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a410e420 con 0x7f58a40ff680 2024-09-19T09:36:02.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.175+0000 7f58a95f0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58a4065c40 0x7f58a410d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:02.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.175+0000 7f58a95f0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58a4065c40 0x7f58a410d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53936/0 (socket says 172.21.15.112:53936) 2024-09-19T09:36:02.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.175+0000 7f58a95f0640 1 -- 172.21.15.112:0/2542278130 learned_addr learned my addr 172.21.15.112:0/2542278130 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:36:02.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.176+0000 7f58a8def640 1 --2- 172.21.15.112:0/2542278130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58a40ff680 0x7f58a410d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:02.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.176+0000 7f58a95f0640 1 -- 172.21.15.112:0/2542278130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58a40ff680 msgr2=0x7f58a410d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.176+0000 7f58a95f0640 1 --2- 172.21.15.112:0/2542278130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58a40ff680 0x7f58a410d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.176+0000 7f58a95f0640 1 -- 172.21.15.112:0/2542278130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5894005040 con 0x7f58a4065c40 2024-09-19T09:36:02.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.176+0000 7f58a95f0640 1 --2- 172.21.15.112:0/2542278130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58a4065c40 0x7f58a410d070 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f58a000eb70 tx=0x7f58a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:02.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.176+0000 7f5899ffb640 1 -- 172.21.15.112:0/2542278130 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58a0007c30 con 0x7f58a4065c40 2024-09-19T09:36:02.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.176+0000 7f5899ffb640 1 -- 172.21.15.112:0/2542278130 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f58a000f040 con 0x7f58a4065c40 2024-09-19T09:36:02.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.176+0000 7f58ab854640 1 -- 172.21.15.112:0/2542278130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a410e6b0 con 0x7f58a4065c40 2024-09-19T09:36:02.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.176+0000 7f5899ffb640 1 -- 172.21.15.112:0/2542278130 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58a000cb20 con 0x7f58a4065c40 2024-09-19T09:36:02.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.176+0000 7f58ab854640 1 -- 172.21.15.112:0/2542278130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a410ec50 con 0x7f58a4065c40 2024-09-19T09:36:02.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.178+0000 7f58ab854640 1 -- 172.21.15.112:0/2542278130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a40fa890 con 0x7f58a4065c40 2024-09-19T09:36:02.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.178+0000 7f5899ffb640 1 -- 172.21.15.112:0/2542278130 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f58a0009110 con 0x7f58a4065c40 2024-09-19T09:36:02.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.178+0000 7f5899ffb640 1 --2- 172.21.15.112:0/2542278130 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f589006e6e0 0x7f5890070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:02.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.179+0000 7f5899ffb640 1 -- 172.21.15.112:0/2542278130 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f58a008e300 con 0x7f58a4065c40 2024-09-19T09:36:02.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.179+0000 7f58a8def640 1 --2- 172.21.15.112:0/2542278130 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f589006e6e0 0x7f5890070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:02.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.179+0000 7f58a8def640 1 --2- 172.21.15.112:0/2542278130 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f589006e6e0 0x7f5890070b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5894007ac0 tx=0x7f5894035040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:02.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.183+0000 7f5899ffb640 1 -- 172.21.15.112:0/2542278130 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f58a0057b80 con 0x7f58a4065c40 2024-09-19T09:36:02.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.393+0000 7f58ab854640 1 -- 172.21.15.112:0/2542278130 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f58a410f060 con 0x7f589006e6e0 2024-09-19T09:36:02.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.394+0000 7f5899ffb640 1 -- 172.21.15.112:0/2542278130 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f58a410f060 con 0x7f589006e6e0 2024-09-19T09:36:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.396+0000 7f58ab854640 1 -- 172.21.15.112:0/2542278130 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f589006e6e0 msgr2=0x7f5890070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.396+0000 7f58ab854640 1 --2- 172.21.15.112:0/2542278130 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f589006e6e0 0x7f5890070b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5894007ac0 tx=0x7f5894035040 comp rx=0 tx=0).stop 2024-09-19T09:36:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.396+0000 7f58ab854640 1 -- 172.21.15.112:0/2542278130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58a4065c40 msgr2=0x7f58a410d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.396+0000 7f58ab854640 1 --2- 172.21.15.112:0/2542278130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58a4065c40 0x7f58a410d070 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f58a000eb70 tx=0x7f58a000b040 comp rx=0 tx=0).stop 2024-09-19T09:36:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.396+0000 7f58ab854640 1 -- 172.21.15.112:0/2542278130 shutdown_connections 2024-09-19T09:36:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.396+0000 7f58ab854640 1 --2- 172.21.15.112:0/2542278130 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f589006e6e0 0x7f5890070b90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.396+0000 7f58ab854640 1 --2- 172.21.15.112:0/2542278130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58a40ff680 0x7f58a410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.396+0000 7f58ab854640 1 --2- 172.21.15.112:0/2542278130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58a4065c40 0x7f58a410d070 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.396+0000 7f58ab854640 1 -- 172.21.15.112:0/2542278130 >> 172.21.15.112:0/2542278130 conn(0x7f58a40f6c10 msgr2=0x7f58a40f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.396+0000 7f58ab854640 1 -- 172.21.15.112:0/2542278130 shutdown_connections 2024-09-19T09:36:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.396+0000 7f58ab854640 1 -- 172.21.15.112:0/2542278130 wait complete. 2024-09-19T09:36:02.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.488+0000 7f036dcc7640 1 -- 172.21.15.112:0/3932566878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03680fc700 msgr2=0x7f03680fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.488+0000 7f036dcc7640 1 --2- 172.21.15.112:0/3932566878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03680fc700 0x7f03680fcb70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f035c0048d0 tx=0x7f035c009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.488+0000 7f036dcc7640 1 -- 172.21.15.112:0/3932566878 shutdown_connections 2024-09-19T09:36:02.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.488+0000 7f036dcc7640 1 --2- 172.21.15.112:0/3932566878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03680fc700 0x7f03680fcb70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.488+0000 7f036dcc7640 1 --2- 172.21.15.112:0/3932566878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03680fb430 0x7f03680fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.488+0000 7f036dcc7640 1 -- 172.21.15.112:0/3932566878 >> 172.21.15.112:0/3932566878 conn(0x7f03680f6c10 msgr2=0x7f03680f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:02.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.488+0000 7f036dcc7640 1 -- 172.21.15.112:0/3932566878 shutdown_connections 2024-09-19T09:36:02.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.488+0000 7f036dcc7640 1 -- 172.21.15.112:0/3932566878 wait complete. 2024-09-19T09:36:02.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.489+0000 7f036dcc7640 1 Processor -- start 2024-09-19T09:36:02.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.489+0000 7f036dcc7640 1 -- start start 2024-09-19T09:36:02.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.489+0000 7f036dcc7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03680fb430 0x7f036810fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:02.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.489+0000 7f036dcc7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03680fc700 0x7f03681122d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:02.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.489+0000 7f036dcc7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0368065c60 con 0x7f03680fc700 2024-09-19T09:36:02.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.489+0000 7f036dcc7640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0368065dd0 con 0x7f03680fb430 2024-09-19T09:36:02.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.489+0000 7f0366ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03680fc700 0x7f03681122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:02.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.489+0000 7f0366ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03680fc700 0x7f03681122d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53946/0 (socket says 172.21.15.112:53946) 2024-09-19T09:36:02.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.489+0000 7f0366ffd640 1 -- 172.21.15.112:0/3421043211 learned_addr learned my addr 172.21.15.112:0/3421043211 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:36:02.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.489+0000 7f03677fe640 1 --2- 172.21.15.112:0/3421043211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03680fb430 0x7f036810fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:02.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.490+0000 7f0366ffd640 1 -- 172.21.15.112:0/3421043211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03680fb430 msgr2=0x7f036810fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.490+0000 7f0366ffd640 1 --2- 172.21.15.112:0/3421043211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03680fb430 0x7f036810fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.490+0000 7f0366ffd640 1 -- 172.21.15.112:0/3421043211 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c005040 con 0x7f03680fc700 2024-09-19T09:36:02.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.490+0000 7f0366ffd640 1 --2- 172.21.15.112:0/3421043211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03680fc700 0x7f03681122d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f035c0043d0 tx=0x7f035c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:02.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.490+0000 7f034ffff640 1 -- 172.21.15.112:0/3421043211 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f035c038070 con 0x7f03680fc700 2024-09-19T09:36:02.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.490+0000 7f034ffff640 1 -- 172.21.15.112:0/3421043211 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f035c02ae90 con 0x7f03680fc700 2024-09-19T09:36:02.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.490+0000 7f036dcc7640 1 -- 172.21.15.112:0/3421043211 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0368112810 con 0x7f03680fc700 2024-09-19T09:36:02.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.490+0000 7f036dcc7640 1 -- 172.21.15.112:0/3421043211 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0368112d80 con 0x7f03680fc700 2024-09-19T09:36:02.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.490+0000 7f034ffff640 1 -- 172.21.15.112:0/3421043211 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f035c03e670 con 0x7f03680fc700 2024-09-19T09:36:02.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.491+0000 7f036dcc7640 1 -- 172.21.15.112:0/3421043211 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0354005240 con 0x7f03680fc700 2024-09-19T09:36:02.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.492+0000 7f034ffff640 1 -- 172.21.15.112:0/3421043211 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f035c030020 con 0x7f03680fc700 2024-09-19T09:36:02.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.492+0000 7f034ffff640 1 --2- 172.21.15.112:0/3421043211 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f035006e6e0 0x7f0350070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:02.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.493+0000 7f034ffff640 1 -- 172.21.15.112:0/3421043211 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f035c0adf10 con 0x7f03680fc700 2024-09-19T09:36:02.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.493+0000 7f03677fe640 1 --2- 172.21.15.112:0/3421043211 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f035006e6e0 0x7f0350070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:02.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.494+0000 7f03677fe640 1 --2- 172.21.15.112:0/3421043211 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f035006e6e0 0x7f0350070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0358009fd0 tx=0x7f0358009e50 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:02.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.498+0000 7f034ffff640 1 -- 172.21.15.112:0/3421043211 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f035c077920 con 0x7f03680fc700 2024-09-19T09:36:02.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.768+0000 7f036dcc7640 1 -- 172.21.15.112:0/3421043211 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0354000bf0 con 0x7f035006e6e0 2024-09-19T09:36:02.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.777+0000 7f034ffff640 1 -- 172.21.15.112:0/3421043211 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0354000bf0 con 0x7f035006e6e0 2024-09-19T09:36:02.778 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:36:02.779 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 starting - - - - 2024-09-19T09:36:02.779 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (9m) 69s ago 9m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1513f1075df5 2024-09-19T09:36:02.779 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (8m) 72s ago 8m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6c313b300b35 2024-09-19T09:36:02.779 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 starting - - - - 2024-09-19T09:36:02.779 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (3m) 69s ago 3m 170M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:36:02.779 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (3m) 69s ago 3m 96.1M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:36:02.779 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (3m) 72s ago 3m 11.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:36:02.779 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (3m) 72s ago 3m 14.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:36:02.779 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:9283,8765,8443 running (10m) 69s ago 10m 189M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a963c39d50ce 2024-09-19T09:36:02.779 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283 running (95s) 72s ago 8m 482M - 19.1.1-361-g2f599a46 d2baa855c067 b9c59e3583b1 2024-09-19T09:36:02.779 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (10m) 69s ago 10m 50.4M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 34676d67b669 2024-09-19T09:36:02.779 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (7m) 72s ago 7m 39.9M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 35690ef0929b 2024-09-19T09:36:02.779 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 starting - - - - 2024-09-19T09:36:02.780 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 starting - - - - 2024-09-19T09:36:02.780 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (7m) 69s ago 7m 108M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 621693067dce 2024-09-19T09:36:02.780 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (6m) 69s ago 6m 115M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1742e5964367 2024-09-19T09:36:02.780 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (6m) 69s ago 6m 104M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 4dcca18af229 2024-09-19T09:36:02.780 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (5m) 72s ago 5m 116M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:36:02.780 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (5m) 72s ago 5m 111M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:36:02.780 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (5m) 72s ago 5m 109M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:36:02.780 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 starting - - - - 2024-09-19T09:36:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.780+0000 7f036dcc7640 1 -- 172.21.15.112:0/3421043211 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f035006e6e0 msgr2=0x7f0350070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.780+0000 7f036dcc7640 1 --2- 172.21.15.112:0/3421043211 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f035006e6e0 0x7f0350070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0358009fd0 tx=0x7f0358009e50 comp rx=0 tx=0).stop 2024-09-19T09:36:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.780+0000 7f036dcc7640 1 -- 172.21.15.112:0/3421043211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03680fc700 msgr2=0x7f03681122d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.780+0000 7f036dcc7640 1 --2- 172.21.15.112:0/3421043211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03680fc700 0x7f03681122d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f035c0043d0 tx=0x7f035c009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.780+0000 7f036dcc7640 1 -- 172.21.15.112:0/3421043211 shutdown_connections 2024-09-19T09:36:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.780+0000 7f036dcc7640 1 --2- 172.21.15.112:0/3421043211 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f035006e6e0 0x7f0350070b90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.780+0000 7f036dcc7640 1 --2- 172.21.15.112:0/3421043211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03680fc700 0x7f03681122d0 secure :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f035c0043d0 tx=0x7f035c009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.780+0000 7f036dcc7640 1 --2- 172.21.15.112:0/3421043211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03680fb430 0x7f036810fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.780+0000 7f036dcc7640 1 -- 172.21.15.112:0/3421043211 >> 172.21.15.112:0/3421043211 conn(0x7f03680f6c10 msgr2=0x7f03680f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.780+0000 7f036dcc7640 1 -- 172.21.15.112:0/3421043211 shutdown_connections 2024-09-19T09:36:02.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.781+0000 7f036dcc7640 1 -- 172.21.15.112:0/3421043211 wait complete. 2024-09-19T09:36:02.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.883+0000 7f2748a43640 1 -- 172.21.15.112:0/886651120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27440fc6f0 msgr2=0x7f27440fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.883+0000 7f2748a43640 1 --2- 172.21.15.112:0/886651120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27440fc6f0 0x7f27440fcb60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f27380048d0 tx=0x7f2738009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.883+0000 7f2748a43640 1 -- 172.21.15.112:0/886651120 shutdown_connections 2024-09-19T09:36:02.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.883+0000 7f2748a43640 1 --2- 172.21.15.112:0/886651120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27440fc6f0 0x7f27440fcb60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.883+0000 7f2748a43640 1 --2- 172.21.15.112:0/886651120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27440fb420 0x7f27440fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.883+0000 7f2748a43640 1 -- 172.21.15.112:0/886651120 >> 172.21.15.112:0/886651120 conn(0x7f27440f6c00 msgr2=0x7f27440f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:02.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.884+0000 7f2748a43640 1 -- 172.21.15.112:0/886651120 shutdown_connections 2024-09-19T09:36:02.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.884+0000 7f2748a43640 1 -- 172.21.15.112:0/886651120 wait complete. 2024-09-19T09:36:02.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.884+0000 7f2748a43640 1 Processor -- start 2024-09-19T09:36:02.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.885+0000 7f2748a43640 1 -- start start 2024-09-19T09:36:02.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.885+0000 7f2748a43640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27440fb420 0x7f274410d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:02.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.885+0000 7f2748a43640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27440fc6f0 0x7f274410d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:02.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.885+0000 7f2748a43640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274410dc70 con 0x7f27440fb420 2024-09-19T09:36:02.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.885+0000 7f2748a43640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274410e440 con 0x7f27440fc6f0 2024-09-19T09:36:02.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.885+0000 7f274259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27440fb420 0x7f274410d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:02.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.885+0000 7f2741d9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27440fc6f0 0x7f274410d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:02.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.885+0000 7f274259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27440fb420 0x7f274410d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53972/0 (socket says 172.21.15.112:53972) 2024-09-19T09:36:02.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.885+0000 7f2741d9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27440fc6f0 0x7f274410d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.112:60756/0 (socket says 172.21.15.112:60756) 2024-09-19T09:36:02.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.885+0000 7f274259c640 1 -- 172.21.15.112:0/959027001 learned_addr learned my addr 172.21.15.112:0/959027001 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:36:02.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.885+0000 7f2741d9b640 1 -- 172.21.15.112:0/959027001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27440fb420 msgr2=0x7f274410d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.885+0000 7f2741d9b640 1 --2- 172.21.15.112:0/959027001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27440fb420 0x7f274410d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.885+0000 7f2741d9b640 1 -- 172.21.15.112:0/959027001 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2738005040 con 0x7f27440fc6f0 2024-09-19T09:36:02.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.885+0000 7f274259c640 1 --2- 172.21.15.112:0/959027001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27440fb420 0x7f274410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:02.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.886+0000 7f2741d9b640 1 --2- 172.21.15.112:0/959027001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27440fc6f0 0x7f274410d620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2738003080 tx=0x7f2738009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:02.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.886+0000 7f2732ffd640 1 -- 172.21.15.112:0/959027001 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2738038070 con 0x7f27440fc6f0 2024-09-19T09:36:02.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.886+0000 7f2732ffd640 1 -- 172.21.15.112:0/959027001 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f273802abd0 con 0x7f27440fc6f0 2024-09-19T09:36:02.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.886+0000 7f2748a43640 1 -- 172.21.15.112:0/959027001 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274410e670 con 0x7f27440fc6f0 2024-09-19T09:36:02.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.886+0000 7f2732ffd640 1 -- 172.21.15.112:0/959027001 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f273803e670 con 0x7f27440fc6f0 2024-09-19T09:36:02.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.886+0000 7f2748a43640 1 -- 172.21.15.112:0/959027001 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274410ec10 con 0x7f27440fc6f0 2024-09-19T09:36:02.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.887+0000 7f2732ffd640 1 -- 172.21.15.112:0/959027001 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f2738030020 con 0x7f27440fc6f0 2024-09-19T09:36:02.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.887+0000 7f2748a43640 1 -- 172.21.15.112:0/959027001 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27440fa880 con 0x7f27440fc6f0 2024-09-19T09:36:02.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.888+0000 7f2732ffd640 1 --2- 172.21.15.112:0/959027001 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f272c06e6e0 0x7f272c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:02.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.888+0000 7f2732ffd640 1 -- 172.21.15.112:0/959027001 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f27380ae150 con 0x7f27440fc6f0 2024-09-19T09:36:02.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.888+0000 7f274259c640 1 --2- 172.21.15.112:0/959027001 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f272c06e6e0 0x7f272c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:02.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.889+0000 7f274259c640 1 --2- 172.21.15.112:0/959027001 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f272c06e6e0 0x7f272c070b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f273400efd0 tx=0x7f273400e500 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:02.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:02.897+0000 7f2732ffd640 1 -- 172.21.15.112:0/959027001 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f2738077b10 con 0x7f27440fc6f0 2024-09-19T09:36:03.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:02 smithi191 ceph-mon[34834]: pgmap v43: 65 pgs: 65 active+clean; 879 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 319 op/s 2024-09-19T09:36:03.071 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:02 smithi112 ceph-mon[27605]: pgmap v43: 65 pgs: 65 active+clean; 879 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 319 op/s 2024-09-19T09:36:03.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.269+0000 7f2748a43640 1 -- 172.21.15.112:0/959027001 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f274404b720 con 0x7f27440fc6f0 2024-09-19T09:36:03.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.270+0000 7f2732ffd640 1 -- 172.21.15.112:0/959027001 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f273807b1d0 con 0x7f27440fc6f0 2024-09-19T09:36:03.272 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:36:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:36:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T09:36:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:36:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:36:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 1, 2024-09-19T09:36:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T09:36:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:36:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:36:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T09:36:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:36:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:36:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:36:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:36:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:36:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 13, 2024-09-19T09:36:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T09:36:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:36:03.273 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:36:03.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.272+0000 7f2748a43640 1 -- 172.21.15.112:0/959027001 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f272c06e6e0 msgr2=0x7f272c070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:03.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.272+0000 7f2748a43640 1 --2- 172.21.15.112:0/959027001 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f272c06e6e0 0x7f272c070b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f273400efd0 tx=0x7f273400e500 comp rx=0 tx=0).stop 2024-09-19T09:36:03.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.272+0000 7f2748a43640 1 -- 172.21.15.112:0/959027001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27440fc6f0 msgr2=0x7f274410d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:03.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.272+0000 7f2748a43640 1 --2- 172.21.15.112:0/959027001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27440fc6f0 0x7f274410d620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2738003080 tx=0x7f2738009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.272+0000 7f2748a43640 1 -- 172.21.15.112:0/959027001 shutdown_connections 2024-09-19T09:36:03.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.272+0000 7f2748a43640 1 --2- 172.21.15.112:0/959027001 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f272c06e6e0 0x7f272c070b90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.272+0000 7f2748a43640 1 --2- 172.21.15.112:0/959027001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27440fc6f0 0x7f274410d620 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.272+0000 7f2748a43640 1 --2- 172.21.15.112:0/959027001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27440fb420 0x7f274410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.272+0000 7f2748a43640 1 -- 172.21.15.112:0/959027001 >> 172.21.15.112:0/959027001 conn(0x7f27440f6c00 msgr2=0x7f2744065f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:03.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.272+0000 7f2748a43640 1 -- 172.21.15.112:0/959027001 shutdown_connections 2024-09-19T09:36:03.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.272+0000 7f2748a43640 1 -- 172.21.15.112:0/959027001 wait complete. 2024-09-19T09:36:03.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.360+0000 7ff2b6e13640 1 -- 172.21.15.112:0/1044083060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2b00fb420 msgr2=0x7ff2b00fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:03.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.360+0000 7ff2b6e13640 1 --2- 172.21.15.112:0/1044083060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2b00fb420 0x7ff2b00fb830 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40048d0 tx=0x7ff2a4009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.360+0000 7ff2b6e13640 1 -- 172.21.15.112:0/1044083060 shutdown_connections 2024-09-19T09:36:03.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.360+0000 7ff2b6e13640 1 --2- 172.21.15.112:0/1044083060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2b00fc6f0 0x7ff2b00fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.360+0000 7ff2b6e13640 1 --2- 172.21.15.112:0/1044083060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2b00fb420 0x7ff2b00fb830 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.360+0000 7ff2b6e13640 1 -- 172.21.15.112:0/1044083060 >> 172.21.15.112:0/1044083060 conn(0x7ff2b00f6c00 msgr2=0x7ff2b00f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:03.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.360+0000 7ff2b6e13640 1 -- 172.21.15.112:0/1044083060 shutdown_connections 2024-09-19T09:36:03.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.360+0000 7ff2b6e13640 1 -- 172.21.15.112:0/1044083060 wait complete. 2024-09-19T09:36:03.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.360+0000 7ff2b6e13640 1 Processor -- start 2024-09-19T09:36:03.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.360+0000 7ff2b6e13640 1 -- start start 2024-09-19T09:36:03.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.361+0000 7ff2b6e13640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2b00fb420 0x7ff2b010bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.361+0000 7ff2b6e13640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2b00fc6f0 0x7ff2b010c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.361+0000 7ff2b6e13640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b010cb00 con 0x7ff2b00fb420 2024-09-19T09:36:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.361+0000 7ff2b6e13640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b010d320 con 0x7ff2b00fc6f0 2024-09-19T09:36:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.361+0000 7ff2b4baf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2b00fb420 0x7ff2b010bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.361+0000 7ff2b4baf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2b00fb420 0x7ff2b010bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53992/0 (socket says 172.21.15.112:53992) 2024-09-19T09:36:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.361+0000 7ff2b4baf640 1 -- 172.21.15.112:0/1280850684 learned_addr learned my addr 172.21.15.112:0/1280850684 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:36:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.361+0000 7ff2affff640 1 --2- 172.21.15.112:0/1280850684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2b00fc6f0 0x7ff2b010c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.361+0000 7ff2affff640 1 -- 172.21.15.112:0/1280850684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2b00fb420 msgr2=0x7ff2b010bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.361+0000 7ff2affff640 1 --2- 172.21.15.112:0/1280850684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2b00fb420 0x7ff2b010bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.361+0000 7ff2affff640 1 -- 172.21.15.112:0/1280850684 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a4005040 con 0x7ff2b00fc6f0 2024-09-19T09:36:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.361+0000 7ff2b4baf640 1 --2- 172.21.15.112:0/1280850684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2b00fb420 0x7ff2b010bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.362+0000 7ff2affff640 1 --2- 172.21.15.112:0/1280850684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2b00fc6f0 0x7ff2b010c4b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00eb40 tx=0x7ff29c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.362+0000 7ff2ad7fa640 1 -- 172.21.15.112:0/1280850684 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff29c007c30 con 0x7ff2b00fc6f0 2024-09-19T09:36:03.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.362+0000 7ff2ad7fa640 1 -- 172.21.15.112:0/1280850684 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff29c00f040 con 0x7ff2b00fc6f0 2024-09-19T09:36:03.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.362+0000 7ff2ad7fa640 1 -- 172.21.15.112:0/1280850684 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff29c0094b0 con 0x7ff2b00fc6f0 2024-09-19T09:36:03.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.362+0000 7ff2b6e13640 1 -- 172.21.15.112:0/1280850684 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b010d550 con 0x7ff2b00fc6f0 2024-09-19T09:36:03.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.362+0000 7ff2b6e13640 1 -- 172.21.15.112:0/1280850684 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b010daf0 con 0x7ff2b00fc6f0 2024-09-19T09:36:03.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.363+0000 7ff2b6e13640 1 -- 172.21.15.112:0/1280850684 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b00fa880 con 0x7ff2b00fc6f0 2024-09-19T09:36:03.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.364+0000 7ff2ad7fa640 1 -- 172.21.15.112:0/1280850684 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7ff29c00cc40 con 0x7ff2b00fc6f0 2024-09-19T09:36:03.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.364+0000 7ff2ad7fa640 1 --2- 172.21.15.112:0/1280850684 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7ff2a006e6e0 0x7ff2a0070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.364+0000 7ff2ad7fa640 1 -- 172.21.15.112:0/1280850684 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff29c08db40 con 0x7ff2b00fc6f0 2024-09-19T09:36:03.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.365+0000 7ff2b4baf640 1 --2- 172.21.15.112:0/1280850684 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7ff2a006e6e0 0x7ff2a0070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.365+0000 7ff2b4baf640 1 --2- 172.21.15.112:0/1280850684 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7ff2a006e6e0 0x7ff2a0070b90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4000c00 tx=0x7ff2a4035040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:03.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.369+0000 7ff2ad7fa640 1 -- 172.21.15.112:0/1280850684 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7ff29c0574f0 con 0x7ff2b00fc6f0 2024-09-19T09:36:03.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.603+0000 7ff2b6e13640 1 -- 172.21.15.112:0/1280850684 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2b010de70 con 0x7ff2a006e6e0 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.605+0000 7ff2ad7fa640 1 -- 172.21.15.112:0/1280850684 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7ff2b010de70 con 0x7ff2a006e6e0 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [], 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "1/2 daemons upgraded", 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading mgr daemons", 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.607+0000 7ff2b6e13640 1 -- 172.21.15.112:0/1280850684 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7ff2a006e6e0 msgr2=0x7ff2a0070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.607+0000 7ff2b6e13640 1 --2- 172.21.15.112:0/1280850684 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7ff2a006e6e0 0x7ff2a0070b90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4000c00 tx=0x7ff2a4035040 comp rx=0 tx=0).stop 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.607+0000 7ff2b6e13640 1 -- 172.21.15.112:0/1280850684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2b00fc6f0 msgr2=0x7ff2b010c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.607+0000 7ff2b6e13640 1 --2- 172.21.15.112:0/1280850684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2b00fc6f0 0x7ff2b010c4b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00eb40 tx=0x7ff29c00b040 comp rx=0 tx=0).stop 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.607+0000 7ff2b6e13640 1 -- 172.21.15.112:0/1280850684 shutdown_connections 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.607+0000 7ff2b6e13640 1 --2- 172.21.15.112:0/1280850684 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7ff2a006e6e0 0x7ff2a0070b90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.607+0000 7ff2b6e13640 1 --2- 172.21.15.112:0/1280850684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2b00fc6f0 0x7ff2b010c4b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.607+0000 7ff2b6e13640 1 --2- 172.21.15.112:0/1280850684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2b00fb420 0x7ff2b010bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.607+0000 7ff2b6e13640 1 -- 172.21.15.112:0/1280850684 >> 172.21.15.112:0/1280850684 conn(0x7ff2b00f6c00 msgr2=0x7ff2b00f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.607+0000 7ff2b6e13640 1 -- 172.21.15.112:0/1280850684 shutdown_connections 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:03.607+0000 7ff2b6e13640 1 -- 172.21.15.112:0/1280850684 wait complete. 2024-09-19T09:36:04.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:03 smithi191 ceph-mon[34834]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:04.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:03 smithi191 ceph-mon[34834]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:04.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:03 smithi191 ceph-mon[34834]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:04.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:03 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/959027001' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:36:04.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:03 smithi112 ceph-mon[27605]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:04.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:03 smithi112 ceph-mon[27605]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:04.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:03 smithi112 ceph-mon[27605]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:04.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:03 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/959027001' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:36:05.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:04 smithi191 ceph-mon[34834]: from='client.24423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:05.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:04 smithi191 ceph-mon[34834]: pgmap v44: 65 pgs: 65 active+clean; 309 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 424 op/s 2024-09-19T09:36:05.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:04 smithi112 ceph-mon[27605]: from='client.24423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:05.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:04 smithi112 ceph-mon[27605]: pgmap v44: 65 pgs: 65 active+clean; 309 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 424 op/s 2024-09-19T09:36:07.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:06 smithi191 ceph-mon[34834]: pgmap v45: 65 pgs: 65 active+clean; 309 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 243 op/s 2024-09-19T09:36:07.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:06 smithi112 ceph-mon[27605]: pgmap v45: 65 pgs: 65 active+clean; 309 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 243 op/s 2024-09-19T09:36:08.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:08 smithi112 ceph-mon[27605]: pgmap v46: 65 pgs: 65 active+clean; 306 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 283 op/s 2024-09-19T09:36:09.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:08 smithi191 ceph-mon[34834]: pgmap v46: 65 pgs: 65 active+clean; 306 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 283 op/s 2024-09-19T09:36:11.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:10 smithi112 ceph-mon[27605]: pgmap v47: 65 pgs: 65 active+clean; 317 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 280 op/s 2024-09-19T09:36:11.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:10 smithi191 ceph-mon[34834]: pgmap v47: 65 pgs: 65 active+clean; 317 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 280 op/s 2024-09-19T09:36:13.147 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:12 smithi112 ceph-mon[27605]: pgmap v48: 65 pgs: 65 active+clean; 317 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 204 op/s 2024-09-19T09:36:13.147 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:12 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:36:13.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:12 smithi191 ceph-mon[34834]: pgmap v48: 65 pgs: 65 active+clean; 317 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 204 op/s 2024-09-19T09:36:13.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:12 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:36:15.126 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:14 smithi112 ceph-mon[27605]: pgmap v49: 65 pgs: 65 active+clean; 316 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 665 op/s 2024-09-19T09:36:15.126 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:14 smithi112 ceph-mon[27605]: mgrmap e26: smithi191.xjpplx(active, since 92s), standbys: smithi112.puhuua 2024-09-19T09:36:15.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:14 smithi191 ceph-mon[34834]: pgmap v49: 65 pgs: 65 active+clean; 316 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 665 op/s 2024-09-19T09:36:15.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:14 smithi191 ceph-mon[34834]: mgrmap e26: smithi191.xjpplx(active, since 92s), standbys: smithi112.puhuua 2024-09-19T09:36:16.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:16 smithi112 ceph-mon[27605]: pgmap v50: 65 pgs: 65 active+clean; 316 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 560 op/s 2024-09-19T09:36:16.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:16 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:16.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:16 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:16.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:16 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:17.109 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:16 smithi191 ceph-mon[34834]: pgmap v50: 65 pgs: 65 active+clean; 316 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 560 op/s 2024-09-19T09:36:17.109 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:16 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:17.109 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:16 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:17.109 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:16 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:18.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:18 smithi112 ceph-mon[27605]: pgmap v51: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 760 op/s 2024-09-19T09:36:19.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:18 smithi191 ceph-mon[34834]: pgmap v51: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 760 op/s 2024-09-19T09:36:20.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:20 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:20.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:20 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:20.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:20 smithi112 ceph-mon[27605]: pgmap v52: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 956 op/s 2024-09-19T09:36:20.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:20 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:20.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:20 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:20.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:20 smithi191 ceph-mon[34834]: pgmap v52: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 956 op/s 2024-09-19T09:36:21.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:21 smithi112 ceph-mon[27605]: Standby manager daemon smithi112.puhuua restarted 2024-09-19T09:36:21.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:21 smithi112 ceph-mon[27605]: Standby manager daemon smithi112.puhuua started 2024-09-19T09:36:21.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:21 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.puhuua/crt"}]: dispatch 2024-09-19T09:36:21.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:21 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:36:21.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:21 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.puhuua/key"}]: dispatch 2024-09-19T09:36:21.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:21 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:36:22.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:21 smithi191 ceph-mon[34834]: Standby manager daemon smithi112.puhuua restarted 2024-09-19T09:36:22.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:21 smithi191 ceph-mon[34834]: Standby manager daemon smithi112.puhuua started 2024-09-19T09:36:22.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:21 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.puhuua/crt"}]: dispatch 2024-09-19T09:36:22.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:21 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:36:22.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:21 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.puhuua/key"}]: dispatch 2024-09-19T09:36:22.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:21 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:36:23.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:22 smithi191 ceph-mon[34834]: mgrmap e27: smithi191.xjpplx(active, since 100s), standbys: smithi112.puhuua 2024-09-19T09:36:23.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:22 smithi191 ceph-mon[34834]: pgmap v53: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 897 op/s 2024-09-19T09:36:23.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:22 smithi112 ceph-mon[27605]: mgrmap e27: smithi191.xjpplx(active, since 100s), standbys: smithi112.puhuua 2024-09-19T09:36:23.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:22 smithi112 ceph-mon[27605]: pgmap v53: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 897 op/s 2024-09-19T09:36:25.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:24 smithi191 ceph-mon[34834]: pgmap v54: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 1.11k op/s 2024-09-19T09:36:25.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:24 smithi112 ceph-mon[27605]: pgmap v54: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 1.11k op/s 2024-09-19T09:36:27.012 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-19T09:36:27.012 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-19T09:36:27.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:26 smithi191 ceph-mon[34834]: pgmap v55: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 648 op/s 2024-09-19T09:36:27.164 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:26 smithi112 ceph-mon[27605]: pgmap v55: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 648 op/s 2024-09-19T09:36:27.368 DEBUG:teuthology.parallel:result is None 2024-09-19T09:36:28.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:27 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:36:28.178 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:27 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:36:28.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:28 smithi112 ceph-mon[27605]: pgmap v56: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 857 op/s 2024-09-19T09:36:29.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:28 smithi191 ceph-mon[34834]: pgmap v56: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 857 op/s 2024-09-19T09:36:30.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:30 smithi112 ceph-mon[27605]: pgmap v57: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 749 op/s 2024-09-19T09:36:31.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:30 smithi191 ceph-mon[34834]: pgmap v57: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 749 op/s 2024-09-19T09:36:32.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:32 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:32.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:32 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:32.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:32 smithi112 ceph-mon[27605]: pgmap v58: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 513 op/s 2024-09-19T09:36:32.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:32 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:32.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:32 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:32.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:32 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:32.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:32 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:32.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:32 smithi191 ceph-mon[34834]: pgmap v58: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 513 op/s 2024-09-19T09:36:32.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:32 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:32.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:32 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:33.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.693+0000 7f839b352640 1 -- 172.21.15.112:0/2946644033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8394065bc0 msgr2=0x7f83940ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:33.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.693+0000 7f839b352640 1 --2- 172.21.15.112:0/2946644033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8394065bc0 0x7f83940ff1c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f83900048d0 tx=0x7f8390009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.693+0000 7f839b352640 1 -- 172.21.15.112:0/2946644033 shutdown_connections 2024-09-19T09:36:33.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.693+0000 7f839b352640 1 --2- 172.21.15.112:0/2946644033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83940ff700 0x7f8394101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.693+0000 7f839b352640 1 --2- 172.21.15.112:0/2946644033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8394065bc0 0x7f83940ff1c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.693+0000 7f839b352640 1 -- 172.21.15.112:0/2946644033 >> 172.21.15.112:0/2946644033 conn(0x7f83940f6c10 msgr2=0x7f83940f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:33.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.693+0000 7f839b352640 1 -- 172.21.15.112:0/2946644033 shutdown_connections 2024-09-19T09:36:33.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.693+0000 7f839b352640 1 -- 172.21.15.112:0/2946644033 wait complete. 2024-09-19T09:36:33.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.693+0000 7f839b352640 1 Processor -- start 2024-09-19T09:36:33.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.693+0000 7f839b352640 1 -- start start 2024-09-19T09:36:33.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.694+0000 7f839b352640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8394065bc0 0x7f83940fcb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.694+0000 7f839b352640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83940ff700 0x7f83940fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.694+0000 7f839b352640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8394110e30 con 0x7f83940ff700 2024-09-19T09:36:33.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.694+0000 7f839b352640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8394110f70 con 0x7f8394065bc0 2024-09-19T09:36:33.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.694+0000 7f83988ed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83940ff700 0x7f83940fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.694+0000 7f83988ed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83940ff700 0x7f83940fb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59634/0 (socket says 172.21.15.112:59634) 2024-09-19T09:36:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.694+0000 7f83988ed640 1 -- 172.21.15.112:0/3992927957 learned_addr learned my addr 172.21.15.112:0/3992927957 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:36:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.694+0000 7f83990ee640 1 --2- 172.21.15.112:0/3992927957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8394065bc0 0x7f83940fcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.694+0000 7f83988ed640 1 -- 172.21.15.112:0/3992927957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8394065bc0 msgr2=0x7f83940fcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.694+0000 7f83988ed640 1 --2- 172.21.15.112:0/3992927957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8394065bc0 0x7f83940fcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.694+0000 7f83988ed640 1 -- 172.21.15.112:0/3992927957 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8390005040 con 0x7f83940ff700 2024-09-19T09:36:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.694+0000 7f83988ed640 1 --2- 172.21.15.112:0/3992927957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83940ff700 0x7f83940fb0c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f838400b580 tx=0x7f83840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.695+0000 7f8389ffb640 1 -- 172.21.15.112:0/3992927957 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f838400f6f0 con 0x7f83940ff700 2024-09-19T09:36:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.695+0000 7f839b352640 1 -- 172.21.15.112:0/3992927957 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83940fb6c0 con 0x7f83940ff700 2024-09-19T09:36:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.695+0000 7f8389ffb640 1 -- 172.21.15.112:0/3992927957 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f838400fcf0 con 0x7f83940ff700 2024-09-19T09:36:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.695+0000 7f8389ffb640 1 -- 172.21.15.112:0/3992927957 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83840103a0 con 0x7f83940ff700 2024-09-19T09:36:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.695+0000 7f839b352640 1 -- 172.21.15.112:0/3992927957 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83940fbbe0 con 0x7f83940ff700 2024-09-19T09:36:33.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.696+0000 7f839b352640 1 -- 172.21.15.112:0/3992927957 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83940fa890 con 0x7f83940ff700 2024-09-19T09:36:33.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.696+0000 7f8389ffb640 1 -- 172.21.15.112:0/3992927957 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 27) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f83840116b0 con 0x7f83940ff700 2024-09-19T09:36:33.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.697+0000 7f8389ffb640 1 --2- 172.21.15.112:0/3992927957 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f838006de30 0x7f83800702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.697+0000 7f8389ffb640 1 -- 172.21.15.112:0/3992927957 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f838408d510 con 0x7f83940ff700 2024-09-19T09:36:33.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.697+0000 7f83990ee640 1 --2- 172.21.15.112:0/3992927957 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f838006de30 0x7f83800702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.697+0000 7f83990ee640 1 --2- 172.21.15.112:0/3992927957 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f838006de30 0x7f83800702e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f83940fc930 tx=0x7f8390035040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:33.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.705+0000 7f8389ffb640 1 -- 172.21.15.112:0/3992927957 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f838405ab60 con 0x7f83940ff700 2024-09-19T09:36:33.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.966+0000 7f839b352640 1 -- 172.21.15.112:0/3992927957 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8394105150 con 0x7f838006de30 2024-09-19T09:36:33.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.968+0000 7f8389ffb640 1 -- 172.21.15.112:0/3992927957 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f8394105150 con 0x7f838006de30 2024-09-19T09:36:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.970+0000 7f839b352640 1 -- 172.21.15.112:0/3992927957 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f838006de30 msgr2=0x7f83800702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.970+0000 7f839b352640 1 --2- 172.21.15.112:0/3992927957 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f838006de30 0x7f83800702e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f83940fc930 tx=0x7f8390035040 comp rx=0 tx=0).stop 2024-09-19T09:36:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.970+0000 7f839b352640 1 -- 172.21.15.112:0/3992927957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83940ff700 msgr2=0x7f83940fb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.970+0000 7f839b352640 1 --2- 172.21.15.112:0/3992927957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83940ff700 0x7f83940fb0c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f838400b580 tx=0x7f83840091a0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.970+0000 7f839b352640 1 -- 172.21.15.112:0/3992927957 shutdown_connections 2024-09-19T09:36:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.970+0000 7f839b352640 1 --2- 172.21.15.112:0/3992927957 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f838006de30 0x7f83800702e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.970+0000 7f839b352640 1 --2- 172.21.15.112:0/3992927957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83940ff700 0x7f83940fb0c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.970+0000 7f839b352640 1 --2- 172.21.15.112:0/3992927957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8394065bc0 0x7f83940fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.970+0000 7f839b352640 1 -- 172.21.15.112:0/3992927957 >> 172.21.15.112:0/3992927957 conn(0x7f83940f6c10 msgr2=0x7f83940f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.970+0000 7f839b352640 1 -- 172.21.15.112:0/3992927957 shutdown_connections 2024-09-19T09:36:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:33.970+0000 7f839b352640 1 -- 172.21.15.112:0/3992927957 wait complete. 2024-09-19T09:36:33.981 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:36:34.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.072+0000 7f0603bba640 1 -- 172.21.15.112:0/2689084060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05fc065b80 msgr2=0x7f05fc0ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.072+0000 7f0603bba640 1 --2- 172.21.15.112:0/2689084060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05fc065b80 0x7f05fc0ff200 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f05f80048d0 tx=0x7f05f8009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.072+0000 7f0603bba640 1 -- 172.21.15.112:0/2689084060 shutdown_connections 2024-09-19T09:36:34.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.072+0000 7f0603bba640 1 --2- 172.21.15.112:0/2689084060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05fc0ff740 0x7f05fc101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.072+0000 7f0603bba640 1 --2- 172.21.15.112:0/2689084060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05fc065b80 0x7f05fc0ff200 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.072+0000 7f0603bba640 1 -- 172.21.15.112:0/2689084060 >> 172.21.15.112:0/2689084060 conn(0x7f05fc0f6c10 msgr2=0x7f05fc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:34.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.073+0000 7f0603bba640 1 -- 172.21.15.112:0/2689084060 shutdown_connections 2024-09-19T09:36:34.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.073+0000 7f0603bba640 1 -- 172.21.15.112:0/2689084060 wait complete. 2024-09-19T09:36:34.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.073+0000 7f0603bba640 1 Processor -- start 2024-09-19T09:36:34.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.073+0000 7f0603bba640 1 -- start start 2024-09-19T09:36:34.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.073+0000 7f0603bba640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05fc065b80 0x7f05fc10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.073+0000 7f0603bba640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05fc0ff740 0x7f05fc10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.073+0000 7f0603bba640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc10dc40 con 0x7f05fc065b80 2024-09-19T09:36:34.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.073+0000 7f0603bba640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc10e410 con 0x7f05fc0ff740 2024-09-19T09:36:34.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.074+0000 7f0601956640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05fc065b80 0x7f05fc10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.074+0000 7f0601956640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05fc065b80 0x7f05fc10d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59648/0 (socket says 172.21.15.112:59648) 2024-09-19T09:36:34.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.074+0000 7f0601956640 1 -- 172.21.15.112:0/2264773669 learned_addr learned my addr 172.21.15.112:0/2264773669 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:36:34.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.074+0000 7f0601155640 1 --2- 172.21.15.112:0/2264773669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05fc0ff740 0x7f05fc10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.074+0000 7f0601956640 1 -- 172.21.15.112:0/2264773669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05fc0ff740 msgr2=0x7f05fc10d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.074+0000 7f0601956640 1 --2- 172.21.15.112:0/2264773669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05fc0ff740 0x7f05fc10d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.074+0000 7f0601956640 1 -- 172.21.15.112:0/2264773669 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f8005040 con 0x7f05fc065b80 2024-09-19T09:36:34.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.075+0000 7f0601956640 1 --2- 172.21.15.112:0/2264773669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05fc065b80 0x7f05fc10d0b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f05f80043d0 tx=0x7f05f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:34.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.075+0000 7f05f27fc640 1 -- 172.21.15.112:0/2264773669 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05f8038070 con 0x7f05fc065b80 2024-09-19T09:36:34.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.075+0000 7f0603bba640 1 -- 172.21.15.112:0/2264773669 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05fc10e640 con 0x7f05fc065b80 2024-09-19T09:36:34.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.075+0000 7f05f27fc640 1 -- 172.21.15.112:0/2264773669 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f05f802ae90 con 0x7f05fc065b80 2024-09-19T09:36:34.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.075+0000 7f05f27fc640 1 -- 172.21.15.112:0/2264773669 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05f803e670 con 0x7f05fc065b80 2024-09-19T09:36:34.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.075+0000 7f0603bba640 1 -- 172.21.15.112:0/2264773669 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05fc10eb00 con 0x7f05fc065b80 2024-09-19T09:36:34.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.077+0000 7f0603bba640 1 -- 172.21.15.112:0/2264773669 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05fc0fa890 con 0x7f05fc065b80 2024-09-19T09:36:34.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.077+0000 7f05f27fc640 1 -- 172.21.15.112:0/2264773669 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 27) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f05f8030020 con 0x7f05fc065b80 2024-09-19T09:36:34.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.078+0000 7f05f27fc640 1 --2- 172.21.15.112:0/2264773669 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f05e806de30 0x7f05e80702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.078+0000 7f05f27fc640 1 -- 172.21.15.112:0/2264773669 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f05f80ad8e0 con 0x7f05fc065b80 2024-09-19T09:36:34.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.078+0000 7f0601155640 1 --2- 172.21.15.112:0/2264773669 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f05e806de30 0x7f05e80702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.078+0000 7f0601155640 1 --2- 172.21.15.112:0/2264773669 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f05e806de30 0x7f05e80702e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f05ec007fd0 tx=0x7f05ec009e90 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:34.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.086+0000 7f05f27fc640 1 -- 172.21.15.112:0/2264773669 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f05f8077380 con 0x7f05fc065b80 2024-09-19T09:36:34.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.342+0000 7f0603bba640 1 -- 172.21.15.112:0/2264773669 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f05fc10ef40 con 0x7f05e806de30 2024-09-19T09:36:34.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.343+0000 7f05f27fc640 1 -- 172.21.15.112:0/2264773669 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f05fc10ef40 con 0x7f05e806de30 2024-09-19T09:36:34.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.345+0000 7f0603bba640 1 -- 172.21.15.112:0/2264773669 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f05e806de30 msgr2=0x7f05e80702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.345+0000 7f0603bba640 1 --2- 172.21.15.112:0/2264773669 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f05e806de30 0x7f05e80702e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f05ec007fd0 tx=0x7f05ec009e90 comp rx=0 tx=0).stop 2024-09-19T09:36:34.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.345+0000 7f0603bba640 1 -- 172.21.15.112:0/2264773669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05fc065b80 msgr2=0x7f05fc10d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.345+0000 7f0603bba640 1 --2- 172.21.15.112:0/2264773669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05fc065b80 0x7f05fc10d0b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f05f80043d0 tx=0x7f05f8009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.345+0000 7f0603bba640 1 -- 172.21.15.112:0/2264773669 shutdown_connections 2024-09-19T09:36:34.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.345+0000 7f0603bba640 1 --2- 172.21.15.112:0/2264773669 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f05e806de30 0x7f05e80702e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.345+0000 7f0603bba640 1 --2- 172.21.15.112:0/2264773669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05fc0ff740 0x7f05fc10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.345+0000 7f0603bba640 1 --2- 172.21.15.112:0/2264773669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05fc065b80 0x7f05fc10d0b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.345+0000 7f0603bba640 1 -- 172.21.15.112:0/2264773669 >> 172.21.15.112:0/2264773669 conn(0x7f05fc0f6c10 msgr2=0x7f05fc0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:34.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.345+0000 7f0603bba640 1 -- 172.21.15.112:0/2264773669 shutdown_connections 2024-09-19T09:36:34.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.345+0000 7f0603bba640 1 -- 172.21.15.112:0/2264773669 wait complete. 2024-09-19T09:36:34.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.475+0000 7f16ae840640 1 -- 172.21.15.112:0/3470726231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16a806e540 msgr2=0x7f16a8108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.475+0000 7f16ae840640 1 --2- 172.21.15.112:0/3470726231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16a806e540 0x7f16a8108730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f169c0048d0 tx=0x7f169c009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.475+0000 7f16ae840640 1 -- 172.21.15.112:0/3470726231 shutdown_connections 2024-09-19T09:36:34.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.475+0000 7f16ae840640 1 --2- 172.21.15.112:0/3470726231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16a806e540 0x7f16a8108730 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.475+0000 7f16ae840640 1 --2- 172.21.15.112:0/3470726231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a806dbf0 0x7f16a806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.475+0000 7f16ae840640 1 -- 172.21.15.112:0/3470726231 >> 172.21.15.112:0/3470726231 conn(0x7f16a8069560 msgr2=0x7f16a806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:34.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.476+0000 7f16ae840640 1 -- 172.21.15.112:0/3470726231 shutdown_connections 2024-09-19T09:36:34.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.476+0000 7f16ae840640 1 -- 172.21.15.112:0/3470726231 wait complete. 2024-09-19T09:36:34.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.476+0000 7f16ae840640 1 Processor -- start 2024-09-19T09:36:34.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.477+0000 7f16ae840640 1 -- start start 2024-09-19T09:36:34.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.477+0000 7f16ae840640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a806dbf0 0x7f16a811bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.477+0000 7f16ae840640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16a806e540 0x7f16a811c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.477+0000 7f16ae840640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a811ca90 con 0x7f16a806e540 2024-09-19T09:36:34.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.477+0000 7f16ae840640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a811d1d0 con 0x7f16a806dbf0 2024-09-19T09:36:34.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.477+0000 7f16a7fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a806dbf0 0x7f16a811bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.477+0000 7f16a7fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a806dbf0 0x7f16a811bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.112:33016/0 (socket says 172.21.15.112:33016) 2024-09-19T09:36:34.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.477+0000 7f16a7fff640 1 -- 172.21.15.112:0/656096114 learned_addr learned my addr 172.21.15.112:0/656096114 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:36:34.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.477+0000 7f16a77fe640 1 --2- 172.21.15.112:0/656096114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16a806e540 0x7f16a811c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.477+0000 7f16a7fff640 1 -- 172.21.15.112:0/656096114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16a806e540 msgr2=0x7f16a811c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.477+0000 7f16a7fff640 1 --2- 172.21.15.112:0/656096114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16a806e540 0x7f16a811c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.477+0000 7f16a7fff640 1 -- 172.21.15.112:0/656096114 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c005040 con 0x7f16a806dbf0 2024-09-19T09:36:34.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.478+0000 7f16a7fff640 1 --2- 172.21.15.112:0/656096114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a806dbf0 0x7f16a811bf00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f16a000cae0 tx=0x7f16a0007e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:34.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.478+0000 7f16a4ff9640 1 -- 172.21.15.112:0/656096114 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16a000aa80 con 0x7f16a806dbf0 2024-09-19T09:36:34.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.478+0000 7f16a4ff9640 1 -- 172.21.15.112:0/656096114 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f16a000abe0 con 0x7f16a806dbf0 2024-09-19T09:36:34.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.478+0000 7f16a4ff9640 1 -- 172.21.15.112:0/656096114 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16a00115e0 con 0x7f16a806dbf0 2024-09-19T09:36:34.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.478+0000 7f16ae840640 1 -- 172.21.15.112:0/656096114 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a811d460 con 0x7f16a806dbf0 2024-09-19T09:36:34.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.478+0000 7f16ae840640 1 -- 172.21.15.112:0/656096114 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a811d940 con 0x7f16a806dbf0 2024-09-19T09:36:34.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.479+0000 7f16ae840640 1 -- 172.21.15.112:0/656096114 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a804b720 con 0x7f16a806dbf0 2024-09-19T09:36:34.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.480+0000 7f16a4ff9640 1 -- 172.21.15.112:0/656096114 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 27) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f16a0011850 con 0x7f16a806dbf0 2024-09-19T09:36:34.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.481+0000 7f16a4ff9640 1 --2- 172.21.15.112:0/656096114 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f169006de30 0x7f16900702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.481+0000 7f16a4ff9640 1 -- 172.21.15.112:0/656096114 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f16a0057c20 con 0x7f16a806dbf0 2024-09-19T09:36:34.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.481+0000 7f16a77fe640 1 --2- 172.21.15.112:0/656096114 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f169006de30 0x7f16900702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.482+0000 7f16a77fe640 1 --2- 172.21.15.112:0/656096114 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f169006de30 0x7f16900702e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f169c000c00 tx=0x7f169c035040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:34.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.486+0000 7f16a4ff9640 1 -- 172.21.15.112:0/656096114 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f16a0057850 con 0x7f16a806dbf0 2024-09-19T09:36:34.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.695+0000 7f16ae840640 1 -- 172.21.15.112:0/656096114 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f16a811dd20 con 0x7f169006de30 2024-09-19T09:36:34.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.704+0000 7f16a4ff9640 1 -- 172.21.15.112:0/656096114 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f16a811dd20 con 0x7f169006de30 2024-09-19T09:36:34.706 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:36:34.706 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (51s) 3s ago 9m 24.0M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:36:34.706 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (9m) 3s ago 9m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1513f1075df5 2024-09-19T09:36:34.706 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (8m) 15s ago 8m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6c313b300b35 2024-09-19T09:36:34.706 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (45s) 3s ago 9m 79.5M - 9.4.7 954c08fa6188 838cccf865fe 2024-09-19T09:36:34.706 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (3m) 3s ago 3m 250M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:36:34.706 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (4m) 3s ago 4m 141M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:36:34.707 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (4m) 15s ago 4m 12.4M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:36:34.707 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (3m) 15s ago 3m 14.9M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:36:34.707 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (22s) 3s ago 10m 117M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:36:34.707 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283 running (2m) 15s ago 8m 503M - 19.1.1-361-g2f599a46 d2baa855c067 b9c59e3583b1 2024-09-19T09:36:34.707 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (10m) 3s ago 10m 52.7M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 34676d67b669 2024-09-19T09:36:34.707 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (8m) 15s ago 8m 38.2M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 35690ef0929b 2024-09-19T09:36:34.707 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (84s) 3s ago 9m 16.0M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:36:34.707 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (35s) 15s ago 8m 8052k - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:36:34.707 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (7m) 3s ago 7m 210M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 621693067dce 2024-09-19T09:36:34.707 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (7m) 3s ago 7m 229M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1742e5964367 2024-09-19T09:36:34.707 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (6m) 3s ago 6m 194M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 4dcca18af229 2024-09-19T09:36:34.707 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (6m) 15s ago 6m 252M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:36:34.707 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (5m) 15s ago 5m 222M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:36:34.708 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (5m) 15s ago 5m 211M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:36:34.708 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (39s) 3s ago 8m 48.8M - 2.43.0 a07b618ecd1d 661a9f80826a 2024-09-19T09:36:34.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.707+0000 7f16ae840640 1 -- 172.21.15.112:0/656096114 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f169006de30 msgr2=0x7f16900702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.707+0000 7f16ae840640 1 --2- 172.21.15.112:0/656096114 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f169006de30 0x7f16900702e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f169c000c00 tx=0x7f169c035040 comp rx=0 tx=0).stop 2024-09-19T09:36:34.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.707+0000 7f16ae840640 1 -- 172.21.15.112:0/656096114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a806dbf0 msgr2=0x7f16a811bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.707+0000 7f16ae840640 1 --2- 172.21.15.112:0/656096114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a806dbf0 0x7f16a811bf00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f16a000cae0 tx=0x7f16a0007e50 comp rx=0 tx=0).stop 2024-09-19T09:36:34.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.707+0000 7f16ae840640 1 -- 172.21.15.112:0/656096114 shutdown_connections 2024-09-19T09:36:34.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.707+0000 7f16ae840640 1 --2- 172.21.15.112:0/656096114 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f169006de30 0x7f16900702e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.707+0000 7f16ae840640 1 --2- 172.21.15.112:0/656096114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16a806e540 0x7f16a811c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.707+0000 7f16ae840640 1 --2- 172.21.15.112:0/656096114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a806dbf0 0x7f16a811bf00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.707+0000 7f16ae840640 1 -- 172.21.15.112:0/656096114 >> 172.21.15.112:0/656096114 conn(0x7f16a8069560 msgr2=0x7f16a8106890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:34.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.707+0000 7f16ae840640 1 -- 172.21.15.112:0/656096114 shutdown_connections 2024-09-19T09:36:34.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.707+0000 7f16ae840640 1 -- 172.21.15.112:0/656096114 wait complete. 2024-09-19T09:36:34.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.796+0000 7f61199b2640 1 -- 172.21.15.112:0/3694392567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61140fc540 msgr2=0x7f61140fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.796+0000 7f61199b2640 1 --2- 172.21.15.112:0/3694392567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61140fc540 0x7f61140fc950 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f61040048d0 tx=0x7f6104009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.796+0000 7f61199b2640 1 -- 172.21.15.112:0/3694392567 shutdown_connections 2024-09-19T09:36:34.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.796+0000 7f61199b2640 1 --2- 172.21.15.112:0/3694392567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61140fd810 0x7f61140fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.796+0000 7f61199b2640 1 --2- 172.21.15.112:0/3694392567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61140fc540 0x7f61140fc950 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.796+0000 7f61199b2640 1 -- 172.21.15.112:0/3694392567 >> 172.21.15.112:0/3694392567 conn(0x7f61140f7d00 msgr2=0x7f61140fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:34.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.796+0000 7f61199b2640 1 -- 172.21.15.112:0/3694392567 shutdown_connections 2024-09-19T09:36:34.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.796+0000 7f61199b2640 1 -- 172.21.15.112:0/3694392567 wait complete. 2024-09-19T09:36:34.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.797+0000 7f61199b2640 1 Processor -- start 2024-09-19T09:36:34.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.797+0000 7f61199b2640 1 -- start start 2024-09-19T09:36:34.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.797+0000 7f61199b2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61140fc540 0x7f611410d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.797+0000 7f61199b2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61140fd810 0x7f611410d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.797+0000 7f61199b2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611410dbe0 con 0x7f61140fc540 2024-09-19T09:36:34.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.797+0000 7f61199b2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611410e400 con 0x7f61140fd810 2024-09-19T09:36:34.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.797+0000 7f6112ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61140fc540 0x7f611410d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.797+0000 7f6112ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61140fc540 0x7f611410d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59666/0 (socket says 172.21.15.112:59666) 2024-09-19T09:36:34.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.797+0000 7f6112ffd640 1 -- 172.21.15.112:0/1269833583 learned_addr learned my addr 172.21.15.112:0/1269833583 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:36:34.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.798+0000 7f61127fc640 1 --2- 172.21.15.112:0/1269833583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61140fd810 0x7f611410d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.798+0000 7f6112ffd640 1 -- 172.21.15.112:0/1269833583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61140fd810 msgr2=0x7f611410d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.798+0000 7f6112ffd640 1 --2- 172.21.15.112:0/1269833583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61140fd810 0x7f611410d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.798+0000 7f6112ffd640 1 -- 172.21.15.112:0/1269833583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6104005040 con 0x7f61140fc540 2024-09-19T09:36:34.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.798+0000 7f6112ffd640 1 --2- 172.21.15.112:0/1269833583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61140fc540 0x7f611410d050 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6104003080 tx=0x7f6104009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:34.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.798+0000 7f60fb7fe640 1 -- 172.21.15.112:0/1269833583 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6104038070 con 0x7f61140fc540 2024-09-19T09:36:34.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.798+0000 7f60fb7fe640 1 -- 172.21.15.112:0/1269833583 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f610402abd0 con 0x7f61140fc540 2024-09-19T09:36:34.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.798+0000 7f61199b2640 1 -- 172.21.15.112:0/1269833583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611410e630 con 0x7f61140fc540 2024-09-19T09:36:34.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.798+0000 7f60fb7fe640 1 -- 172.21.15.112:0/1269833583 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f610403e670 con 0x7f61140fc540 2024-09-19T09:36:34.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.798+0000 7f61199b2640 1 -- 172.21.15.112:0/1269833583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611410ebd0 con 0x7f61140fc540 2024-09-19T09:36:34.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.799+0000 7f61199b2640 1 -- 172.21.15.112:0/1269833583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61140fb9a0 con 0x7f61140fc540 2024-09-19T09:36:34.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.800+0000 7f60fb7fe640 1 -- 172.21.15.112:0/1269833583 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 27) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f6104030020 con 0x7f61140fc540 2024-09-19T09:36:34.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.800+0000 7f60fb7fe640 1 --2- 172.21.15.112:0/1269833583 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f60fc06de30 0x7f60fc0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.800+0000 7f60fb7fe640 1 -- 172.21.15.112:0/1269833583 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f61040adaf0 con 0x7f61140fc540 2024-09-19T09:36:34.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.800+0000 7f61127fc640 1 --2- 172.21.15.112:0/1269833583 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f60fc06de30 0x7f60fc0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.801+0000 7f61127fc640 1 --2- 172.21.15.112:0/1269833583 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f60fc06de30 0x7f60fc0702e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f611410ce00 tx=0x7f6108009040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:34.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:34.804+0000 7f60fb7fe640 1 -- 172.21.15.112:0/1269833583 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f6104077590 con 0x7f61140fc540 2024-09-19T09:36:34.978 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:34 smithi112 ceph-mon[27605]: pgmap v59: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 739 op/s 2024-09-19T09:36:35.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.115+0000 7f61199b2640 1 -- 172.21.15.112:0/1269833583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f611410eee0 con 0x7f61140fc540 2024-09-19T09:36:35.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.115+0000 7f60fb7fe640 1 -- 172.21.15.112:0/1269833583 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f6104075e60 con 0x7f61140fc540 2024-09-19T09:36:35.117 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:36:35.117 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:36:35.117 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T09:36:35.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:36:35.118 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:36:35.118 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:36:35.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:36:35.118 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:36:35.118 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T09:36:35.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:36:35.118 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:36:35.118 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:36:35.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:36:35.118 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:36:35.118 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 12, 2024-09-19T09:36:35.118 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:36:35.118 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:36:35.118 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:36:35.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.118+0000 7f61199b2640 1 -- 172.21.15.112:0/1269833583 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f60fc06de30 msgr2=0x7f60fc0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:35.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.118+0000 7f61199b2640 1 --2- 172.21.15.112:0/1269833583 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f60fc06de30 0x7f60fc0702e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f611410ce00 tx=0x7f6108009040 comp rx=0 tx=0).stop 2024-09-19T09:36:35.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.119+0000 7f61199b2640 1 -- 172.21.15.112:0/1269833583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61140fc540 msgr2=0x7f611410d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:35.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.119+0000 7f61199b2640 1 --2- 172.21.15.112:0/1269833583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61140fc540 0x7f611410d050 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6104003080 tx=0x7f6104009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.119+0000 7f61199b2640 1 -- 172.21.15.112:0/1269833583 shutdown_connections 2024-09-19T09:36:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.119+0000 7f61199b2640 1 --2- 172.21.15.112:0/1269833583 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7f60fc06de30 0x7f60fc0702e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.119+0000 7f61199b2640 1 --2- 172.21.15.112:0/1269833583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61140fd810 0x7f611410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.119+0000 7f61199b2640 1 --2- 172.21.15.112:0/1269833583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61140fc540 0x7f611410d050 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.119+0000 7f61199b2640 1 -- 172.21.15.112:0/1269833583 >> 172.21.15.112:0/1269833583 conn(0x7f61140f7d00 msgr2=0x7f61140f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.119+0000 7f61199b2640 1 -- 172.21.15.112:0/1269833583 shutdown_connections 2024-09-19T09:36:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.119+0000 7f61199b2640 1 -- 172.21.15.112:0/1269833583 wait complete. 2024-09-19T09:36:35.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.209+0000 7effcd167640 1 -- 172.21.15.112:0/3335295908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effc80fc740 msgr2=0x7effc80fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:35.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.209+0000 7effcd167640 1 --2- 172.21.15.112:0/3335295908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effc80fc740 0x7effc80fcbb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7effbc0048d0 tx=0x7effbc009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.209+0000 7effcd167640 1 -- 172.21.15.112:0/3335295908 shutdown_connections 2024-09-19T09:36:35.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.209+0000 7effcd167640 1 --2- 172.21.15.112:0/3335295908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effc80fc740 0x7effc80fcbb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.209+0000 7effcd167640 1 --2- 172.21.15.112:0/3335295908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc80fb470 0x7effc80fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.209+0000 7effcd167640 1 -- 172.21.15.112:0/3335295908 >> 172.21.15.112:0/3335295908 conn(0x7effc80f6c70 msgr2=0x7effc80f9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:35.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.209+0000 7effcd167640 1 -- 172.21.15.112:0/3335295908 shutdown_connections 2024-09-19T09:36:35.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.209+0000 7effcd167640 1 -- 172.21.15.112:0/3335295908 wait complete. 2024-09-19T09:36:35.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.210+0000 7effcd167640 1 Processor -- start 2024-09-19T09:36:35.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.210+0000 7effcd167640 1 -- start start 2024-09-19T09:36:35.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.210+0000 7effcd167640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc80fb470 0x7effc80ff590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:35.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.210+0000 7effcd167640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effc80fc740 0x7effc80fda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:35.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.210+0000 7effcd167640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80fe010 con 0x7effc80fb470 2024-09-19T09:36:35.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.210+0000 7effcd167640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80fe150 con 0x7effc80fc740 2024-09-19T09:36:35.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.210+0000 7effc659c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effc80fc740 0x7effc80fda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:35.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.210+0000 7effc659c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effc80fc740 0x7effc80fda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.112:33072/0 (socket says 172.21.15.112:33072) 2024-09-19T09:36:35.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.210+0000 7effc659c640 1 -- 172.21.15.112:0/3964332282 learned_addr learned my addr 172.21.15.112:0/3964332282 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:36:35.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.210+0000 7effc6d9d640 1 --2- 172.21.15.112:0/3964332282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc80fb470 0x7effc80ff590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:35.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.211+0000 7effc659c640 1 -- 172.21.15.112:0/3964332282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc80fb470 msgr2=0x7effc80ff590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:35.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.211+0000 7effc659c640 1 --2- 172.21.15.112:0/3964332282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc80fb470 0x7effc80ff590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.211+0000 7effc659c640 1 -- 172.21.15.112:0/3964332282 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc005040 con 0x7effc80fc740 2024-09-19T09:36:35.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.211+0000 7effc659c640 1 --2- 172.21.15.112:0/3964332282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effc80fc740 0x7effc80fda80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effbc0048a0 tx=0x7effbc009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:35.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.211+0000 7effaf7fe640 1 -- 172.21.15.112:0/3964332282 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effbc038070 con 0x7effc80fc740 2024-09-19T09:36:35.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.211+0000 7effaf7fe640 1 -- 172.21.15.112:0/3964332282 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7effbc004290 con 0x7effc80fc740 2024-09-19T09:36:35.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.211+0000 7effcd167640 1 -- 172.21.15.112:0/3964332282 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc80fe3d0 con 0x7effc80fc740 2024-09-19T09:36:35.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.211+0000 7effcd167640 1 -- 172.21.15.112:0/3964332282 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc81150d0 con 0x7effc80fc740 2024-09-19T09:36:35.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.211+0000 7effaf7fe640 1 -- 172.21.15.112:0/3964332282 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effbc033660 con 0x7effc80fc740 2024-09-19T09:36:35.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.213+0000 7effcd167640 1 -- 172.21.15.112:0/3964332282 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb4005210 con 0x7effc80fc740 2024-09-19T09:36:35.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.213+0000 7effaf7fe640 1 -- 172.21.15.112:0/3964332282 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 27) v1 ==== 92275+0+0 (secure 0 0 0) 0x7effbc030020 con 0x7effc80fc740 2024-09-19T09:36:35.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.214+0000 7effaf7fe640 1 --2- 172.21.15.112:0/3964332282 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7effb006df00 0x7effb00703b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:35.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.214+0000 7effaf7fe640 1 -- 172.21.15.112:0/3964332282 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7effbc0ad690 con 0x7effc80fc740 2024-09-19T09:36:35.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.214+0000 7effc6d9d640 1 --2- 172.21.15.112:0/3964332282 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7effb006df00 0x7effb00703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:35.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.215+0000 7effc6d9d640 1 --2- 172.21.15.112:0/3964332282 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7effb006df00 0x7effb00703b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7effc80ff340 tx=0x7effb800b040 comp rx=0 tx=0).ready entity=mgr.24345 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:35.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.218+0000 7effaf7fe640 1 -- 172.21.15.112:0/3964332282 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7effbc0771e0 con 0x7effc80fc740 2024-09-19T09:36:35.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:34 smithi191 ceph-mon[34834]: pgmap v59: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 739 op/s 2024-09-19T09:36:35.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.470+0000 7effcd167640 1 -- 172.21.15.112:0/3964332282 --> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7effb4000bc0 con 0x7effb006df00 2024-09-19T09:36:35.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.472+0000 7effaf7fe640 1 -- 172.21.15.112:0/3964332282 <== mgr.24345 v2:172.21.15.191:6828/4211232097 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7effb4000bc0 con 0x7effb006df00 2024-09-19T09:36:35.474 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:36:35.474 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:36:35.475 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:36:35.475 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-19T09:36:35.475 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-19T09:36:35.475 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr" 2024-09-19T09:36:35.475 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-19T09:36:35.475 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "2/2 daemons upgraded", 2024-09-19T09:36:35.475 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading mgr daemons", 2024-09-19T09:36:35.475 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:36:35.475 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:36:35.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.474+0000 7effcd167640 1 -- 172.21.15.112:0/3964332282 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7effb006df00 msgr2=0x7effb00703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:35.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.474+0000 7effcd167640 1 --2- 172.21.15.112:0/3964332282 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7effb006df00 0x7effb00703b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7effc80ff340 tx=0x7effb800b040 comp rx=0 tx=0).stop 2024-09-19T09:36:35.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.474+0000 7effcd167640 1 -- 172.21.15.112:0/3964332282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effc80fc740 msgr2=0x7effc80fda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:35.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.474+0000 7effcd167640 1 --2- 172.21.15.112:0/3964332282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effc80fc740 0x7effc80fda80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effbc0048a0 tx=0x7effbc009da0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.474+0000 7effcd167640 1 -- 172.21.15.112:0/3964332282 shutdown_connections 2024-09-19T09:36:35.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.474+0000 7effcd167640 1 --2- 172.21.15.112:0/3964332282 >> [v2:172.21.15.191:6828/4211232097,v1:172.21.15.191:6829/4211232097] conn(0x7effb006df00 0x7effb00703b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.474+0000 7effcd167640 1 --2- 172.21.15.112:0/3964332282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effc80fc740 0x7effc80fda80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.474+0000 7effcd167640 1 --2- 172.21.15.112:0/3964332282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc80fb470 0x7effc80ff590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.474+0000 7effcd167640 1 -- 172.21.15.112:0/3964332282 >> 172.21.15.112:0/3964332282 conn(0x7effc80f6c70 msgr2=0x7effc8066100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:35.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.474+0000 7effcd167640 1 -- 172.21.15.112:0/3964332282 shutdown_connections 2024-09-19T09:36:35.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:36:35.474+0000 7effcd167640 1 -- 172.21.15.112:0/3964332282 wait complete. 2024-09-19T09:36:36.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:35 smithi112 ceph-mon[27605]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:36.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:35 smithi112 ceph-mon[27605]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:36.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:35 smithi112 ceph-mon[27605]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:36.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:35 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1269833583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:36:36.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:35 smithi191 ceph-mon[34834]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:36.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:35 smithi191 ceph-mon[34834]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:36.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:35 smithi191 ceph-mon[34834]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:36.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:35 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/1269833583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:36:37.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:36 smithi191 ceph-mon[34834]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:37.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:36 smithi191 ceph-mon[34834]: pgmap v60: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 526 op/s 2024-09-19T09:36:37.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:36 smithi112 ceph-mon[27605]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:37.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:36 smithi112 ceph-mon[27605]: pgmap v60: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 526 op/s 2024-09-19T09:36:38.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:38 smithi112 ceph-mon[27605]: pgmap v61: 65 pgs: 65 active+clean; 248 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 644 op/s 2024-09-19T09:36:39.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:38 smithi191 ceph-mon[34834]: pgmap v61: 65 pgs: 65 active+clean; 248 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 644 op/s 2024-09-19T09:36:41.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:40 smithi112 ceph-mon[27605]: pgmap v62: 65 pgs: 65 active+clean; 247 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 488 op/s 2024-09-19T09:36:41.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:40 smithi191 ceph-mon[34834]: pgmap v62: 65 pgs: 65 active+clean; 247 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 488 op/s 2024-09-19T09:36:43.132 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:42 smithi112 ceph-mon[27605]: pgmap v63: 65 pgs: 65 active+clean; 247 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 396 op/s 2024-09-19T09:36:43.132 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:42 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:36:43.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:42 smithi191 ceph-mon[34834]: pgmap v63: 65 pgs: 65 active+clean; 247 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 396 op/s 2024-09-19T09:36:43.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:42 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:36:45.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:44 smithi112 ceph-mon[27605]: pgmap v64: 65 pgs: 65 active+clean; 238 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 678 op/s 2024-09-19T09:36:45.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:44 smithi191 ceph-mon[34834]: pgmap v64: 65 pgs: 65 active+clean; 238 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 678 op/s 2024-09-19T09:36:45.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:45 smithi112 ceph-mon[27605]: pgmap v65: 65 pgs: 65 active+clean; 238 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 452 op/s 2024-09-19T09:36:46.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:45 smithi191 ceph-mon[34834]: pgmap v65: 65 pgs: 65 active+clean; 238 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 452 op/s 2024-09-19T09:36:48.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:48.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:48.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:48.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:48.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:48.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:48.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mgr fail", "who": "smithi191.xjpplx"}]: dispatch 2024-09-19T09:36:48.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mgr fail", "who": "smithi191.xjpplx"}]: dispatch 2024-09-19T09:36:48.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: Activating manager daemon smithi112.puhuua 2024-09-19T09:36:48.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: osdmap e47: 6 total, 6 up, 6 in 2024-09-19T09:36:48.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd='[{"prefix": "mgr fail", "who": "smithi191.xjpplx"}]': finished 2024-09-19T09:36:48.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: mgrmap e28: smithi112.puhuua(active, starting, since 0.00642498s) 2024-09-19T09:36:48.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:36:48.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:36:48.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.hcoxjz"}]: dispatch 2024-09-19T09:36:48.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:36:48.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.qweljt"}]: dispatch 2024-09-19T09:36:48.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.jjldod"}]: dispatch 2024-09-19T09:36:48.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr metadata", "who": "smithi112.puhuua", "id": "smithi112.puhuua"}]: dispatch 2024-09-19T09:36:48.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:36:48.787 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:36:48.787 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:36:48.787 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:36:48.787 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:36:48.787 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:36:48.787 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:36:48.787 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:36:48.787 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:36:48.787 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: Manager daemon smithi112.puhuua is now available 2024-09-19T09:36:48.787 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:48.787 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:36:48.787 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:36:48.787 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/trash_purge_schedule"}]: dispatch 2024-09-19T09:36:48.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:48.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:48.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:48.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:48.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' 2024-09-19T09:36:48.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:48.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.24345 172.21.15.191:0/2294374435' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mgr fail", "who": "smithi191.xjpplx"}]: dispatch 2024-09-19T09:36:48.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "mgr fail", "who": "smithi191.xjpplx"}]: dispatch 2024-09-19T09:36:48.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: Activating manager daemon smithi112.puhuua 2024-09-19T09:36:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: osdmap e47: 6 total, 6 up, 6 in 2024-09-19T09:36:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.24345 ' entity='mgr.smithi191.xjpplx' cmd='[{"prefix": "mgr fail", "who": "smithi191.xjpplx"}]': finished 2024-09-19T09:36:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: mgrmap e28: smithi112.puhuua(active, starting, since 0.00642498s) 2024-09-19T09:36:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:36:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:36:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.hcoxjz"}]: dispatch 2024-09-19T09:36:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:36:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.qweljt"}]: dispatch 2024-09-19T09:36:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.jjldod"}]: dispatch 2024-09-19T09:36:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr metadata", "who": "smithi112.puhuua", "id": "smithi112.puhuua"}]: dispatch 2024-09-19T09:36:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:36:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:36:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:36:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:36:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:36:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:36:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:36:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:36:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:36:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: Manager daemon smithi112.puhuua is now available 2024-09-19T09:36:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:36:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:36:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/trash_purge_schedule"}]: dispatch 2024-09-19T09:36:49.180 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-19T09:36:49.180 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T09:36:49.557 DEBUG:teuthology.parallel:result is None 2024-09-19T09:36:49.558 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:36:49.619 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:36:49.619 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-19T09:36:49.652 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-19T09:36:49.652 DEBUG:teuthology.parallel:result is None 2024-09-19T09:36:49.864 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:49 smithi112 ceph-mon[27605]: mgrmap e29: smithi112.puhuua(active, since 1.00862s) 2024-09-19T09:36:49.864 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:49 smithi112 ceph-mon[27605]: pgmap v3: 65 pgs: 65 active+clean; 224 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:36:49.864 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:49 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:49.864 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:49 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:49.963 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:49 smithi191 ceph-mon[34834]: mgrmap e29: smithi112.puhuua(active, since 1.00862s) 2024-09-19T09:36:49.963 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:49 smithi191 ceph-mon[34834]: pgmap v3: 65 pgs: 65 active+clean; 224 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:36:49.963 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:49 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:49.963 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:49 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:51.270 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:50 smithi191 ceph-mon[34834]: [19/Sep/2024:09:36:49] ENGINE Bus STARTING 2024-09-19T09:36:51.270 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:50 smithi191 ceph-mon[34834]: pgmap v4: 65 pgs: 65 active+clean; 224 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:36:51.271 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:50 smithi191 ceph-mon[34834]: [19/Sep/2024:09:36:49] ENGINE Serving on https://172.21.15.112:7150 2024-09-19T09:36:51.271 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:50 smithi191 ceph-mon[34834]: [19/Sep/2024:09:36:49] ENGINE Error in HTTPServer.serve 2024-09-19T09:36:51.271 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Traceback (most recent call last): 2024-09-19T09:36:51.271 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:36:51.271 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:36:51.272 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:36:51.272 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: self._run(expiration_interval) 2024-09-19T09:36:51.272 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:36:51.272 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:36:51.272 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:36:51.272 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:36:51.273 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:36:51.273 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: s = self.context.wrap_socket( 2024-09-19T09:36:51.273 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:36:51.273 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: return self.sslsocket_class._create( 2024-09-19T09:36:51.273 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:36:51.273 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: self.do_handshake() 2024-09-19T09:36:51.273 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:36:51.274 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: self._sslobj.do_handshake() 2024-09-19T09:36:51.274 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:36:51.274 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:50 smithi191 ceph-mon[34834]: mgrmap e30: smithi112.puhuua(active, since 2s) 2024-09-19T09:36:51.274 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:50 smithi191 ceph-mon[34834]: [19/Sep/2024:09:36:50] ENGINE Serving on http://172.21.15.112:8765 2024-09-19T09:36:51.274 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:50 smithi191 ceph-mon[34834]: [19/Sep/2024:09:36:50] ENGINE Bus STARTED 2024-09-19T09:36:51.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:50 smithi112 ceph-mon[27605]: [19/Sep/2024:09:36:49] ENGINE Bus STARTING 2024-09-19T09:36:51.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:50 smithi112 ceph-mon[27605]: pgmap v4: 65 pgs: 65 active+clean; 224 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:36:51.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:50 smithi112 ceph-mon[27605]: [19/Sep/2024:09:36:49] ENGINE Serving on https://172.21.15.112:7150 2024-09-19T09:36:51.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:50 smithi112 ceph-mon[27605]: [19/Sep/2024:09:36:49] ENGINE Error in HTTPServer.serve 2024-09-19T09:36:51.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Traceback (most recent call last): 2024-09-19T09:36:51.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:36:51.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:36:51.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:36:51.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._run(expiration_interval) 2024-09-19T09:36:51.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:36:51.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:36:51.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:36:51.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:36:51.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:36:51.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s = self.context.wrap_socket( 2024-09-19T09:36:51.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:36:51.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: return self.sslsocket_class._create( 2024-09-19T09:36:51.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:36:51.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self.do_handshake() 2024-09-19T09:36:51.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:36:51.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._sslobj.do_handshake() 2024-09-19T09:36:51.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:36:51.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:50 smithi112 ceph-mon[27605]: mgrmap e30: smithi112.puhuua(active, since 2s) 2024-09-19T09:36:51.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:50 smithi112 ceph-mon[27605]: [19/Sep/2024:09:36:50] ENGINE Serving on http://172.21.15.112:8765 2024-09-19T09:36:51.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:50 smithi112 ceph-mon[27605]: [19/Sep/2024:09:36:50] ENGINE Bus STARTED 2024-09-19T09:36:52.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:52 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:52.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:52 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:52.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:52 smithi191 ceph-mon[34834]: pgmap v5: 65 pgs: 65 active+clean; 224 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:36:52.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:52 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:52.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:52 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:52.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:52 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:52.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:52 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:52.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:52 smithi112 ceph-mon[27605]: pgmap v5: 65 pgs: 65 active+clean; 224 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:36:52.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:52 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:52.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:52 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:53.585 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:53 smithi112 ceph-mon[27605]: mgrmap e31: smithi112.puhuua(active, since 4s) 2024-09-19T09:36:53.585 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:53 smithi112 ceph-mon[27605]: Standby manager daemon smithi191.xjpplx started 2024-09-19T09:36:53.585 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:53 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.191:0/3421561700' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/crt"}]: dispatch 2024-09-19T09:36:53.585 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:53 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.191:0/3421561700' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:36:53.585 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:53 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.191:0/3421561700' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/key"}]: dispatch 2024-09-19T09:36:53.586 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:53 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.191:0/3421561700' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:36:53.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:53 smithi191 ceph-mon[34834]: mgrmap e31: smithi112.puhuua(active, since 4s) 2024-09-19T09:36:53.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:53 smithi191 ceph-mon[34834]: Standby manager daemon smithi191.xjpplx started 2024-09-19T09:36:53.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:53 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/3421561700' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/crt"}]: dispatch 2024-09-19T09:36:53.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:53 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/3421561700' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:36:53.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:53 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/3421561700' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/key"}]: dispatch 2024-09-19T09:36:53.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:53 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/3421561700' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:36:54.686 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:54 smithi191 ceph-mon[34834]: mgrmap e32: smithi112.puhuua(active, since 5s), standbys: smithi191.xjpplx 2024-09-19T09:36:54.686 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:54 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr metadata", "who": "smithi191.xjpplx", "id": "smithi191.xjpplx"}]: dispatch 2024-09-19T09:36:54.686 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:54 smithi191 ceph-mon[34834]: pgmap v6: 65 pgs: 65 active+clean; 224 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:36:54.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:54 smithi112 ceph-mon[27605]: mgrmap e32: smithi112.puhuua(active, since 5s), standbys: smithi191.xjpplx 2024-09-19T09:36:54.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:54 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr metadata", "who": "smithi191.xjpplx", "id": "smithi191.xjpplx"}]: dispatch 2024-09-19T09:36:54.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:54 smithi112 ceph-mon[27605]: pgmap v6: 65 pgs: 65 active+clean; 224 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:36:56.896 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:56 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:56.897 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:56 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:56.897 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:56 smithi191 ceph-mon[34834]: pgmap v7: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 248 KiB/s rd, 139 KiB/s wr, 73 op/s 2024-09-19T09:36:56.897 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:56 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:56.897 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:56 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:56.913 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:56 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:56.913 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:56 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:56.913 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:56 smithi112 ceph-mon[27605]: pgmap v7: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 248 KiB/s rd, 139 KiB/s wr, 73 op/s 2024-09-19T09:36:56.913 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:56 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:56.913 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:56 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:36:59.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:36:58 smithi112 ceph-mon[27605]: pgmap v8: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 193 KiB/s rd, 108 KiB/s wr, 57 op/s 2024-09-19T09:36:59.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:36:58 smithi191 ceph-mon[34834]: pgmap v8: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 193 KiB/s rd, 108 KiB/s wr, 57 op/s 2024-09-19T09:37:00.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:00.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-19T09:37:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-19T09:37:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: pgmap v9: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 163 KiB/s rd, 93 KiB/s wr, 55 op/s 2024-09-19T09:37:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:37:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:37:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:37:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:37:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:00.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:00.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:00.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:00.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:00 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:01.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-19T09:37:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-19T09:37:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: pgmap v9: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 163 KiB/s rd, 93 KiB/s wr, 55 op/s 2024-09-19T09:37:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:37:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:37:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:37:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:37:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:01.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:01.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:01.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:01.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:00 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:01.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:01 smithi112 ceph-mon[27605]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:37:01.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:01 smithi112 ceph-mon[27605]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:37:01.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:01 smithi112 ceph-mon[27605]: Reconfiguring prometheus.smithi112 (dependencies changed)... 2024-09-19T09:37:01.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:01 smithi112 ceph-mon[27605]: Reconfiguring daemon prometheus.smithi112 on smithi112 2024-09-19T09:37:02.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:01 smithi191 ceph-mon[34834]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:37:02.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:01 smithi191 ceph-mon[34834]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:37:02.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:01 smithi191 ceph-mon[34834]: Reconfiguring prometheus.smithi112 (dependencies changed)... 2024-09-19T09:37:02.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:01 smithi191 ceph-mon[34834]: Reconfiguring daemon prometheus.smithi112 on smithi112 2024-09-19T09:37:02.904 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:02 smithi112 ceph-mon[27605]: pgmap v10: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 149 KiB/s rd, 85 KiB/s wr, 50 op/s 2024-09-19T09:37:03.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:02 smithi191 ceph-mon[34834]: pgmap v10: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 149 KiB/s rd, 85 KiB/s wr, 50 op/s 2024-09-19T09:37:03.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:03 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:37:04.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:03 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:37:05.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:04 smithi191 ceph-mon[34834]: pgmap v11: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 149 KiB/s rd, 85 KiB/s wr, 50 op/s 2024-09-19T09:37:05.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:04 smithi112 ceph-mon[27605]: pgmap v11: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 149 KiB/s rd, 85 KiB/s wr, 50 op/s 2024-09-19T09:37:05.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.561+0000 7facd22aa640 1 -- 172.21.15.112:0/3715811895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faccc0fc520 msgr2=0x7faccc0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.561+0000 7facd22aa640 1 --2- 172.21.15.112:0/3715811895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faccc0fc520 0x7faccc0fc930 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7facbc0048d0 tx=0x7facbc009da0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.561+0000 7facd22aa640 1 -- 172.21.15.112:0/3715811895 shutdown_connections 2024-09-19T09:37:05.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.561+0000 7facd22aa640 1 --2- 172.21.15.112:0/3715811895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faccc0fd7f0 0x7faccc0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.561+0000 7facd22aa640 1 --2- 172.21.15.112:0/3715811895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faccc0fc520 0x7faccc0fc930 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.561+0000 7facd22aa640 1 -- 172.21.15.112:0/3715811895 >> 172.21.15.112:0/3715811895 conn(0x7faccc0f7ce0 msgr2=0x7faccc0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:05.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.561+0000 7facd22aa640 1 -- 172.21.15.112:0/3715811895 shutdown_connections 2024-09-19T09:37:05.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.561+0000 7facd22aa640 1 -- 172.21.15.112:0/3715811895 wait complete. 2024-09-19T09:37:05.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.561+0000 7facd22aa640 1 Processor -- start 2024-09-19T09:37:05.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.561+0000 7facd22aa640 1 -- start start 2024-09-19T09:37:05.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facd22aa640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faccc0fc520 0x7faccc10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facd22aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faccc0fd7f0 0x7faccc10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facd22aa640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc10dc10 con 0x7faccc0fd7f0 2024-09-19T09:37:05.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facd22aa640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc10e430 con 0x7faccc0fc520 2024-09-19T09:37:05.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facc3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faccc0fd7f0 0x7faccc10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facc3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faccc0fd7f0 0x7faccc10d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41568/0 (socket says 172.21.15.112:41568) 2024-09-19T09:37:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facc3fff640 1 -- 172.21.15.112:0/151071428 learned_addr learned my addr 172.21.15.112:0/151071428 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:37:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7faccbfff640 1 --2- 172.21.15.112:0/151071428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faccc0fc520 0x7faccc10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facc3fff640 1 -- 172.21.15.112:0/151071428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faccc0fc520 msgr2=0x7faccc10d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facc3fff640 1 --2- 172.21.15.112:0/151071428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faccc0fc520 0x7faccc10d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facc3fff640 1 -- 172.21.15.112:0/151071428 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc005040 con 0x7faccc0fd7f0 2024-09-19T09:37:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facc3fff640 1 --2- 172.21.15.112:0/151071428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faccc0fd7f0 0x7faccc10d5c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7facb400c830 tx=0x7facb4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facc97fa640 1 -- 172.21.15.112:0/151071428 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facb400a7d0 con 0x7faccc0fd7f0 2024-09-19T09:37:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facc97fa640 1 -- 172.21.15.112:0/151071428 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7facb400add0 con 0x7faccc0fd7f0 2024-09-19T09:37:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facd22aa640 1 -- 172.21.15.112:0/151071428 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faccc10e6c0 con 0x7faccc0fd7f0 2024-09-19T09:37:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facc97fa640 1 -- 172.21.15.112:0/151071428 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facb40113a0 con 0x7faccc0fd7f0 2024-09-19T09:37:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.562+0000 7facd22aa640 1 -- 172.21.15.112:0/151071428 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faccc10ec60 con 0x7faccc0fd7f0 2024-09-19T09:37:05.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.564+0000 7facd22aa640 1 -- 172.21.15.112:0/151071428 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faccc0fb980 con 0x7faccc0fd7f0 2024-09-19T09:37:05.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.564+0000 7facc97fa640 1 -- 172.21.15.112:0/151071428 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7facb400a930 con 0x7faccc0fd7f0 2024-09-19T09:37:05.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.564+0000 7facc97fa640 1 --2- 172.21.15.112:0/151071428 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7facb806df60 0x7facb8070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.564+0000 7facc97fa640 1 -- 172.21.15.112:0/151071428 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7facb408da30 con 0x7faccc0fd7f0 2024-09-19T09:37:05.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.565+0000 7faccbfff640 1 --2- 172.21.15.112:0/151071428 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7facb806df60 0x7facb8070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.565+0000 7faccbfff640 1 --2- 172.21.15.112:0/151071428 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7facb806df60 0x7facb8070410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7facbc000c00 tx=0x7facbc035040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:05.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.569+0000 7facc97fa640 1 -- 172.21.15.112:0/151071428 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7facb4057330 con 0x7faccc0fd7f0 2024-09-19T09:37:05.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.772+0000 7facd22aa640 1 -- 172.21.15.112:0/151071428 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faccc10ef80 con 0x7facb806df60 2024-09-19T09:37:05.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.774+0000 7facc97fa640 1 -- 172.21.15.112:0/151071428 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7faccc10ef80 con 0x7facb806df60 2024-09-19T09:37:05.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.776+0000 7facd22aa640 1 -- 172.21.15.112:0/151071428 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7facb806df60 msgr2=0x7facb8070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.776+0000 7facd22aa640 1 --2- 172.21.15.112:0/151071428 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7facb806df60 0x7facb8070410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7facbc000c00 tx=0x7facbc035040 comp rx=0 tx=0).stop 2024-09-19T09:37:05.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.776+0000 7facd22aa640 1 -- 172.21.15.112:0/151071428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faccc0fd7f0 msgr2=0x7faccc10d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.776+0000 7facd22aa640 1 --2- 172.21.15.112:0/151071428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faccc0fd7f0 0x7faccc10d5c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7facb400c830 tx=0x7facb4004430 comp rx=0 tx=0).stop 2024-09-19T09:37:05.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.776+0000 7facd22aa640 1 -- 172.21.15.112:0/151071428 shutdown_connections 2024-09-19T09:37:05.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.776+0000 7facd22aa640 1 --2- 172.21.15.112:0/151071428 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7facb806df60 0x7facb8070410 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.776+0000 7facd22aa640 1 --2- 172.21.15.112:0/151071428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faccc0fd7f0 0x7faccc10d5c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.776+0000 7facd22aa640 1 --2- 172.21.15.112:0/151071428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faccc0fc520 0x7faccc10d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.776+0000 7facd22aa640 1 -- 172.21.15.112:0/151071428 >> 172.21.15.112:0/151071428 conn(0x7faccc0f7ce0 msgr2=0x7faccc0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:05.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.776+0000 7facd22aa640 1 -- 172.21.15.112:0/151071428 shutdown_connections 2024-09-19T09:37:05.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.776+0000 7facd22aa640 1 -- 172.21.15.112:0/151071428 wait complete. 2024-09-19T09:37:05.786 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:37:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.858+0000 7fc1c0c8f640 1 -- 172.21.15.112:0/2236012008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1bc0fa980 msgr2=0x7fc1bc0fad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.858+0000 7fc1c0c8f640 1 --2- 172.21.15.112:0/2236012008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1bc0fa980 0x7fc1bc0fad90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0048d0 tx=0x7fc1ac009da0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.858+0000 7fc1c0c8f640 1 -- 172.21.15.112:0/2236012008 shutdown_connections 2024-09-19T09:37:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.858+0000 7fc1c0c8f640 1 --2- 172.21.15.112:0/2236012008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1bc0fb2d0 0x7fc1bc0fdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.858+0000 7fc1c0c8f640 1 --2- 172.21.15.112:0/2236012008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1bc0fa980 0x7fc1bc0fad90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.858+0000 7fc1c0c8f640 1 -- 172.21.15.112:0/2236012008 >> 172.21.15.112:0/2236012008 conn(0x7fc1bc0f63c0 msgr2=0x7fc1bc0f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.858+0000 7fc1c0c8f640 1 -- 172.21.15.112:0/2236012008 shutdown_connections 2024-09-19T09:37:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.858+0000 7fc1c0c8f640 1 -- 172.21.15.112:0/2236012008 wait complete. 2024-09-19T09:37:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.858+0000 7fc1c0c8f640 1 Processor -- start 2024-09-19T09:37:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.858+0000 7fc1c0c8f640 1 -- start start 2024-09-19T09:37:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.858+0000 7fc1c0c8f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1bc0fa980 0x7fc1bc10d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1c0c8f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1bc0fb2d0 0x7fc1bc10d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1c0c8f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc10e770 con 0x7fc1bc0fb2d0 2024-09-19T09:37:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1c0c8f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc10e8e0 con 0x7fc1bc0fa980 2024-09-19T09:37:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1b9d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1bc0fb2d0 0x7fc1bc10d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1b9d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1bc0fb2d0 0x7fc1bc10d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41596/0 (socket says 172.21.15.112:41596) 2024-09-19T09:37:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1b9d9b640 1 -- 172.21.15.112:0/2631940004 learned_addr learned my addr 172.21.15.112:0/2631940004 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:37:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1ba59c640 1 --2- 172.21.15.112:0/2631940004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1bc0fa980 0x7fc1bc10d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1b9d9b640 1 -- 172.21.15.112:0/2631940004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1bc0fa980 msgr2=0x7fc1bc10d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1b9d9b640 1 --2- 172.21.15.112:0/2631940004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1bc0fa980 0x7fc1bc10d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1b9d9b640 1 -- 172.21.15.112:0/2631940004 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac005040 con 0x7fc1bc0fb2d0 2024-09-19T09:37:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1b9d9b640 1 --2- 172.21.15.112:0/2631940004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1bc0fb2d0 0x7fc1bc10d900 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000b580 tx=0x7fc1b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1aaffd640 1 -- 172.21.15.112:0/2631940004 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1b000f6f0 con 0x7fc1bc0fb2d0 2024-09-19T09:37:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1aaffd640 1 -- 172.21.15.112:0/2631940004 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc1b000fcf0 con 0x7fc1bc0fb2d0 2024-09-19T09:37:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1c0c8f640 1 -- 172.21.15.112:0/2631940004 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1bc10ebc0 con 0x7fc1bc0fb2d0 2024-09-19T09:37:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1aaffd640 1 -- 172.21.15.112:0/2631940004 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1b00103a0 con 0x7fc1bc0fb2d0 2024-09-19T09:37:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.859+0000 7fc1c0c8f640 1 -- 172.21.15.112:0/2631940004 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1bc10f0e0 con 0x7fc1bc0fb2d0 2024-09-19T09:37:05.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.860+0000 7fc1c0c8f640 1 -- 172.21.15.112:0/2631940004 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1bc0fa060 con 0x7fc1bc0fb2d0 2024-09-19T09:37:05.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.861+0000 7fc1aaffd640 1 -- 172.21.15.112:0/2631940004 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7fc1b00116b0 con 0x7fc1bc0fb2d0 2024-09-19T09:37:05.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.861+0000 7fc1aaffd640 1 --2- 172.21.15.112:0/2631940004 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fc1a406df60 0x7fc1a4070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.862+0000 7fc1ba59c640 1 --2- 172.21.15.112:0/2631940004 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fc1a406df60 0x7fc1a4070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.862+0000 7fc1aaffd640 1 -- 172.21.15.112:0/2631940004 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc1b008d790 con 0x7fc1bc0fb2d0 2024-09-19T09:37:05.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.862+0000 7fc1ba59c640 1 --2- 172.21.15.112:0/2631940004 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fc1a406df60 0x7fc1a4070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac000c00 tx=0x7fc1ac035040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:05.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:05.866+0000 7fc1aaffd640 1 -- 172.21.15.112:0/2631940004 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fc1b0057090 con 0x7fc1bc0fb2d0 2024-09-19T09:37:06.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.056+0000 7fc1c0c8f640 1 -- 172.21.15.112:0/2631940004 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1bc1052c0 con 0x7fc1a406df60 2024-09-19T09:37:06.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.057+0000 7fc1aaffd640 1 -- 172.21.15.112:0/2631940004 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fc1bc1052c0 con 0x7fc1a406df60 2024-09-19T09:37:06.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.060+0000 7fc1c0c8f640 1 -- 172.21.15.112:0/2631940004 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fc1a406df60 msgr2=0x7fc1a4070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.060+0000 7fc1c0c8f640 1 --2- 172.21.15.112:0/2631940004 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fc1a406df60 0x7fc1a4070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac000c00 tx=0x7fc1ac035040 comp rx=0 tx=0).stop 2024-09-19T09:37:06.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.060+0000 7fc1c0c8f640 1 -- 172.21.15.112:0/2631940004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1bc0fb2d0 msgr2=0x7fc1bc10d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.060+0000 7fc1c0c8f640 1 --2- 172.21.15.112:0/2631940004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1bc0fb2d0 0x7fc1bc10d900 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000b580 tx=0x7fc1b00091a0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.060+0000 7fc1c0c8f640 1 -- 172.21.15.112:0/2631940004 shutdown_connections 2024-09-19T09:37:06.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.060+0000 7fc1c0c8f640 1 --2- 172.21.15.112:0/2631940004 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fc1a406df60 0x7fc1a4070410 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.060+0000 7fc1c0c8f640 1 --2- 172.21.15.112:0/2631940004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1bc0fb2d0 0x7fc1bc10d900 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.060+0000 7fc1c0c8f640 1 --2- 172.21.15.112:0/2631940004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1bc0fa980 0x7fc1bc10d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.060+0000 7fc1c0c8f640 1 -- 172.21.15.112:0/2631940004 >> 172.21.15.112:0/2631940004 conn(0x7fc1bc0f63c0 msgr2=0x7fc1bc0f7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.060+0000 7fc1c0c8f640 1 -- 172.21.15.112:0/2631940004 shutdown_connections 2024-09-19T09:37:06.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.060+0000 7fc1c0c8f640 1 -- 172.21.15.112:0/2631940004 wait complete. 2024-09-19T09:37:06.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.149+0000 7fcf6e9a9640 1 -- 172.21.15.112:0/17594758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf680fd800 msgr2=0x7fcf680fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.149+0000 7fcf6e9a9640 1 --2- 172.21.15.112:0/17594758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf680fd800 0x7fcf680fdc70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0048d0 tx=0x7fcf5c009da0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.150+0000 7fcf6e9a9640 1 -- 172.21.15.112:0/17594758 shutdown_connections 2024-09-19T09:37:06.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.150+0000 7fcf6e9a9640 1 --2- 172.21.15.112:0/17594758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf680fd800 0x7fcf680fdc70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.150+0000 7fcf6e9a9640 1 --2- 172.21.15.112:0/17594758 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf680fc530 0x7fcf680fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.150+0000 7fcf6e9a9640 1 -- 172.21.15.112:0/17594758 >> 172.21.15.112:0/17594758 conn(0x7fcf680f7d10 msgr2=0x7fcf680fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.150+0000 7fcf6e9a9640 1 -- 172.21.15.112:0/17594758 shutdown_connections 2024-09-19T09:37:06.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.150+0000 7fcf6e9a9640 1 -- 172.21.15.112:0/17594758 wait complete. 2024-09-19T09:37:06.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.150+0000 7fcf6e9a9640 1 Processor -- start 2024-09-19T09:37:06.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.151+0000 7fcf6e9a9640 1 -- start start 2024-09-19T09:37:06.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.151+0000 7fcf6e9a9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf680fc530 0x7fcf68071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.151+0000 7fcf6e9a9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf680fd800 0x7fcf6806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.151+0000 7fcf6e9a9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6806fff0 con 0x7fcf680fc530 2024-09-19T09:37:06.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.151+0000 7fcf6e9a9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68070130 con 0x7fcf680fd800 2024-09-19T09:37:06.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.151+0000 7fcf67fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf680fc530 0x7fcf68071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.151+0000 7fcf67fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf680fc530 0x7fcf68071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41622/0 (socket says 172.21.15.112:41622) 2024-09-19T09:37:06.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.151+0000 7fcf67fff640 1 -- 172.21.15.112:0/2740882768 learned_addr learned my addr 172.21.15.112:0/2740882768 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:37:06.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.151+0000 7fcf677fe640 1 --2- 172.21.15.112:0/2740882768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf680fd800 0x7fcf6806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.151+0000 7fcf67fff640 1 -- 172.21.15.112:0/2740882768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf680fd800 msgr2=0x7fcf6806fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.151+0000 7fcf67fff640 1 --2- 172.21.15.112:0/2740882768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf680fd800 0x7fcf6806fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.151+0000 7fcf67fff640 1 -- 172.21.15.112:0/2740882768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c005040 con 0x7fcf680fc530 2024-09-19T09:37:06.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.151+0000 7fcf67fff640 1 --2- 172.21.15.112:0/2740882768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf680fc530 0x7fcf68071570 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcf58002a50 tx=0x7fcf58004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.152+0000 7fcf64ff9640 1 -- 172.21.15.112:0/2740882768 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf58007c30 con 0x7fcf680fc530 2024-09-19T09:37:06.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.152+0000 7fcf6e9a9640 1 -- 172.21.15.112:0/2740882768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf68070410 con 0x7fcf680fc530 2024-09-19T09:37:06.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.152+0000 7fcf64ff9640 1 -- 172.21.15.112:0/2740882768 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcf5800f040 con 0x7fcf680fc530 2024-09-19T09:37:06.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.152+0000 7fcf6e9a9640 1 -- 172.21.15.112:0/2740882768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf681150f0 con 0x7fcf680fc530 2024-09-19T09:37:06.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.152+0000 7fcf64ff9640 1 -- 172.21.15.112:0/2740882768 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf5800da10 con 0x7fcf680fc530 2024-09-19T09:37:06.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.153+0000 7fcf6e9a9640 1 -- 172.21.15.112:0/2740882768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf680fb990 con 0x7fcf680fc530 2024-09-19T09:37:06.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.153+0000 7fcf64ff9640 1 -- 172.21.15.112:0/2740882768 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7fcf5800dc50 con 0x7fcf680fc530 2024-09-19T09:37:06.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.154+0000 7fcf64ff9640 1 --2- 172.21.15.112:0/2740882768 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fcf5006df60 0x7fcf50070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.154+0000 7fcf64ff9640 1 -- 172.21.15.112:0/2740882768 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fcf5808d180 con 0x7fcf680fc530 2024-09-19T09:37:06.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.154+0000 7fcf677fe640 1 --2- 172.21.15.112:0/2740882768 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fcf5006df60 0x7fcf50070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.155+0000 7fcf677fe640 1 --2- 172.21.15.112:0/2740882768 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fcf5006df60 0x7fcf50070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00b020 tx=0x7fcf5c035040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.159+0000 7fcf64ff9640 1 -- 172.21.15.112:0/2740882768 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fcf58056a20 con 0x7fcf680fc530 2024-09-19T09:37:06.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.342+0000 7fcf6e9a9640 1 -- 172.21.15.112:0/2740882768 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf68101c50 con 0x7fcf5006df60 2024-09-19T09:37:06.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.351+0000 7fcf64ff9640 1 -- 172.21.15.112:0/2740882768 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fcf68101c50 con 0x7fcf5006df60 2024-09-19T09:37:06.353 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:37:06.353 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (82s) 10s ago 9m 28.2M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:37:06.353 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (10m) 10s ago 10m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1513f1075df5 2024-09-19T09:37:06.353 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (9m) 14s ago 9m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6c313b300b35 2024-09-19T09:37:06.353 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (77s) 10s ago 9m 82.0M - 9.4.7 954c08fa6188 838cccf865fe 2024-09-19T09:37:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (4m) 10s ago 4m 180M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:37:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (4m) 10s ago 4m 116M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:37:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (4m) 14s ago 4m 12.6M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:37:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (4m) 14s ago 4m 15.0M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:37:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (54s) 10s ago 11m 475M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:37:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283 running (2m) 14s ago 9m 108M - 19.1.1-361-g2f599a46 d2baa855c067 b9c59e3583b1 2024-09-19T09:37:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (11m) 10s ago 11m 54.3M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 34676d67b669 2024-09-19T09:37:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (8m) 14s ago 8m 40.0M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 35690ef0929b 2024-09-19T09:37:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (115s) 10s ago 10m 16.4M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:37:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (67s) 14s ago 9m 15.7M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:37:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (8m) 10s ago 8m 229M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 621693067dce 2024-09-19T09:37:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (7m) 10s ago 7m 246M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1742e5964367 2024-09-19T09:37:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (7m) 10s ago 7m 211M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 4dcca18af229 2024-09-19T09:37:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (6m) 14s ago 6m 270M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:37:06.355 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (6m) 14s ago 6m 239M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:37:06.355 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (6m) 14s ago 6m 226M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:37:06.355 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 starting - - - - 2024-09-19T09:37:06.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.353+0000 7fcf6e9a9640 1 -- 172.21.15.112:0/2740882768 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fcf5006df60 msgr2=0x7fcf50070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.353+0000 7fcf6e9a9640 1 --2- 172.21.15.112:0/2740882768 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fcf5006df60 0x7fcf50070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00b020 tx=0x7fcf5c035040 comp rx=0 tx=0).stop 2024-09-19T09:37:06.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.353+0000 7fcf6e9a9640 1 -- 172.21.15.112:0/2740882768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf680fc530 msgr2=0x7fcf68071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.353+0000 7fcf6e9a9640 1 --2- 172.21.15.112:0/2740882768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf680fc530 0x7fcf68071570 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcf58002a50 tx=0x7fcf58004600 comp rx=0 tx=0).stop 2024-09-19T09:37:06.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.353+0000 7fcf6e9a9640 1 -- 172.21.15.112:0/2740882768 shutdown_connections 2024-09-19T09:37:06.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.353+0000 7fcf6e9a9640 1 --2- 172.21.15.112:0/2740882768 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fcf5006df60 0x7fcf50070410 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.353+0000 7fcf6e9a9640 1 --2- 172.21.15.112:0/2740882768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf680fd800 0x7fcf6806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.353+0000 7fcf6e9a9640 1 --2- 172.21.15.112:0/2740882768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf680fc530 0x7fcf68071570 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.353+0000 7fcf6e9a9640 1 -- 172.21.15.112:0/2740882768 >> 172.21.15.112:0/2740882768 conn(0x7fcf680f7d10 msgr2=0x7fcf680f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.354+0000 7fcf6e9a9640 1 -- 172.21.15.112:0/2740882768 shutdown_connections 2024-09-19T09:37:06.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.354+0000 7fcf6e9a9640 1 -- 172.21.15.112:0/2740882768 wait complete. 2024-09-19T09:37:06.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.430+0000 7f209a5fa640 1 -- 172.21.15.112:0/3215602901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20940ff720 msgr2=0x7f2094101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.430+0000 7f209a5fa640 1 --2- 172.21.15.112:0/3215602901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20940ff720 0x7f2094101b00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f20880048d0 tx=0x7f2088009da0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.430+0000 7f209a5fa640 1 -- 172.21.15.112:0/3215602901 shutdown_connections 2024-09-19T09:37:06.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.430+0000 7f209a5fa640 1 --2- 172.21.15.112:0/3215602901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20940ff720 0x7f2094101b00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.430+0000 7f209a5fa640 1 --2- 172.21.15.112:0/3215602901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20940666b0 0x7f20940ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.430+0000 7f209a5fa640 1 -- 172.21.15.112:0/3215602901 >> 172.21.15.112:0/3215602901 conn(0x7f20940f6c10 msgr2=0x7f20940f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.430+0000 7f209a5fa640 1 -- 172.21.15.112:0/3215602901 shutdown_connections 2024-09-19T09:37:06.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.430+0000 7f209a5fa640 1 -- 172.21.15.112:0/3215602901 wait complete. 2024-09-19T09:37:06.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.431+0000 7f209a5fa640 1 Processor -- start 2024-09-19T09:37:06.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.431+0000 7f209a5fa640 1 -- start start 2024-09-19T09:37:06.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.431+0000 7f209a5fa640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20940666b0 0x7f209410f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.431+0000 7f209a5fa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20940ff720 0x7f209410f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.431+0000 7f209a5fa640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209410fed0 con 0x7f20940ff720 2024-09-19T09:37:06.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.431+0000 7f209a5fa640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2094110650 con 0x7f20940666b0 2024-09-19T09:37:06.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.431+0000 7f20937fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20940ff720 0x7f209410f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.431+0000 7f20937fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20940ff720 0x7f209410f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41646/0 (socket says 172.21.15.112:41646) 2024-09-19T09:37:06.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.431+0000 7f20937fe640 1 -- 172.21.15.112:0/1037049981 learned_addr learned my addr 172.21.15.112:0/1037049981 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:37:06.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.431+0000 7f2093fff640 1 --2- 172.21.15.112:0/1037049981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20940666b0 0x7f209410f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.432+0000 7f20937fe640 1 -- 172.21.15.112:0/1037049981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20940666b0 msgr2=0x7f209410f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.432+0000 7f20937fe640 1 --2- 172.21.15.112:0/1037049981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20940666b0 0x7f209410f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.432+0000 7f20937fe640 1 -- 172.21.15.112:0/1037049981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2088005040 con 0x7f20940ff720 2024-09-19T09:37:06.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.432+0000 7f20937fe640 1 --2- 172.21.15.112:0/1037049981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20940ff720 0x7f209410f880 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f208802d040 tx=0x7f2088009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.432+0000 7f2090ff9640 1 -- 172.21.15.112:0/1037049981 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2088038070 con 0x7f20940ff720 2024-09-19T09:37:06.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.432+0000 7f2090ff9640 1 -- 172.21.15.112:0/1037049981 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f208802ae90 con 0x7f20940ff720 2024-09-19T09:37:06.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.432+0000 7f209a5fa640 1 -- 172.21.15.112:0/1037049981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2094110880 con 0x7f20940ff720 2024-09-19T09:37:06.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.432+0000 7f2090ff9640 1 -- 172.21.15.112:0/1037049981 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f208803e670 con 0x7f20940ff720 2024-09-19T09:37:06.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.432+0000 7f209a5fa640 1 -- 172.21.15.112:0/1037049981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2094110e20 con 0x7f20940ff720 2024-09-19T09:37:06.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.433+0000 7f209a5fa640 1 -- 172.21.15.112:0/1037049981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20940fa8b0 con 0x7f20940ff720 2024-09-19T09:37:06.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.433+0000 7f2090ff9640 1 -- 172.21.15.112:0/1037049981 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f2088030020 con 0x7f20940ff720 2024-09-19T09:37:06.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.434+0000 7f2090ff9640 1 --2- 172.21.15.112:0/1037049981 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f207c06df60 0x7f207c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.434+0000 7f2090ff9640 1 -- 172.21.15.112:0/1037049981 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f20880ad960 con 0x7f20940ff720 2024-09-19T09:37:06.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.434+0000 7f2093fff640 1 --2- 172.21.15.112:0/1037049981 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f207c06df60 0x7f207c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.434+0000 7f2093fff640 1 --2- 172.21.15.112:0/1037049981 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f207c06df60 0x7f207c070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2084009af0 tx=0x7f208400b040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.438+0000 7f2090ff9640 1 -- 172.21.15.112:0/1037049981 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f2088077290 con 0x7f20940ff720 2024-09-19T09:37:06.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.669+0000 7f209a5fa640 1 -- 172.21.15.112:0/1037049981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f20940f8700 con 0x7f20940ff720 2024-09-19T09:37:06.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.670+0000 7f2090ff9640 1 -- 172.21.15.112:0/1037049981 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f208807a950 con 0x7f20940ff720 2024-09-19T09:37:06.671 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:37:06.672 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:37:06.672 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T09:37:06.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:37:06.672 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:37:06.672 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:37:06.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:37:06.672 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:37:06.672 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T09:37:06.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:37:06.672 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:37:06.672 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:37:06.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:37:06.673 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:37:06.673 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 12, 2024-09-19T09:37:06.673 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:37:06.673 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:37:06.673 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:37:06.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.672+0000 7f209a5fa640 1 -- 172.21.15.112:0/1037049981 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f207c06df60 msgr2=0x7f207c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.672+0000 7f209a5fa640 1 --2- 172.21.15.112:0/1037049981 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f207c06df60 0x7f207c070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2084009af0 tx=0x7f208400b040 comp rx=0 tx=0).stop 2024-09-19T09:37:06.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.672+0000 7f209a5fa640 1 -- 172.21.15.112:0/1037049981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20940ff720 msgr2=0x7f209410f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.672+0000 7f209a5fa640 1 --2- 172.21.15.112:0/1037049981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20940ff720 0x7f209410f880 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f208802d040 tx=0x7f2088009da0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.672+0000 7f209a5fa640 1 -- 172.21.15.112:0/1037049981 shutdown_connections 2024-09-19T09:37:06.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.672+0000 7f209a5fa640 1 --2- 172.21.15.112:0/1037049981 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f207c06df60 0x7f207c070410 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.672+0000 7f209a5fa640 1 --2- 172.21.15.112:0/1037049981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20940ff720 0x7f209410f880 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.672+0000 7f209a5fa640 1 --2- 172.21.15.112:0/1037049981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20940666b0 0x7f209410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.672+0000 7f209a5fa640 1 -- 172.21.15.112:0/1037049981 >> 172.21.15.112:0/1037049981 conn(0x7f20940f6c10 msgr2=0x7f20940fb380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.672+0000 7f209a5fa640 1 -- 172.21.15.112:0/1037049981 shutdown_connections 2024-09-19T09:37:06.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.672+0000 7f209a5fa640 1 -- 172.21.15.112:0/1037049981 wait complete. 2024-09-19T09:37:06.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.751+0000 7f9a8e029640 1 -- 172.21.15.112:0/1430699833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a880fd820 msgr2=0x7f9a880fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.751+0000 7f9a8e029640 1 --2- 172.21.15.112:0/1430699833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a880fd820 0x7f9a880fdc90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9a700048d0 tx=0x7f9a70009da0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.751+0000 7f9a8e029640 1 -- 172.21.15.112:0/1430699833 shutdown_connections 2024-09-19T09:37:06.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.751+0000 7f9a8e029640 1 --2- 172.21.15.112:0/1430699833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a880fd820 0x7f9a880fdc90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.751+0000 7f9a8e029640 1 --2- 172.21.15.112:0/1430699833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a880fc550 0x7f9a880fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.751+0000 7f9a8e029640 1 -- 172.21.15.112:0/1430699833 >> 172.21.15.112:0/1430699833 conn(0x7f9a880f7d30 msgr2=0x7f9a880fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.751+0000 7f9a8e029640 1 -- 172.21.15.112:0/1430699833 shutdown_connections 2024-09-19T09:37:06.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.751+0000 7f9a8e029640 1 -- 172.21.15.112:0/1430699833 wait complete. 2024-09-19T09:37:06.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.751+0000 7f9a8e029640 1 Processor -- start 2024-09-19T09:37:06.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.751+0000 7f9a8e029640 1 -- start start 2024-09-19T09:37:06.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a8e029640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a880fc550 0x7f9a8810d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a8e029640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a880fd820 0x7f9a8810d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a8e029640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8810e4b0 con 0x7f9a880fc550 2024-09-19T09:37:06.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a8e029640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8810e620 con 0x7f9a880fd820 2024-09-19T09:37:06.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a877fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a880fc550 0x7f9a8810d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a877fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a880fc550 0x7f9a8810d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41668/0 (socket says 172.21.15.112:41668) 2024-09-19T09:37:06.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a877fe640 1 -- 172.21.15.112:0/1647408996 learned_addr learned my addr 172.21.15.112:0/1647408996 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:37:06.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a7ffff640 1 --2- 172.21.15.112:0/1647408996 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a880fd820 0x7f9a8810d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a877fe640 1 -- 172.21.15.112:0/1647408996 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a880fd820 msgr2=0x7f9a8810d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a877fe640 1 --2- 172.21.15.112:0/1647408996 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a880fd820 0x7f9a8810d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a877fe640 1 -- 172.21.15.112:0/1647408996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a70005040 con 0x7f9a880fc550 2024-09-19T09:37:06.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a877fe640 1 --2- 172.21.15.112:0/1647408996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a880fc550 0x7f9a8810d100 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800b790 tx=0x7f9a780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a84ff9640 1 -- 172.21.15.112:0/1647408996 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a7800c700 con 0x7f9a880fc550 2024-09-19T09:37:06.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a84ff9640 1 -- 172.21.15.112:0/1647408996 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9a7800cd00 con 0x7f9a880fc550 2024-09-19T09:37:06.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a84ff9640 1 -- 172.21.15.112:0/1647408996 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a78015e80 con 0x7f9a880fc550 2024-09-19T09:37:06.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.752+0000 7f9a8e029640 1 -- 172.21.15.112:0/1647408996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8810e900 con 0x7f9a880fc550 2024-09-19T09:37:06.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.753+0000 7f9a8e029640 1 -- 172.21.15.112:0/1647408996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8810edd0 con 0x7f9a880fc550 2024-09-19T09:37:06.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.753+0000 7f9a8e029640 1 -- 172.21.15.112:0/1647408996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a881057e0 con 0x7f9a880fc550 2024-09-19T09:37:06.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.754+0000 7f9a84ff9640 1 -- 172.21.15.112:0/1647408996 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f9a78012070 con 0x7f9a880fc550 2024-09-19T09:37:06.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.754+0000 7f9a84ff9640 1 --2- 172.21.15.112:0/1647408996 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f9a7406df60 0x7f9a74070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.755+0000 7f9a7ffff640 1 --2- 172.21.15.112:0/1647408996 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f9a7406df60 0x7f9a74070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.755+0000 7f9a84ff9640 1 -- 172.21.15.112:0/1647408996 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9a7808d250 con 0x7f9a880fc550 2024-09-19T09:37:06.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.755+0000 7f9a7ffff640 1 --2- 172.21.15.112:0/1647408996 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f9a7406df60 0x7f9a74070410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9a8810ceb0 tx=0x7f9a70035040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.759+0000 7f9a84ff9640 1 -- 172.21.15.112:0/1647408996 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f9a78056ad0 con 0x7f9a880fc550 2024-09-19T09:37:06.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.942+0000 7f9a8e029640 1 -- 172.21.15.112:0/1647408996 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a8810f050 con 0x7f9a7406df60 2024-09-19T09:37:06.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.943+0000 7f9a84ff9640 1 -- 172.21.15.112:0/1647408996 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f9a8810f050 con 0x7f9a7406df60 2024-09-19T09:37:06.945 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:37:06.945 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:37:06.945 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:37:06.945 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-19T09:37:06.945 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-19T09:37:06.945 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr" 2024-09-19T09:37:06.945 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-19T09:37:06.945 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "2/2 daemons upgraded", 2024-09-19T09:37:06.945 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading mgr daemons", 2024-09-19T09:37:06.945 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:37:06.945 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:37:06.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.945+0000 7f9a8e029640 1 -- 172.21.15.112:0/1647408996 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f9a7406df60 msgr2=0x7f9a74070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.945+0000 7f9a8e029640 1 --2- 172.21.15.112:0/1647408996 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f9a7406df60 0x7f9a74070410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9a8810ceb0 tx=0x7f9a70035040 comp rx=0 tx=0).stop 2024-09-19T09:37:06.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.945+0000 7f9a8e029640 1 -- 172.21.15.112:0/1647408996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a880fc550 msgr2=0x7f9a8810d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.945+0000 7f9a8e029640 1 --2- 172.21.15.112:0/1647408996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a880fc550 0x7f9a8810d100 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800b790 tx=0x7f9a780091d0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.945+0000 7f9a8e029640 1 -- 172.21.15.112:0/1647408996 shutdown_connections 2024-09-19T09:37:06.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.945+0000 7f9a8e029640 1 --2- 172.21.15.112:0/1647408996 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f9a7406df60 0x7f9a74070410 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.945+0000 7f9a8e029640 1 --2- 172.21.15.112:0/1647408996 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a880fd820 0x7f9a8810d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.945+0000 7f9a8e029640 1 --2- 172.21.15.112:0/1647408996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a880fc550 0x7f9a8810d100 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.945+0000 7f9a8e029640 1 -- 172.21.15.112:0/1647408996 >> 172.21.15.112:0/1647408996 conn(0x7f9a880f7d30 msgr2=0x7f9a880f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.945+0000 7f9a8e029640 1 -- 172.21.15.112:0/1647408996 shutdown_connections 2024-09-19T09:37:06.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:06.945+0000 7f9a8e029640 1 -- 172.21.15.112:0/1647408996 wait complete. 2024-09-19T09:37:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:07 smithi191 ceph-mon[34834]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:07 smithi191 ceph-mon[34834]: pgmap v12: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 150 KiB/s rd, 85 KiB/s wr, 51 op/s 2024-09-19T09:37:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:07 smithi191 ceph-mon[34834]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:07 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:07 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:07 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:37:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:07 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:07 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/1037049981' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:07.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:07 smithi112 ceph-mon[27605]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:07.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:07 smithi112 ceph-mon[27605]: pgmap v12: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 150 KiB/s rd, 85 KiB/s wr, 51 op/s 2024-09-19T09:37:07.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:07 smithi112 ceph-mon[27605]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:07.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:07 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:07.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:07 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:07.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:07 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:37:07.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:07 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:07.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:07 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1037049981' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:08.392 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:08 smithi191 ceph-mon[34834]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:37:08.392 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:08 smithi191 ceph-mon[34834]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:08.392 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:08 smithi191 ceph-mon[34834]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:08.392 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:08 smithi191 ceph-mon[34834]: Upgrade: Updating mgr.smithi191.xjpplx 2024-09-19T09:37:08.392 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:08 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi191.xjpplx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:37:08.392 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:08 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:37:08.392 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:08 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:08.392 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:08 smithi191 ceph-mon[34834]: Deploying daemon mgr.smithi191.xjpplx on smithi191 2024-09-19T09:37:08.393 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:08 smithi191 ceph-mon[34834]: pgmap v13: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.2 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-19T09:37:08.611 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:08 smithi112 ceph-mon[27605]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:37:08.611 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:08 smithi112 ceph-mon[27605]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:08.611 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:08 smithi112 ceph-mon[27605]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:08.611 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:08 smithi112 ceph-mon[27605]: Upgrade: Updating mgr.smithi191.xjpplx 2024-09-19T09:37:08.611 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:08 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi191.xjpplx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:37:08.611 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:08 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:37:08.612 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:08 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:08.612 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:08 smithi112 ceph-mon[27605]: Deploying daemon mgr.smithi191.xjpplx on smithi191 2024-09-19T09:37:08.612 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:08 smithi112 ceph-mon[27605]: pgmap v13: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.2 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-19T09:37:10.981 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:10 smithi191 ceph-mon[34834]: pgmap v14: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-19T09:37:11.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:10 smithi112 ceph-mon[27605]: pgmap v14: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-19T09:37:12.204 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:12 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:12.204 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:12 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:12.204 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:12 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:12.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:12 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:12.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:12 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:12.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:12 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:13.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:13 smithi112 ceph-mon[27605]: pgmap v15: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:13.447 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:13 smithi191 ceph-mon[34834]: pgmap v15: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:15.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:14 smithi112 ceph-mon[27605]: pgmap v16: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:15.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:14 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:15.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:14 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:15.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:14 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:15.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:14 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:15.188 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:14 smithi191 ceph-mon[34834]: pgmap v16: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:15.189 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:14 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:15.189 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:14 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:15.189 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:14 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:15.189 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:14 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:16 smithi191 ceph-mon[34834]: pgmap v17: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:16 smithi191 ceph-mon[34834]: Standby manager daemon smithi191.xjpplx restarted 2024-09-19T09:37:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:16 smithi191 ceph-mon[34834]: Standby manager daemon smithi191.xjpplx started 2024-09-19T09:37:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:16 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/3290291879' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/crt"}]: dispatch 2024-09-19T09:37:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:16 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/3290291879' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:37:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:16 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/3290291879' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/key"}]: dispatch 2024-09-19T09:37:17.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:16 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/3290291879' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:37:17.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:16 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:17.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:16 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:17.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:16 smithi112 ceph-mon[27605]: pgmap v17: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:17.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:16 smithi112 ceph-mon[27605]: Standby manager daemon smithi191.xjpplx restarted 2024-09-19T09:37:17.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:16 smithi112 ceph-mon[27605]: Standby manager daemon smithi191.xjpplx started 2024-09-19T09:37:17.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:16 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.191:0/3290291879' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/crt"}]: dispatch 2024-09-19T09:37:17.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:16 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.191:0/3290291879' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:37:17.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:16 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.191:0/3290291879' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/key"}]: dispatch 2024-09-19T09:37:17.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:16 smithi112 ceph-mon[27605]: from='mgr.? 172.21.15.191:0/3290291879' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:37:17.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:16 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:17.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:16 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: mgrmap e33: smithi112.puhuua(active, since 29s), standbys: smithi191.xjpplx 2024-09-19T09:37:18.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:18.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:18.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:18.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.puhuua"}]: dispatch 2024-09-19T09:37:18.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.puhuua"}]': finished 2024-09-19T09:37:18.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi191.xjpplx"}]: dispatch 2024-09-19T09:37:18.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi191.xjpplx"}]': finished 2024-09-19T09:37:18.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:17 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: mgrmap e33: smithi112.puhuua(active, since 29s), standbys: smithi191.xjpplx 2024-09-19T09:37:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.puhuua"}]: dispatch 2024-09-19T09:37:18.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.puhuua"}]': finished 2024-09-19T09:37:18.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi191.xjpplx"}]: dispatch 2024-09-19T09:37:18.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi191.xjpplx"}]': finished 2024-09-19T09:37:18.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.287 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.287 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.287 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.287 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.287 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.287 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.287 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:18.287 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.287 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:18.287 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:17 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:18 smithi191 ceph-mon[34834]: pgmap v18: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:18 smithi191 ceph-mon[34834]: Upgrade: Setting container_image for all mgr 2024-09-19T09:37:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:18 smithi191 ceph-mon[34834]: Upgrade: Setting container_image for all rgw 2024-09-19T09:37:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:18 smithi191 ceph-mon[34834]: Upgrade: Setting container_image for all rbd-mirror 2024-09-19T09:37:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:18 smithi191 ceph-mon[34834]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-19T09:37:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:18 smithi191 ceph-mon[34834]: Upgrade: Setting container_image for all ceph-exporter 2024-09-19T09:37:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:18 smithi191 ceph-mon[34834]: Upgrade: Setting container_image for all iscsi 2024-09-19T09:37:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:18 smithi191 ceph-mon[34834]: Upgrade: Setting container_image for all nfs 2024-09-19T09:37:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:18 smithi191 ceph-mon[34834]: Upgrade: Setting container_image for all nvmeof 2024-09-19T09:37:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:18 smithi191 ceph-mon[34834]: Upgrade: Setting container_image for all node-exporter 2024-09-19T09:37:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:18 smithi191 ceph-mon[34834]: Upgrade: Setting container_image for all prometheus 2024-09-19T09:37:19.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:18 smithi191 ceph-mon[34834]: Upgrade: Setting container_image for all alertmanager 2024-09-19T09:37:19.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:18 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:37:19.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:18 smithi112 ceph-mon[27605]: pgmap v18: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:19.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:18 smithi112 ceph-mon[27605]: Upgrade: Setting container_image for all mgr 2024-09-19T09:37:19.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:18 smithi112 ceph-mon[27605]: Upgrade: Setting container_image for all rgw 2024-09-19T09:37:19.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:18 smithi112 ceph-mon[27605]: Upgrade: Setting container_image for all rbd-mirror 2024-09-19T09:37:19.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:18 smithi112 ceph-mon[27605]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-19T09:37:19.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:18 smithi112 ceph-mon[27605]: Upgrade: Setting container_image for all ceph-exporter 2024-09-19T09:37:19.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:18 smithi112 ceph-mon[27605]: Upgrade: Setting container_image for all iscsi 2024-09-19T09:37:19.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:18 smithi112 ceph-mon[27605]: Upgrade: Setting container_image for all nfs 2024-09-19T09:37:19.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:18 smithi112 ceph-mon[27605]: Upgrade: Setting container_image for all nvmeof 2024-09-19T09:37:19.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:18 smithi112 ceph-mon[27605]: Upgrade: Setting container_image for all node-exporter 2024-09-19T09:37:19.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:18 smithi112 ceph-mon[27605]: Upgrade: Setting container_image for all prometheus 2024-09-19T09:37:19.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:18 smithi112 ceph-mon[27605]: Upgrade: Setting container_image for all alertmanager 2024-09-19T09:37:19.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:18 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:37:21.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:20 smithi191 ceph-mon[34834]: Upgrade: Updating grafana.smithi112 2024-09-19T09:37:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:20 smithi191 ceph-mon[34834]: Deploying daemon grafana.smithi112 on smithi112 2024-09-19T09:37:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:20 smithi191 ceph-mon[34834]: pgmap v19: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:21.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:20 smithi112 ceph-mon[27605]: Upgrade: Updating grafana.smithi112 2024-09-19T09:37:21.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:20 smithi112 ceph-mon[27605]: Deploying daemon grafana.smithi112 on smithi112 2024-09-19T09:37:21.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:20 smithi112 ceph-mon[27605]: pgmap v19: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:23.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:22 smithi191 ceph-mon[34834]: pgmap v20: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:23.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:22 smithi112 ceph-mon[27605]: pgmap v20: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:25.240 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:24 smithi191 ceph-mon[34834]: pgmap v21: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:25.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:24 smithi112 ceph-mon[27605]: pgmap v21: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:27.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:26 smithi191 ceph-mon[34834]: pgmap v22: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:27.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:26 smithi112 ceph-mon[27605]: pgmap v22: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:29.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:28 smithi191 ceph-mon[34834]: pgmap v23: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:29.398 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:28 smithi112 ceph-mon[27605]: pgmap v23: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:31.019 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:30 smithi112 ceph-mon[27605]: pgmap v24: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:31.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:30 smithi191 ceph-mon[34834]: pgmap v24: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:32.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:32 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:32.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:32 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:32.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:32 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:32.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:32 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:32.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:32 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:32.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:32 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:33.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:33 smithi112 ceph-mon[27605]: pgmap v25: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:33.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:33 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:37:33.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:33 smithi191 ceph-mon[34834]: pgmap v25: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:33.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:33 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:37:35.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:35 smithi112 ceph-mon[27605]: pgmap v26: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:35.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:35 smithi191 ceph-mon[34834]: pgmap v26: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:37.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.030+0000 7ff076990640 1 -- 172.21.15.112:0/2305275405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0700fc540 msgr2=0x7ff0700fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.030+0000 7ff076990640 1 --2- 172.21.15.112:0/2305275405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0700fc540 0x7ff0700fc950 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff0600048d0 tx=0x7ff060009da0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.030+0000 7ff076990640 1 -- 172.21.15.112:0/2305275405 shutdown_connections 2024-09-19T09:37:37.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.030+0000 7ff076990640 1 --2- 172.21.15.112:0/2305275405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0700fd810 0x7ff0700fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.030+0000 7ff076990640 1 --2- 172.21.15.112:0/2305275405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0700fc540 0x7ff0700fc950 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.030+0000 7ff076990640 1 -- 172.21.15.112:0/2305275405 >> 172.21.15.112:0/2305275405 conn(0x7ff0700f7d00 msgr2=0x7ff0700fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:37.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.030+0000 7ff076990640 1 -- 172.21.15.112:0/2305275405 shutdown_connections 2024-09-19T09:37:37.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.030+0000 7ff076990640 1 -- 172.21.15.112:0/2305275405 wait complete. 2024-09-19T09:37:37.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.030+0000 7ff076990640 1 Processor -- start 2024-09-19T09:37:37.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.031+0000 7ff076990640 1 -- start start 2024-09-19T09:37:37.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.031+0000 7ff076990640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0700fc540 0x7ff07010d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.031+0000 7ff076990640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0700fd810 0x7ff07010d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.031+0000 7ff076990640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07010dbe0 con 0x7ff0700fd810 2024-09-19T09:37:37.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.031+0000 7ff076990640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07010e400 con 0x7ff0700fc540 2024-09-19T09:37:37.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.031+0000 7ff06f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0700fd810 0x7ff07010d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.031+0000 7ff06f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0700fd810 0x7ff07010d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55780/0 (socket says 172.21.15.112:55780) 2024-09-19T09:37:37.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.031+0000 7ff06f7fe640 1 -- 172.21.15.112:0/3037940697 learned_addr learned my addr 172.21.15.112:0/3037940697 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:37:37.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.031+0000 7ff06ffff640 1 --2- 172.21.15.112:0/3037940697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0700fc540 0x7ff07010d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.031+0000 7ff06f7fe640 1 -- 172.21.15.112:0/3037940697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0700fc540 msgr2=0x7ff07010d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.031+0000 7ff06f7fe640 1 --2- 172.21.15.112:0/3037940697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0700fc540 0x7ff07010d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.031+0000 7ff06f7fe640 1 -- 172.21.15.112:0/3037940697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff060005040 con 0x7ff0700fd810 2024-09-19T09:37:37.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.031+0000 7ff06f7fe640 1 --2- 172.21.15.112:0/3037940697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0700fd810 0x7ff07010d590 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff064002a50 tx=0x7ff064004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:37.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.032+0000 7ff06cff9640 1 -- 172.21.15.112:0/3037940697 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff064007c30 con 0x7ff0700fd810 2024-09-19T09:37:37.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.032+0000 7ff076990640 1 -- 172.21.15.112:0/3037940697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07010e690 con 0x7ff0700fd810 2024-09-19T09:37:37.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.032+0000 7ff06cff9640 1 -- 172.21.15.112:0/3037940697 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff06400f040 con 0x7ff0700fd810 2024-09-19T09:37:37.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.032+0000 7ff06cff9640 1 -- 172.21.15.112:0/3037940697 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff06400da10 con 0x7ff0700fd810 2024-09-19T09:37:37.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.032+0000 7ff076990640 1 -- 172.21.15.112:0/3037940697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07010ec30 con 0x7ff0700fd810 2024-09-19T09:37:37.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.033+0000 7ff076990640 1 -- 172.21.15.112:0/3037940697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0700fb9a0 con 0x7ff0700fd810 2024-09-19T09:37:37.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.033+0000 7ff06cff9640 1 -- 172.21.15.112:0/3037940697 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) v1 ==== 92377+0+0 (secure 0 0 0) 0x7ff06400dc80 con 0x7ff0700fd810 2024-09-19T09:37:37.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.034+0000 7ff06cff9640 1 --2- 172.21.15.112:0/3037940697 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7ff05806df60 0x7ff058070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.034+0000 7ff06cff9640 1 -- 172.21.15.112:0/3037940697 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff06408d200 con 0x7ff0700fd810 2024-09-19T09:37:37.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.034+0000 7ff06ffff640 1 --2- 172.21.15.112:0/3037940697 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7ff05806df60 0x7ff058070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.035+0000 7ff06ffff640 1 --2- 172.21.15.112:0/3037940697 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7ff05806df60 0x7ff058070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff06000b020 tx=0x7ff060035040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:37.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.038+0000 7ff06cff9640 1 -- 172.21.15.112:0/3037940697 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7ff064056a20 con 0x7ff0700fd810 2024-09-19T09:37:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.240+0000 7ff076990640 1 -- 172.21.15.112:0/3037940697 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff07010ef60 con 0x7ff05806df60 2024-09-19T09:37:37.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.241+0000 7ff06cff9640 1 -- 172.21.15.112:0/3037940697 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7ff07010ef60 con 0x7ff05806df60 2024-09-19T09:37:37.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.243+0000 7ff076990640 1 -- 172.21.15.112:0/3037940697 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7ff05806df60 msgr2=0x7ff058070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.243+0000 7ff076990640 1 --2- 172.21.15.112:0/3037940697 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7ff05806df60 0x7ff058070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff06000b020 tx=0x7ff060035040 comp rx=0 tx=0).stop 2024-09-19T09:37:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.243+0000 7ff076990640 1 -- 172.21.15.112:0/3037940697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0700fd810 msgr2=0x7ff07010d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.243+0000 7ff076990640 1 --2- 172.21.15.112:0/3037940697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0700fd810 0x7ff07010d590 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff064002a50 tx=0x7ff064004600 comp rx=0 tx=0).stop 2024-09-19T09:37:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.243+0000 7ff076990640 1 -- 172.21.15.112:0/3037940697 shutdown_connections 2024-09-19T09:37:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.243+0000 7ff076990640 1 --2- 172.21.15.112:0/3037940697 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7ff05806df60 0x7ff058070410 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.243+0000 7ff076990640 1 --2- 172.21.15.112:0/3037940697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0700fd810 0x7ff07010d590 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.243+0000 7ff076990640 1 --2- 172.21.15.112:0/3037940697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0700fc540 0x7ff07010d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.243+0000 7ff076990640 1 -- 172.21.15.112:0/3037940697 >> 172.21.15.112:0/3037940697 conn(0x7ff0700f7d00 msgr2=0x7ff0700f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.243+0000 7ff076990640 1 -- 172.21.15.112:0/3037940697 shutdown_connections 2024-09-19T09:37:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.243+0000 7ff076990640 1 -- 172.21.15.112:0/3037940697 wait complete. 2024-09-19T09:37:37.253 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:37:37.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:37 smithi112 ceph-mon[27605]: pgmap v27: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:37.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:37 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:37.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:37 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:37.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:37 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:37.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:37 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:37.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.322+0000 7f14756ee640 1 -- 172.21.15.112:0/1022976400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14700ff670 msgr2=0x7f1470101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.322+0000 7f14756ee640 1 --2- 172.21.15.112:0/1022976400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14700ff670 0x7f1470101a50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f14580048d0 tx=0x7f1458009da0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.322+0000 7f14756ee640 1 -- 172.21.15.112:0/1022976400 shutdown_connections 2024-09-19T09:37:37.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.322+0000 7f14756ee640 1 --2- 172.21.15.112:0/1022976400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14700ff670 0x7f1470101a50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.322+0000 7f14756ee640 1 --2- 172.21.15.112:0/1022976400 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14700664d0 0x7f14700ff130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.322+0000 7f14756ee640 1 -- 172.21.15.112:0/1022976400 >> 172.21.15.112:0/1022976400 conn(0x7f14700f6c00 msgr2=0x7f14700f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:37.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.322+0000 7f14756ee640 1 -- 172.21.15.112:0/1022976400 shutdown_connections 2024-09-19T09:37:37.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.322+0000 7f14756ee640 1 -- 172.21.15.112:0/1022976400 wait complete. 2024-09-19T09:37:37.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.323+0000 7f14756ee640 1 Processor -- start 2024-09-19T09:37:37.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.323+0000 7f14756ee640 1 -- start start 2024-09-19T09:37:37.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.323+0000 7f14756ee640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14700664d0 0x7f147010d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.323+0000 7f14756ee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14700ff670 0x7f147010d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.323+0000 7f14756ee640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147010e4e0 con 0x7f14700ff670 2024-09-19T09:37:37.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.323+0000 7f14756ee640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147010e650 con 0x7f14700664d0 2024-09-19T09:37:37.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.323+0000 7f14667fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14700ff670 0x7f147010d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.323+0000 7f14667fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14700ff670 0x7f147010d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55796/0 (socket says 172.21.15.112:55796) 2024-09-19T09:37:37.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.323+0000 7f14667fc640 1 -- 172.21.15.112:0/2940426450 learned_addr learned my addr 172.21.15.112:0/2940426450 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:37:37.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.323+0000 7f146effd640 1 --2- 172.21.15.112:0/2940426450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14700664d0 0x7f147010d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.323+0000 7f14667fc640 1 -- 172.21.15.112:0/2940426450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14700664d0 msgr2=0x7f147010d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.323+0000 7f14667fc640 1 --2- 172.21.15.112:0/2940426450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14700664d0 0x7f147010d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.323+0000 7f14667fc640 1 -- 172.21.15.112:0/2940426450 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1458005040 con 0x7f14700ff670 2024-09-19T09:37:37.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.324+0000 7f14667fc640 1 --2- 172.21.15.112:0/2940426450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14700ff670 0x7f147010d6c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1458003080 tx=0x7f1458009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:37.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.324+0000 7f1467fff640 1 -- 172.21.15.112:0/2940426450 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1458038070 con 0x7f14700ff670 2024-09-19T09:37:37.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.324+0000 7f1467fff640 1 -- 172.21.15.112:0/2940426450 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f145802abd0 con 0x7f14700ff670 2024-09-19T09:37:37.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.324+0000 7f14756ee640 1 -- 172.21.15.112:0/2940426450 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147010e8d0 con 0x7f14700ff670 2024-09-19T09:37:37.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.324+0000 7f1467fff640 1 -- 172.21.15.112:0/2940426450 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f145803e670 con 0x7f14700ff670 2024-09-19T09:37:37.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.324+0000 7f14756ee640 1 -- 172.21.15.112:0/2940426450 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147010edf0 con 0x7f14700ff670 2024-09-19T09:37:37.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.325+0000 7f14756ee640 1 -- 172.21.15.112:0/2940426450 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14700fa880 con 0x7f14700ff670 2024-09-19T09:37:37.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.325+0000 7f1467fff640 1 -- 172.21.15.112:0/2940426450 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f1458030020 con 0x7f14700ff670 2024-09-19T09:37:37.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.326+0000 7f1467fff640 1 --2- 172.21.15.112:0/2940426450 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f145c06df60 0x7f145c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.326+0000 7f1467fff640 1 -- 172.21.15.112:0/2940426450 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f14580add40 con 0x7f14700ff670 2024-09-19T09:37:37.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.326+0000 7f146effd640 1 --2- 172.21.15.112:0/2940426450 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f145c06df60 0x7f145c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.327+0000 7f146effd640 1 --2- 172.21.15.112:0/2940426450 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f145c06df60 0x7f145c070410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1460006fd0 tx=0x7f1460008040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.330+0000 7f1467fff640 1 -- 172.21.15.112:0/2940426450 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f14580775c0 con 0x7f14700ff670 2024-09-19T09:37:37.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.517+0000 7f14756ee640 1 -- 172.21.15.112:0/2940426450 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14701050d0 con 0x7f145c06df60 2024-09-19T09:37:37.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.518+0000 7f1467fff640 1 -- 172.21.15.112:0/2940426450 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f14701050d0 con 0x7f145c06df60 2024-09-19T09:37:37.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.521+0000 7f14756ee640 1 -- 172.21.15.112:0/2940426450 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f145c06df60 msgr2=0x7f145c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.521+0000 7f14756ee640 1 --2- 172.21.15.112:0/2940426450 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f145c06df60 0x7f145c070410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1460006fd0 tx=0x7f1460008040 comp rx=0 tx=0).stop 2024-09-19T09:37:37.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.521+0000 7f14756ee640 1 -- 172.21.15.112:0/2940426450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14700ff670 msgr2=0x7f147010d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.521+0000 7f14756ee640 1 --2- 172.21.15.112:0/2940426450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14700ff670 0x7f147010d6c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1458003080 tx=0x7f1458009da0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.521+0000 7f14756ee640 1 -- 172.21.15.112:0/2940426450 shutdown_connections 2024-09-19T09:37:37.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.521+0000 7f14756ee640 1 --2- 172.21.15.112:0/2940426450 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f145c06df60 0x7f145c070410 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.521+0000 7f14756ee640 1 --2- 172.21.15.112:0/2940426450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14700ff670 0x7f147010d6c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.521+0000 7f14756ee640 1 --2- 172.21.15.112:0/2940426450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14700664d0 0x7f147010d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.521+0000 7f14756ee640 1 -- 172.21.15.112:0/2940426450 >> 172.21.15.112:0/2940426450 conn(0x7f14700f6c00 msgr2=0x7f14700f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:37.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.521+0000 7f14756ee640 1 -- 172.21.15.112:0/2940426450 shutdown_connections 2024-09-19T09:37:37.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.521+0000 7f14756ee640 1 -- 172.21.15.112:0/2940426450 wait complete. 2024-09-19T09:37:37.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:37 smithi191 ceph-mon[34834]: pgmap v27: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:37.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:37 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:37.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:37 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:37.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:37 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:37.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:37 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:37.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.601+0000 7f6e72dc8640 1 -- 172.21.15.112:0/1729383967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e6c0fc700 msgr2=0x7f6e6c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.601+0000 7f6e72dc8640 1 --2- 172.21.15.112:0/1729383967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e6c0fc700 0x7f6e6c0fcb70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6e580048d0 tx=0x7f6e58009da0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.601+0000 7f6e72dc8640 1 -- 172.21.15.112:0/1729383967 shutdown_connections 2024-09-19T09:37:37.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.601+0000 7f6e72dc8640 1 --2- 172.21.15.112:0/1729383967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e6c0fc700 0x7f6e6c0fcb70 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.601+0000 7f6e72dc8640 1 --2- 172.21.15.112:0/1729383967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e6c0fb430 0x7f6e6c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.601+0000 7f6e72dc8640 1 -- 172.21.15.112:0/1729383967 >> 172.21.15.112:0/1729383967 conn(0x7f6e6c0f6c10 msgr2=0x7f6e6c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:37.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.601+0000 7f6e72dc8640 1 -- 172.21.15.112:0/1729383967 shutdown_connections 2024-09-19T09:37:37.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.601+0000 7f6e72dc8640 1 -- 172.21.15.112:0/1729383967 wait complete. 2024-09-19T09:37:37.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.602+0000 7f6e72dc8640 1 Processor -- start 2024-09-19T09:37:37.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.602+0000 7f6e72dc8640 1 -- start start 2024-09-19T09:37:37.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.602+0000 7f6e72dc8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e6c0fb430 0x7f6e6c10bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.602+0000 7f6e72dc8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e6c0fc700 0x7f6e6c10c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.602+0000 7f6e72dc8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c10d370 con 0x7f6e6c0fc700 2024-09-19T09:37:37.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.602+0000 7f6e72dc8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c10d4e0 con 0x7f6e6c0fb430 2024-09-19T09:37:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.602+0000 7f6e6bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e6c0fc700 0x7f6e6c10c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.602+0000 7f6e6bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e6c0fc700 0x7f6e6c10c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55820/0 (socket says 172.21.15.112:55820) 2024-09-19T09:37:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.602+0000 7f6e6bfff640 1 -- 172.21.15.112:0/632911653 learned_addr learned my addr 172.21.15.112:0/632911653 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:37:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.603+0000 7f6e70b64640 1 --2- 172.21.15.112:0/632911653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e6c0fb430 0x7f6e6c10bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.603+0000 7f6e6bfff640 1 -- 172.21.15.112:0/632911653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e6c0fb430 msgr2=0x7f6e6c10bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.603+0000 7f6e6bfff640 1 --2- 172.21.15.112:0/632911653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e6c0fb430 0x7f6e6c10bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.603+0000 7f6e6bfff640 1 -- 172.21.15.112:0/632911653 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e58005040 con 0x7f6e6c0fc700 2024-09-19T09:37:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.603+0000 7f6e6bfff640 1 --2- 172.21.15.112:0/632911653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e6c0fc700 0x7f6e6c10c500 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6e58003080 tx=0x7f6e58009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.603+0000 7f6e697fa640 1 -- 172.21.15.112:0/632911653 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e58038070 con 0x7f6e6c0fc700 2024-09-19T09:37:37.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.603+0000 7f6e72dc8640 1 -- 172.21.15.112:0/632911653 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6c10d760 con 0x7f6e6c0fc700 2024-09-19T09:37:37.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.603+0000 7f6e697fa640 1 -- 172.21.15.112:0/632911653 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6e5802abd0 con 0x7f6e6c0fc700 2024-09-19T09:37:37.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.603+0000 7f6e72dc8640 1 -- 172.21.15.112:0/632911653 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6c10dc80 con 0x7f6e6c0fc700 2024-09-19T09:37:37.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.603+0000 7f6e697fa640 1 -- 172.21.15.112:0/632911653 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e5803e670 con 0x7f6e6c0fc700 2024-09-19T09:37:37.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.605+0000 7f6e72dc8640 1 -- 172.21.15.112:0/632911653 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6c0fa890 con 0x7f6e6c0fc700 2024-09-19T09:37:37.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.605+0000 7f6e697fa640 1 -- 172.21.15.112:0/632911653 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f6e58030020 con 0x7f6e6c0fc700 2024-09-19T09:37:37.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.606+0000 7f6e697fa640 1 --2- 172.21.15.112:0/632911653 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6e5c06df60 0x7f6e5c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.606+0000 7f6e697fa640 1 -- 172.21.15.112:0/632911653 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6e580add20 con 0x7f6e6c0fc700 2024-09-19T09:37:37.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.606+0000 7f6e70b64640 1 --2- 172.21.15.112:0/632911653 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6e5c06df60 0x7f6e5c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.606+0000 7f6e70b64640 1 --2- 172.21.15.112:0/632911653 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6e5c06df60 0x7f6e5c070410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6e60006fd0 tx=0x7f6e60008040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:37.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.610+0000 7f6e697fa640 1 -- 172.21.15.112:0/632911653 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f6e58078420 con 0x7f6e6c0fc700 2024-09-19T09:37:37.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.784+0000 7f6e72dc8640 1 -- 172.21.15.112:0/632911653 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e6c103fc0 con 0x7f6e5c06df60 2024-09-19T09:37:37.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.793+0000 7f6e697fa640 1 -- 172.21.15.112:0/632911653 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f6e6c103fc0 con 0x7f6e5c06df60 2024-09-19T09:37:37.794 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:37:37.794 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (114s) 1s ago 10m 28.2M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:37:37.794 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (10m) 1s ago 10m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1513f1075df5 2024-09-19T09:37:37.795 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (9m) 23s ago 9m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6c313b300b35 2024-09-19T09:37:37.795 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (7s) 1s ago 10m 45.6M - 9.4.12 2bacad6d85d8 e462aca2b022 2024-09-19T09:37:37.795 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (5m) 1s ago 5m 154M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:37:37.795 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (5m) 1s ago 5m 106M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:37:37.795 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (5m) 23s ago 5m 12.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:37:37.795 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (5m) 23s ago 4m 15.2M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:37:37.795 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (85s) 1s ago 11m 500M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:37:37.795 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283,8765 running (27s) 23s ago 9m 68.8M - 19.1.1-361-g2f599a46 d2baa855c067 fddba1bee64a 2024-09-19T09:37:37.795 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (11m) 1s ago 11m 55.6M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 34676d67b669 2024-09-19T09:37:37.795 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (9m) 23s ago 9m 41.4M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 35690ef0929b 2024-09-19T09:37:37.795 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (2m) 1s ago 10m 15.9M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:37:37.795 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (99s) 23s ago 9m 15.9M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:37:37.795 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (8m) 1s ago 8m 228M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 621693067dce 2024-09-19T09:37:37.796 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (8m) 1s ago 8m 247M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1742e5964367 2024-09-19T09:37:37.796 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (7m) 1s ago 7m 211M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 4dcca18af229 2024-09-19T09:37:37.796 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (7m) 23s ago 7m 269M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:37:37.796 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (7m) 23s ago 7m 239M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:37:37.796 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (6m) 23s ago 6m 224M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:37:37.796 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (32s) 1s ago 9m 51.0M - 2.43.0 a07b618ecd1d 54850883a171 2024-09-19T09:37:37.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.795+0000 7f6e72dc8640 1 -- 172.21.15.112:0/632911653 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6e5c06df60 msgr2=0x7f6e5c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.795+0000 7f6e72dc8640 1 --2- 172.21.15.112:0/632911653 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6e5c06df60 0x7f6e5c070410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6e60006fd0 tx=0x7f6e60008040 comp rx=0 tx=0).stop 2024-09-19T09:37:37.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.795+0000 7f6e72dc8640 1 -- 172.21.15.112:0/632911653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e6c0fc700 msgr2=0x7f6e6c10c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.795+0000 7f6e72dc8640 1 --2- 172.21.15.112:0/632911653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e6c0fc700 0x7f6e6c10c500 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6e58003080 tx=0x7f6e58009da0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.795+0000 7f6e72dc8640 1 -- 172.21.15.112:0/632911653 shutdown_connections 2024-09-19T09:37:37.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.795+0000 7f6e72dc8640 1 --2- 172.21.15.112:0/632911653 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6e5c06df60 0x7f6e5c070410 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.795+0000 7f6e72dc8640 1 --2- 172.21.15.112:0/632911653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e6c0fc700 0x7f6e6c10c500 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.795+0000 7f6e72dc8640 1 --2- 172.21.15.112:0/632911653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e6c0fb430 0x7f6e6c10bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.795+0000 7f6e72dc8640 1 -- 172.21.15.112:0/632911653 >> 172.21.15.112:0/632911653 conn(0x7f6e6c0f6c10 msgr2=0x7f6e6c0f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:37.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.795+0000 7f6e72dc8640 1 -- 172.21.15.112:0/632911653 shutdown_connections 2024-09-19T09:37:37.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.795+0000 7f6e72dc8640 1 -- 172.21.15.112:0/632911653 wait complete. 2024-09-19T09:37:37.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.873+0000 7f95024b6640 1 -- 172.21.15.112:0/3383188151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94fc0fc550 msgr2=0x7f94fc0fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.873+0000 7f95024b6640 1 --2- 172.21.15.112:0/3383188151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94fc0fc550 0x7f94fc0fc960 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0048d0 tx=0x7f94ec009da0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.873+0000 7f95024b6640 1 -- 172.21.15.112:0/3383188151 shutdown_connections 2024-09-19T09:37:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.873+0000 7f95024b6640 1 --2- 172.21.15.112:0/3383188151 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94fc0fd820 0x7f94fc0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.873+0000 7f95024b6640 1 --2- 172.21.15.112:0/3383188151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94fc0fc550 0x7f94fc0fc960 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.873+0000 7f95024b6640 1 -- 172.21.15.112:0/3383188151 >> 172.21.15.112:0/3383188151 conn(0x7f94fc0f7d30 msgr2=0x7f94fc0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.873+0000 7f95024b6640 1 -- 172.21.15.112:0/3383188151 shutdown_connections 2024-09-19T09:37:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.873+0000 7f95024b6640 1 -- 172.21.15.112:0/3383188151 wait complete. 2024-09-19T09:37:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.874+0000 7f95024b6640 1 Processor -- start 2024-09-19T09:37:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.874+0000 7f95024b6640 1 -- start start 2024-09-19T09:37:37.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.874+0000 7f95024b6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94fc0fc550 0x7f94fc10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.874+0000 7f95024b6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94fc0fd820 0x7f94fc10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.874+0000 7f95024b6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc10dc10 con 0x7f94fc0fd820 2024-09-19T09:37:37.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.874+0000 7f95024b6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc10e430 con 0x7f94fc0fc550 2024-09-19T09:37:37.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.874+0000 7f94fb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94fc0fd820 0x7f94fc10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.874+0000 7f94fb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94fc0fd820 0x7f94fc10d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55828/0 (socket says 172.21.15.112:55828) 2024-09-19T09:37:37.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.874+0000 7f94fb7fe640 1 -- 172.21.15.112:0/2800961244 learned_addr learned my addr 172.21.15.112:0/2800961244 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:37:37.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.875+0000 7f94fbfff640 1 --2- 172.21.15.112:0/2800961244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94fc0fc550 0x7f94fc10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.875+0000 7f94fb7fe640 1 -- 172.21.15.112:0/2800961244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94fc0fc550 msgr2=0x7f94fc10d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.875+0000 7f94fb7fe640 1 --2- 172.21.15.112:0/2800961244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94fc0fc550 0x7f94fc10d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.875+0000 7f94fb7fe640 1 -- 172.21.15.112:0/2800961244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec005040 con 0x7f94fc0fd820 2024-09-19T09:37:37.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.875+0000 7f94fb7fe640 1 --2- 172.21.15.112:0/2800961244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94fc0fd820 0x7f94fc10d5c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f94f0002a50 tx=0x7f94f0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:37.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.875+0000 7f94f8ff9640 1 -- 172.21.15.112:0/2800961244 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94f0007c30 con 0x7f94fc0fd820 2024-09-19T09:37:37.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.875+0000 7f95024b6640 1 -- 172.21.15.112:0/2800961244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94fc10e6c0 con 0x7f94fc0fd820 2024-09-19T09:37:37.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.875+0000 7f94f8ff9640 1 -- 172.21.15.112:0/2800961244 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f94f000f040 con 0x7f94fc0fd820 2024-09-19T09:37:37.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.875+0000 7f94f8ff9640 1 -- 172.21.15.112:0/2800961244 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94f000da90 con 0x7f94fc0fd820 2024-09-19T09:37:37.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.875+0000 7f95024b6640 1 -- 172.21.15.112:0/2800961244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94fc10ec60 con 0x7f94fc0fd820 2024-09-19T09:37:37.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.876+0000 7f95024b6640 1 -- 172.21.15.112:0/2800961244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94fc0fb9b0 con 0x7f94fc0fd820 2024-09-19T09:37:37.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.877+0000 7f94f8ff9640 1 -- 172.21.15.112:0/2800961244 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f94f000dd00 con 0x7f94fc0fd820 2024-09-19T09:37:37.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.877+0000 7f94f8ff9640 1 --2- 172.21.15.112:0/2800961244 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f94e406df60 0x7f94e4070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.877+0000 7f94f8ff9640 1 -- 172.21.15.112:0/2800961244 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f94f008d360 con 0x7f94fc0fd820 2024-09-19T09:37:37.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.877+0000 7f94fbfff640 1 --2- 172.21.15.112:0/2800961244 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f94e406df60 0x7f94e4070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.878+0000 7f94fbfff640 1 --2- 172.21.15.112:0/2800961244 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f94e406df60 0x7f94e4070410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f94ec007ac0 tx=0x7f94ec035040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:37.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:37.881+0000 7f94f8ff9640 1 -- 172.21.15.112:0/2800961244 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f94f0056ad0 con 0x7f94fc0fd820 2024-09-19T09:37:38.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.125+0000 7f95024b6640 1 -- 172.21.15.112:0/2800961244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f94fc104f70 con 0x7f94fc0fd820 2024-09-19T09:37:38.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.125+0000 7f94f8ff9640 1 -- 172.21.15.112:0/2800961244 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f94f005a190 con 0x7f94fc0fd820 2024-09-19T09:37:38.127 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:37:38.127 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:37:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T09:37:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:37:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:37:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:37:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:37:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:37:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T09:37:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:37:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:37:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:37:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:37:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:37:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 12, 2024-09-19T09:37:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:37:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:37:38.129 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:37:38.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.127+0000 7f95024b6640 1 -- 172.21.15.112:0/2800961244 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f94e406df60 msgr2=0x7f94e4070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.127+0000 7f95024b6640 1 --2- 172.21.15.112:0/2800961244 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f94e406df60 0x7f94e4070410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f94ec007ac0 tx=0x7f94ec035040 comp rx=0 tx=0).stop 2024-09-19T09:37:38.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.127+0000 7f95024b6640 1 -- 172.21.15.112:0/2800961244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94fc0fd820 msgr2=0x7f94fc10d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.127+0000 7f95024b6640 1 --2- 172.21.15.112:0/2800961244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94fc0fd820 0x7f94fc10d5c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f94f0002a50 tx=0x7f94f0004600 comp rx=0 tx=0).stop 2024-09-19T09:37:38.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.127+0000 7f95024b6640 1 -- 172.21.15.112:0/2800961244 shutdown_connections 2024-09-19T09:37:38.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.127+0000 7f95024b6640 1 --2- 172.21.15.112:0/2800961244 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f94e406df60 0x7f94e4070410 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.127+0000 7f95024b6640 1 --2- 172.21.15.112:0/2800961244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94fc0fd820 0x7f94fc10d5c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.127+0000 7f95024b6640 1 --2- 172.21.15.112:0/2800961244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94fc0fc550 0x7f94fc10d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.127+0000 7f95024b6640 1 -- 172.21.15.112:0/2800961244 >> 172.21.15.112:0/2800961244 conn(0x7f94fc0f7d30 msgr2=0x7f94fc0f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:38.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.128+0000 7f95024b6640 1 -- 172.21.15.112:0/2800961244 shutdown_connections 2024-09-19T09:37:38.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.128+0000 7f95024b6640 1 -- 172.21.15.112:0/2800961244 wait complete. 2024-09-19T09:37:38.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.207+0000 7f92496d1640 1 -- 172.21.15.112:0/3991047669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92440fdb70 msgr2=0x7f92440fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.207+0000 7f92496d1640 1 --2- 172.21.15.112:0/3991047669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92440fdb70 0x7f92440fdf80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f92340048d0 tx=0x7f9234009da0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.207+0000 7f92496d1640 1 -- 172.21.15.112:0/3991047669 shutdown_connections 2024-09-19T09:37:38.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.207+0000 7f92496d1640 1 --2- 172.21.15.112:0/3991047669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92440fe4c0 0x7f92440fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.207+0000 7f92496d1640 1 --2- 172.21.15.112:0/3991047669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92440fdb70 0x7f92440fdf80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.207+0000 7f92496d1640 1 -- 172.21.15.112:0/3991047669 >> 172.21.15.112:0/3991047669 conn(0x7f92440f6390 msgr2=0x7f92440f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:38.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.207+0000 7f92496d1640 1 -- 172.21.15.112:0/3991047669 shutdown_connections 2024-09-19T09:37:38.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.207+0000 7f92496d1640 1 -- 172.21.15.112:0/3991047669 wait complete. 2024-09-19T09:37:38.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.208+0000 7f92496d1640 1 Processor -- start 2024-09-19T09:37:38.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.208+0000 7f92496d1640 1 -- start start 2024-09-19T09:37:38.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.208+0000 7f92496d1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92440fdb70 0x7f924410d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.208+0000 7f92496d1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92440fe4c0 0x7f924410d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.208+0000 7f92496d1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924410e4a0 con 0x7f92440fe4c0 2024-09-19T09:37:38.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.208+0000 7f92496d1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924410e610 con 0x7f92440fdb70 2024-09-19T09:37:38.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.208+0000 7f923a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92440fe4c0 0x7f924410d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.208+0000 7f923a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92440fe4c0 0x7f924410d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55852/0 (socket says 172.21.15.112:55852) 2024-09-19T09:37:38.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.208+0000 7f923a7fc640 1 -- 172.21.15.112:0/2151561727 learned_addr learned my addr 172.21.15.112:0/2151561727 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:37:38.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.208+0000 7f9242ffd640 1 --2- 172.21.15.112:0/2151561727 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92440fdb70 0x7f924410d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.209+0000 7f923a7fc640 1 -- 172.21.15.112:0/2151561727 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92440fdb70 msgr2=0x7f924410d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.209+0000 7f923a7fc640 1 --2- 172.21.15.112:0/2151561727 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92440fdb70 0x7f924410d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.209+0000 7f923a7fc640 1 -- 172.21.15.112:0/2151561727 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9234005040 con 0x7f92440fe4c0 2024-09-19T09:37:38.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.209+0000 7f923a7fc640 1 --2- 172.21.15.112:0/2151561727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92440fe4c0 0x7f924410d630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f922c00b580 tx=0x7f922c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.209+0000 7f923bfff640 1 -- 172.21.15.112:0/2151561727 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f922c00f6f0 con 0x7f92440fe4c0 2024-09-19T09:37:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.209+0000 7f923bfff640 1 -- 172.21.15.112:0/2151561727 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f922c00fcf0 con 0x7f92440fe4c0 2024-09-19T09:37:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.209+0000 7f92496d1640 1 -- 172.21.15.112:0/2151561727 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924410e8f0 con 0x7f92440fe4c0 2024-09-19T09:37:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.209+0000 7f923bfff640 1 -- 172.21.15.112:0/2151561727 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f922c0103a0 con 0x7f92440fe4c0 2024-09-19T09:37:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.209+0000 7f92496d1640 1 -- 172.21.15.112:0/2151561727 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924410ee10 con 0x7f92440fe4c0 2024-09-19T09:37:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.210+0000 7f92496d1640 1 -- 172.21.15.112:0/2151561727 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92440fa010 con 0x7f92440fe4c0 2024-09-19T09:37:38.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.211+0000 7f923bfff640 1 -- 172.21.15.112:0/2151561727 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f922c0116b0 con 0x7f92440fe4c0 2024-09-19T09:37:38.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.211+0000 7f923bfff640 1 --2- 172.21.15.112:0/2151561727 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f923006df60 0x7f9230070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.211+0000 7f923bfff640 1 -- 172.21.15.112:0/2151561727 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f922c08d6a0 con 0x7f92440fe4c0 2024-09-19T09:37:38.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.211+0000 7f9242ffd640 1 --2- 172.21.15.112:0/2151561727 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f923006df60 0x7f9230070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.212+0000 7f9242ffd640 1 --2- 172.21.15.112:0/2151561727 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f923006df60 0x7f9230070410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9234000c00 tx=0x7f9234035040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:38.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.215+0000 7f923bfff640 1 -- 172.21.15.112:0/2151561727 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f922c05ab70 con 0x7f92440fe4c0 2024-09-19T09:37:38.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.399+0000 7f92496d1640 1 -- 172.21.15.112:0/2151561727 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f924410f0e0 con 0x7f923006df60 2024-09-19T09:37:38.402 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:38 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2800961244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:38.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.401+0000 7f923bfff640 1 -- 172.21.15.112:0/2151561727 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f924410f0e0 con 0x7f923006df60 2024-09-19T09:37:38.403 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:37:38.403 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:37:38.403 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:37:38.403 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-19T09:37:38.403 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-19T09:37:38.403 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr" 2024-09-19T09:37:38.403 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-19T09:37:38.403 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "2/2 daemons upgraded", 2024-09-19T09:37:38.404 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading grafana daemons", 2024-09-19T09:37:38.404 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:37:38.404 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:37:38.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.403+0000 7f92496d1640 1 -- 172.21.15.112:0/2151561727 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f923006df60 msgr2=0x7f9230070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.403+0000 7f92496d1640 1 --2- 172.21.15.112:0/2151561727 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f923006df60 0x7f9230070410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9234000c00 tx=0x7f9234035040 comp rx=0 tx=0).stop 2024-09-19T09:37:38.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.403+0000 7f92496d1640 1 -- 172.21.15.112:0/2151561727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92440fe4c0 msgr2=0x7f924410d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.403+0000 7f92496d1640 1 --2- 172.21.15.112:0/2151561727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92440fe4c0 0x7f924410d630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f922c00b580 tx=0x7f922c0091a0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.403+0000 7f92496d1640 1 -- 172.21.15.112:0/2151561727 shutdown_connections 2024-09-19T09:37:38.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.403+0000 7f92496d1640 1 --2- 172.21.15.112:0/2151561727 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f923006df60 0x7f9230070410 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.403+0000 7f92496d1640 1 --2- 172.21.15.112:0/2151561727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92440fe4c0 0x7f924410d630 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.403+0000 7f92496d1640 1 --2- 172.21.15.112:0/2151561727 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92440fdb70 0x7f924410d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.403+0000 7f92496d1640 1 -- 172.21.15.112:0/2151561727 >> 172.21.15.112:0/2151561727 conn(0x7f92440f6390 msgr2=0x7f92440f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:38.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.403+0000 7f92496d1640 1 -- 172.21.15.112:0/2151561727 shutdown_connections 2024-09-19T09:37:38.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:37:38.403+0000 7f92496d1640 1 -- 172.21.15.112:0/2151561727 wait complete. 2024-09-19T09:37:38.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:38 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2800961244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:39 smithi112 ceph-mon[27605]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:39 smithi112 ceph-mon[27605]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:39 smithi112 ceph-mon[27605]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:39 smithi112 ceph-mon[27605]: pgmap v28: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:39.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:39 smithi191 ceph-mon[34834]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:39.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:39 smithi191 ceph-mon[34834]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:39.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:39 smithi191 ceph-mon[34834]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:39.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:39 smithi191 ceph-mon[34834]: pgmap v28: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:40.399 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:40 smithi112 ceph-mon[27605]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:40.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:40 smithi191 ceph-mon[34834]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:41.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: pgmap v29: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:41.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:41.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:41.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:41.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:41.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:41.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:37:41.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:41.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:41.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-19T09:37:41.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-19T09:37:41.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-19T09:37:41.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-19T09:37:41.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-19T09:37:41.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-19T09:37:41.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-19T09:37:41.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-19T09:37:41.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-19T09:37:41.442 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-19T09:37:41.442 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.442 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-19T09:37:41.442 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-19T09:37:41.442 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-19T09:37:41.442 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-19T09:37:41.442 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-19T09:37:41.442 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-19T09:37:41.442 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-19T09:37:41.442 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-19T09:37:41.442 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.442 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.442 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.442 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-19T09:37:41.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-19T09:37:41.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:41.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:41.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:41.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:41.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:41.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:41.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:41.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:41 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:41.537 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: pgmap v29: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:41.537 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:41.537 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:41.537 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:41.537 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:41.537 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:41.537 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:37:41.537 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:41.537 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.538 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.538 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.538 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.538 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.538 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.538 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.538 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.538 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.538 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.538 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.538 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.538 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.538 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:37:41.538 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:41.539 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-19T09:37:41.539 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-19T09:37:41.539 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.539 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-19T09:37:41.539 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-19T09:37:41.539 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-19T09:37:41.539 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-19T09:37:41.539 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-19T09:37:41.539 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-19T09:37:41.539 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-19T09:37:41.539 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-19T09:37:41.539 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.539 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-19T09:37:41.540 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-19T09:37:41.540 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-19T09:37:41.540 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-19T09:37:41.540 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-19T09:37:41.540 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-19T09:37:41.540 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-19T09:37:41.540 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-19T09:37:41.540 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.540 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.540 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.540 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.540 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.540 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:37:41.541 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-19T09:37:41.541 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-19T09:37:41.541 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:41.541 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:41.541 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:41.541 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:41.541 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:41.541 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:41.541 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:41.541 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:41 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:42.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:42 smithi191 ceph-mon[34834]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:37:42.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:42 smithi191 ceph-mon[34834]: Upgrade: Finalizing container_image settings 2024-09-19T09:37:42.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:42 smithi191 ceph-mon[34834]: Upgrade: Complete! 2024-09-19T09:37:42.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:42 smithi112 ceph-mon[27605]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:37:42.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:42 smithi112 ceph-mon[27605]: Upgrade: Finalizing container_image settings 2024-09-19T09:37:42.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:42 smithi112 ceph-mon[27605]: Upgrade: Complete! 2024-09-19T09:37:43.506 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:43 smithi112 ceph-mon[27605]: pgmap v30: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:43.506 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:43 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:43.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:43 smithi191 ceph-mon[34834]: pgmap v30: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:43.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:43 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:37:44.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:44 smithi191 ceph-mon[34834]: pgmap v31: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:44.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:44 smithi112 ceph-mon[27605]: pgmap v31: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:47.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:46 smithi112 ceph-mon[27605]: pgmap v32: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:47.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:46 smithi191 ceph-mon[34834]: pgmap v32: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:48.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:48 smithi191 ceph-mon[34834]: pgmap v33: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:48.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:48 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:37:48.660 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:48 smithi112 ceph-mon[27605]: pgmap v33: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:48.660 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:48 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:37:51.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:50 smithi112 ceph-mon[27605]: pgmap v34: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:51.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:50 smithi191 ceph-mon[34834]: pgmap v34: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:53.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:52 smithi112 ceph-mon[27605]: pgmap v35: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:53.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:52 smithi191 ceph-mon[34834]: pgmap v35: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:55.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:54 smithi112 ceph-mon[27605]: pgmap v36: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:37:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:54 smithi191 ceph-mon[34834]: pgmap v36: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:37:57.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:56 smithi112 ceph-mon[27605]: pgmap v37: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:57.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:56 smithi191 ceph-mon[34834]: pgmap v37: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:58.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:37:58 smithi112 ceph-mon[27605]: pgmap v38: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:59.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:37:58 smithi191 ceph-mon[34834]: pgmap v38: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:01.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:00 smithi112 ceph-mon[27605]: pgmap v39: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:01.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:00 smithi191 ceph-mon[34834]: pgmap v39: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:03.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:02 smithi112 ceph-mon[27605]: pgmap v40: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:03.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:02 smithi191 ceph-mon[34834]: pgmap v40: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:04.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:03 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:38:04.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:03 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:38:05.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:04 smithi112 ceph-mon[27605]: pgmap v41: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:05.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:04 smithi191 ceph-mon[34834]: pgmap v41: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:07.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:06 smithi112 ceph-mon[27605]: pgmap v42: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:06 smithi191 ceph-mon[34834]: pgmap v42: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:08.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.493+0000 7ffb72581640 1 -- 172.21.15.112:0/1575426547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb6c0ff6a0 msgr2=0x7ffb6c101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.493+0000 7ffb72581640 1 --2- 172.21.15.112:0/1575426547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb6c0ff6a0 0x7ffb6c101a80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ffb600048d0 tx=0x7ffb60009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.493+0000 7ffb72581640 1 -- 172.21.15.112:0/1575426547 shutdown_connections 2024-09-19T09:38:08.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.493+0000 7ffb72581640 1 --2- 172.21.15.112:0/1575426547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb6c0ff6a0 0x7ffb6c101a80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.493+0000 7ffb72581640 1 --2- 172.21.15.112:0/1575426547 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb6c066710 0x7ffb6c0ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.493+0000 7ffb72581640 1 -- 172.21.15.112:0/1575426547 >> 172.21.15.112:0/1575426547 conn(0x7ffb6c0f6c10 msgr2=0x7ffb6c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:08.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.494+0000 7ffb72581640 1 -- 172.21.15.112:0/1575426547 shutdown_connections 2024-09-19T09:38:08.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.494+0000 7ffb72581640 1 -- 172.21.15.112:0/1575426547 wait complete. 2024-09-19T09:38:08.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.494+0000 7ffb72581640 1 Processor -- start 2024-09-19T09:38:08.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.494+0000 7ffb72581640 1 -- start start 2024-09-19T09:38:08.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.494+0000 7ffb72581640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb6c066710 0x7ffb6c10d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:08.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.494+0000 7ffb72581640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb6c0ff6a0 0x7ffb6c10d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:08.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.494+0000 7ffb72581640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c10dd00 con 0x7ffb6c0ff6a0 2024-09-19T09:38:08.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.494+0000 7ffb72581640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c10e4d0 con 0x7ffb6c066710 2024-09-19T09:38:08.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.495+0000 7ffb6b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb6c0ff6a0 0x7ffb6c10d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:08.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.495+0000 7ffb6b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb6c0ff6a0 0x7ffb6c10d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57450/0 (socket says 172.21.15.112:57450) 2024-09-19T09:38:08.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.495+0000 7ffb6b7fe640 1 -- 172.21.15.112:0/277740537 learned_addr learned my addr 172.21.15.112:0/277740537 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:08.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.495+0000 7ffb6bfff640 1 --2- 172.21.15.112:0/277740537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb6c066710 0x7ffb6c10d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:08.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.495+0000 7ffb6b7fe640 1 -- 172.21.15.112:0/277740537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb6c066710 msgr2=0x7ffb6c10d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.495+0000 7ffb6b7fe640 1 --2- 172.21.15.112:0/277740537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb6c066710 0x7ffb6c10d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.495+0000 7ffb6b7fe640 1 -- 172.21.15.112:0/277740537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60005040 con 0x7ffb6c0ff6a0 2024-09-19T09:38:08.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.495+0000 7ffb6b7fe640 1 --2- 172.21.15.112:0/277740537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb6c0ff6a0 0x7ffb6c10d6b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffb60003080 tx=0x7ffb60009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:08.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.495+0000 7ffb68ff9640 1 -- 172.21.15.112:0/277740537 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb60038070 con 0x7ffb6c0ff6a0 2024-09-19T09:38:08.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.495+0000 7ffb72581640 1 -- 172.21.15.112:0/277740537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6c10e700 con 0x7ffb6c0ff6a0 2024-09-19T09:38:08.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.495+0000 7ffb68ff9640 1 -- 172.21.15.112:0/277740537 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffb6002ae90 con 0x7ffb6c0ff6a0 2024-09-19T09:38:08.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.495+0000 7ffb68ff9640 1 -- 172.21.15.112:0/277740537 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb60033660 con 0x7ffb6c0ff6a0 2024-09-19T09:38:08.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.495+0000 7ffb72581640 1 -- 172.21.15.112:0/277740537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6c10eca0 con 0x7ffb6c0ff6a0 2024-09-19T09:38:08.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.496+0000 7ffb72581640 1 -- 172.21.15.112:0/277740537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb6c0fa8b0 con 0x7ffb6c0ff6a0 2024-09-19T09:38:08.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.497+0000 7ffb68ff9640 1 -- 172.21.15.112:0/277740537 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) v1 ==== 92377+0+0 (secure 0 0 0) 0x7ffb60030020 con 0x7ffb6c0ff6a0 2024-09-19T09:38:08.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.497+0000 7ffb68ff9640 1 --2- 172.21.15.112:0/277740537 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7ffb5406df60 0x7ffb54070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:08.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.498+0000 7ffb68ff9640 1 -- 172.21.15.112:0/277740537 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ffb600ada90 con 0x7ffb6c0ff6a0 2024-09-19T09:38:08.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.498+0000 7ffb6bfff640 1 --2- 172.21.15.112:0/277740537 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7ffb5406df60 0x7ffb54070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:08.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.498+0000 7ffb6bfff640 1 --2- 172.21.15.112:0/277740537 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7ffb5406df60 0x7ffb54070410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c066470 tx=0x7ffb5c00b040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:08.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.502+0000 7ffb68ff9640 1 -- 172.21.15.112:0/277740537 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7ffb600773c0 con 0x7ffb6c0ff6a0 2024-09-19T09:38:08.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.683+0000 7ffb72581640 1 -- 172.21.15.112:0/277740537 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb6c10efd0 con 0x7ffb5406df60 2024-09-19T09:38:08.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.684+0000 7ffb68ff9640 1 -- 172.21.15.112:0/277740537 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7ffb6c10efd0 con 0x7ffb5406df60 2024-09-19T09:38:08.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.686+0000 7ffb72581640 1 -- 172.21.15.112:0/277740537 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7ffb5406df60 msgr2=0x7ffb54070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.686+0000 7ffb72581640 1 --2- 172.21.15.112:0/277740537 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7ffb5406df60 0x7ffb54070410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c066470 tx=0x7ffb5c00b040 comp rx=0 tx=0).stop 2024-09-19T09:38:08.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.686+0000 7ffb72581640 1 -- 172.21.15.112:0/277740537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb6c0ff6a0 msgr2=0x7ffb6c10d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.686+0000 7ffb72581640 1 --2- 172.21.15.112:0/277740537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb6c0ff6a0 0x7ffb6c10d6b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffb60003080 tx=0x7ffb60009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.687+0000 7ffb72581640 1 -- 172.21.15.112:0/277740537 shutdown_connections 2024-09-19T09:38:08.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.687+0000 7ffb72581640 1 --2- 172.21.15.112:0/277740537 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7ffb5406df60 0x7ffb54070410 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.687+0000 7ffb72581640 1 --2- 172.21.15.112:0/277740537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb6c0ff6a0 0x7ffb6c10d6b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.687+0000 7ffb72581640 1 --2- 172.21.15.112:0/277740537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb6c066710 0x7ffb6c10d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.687+0000 7ffb72581640 1 -- 172.21.15.112:0/277740537 >> 172.21.15.112:0/277740537 conn(0x7ffb6c0f6c10 msgr2=0x7ffb6c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:08.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.687+0000 7ffb72581640 1 -- 172.21.15.112:0/277740537 shutdown_connections 2024-09-19T09:38:08.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:08.687+0000 7ffb72581640 1 -- 172.21.15.112:0/277740537 wait complete. 2024-09-19T09:38:09.172 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:08 smithi112 ceph-mon[27605]: pgmap v43: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:09.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:08 smithi191 ceph-mon[34834]: pgmap v43: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:09.632 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-19T09:38:09.921 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:38:10.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:09 smithi112 ceph-mon[27605]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:10.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:09 smithi191 ceph-mon[34834]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:10 smithi112 ceph-mon[27605]: pgmap v44: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:11.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:10 smithi191 ceph-mon[34834]: pgmap v44: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.734+0000 7f4b922a8640 1 -- 172.21.15.112:0/1686454981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b8c1014c0 msgr2=0x7f4b8c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.734+0000 7f4b922a8640 1 --2- 172.21.15.112:0/1686454981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b8c1014c0 0x7f4b8c101890 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0048d0 tx=0x7f4b7c009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.734+0000 7f4b922a8640 1 -- 172.21.15.112:0/1686454981 shutdown_connections 2024-09-19T09:38:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.734+0000 7f4b922a8640 1 --2- 172.21.15.112:0/1686454981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8c0fb480 0x7f4b8c0fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.734+0000 7f4b922a8640 1 --2- 172.21.15.112:0/1686454981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b8c1014c0 0x7f4b8c101890 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.734+0000 7f4b922a8640 1 -- 172.21.15.112:0/1686454981 >> 172.21.15.112:0/1686454981 conn(0x7f4b8c0f7000 msgr2=0x7f4b8c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.734+0000 7f4b922a8640 1 -- 172.21.15.112:0/1686454981 shutdown_connections 2024-09-19T09:38:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.734+0000 7f4b922a8640 1 -- 172.21.15.112:0/1686454981 wait complete. 2024-09-19T09:38:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.734+0000 7f4b922a8640 1 Processor -- start 2024-09-19T09:38:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.734+0000 7f4b922a8640 1 -- start start 2024-09-19T09:38:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b922a8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b8c0fb480 0x7f4b8c1132a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b922a8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8c1014c0 0x7f4b8c1137e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b922a8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c113e70 con 0x7f4b8c0fb480 2024-09-19T09:38:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b922a8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c10d220 con 0x7f4b8c1014c0 2024-09-19T09:38:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b8bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b8c0fb480 0x7f4b8c1132a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b8bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b8c0fb480 0x7f4b8c1132a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57462/0 (socket says 172.21.15.112:57462) 2024-09-19T09:38:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b8bfff640 1 -- 172.21.15.112:0/2092218371 learned_addr learned my addr 172.21.15.112:0/2092218371 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b83fff640 1 --2- 172.21.15.112:0/2092218371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8c1014c0 0x7f4b8c1137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b8bfff640 1 -- 172.21.15.112:0/2092218371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8c1014c0 msgr2=0x7f4b8c1137e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b8bfff640 1 --2- 172.21.15.112:0/2092218371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8c1014c0 0x7f4b8c1137e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b8bfff640 1 -- 172.21.15.112:0/2092218371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c005040 con 0x7f4b8c0fb480 2024-09-19T09:38:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b8bfff640 1 --2- 172.21.15.112:0/2092218371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b8c0fb480 0x7f4b8c1132a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c003080 tx=0x7f4b7c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b897fa640 1 -- 172.21.15.112:0/2092218371 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b7c038070 con 0x7f4b8c0fb480 2024-09-19T09:38:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b897fa640 1 -- 172.21.15.112:0/2092218371 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4b7c0097e0 con 0x7f4b8c0fb480 2024-09-19T09:38:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b922a8640 1 -- 172.21.15.112:0/2092218371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8c10d4a0 con 0x7f4b8c0fb480 2024-09-19T09:38:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b897fa640 1 -- 172.21.15.112:0/2092218371 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b7c03d420 con 0x7f4b8c0fb480 2024-09-19T09:38:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.735+0000 7f4b922a8640 1 -- 172.21.15.112:0/2092218371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8c10d960 con 0x7f4b8c0fb480 2024-09-19T09:38:11.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.736+0000 7f4b922a8640 1 -- 172.21.15.112:0/2092218371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8c0fcbc0 con 0x7f4b8c0fb480 2024-09-19T09:38:11.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.737+0000 7f4b897fa640 1 -- 172.21.15.112:0/2092218371 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f4b7c030020 con 0x7f4b8c0fb480 2024-09-19T09:38:11.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.737+0000 7f4b897fa640 1 --2- 172.21.15.112:0/2092218371 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f4b7806df60 0x7f4b78070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:11.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.738+0000 7f4b897fa640 1 -- 172.21.15.112:0/2092218371 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4b7c0ade70 con 0x7f4b8c0fb480 2024-09-19T09:38:11.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.738+0000 7f4b83fff640 1 --2- 172.21.15.112:0/2092218371 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f4b7806df60 0x7f4b78070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:11.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.738+0000 7f4b83fff640 1 --2- 172.21.15.112:0/2092218371 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f4b7806df60 0x7f4b78070410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4b74006fd0 tx=0x7f4b74008040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:11.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.742+0000 7f4b897fa640 1 -- 172.21.15.112:0/2092218371 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f4b7c0776f0 con 0x7f4b8c0fb480 2024-09-19T09:38:11.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.972+0000 7f4b922a8640 1 -- 172.21.15.112:0/2092218371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4b8c04b750 con 0x7f4b8c0fb480 2024-09-19T09:38:11.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.973+0000 7f4b897fa640 1 -- 172.21.15.112:0/2092218371 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f4b7c07adb0 con 0x7f4b8c0fb480 2024-09-19T09:38:11.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.975+0000 7f4b922a8640 1 -- 172.21.15.112:0/2092218371 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f4b7806df60 msgr2=0x7f4b78070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:11.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.975+0000 7f4b922a8640 1 --2- 172.21.15.112:0/2092218371 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f4b7806df60 0x7f4b78070410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4b74006fd0 tx=0x7f4b74008040 comp rx=0 tx=0).stop 2024-09-19T09:38:11.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.975+0000 7f4b922a8640 1 -- 172.21.15.112:0/2092218371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b8c0fb480 msgr2=0x7f4b8c1132a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:11.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.975+0000 7f4b922a8640 1 --2- 172.21.15.112:0/2092218371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b8c0fb480 0x7f4b8c1132a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c003080 tx=0x7f4b7c009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.975+0000 7f4b922a8640 1 -- 172.21.15.112:0/2092218371 shutdown_connections 2024-09-19T09:38:11.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.975+0000 7f4b922a8640 1 --2- 172.21.15.112:0/2092218371 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f4b7806df60 0x7f4b78070410 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.975+0000 7f4b922a8640 1 --2- 172.21.15.112:0/2092218371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8c1014c0 0x7f4b8c1137e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.975+0000 7f4b922a8640 1 --2- 172.21.15.112:0/2092218371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b8c0fb480 0x7f4b8c1132a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.975+0000 7f4b922a8640 1 -- 172.21.15.112:0/2092218371 >> 172.21.15.112:0/2092218371 conn(0x7f4b8c0f7000 msgr2=0x7f4b8c065a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:11.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.975+0000 7f4b922a8640 1 -- 172.21.15.112:0/2092218371 shutdown_connections 2024-09-19T09:38:11.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:11.975+0000 7f4b922a8640 1 -- 172.21.15.112:0/2092218371 wait complete. 2024-09-19T09:38:11.985 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:38:12.715 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-19T09:38:12.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:12 smithi112 ceph-mon[27605]: pgmap v45: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:12.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:12 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2092218371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:38:12.965 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:38:13.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:12 smithi191 ceph-mon[34834]: pgmap v45: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:13.290 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:12 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2092218371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:38:14.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.674+0000 7f6d7164b640 1 -- 172.21.15.112:0/1859631242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d6c102ef0 msgr2=0x7f6d6c0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:14.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.674+0000 7f6d7164b640 1 --2- 172.21.15.112:0/1859631242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d6c102ef0 0x7f6d6c0fc5b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6d540048d0 tx=0x7f6d54009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:14.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.674+0000 7f6d7164b640 1 -- 172.21.15.112:0/1859631242 shutdown_connections 2024-09-19T09:38:14.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.674+0000 7f6d7164b640 1 --2- 172.21.15.112:0/1859631242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d6c102ef0 0x7f6d6c0fc5b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:14.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.674+0000 7f6d7164b640 1 --2- 172.21.15.112:0/1859631242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d6c102550 0x7f6d6c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:14.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.674+0000 7f6d7164b640 1 -- 172.21.15.112:0/1859631242 >> 172.21.15.112:0/1859631242 conn(0x7f6d6c0f80f0 msgr2=0x7f6d6c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:14.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.674+0000 7f6d7164b640 1 -- 172.21.15.112:0/1859631242 shutdown_connections 2024-09-19T09:38:14.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.674+0000 7f6d7164b640 1 -- 172.21.15.112:0/1859631242 wait complete. 2024-09-19T09:38:14.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.674+0000 7f6d7164b640 1 Processor -- start 2024-09-19T09:38:14.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.674+0000 7f6d7164b640 1 -- start start 2024-09-19T09:38:14.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d7164b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d6c102550 0x7f6d6c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:14.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d7164b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d6c102ef0 0x7f6d6c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:14.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d7164b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c070490 con 0x7f6d6c102550 2024-09-19T09:38:14.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d7164b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c070600 con 0x7f6d6c102ef0 2024-09-19T09:38:14.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d6affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d6c102550 0x7f6d6c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:14.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d6affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d6c102550 0x7f6d6c06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57482/0 (socket says 172.21.15.112:57482) 2024-09-19T09:38:14.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d6affd640 1 -- 172.21.15.112:0/3740626453 learned_addr learned my addr 172.21.15.112:0/3740626453 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:14.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d6a7fc640 1 --2- 172.21.15.112:0/3740626453 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d6c102ef0 0x7f6d6c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:14.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d6affd640 1 -- 172.21.15.112:0/3740626453 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d6c102ef0 msgr2=0x7f6d6c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:14.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d6affd640 1 --2- 172.21.15.112:0/3740626453 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d6c102ef0 0x7f6d6c06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:14.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d6affd640 1 -- 172.21.15.112:0/3740626453 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d54005040 con 0x7f6d6c102550 2024-09-19T09:38:14.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d6affd640 1 --2- 172.21.15.112:0/3740626453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d6c102550 0x7f6d6c06fa10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6d64002a50 tx=0x7f6d64004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:14.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d637fe640 1 -- 172.21.15.112:0/3740626453 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d64007c30 con 0x7f6d6c102550 2024-09-19T09:38:14.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d637fe640 1 -- 172.21.15.112:0/3740626453 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6d6400f040 con 0x7f6d6c102550 2024-09-19T09:38:14.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d7164b640 1 -- 172.21.15.112:0/3740626453 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c070890 con 0x7f6d6c102550 2024-09-19T09:38:14.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.675+0000 7f6d637fe640 1 -- 172.21.15.112:0/3740626453 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d6400dad0 con 0x7f6d6c102550 2024-09-19T09:38:14.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.676+0000 7f6d7164b640 1 -- 172.21.15.112:0/3740626453 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c119c00 con 0x7f6d6c102550 2024-09-19T09:38:14.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.676+0000 7f6d7164b640 1 -- 172.21.15.112:0/3740626453 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c0fdcd0 con 0x7f6d6c102550 2024-09-19T09:38:14.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.677+0000 7f6d637fe640 1 -- 172.21.15.112:0/3740626453 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f6d6400dc30 con 0x7f6d6c102550 2024-09-19T09:38:14.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.677+0000 7f6d637fe640 1 --2- 172.21.15.112:0/3740626453 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6d5806df60 0x7f6d58070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:14.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.677+0000 7f6d637fe640 1 -- 172.21.15.112:0/3740626453 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6d6408d8e0 con 0x7f6d6c102550 2024-09-19T09:38:14.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.677+0000 7f6d6a7fc640 1 --2- 172.21.15.112:0/3740626453 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6d5806df60 0x7f6d58070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:14.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.678+0000 7f6d6a7fc640 1 --2- 172.21.15.112:0/3740626453 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6d5806df60 0x7f6d58070410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6d540048a0 tx=0x7f6d54035040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:14.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.682+0000 7f6d637fe640 1 -- 172.21.15.112:0/3740626453 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f6d64057050 con 0x7f6d6c102550 2024-09-19T09:38:14.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.914+0000 7f6d7164b640 1 -- 172.21.15.112:0/3740626453 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6d6c071100 con 0x7f6d6c102550 2024-09-19T09:38:14.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.914+0000 7f6d637fe640 1 -- 172.21.15.112:0/3740626453 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f6d6405a710 con 0x7f6d6c102550 2024-09-19T09:38:14.916 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:14 smithi112 ceph-mon[27605]: pgmap v46: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:14.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.916+0000 7f6d7164b640 1 -- 172.21.15.112:0/3740626453 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6d5806df60 msgr2=0x7f6d58070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:14.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.916+0000 7f6d7164b640 1 --2- 172.21.15.112:0/3740626453 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6d5806df60 0x7f6d58070410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6d540048a0 tx=0x7f6d54035040 comp rx=0 tx=0).stop 2024-09-19T09:38:14.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.916+0000 7f6d7164b640 1 -- 172.21.15.112:0/3740626453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d6c102550 msgr2=0x7f6d6c06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:14.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.916+0000 7f6d7164b640 1 --2- 172.21.15.112:0/3740626453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d6c102550 0x7f6d6c06fa10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6d64002a50 tx=0x7f6d64004600 comp rx=0 tx=0).stop 2024-09-19T09:38:14.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.916+0000 7f6d7164b640 1 -- 172.21.15.112:0/3740626453 shutdown_connections 2024-09-19T09:38:14.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.916+0000 7f6d7164b640 1 --2- 172.21.15.112:0/3740626453 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6d5806df60 0x7f6d58070410 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:14.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.916+0000 7f6d7164b640 1 --2- 172.21.15.112:0/3740626453 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d6c102ef0 0x7f6d6c06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:14.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.916+0000 7f6d7164b640 1 --2- 172.21.15.112:0/3740626453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d6c102550 0x7f6d6c06fa10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:14.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.916+0000 7f6d7164b640 1 -- 172.21.15.112:0/3740626453 >> 172.21.15.112:0/3740626453 conn(0x7f6d6c0f80f0 msgr2=0x7f6d6c0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:14.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.916+0000 7f6d7164b640 1 -- 172.21.15.112:0/3740626453 shutdown_connections 2024-09-19T09:38:14.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:14.916+0000 7f6d7164b640 1 -- 172.21.15.112:0/3740626453 wait complete. 2024-09-19T09:38:14.927 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)" 2024-09-19T09:38:15.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:14 smithi191 ceph-mon[34834]: pgmap v46: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:15.628 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-19T09:38:15.874 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:38:16.167 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:15 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/3740626453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:38:16.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:15 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/3740626453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:38:17.136 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:16 smithi112 ceph-mon[27605]: pgmap v47: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:17.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:16 smithi191 ceph-mon[34834]: pgmap v47: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:17.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.647+0000 7f7a315f9640 1 -- 172.21.15.112:0/3599725487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a2c101e20 msgr2=0x7f7a2c0fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:17.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.647+0000 7f7a315f9640 1 --2- 172.21.15.112:0/3599725487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a2c101e20 0x7f7a2c0fbd70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7a200048d0 tx=0x7f7a20009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.647+0000 7f7a315f9640 1 -- 172.21.15.112:0/3599725487 shutdown_connections 2024-09-19T09:38:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.647+0000 7f7a315f9640 1 --2- 172.21.15.112:0/3599725487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a2c101e20 0x7f7a2c0fbd70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.647+0000 7f7a315f9640 1 --2- 172.21.15.112:0/3599725487 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a2c101480 0x7f7a2c101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.647+0000 7f7a315f9640 1 -- 172.21.15.112:0/3599725487 >> 172.21.15.112:0/3599725487 conn(0x7f7a2c070c80 msgr2=0x7f7a2c071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.647+0000 7f7a315f9640 1 -- 172.21.15.112:0/3599725487 shutdown_connections 2024-09-19T09:38:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.647+0000 7f7a315f9640 1 -- 172.21.15.112:0/3599725487 wait complete. 2024-09-19T09:38:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.648+0000 7f7a315f9640 1 Processor -- start 2024-09-19T09:38:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.648+0000 7f7a315f9640 1 -- start start 2024-09-19T09:38:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.648+0000 7f7a315f9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a2c101480 0x7f7a2c1120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.648+0000 7f7a315f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a2c101e20 0x7f7a2c112630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.648+0000 7f7a315f9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c112c30 con 0x7f7a2c101e20 2024-09-19T09:38:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.648+0000 7f7a315f9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c10c070 con 0x7f7a2c101480 2024-09-19T09:38:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.648+0000 7f7a2a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a2c101e20 0x7f7a2c112630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.648+0000 7f7a2a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a2c101e20 0x7f7a2c112630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57494/0 (socket says 172.21.15.112:57494) 2024-09-19T09:38:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.648+0000 7f7a2a7fc640 1 -- 172.21.15.112:0/2376511393 learned_addr learned my addr 172.21.15.112:0/2376511393 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.648+0000 7f7a2affd640 1 --2- 172.21.15.112:0/2376511393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a2c101480 0x7f7a2c1120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.648+0000 7f7a2a7fc640 1 -- 172.21.15.112:0/2376511393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a2c101480 msgr2=0x7f7a2c1120f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.648+0000 7f7a2a7fc640 1 --2- 172.21.15.112:0/2376511393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a2c101480 0x7f7a2c1120f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.648+0000 7f7a2a7fc640 1 -- 172.21.15.112:0/2376511393 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a20005040 con 0x7f7a2c101e20 2024-09-19T09:38:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.649+0000 7f7a2a7fc640 1 --2- 172.21.15.112:0/2376511393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a2c101e20 0x7f7a2c112630 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7a200043d0 tx=0x7f7a20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.649+0000 7f7a137fe640 1 -- 172.21.15.112:0/2376511393 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a20038070 con 0x7f7a2c101e20 2024-09-19T09:38:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.649+0000 7f7a315f9640 1 -- 172.21.15.112:0/2376511393 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c10c2f0 con 0x7f7a2c101e20 2024-09-19T09:38:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.649+0000 7f7a137fe640 1 -- 172.21.15.112:0/2376511393 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7a200096e0 con 0x7f7a2c101e20 2024-09-19T09:38:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.649+0000 7f7a137fe640 1 -- 172.21.15.112:0/2376511393 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a2002c8a0 con 0x7f7a2c101e20 2024-09-19T09:38:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.649+0000 7f7a315f9640 1 -- 172.21.15.112:0/2376511393 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2c10c830 con 0x7f7a2c101e20 2024-09-19T09:38:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.650+0000 7f7a315f9640 1 -- 172.21.15.112:0/2376511393 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2c0fcd80 con 0x7f7a2c101e20 2024-09-19T09:38:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.650+0000 7f7a137fe640 1 -- 172.21.15.112:0/2376511393 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f7a20030020 con 0x7f7a2c101e20 2024-09-19T09:38:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.651+0000 7f7a137fe640 1 --2- 172.21.15.112:0/2376511393 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f7a1406df60 0x7f7a14070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.651+0000 7f7a137fe640 1 -- 172.21.15.112:0/2376511393 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f7a200ad6f0 con 0x7f7a2c101e20 2024-09-19T09:38:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.651+0000 7f7a2affd640 1 --2- 172.21.15.112:0/2376511393 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f7a1406df60 0x7f7a14070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.651+0000 7f7a2affd640 1 --2- 172.21.15.112:0/2376511393 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f7a1406df60 0x7f7a14070410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c007fd0 tx=0x7f7a1c009e90 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.655+0000 7f7a137fe640 1 -- 172.21.15.112:0/2376511393 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f7a20076f70 con 0x7f7a2c101e20 2024-09-19T09:38:17.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.887+0000 7f7a315f9640 1 -- 172.21.15.112:0/2376511393 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7a2c1084b0 con 0x7f7a2c101e20 2024-09-19T09:38:17.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.887+0000 7f7a137fe640 1 -- 172.21.15.112:0/2376511393 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f7a2007a630 con 0x7f7a2c101e20 2024-09-19T09:38:17.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.889+0000 7f7a315f9640 1 -- 172.21.15.112:0/2376511393 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f7a1406df60 msgr2=0x7f7a14070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:17.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.889+0000 7f7a315f9640 1 --2- 172.21.15.112:0/2376511393 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f7a1406df60 0x7f7a14070410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c007fd0 tx=0x7f7a1c009e90 comp rx=0 tx=0).stop 2024-09-19T09:38:17.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.889+0000 7f7a315f9640 1 -- 172.21.15.112:0/2376511393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a2c101e20 msgr2=0x7f7a2c112630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:17.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.889+0000 7f7a315f9640 1 --2- 172.21.15.112:0/2376511393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a2c101e20 0x7f7a2c112630 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7a200043d0 tx=0x7f7a20009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.889+0000 7f7a315f9640 1 -- 172.21.15.112:0/2376511393 shutdown_connections 2024-09-19T09:38:17.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.889+0000 7f7a315f9640 1 --2- 172.21.15.112:0/2376511393 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f7a1406df60 0x7f7a14070410 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.889+0000 7f7a315f9640 1 --2- 172.21.15.112:0/2376511393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a2c101e20 0x7f7a2c112630 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.889+0000 7f7a315f9640 1 --2- 172.21.15.112:0/2376511393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a2c101480 0x7f7a2c1120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.889+0000 7f7a315f9640 1 -- 172.21.15.112:0/2376511393 >> 172.21.15.112:0/2376511393 conn(0x7f7a2c070c80 msgr2=0x7f7a2c0f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:17.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.889+0000 7f7a315f9640 1 -- 172.21.15.112:0/2376511393 shutdown_connections 2024-09-19T09:38:17.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:17.889+0000 7f7a315f9640 1 -- 172.21.15.112:0/2376511393 wait complete. 2024-09-19T09:38:17.900 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:38:18.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:17 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2376511393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:38:18.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:17 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2376511393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:38:18.617 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-19T09:38:18.863 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:38:19.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:18 smithi112 ceph-mon[27605]: pgmap v48: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:19.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:18 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:38:19.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:18 smithi191 ceph-mon[34834]: pgmap v48: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:18 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:38:20.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.564+0000 7f6bb71bf640 1 -- 172.21.15.112:0/686114194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb00fb480 msgr2=0x7f6bb00fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:20.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.564+0000 7f6bb71bf640 1 --2- 172.21.15.112:0/686114194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb00fb480 0x7f6bb00fb8f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009c50 tx=0x7f6ba0004d10 comp rx=0 tx=0).stop 2024-09-19T09:38:20.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.564+0000 7f6bb71bf640 1 -- 172.21.15.112:0/686114194 shutdown_connections 2024-09-19T09:38:20.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.564+0000 7f6bb71bf640 1 --2- 172.21.15.112:0/686114194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb00fb480 0x7f6bb00fb8f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:20.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.564+0000 7f6bb71bf640 1 --2- 172.21.15.112:0/686114194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bb01014c0 0x7f6bb0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:20.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.564+0000 7f6bb71bf640 1 -- 172.21.15.112:0/686114194 >> 172.21.15.112:0/686114194 conn(0x7f6bb00f7000 msgr2=0x7f6bb00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:20.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.564+0000 7f6bb71bf640 1 -- 172.21.15.112:0/686114194 shutdown_connections 2024-09-19T09:38:20.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.564+0000 7f6bb71bf640 1 -- 172.21.15.112:0/686114194 wait complete. 2024-09-19T09:38:20.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.564+0000 7f6bb71bf640 1 Processor -- start 2024-09-19T09:38:20.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.564+0000 7f6bb71bf640 1 -- start start 2024-09-19T09:38:20.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.565+0000 7f6bb71bf640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bb00fb480 0x7f6bb0112150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:20.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.565+0000 7f6bb71bf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb01014c0 0x7f6bb0112690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:20.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.565+0000 7f6bb71bf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb0112d20 con 0x7f6bb01014c0 2024-09-19T09:38:20.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.565+0000 7f6bb71bf640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb010c0d0 con 0x7f6bb00fb480 2024-09-19T09:38:20.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.565+0000 7f6baffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb01014c0 0x7f6bb0112690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:20.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.565+0000 7f6baffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb01014c0 0x7f6bb0112690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40580/0 (socket says 172.21.15.112:40580) 2024-09-19T09:38:20.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.565+0000 7f6baffff640 1 -- 172.21.15.112:0/3395605511 learned_addr learned my addr 172.21.15.112:0/3395605511 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:20.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.565+0000 7f6bb4f5b640 1 --2- 172.21.15.112:0/3395605511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bb00fb480 0x7f6bb0112150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:20.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.565+0000 7f6baffff640 1 -- 172.21.15.112:0/3395605511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bb00fb480 msgr2=0x7f6bb0112150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:20.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.565+0000 7f6baffff640 1 --2- 172.21.15.112:0/3395605511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bb00fb480 0x7f6bb0112150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:20.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.565+0000 7f6baffff640 1 -- 172.21.15.112:0/3395605511 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba00098b0 con 0x7f6bb01014c0 2024-09-19T09:38:20.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.565+0000 7f6baffff640 1 --2- 172.21.15.112:0/3395605511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb01014c0 0x7f6bb0112690 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0004a30 tx=0x7f6ba0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:20.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.566+0000 7f6bad7fa640 1 -- 172.21.15.112:0/3395605511 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba0009690 con 0x7f6bb01014c0 2024-09-19T09:38:20.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.566+0000 7f6bb71bf640 1 -- 172.21.15.112:0/3395605511 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb010c350 con 0x7f6bb01014c0 2024-09-19T09:38:20.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.566+0000 7f6bad7fa640 1 -- 172.21.15.112:0/3395605511 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6ba0032b10 con 0x7f6bb01014c0 2024-09-19T09:38:20.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.566+0000 7f6bad7fa640 1 -- 172.21.15.112:0/3395605511 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba003daa0 con 0x7f6bb01014c0 2024-09-19T09:38:20.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.566+0000 7f6bb71bf640 1 -- 172.21.15.112:0/3395605511 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb010c870 con 0x7f6bb01014c0 2024-09-19T09:38:20.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.567+0000 7f6bb71bf640 1 -- 172.21.15.112:0/3395605511 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb00fcbc0 con 0x7f6bb01014c0 2024-09-19T09:38:20.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.567+0000 7f6bad7fa640 1 -- 172.21.15.112:0/3395605511 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 34) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f6ba002f030 con 0x7f6bb01014c0 2024-09-19T09:38:20.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.568+0000 7f6bad7fa640 1 --2- 172.21.15.112:0/3395605511 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6b9c06de30 0x7f6b9c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:20.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.568+0000 7f6bad7fa640 1 -- 172.21.15.112:0/3395605511 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6ba00ae890 con 0x7f6bb01014c0 2024-09-19T09:38:20.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.568+0000 7f6bb4f5b640 1 --2- 172.21.15.112:0/3395605511 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6b9c06de30 0x7f6b9c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:20.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.568+0000 7f6bb4f5b640 1 --2- 172.21.15.112:0/3395605511 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6b9c06de30 0x7f6b9c0702e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009b50 tx=0x7f6ba8009120 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:20.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.572+0000 7f6bad7fa640 1 -- 172.21.15.112:0/3395605511 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f6ba0078220 con 0x7f6bb01014c0 2024-09-19T09:38:20.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:20.753+0000 7f6bb71bf640 1 -- 172.21.15.112:0/3395605511 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bb01084f0 con 0x7f6b9c06de30 2024-09-19T09:38:21.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:20 smithi112 ceph-mon[27605]: pgmap v49: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:38:21.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:20 smithi112 ceph-mon[27605]: mgrmap e34: smithi112.puhuua(active, since 92s), standbys: smithi191.xjpplx 2024-09-19T09:38:21.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:20 smithi191 ceph-mon[34834]: pgmap v49: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:38:21.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:20 smithi191 ceph-mon[34834]: mgrmap e34: smithi112.puhuua(active, since 92s), standbys: smithi191.xjpplx 2024-09-19T09:38:22.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:21 smithi112 ceph-mon[27605]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:22.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:21 smithi191 ceph-mon[34834]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:22.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:22.708+0000 7f6bad7fa640 1 -- 172.21.15.112:0/3395605511 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5108 (secure 0 0 0) 0x7f6bb01084f0 con 0x7f6b9c06de30 2024-09-19T09:38:22.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:22.710+0000 7f6bb71bf640 1 -- 172.21.15.112:0/3395605511 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6b9c06de30 msgr2=0x7f6b9c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:22.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:22.710+0000 7f6bb71bf640 1 --2- 172.21.15.112:0/3395605511 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6b9c06de30 0x7f6b9c0702e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009b50 tx=0x7f6ba8009120 comp rx=0 tx=0).stop 2024-09-19T09:38:22.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:22.710+0000 7f6bb71bf640 1 -- 172.21.15.112:0/3395605511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb01014c0 msgr2=0x7f6bb0112690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:22.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:22.710+0000 7f6bb71bf640 1 --2- 172.21.15.112:0/3395605511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb01014c0 0x7f6bb0112690 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0004a30 tx=0x7f6ba0004d10 comp rx=0 tx=0).stop 2024-09-19T09:38:22.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:22.710+0000 7f6bb71bf640 1 -- 172.21.15.112:0/3395605511 shutdown_connections 2024-09-19T09:38:22.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:22.710+0000 7f6bb71bf640 1 --2- 172.21.15.112:0/3395605511 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f6b9c06de30 0x7f6b9c0702e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:22.710+0000 7f6bb71bf640 1 --2- 172.21.15.112:0/3395605511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb01014c0 0x7f6bb0112690 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:22.710+0000 7f6bb71bf640 1 --2- 172.21.15.112:0/3395605511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bb00fb480 0x7f6bb0112150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:22.710+0000 7f6bb71bf640 1 -- 172.21.15.112:0/3395605511 >> 172.21.15.112:0/3395605511 conn(0x7f6bb00f7000 msgr2=0x7f6bb00f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:22.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:22.711+0000 7f6bb71bf640 1 -- 172.21.15.112:0/3395605511 shutdown_connections 2024-09-19T09:38:22.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:22.711+0000 7f6bb71bf640 1 -- 172.21.15.112:0/3395605511 wait complete. 2024-09-19T09:38:22.721 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:38:23.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:22 smithi191 ceph-mon[34834]: pgmap v50: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T09:38:23.349 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:22 smithi112 ceph-mon[27605]: pgmap v50: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T09:38:23.373 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch ps' 2024-09-19T09:38:23.619 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:38:25.054 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:24 smithi112 ceph-mon[27605]: pgmap v51: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:38:25.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:24 smithi191 ceph-mon[34834]: pgmap v51: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:38:25.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.261+0000 7f3e4e06e640 1 -- 172.21.15.112:0/1599049482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e48102530 msgr2=0x7f3e48102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:25.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.261+0000 7f3e4e06e640 1 --2- 172.21.15.112:0/1599049482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e48102530 0x7f3e48102900 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009c50 tx=0x7f3e38004d10 comp rx=0 tx=0).stop 2024-09-19T09:38:25.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.261+0000 7f3e4e06e640 1 -- 172.21.15.112:0/1599049482 shutdown_connections 2024-09-19T09:38:25.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.261+0000 7f3e4e06e640 1 --2- 172.21.15.112:0/1599049482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3e48102ed0 0x7f3e480fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:25.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.261+0000 7f3e4e06e640 1 --2- 172.21.15.112:0/1599049482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e48102530 0x7f3e48102900 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:25.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.261+0000 7f3e4e06e640 1 -- 172.21.15.112:0/1599049482 >> 172.21.15.112:0/1599049482 conn(0x7f3e480f80f0 msgr2=0x7f3e480fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:25.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.261+0000 7f3e4e06e640 1 -- 172.21.15.112:0/1599049482 shutdown_connections 2024-09-19T09:38:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.261+0000 7f3e4e06e640 1 -- 172.21.15.112:0/1599049482 wait complete. 2024-09-19T09:38:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.261+0000 7f3e4e06e640 1 Processor -- start 2024-09-19T09:38:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.261+0000 7f3e4e06e640 1 -- start start 2024-09-19T09:38:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e4e06e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e48102530 0x7f3e48113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e4e06e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3e48102ed0 0x7f3e48113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e4e06e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e48113d50 con 0x7f3e48102530 2024-09-19T09:38:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e4e06e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4810d190 con 0x7f3e48102ed0 2024-09-19T09:38:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e477fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e48102530 0x7f3e48113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e477fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e48102530 0x7f3e48113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40594/0 (socket says 172.21.15.112:40594) 2024-09-19T09:38:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e477fe640 1 -- 172.21.15.112:0/1114069544 learned_addr learned my addr 172.21.15.112:0/1114069544 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e46ffd640 1 --2- 172.21.15.112:0/1114069544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3e48102ed0 0x7f3e48113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e477fe640 1 -- 172.21.15.112:0/1114069544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3e48102ed0 msgr2=0x7f3e48113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e477fe640 1 --2- 172.21.15.112:0/1114069544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3e48102ed0 0x7f3e48113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e477fe640 1 -- 172.21.15.112:0/1114069544 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e380098b0 con 0x7f3e48102530 2024-09-19T09:38:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e477fe640 1 --2- 172.21.15.112:0/1114069544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e48102530 0x7f3e48113210 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3e38004a30 tx=0x7f3e38004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e2ffff640 1 -- 172.21.15.112:0/1114069544 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e38009690 con 0x7f3e48102530 2024-09-19T09:38:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e2ffff640 1 -- 172.21.15.112:0/1114069544 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3e38032b10 con 0x7f3e48102530 2024-09-19T09:38:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e4e06e640 1 -- 172.21.15.112:0/1114069544 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4810d410 con 0x7f3e48102530 2024-09-19T09:38:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e2ffff640 1 -- 172.21.15.112:0/1114069544 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e3803daa0 con 0x7f3e48102530 2024-09-19T09:38:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.262+0000 7f3e4e06e640 1 -- 172.21.15.112:0/1114069544 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4810d9b0 con 0x7f3e48102530 2024-09-19T09:38:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.263+0000 7f3e4e06e640 1 -- 172.21.15.112:0/1114069544 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e480fdcb0 con 0x7f3e48102530 2024-09-19T09:38:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.264+0000 7f3e2ffff640 1 -- 172.21.15.112:0/1114069544 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 34) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f3e3802f030 con 0x7f3e48102530 2024-09-19T09:38:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.264+0000 7f3e2ffff640 1 --2- 172.21.15.112:0/1114069544 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f3e3006de30 0x7f3e300702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.265+0000 7f3e2ffff640 1 -- 172.21.15.112:0/1114069544 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f3e380ae890 con 0x7f3e48102530 2024-09-19T09:38:25.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.265+0000 7f3e46ffd640 1 --2- 172.21.15.112:0/1114069544 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f3e3006de30 0x7f3e300702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:25.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.265+0000 7f3e46ffd640 1 --2- 172.21.15.112:0/1114069544 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f3e3006de30 0x7f3e300702e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3e4810ead0 tx=0x7f3e3c004330 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:25.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.269+0000 7f3e2ffff640 1 -- 172.21.15.112:0/1114069544 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f3e38078220 con 0x7f3e48102530 2024-09-19T09:38:25.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.441+0000 7f3e4e06e640 1 -- 172.21.15.112:0/1114069544 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e4804b720 con 0x7f3e3006de30 2024-09-19T09:38:25.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.450+0000 7f3e2ffff640 1 -- 172.21.15.112:0/1114069544 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3e4804b720 con 0x7f3e3006de30 2024-09-19T09:38:25.452 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:38:25.452 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (2m) 49s ago 11m 28.2M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:38:25.452 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (11m) 49s ago 11m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1513f1075df5 2024-09-19T09:38:25.452 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (10m) 71s ago 10m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6c313b300b35 2024-09-19T09:38:25.452 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (54s) 49s ago 11m 45.6M - 9.4.12 2bacad6d85d8 e462aca2b022 2024-09-19T09:38:25.452 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (5m) 49s ago 5m 154M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:38:25.452 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (5m) 49s ago 5m 106M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:38:25.452 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (5m) 71s ago 5m 12.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:38:25.452 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (5m) 71s ago 5m 15.2M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:38:25.453 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (2m) 49s ago 12m 500M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:38:25.453 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283,8765 running (74s) 71s ago 10m 68.8M - 19.1.1-361-g2f599a46 d2baa855c067 fddba1bee64a 2024-09-19T09:38:25.453 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (12m) 49s ago 12m 55.6M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 34676d67b669 2024-09-19T09:38:25.453 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (10m) 71s ago 10m 41.4M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 35690ef0929b 2024-09-19T09:38:25.453 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (3m) 49s ago 11m 15.9M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:38:25.453 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (2m) 71s ago 10m 15.9M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:38:25.453 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (9m) 49s ago 9m 228M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 621693067dce 2024-09-19T09:38:25.453 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (9m) 49s ago 9m 247M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1742e5964367 2024-09-19T09:38:25.453 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (8m) 49s ago 8m 211M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 4dcca18af229 2024-09-19T09:38:25.453 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (8m) 71s ago 8m 269M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:38:25.453 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (7m) 71s ago 7m 239M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:38:25.453 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (7m) 71s ago 7m 224M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:38:25.453 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (79s) 49s ago 10m 51.0M - 2.43.0 a07b618ecd1d 54850883a171 2024-09-19T09:38:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.452+0000 7f3e4e06e640 1 -- 172.21.15.112:0/1114069544 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f3e3006de30 msgr2=0x7f3e300702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.452+0000 7f3e4e06e640 1 --2- 172.21.15.112:0/1114069544 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f3e3006de30 0x7f3e300702e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3e4810ead0 tx=0x7f3e3c004330 comp rx=0 tx=0).stop 2024-09-19T09:38:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.452+0000 7f3e4e06e640 1 -- 172.21.15.112:0/1114069544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e48102530 msgr2=0x7f3e48113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.452+0000 7f3e4e06e640 1 --2- 172.21.15.112:0/1114069544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e48102530 0x7f3e48113210 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3e38004a30 tx=0x7f3e38004d10 comp rx=0 tx=0).stop 2024-09-19T09:38:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.453+0000 7f3e4e06e640 1 -- 172.21.15.112:0/1114069544 shutdown_connections 2024-09-19T09:38:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.453+0000 7f3e4e06e640 1 --2- 172.21.15.112:0/1114069544 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f3e3006de30 0x7f3e300702e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.453+0000 7f3e4e06e640 1 --2- 172.21.15.112:0/1114069544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3e48102ed0 0x7f3e48113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.453+0000 7f3e4e06e640 1 --2- 172.21.15.112:0/1114069544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e48102530 0x7f3e48113210 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.453+0000 7f3e4e06e640 1 -- 172.21.15.112:0/1114069544 >> 172.21.15.112:0/1114069544 conn(0x7f3e480f80f0 msgr2=0x7f3e480f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.453+0000 7f3e4e06e640 1 -- 172.21.15.112:0/1114069544 shutdown_connections 2024-09-19T09:38:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:25.453+0000 7f3e4e06e640 1 -- 172.21.15.112:0/1114069544 wait complete. 2024-09-19T09:38:26.113 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-19T09:38:26.114 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-19T09:38:26.114 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-19T09:38:26.358 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:38:27.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:26 smithi112 ceph-mon[27605]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:27.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:26 smithi112 ceph-mon[27605]: pgmap v52: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T09:38:27.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:26 smithi191 ceph-mon[34834]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:27.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:26 smithi191 ceph-mon[34834]: pgmap v52: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T09:38:28.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.997+0000 7f885727d640 1 -- 172.21.15.112:0/3101782180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88500fe450 msgr2=0x7f88500fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:28.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.997+0000 7f885727d640 1 --2- 172.21.15.112:0/3101782180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88500fe450 0x7f88500fe820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8840009c50 tx=0x7f8840004d10 comp rx=0 tx=0).stop 2024-09-19T09:38:28.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.997+0000 7f885727d640 1 -- 172.21.15.112:0/3101782180 shutdown_connections 2024-09-19T09:38:28.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.997+0000 7f885727d640 1 --2- 172.21.15.112:0/3101782180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8850064fe0 0x7f8850065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:28.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.997+0000 7f885727d640 1 --2- 172.21.15.112:0/3101782180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88500fe450 0x7f88500fe820 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:28.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.997+0000 7f885727d640 1 -- 172.21.15.112:0/3101782180 >> 172.21.15.112:0/3101782180 conn(0x7f88500723b0 msgr2=0x7f88500727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:28.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.997+0000 7f885727d640 1 -- 172.21.15.112:0/3101782180 shutdown_connections 2024-09-19T09:38:28.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.997+0000 7f885727d640 1 -- 172.21.15.112:0/3101782180 wait complete. 2024-09-19T09:38:28.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.997+0000 7f885727d640 1 Processor -- start 2024-09-19T09:38:28.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.997+0000 7f885727d640 1 -- start start 2024-09-19T09:38:28.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.997+0000 7f885727d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8850064fe0 0x7f88501131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:28.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.998+0000 7f885727d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88500fe450 0x7f8850113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:28.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.998+0000 7f885727d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8850113d10 con 0x7f88500fe450 2024-09-19T09:38:28.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.998+0000 7f885727d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885010d150 con 0x7f8850064fe0 2024-09-19T09:38:28.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.998+0000 7f8854818640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88500fe450 0x7f8850113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:28.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.998+0000 7f8854818640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88500fe450 0x7f8850113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40612/0 (socket says 172.21.15.112:40612) 2024-09-19T09:38:28.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.998+0000 7f8854818640 1 -- 172.21.15.112:0/495846640 learned_addr learned my addr 172.21.15.112:0/495846640 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:28.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.998+0000 7f8855019640 1 --2- 172.21.15.112:0/495846640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8850064fe0 0x7f88501131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:28.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.998+0000 7f8854818640 1 -- 172.21.15.112:0/495846640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8850064fe0 msgr2=0x7f88501131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:28.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.998+0000 7f8854818640 1 --2- 172.21.15.112:0/495846640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8850064fe0 0x7f88501131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:28.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.998+0000 7f8854818640 1 -- 172.21.15.112:0/495846640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88400098b0 con 0x7f88500fe450 2024-09-19T09:38:28.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.998+0000 7f8854818640 1 --2- 172.21.15.112:0/495846640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88500fe450 0x7f8850113710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f884400c810 tx=0x7f88440043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:28.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.998+0000 7f884dffb640 1 -- 172.21.15.112:0/495846640 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f884400a820 con 0x7f88500fe450 2024-09-19T09:38:28.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.998+0000 7f885727d640 1 -- 172.21.15.112:0/495846640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885010d430 con 0x7f88500fe450 2024-09-19T09:38:28.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.998+0000 7f884dffb640 1 -- 172.21.15.112:0/495846640 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f884400ae20 con 0x7f88500fe450 2024-09-19T09:38:28.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.998+0000 7f884dffb640 1 -- 172.21.15.112:0/495846640 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88440115c0 con 0x7f88500fe450 2024-09-19T09:38:28.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:27.999+0000 7f885727d640 1 -- 172.21.15.112:0/495846640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885010d9d0 con 0x7f88500fe450 2024-09-19T09:38:28.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.000+0000 7f885727d640 1 -- 172.21.15.112:0/495846640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88500fdce0 con 0x7f88500fe450 2024-09-19T09:38:28.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.000+0000 7f884dffb640 1 -- 172.21.15.112:0/495846640 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 34) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f8844012840 con 0x7f88500fe450 2024-09-19T09:38:28.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.001+0000 7f884dffb640 1 --2- 172.21.15.112:0/495846640 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f883806de30 0x7f88380702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:28.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.001+0000 7f884dffb640 1 -- 172.21.15.112:0/495846640 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f884408dce0 con 0x7f88500fe450 2024-09-19T09:38:28.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.001+0000 7f8855019640 1 --2- 172.21.15.112:0/495846640 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f883806de30 0x7f88380702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:28.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.001+0000 7f8855019640 1 --2- 172.21.15.112:0/495846640 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f883806de30 0x7f88380702e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8840009c20 tx=0x7f8840004d10 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:28.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.006+0000 7f884dffb640 1 -- 172.21.15.112:0/495846640 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f884405b1a0 con 0x7f88500fe450 2024-09-19T09:38:28.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.174+0000 7f885727d640 1 -- 172.21.15.112:0/495846640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f8850072ec0 con 0x7f88500fe450 2024-09-19T09:38:28.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.178+0000 7f884dffb640 1 -- 172.21.15.112:0/495846640 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f884405ad30 con 0x7f88500fe450 2024-09-19T09:38:28.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.180+0000 7f885727d640 1 -- 172.21.15.112:0/495846640 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f883806de30 msgr2=0x7f88380702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:28.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.180+0000 7f885727d640 1 --2- 172.21.15.112:0/495846640 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f883806de30 0x7f88380702e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8840009c20 tx=0x7f8840004d10 comp rx=0 tx=0).stop 2024-09-19T09:38:28.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.180+0000 7f885727d640 1 -- 172.21.15.112:0/495846640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88500fe450 msgr2=0x7f8850113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:28.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.180+0000 7f885727d640 1 --2- 172.21.15.112:0/495846640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88500fe450 0x7f8850113710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f884400c810 tx=0x7f88440043c0 comp rx=0 tx=0).stop 2024-09-19T09:38:28.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.180+0000 7f885727d640 1 -- 172.21.15.112:0/495846640 shutdown_connections 2024-09-19T09:38:28.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.180+0000 7f885727d640 1 --2- 172.21.15.112:0/495846640 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f883806de30 0x7f88380702e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:28.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.180+0000 7f885727d640 1 --2- 172.21.15.112:0/495846640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88500fe450 0x7f8850113710 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:28.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.180+0000 7f885727d640 1 --2- 172.21.15.112:0/495846640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8850064fe0 0x7f88501131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:28.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.180+0000 7f885727d640 1 -- 172.21.15.112:0/495846640 >> 172.21.15.112:0/495846640 conn(0x7f88500723b0 msgr2=0x7f88500fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:28.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.181+0000 7f885727d640 1 -- 172.21.15.112:0/495846640 shutdown_connections 2024-09-19T09:38:28.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:28.181+0000 7f885727d640 1 -- 172.21.15.112:0/495846640 wait complete. 2024-09-19T09:38:28.815 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-19T09:38:28.816 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-19T09:38:28.816 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-19T09:38:29.066 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:38:29.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:29 smithi112 ceph-mon[27605]: pgmap v53: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T09:38:29.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:29 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/495846640' entity='client.admin' 2024-09-19T09:38:29.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:29 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:29.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:29 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:29.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:29 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:29.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:29 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:38:29.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:29 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:38:29.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:29 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:29.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:29 smithi191 ceph-mon[34834]: pgmap v53: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T09:38:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:29 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/495846640' entity='client.admin' 2024-09-19T09:38:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:29 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:29 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:29 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:29 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:38:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:29 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:38:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:29 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:30.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.670+0000 7fafdc2e3640 1 -- 172.21.15.112:0/1497500545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd4064fe0 msgr2=0x7fafd40653b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:30.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.670+0000 7fafdc2e3640 1 --2- 172.21.15.112:0/1497500545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd4064fe0 0x7fafd40653b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fafd00048d0 tx=0x7fafd0009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.670+0000 7fafdc2e3640 1 -- 172.21.15.112:0/1497500545 shutdown_connections 2024-09-19T09:38:30.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.670+0000 7fafdc2e3640 1 --2- 172.21.15.112:0/1497500545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafd40658f0 0x7fafd4108b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.670+0000 7fafdc2e3640 1 --2- 172.21.15.112:0/1497500545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd4064fe0 0x7fafd40653b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.670+0000 7fafdc2e3640 1 -- 172.21.15.112:0/1497500545 >> 172.21.15.112:0/1497500545 conn(0x7fafd40723b0 msgr2=0x7fafd40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:30.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.670+0000 7fafdc2e3640 1 -- 172.21.15.112:0/1497500545 shutdown_connections 2024-09-19T09:38:30.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.670+0000 7fafdc2e3640 1 -- 172.21.15.112:0/1497500545 wait complete. 2024-09-19T09:38:30.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.670+0000 7fafdc2e3640 1 Processor -- start 2024-09-19T09:38:30.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.670+0000 7fafdc2e3640 1 -- start start 2024-09-19T09:38:30.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafdc2e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd4064fe0 0x7fafd41154c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafdc2e3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafd40658f0 0x7fafd4115a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafdc2e3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd4116050 con 0x7fafd4064fe0 2024-09-19T09:38:30.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafdc2e3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd410f460 con 0x7fafd40658f0 2024-09-19T09:38:30.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafda07f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd4064fe0 0x7fafd41154c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafda07f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd4064fe0 0x7fafd41154c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44630/0 (socket says 172.21.15.112:44630) 2024-09-19T09:38:30.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafda07f640 1 -- 172.21.15.112:0/554761441 learned_addr learned my addr 172.21.15.112:0/554761441 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:30.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafda07f640 1 -- 172.21.15.112:0/554761441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafd40658f0 msgr2=0x7fafd4115a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:30.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafda07f640 1 --2- 172.21.15.112:0/554761441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafd40658f0 0x7fafd4115a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafda07f640 1 -- 172.21.15.112:0/554761441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd0005040 con 0x7fafd4064fe0 2024-09-19T09:38:30.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafda07f640 1 --2- 172.21.15.112:0/554761441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd4064fe0 0x7fafd41154c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fafd0000c00 tx=0x7fafd0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:30.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafcaffd640 1 -- 172.21.15.112:0/554761441 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafd0038070 con 0x7fafd4064fe0 2024-09-19T09:38:30.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafcaffd640 1 -- 172.21.15.112:0/554761441 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fafd002ade0 con 0x7fafd4064fe0 2024-09-19T09:38:30.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafdc2e3640 1 -- 172.21.15.112:0/554761441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd410f6e0 con 0x7fafd4064fe0 2024-09-19T09:38:30.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafcaffd640 1 -- 172.21.15.112:0/554761441 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafd002c7e0 con 0x7fafd4064fe0 2024-09-19T09:38:30.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.671+0000 7fafdc2e3640 1 -- 172.21.15.112:0/554761441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd410fba0 con 0x7fafd4064fe0 2024-09-19T09:38:30.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.672+0000 7fafdc2e3640 1 -- 172.21.15.112:0/554761441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd40fbad0 con 0x7fafd4064fe0 2024-09-19T09:38:30.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.673+0000 7fafcaffd640 1 -- 172.21.15.112:0/554761441 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 34) v1 ==== 92275+0+0 (secure 0 0 0) 0x7fafd0030020 con 0x7fafd4064fe0 2024-09-19T09:38:30.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.673+0000 7fafcaffd640 1 --2- 172.21.15.112:0/554761441 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fafc006de30 0x7fafc00702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.673+0000 7fafcaffd640 1 -- 172.21.15.112:0/554761441 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fafd00ad440 con 0x7fafd4064fe0 2024-09-19T09:38:30.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.673+0000 7fafd987e640 1 --2- 172.21.15.112:0/554761441 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fafc006de30 0x7fafc00702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.674+0000 7fafd987e640 1 --2- 172.21.15.112:0/554761441 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fafc006de30 0x7fafc00702e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009fd0 tx=0x7fafc4009c50 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:30.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.678+0000 7fafcaffd640 1 -- 172.21.15.112:0/554761441 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fafd0076e80 con 0x7fafd4064fe0 2024-09-19T09:38:30.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.846+0000 7fafdc2e3640 1 -- 172.21.15.112:0/554761441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fafd4110b30 con 0x7fafd4064fe0 2024-09-19T09:38:30.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.846+0000 7fafcaffd640 1 -- 172.21.15.112:0/554761441 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7fafd007a540 con 0x7fafd4064fe0 2024-09-19T09:38:30.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.848+0000 7fafdc2e3640 1 -- 172.21.15.112:0/554761441 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fafc006de30 msgr2=0x7fafc00702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:30.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.848+0000 7fafdc2e3640 1 --2- 172.21.15.112:0/554761441 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fafc006de30 0x7fafc00702e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009fd0 tx=0x7fafc4009c50 comp rx=0 tx=0).stop 2024-09-19T09:38:30.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.848+0000 7fafdc2e3640 1 -- 172.21.15.112:0/554761441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd4064fe0 msgr2=0x7fafd41154c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:30.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.848+0000 7fafdc2e3640 1 --2- 172.21.15.112:0/554761441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd4064fe0 0x7fafd41154c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fafd0000c00 tx=0x7fafd0009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.848+0000 7fafdc2e3640 1 -- 172.21.15.112:0/554761441 shutdown_connections 2024-09-19T09:38:30.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.848+0000 7fafdc2e3640 1 --2- 172.21.15.112:0/554761441 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fafc006de30 0x7fafc00702e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.848+0000 7fafdc2e3640 1 --2- 172.21.15.112:0/554761441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafd40658f0 0x7fafd4115a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.848+0000 7fafdc2e3640 1 --2- 172.21.15.112:0/554761441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd4064fe0 0x7fafd41154c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.848+0000 7fafdc2e3640 1 -- 172.21.15.112:0/554761441 >> 172.21.15.112:0/554761441 conn(0x7fafd40723b0 msgr2=0x7fafd4103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:30.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.848+0000 7fafdc2e3640 1 -- 172.21.15.112:0/554761441 shutdown_connections 2024-09-19T09:38:30.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:30.848+0000 7fafdc2e3640 1 -- 172.21.15.112:0/554761441 wait complete. 2024-09-19T09:38:31.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:31 smithi112 ceph-mon[27605]: pgmap v54: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:38:31.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:31 smithi191 ceph-mon[34834]: pgmap v54: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:38:31.538 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-19T09:38:31.782 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:38:33.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:33 smithi112 ceph-mon[27605]: pgmap v55: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-19T09:38:33.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:33 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:38:33.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.511+0000 7f39da819640 1 -- 172.21.15.112:0/1507477520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fac80 msgr2=0x7f39d40fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:33.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.511+0000 7f39da819640 1 --2- 172.21.15.112:0/1507477520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fac80 0x7f39d40fb0d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f39c80048d0 tx=0x7f39c8009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.511+0000 7f39da819640 1 -- 172.21.15.112:0/1507477520 shutdown_connections 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.511+0000 7f39da819640 1 --2- 172.21.15.112:0/1507477520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fac80 0x7f39d40fb0d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.511+0000 7f39da819640 1 --2- 172.21.15.112:0/1507477520 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39d4102660 0x7f39d4102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.511+0000 7f39da819640 1 -- 172.21.15.112:0/1507477520 >> 172.21.15.112:0/1507477520 conn(0x7f39d4070ce0 msgr2=0x7f39d40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.511+0000 7f39da819640 1 -- 172.21.15.112:0/1507477520 shutdown_connections 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.511+0000 7f39da819640 1 -- 172.21.15.112:0/1507477520 wait complete. 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.511+0000 7f39da819640 1 Processor -- start 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.511+0000 7f39da819640 1 -- start start 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39da819640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fac80 0x7f39d41131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39da819640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39d4102660 0x7f39d41136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39da819640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4113cf0 con 0x7f39d40fac80 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39da819640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4113e60 con 0x7f39d4102660 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39d3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fac80 0x7f39d41131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39d3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fac80 0x7f39d41131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44654/0 (socket says 172.21.15.112:44654) 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39d3fff640 1 -- 172.21.15.112:0/1277204415 learned_addr learned my addr 172.21.15.112:0/1277204415 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39d37fe640 1 --2- 172.21.15.112:0/1277204415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39d4102660 0x7f39d41136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39d3fff640 1 -- 172.21.15.112:0/1277204415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39d4102660 msgr2=0x7f39d41136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39d3fff640 1 --2- 172.21.15.112:0/1277204415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39d4102660 0x7f39d41136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39d3fff640 1 -- 172.21.15.112:0/1277204415 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c8005040 con 0x7f39d40fac80 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39d37fe640 1 --2- 172.21.15.112:0/1277204415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39d4102660 0x7f39d41136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39d3fff640 1 --2- 172.21.15.112:0/1277204415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fac80 0x7f39d41131b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f39c4002a50 tx=0x7f39c4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39d0ff9640 1 -- 172.21.15.112:0/1277204415 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c4007c30 con 0x7f39d40fac80 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39d0ff9640 1 -- 172.21.15.112:0/1277204415 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f39c400f040 con 0x7f39d40fac80 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39da819640 1 -- 172.21.15.112:0/1277204415 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d410d2e0 con 0x7f39d40fac80 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39d0ff9640 1 -- 172.21.15.112:0/1277204415 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c400da90 con 0x7f39d40fac80 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.512+0000 7f39da819640 1 -- 172.21.15.112:0/1277204415 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d410d880 con 0x7f39d40fac80 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.513+0000 7f39da819640 1 -- 172.21.15.112:0/1277204415 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d40657d0 con 0x7f39d40fac80 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.514+0000 7f39d0ff9640 1 -- 172.21.15.112:0/1277204415 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 34) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f39c400dd00 con 0x7f39d40fac80 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.514+0000 7f39d0ff9640 1 --2- 172.21.15.112:0/1277204415 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f39bc06de30 0x7f39bc0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.515+0000 7f39d0ff9640 1 -- 172.21.15.112:0/1277204415 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f39c408d0c0 con 0x7f39d40fac80 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.515+0000 7f39d37fe640 1 --2- 172.21.15.112:0/1277204415 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f39bc06de30 0x7f39bc0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.515+0000 7f39d37fe640 1 --2- 172.21.15.112:0/1277204415 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f39bc06de30 0x7f39bc0702e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f39c800b020 tx=0x7f39c8009da0 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:33.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.519+0000 7f39d0ff9640 1 -- 172.21.15.112:0/1277204415 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f39c4056a50 con 0x7f39d40fac80 2024-09-19T09:38:33.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:33 smithi191 ceph-mon[34834]: pgmap v55: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-19T09:38:33.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:33 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:38:33.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.682+0000 7f39da819640 1 -- 172.21.15.112:0/1277204415 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f39d4074c00 con 0x7f39d40fac80 2024-09-19T09:38:33.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.683+0000 7f39d0ff9640 1 -- 172.21.15.112:0/1277204415 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f39c405a110 con 0x7f39d40fac80 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.685+0000 7f39da819640 1 -- 172.21.15.112:0/1277204415 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f39bc06de30 msgr2=0x7f39bc0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.685+0000 7f39da819640 1 --2- 172.21.15.112:0/1277204415 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f39bc06de30 0x7f39bc0702e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f39c800b020 tx=0x7f39c8009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.685+0000 7f39da819640 1 -- 172.21.15.112:0/1277204415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fac80 msgr2=0x7f39d41131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.685+0000 7f39da819640 1 --2- 172.21.15.112:0/1277204415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fac80 0x7f39d41131b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f39c4002a50 tx=0x7f39c4004600 comp rx=0 tx=0).stop 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.685+0000 7f39da819640 1 -- 172.21.15.112:0/1277204415 shutdown_connections 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.685+0000 7f39da819640 1 --2- 172.21.15.112:0/1277204415 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f39bc06de30 0x7f39bc0702e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.685+0000 7f39da819640 1 --2- 172.21.15.112:0/1277204415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39d4102660 0x7f39d41136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.685+0000 7f39da819640 1 --2- 172.21.15.112:0/1277204415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fac80 0x7f39d41131b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.685+0000 7f39da819640 1 -- 172.21.15.112:0/1277204415 >> 172.21.15.112:0/1277204415 conn(0x7f39d4070ce0 msgr2=0x7f39d40fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.685+0000 7f39da819640 1 -- 172.21.15.112:0/1277204415 shutdown_connections 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:33.686+0000 7f39da819640 1 -- 172.21.15.112:0/1277204415 wait complete. 2024-09-19T09:38:34.411 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-19T09:38:34.657 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:38:35.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:35 smithi112 ceph-mon[27605]: pgmap v56: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:35.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:35 smithi191 ceph-mon[34834]: pgmap v56: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:36.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.183+0000 7f3730969640 1 -- 172.21.15.112:0/2859097445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c1014e0 msgr2=0x7f372c1018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:36.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.183+0000 7f3730969640 1 --2- 172.21.15.112:0/2859097445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c1014e0 0x7f372c1018b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f371c0048d0 tx=0x7f371c009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.183+0000 7f3730969640 1 -- 172.21.15.112:0/2859097445 shutdown_connections 2024-09-19T09:38:36.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.183+0000 7f3730969640 1 --2- 172.21.15.112:0/2859097445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f372c0fb4a0 0x7f372c0fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.183+0000 7f3730969640 1 --2- 172.21.15.112:0/2859097445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c1014e0 0x7f372c1018b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.183+0000 7f3730969640 1 -- 172.21.15.112:0/2859097445 >> 172.21.15.112:0/2859097445 conn(0x7f372c0f70a0 msgr2=0x7f372c0f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:36.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.183+0000 7f3730969640 1 -- 172.21.15.112:0/2859097445 shutdown_connections 2024-09-19T09:38:36.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.183+0000 7f3730969640 1 -- 172.21.15.112:0/2859097445 wait complete. 2024-09-19T09:38:36.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.184+0000 7f3730969640 1 Processor -- start 2024-09-19T09:38:36.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.184+0000 7f3730969640 1 -- start start 2024-09-19T09:38:36.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.184+0000 7f3730969640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f372c0fb4a0 0x7f372c1131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:36.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.184+0000 7f3730969640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c1014e0 0x7f372c1136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:36.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.184+0000 7f3730969640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c113ce0 con 0x7f372c1014e0 2024-09-19T09:38:36.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.184+0000 7f3730969640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c10d120 con 0x7f372c0fb4a0 2024-09-19T09:38:36.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.184+0000 7f3729d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c1014e0 0x7f372c1136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:36.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.184+0000 7f3729d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c1014e0 0x7f372c1136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44666/0 (socket says 172.21.15.112:44666) 2024-09-19T09:38:36.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.184+0000 7f3729d9b640 1 -- 172.21.15.112:0/1202951779 learned_addr learned my addr 172.21.15.112:0/1202951779 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:36.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.184+0000 7f372a59c640 1 --2- 172.21.15.112:0/1202951779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f372c0fb4a0 0x7f372c1131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:36.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.184+0000 7f3729d9b640 1 -- 172.21.15.112:0/1202951779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f372c0fb4a0 msgr2=0x7f372c1131a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:36.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.184+0000 7f3729d9b640 1 --2- 172.21.15.112:0/1202951779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f372c0fb4a0 0x7f372c1131a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.184+0000 7f3729d9b640 1 -- 172.21.15.112:0/1202951779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c005040 con 0x7f372c1014e0 2024-09-19T09:38:36.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.184+0000 7f3729d9b640 1 --2- 172.21.15.112:0/1202951779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c1014e0 0x7f372c1136e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3720002a50 tx=0x7f3720004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:36.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.185+0000 7f371affd640 1 -- 172.21.15.112:0/1202951779 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3720007c30 con 0x7f372c1014e0 2024-09-19T09:38:36.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.185+0000 7f3730969640 1 -- 172.21.15.112:0/1202951779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372c10d400 con 0x7f372c1014e0 2024-09-19T09:38:36.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.185+0000 7f371affd640 1 -- 172.21.15.112:0/1202951779 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f372000f040 con 0x7f372c1014e0 2024-09-19T09:38:36.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.185+0000 7f371affd640 1 -- 172.21.15.112:0/1202951779 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f372000dad0 con 0x7f372c1014e0 2024-09-19T09:38:36.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.185+0000 7f3730969640 1 -- 172.21.15.112:0/1202951779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c10d9a0 con 0x7f372c1014e0 2024-09-19T09:38:36.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.186+0000 7f3730969640 1 -- 172.21.15.112:0/1202951779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372c0fcbe0 con 0x7f372c1014e0 2024-09-19T09:38:36.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.186+0000 7f371affd640 1 -- 172.21.15.112:0/1202951779 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 34) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f372000dc30 con 0x7f372c1014e0 2024-09-19T09:38:36.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.187+0000 7f371affd640 1 --2- 172.21.15.112:0/1202951779 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f371406de30 0x7f37140702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:36.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.187+0000 7f372a59c640 1 --2- 172.21.15.112:0/1202951779 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f371406de30 0x7f37140702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:36.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.187+0000 7f372a59c640 1 --2- 172.21.15.112:0/1202951779 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f371406de30 0x7f37140702e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f371c009ac0 tx=0x7f371c035040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:36.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.188+0000 7f371affd640 1 -- 172.21.15.112:0/1202951779 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f372005b450 con 0x7f372c1014e0 2024-09-19T09:38:36.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.192+0000 7f371affd640 1 -- 172.21.15.112:0/1202951779 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f3720056ff0 con 0x7f372c1014e0 2024-09-19T09:38:36.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.358+0000 7f3730969640 1 -- 172.21.15.112:0/1202951779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f372c0faca0 con 0x7f372c1014e0 2024-09-19T09:38:36.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.358+0000 7f371affd640 1 -- 172.21.15.112:0/1202951779 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7f372005a6b0 con 0x7f372c1014e0 2024-09-19T09:38:36.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.360+0000 7f3730969640 1 -- 172.21.15.112:0/1202951779 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f371406de30 msgr2=0x7f37140702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:36.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.360+0000 7f3730969640 1 --2- 172.21.15.112:0/1202951779 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f371406de30 0x7f37140702e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f371c009ac0 tx=0x7f371c035040 comp rx=0 tx=0).stop 2024-09-19T09:38:36.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.360+0000 7f3730969640 1 -- 172.21.15.112:0/1202951779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c1014e0 msgr2=0x7f372c1136e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:36.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.360+0000 7f3730969640 1 --2- 172.21.15.112:0/1202951779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c1014e0 0x7f372c1136e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3720002a50 tx=0x7f3720004600 comp rx=0 tx=0).stop 2024-09-19T09:38:36.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.360+0000 7f3730969640 1 -- 172.21.15.112:0/1202951779 shutdown_connections 2024-09-19T09:38:36.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.361+0000 7f3730969640 1 --2- 172.21.15.112:0/1202951779 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f371406de30 0x7f37140702e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.361+0000 7f3730969640 1 --2- 172.21.15.112:0/1202951779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c1014e0 0x7f372c1136e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.361+0000 7f3730969640 1 --2- 172.21.15.112:0/1202951779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f372c0fb4a0 0x7f372c1131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.361+0000 7f3730969640 1 -- 172.21.15.112:0/1202951779 >> 172.21.15.112:0/1202951779 conn(0x7f372c0f70a0 msgr2=0x7f372c0659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:36.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.361+0000 7f3730969640 1 -- 172.21.15.112:0/1202951779 shutdown_connections 2024-09-19T09:38:36.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:36.361+0000 7f3730969640 1 -- 172.21.15.112:0/1202951779 wait complete. 2024-09-19T09:38:37.187 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-19T09:38:37.436 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:38:37.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:37 smithi112 ceph-mon[27605]: pgmap v57: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-19T09:38:37.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:37 smithi191 ceph-mon[34834]: pgmap v57: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-19T09:38:39.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.988+0000 7f954d1c2640 1 -- 172.21.15.112:0/2669966298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9548102560 msgr2=0x7f9548102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:39.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.988+0000 7f954d1c2640 1 --2- 172.21.15.112:0/2669966298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9548102560 0x7f9548102930 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f95380048d0 tx=0x7f9538009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:39.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.988+0000 7f954d1c2640 1 -- 172.21.15.112:0/2669966298 shutdown_connections 2024-09-19T09:38:39.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.988+0000 7f954d1c2640 1 --2- 172.21.15.112:0/2669966298 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9548102f00 0x7f95480fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:39.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.988+0000 7f954d1c2640 1 --2- 172.21.15.112:0/2669966298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9548102560 0x7f9548102930 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:39.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.988+0000 7f954d1c2640 1 -- 172.21.15.112:0/2669966298 >> 172.21.15.112:0/2669966298 conn(0x7f95480f8120 msgr2=0x7f95480fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:39.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.988+0000 7f954d1c2640 1 -- 172.21.15.112:0/2669966298 shutdown_connections 2024-09-19T09:38:39.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.988+0000 7f954d1c2640 1 -- 172.21.15.112:0/2669966298 wait complete. 2024-09-19T09:38:39.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.989+0000 7f954d1c2640 1 Processor -- start 2024-09-19T09:38:39.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.989+0000 7f954d1c2640 1 -- start start 2024-09-19T09:38:39.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.989+0000 7f954d1c2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9548102560 0x7f9548113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:39.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.989+0000 7f954d1c2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9548102f00 0x7f95481137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:39.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.989+0000 7f954d1c2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9548113e30 con 0x7f9548102560 2024-09-19T09:38:39.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.989+0000 7f954d1c2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954810d1e0 con 0x7f9548102f00 2024-09-19T09:38:39.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.989+0000 7f9546d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9548102560 0x7f9548113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:39.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.989+0000 7f9546d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9548102560 0x7f9548113260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57588/0 (socket says 172.21.15.112:57588) 2024-09-19T09:38:39.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.989+0000 7f9546d9d640 1 -- 172.21.15.112:0/1081305437 learned_addr learned my addr 172.21.15.112:0/1081305437 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:39.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.990+0000 7f954659c640 1 --2- 172.21.15.112:0/1081305437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9548102f00 0x7f95481137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:39.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.990+0000 7f9546d9d640 1 -- 172.21.15.112:0/1081305437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9548102f00 msgr2=0x7f95481137a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:39.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.990+0000 7f9546d9d640 1 --2- 172.21.15.112:0/1081305437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9548102f00 0x7f95481137a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:39.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.990+0000 7f9546d9d640 1 -- 172.21.15.112:0/1081305437 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9538005040 con 0x7f9548102560 2024-09-19T09:38:39.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.990+0000 7f9546d9d640 1 --2- 172.21.15.112:0/1081305437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9548102560 0x7f9548113260 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9538000c00 tx=0x7f9538009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:39.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.990+0000 7f952f7fe640 1 -- 172.21.15.112:0/1081305437 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9538038070 con 0x7f9548102560 2024-09-19T09:38:39.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.990+0000 7f952f7fe640 1 -- 172.21.15.112:0/1081305437 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f953803daf0 con 0x7f9548102560 2024-09-19T09:38:39.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.990+0000 7f954d1c2640 1 -- 172.21.15.112:0/1081305437 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954810d460 con 0x7f9548102560 2024-09-19T09:38:39.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.990+0000 7f952f7fe640 1 -- 172.21.15.112:0/1081305437 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9538033b20 con 0x7f9548102560 2024-09-19T09:38:39.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.990+0000 7f954d1c2640 1 -- 172.21.15.112:0/1081305437 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954810d980 con 0x7f9548102560 2024-09-19T09:38:39.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.991+0000 7f954d1c2640 1 -- 172.21.15.112:0/1081305437 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95480fdce0 con 0x7f9548102560 2024-09-19T09:38:39.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.992+0000 7f952f7fe640 1 -- 172.21.15.112:0/1081305437 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 34) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f9538030020 con 0x7f9548102560 2024-09-19T09:38:39.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.992+0000 7f952f7fe640 1 --2- 172.21.15.112:0/1081305437 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f953006de30 0x7f95300702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:39.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.992+0000 7f952f7fe640 1 -- 172.21.15.112:0/1081305437 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f95380ada20 con 0x7f9548102560 2024-09-19T09:38:39.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.992+0000 7f954659c640 1 --2- 172.21.15.112:0/1081305437 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f953006de30 0x7f95300702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:39.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.993+0000 7f954659c640 1 --2- 172.21.15.112:0/1081305437 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f953006de30 0x7f95300702e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f953c006fd0 tx=0x7f953c008040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:39.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:38.997+0000 7f952f7fe640 1 -- 172.21.15.112:0/1081305437 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f9538077460 con 0x7f9548102560 2024-09-19T09:38:39.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:39.180+0000 7f954d1c2640 1 -- 172.21.15.112:0/1081305437 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "target": ["mon-mgr", ""]}) v1 -- 0x7f954804b780 con 0x7f953006de30 2024-09-19T09:38:39.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:39.185+0000 7f952f7fe640 1 -- 172.21.15.112:0/1081305437 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f954804b780 con 0x7f953006de30 2024-09-19T09:38:39.186 INFO:teuthology.orchestra.run.smithi112.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:38:39.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:39.187+0000 7f954d1c2640 1 -- 172.21.15.112:0/1081305437 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f953006de30 msgr2=0x7f95300702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:39.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:39.187+0000 7f954d1c2640 1 --2- 172.21.15.112:0/1081305437 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f953006de30 0x7f95300702e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f953c006fd0 tx=0x7f953c008040 comp rx=0 tx=0).stop 2024-09-19T09:38:39.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:39.187+0000 7f954d1c2640 1 -- 172.21.15.112:0/1081305437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9548102560 msgr2=0x7f9548113260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:39.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:39.187+0000 7f954d1c2640 1 --2- 172.21.15.112:0/1081305437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9548102560 0x7f9548113260 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9538000c00 tx=0x7f9538009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:39.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:39.187+0000 7f954d1c2640 1 -- 172.21.15.112:0/1081305437 shutdown_connections 2024-09-19T09:38:39.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:39.187+0000 7f954d1c2640 1 --2- 172.21.15.112:0/1081305437 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f953006de30 0x7f95300702e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:39.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:39.187+0000 7f954d1c2640 1 --2- 172.21.15.112:0/1081305437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9548102f00 0x7f95481137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:39.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:39.187+0000 7f954d1c2640 1 --2- 172.21.15.112:0/1081305437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9548102560 0x7f9548113260 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:39.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:39.187+0000 7f954d1c2640 1 -- 172.21.15.112:0/1081305437 >> 172.21.15.112:0/1081305437 conn(0x7f95480f8120 msgr2=0x7f95480f9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:39.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:39.187+0000 7f954d1c2640 1 -- 172.21.15.112:0/1081305437 shutdown_connections 2024-09-19T09:38:39.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:39.187+0000 7f954d1c2640 1 -- 172.21.15.112:0/1081305437 wait complete. 2024-09-19T09:38:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:39 smithi112 ceph-mon[27605]: pgmap v58: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-19T09:38:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:39 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:39 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:39.537 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:39 smithi191 ceph-mon[34834]: pgmap v58: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-19T09:38:39.537 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:39 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:39.537 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:39 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:39.873 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-19T09:38:39.874 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-19T09:38:39.874 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-19T09:38:40.143 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:38:40.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:40 smithi112 ceph-mon[27605]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:40.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:40 smithi112 ceph-mon[27605]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:38:40.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:40 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:38:40.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:40 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:38:40.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:40 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:40.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:40 smithi191 ceph-mon[34834]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:40.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:40 smithi191 ceph-mon[34834]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:38:40.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:40 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:38:40.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:40 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:38:40.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:40 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:41.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:41 smithi191 ceph-mon[34834]: pgmap v59: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:41.542 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:41 smithi112 ceph-mon[27605]: pgmap v59: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:42.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.301+0000 7f39d00c2640 1 -- 172.21.15.112:0/3742805603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102620 msgr2=0x7f39c81029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.301+0000 7f39d00c2640 1 --2- 172.21.15.112:0/3742805603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102620 0x7f39c81029f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f39c40048d0 tx=0x7f39c4009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.302+0000 7f39d00c2640 1 -- 172.21.15.112:0/3742805603 shutdown_connections 2024-09-19T09:38:42.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.302+0000 7f39d00c2640 1 --2- 172.21.15.112:0/3742805603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39c80fac80 0x7f39c80fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.302+0000 7f39d00c2640 1 --2- 172.21.15.112:0/3742805603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102620 0x7f39c81029f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.302+0000 7f39d00c2640 1 -- 172.21.15.112:0/3742805603 >> 172.21.15.112:0/3742805603 conn(0x7f39c8070ce0 msgr2=0x7f39c80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:42.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.302+0000 7f39d00c2640 1 -- 172.21.15.112:0/3742805603 shutdown_connections 2024-09-19T09:38:42.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.302+0000 7f39d00c2640 1 -- 172.21.15.112:0/3742805603 wait complete. 2024-09-19T09:38:42.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.302+0000 7f39d00c2640 1 Processor -- start 2024-09-19T09:38:42.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.302+0000 7f39d00c2640 1 -- start start 2024-09-19T09:38:42.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39d00c2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39c80fac80 0x7f39c80fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39d00c2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102620 0x7f39c80fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39d00c2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c80fdca0 con 0x7f39c8102620 2024-09-19T09:38:42.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39d00c2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c80fde10 con 0x7f39c80fac80 2024-09-19T09:38:42.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39cd65d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102620 0x7f39c80fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39cd65d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102620 0x7f39c80fc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57602/0 (socket says 172.21.15.112:57602) 2024-09-19T09:38:42.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39cd65d640 1 -- 172.21.15.112:0/502749105 learned_addr learned my addr 172.21.15.112:0/502749105 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:42.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39cde5e640 1 --2- 172.21.15.112:0/502749105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39c80fac80 0x7f39c80fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39cd65d640 1 -- 172.21.15.112:0/502749105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39c80fac80 msgr2=0x7f39c80fbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39cd65d640 1 --2- 172.21.15.112:0/502749105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39c80fac80 0x7f39c80fbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39cd65d640 1 -- 172.21.15.112:0/502749105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c4005040 con 0x7f39c8102620 2024-09-19T09:38:42.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39cd65d640 1 --2- 172.21.15.112:0/502749105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102620 0x7f39c80fc3a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f39b800b790 tx=0x7f39b80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:42.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39be7fc640 1 -- 172.21.15.112:0/502749105 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39b800c700 con 0x7f39c8102620 2024-09-19T09:38:42.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39d00c2640 1 -- 172.21.15.112:0/502749105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c80fca30 con 0x7f39c8102620 2024-09-19T09:38:42.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39be7fc640 1 -- 172.21.15.112:0/502749105 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f39b800cd00 con 0x7f39c8102620 2024-09-19T09:38:42.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39be7fc640 1 -- 172.21.15.112:0/502749105 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39b8015e70 con 0x7f39c8102620 2024-09-19T09:38:42.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.303+0000 7f39d00c2640 1 -- 172.21.15.112:0/502749105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c811de60 con 0x7f39c8102620 2024-09-19T09:38:42.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.305+0000 7f39d00c2640 1 -- 172.21.15.112:0/502749105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c80657b0 con 0x7f39c8102620 2024-09-19T09:38:42.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.306+0000 7f39be7fc640 1 -- 172.21.15.112:0/502749105 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 34) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f39b8012070 con 0x7f39c8102620 2024-09-19T09:38:42.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.306+0000 7f39be7fc640 1 --2- 172.21.15.112:0/502749105 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f39b406de30 0x7f39b40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.306+0000 7f39be7fc640 1 -- 172.21.15.112:0/502749105 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f39b808d3d0 con 0x7f39c8102620 2024-09-19T09:38:42.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.306+0000 7f39cde5e640 1 --2- 172.21.15.112:0/502749105 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f39b406de30 0x7f39b40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.307+0000 7f39cde5e640 1 --2- 172.21.15.112:0/502749105 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f39b406de30 0x7f39b40702e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009ac0 tx=0x7f39c4035040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:42.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.311+0000 7f39be7fc640 1 -- 172.21.15.112:0/502749105 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f39b8056d60 con 0x7f39c8102620 2024-09-19T09:38:42.433 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:42 smithi112 ceph-mon[27605]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:38:42.433 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:42 smithi112 ceph-mon[27605]: pgmap v60: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:42.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.497+0000 7f39d00c2640 1 -- 172.21.15.112:0/502749105 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39c804b720 con 0x7f39b406de30 2024-09-19T09:38:42.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.498+0000 7f39be7fc640 1 -- 172.21.15.112:0/502749105 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f39c804b720 con 0x7f39b406de30 2024-09-19T09:38:42.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.501+0000 7f39d00c2640 1 -- 172.21.15.112:0/502749105 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f39b406de30 msgr2=0x7f39b40702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.501+0000 7f39d00c2640 1 --2- 172.21.15.112:0/502749105 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f39b406de30 0x7f39b40702e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009ac0 tx=0x7f39c4035040 comp rx=0 tx=0).stop 2024-09-19T09:38:42.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.501+0000 7f39d00c2640 1 -- 172.21.15.112:0/502749105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102620 msgr2=0x7f39c80fc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.501+0000 7f39d00c2640 1 --2- 172.21.15.112:0/502749105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102620 0x7f39c80fc3a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f39b800b790 tx=0x7f39b80091d0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.501+0000 7f39d00c2640 1 -- 172.21.15.112:0/502749105 shutdown_connections 2024-09-19T09:38:42.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.501+0000 7f39d00c2640 1 --2- 172.21.15.112:0/502749105 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f39b406de30 0x7f39b40702e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.501+0000 7f39d00c2640 1 --2- 172.21.15.112:0/502749105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102620 0x7f39c80fc3a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.501+0000 7f39d00c2640 1 --2- 172.21.15.112:0/502749105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39c80fac80 0x7f39c80fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.501+0000 7f39d00c2640 1 -- 172.21.15.112:0/502749105 >> 172.21.15.112:0/502749105 conn(0x7f39c8070ce0 msgr2=0x7f39c8105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:42.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.501+0000 7f39d00c2640 1 -- 172.21.15.112:0/502749105 shutdown_connections 2024-09-19T09:38:42.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.501+0000 7f39d00c2640 1 -- 172.21.15.112:0/502749105 wait complete. 2024-09-19T09:38:42.511 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:38:42.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:42 smithi191 ceph-mon[34834]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:38:42.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:42 smithi191 ceph-mon[34834]: pgmap v60: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:42.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.589+0000 7f41bb970640 1 -- 172.21.15.112:0/3453435082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41b41014b0 msgr2=0x7f41b4101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.589+0000 7f41bb970640 1 --2- 172.21.15.112:0/3453435082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41b41014b0 0x7f41b4101880 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f41b00048d0 tx=0x7f41b0009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.589+0000 7f41bb970640 1 -- 172.21.15.112:0/3453435082 shutdown_connections 2024-09-19T09:38:42.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.589+0000 7f41bb970640 1 --2- 172.21.15.112:0/3453435082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41b40fb470 0x7f41b40fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.589+0000 7f41bb970640 1 --2- 172.21.15.112:0/3453435082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41b41014b0 0x7f41b4101880 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.589+0000 7f41bb970640 1 -- 172.21.15.112:0/3453435082 >> 172.21.15.112:0/3453435082 conn(0x7f41b40f6ff0 msgr2=0x7f41b40f9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:42.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.589+0000 7f41bb970640 1 -- 172.21.15.112:0/3453435082 shutdown_connections 2024-09-19T09:38:42.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.589+0000 7f41bb970640 1 -- 172.21.15.112:0/3453435082 wait complete. 2024-09-19T09:38:42.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.589+0000 7f41bb970640 1 Processor -- start 2024-09-19T09:38:42.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.589+0000 7f41bb970640 1 -- start start 2024-09-19T09:38:42.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41bb970640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41b40fb470 0x7f41b41131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41bb970640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41b41014b0 0x7f41b4113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41bb970640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b4113d00 con 0x7f41b41014b0 2024-09-19T09:38:42.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41bb970640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b410d140 con 0x7f41b40fb470 2024-09-19T09:38:42.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41b8f0b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41b41014b0 0x7f41b4113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41b8f0b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41b41014b0 0x7f41b4113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57618/0 (socket says 172.21.15.112:57618) 2024-09-19T09:38:42.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41b8f0b640 1 -- 172.21.15.112:0/3274920596 learned_addr learned my addr 172.21.15.112:0/3274920596 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:42.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41b970c640 1 --2- 172.21.15.112:0/3274920596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41b40fb470 0x7f41b41131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41b8f0b640 1 -- 172.21.15.112:0/3274920596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41b40fb470 msgr2=0x7f41b41131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41b8f0b640 1 --2- 172.21.15.112:0/3274920596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41b40fb470 0x7f41b41131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41b8f0b640 1 -- 172.21.15.112:0/3274920596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b0005040 con 0x7f41b41014b0 2024-09-19T09:38:42.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41b8f0b640 1 --2- 172.21.15.112:0/3274920596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41b41014b0 0x7f41b4113700 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f41a400c790 tx=0x7f41a40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:42.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41a9ffb640 1 -- 172.21.15.112:0/3274920596 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41a400a7a0 con 0x7f41b41014b0 2024-09-19T09:38:42.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41a9ffb640 1 -- 172.21.15.112:0/3274920596 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f41a400ada0 con 0x7f41b41014b0 2024-09-19T09:38:42.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41a9ffb640 1 -- 172.21.15.112:0/3274920596 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41a40113a0 con 0x7f41b41014b0 2024-09-19T09:38:42.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.590+0000 7f41bb970640 1 -- 172.21.15.112:0/3274920596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b410d420 con 0x7f41b41014b0 2024-09-19T09:38:42.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.591+0000 7f41bb970640 1 -- 172.21.15.112:0/3274920596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b410d9c0 con 0x7f41b41014b0 2024-09-19T09:38:42.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.591+0000 7f41bb970640 1 -- 172.21.15.112:0/3274920596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b40fcbb0 con 0x7f41b41014b0 2024-09-19T09:38:42.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.592+0000 7f41a9ffb640 1 -- 172.21.15.112:0/3274920596 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 34) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f41a400a900 con 0x7f41b41014b0 2024-09-19T09:38:42.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.592+0000 7f41a9ffb640 1 --2- 172.21.15.112:0/3274920596 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f41a006de30 0x7f41a00702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.592+0000 7f41a9ffb640 1 -- 172.21.15.112:0/3274920596 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f41a408d7a0 con 0x7f41b41014b0 2024-09-19T09:38:42.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.592+0000 7f41b970c640 1 --2- 172.21.15.112:0/3274920596 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f41a006de30 0x7f41a00702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.593+0000 7f41b970c640 1 --2- 172.21.15.112:0/3274920596 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f41a006de30 0x7f41a00702e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009ac0 tx=0x7f41b0035040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:42.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.597+0000 7f41a9ffb640 1 -- 172.21.15.112:0/3274920596 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f41a4057250 con 0x7f41b41014b0 2024-09-19T09:38:42.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.779+0000 7f41bb970640 1 -- 172.21.15.112:0/3274920596 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f41b4108450 con 0x7f41a006de30 2024-09-19T09:38:42.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.780+0000 7f41a9ffb640 1 -- 172.21.15.112:0/3274920596 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f41b4108450 con 0x7f41a006de30 2024-09-19T09:38:42.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.782+0000 7f41bb970640 1 -- 172.21.15.112:0/3274920596 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f41a006de30 msgr2=0x7f41a00702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.782+0000 7f41bb970640 1 --2- 172.21.15.112:0/3274920596 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f41a006de30 0x7f41a00702e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009ac0 tx=0x7f41b0035040 comp rx=0 tx=0).stop 2024-09-19T09:38:42.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.783+0000 7f41bb970640 1 -- 172.21.15.112:0/3274920596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41b41014b0 msgr2=0x7f41b4113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.783+0000 7f41bb970640 1 --2- 172.21.15.112:0/3274920596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41b41014b0 0x7f41b4113700 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f41a400c790 tx=0x7f41a40043c0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.783+0000 7f41bb970640 1 -- 172.21.15.112:0/3274920596 shutdown_connections 2024-09-19T09:38:42.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.783+0000 7f41bb970640 1 --2- 172.21.15.112:0/3274920596 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f41a006de30 0x7f41a00702e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.783+0000 7f41bb970640 1 --2- 172.21.15.112:0/3274920596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41b41014b0 0x7f41b4113700 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.783+0000 7f41bb970640 1 --2- 172.21.15.112:0/3274920596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41b40fb470 0x7f41b41131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.783+0000 7f41bb970640 1 -- 172.21.15.112:0/3274920596 >> 172.21.15.112:0/3274920596 conn(0x7f41b40f6ff0 msgr2=0x7f41b4065ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:42.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.783+0000 7f41bb970640 1 -- 172.21.15.112:0/3274920596 shutdown_connections 2024-09-19T09:38:42.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.783+0000 7f41bb970640 1 -- 172.21.15.112:0/3274920596 wait complete. 2024-09-19T09:38:42.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.861+0000 7f9c4e40b640 1 -- 172.21.15.112:0/1289094722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c480fac80 msgr2=0x7f9c480fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.861+0000 7f9c4e40b640 1 --2- 172.21.15.112:0/1289094722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c480fac80 0x7f9c480fb0f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0048d0 tx=0x7f9c3c009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.861+0000 7f9c4e40b640 1 -- 172.21.15.112:0/1289094722 shutdown_connections 2024-09-19T09:38:42.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.861+0000 7f9c4e40b640 1 --2- 172.21.15.112:0/1289094722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c480fac80 0x7f9c480fb0f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.861+0000 7f9c4e40b640 1 --2- 172.21.15.112:0/1289094722 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c48102620 0x7f9c481029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.861+0000 7f9c4e40b640 1 -- 172.21.15.112:0/1289094722 >> 172.21.15.112:0/1289094722 conn(0x7f9c48070ce0 msgr2=0x7f9c480710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:42.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.861+0000 7f9c4e40b640 1 -- 172.21.15.112:0/1289094722 shutdown_connections 2024-09-19T09:38:42.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.861+0000 7f9c4e40b640 1 -- 172.21.15.112:0/1289094722 wait complete. 2024-09-19T09:38:42.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.861+0000 7f9c4e40b640 1 Processor -- start 2024-09-19T09:38:42.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.862+0000 7f9c4e40b640 1 -- start start 2024-09-19T09:38:42.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.862+0000 7f9c4e40b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c480fac80 0x7f9c480fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.862+0000 7f9c4e40b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c48102620 0x7f9c480fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.862+0000 7f9c4e40b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480fc8e0 con 0x7f9c48102620 2024-09-19T09:38:42.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.862+0000 7f9c4e40b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480fca50 con 0x7f9c480fac80 2024-09-19T09:38:42.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.862+0000 7f9c477fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c48102620 0x7f9c480fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.862+0000 7f9c477fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c48102620 0x7f9c480fc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57644/0 (socket says 172.21.15.112:57644) 2024-09-19T09:38:42.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.862+0000 7f9c477fe640 1 -- 172.21.15.112:0/4170646624 learned_addr learned my addr 172.21.15.112:0/4170646624 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:42.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.862+0000 7f9c47fff640 1 --2- 172.21.15.112:0/4170646624 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c480fac80 0x7f9c480fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.862+0000 7f9c477fe640 1 -- 172.21.15.112:0/4170646624 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c480fac80 msgr2=0x7f9c480fbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.862+0000 7f9c477fe640 1 --2- 172.21.15.112:0/4170646624 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c480fac80 0x7f9c480fbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.862+0000 7f9c477fe640 1 -- 172.21.15.112:0/4170646624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c005040 con 0x7f9c48102620 2024-09-19T09:38:42.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.862+0000 7f9c47fff640 1 --2- 172.21.15.112:0/4170646624 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c480fac80 0x7f9c480fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:42.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.862+0000 7f9c477fe640 1 --2- 172.21.15.112:0/4170646624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c48102620 0x7f9c480fc3a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c000c00 tx=0x7f9c3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:42.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.863+0000 7f9c44ff9640 1 -- 172.21.15.112:0/4170646624 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c3c038070 con 0x7f9c48102620 2024-09-19T09:38:42.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.863+0000 7f9c4e40b640 1 -- 172.21.15.112:0/4170646624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c480fcc80 con 0x7f9c48102620 2024-09-19T09:38:42.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.863+0000 7f9c44ff9640 1 -- 172.21.15.112:0/4170646624 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9c3c02ade0 con 0x7f9c48102620 2024-09-19T09:38:42.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.863+0000 7f9c44ff9640 1 -- 172.21.15.112:0/4170646624 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c3c02c7e0 con 0x7f9c48102620 2024-09-19T09:38:42.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.863+0000 7f9c4e40b640 1 -- 172.21.15.112:0/4170646624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c48119860 con 0x7f9c48102620 2024-09-19T09:38:42.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.864+0000 7f9c4e40b640 1 -- 172.21.15.112:0/4170646624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c480657b0 con 0x7f9c48102620 2024-09-19T09:38:42.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.864+0000 7f9c44ff9640 1 -- 172.21.15.112:0/4170646624 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 34) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f9c3c030020 con 0x7f9c48102620 2024-09-19T09:38:42.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.865+0000 7f9c44ff9640 1 --2- 172.21.15.112:0/4170646624 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f9c3006de30 0x7f9c300702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.865+0000 7f9c44ff9640 1 -- 172.21.15.112:0/4170646624 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9c3c0ad3a0 con 0x7f9c48102620 2024-09-19T09:38:42.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.865+0000 7f9c47fff640 1 --2- 172.21.15.112:0/4170646624 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f9c3006de30 0x7f9c300702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.865+0000 7f9c47fff640 1 --2- 172.21.15.112:0/4170646624 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f9c3006de30 0x7f9c300702e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9c38007fd0 tx=0x7f9c38009e90 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:42.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:42.869+0000 7f9c44ff9640 1 -- 172.21.15.112:0/4170646624 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f9c3c076e60 con 0x7f9c48102620 2024-09-19T09:38:43.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.048+0000 7f9c4e40b640 1 -- 172.21.15.112:0/4170646624 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c4804b720 con 0x7f9c3006de30 2024-09-19T09:38:43.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.057+0000 7f9c44ff9640 1 -- 172.21.15.112:0/4170646624 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9c4804b720 con 0x7f9c3006de30 2024-09-19T09:38:43.058 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:38:43.058 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (2m) 66s ago 11m 28.2M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:38:43.059 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (11m) 66s ago 11m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1513f1075df5 2024-09-19T09:38:43.059 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (10m) 89s ago 10m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6c313b300b35 2024-09-19T09:38:43.059 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (72s) 66s ago 11m 45.6M - 9.4.12 2bacad6d85d8 e462aca2b022 2024-09-19T09:38:43.059 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (6m) 66s ago 6m 154M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:38:43.059 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (6m) 66s ago 6m 106M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:38:43.059 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (6m) 89s ago 6m 12.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:38:43.059 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (6m) 89s ago 6m 15.2M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:38:43.059 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (2m) 66s ago 12m 500M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:38:43.059 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283,8765 running (92s) 89s ago 10m 68.8M - 19.1.1-361-g2f599a46 d2baa855c067 fddba1bee64a 2024-09-19T09:38:43.059 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (12m) 66s ago 13m 55.6M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 34676d67b669 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (10m) 89s ago 10m 41.4M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 35690ef0929b 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (3m) 66s ago 11m 15.9M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (2m) 89s ago 10m 15.9M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (9m) 66s ago 9m 228M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 621693067dce 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (9m) 66s ago 9m 247M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1742e5964367 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (8m) 66s ago 8m 211M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 4dcca18af229 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (8m) 89s ago 8m 269M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (8m) 89s ago 8m 239M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (7m) 89s ago 7m 224M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (97s) 66s ago 11m 51.0M - 2.43.0 a07b618ecd1d 54850883a171 2024-09-19T09:38:43.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.059+0000 7f9c4e40b640 1 -- 172.21.15.112:0/4170646624 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f9c3006de30 msgr2=0x7f9c300702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.059+0000 7f9c4e40b640 1 --2- 172.21.15.112:0/4170646624 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f9c3006de30 0x7f9c300702e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9c38007fd0 tx=0x7f9c38009e90 comp rx=0 tx=0).stop 2024-09-19T09:38:43.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.059+0000 7f9c4e40b640 1 -- 172.21.15.112:0/4170646624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c48102620 msgr2=0x7f9c480fc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.059+0000 7f9c4e40b640 1 --2- 172.21.15.112:0/4170646624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c48102620 0x7f9c480fc3a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c000c00 tx=0x7f9c3c009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.059+0000 7f9c4e40b640 1 -- 172.21.15.112:0/4170646624 shutdown_connections 2024-09-19T09:38:43.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.059+0000 7f9c4e40b640 1 --2- 172.21.15.112:0/4170646624 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f9c3006de30 0x7f9c300702e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.059+0000 7f9c4e40b640 1 --2- 172.21.15.112:0/4170646624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c48102620 0x7f9c480fc3a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.059+0000 7f9c4e40b640 1 --2- 172.21.15.112:0/4170646624 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c480fac80 0x7f9c480fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.059+0000 7f9c4e40b640 1 -- 172.21.15.112:0/4170646624 >> 172.21.15.112:0/4170646624 conn(0x7f9c48070ce0 msgr2=0x7f9c48105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:43.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.059+0000 7f9c4e40b640 1 -- 172.21.15.112:0/4170646624 shutdown_connections 2024-09-19T09:38:43.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.059+0000 7f9c4e40b640 1 -- 172.21.15.112:0/4170646624 wait complete. 2024-09-19T09:38:43.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.137+0000 7f68726c8640 1 -- 172.21.15.112:0/2023272503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c0fcf80 msgr2=0x7f686c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.137+0000 7f68726c8640 1 --2- 172.21.15.112:0/2023272503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c0fcf80 0x7f686c0fd3d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f68540048d0 tx=0x7f6854009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.137+0000 7f68726c8640 1 -- 172.21.15.112:0/2023272503 shutdown_connections 2024-09-19T09:38:43.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.137+0000 7f68726c8640 1 --2- 172.21.15.112:0/2023272503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c0fcf80 0x7f686c0fd3d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.137+0000 7f68726c8640 1 --2- 172.21.15.112:0/2023272503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f686c0fb810 0x7f686c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.137+0000 7f68726c8640 1 -- 172.21.15.112:0/2023272503 >> 172.21.15.112:0/2023272503 conn(0x7f686c0723b0 msgr2=0x7f686c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:43.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.137+0000 7f68726c8640 1 -- 172.21.15.112:0/2023272503 shutdown_connections 2024-09-19T09:38:43.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.137+0000 7f68726c8640 1 -- 172.21.15.112:0/2023272503 wait complete. 2024-09-19T09:38:43.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.137+0000 7f68726c8640 1 Processor -- start 2024-09-19T09:38:43.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.138+0000 7f68726c8640 1 -- start start 2024-09-19T09:38:43.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.138+0000 7f68726c8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f686c0fb810 0x7f686c113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:43.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.138+0000 7f68726c8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c0fcf80 0x7f686c113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:43.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.138+0000 7f68726c8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c113d50 con 0x7f686c0fcf80 2024-09-19T09:38:43.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.138+0000 7f68726c8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c10d190 con 0x7f686c0fb810 2024-09-19T09:38:43.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.138+0000 7f686b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c0fcf80 0x7f686c113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:43.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.138+0000 7f686b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c0fcf80 0x7f686c113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57668/0 (socket says 172.21.15.112:57668) 2024-09-19T09:38:43.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.138+0000 7f686b7fe640 1 -- 172.21.15.112:0/1493120659 learned_addr learned my addr 172.21.15.112:0/1493120659 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:43.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.138+0000 7f686bfff640 1 --2- 172.21.15.112:0/1493120659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f686c0fb810 0x7f686c113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:43.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.138+0000 7f686b7fe640 1 -- 172.21.15.112:0/1493120659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f686c0fb810 msgr2=0x7f686c113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.138+0000 7f686b7fe640 1 --2- 172.21.15.112:0/1493120659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f686c0fb810 0x7f686c113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.138+0000 7f686b7fe640 1 -- 172.21.15.112:0/1493120659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854005040 con 0x7f686c0fcf80 2024-09-19T09:38:43.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.138+0000 7f686b7fe640 1 --2- 172.21.15.112:0/1493120659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c0fcf80 0x7f686c113750 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6854003080 tx=0x7f6854009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:43.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.139+0000 7f6868ff9640 1 -- 172.21.15.112:0/1493120659 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6854038070 con 0x7f686c0fcf80 2024-09-19T09:38:43.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.139+0000 7f6868ff9640 1 -- 172.21.15.112:0/1493120659 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f68540097e0 con 0x7f686c0fcf80 2024-09-19T09:38:43.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.139+0000 7f6868ff9640 1 -- 172.21.15.112:0/1493120659 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f685403d420 con 0x7f686c0fcf80 2024-09-19T09:38:43.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.139+0000 7f68726c8640 1 -- 172.21.15.112:0/1493120659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686c10d410 con 0x7f686c0fcf80 2024-09-19T09:38:43.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.139+0000 7f68726c8640 1 -- 172.21.15.112:0/1493120659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686c10d8d0 con 0x7f686c0fcf80 2024-09-19T09:38:43.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.140+0000 7f68726c8640 1 -- 172.21.15.112:0/1493120659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686c0fcbc0 con 0x7f686c0fcf80 2024-09-19T09:38:43.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.140+0000 7f6868ff9640 1 -- 172.21.15.112:0/1493120659 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 34) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f6854030020 con 0x7f686c0fcf80 2024-09-19T09:38:43.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.141+0000 7f6868ff9640 1 --2- 172.21.15.112:0/1493120659 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f685806de30 0x7f68580702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:43.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.141+0000 7f6868ff9640 1 -- 172.21.15.112:0/1493120659 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f68540adc90 con 0x7f686c0fcf80 2024-09-19T09:38:43.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.141+0000 7f686bfff640 1 --2- 172.21.15.112:0/1493120659 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f685806de30 0x7f68580702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:43.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.141+0000 7f686bfff640 1 --2- 172.21.15.112:0/1493120659 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f685806de30 0x7f68580702e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f685c004c40 tx=0x7f685c009040 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:43.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.145+0000 7f6868ff9640 1 -- 172.21.15.112:0/1493120659 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f68540776a0 con 0x7f686c0fcf80 2024-09-19T09:38:43.347 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:43 smithi112 ceph-mon[27605]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:43.347 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:43 smithi112 ceph-mon[27605]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:43.347 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:43 smithi112 ceph-mon[27605]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:43.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.382+0000 7f68726c8640 1 -- 172.21.15.112:0/1493120659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f686c10e880 con 0x7f686c0fcf80 2024-09-19T09:38:43.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.384+0000 7f6868ff9640 1 -- 172.21.15.112:0/1493120659 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f685407ad60 con 0x7f686c0fcf80 2024-09-19T09:38:43.386 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:38:43.386 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:38:43.386 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T09:38:43.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:38:43.386 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:38:43.386 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:38:43.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:38:43.386 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:38:43.386 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T09:38:43.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:38:43.387 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:38:43.387 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:38:43.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:38:43.387 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:38:43.387 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 12, 2024-09-19T09:38:43.387 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:38:43.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:38:43.387 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:38:43.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.387+0000 7f68726c8640 1 -- 172.21.15.112:0/1493120659 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f685806de30 msgr2=0x7f68580702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.387+0000 7f68726c8640 1 --2- 172.21.15.112:0/1493120659 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f685806de30 0x7f68580702e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f685c004c40 tx=0x7f685c009040 comp rx=0 tx=0).stop 2024-09-19T09:38:43.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.387+0000 7f68726c8640 1 -- 172.21.15.112:0/1493120659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c0fcf80 msgr2=0x7f686c113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.387+0000 7f68726c8640 1 --2- 172.21.15.112:0/1493120659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c0fcf80 0x7f686c113750 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6854003080 tx=0x7f6854009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.387+0000 7f68726c8640 1 -- 172.21.15.112:0/1493120659 shutdown_connections 2024-09-19T09:38:43.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.387+0000 7f68726c8640 1 --2- 172.21.15.112:0/1493120659 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f685806de30 0x7f68580702e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.387+0000 7f68726c8640 1 --2- 172.21.15.112:0/1493120659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c0fcf80 0x7f686c113750 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.387+0000 7f68726c8640 1 --2- 172.21.15.112:0/1493120659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f686c0fb810 0x7f686c113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.387+0000 7f68726c8640 1 -- 172.21.15.112:0/1493120659 >> 172.21.15.112:0/1493120659 conn(0x7f686c0723b0 msgr2=0x7f686c0fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:43.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.387+0000 7f68726c8640 1 -- 172.21.15.112:0/1493120659 shutdown_connections 2024-09-19T09:38:43.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.387+0000 7f68726c8640 1 -- 172.21.15.112:0/1493120659 wait complete. 2024-09-19T09:38:43.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.468+0000 7f323bbcd640 1 -- 172.21.15.112:0/3293996661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3234065300 msgr2=0x7f32340656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.468+0000 7f323bbcd640 1 --2- 172.21.15.112:0/3293996661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3234065300 0x7f32340656d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3224004810 tx=0x7f3224009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.468+0000 7f323bbcd640 1 -- 172.21.15.112:0/3293996661 shutdown_connections 2024-09-19T09:38:43.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.468+0000 7f323bbcd640 1 --2- 172.21.15.112:0/3293996661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3234065c10 0x7f32340fe0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.468+0000 7f323bbcd640 1 --2- 172.21.15.112:0/3293996661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3234065300 0x7f32340656d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.468+0000 7f323bbcd640 1 -- 172.21.15.112:0/3293996661 >> 172.21.15.112:0/3293996661 conn(0x7f32340723b0 msgr2=0x7f32340727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:43.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.469+0000 7f323bbcd640 1 -- 172.21.15.112:0/3293996661 shutdown_connections 2024-09-19T09:38:43.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.469+0000 7f323bbcd640 1 -- 172.21.15.112:0/3293996661 wait complete. 2024-09-19T09:38:43.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.469+0000 7f323bbcd640 1 Processor -- start 2024-09-19T09:38:43.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.469+0000 7f323bbcd640 1 -- start start 2024-09-19T09:38:43.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.469+0000 7f323bbcd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3234065300 0x7f32341131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:43.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.469+0000 7f323bbcd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3234065c10 0x7f3234113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:43.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.469+0000 7f323bbcd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3234113d10 con 0x7f3234065c10 2024-09-19T09:38:43.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.469+0000 7f323bbcd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323410d150 con 0x7f3234065300 2024-09-19T09:38:43.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.469+0000 7f3239168640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3234065c10 0x7f3234113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:43.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.469+0000 7f3239168640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3234065c10 0x7f3234113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57682/0 (socket says 172.21.15.112:57682) 2024-09-19T09:38:43.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.469+0000 7f3239168640 1 -- 172.21.15.112:0/2838645580 learned_addr learned my addr 172.21.15.112:0/2838645580 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:43.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.470+0000 7f3239969640 1 --2- 172.21.15.112:0/2838645580 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3234065300 0x7f32341131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:43.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.470+0000 7f3239168640 1 -- 172.21.15.112:0/2838645580 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3234065300 msgr2=0x7f32341131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.470+0000 7f3239168640 1 --2- 172.21.15.112:0/2838645580 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3234065300 0x7f32341131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.470+0000 7f3239168640 1 -- 172.21.15.112:0/2838645580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3224005040 con 0x7f3234065c10 2024-09-19T09:38:43.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.470+0000 7f3239168640 1 --2- 172.21.15.112:0/2838645580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3234065c10 0x7f3234113710 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f323000eb40 tx=0x7f323000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:43.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.470+0000 7f322a7fc640 1 -- 172.21.15.112:0/2838645580 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3230007c30 con 0x7f3234065c10 2024-09-19T09:38:43.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.470+0000 7f322a7fc640 1 -- 172.21.15.112:0/2838645580 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f323000f040 con 0x7f3234065c10 2024-09-19T09:38:43.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.470+0000 7f323bbcd640 1 -- 172.21.15.112:0/2838645580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323410d3d0 con 0x7f3234065c10 2024-09-19T09:38:43.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.470+0000 7f322a7fc640 1 -- 172.21.15.112:0/2838645580 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3230009550 con 0x7f3234065c10 2024-09-19T09:38:43.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.470+0000 7f323bbcd640 1 -- 172.21.15.112:0/2838645580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323410d970 con 0x7f3234065c10 2024-09-19T09:38:43.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.471+0000 7f323bbcd640 1 -- 172.21.15.112:0/2838645580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32340fdce0 con 0x7f3234065c10 2024-09-19T09:38:43.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.472+0000 7f322a7fc640 1 -- 172.21.15.112:0/2838645580 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 34) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f32300096f0 con 0x7f3234065c10 2024-09-19T09:38:43.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.472+0000 7f322a7fc640 1 --2- 172.21.15.112:0/2838645580 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f322006de30 0x7f32200702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:43.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.472+0000 7f322a7fc640 1 -- 172.21.15.112:0/2838645580 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f323008d610 con 0x7f3234065c10 2024-09-19T09:38:43.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.472+0000 7f3239969640 1 --2- 172.21.15.112:0/2838645580 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f322006de30 0x7f32200702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:43.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.473+0000 7f3239969640 1 --2- 172.21.15.112:0/2838645580 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f322006de30 0x7f32200702e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3224009ac0 tx=0x7f3224009da0 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:43.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.476+0000 7f322a7fc640 1 -- 172.21.15.112:0/2838645580 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f3230056fa0 con 0x7f3234065c10 2024-09-19T09:38:43.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:43 smithi191 ceph-mon[34834]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:43.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:43 smithi191 ceph-mon[34834]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:43.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:43 smithi191 ceph-mon[34834]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:43.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.701+0000 7f323bbcd640 1 -- 172.21.15.112:0/2838645580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f323410e840 con 0x7f3234065c10 2024-09-19T09:38:43.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.701+0000 7f322a7fc640 1 -- 172.21.15.112:0/2838645580 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f323005a660 con 0x7f3234065c10 2024-09-19T09:38:43.703 INFO:teuthology.orchestra.run.smithi112.stdout:e17 2024-09-19T09:38:43.703 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:38:43.703 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:38:43.704 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-19T09:38:43.704 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:38:43.704 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:38:43.704 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-19T09:38:43.704 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 17 2024-09-19T09:38:43.704 INFO:teuthology.orchestra.run.smithi112.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:38:43.704 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:38:43.704 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-19T09:32:42.200999+0000 2024-09-19T09:38:43.704 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-19T09:38:43.704 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-19T09:38:43.704 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-19T09:38:43.704 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-19T09:38:43.704 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-19T09:38:43.704 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-19T09:38:43.705 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-19T09:38:43.705 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 45 2024-09-19T09:38:43.705 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:38:43.705 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-19T09:38:43.705 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-19T09:38:43.705 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14460} 2024-09-19T09:38:43.705 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-19T09:38:43.705 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-19T09:38:43.705 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-19T09:38:43.705 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-19T09:38:43.705 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-19T09:38:43.705 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data disabled 2024-09-19T09:38:43.705 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-19T09:38:43.705 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-19T09:38:43.706 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.hcoxjz{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:38:43.706 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ymjyok{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/3468750429,v1:172.21.15.112:6827/3468750429] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:38:43.706 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:38:43.706 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:38:43.706 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-19T09:38:43.706 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:38:43.706 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.qweljt{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:38:43.706 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.jjldod{-1:24281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6824/2759077122,v1:172.21.15.191:6825/2759077122] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:38:43.707 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2024-09-19T09:38:43.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.704+0000 7f323bbcd640 1 -- 172.21.15.112:0/2838645580 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f322006de30 msgr2=0x7f32200702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.704+0000 7f323bbcd640 1 --2- 172.21.15.112:0/2838645580 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f322006de30 0x7f32200702e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3224009ac0 tx=0x7f3224009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.704+0000 7f323bbcd640 1 -- 172.21.15.112:0/2838645580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3234065c10 msgr2=0x7f3234113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.704+0000 7f323bbcd640 1 --2- 172.21.15.112:0/2838645580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3234065c10 0x7f3234113710 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f323000eb40 tx=0x7f323000b040 comp rx=0 tx=0).stop 2024-09-19T09:38:43.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.704+0000 7f323bbcd640 1 -- 172.21.15.112:0/2838645580 shutdown_connections 2024-09-19T09:38:43.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.704+0000 7f323bbcd640 1 --2- 172.21.15.112:0/2838645580 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f322006de30 0x7f32200702e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.704+0000 7f323bbcd640 1 --2- 172.21.15.112:0/2838645580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3234065c10 0x7f3234113710 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.704+0000 7f323bbcd640 1 --2- 172.21.15.112:0/2838645580 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3234065300 0x7f32341131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.704+0000 7f323bbcd640 1 -- 172.21.15.112:0/2838645580 >> 172.21.15.112:0/2838645580 conn(0x7f32340723b0 msgr2=0x7f3234105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:43.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.704+0000 7f323bbcd640 1 -- 172.21.15.112:0/2838645580 shutdown_connections 2024-09-19T09:38:43.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.704+0000 7f323bbcd640 1 -- 172.21.15.112:0/2838645580 wait complete. 2024-09-19T09:38:43.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.784+0000 7fd492b7a640 1 -- 172.21.15.112:0/1503815891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0fcf80 msgr2=0x7fd48c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.784+0000 7fd492b7a640 1 --2- 172.21.15.112:0/1503815891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0fcf80 0x7fd48c0fd3d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009c50 tx=0x7fd47c004d10 comp rx=0 tx=0).stop 2024-09-19T09:38:43.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.784+0000 7fd492b7a640 1 -- 172.21.15.112:0/1503815891 shutdown_connections 2024-09-19T09:38:43.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.784+0000 7fd492b7a640 1 --2- 172.21.15.112:0/1503815891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0fcf80 0x7fd48c0fd3d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.784+0000 7fd492b7a640 1 --2- 172.21.15.112:0/1503815891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd48c0fb810 0x7fd48c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.784+0000 7fd492b7a640 1 -- 172.21.15.112:0/1503815891 >> 172.21.15.112:0/1503815891 conn(0x7fd48c0723b0 msgr2=0x7fd48c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:43.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.784+0000 7fd492b7a640 1 -- 172.21.15.112:0/1503815891 shutdown_connections 2024-09-19T09:38:43.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.784+0000 7fd492b7a640 1 -- 172.21.15.112:0/1503815891 wait complete. 2024-09-19T09:38:43.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.785+0000 7fd492b7a640 1 Processor -- start 2024-09-19T09:38:43.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.785+0000 7fd492b7a640 1 -- start start 2024-09-19T09:38:43.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.785+0000 7fd492b7a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0fb810 0x7fd48c10e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:43.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.785+0000 7fd492b7a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd48c0fcf80 0x7fd48c10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:43.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.785+0000 7fd492b7a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c10ed20 con 0x7fd48c0fb810 2024-09-19T09:38:43.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.785+0000 7fd492b7a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c10ee90 con 0x7fd48c0fcf80 2024-09-19T09:38:43.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.785+0000 7fd490916640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0fb810 0x7fd48c10e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:43.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.785+0000 7fd490916640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0fb810 0x7fd48c10e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57700/0 (socket says 172.21.15.112:57700) 2024-09-19T09:38:43.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.785+0000 7fd490916640 1 -- 172.21.15.112:0/2855842565 learned_addr learned my addr 172.21.15.112:0/2855842565 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:43.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.785+0000 7fd48bfff640 1 --2- 172.21.15.112:0/2855842565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd48c0fcf80 0x7fd48c10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:43.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.785+0000 7fd490916640 1 -- 172.21.15.112:0/2855842565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd48c0fcf80 msgr2=0x7fd48c10e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.785+0000 7fd490916640 1 --2- 172.21.15.112:0/2855842565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd48c0fcf80 0x7fd48c10e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.785+0000 7fd490916640 1 -- 172.21.15.112:0/2855842565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c0098b0 con 0x7fd48c0fb810 2024-09-19T09:38:43.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.786+0000 7fd490916640 1 --2- 172.21.15.112:0/2855842565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0fb810 0x7fd48c10e190 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd48400c790 tx=0x7fd4840043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:43.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.786+0000 7fd4897fa640 1 -- 172.21.15.112:0/2855842565 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd48400a820 con 0x7fd48c0fb810 2024-09-19T09:38:43.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.786+0000 7fd4897fa640 1 -- 172.21.15.112:0/2855842565 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd48400ae20 con 0x7fd48c0fb810 2024-09-19T09:38:43.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.786+0000 7fd4897fa640 1 -- 172.21.15.112:0/2855842565 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4840113a0 con 0x7fd48c0fb810 2024-09-19T09:38:43.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.786+0000 7fd492b7a640 1 -- 172.21.15.112:0/2855842565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48c117200 con 0x7fd48c0fb810 2024-09-19T09:38:43.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.786+0000 7fd492b7a640 1 -- 172.21.15.112:0/2855842565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48c117710 con 0x7fd48c0fb810 2024-09-19T09:38:43.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.787+0000 7fd492b7a640 1 -- 172.21.15.112:0/2855842565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48c0fcbc0 con 0x7fd48c0fb810 2024-09-19T09:38:43.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.787+0000 7fd4897fa640 1 -- 172.21.15.112:0/2855842565 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 34) v1 ==== 92275+0+0 (secure 0 0 0) 0x7fd484012400 con 0x7fd48c0fb810 2024-09-19T09:38:43.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.788+0000 7fd4897fa640 1 --2- 172.21.15.112:0/2855842565 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fd47806de30 0x7fd4780702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:43.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.788+0000 7fd4897fa640 1 -- 172.21.15.112:0/2855842565 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd48408d870 con 0x7fd48c0fb810 2024-09-19T09:38:43.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.788+0000 7fd48bfff640 1 --2- 172.21.15.112:0/2855842565 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fd47806de30 0x7fd4780702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:43.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.788+0000 7fd48bfff640 1 --2- 172.21.15.112:0/2855842565 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fd47806de30 0x7fd4780702e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd48c065980 tx=0x7fd47c004d10 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:43.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.792+0000 7fd4897fa640 1 -- 172.21.15.112:0/2855842565 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fd484057320 con 0x7fd48c0fb810 2024-09-19T09:38:43.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.982+0000 7fd492b7a640 1 -- 172.21.15.112:0/2855842565 --> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd48c065730 con 0x7fd47806de30 2024-09-19T09:38:43.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.983+0000 7fd4897fa640 1 -- 172.21.15.112:0/2855842565 <== mgr.14650 v2:172.21.15.112:6800/18888963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd48c065730 con 0x7fd47806de30 2024-09-19T09:38:43.985 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:38:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:38:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:38:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:38:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-19T09:38:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr" 2024-09-19T09:38:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-19T09:38:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "2/21 daemons upgraded", 2024-09-19T09:38:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading mon daemons", 2024-09-19T09:38:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:38:43.986 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:38:43.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.985+0000 7fd492b7a640 1 -- 172.21.15.112:0/2855842565 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fd47806de30 msgr2=0x7fd4780702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.985+0000 7fd492b7a640 1 --2- 172.21.15.112:0/2855842565 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fd47806de30 0x7fd4780702e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd48c065980 tx=0x7fd47c004d10 comp rx=0 tx=0).stop 2024-09-19T09:38:43.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.985+0000 7fd492b7a640 1 -- 172.21.15.112:0/2855842565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0fb810 msgr2=0x7fd48c10e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.985+0000 7fd492b7a640 1 --2- 172.21.15.112:0/2855842565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0fb810 0x7fd48c10e190 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd48400c790 tx=0x7fd4840043c0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.985+0000 7fd492b7a640 1 -- 172.21.15.112:0/2855842565 shutdown_connections 2024-09-19T09:38:43.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.985+0000 7fd492b7a640 1 --2- 172.21.15.112:0/2855842565 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7fd47806de30 0x7fd4780702e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.985+0000 7fd492b7a640 1 --2- 172.21.15.112:0/2855842565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd48c0fcf80 0x7fd48c10e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.985+0000 7fd492b7a640 1 --2- 172.21.15.112:0/2855842565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0fb810 0x7fd48c10e190 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.985+0000 7fd492b7a640 1 -- 172.21.15.112:0/2855842565 >> 172.21.15.112:0/2855842565 conn(0x7fd48c0723b0 msgr2=0x7fd48c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:43.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.985+0000 7fd492b7a640 1 -- 172.21.15.112:0/2855842565 shutdown_connections 2024-09-19T09:38:43.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:43.985+0000 7fd492b7a640 1 -- 172.21.15.112:0/2855842565 wait complete. 2024-09-19T09:38:44.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.067+0000 7f6379cbf640 1 -- 172.21.15.112:0/1306820687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63740fb810 msgr2=0x7f63740fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.067+0000 7f6379cbf640 1 --2- 172.21.15.112:0/1306820687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63740fb810 0x7f63740fbbe0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f63640048d0 tx=0x7f6364009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.067+0000 7f6379cbf640 1 -- 172.21.15.112:0/1306820687 shutdown_connections 2024-09-19T09:38:44.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.067+0000 7f6379cbf640 1 --2- 172.21.15.112:0/1306820687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63740fcf80 0x7f63740fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.067+0000 7f6379cbf640 1 --2- 172.21.15.112:0/1306820687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63740fb810 0x7f63740fbbe0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.067+0000 7f6379cbf640 1 -- 172.21.15.112:0/1306820687 >> 172.21.15.112:0/1306820687 conn(0x7f63740723b0 msgr2=0x7f63740727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:44.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.067+0000 7f6379cbf640 1 -- 172.21.15.112:0/1306820687 shutdown_connections 2024-09-19T09:38:44.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.067+0000 7f6379cbf640 1 -- 172.21.15.112:0/1306820687 wait complete. 2024-09-19T09:38:44.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.068+0000 7f6379cbf640 1 Processor -- start 2024-09-19T09:38:44.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.068+0000 7f6379cbf640 1 -- start start 2024-09-19T09:38:44.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.068+0000 7f6379cbf640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63740fb810 0x7f637410e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.068+0000 7f6379cbf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63740fcf80 0x7f637410e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.068+0000 7f6379cbf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637410ecd0 con 0x7f63740fcf80 2024-09-19T09:38:44.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.068+0000 7f6379cbf640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637410ee40 con 0x7f63740fb810 2024-09-19T09:38:44.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.068+0000 7f6372ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63740fcf80 0x7f637410e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.068+0000 7f6372ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63740fcf80 0x7f637410e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57712/0 (socket says 172.21.15.112:57712) 2024-09-19T09:38:44.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.068+0000 7f6372ffd640 1 -- 172.21.15.112:0/1970723929 learned_addr learned my addr 172.21.15.112:0/1970723929 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:38:44.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.069+0000 7f63737fe640 1 --2- 172.21.15.112:0/1970723929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63740fb810 0x7f637410e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.069+0000 7f6372ffd640 1 -- 172.21.15.112:0/1970723929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63740fb810 msgr2=0x7f637410e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.069+0000 7f6372ffd640 1 --2- 172.21.15.112:0/1970723929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63740fb810 0x7f637410e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.069+0000 7f6372ffd640 1 -- 172.21.15.112:0/1970723929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6364005040 con 0x7f63740fcf80 2024-09-19T09:38:44.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.069+0000 7f6372ffd640 1 --2- 172.21.15.112:0/1970723929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63740fcf80 0x7f637410e6d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6368002a50 tx=0x7f6368004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:44.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.069+0000 7f635bfff640 1 -- 172.21.15.112:0/1970723929 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6368007c30 con 0x7f63740fcf80 2024-09-19T09:38:44.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.069+0000 7f635bfff640 1 -- 172.21.15.112:0/1970723929 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f636800f040 con 0x7f63740fcf80 2024-09-19T09:38:44.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.069+0000 7f635bfff640 1 -- 172.21.15.112:0/1970723929 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f636800da90 con 0x7f63740fcf80 2024-09-19T09:38:44.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.069+0000 7f6379cbf640 1 -- 172.21.15.112:0/1970723929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6374117200 con 0x7f63740fcf80 2024-09-19T09:38:44.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.069+0000 7f6379cbf640 1 -- 172.21.15.112:0/1970723929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6374117740 con 0x7f63740fcf80 2024-09-19T09:38:44.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.070+0000 7f6379cbf640 1 -- 172.21.15.112:0/1970723929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63740fcbc0 con 0x7f63740fcf80 2024-09-19T09:38:44.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.071+0000 7f635bfff640 1 -- 172.21.15.112:0/1970723929 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 34) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f636800dd00 con 0x7f63740fcf80 2024-09-19T09:38:44.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.071+0000 7f635bfff640 1 --2- 172.21.15.112:0/1970723929 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f635c06de30 0x7f635c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.071+0000 7f635bfff640 1 -- 172.21.15.112:0/1970723929 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f636808d0c0 con 0x7f63740fcf80 2024-09-19T09:38:44.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.071+0000 7f63737fe640 1 --2- 172.21.15.112:0/1970723929 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f635c06de30 0x7f635c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.072+0000 7f63737fe640 1 --2- 172.21.15.112:0/1970723929 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f635c06de30 0x7f635c0702e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6364004540 tx=0x7f6364009da0 comp rx=0 tx=0).ready entity=mgr.14650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:44.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.076+0000 7f635bfff640 1 -- 172.21.15.112:0/1970723929 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f6368056a50 con 0x7f63740fcf80 2024-09-19T09:38:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.315+0000 7f6379cbf640 1 -- 172.21.15.112:0/1970723929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6374072ec0 con 0x7f63740fcf80 2024-09-19T09:38:44.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.315+0000 7f635bfff640 1 -- 172.21.15.112:0/1970723929 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6374072ec0 con 0x7f63740fcf80 2024-09-19T09:38:44.317 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_OK 2024-09-19T09:38:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.317+0000 7f6379cbf640 1 -- 172.21.15.112:0/1970723929 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f635c06de30 msgr2=0x7f635c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.317+0000 7f6379cbf640 1 --2- 172.21.15.112:0/1970723929 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f635c06de30 0x7f635c0702e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6364004540 tx=0x7f6364009da0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.317+0000 7f6379cbf640 1 -- 172.21.15.112:0/1970723929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63740fcf80 msgr2=0x7f637410e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.317+0000 7f6379cbf640 1 --2- 172.21.15.112:0/1970723929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63740fcf80 0x7f637410e6d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6368002a50 tx=0x7f6368004600 comp rx=0 tx=0).stop 2024-09-19T09:38:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.317+0000 7f6379cbf640 1 -- 172.21.15.112:0/1970723929 shutdown_connections 2024-09-19T09:38:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.317+0000 7f6379cbf640 1 --2- 172.21.15.112:0/1970723929 >> [v2:172.21.15.112:6800/18888963,v1:172.21.15.112:6801/18888963] conn(0x7f635c06de30 0x7f635c0702e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.317+0000 7f6379cbf640 1 --2- 172.21.15.112:0/1970723929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63740fcf80 0x7f637410e6d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.317+0000 7f6379cbf640 1 --2- 172.21.15.112:0/1970723929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63740fb810 0x7f637410e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.317+0000 7f6379cbf640 1 -- 172.21.15.112:0/1970723929 >> 172.21.15.112:0/1970723929 conn(0x7f63740723b0 msgr2=0x7f63740fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.317+0000 7f6379cbf640 1 -- 172.21.15.112:0/1970723929 shutdown_connections 2024-09-19T09:38:44.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:38:44.317+0000 7f6379cbf640 1 -- 172.21.15.112:0/1970723929 wait complete. 2024-09-19T09:38:44.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:44 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:44.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:44 smithi112 ceph-mon[27605]: Upgrade: Target is version 19.1.1-361-g2f599a46 (squid) 2024-09-19T09:38:44.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:44 smithi112 ceph-mon[27605]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e'] 2024-09-19T09:38:44.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:44 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:44.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:44 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:38:44.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:44 smithi112 ceph-mon[27605]: Upgrade: Setting container_image for all mgr 2024-09-19T09:38:44.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:44 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:44.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:44 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1493120659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:38:44.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:44 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-19T09:38:44.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:44 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/2838645580' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:38:44.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:44 smithi112 ceph-mon[27605]: pgmap v61: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:44.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:44 smithi112 ceph-mon[27605]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:44.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:44 smithi112 ceph-mon[27605]: from='client.? 172.21.15.112:0/1970723929' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:38:44.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:44 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:44.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:44 smithi191 ceph-mon[34834]: Upgrade: Target is version 19.1.1-361-g2f599a46 (squid) 2024-09-19T09:38:44.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:44 smithi191 ceph-mon[34834]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e'] 2024-09-19T09:38:44.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:44 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:44.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:44 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:38:44.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:44 smithi191 ceph-mon[34834]: Upgrade: Setting container_image for all mgr 2024-09-19T09:38:44.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:44 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:44.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:44 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/1493120659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:38:44.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:44 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-19T09:38:44.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:44 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/2838645580' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:38:44.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:44 smithi191 ceph-mon[34834]: pgmap v61: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:44.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:44 smithi191 ceph-mon[34834]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:44.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:44 smithi191 ceph-mon[34834]: from='client.? 172.21.15.112:0/1970723929' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:38:46.180 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:45 smithi112 ceph-mon[27605]: Upgrade: Updating mon.smithi112 2024-09-19T09:38:46.180 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:45 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:46.180 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:45 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:38:46.180 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:45 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:38:46.180 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:45 smithi112 ceph-mon[27605]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:38:46.180 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:45 smithi112 ceph-mon[27605]: Deploying daemon mon.smithi112 on smithi112 2024-09-19T09:38:46.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:45 smithi191 ceph-mon[34834]: Upgrade: Updating mon.smithi112 2024-09-19T09:38:46.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:45 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:46.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:45 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:38:46.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:45 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:38:46.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:45 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:38:46.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:45 smithi191 ceph-mon[34834]: Deploying daemon mon.smithi112 on smithi112 2024-09-19T09:38:46.743 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:46 smithi112 systemd[1]: Stopping Ceph mon.smithi112 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:38:47.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:46 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112[27601]: 2024-09-19T09:38:46.740+0000 7f52a91a4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi112 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:38:47.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:46 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112[27601]: 2024-09-19T09:38:46.740+0000 7f52a91a4640 -1 mon.smithi112@0(leader) e2 *** Got Signal Terminated *** 2024-09-19T09:38:47.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:46 smithi112 podman[97332]: 2024-09-19 09:38:46.986043359 +0000 UTC m=+0.357746516 container died 34676d67b66963873ddcd2d625151939d68061f559889773357b7fce288664bf (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=quincy-6e06d1e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:38:47.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:47 smithi112 podman[97332]: 2024-09-19 09:38:47.391263976 +0000 UTC m=+0.762967121 container cleanup 34676d67b66963873ddcd2d625151939d68061f559889773357b7fce288664bf (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=quincy-6e06d1e, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:38:47.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:47 smithi112 bash[97332]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112 2024-09-19T09:38:47.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:47 smithi112 podman[97344]: 2024-09-19 09:38:47.642815784 +0000 UTC m=+0.659346235 container remove 34676d67b66963873ddcd2d625151939d68061f559889773357b7fce288664bf (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=quincy-6e06d1e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:38:47.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:47 smithi112 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mon.smithi112.service: Deactivated successfully. 2024-09-19T09:38:47.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:47 smithi112 systemd[1]: Stopped Ceph mon.smithi112 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:38:47.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:47 smithi112 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mon.smithi112.service: Consumed 11.227s CPU time. 2024-09-19T09:38:48.363 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 systemd[1]: Starting Ceph mon.smithi112 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:38:48.364 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 podman[97484]: 2024-09-19 09:38:48.137885635 +0000 UTC m=+0.015778031 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:38:48.364 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 podman[97484]: 2024-09-19 09:38:48.252691628 +0000 UTC m=+0.130584056 container create 89dfb5de44c8cedd0254cfb7e803411b4536f0d7b4eff349aedafee6b98656e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T09:38:48.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 podman[97484]: 2024-09-19 09:38:48.496876821 +0000 UTC m=+0.374769208 container init 89dfb5de44c8cedd0254cfb7e803411b4536f0d7b4eff349aedafee6b98656e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:38:48.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 podman[97484]: 2024-09-19 09:38:48.499959353 +0000 UTC m=+0.377851736 container start 89dfb5de44c8cedd0254cfb7e803411b4536f0d7b4eff349aedafee6b98656e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T09:38:48.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T09:38:48.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T09:38:48.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: pidfile_write: ignore empty --pid-file 2024-09-19T09:38:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: load: jerasure load: lrc 2024-09-19T09:38:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: RocksDB version: 7.9.2 2024-09-19T09:38:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Git sha 0 2024-09-19T09:38:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T09:38:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: DB SUMMARY 2024-09-19T09:38:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: DB Session ID: YOVJLWWDDYM8L83XW191 2024-09-19T09:38:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: CURRENT file: CURRENT 2024-09-19T09:38:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T09:38:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1159 Bytes 2024-09-19T09:38:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi112/store.db dir, Total Num: 1, files: 000033.sst 2024-09-19T09:38:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi112/store.db: 000031.log size: 599682 ; 2024-09-19T09:38:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.error_if_exists: 0 2024-09-19T09:38:48.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.create_if_missing: 0 2024-09-19T09:38:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.paranoid_checks: 1 2024-09-19T09:38:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T09:38:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T09:38:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T09:38:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.env: 0x55a46161a940 2024-09-19T09:38:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T09:38:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.info_log: 0x55a4631558c0 2024-09-19T09:38:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T09:38:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.statistics: (nil) 2024-09-19T09:38:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.use_fsync: 0 2024-09-19T09:38:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_log_file_size: 0 2024-09-19T09:38:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T09:38:48.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T09:38:48.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T09:38:48.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T09:38:48.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.allow_fallocate: 1 2024-09-19T09:38:48.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T09:38:48.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T09:38:48.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.use_direct_reads: 0 2024-09-19T09:38:48.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T09:38:48.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T09:38:48.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.db_log_dir: 2024-09-19T09:38:48.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.wal_dir: 2024-09-19T09:38:48.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T09:38:48.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T09:38:48.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T09:38:48.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.write_buffer_manager: 0x55a463164dc0 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.unordered_write: 0 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T09:38:48.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T09:38:48.944 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T09:38:48.944 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T09:38:48.944 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.row_cache: None 2024-09-19T09:38:48.944 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.wal_filter: None 2024-09-19T09:38:48.948 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T09:38:48.948 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T09:38:48.948 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.two_write_queues: 0 2024-09-19T09:38:48.948 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T09:38:48.948 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.wal_compression: 0 2024-09-19T09:38:48.948 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.atomic_flush: 0 2024-09-19T09:38:48.948 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T09:38:48.948 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T09:38:48.948 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T09:38:48.949 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.log_readahead_size: 0 2024-09-19T09:38:48.949 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T09:38:48.949 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T09:38:48.949 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T09:38:48.949 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T09:38:48.949 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T09:38:48.949 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T09:38:48.949 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T09:38:48.949 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_background_jobs: 2 2024-09-19T09:38:48.949 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_background_compactions: -1 2024-09-19T09:38:48.949 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_subcompactions: 1 2024-09-19T09:38:48.949 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T09:38:48.949 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T09:38:48.949 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_open_files: -1 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_background_flushes: -1 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Compression algorithms supported: 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: kZSTD supported: 0 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: kXpressCompression supported: 0 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: kBZip2Compression supported: 0 2024-09-19T09:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: kLZ4Compression supported: 1 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: kZlibCompression supported: 1 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: kSnappyCompression supported: 1 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000015 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.merge_operator: 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compaction_filter: None 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T09:38:48.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a463155520) 2024-09-19T09:38:48.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks: 1 2024-09-19T09:38:48.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T09:38:48.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T09:38:48.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_top_level_index_and_filter: 1 2024-09-19T09:38:48.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_type: 0 2024-09-19T09:38:48.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_index_type: 0 2024-09-19T09:38:48.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_shortening: 1 2024-09-19T09:38:48.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T09:38:48.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: checksum: 4 2024-09-19T09:38:48.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: no_block_cache: 0 2024-09-19T09:38:48.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache: 0x55a4631491f0 2024-09-19T09:38:48.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_name: BinnedLRUCache 2024-09-19T09:38:48.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_options: 2024-09-19T09:38:48.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: capacity : 536870912 2024-09-19T09:38:48.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: num_shard_bits : 4 2024-09-19T09:38:48.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: strict_capacity_limit : 0 2024-09-19T09:38:48.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: high_pri_pool_ratio: 0.000 2024-09-19T09:38:48.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_compressed: (nil) 2024-09-19T09:38:48.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: persistent_cache: (nil) 2024-09-19T09:38:48.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size: 4096 2024-09-19T09:38:48.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size_deviation: 10 2024-09-19T09:38:48.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_restart_interval: 16 2024-09-19T09:38:48.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_block_restart_interval: 1 2024-09-19T09:38:48.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: metadata_block_size: 4096 2024-09-19T09:38:48.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: partition_filters: 0 2024-09-19T09:38:48.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: use_delta_encoding: 1 2024-09-19T09:38:48.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: filter_policy: bloomfilter 2024-09-19T09:38:48.955 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: whole_key_filtering: 1 2024-09-19T09:38:48.956 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: verify_compression: 0 2024-09-19T09:38:48.956 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: read_amp_bytes_per_bit: 0 2024-09-19T09:38:48.956 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: format_version: 5 2024-09-19T09:38:48.956 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_index_compression: 1 2024-09-19T09:38:48.956 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_align: 0 2024-09-19T09:38:48.956 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_auto_readahead_size: 262144 2024-09-19T09:38:48.956 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: prepopulate_block_cache: 0 2024-09-19T09:38:48.956 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: initial_auto_readahead_size: 8192 2024-09-19T09:38:48.956 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T09:38:48.956 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T09:38:48.957 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T09:38:48.957 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compression: NoCompression 2024-09-19T09:38:48.957 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T09:38:48.957 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T09:38:48.957 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T09:38:48.957 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.num_levels: 7 2024-09-19T09:38:48.957 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T09:38:48.957 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T09:38:48.957 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T09:38:48.957 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T09:38:48.957 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T09:38:48.957 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T09:38:48.957 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T09:38:48.958 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:38:48.958 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T09:38:48.958 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T09:38:48.958 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:38:48.958 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:38:48.958 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T09:38:48.958 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T09:38:48.958 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T09:38:48.958 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T09:38:48.958 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:38:48.958 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:38:48.958 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T09:38:48.958 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T09:38:48.958 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:38:48.959 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T09:38:48.959 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T09:38:48.959 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T09:38:48.959 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T09:38:48.959 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T09:38:48.959 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T09:38:48.959 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T09:38:48.959 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T09:38:48.959 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T09:38:48.959 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T09:38:48.959 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T09:38:48.959 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T09:38:48.959 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T09:38:48.960 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T09:38:48.960 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T09:38:48.960 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T09:38:48.960 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T09:38:48.960 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T09:38:48.960 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T09:38:48.960 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T09:38:48.960 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T09:38:48.960 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T09:38:48.960 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T09:38:48.960 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T09:38:48.960 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T09:38:48.960 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T09:38:48.961 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T09:38:48.961 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T09:38:48.961 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T09:38:48.961 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T09:38:48.961 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T09:38:48.961 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T09:38:48.961 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T09:38:48.961 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.inplace_update_support: 0 2024-09-19T09:38:48.961 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T09:38:48.961 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T09:38:48.961 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T09:38:48.961 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T09:38:48.961 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.bloom_locality: 0 2024-09-19T09:38:48.961 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.max_successive_merges: 0 2024-09-19T09:38:48.961 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T09:38:48.962 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T09:38:48.962 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T09:38:48.962 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T09:38:48.962 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.ttl: 2592000 2024-09-19T09:38:48.962 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T09:38:48.962 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T09:38:48.962 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T09:38:48.962 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.enable_blob_files: false 2024-09-19T09:38:48.962 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.min_blob_size: 0 2024-09-19T09:38:48.962 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T09:38:48.962 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T09:38:48.962 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T09:38:48.962 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T09:38:48.962 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T09:38:48.963 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T09:38:48.963 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T09:38:48.963 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T09:38:48.963 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-09-19T09:38:48.963 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-19T09:38:48.963 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12073, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T09:38:48.963 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-09-19T09:38:48.963 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2368659a-0336-440e-9af0-6386197a5183 2024-09-19T09:38:48.963 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738728526460, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-09-19T09:38:48.963 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-09-19T09:38:48.963 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738728530644, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 590316, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12074, "largest_seqno": 12647, "table_properties": {"data_size": 586957, "index_size": 1679, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 5711, "raw_average_key_size": 22, "raw_value_size": 581491, "raw_average_value_size": 2335, "num_data_blocks": 76, "num_entries": 249, "num_filter_entries": 249, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726738728, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2368659a-0336-440e-9af0-6386197a5183", "db_session_id": "YOVJLWWDDYM8L83XW191", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-09-19T09:38:48.963 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738728530794, "job": 1, "event": "recovery_finished"} 2024-09-19T09:38:48.963 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-09-19T09:38:48.964 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-19T09:38:48.964 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi112/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T09:38:48.964 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a463176e00 2024-09-19T09:38:48.964 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: DB pointer 0x55a463272000 2024-09-19T09:38:48.964 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T09:38:48.964 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T09:38:48.964 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** DB Stats ** 2024-09-19T09:38:48.964 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:38:48.964 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T09:38:48.964 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:38:48.964 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:38:48.964 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T09:38:48.964 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:38:48.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:38:48.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:38:48.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-19T09:38:48.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:38:48.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T09:38:48.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: L0 1/0 576.48 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 228.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-19T09:38:48.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: L6 1/0 7.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-19T09:38:48.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Sum 2/0 7.59 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 228.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-19T09:38:48.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 228.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-19T09:38:48.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:38:48.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-19T09:38:48.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:38:48.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T09:38:48.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 228.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-19T09:38:48.965 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:38:48.966 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T09:38:48.966 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:38:48.966 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:38:48.966 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-09-19T09:38:48.966 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T09:38:48.966 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T09:38:48.966 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T09:38:48.966 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T09:38:48.966 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative compaction: 0.00 GB write, 78.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:38:48.966 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval compaction: 0.00 GB write, 78.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:38:48.966 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T09:38:48.966 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Block cache BinnedLRUCache@0x55a4631491f0#2 capacity: 512.00 MB usage: 2.55 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-19T09:38:48.966 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.72 KB,0.000137091%) IndexBlock(1,1.83 KB,0.000348687%) Misc(1,0.00 KB,0%) 2024-09-19T09:38:48.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:38:48.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T09:38:48.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: starting mon.smithi112 rank 0 at public addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] at bind addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi112 fsid 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:38:48.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: mon.smithi112@-1(???) e2 preinit fsid 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:38:48.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: mon.smithi112@-1(???).mds e17 new map 2024-09-19T09:38:48.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: mon.smithi112@-1(???).mds e17 print_map 2024-09-19T09:38:48.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: e17 2024-09-19T09:38:48.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:38:48.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:38:48.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:38:48.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: legacy client fscid: 1 2024-09-19T09:38:48.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:38:48.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Filesystem 'cephfs' (1) 2024-09-19T09:38:48.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: fs_name cephfs 2024-09-19T09:38:48.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: epoch 17 2024-09-19T09:38:48.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:38:48.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:38:48.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: modified 2024-09-19T09:32:42.200999+0000 2024-09-19T09:38:48.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: tableserver 0 2024-09-19T09:38:48.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: root 0 2024-09-19T09:38:48.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: session_timeout 60 2024-09-19T09:38:48.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: session_autoclose 300 2024-09-19T09:38:48.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_file_size 1099511627776 2024-09-19T09:38:48.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_xattr_size 65536 2024-09-19T09:38:48.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: required_client_features {} 2024-09-19T09:38:48.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: last_failure 0 2024-09-19T09:38:48.969 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: last_failure_osd_epoch 45 2024-09-19T09:38:48.969 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:38:48.969 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_mds 1 2024-09-19T09:38:48.969 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: in 0 2024-09-19T09:38:48.969 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: up {0=14460} 2024-09-19T09:38:48.969 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: failed 2024-09-19T09:38:48.969 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: damaged 2024-09-19T09:38:48.969 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: stopped 2024-09-19T09:38:48.969 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_pools [3] 2024-09-19T09:38:48.969 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: metadata_pool 2 2024-09-19T09:38:48.969 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: inline_data disabled 2024-09-19T09:38:48.969 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: balancer 2024-09-19T09:38:48.969 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: bal_rank_mask -1 2024-09-19T09:38:48.969 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: standby_count_wanted 1 2024-09-19T09:38:48.970 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: qdb_cluster leader: 0 members: 2024-09-19T09:38:48.970 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi112.hcoxjz{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:38:48.970 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi112.ymjyok{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/3468750429,v1:172.21.15.112:6827/3468750429] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:38:48.970 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:38:48.970 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:38:48.970 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Standby daemons: 2024-09-19T09:38:48.970 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-19T09:38:48.970 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi191.qweljt{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:38:48.970 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi191.jjldod{-1:24281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6824/2759077122,v1:172.21.15.191:6825/2759077122] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:38:48.970 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: mon.smithi112@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-19T09:38:48.970 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: mon.smithi112@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T09:38:48.970 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: mon.smithi112@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T09:38:48.970 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: mon.smithi112@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T09:38:48.970 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 ceph-mon[97503]: mon.smithi112@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-09-19T09:38:48.971 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 bash[97484]: 89dfb5de44c8cedd0254cfb7e803411b4536f0d7b4eff349aedafee6b98656e7 2024-09-19T09:38:48.971 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:48 smithi112 systemd[1]: Started Ceph mon.smithi112 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:38:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:38:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:38:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: pgmap v63: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:38:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: mon.smithi112 calling monitor election 2024-09-19T09:38:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: mon.smithi112 is new leader, mons smithi112,smithi191 in quorum (ranks 0,1) 2024-09-19T09:38:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: monmap epoch 2 2024-09-19T09:38:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: fsid 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:38:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: last_changed 2024-09-19T09:28:07.274063+0000 2024-09-19T09:38:50.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: created 2024-09-19T09:25:39.367095+0000 2024-09-19T09:38:50.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: min_mon_release 17 (quincy) 2024-09-19T09:38:50.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: election_strategy: 1 2024-09-19T09:38:50.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: 0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-09-19T09:38:50.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.smithi191 2024-09-19T09:38:50.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 1 up:standby-replay 2 up:standby 2024-09-19T09:38:50.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: osdmap e47: 6 total, 6 up, 6 in 2024-09-19T09:38:50.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: mgrmap e34: smithi112.puhuua(active, since 2m), standbys: smithi191.xjpplx 2024-09-19T09:38:50.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: overall HEALTH_OK 2024-09-19T09:38:50.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: from='mgr.14650 ' entity='' 2024-09-19T09:38:50.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:50 smithi191 ceph-mon[34834]: mgrmap e35: smithi112.puhuua(active, since 2m), standbys: smithi191.xjpplx 2024-09-19T09:38:50.321 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:38:50.321 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:38:50.321 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: pgmap v63: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:50.321 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: from='mgr.14650 172.21.15.112:0/3006203430' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:38:50.321 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: mon.smithi112 calling monitor election 2024-09-19T09:38:50.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: mon.smithi112 is new leader, mons smithi112,smithi191 in quorum (ranks 0,1) 2024-09-19T09:38:50.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: monmap epoch 2 2024-09-19T09:38:50.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: fsid 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:38:50.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: last_changed 2024-09-19T09:28:07.274063+0000 2024-09-19T09:38:50.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: created 2024-09-19T09:25:39.367095+0000 2024-09-19T09:38:50.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: min_mon_release 17 (quincy) 2024-09-19T09:38:50.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: election_strategy: 1 2024-09-19T09:38:50.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: 0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-09-19T09:38:50.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.smithi191 2024-09-19T09:38:50.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 1 up:standby-replay 2 up:standby 2024-09-19T09:38:50.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: osdmap e47: 6 total, 6 up, 6 in 2024-09-19T09:38:50.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: mgrmap e34: smithi112.puhuua(active, since 2m), standbys: smithi191.xjpplx 2024-09-19T09:38:50.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: overall HEALTH_OK 2024-09-19T09:38:50.323 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: from='mgr.14650 ' entity='' 2024-09-19T09:38:50.323 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:50 smithi112 ceph-mon[97503]: mgrmap e35: smithi112.puhuua(active, since 2m), standbys: smithi191.xjpplx 2024-09-19T09:38:54.988 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:54 smithi191 ceph-mon[34834]: Standby manager daemon smithi191.xjpplx restarted 2024-09-19T09:38:54.988 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:54 smithi191 ceph-mon[34834]: Standby manager daemon smithi191.xjpplx started 2024-09-19T09:38:54.988 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:54 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/833274908' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/crt"}]: dispatch 2024-09-19T09:38:54.988 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:54 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/833274908' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:38:54.988 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:54 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/833274908' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/key"}]: dispatch 2024-09-19T09:38:54.988 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:54 smithi191 ceph-mon[34834]: from='mgr.? 172.21.15.191:0/833274908' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:38:54.988 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:54 smithi191 ceph-mon[34834]: Active manager daemon smithi112.puhuua restarted 2024-09-19T09:38:54.988 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:54 smithi191 ceph-mon[34834]: Activating manager daemon smithi112.puhuua 2024-09-19T09:38:55.003 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:54 smithi112 ceph-mon[97503]: Standby manager daemon smithi191.xjpplx restarted 2024-09-19T09:38:55.003 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:54 smithi112 ceph-mon[97503]: Standby manager daemon smithi191.xjpplx started 2024-09-19T09:38:55.003 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:54 smithi112 ceph-mon[97503]: from='mgr.? 172.21.15.191:0/833274908' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/crt"}]: dispatch 2024-09-19T09:38:55.003 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:54 smithi112 ceph-mon[97503]: from='mgr.? 172.21.15.191:0/833274908' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:38:55.003 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:54 smithi112 ceph-mon[97503]: from='mgr.? 172.21.15.191:0/833274908' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi191.xjpplx/key"}]: dispatch 2024-09-19T09:38:55.003 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:54 smithi112 ceph-mon[97503]: from='mgr.? 172.21.15.191:0/833274908' entity='mgr.smithi191.xjpplx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:38:55.004 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:54 smithi112 ceph-mon[97503]: Active manager daemon smithi112.puhuua restarted 2024-09-19T09:38:55.004 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:54 smithi112 ceph-mon[97503]: Activating manager daemon smithi112.puhuua 2024-09-19T09:38:56.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: osdmap e48: 6 total, 6 up, 6 in 2024-09-19T09:38:56.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: mgrmap e36: smithi112.puhuua(active, starting, since 0.00840119s), standbys: smithi191.xjpplx 2024-09-19T09:38:56.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:38:56.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:38:56.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.hcoxjz"}]: dispatch 2024-09-19T09:38:56.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:38:56.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.qweljt"}]: dispatch 2024-09-19T09:38:56.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.jjldod"}]: dispatch 2024-09-19T09:38:56.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr metadata", "who": "smithi112.puhuua", "id": "smithi112.puhuua"}]: dispatch 2024-09-19T09:38:56.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr metadata", "who": "smithi191.xjpplx", "id": "smithi191.xjpplx"}]: dispatch 2024-09-19T09:38:56.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:38:56.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:38:56.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:38:56.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:38:56.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:38:56.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:38:56.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:38:56.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:38:56.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:38:56.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: Manager daemon smithi112.puhuua is now available 2024-09-19T09:38:56.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:56.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:38:56.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:38:56.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:55 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/trash_purge_schedule"}]: dispatch 2024-09-19T09:38:56.068 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: osdmap e48: 6 total, 6 up, 6 in 2024-09-19T09:38:56.068 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: mgrmap e36: smithi112.puhuua(active, starting, since 0.00840119s), standbys: smithi191.xjpplx 2024-09-19T09:38:56.068 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:38:56.068 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:38:56.068 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.hcoxjz"}]: dispatch 2024-09-19T09:38:56.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:38:56.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.qweljt"}]: dispatch 2024-09-19T09:38:56.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.jjldod"}]: dispatch 2024-09-19T09:38:56.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr metadata", "who": "smithi112.puhuua", "id": "smithi112.puhuua"}]: dispatch 2024-09-19T09:38:56.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr metadata", "who": "smithi191.xjpplx", "id": "smithi191.xjpplx"}]: dispatch 2024-09-19T09:38:56.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:38:56.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:38:56.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:38:56.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:38:56.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:38:56.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:38:56.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:38:56.069 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:38:56.070 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:38:56.070 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: Manager daemon smithi112.puhuua is now available 2024-09-19T09:38:56.070 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:56.070 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:38:56.070 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:38:56.070 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.puhuua/trash_purge_schedule"}]: dispatch 2024-09-19T09:38:56.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:56 smithi112 ceph-mon[97503]: mgrmap e37: smithi112.puhuua(active, since 1.02449s), standbys: smithi191.xjpplx 2024-09-19T09:38:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:56 smithi112 ceph-mon[97503]: [19/Sep/2024:09:38:55] ENGINE Bus STARTING 2024-09-19T09:38:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:56 smithi112 ceph-mon[97503]: [19/Sep/2024:09:38:55] ENGINE Serving on https://172.21.15.112:7150 2024-09-19T09:38:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:56 smithi112 ceph-mon[97503]: [19/Sep/2024:09:38:55] ENGINE Error in HTTPServer.serve 2024-09-19T09:38:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Traceback (most recent call last): 2024-09-19T09:38:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:38:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:38:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:38:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._run(expiration_interval) 2024-09-19T09:38:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:38:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:38:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:38:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:38:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:38:56.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s = self.context.wrap_socket( 2024-09-19T09:38:56.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:38:56.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: return self.sslsocket_class._create( 2024-09-19T09:38:56.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:38:56.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self.do_handshake() 2024-09-19T09:38:56.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:38:56.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._sslobj.do_handshake() 2024-09-19T09:38:56.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:38:57.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:56 smithi191 ceph-mon[34834]: mgrmap e37: smithi112.puhuua(active, since 1.02449s), standbys: smithi191.xjpplx 2024-09-19T09:38:57.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:56 smithi191 ceph-mon[34834]: [19/Sep/2024:09:38:55] ENGINE Bus STARTING 2024-09-19T09:38:57.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:56 smithi191 ceph-mon[34834]: [19/Sep/2024:09:38:55] ENGINE Serving on https://172.21.15.112:7150 2024-09-19T09:38:57.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:56 smithi191 ceph-mon[34834]: [19/Sep/2024:09:38:55] ENGINE Error in HTTPServer.serve 2024-09-19T09:38:57.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Traceback (most recent call last): 2024-09-19T09:38:57.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:38:57.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:38:57.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:38:57.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: self._run(expiration_interval) 2024-09-19T09:38:57.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:38:57.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:38:57.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:38:57.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:38:57.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:38:57.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: s = self.context.wrap_socket( 2024-09-19T09:38:57.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:38:57.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: return self.sslsocket_class._create( 2024-09-19T09:38:57.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:38:57.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: self.do_handshake() 2024-09-19T09:38:57.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:38:57.038 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: self._sslobj.do_handshake() 2024-09-19T09:38:57.038 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:38:57.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:57 smithi112 ceph-mon[97503]: [19/Sep/2024:09:38:56] ENGINE Serving on http://172.21.15.112:8765 2024-09-19T09:38:57.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:57 smithi112 ceph-mon[97503]: [19/Sep/2024:09:38:56] ENGINE Bus STARTED 2024-09-19T09:38:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:57 smithi112 ceph-mon[97503]: pgmap v4: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:38:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:57 smithi112 ceph-mon[97503]: mgrmap e38: smithi112.puhuua(active, since 2s), standbys: smithi191.xjpplx 2024-09-19T09:38:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:57 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:57 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:58.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:57 smithi191 ceph-mon[34834]: [19/Sep/2024:09:38:56] ENGINE Serving on http://172.21.15.112:8765 2024-09-19T09:38:58.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:57 smithi191 ceph-mon[34834]: [19/Sep/2024:09:38:56] ENGINE Bus STARTED 2024-09-19T09:38:58.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:57 smithi191 ceph-mon[34834]: pgmap v4: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:38:58.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:57 smithi191 ceph-mon[34834]: mgrmap e38: smithi112.puhuua(active, since 2s), standbys: smithi191.xjpplx 2024-09-19T09:38:58.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:57 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:58.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:57 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:59.668 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:59.669 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:59.669 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:38:59 smithi112 ceph-mon[97503]: pgmap v5: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:38:59.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:59 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:59.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:59 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:38:59.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:38:59 smithi191 ceph-mon[34834]: pgmap v5: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:39:00.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:00 smithi112 ceph-mon[97503]: mgrmap e39: smithi112.puhuua(active, since 4s), standbys: smithi191.xjpplx 2024-09-19T09:39:00.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:00 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:00.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:00 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:00.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:00 smithi191 ceph-mon[34834]: mgrmap e39: smithi112.puhuua(active, since 4s), standbys: smithi191.xjpplx 2024-09-19T09:39:00.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:00 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:00.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:00 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:01 smithi112 ceph-mon[97503]: pgmap v6: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:39:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:01 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:01 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:02.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:01 smithi191 ceph-mon[34834]: pgmap v6: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-19T09:39:02.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:01 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:02.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:01 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:04.096 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:03 smithi112 ceph-mon[97503]: pgmap v7: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-19T09:39:04.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:03 smithi191 ceph-mon[34834]: pgmap v7: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-19T09:39:05.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: Detected new or changed devices on smithi112 2024-09-19T09:39:05.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:05.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:05.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:05.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:39:05.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-19T09:39:05.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-19T09:39:05.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:39:05.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:39:05.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:39:05.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:39:05.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: pgmap v8: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-19T09:39:05.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:39:05.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:39:05.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:05.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:05.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:05.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:05.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:05.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:05.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:05.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-19T09:39:05.490 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: Detected new or changed devices on smithi112 2024-09-19T09:39:05.490 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:05.490 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:05.491 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:05.491 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:39:05.491 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-19T09:39:05.491 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-19T09:39:05.491 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:39:05.491 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:39:05.491 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:39:05.491 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:39:05.491 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: pgmap v8: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-19T09:39:05.491 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: Updating smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:39:05.491 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: Updating smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:39:05.491 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:05.492 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:05.492 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:05.492 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:05.492 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:05.492 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:05.492 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:05.492 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:05 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-19T09:39:07.848 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:07 smithi191 ceph-mon[34834]: Upgrade: Updating mon.smithi191 2024-09-19T09:39:07.849 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:07 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:07.849 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:07 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:39:07.849 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:07 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:39:07.849 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:07 smithi191 ceph-mon[34834]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:07.849 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:07 smithi191 ceph-mon[34834]: Deploying daemon mon.smithi191 on smithi191 2024-09-19T09:39:07.849 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:07 smithi191 ceph-mon[34834]: pgmap v9: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-19T09:39:07.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:07 smithi112 ceph-mon[97503]: Upgrade: Updating mon.smithi191 2024-09-19T09:39:07.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:07 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:07.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:07 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:39:07.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:07 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:39:07.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:07 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:07.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:07 smithi112 ceph-mon[97503]: Deploying daemon mon.smithi191 on smithi191 2024-09-19T09:39:07.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:07 smithi112 ceph-mon[97503]: pgmap v9: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-19T09:39:08.431 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:08 smithi191 systemd[1]: Stopping Ceph mon.smithi191 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:39:08.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:08 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi191[34825]: 2024-09-19T09:39:08.428+0000 7fc20864a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi191 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:39:08.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:08 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi191[34825]: 2024-09-19T09:39:08.428+0000 7fc20864a640 -1 mon.smithi191@1(peon) e2 *** Got Signal Terminated *** 2024-09-19T09:39:08.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:08 smithi191 podman[77463]: 2024-09-19 09:39:08.653527545 +0000 UTC m=+0.378752404 container died 35690ef0929b8dc3e8faa485b33da57931cbddc535d02972312f7b77d17843a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi191, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=quincy-6e06d1e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:39:09.282 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:09 smithi191 podman[77463]: 2024-09-19 09:39:09.037852341 +0000 UTC m=+0.763077209 container cleanup 35690ef0929b8dc3e8faa485b33da57931cbddc535d02972312f7b77d17843a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi191, org.label-schema.license=GPLv2, ceph=True, RELEASE=quincy-6e06d1e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T09:39:09.282 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:09 smithi191 bash[77463]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi191 2024-09-19T09:39:09.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:09 smithi191 podman[77475]: 2024-09-19 09:39:09.28150548 +0000 UTC m=+0.617448356 container remove 35690ef0929b8dc3e8faa485b33da57931cbddc535d02972312f7b77d17843a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi191, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-6e06d1e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T09:39:09.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:09 smithi191 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mon.smithi191.service: Deactivated successfully. 2024-09-19T09:39:09.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:09 smithi191 systemd[1]: Stopped Ceph mon.smithi191 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:39:09.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:09 smithi191 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mon.smithi191.service: Consumed 6.422s CPU time. 2024-09-19T09:39:09.949 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:09 smithi191 systemd[1]: Starting Ceph mon.smithi191 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:39:09.949 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:09 smithi191 podman[77605]: 2024-09-19 09:39:09.73278079 +0000 UTC m=+0.015711951 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:39:09.949 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:09 smithi191 podman[77605]: 2024-09-19 09:39:09.841617629 +0000 UTC m=+0.124548827 container create 3cab8f7cc27e658f6fe5d2125dfd05811fcc2f915a388bc15268da5ab73a3ecc (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi191, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:39:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 podman[77605]: 2024-09-19 09:39:10.05305675 +0000 UTC m=+0.335987911 container init 3cab8f7cc27e658f6fe5d2125dfd05811fcc2f915a388bc15268da5ab73a3ecc (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi191, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T09:39:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 podman[77605]: 2024-09-19 09:39:10.056356701 +0000 UTC m=+0.339287866 container start 3cab8f7cc27e658f6fe5d2125dfd05811fcc2f915a388bc15268da5ab73a3ecc (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi191, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T09:39:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T09:39:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T09:39:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: pidfile_write: ignore empty --pid-file 2024-09-19T09:39:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: load: jerasure load: lrc 2024-09-19T09:39:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: RocksDB version: 7.9.2 2024-09-19T09:39:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Git sha 0 2024-09-19T09:39:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T09:39:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: DB SUMMARY 2024-09-19T09:39:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: DB Session ID: NQ1Z7YN8YGKWRXKOMI3A 2024-09-19T09:39:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: CURRENT file: CURRENT 2024-09-19T09:39:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T09:39:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1083 Bytes 2024-09-19T09:39:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi191/store.db dir, Total Num: 1, files: 000027.sst 2024-09-19T09:39:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi191/store.db: 000025.log size: 3464067 ; 2024-09-19T09:39:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.error_if_exists: 0 2024-09-19T09:39:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.create_if_missing: 0 2024-09-19T09:39:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.paranoid_checks: 1 2024-09-19T09:39:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T09:39:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T09:39:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T09:39:10.287 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.env: 0x55da38255940 2024-09-19T09:39:10.287 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T09:39:10.287 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.info_log: 0x55da390138c0 2024-09-19T09:39:10.287 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T09:39:10.288 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.statistics: (nil) 2024-09-19T09:39:10.288 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.use_fsync: 0 2024-09-19T09:39:10.288 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_log_file_size: 0 2024-09-19T09:39:10.288 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T09:39:10.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T09:39:10.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T09:39:10.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T09:39:10.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.allow_fallocate: 1 2024-09-19T09:39:10.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T09:39:10.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T09:39:10.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.use_direct_reads: 0 2024-09-19T09:39:10.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T09:39:10.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T09:39:10.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.db_log_dir: 2024-09-19T09:39:10.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.wal_dir: 2024-09-19T09:39:10.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T09:39:10.290 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T09:39:10.290 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T09:39:10.290 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T09:39:10.290 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T09:39:10.290 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T09:39:10.290 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T09:39:10.290 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T09:39:10.290 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.write_buffer_manager: 0x55da39022dc0 2024-09-19T09:39:10.290 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T09:39:10.290 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T09:39:10.290 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T09:39:10.290 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T09:39:10.290 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T09:39:10.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T09:39:10.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T09:39:10.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T09:39:10.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.unordered_write: 0 2024-09-19T09:39:10.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T09:39:10.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T09:39:10.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T09:39:10.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T09:39:10.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.row_cache: None 2024-09-19T09:39:10.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.wal_filter: None 2024-09-19T09:39:10.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T09:39:10.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T09:39:10.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.two_write_queues: 0 2024-09-19T09:39:10.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T09:39:10.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.wal_compression: 0 2024-09-19T09:39:10.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.atomic_flush: 0 2024-09-19T09:39:10.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T09:39:10.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T09:39:10.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T09:39:10.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.log_readahead_size: 0 2024-09-19T09:39:10.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T09:39:10.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T09:39:10.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T09:39:10.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T09:39:10.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T09:39:10.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T09:39:10.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T09:39:10.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_background_jobs: 2 2024-09-19T09:39:10.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_background_compactions: -1 2024-09-19T09:39:10.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_subcompactions: 1 2024-09-19T09:39:10.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T09:39:10.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T09:39:10.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T09:39:10.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T09:39:10.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T09:39:10.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T09:39:10.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T09:39:10.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T09:39:10.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_open_files: -1 2024-09-19T09:39:10.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T09:39:10.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T09:39:10.294 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T09:39:10.294 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T09:39:10.294 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_background_flushes: -1 2024-09-19T09:39:10.294 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Compression algorithms supported: 2024-09-19T09:39:10.294 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: kZSTD supported: 0 2024-09-19T09:39:10.294 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: kXpressCompression supported: 0 2024-09-19T09:39:10.294 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: kBZip2Compression supported: 0 2024-09-19T09:39:10.294 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T09:39:10.294 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: kLZ4Compression supported: 1 2024-09-19T09:39:10.294 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: kZlibCompression supported: 1 2024-09-19T09:39:10.294 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T09:39:10.294 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: kSnappyCompression supported: 1 2024-09-19T09:39:10.294 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T09:39:10.295 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T09:39:10.295 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi191/store.db/MANIFEST-000009 2024-09-19T09:39:10.295 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T09:39:10.295 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T09:39:10.295 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.merge_operator: 2024-09-19T09:39:10.295 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compaction_filter: None 2024-09-19T09:39:10.295 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T09:39:10.295 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T09:39:10.295 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T09:39:10.295 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T09:39:10.295 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55da39013520) 2024-09-19T09:39:10.295 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: cache_index_and_filter_blocks: 1 2024-09-19T09:39:10.295 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T09:39:10.295 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T09:39:10.296 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: pin_top_level_index_and_filter: 1 2024-09-19T09:39:10.296 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: index_type: 0 2024-09-19T09:39:10.296 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: data_block_index_type: 0 2024-09-19T09:39:10.296 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: index_shortening: 1 2024-09-19T09:39:10.296 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T09:39:10.296 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: checksum: 4 2024-09-19T09:39:10.296 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: no_block_cache: 0 2024-09-19T09:39:10.296 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: block_cache: 0x55da390071f0 2024-09-19T09:39:10.296 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: block_cache_name: BinnedLRUCache 2024-09-19T09:39:10.296 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: block_cache_options: 2024-09-19T09:39:10.296 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: capacity : 536870912 2024-09-19T09:39:10.296 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: num_shard_bits : 4 2024-09-19T09:39:10.296 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: strict_capacity_limit : 0 2024-09-19T09:39:10.296 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: high_pri_pool_ratio: 0.000 2024-09-19T09:39:10.297 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: block_cache_compressed: (nil) 2024-09-19T09:39:10.297 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: persistent_cache: (nil) 2024-09-19T09:39:10.297 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: block_size: 4096 2024-09-19T09:39:10.297 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: block_size_deviation: 10 2024-09-19T09:39:10.297 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: block_restart_interval: 16 2024-09-19T09:39:10.297 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: index_block_restart_interval: 1 2024-09-19T09:39:10.297 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: metadata_block_size: 4096 2024-09-19T09:39:10.297 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: partition_filters: 0 2024-09-19T09:39:10.297 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: use_delta_encoding: 1 2024-09-19T09:39:10.297 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: filter_policy: bloomfilter 2024-09-19T09:39:10.297 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: whole_key_filtering: 1 2024-09-19T09:39:10.297 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: verify_compression: 0 2024-09-19T09:39:10.297 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: read_amp_bytes_per_bit: 0 2024-09-19T09:39:10.297 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: format_version: 5 2024-09-19T09:39:10.298 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: enable_index_compression: 1 2024-09-19T09:39:10.298 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: block_align: 0 2024-09-19T09:39:10.298 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: max_auto_readahead_size: 262144 2024-09-19T09:39:10.298 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: prepopulate_block_cache: 0 2024-09-19T09:39:10.298 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: initial_auto_readahead_size: 8192 2024-09-19T09:39:10.298 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T09:39:10.298 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T09:39:10.298 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T09:39:10.298 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compression: NoCompression 2024-09-19T09:39:10.298 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T09:39:10.299 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T09:39:10.299 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T09:39:10.299 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.num_levels: 7 2024-09-19T09:39:10.299 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T09:39:10.299 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T09:39:10.299 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T09:39:10.299 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T09:39:10.299 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T09:39:10.299 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T09:39:10.299 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T09:39:10.299 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:39:10.299 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T09:39:10.299 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T09:39:10.299 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:39:10.300 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:39:10.300 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T09:39:10.300 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T09:39:10.300 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T09:39:10.300 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T09:39:10.300 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:39:10.300 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:39:10.300 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T09:39:10.300 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T09:39:10.300 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:39:10.300 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T09:39:10.300 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T09:39:10.300 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T09:39:10.300 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T09:39:10.301 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T09:39:10.301 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T09:39:10.301 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T09:39:10.301 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T09:39:10.301 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T09:39:10.301 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T09:39:10.301 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T09:39:10.301 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T09:39:10.301 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T09:39:10.301 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T09:39:10.301 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T09:39:10.301 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T09:39:10.302 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T09:39:10.302 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T09:39:10.302 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T09:39:10.302 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T09:39:10.302 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T09:39:10.302 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T09:39:10.302 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T09:39:10.302 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T09:39:10.302 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T09:39:10.302 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T09:39:10.302 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T09:39:10.302 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T09:39:10.302 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T09:39:10.302 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T09:39:10.302 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T09:39:10.303 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T09:39:10.303 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T09:39:10.303 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.inplace_update_support: 0 2024-09-19T09:39:10.303 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T09:39:10.303 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T09:39:10.303 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T09:39:10.303 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T09:39:10.303 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.bloom_locality: 0 2024-09-19T09:39:10.303 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.max_successive_merges: 0 2024-09-19T09:39:10.303 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T09:39:10.303 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T09:39:10.303 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T09:39:10.303 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T09:39:10.303 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.ttl: 2592000 2024-09-19T09:39:10.304 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T09:39:10.304 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T09:39:10.304 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T09:39:10.304 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.enable_blob_files: false 2024-09-19T09:39:10.304 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.min_blob_size: 0 2024-09-19T09:39:10.304 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T09:39:10.304 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T09:39:10.304 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T09:39:10.304 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T09:39:10.304 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T09:39:10.304 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T09:39:10.304 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T09:39:10.304 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T09:39:10.304 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-09-19T09:39:10.305 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-19T09:39:10.305 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi191/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12367, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T09:39:10.305 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-19T09:39:10.305 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7d53f226-543c-4841-a9ad-4b4a8fbefb34 2024-09-19T09:39:10.305 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738750083168, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-19T09:39:10.305 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-19T09:39:10.305 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738750091490, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2216059, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12372, "largest_seqno": 13450, "table_properties": {"data_size": 2210774, "index_size": 3088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1157, "raw_key_size": 10601, "raw_average_key_size": 23, "raw_value_size": 2200876, "raw_average_value_size": 4869, "num_data_blocks": 140, "num_entries": 452, "num_filter_entries": 452, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726738750, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7d53f226-543c-4841-a9ad-4b4a8fbefb34", "db_session_id": "NQ1Z7YN8YGKWRXKOMI3A", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-19T09:39:10.305 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738750091610, "job": 1, "event": "recovery_finished"} 2024-09-19T09:39:10.305 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-19T09:39:10.305 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-19T09:39:10.305 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi191/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T09:39:10.305 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55da39034e00 2024-09-19T09:39:10.305 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: DB pointer 0x55da39130000 2024-09-19T09:39:10.306 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T09:39:10.306 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T09:39:10.306 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: ** DB Stats ** 2024-09-19T09:39:10.306 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:39:10.306 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T09:39:10.306 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:39:10.306 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:39:10.306 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T09:39:10.306 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:39:10.306 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:39:10.306 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: 2024-09-19T09:39:10.306 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: ** Compaction Stats [default] ** 2024-09-19T09:39:10.306 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:39:10.307 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T09:39:10.307 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: L0 1/0 2.11 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 611.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-19T09:39:10.307 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: L6 1/0 7.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-19T09:39:10.307 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Sum 2/0 9.14 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 611.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-19T09:39:10.307 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 611.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-19T09:39:10.307 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: 2024-09-19T09:39:10.307 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: ** Compaction Stats [default] ** 2024-09-19T09:39:10.307 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:39:10.307 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T09:39:10.307 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 611.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-19T09:39:10.307 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: 2024-09-19T09:39:10.307 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T09:39:10.307 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: 2024-09-19T09:39:10.308 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:39:10.308 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-19T09:39:10.308 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T09:39:10.308 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T09:39:10.308 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T09:39:10.308 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T09:39:10.308 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Cumulative compaction: 0.00 GB write, 195.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:39:10.308 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Interval compaction: 0.00 GB write, 195.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:39:10.308 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T09:39:10.308 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Block cache BinnedLRUCache@0x55da390071f0#2 capacity: 512.00 MB usage: 4.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-19T09:39:10.308 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.28 KB,0.000244379%) IndexBlock(1,3.33 KB,0.000634789%) Misc(1,0.00 KB,0%) 2024-09-19T09:39:10.308 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: 2024-09-19T09:39:10.308 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T09:39:10.309 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: starting mon.smithi191 rank 1 at public addrs [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] at bind addrs [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi191 fsid 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:39:10.309 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: mon.smithi191@-1(???) e2 preinit fsid 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:39:10.309 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: mon.smithi191@-1(???).mds e17 new map 2024-09-19T09:39:10.309 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: mon.smithi191@-1(???).mds e17 print_map 2024-09-19T09:39:10.309 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: e17 2024-09-19T09:39:10.309 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:39:10.309 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:39:10.309 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:39:10.309 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: legacy client fscid: 1 2024-09-19T09:39:10.309 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: 2024-09-19T09:39:10.309 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Filesystem 'cephfs' (1) 2024-09-19T09:39:10.309 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: fs_name cephfs 2024-09-19T09:39:10.309 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: epoch 17 2024-09-19T09:39:10.310 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:39:10.310 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:39:10.310 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: modified 2024-09-19T09:32:42.200999+0000 2024-09-19T09:39:10.310 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: tableserver 0 2024-09-19T09:39:10.310 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: root 0 2024-09-19T09:39:10.310 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: session_timeout 60 2024-09-19T09:39:10.310 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: session_autoclose 300 2024-09-19T09:39:10.310 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: max_file_size 1099511627776 2024-09-19T09:39:10.310 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: max_xattr_size 65536 2024-09-19T09:39:10.310 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: required_client_features {} 2024-09-19T09:39:10.311 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: last_failure 0 2024-09-19T09:39:10.311 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: last_failure_osd_epoch 45 2024-09-19T09:39:10.311 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:39:10.311 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: max_mds 1 2024-09-19T09:39:10.311 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: in 0 2024-09-19T09:39:10.311 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: up {0=14460} 2024-09-19T09:39:10.311 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: failed 2024-09-19T09:39:10.311 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: damaged 2024-09-19T09:39:10.311 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: stopped 2024-09-19T09:39:10.311 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: data_pools [3] 2024-09-19T09:39:10.312 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: metadata_pool 2 2024-09-19T09:39:10.312 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: inline_data disabled 2024-09-19T09:39:10.312 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: balancer 2024-09-19T09:39:10.312 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: bal_rank_mask -1 2024-09-19T09:39:10.312 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: standby_count_wanted 1 2024-09-19T09:39:10.312 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: qdb_cluster leader: 0 members: 2024-09-19T09:39:10.312 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: [mds.cephfs.smithi112.hcoxjz{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:39:10.312 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: [mds.cephfs.smithi112.ymjyok{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/3468750429,v1:172.21.15.112:6827/3468750429] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:39:10.312 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: 2024-09-19T09:39:10.312 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: 2024-09-19T09:39:10.312 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: Standby daemons: 2024-09-19T09:39:10.312 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: 2024-09-19T09:39:10.312 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: [mds.cephfs.smithi191.qweljt{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:39:10.313 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout: [mds.cephfs.smithi191.jjldod{-1:24281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6824/2759077122,v1:172.21.15.191:6825/2759077122] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:39:10.313 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: mon.smithi191@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-19T09:39:10.313 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: mon.smithi191@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T09:39:10.313 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: mon.smithi191@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T09:39:10.313 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: mon.smithi191@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T09:39:10.313 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 ceph-mon[77624]: mon.smithi191@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-09-19T09:39:10.313 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 bash[77605]: 3cab8f7cc27e658f6fe5d2125dfd05811fcc2f915a388bc15268da5ab73a3ecc 2024-09-19T09:39:10.313 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:10 smithi191 systemd[1]: Started Ceph mon.smithi191 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:39:11.496 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 1 up:standby-replay 2 up:standby 2024-09-19T09:39:11.497 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: osdmap e48: 6 total, 6 up, 6 in 2024-09-19T09:39:11.497 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: mgrmap e39: smithi112.puhuua(active, since 15s), standbys: smithi191.xjpplx 2024-09-19T09:39:11.497 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: overall HEALTH_OK 2024-09-19T09:39:11.497 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:39:11.497 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:39:11.497 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: mon.smithi191 calling monitor election 2024-09-19T09:39:11.497 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: mon.smithi112 calling monitor election 2024-09-19T09:39:11.497 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: mon.smithi112 is new leader, mons smithi112,smithi191 in quorum (ranks 0,1) 2024-09-19T09:39:11.497 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: monmap epoch 3 2024-09-19T09:39:11.497 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: fsid 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:39:11.497 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: last_changed 2024-09-19T09:39:10.228869+0000 2024-09-19T09:39:11.497 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: created 2024-09-19T09:25:39.367095+0000 2024-09-19T09:39:11.498 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: min_mon_release 19 (squid) 2024-09-19T09:39:11.498 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: election_strategy: 1 2024-09-19T09:39:11.498 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: 0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-09-19T09:39:11.498 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.smithi191 2024-09-19T09:39:11.498 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 1 up:standby-replay 2 up:standby 2024-09-19T09:39:11.498 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: osdmap e48: 6 total, 6 up, 6 in 2024-09-19T09:39:11.498 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: mgrmap e39: smithi112.puhuua(active, since 15s), standbys: smithi191.xjpplx 2024-09-19T09:39:11.498 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: overall HEALTH_OK 2024-09-19T09:39:11.498 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:11.498 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:11.498 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:11.498 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:11 smithi191 ceph-mon[77624]: pgmap v11: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-19T09:39:11.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 1 up:standby-replay 2 up:standby 2024-09-19T09:39:11.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: osdmap e48: 6 total, 6 up, 6 in 2024-09-19T09:39:11.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: mgrmap e39: smithi112.puhuua(active, since 15s), standbys: smithi191.xjpplx 2024-09-19T09:39:11.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: overall HEALTH_OK 2024-09-19T09:39:11.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-19T09:39:11.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mon metadata", "id": "smithi191"}]: dispatch 2024-09-19T09:39:11.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: mon.smithi191 calling monitor election 2024-09-19T09:39:11.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: mon.smithi112 calling monitor election 2024-09-19T09:39:11.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: mon.smithi112 is new leader, mons smithi112,smithi191 in quorum (ranks 0,1) 2024-09-19T09:39:11.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: monmap epoch 3 2024-09-19T09:39:11.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: fsid 0bd98d30-7669-11ef-bceb-c7b262605968 2024-09-19T09:39:11.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: last_changed 2024-09-19T09:39:10.228869+0000 2024-09-19T09:39:11.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: created 2024-09-19T09:25:39.367095+0000 2024-09-19T09:39:11.691 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: min_mon_release 19 (squid) 2024-09-19T09:39:11.691 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: election_strategy: 1 2024-09-19T09:39:11.691 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: 0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-09-19T09:39:11.691 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.smithi191 2024-09-19T09:39:11.691 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 1 up:standby-replay 2 up:standby 2024-09-19T09:39:11.691 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: osdmap e48: 6 total, 6 up, 6 in 2024-09-19T09:39:11.691 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: mgrmap e39: smithi112.puhuua(active, since 15s), standbys: smithi191.xjpplx 2024-09-19T09:39:11.691 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: overall HEALTH_OK 2024-09-19T09:39:11.691 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:11.691 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:11.691 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:11.691 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:11 smithi112 ceph-mon[97503]: pgmap v11: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-19T09:39:14.176 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:13 smithi191 ceph-mon[77624]: pgmap v12: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-19T09:39:14.176 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:13 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:14.176 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:13 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:14.176 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:13 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:14.176 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:13 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:14.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:13 smithi112 ceph-mon[97503]: pgmap v12: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-19T09:39:14.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:13 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:14.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:13 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:14.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:13 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:14.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:13 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:14.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.408+0000 7f71279b8640 1 -- 172.21.15.112:0/2084015862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7120102550 msgr2=0x7f7120102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.408+0000 7f71279b8640 1 --2- 172.21.15.112:0/2084015862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7120102550 0x7f7120102920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f71180048d0 tx=0x7f7118009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.408+0000 7f71279b8640 1 -- 172.21.15.112:0/2084015862 shutdown_connections 2024-09-19T09:39:14.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.408+0000 7f71279b8640 1 --2- 172.21.15.112:0/2084015862 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7120102ef0 0x7f71200fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.408+0000 7f71279b8640 1 --2- 172.21.15.112:0/2084015862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7120102550 0x7f7120102920 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.408+0000 7f71279b8640 1 -- 172.21.15.112:0/2084015862 >> 172.21.15.112:0/2084015862 conn(0x7f71200f80f0 msgr2=0x7f71200fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:14.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.409+0000 7f71279b8640 1 -- 172.21.15.112:0/2084015862 shutdown_connections 2024-09-19T09:39:14.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.409+0000 7f71279b8640 1 -- 172.21.15.112:0/2084015862 wait complete. 2024-09-19T09:39:14.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.409+0000 7f71279b8640 1 Processor -- start 2024-09-19T09:39:14.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.409+0000 7f71279b8640 1 -- start start 2024-09-19T09:39:14.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.409+0000 7f71279b8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7120102550 0x7f7120113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.409+0000 7f71279b8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7120102ef0 0x7f7120113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.409+0000 7f71279b8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71201140d0 con 0x7f7120102550 2024-09-19T09:39:14.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.409+0000 7f71279b8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712010d4e0 con 0x7f7120102ef0 2024-09-19T09:39:14.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f7125754640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7120102550 0x7f7120113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f7124f53640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7120102ef0 0x7f7120113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f7125754640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7120102550 0x7f7120113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40396/0 (socket says 172.21.15.112:40396) 2024-09-19T09:39:14.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f7125754640 1 -- 172.21.15.112:0/1238738692 learned_addr learned my addr 172.21.15.112:0/1238738692 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:39:14.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f7124f53640 1 -- 172.21.15.112:0/1238738692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7120102ef0 msgr2=0x7f7120113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T09:39:14.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f7124f53640 1 -- 172.21.15.112:0/1238738692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7120102ef0 msgr2=0x7f7120113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:39:14.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f7124f53640 1 --2- 172.21.15.112:0/1238738692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7120102ef0 0x7f7120113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-19T09:39:14.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f7124f53640 1 --2- 172.21.15.112:0/1238738692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7120102ef0 0x7f7120113a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:39:14.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f7125754640 1 -- 172.21.15.112:0/1238738692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7120102ef0 msgr2=0x7f7120113a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:39:14.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f7125754640 1 --2- 172.21.15.112:0/1238738692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7120102ef0 0x7f7120113a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f7125754640 1 -- 172.21.15.112:0/1238738692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7118005040 con 0x7f7120102550 2024-09-19T09:39:14.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f7125754640 1 --2- 172.21.15.112:0/1238738692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7120102550 0x7f7120113540 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f71180043d0 tx=0x7f7118009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:14.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f711dffb640 1 -- 172.21.15.112:0/1238738692 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7118038070 con 0x7f7120102550 2024-09-19T09:39:14.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f711dffb640 1 -- 172.21.15.112:0/1238738692 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f71180096e0 con 0x7f7120102550 2024-09-19T09:39:14.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f71279b8640 1 -- 172.21.15.112:0/1238738692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712010d760 con 0x7f7120102550 2024-09-19T09:39:14.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.410+0000 7f711dffb640 1 -- 172.21.15.112:0/1238738692 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f711803d420 con 0x7f7120102550 2024-09-19T09:39:14.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.411+0000 7f71279b8640 1 -- 172.21.15.112:0/1238738692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712010dd00 con 0x7f7120102550 2024-09-19T09:39:14.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.412+0000 7f71279b8640 1 -- 172.21.15.112:0/1238738692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71200fdcd0 con 0x7f7120102550 2024-09-19T09:39:14.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.412+0000 7f711dffb640 1 -- 172.21.15.112:0/1238738692 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f7118030020 con 0x7f7120102550 2024-09-19T09:39:14.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.413+0000 7f711dffb640 1 --2- 172.21.15.112:0/1238738692 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f710806e660 0x7f7108070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.413+0000 7f711dffb640 1 -- 172.21.15.112:0/1238738692 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f71180ae6c0 con 0x7f7120102550 2024-09-19T09:39:14.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.413+0000 7f7124f53640 1 --2- 172.21.15.112:0/1238738692 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f710806e660 0x7f7108070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.413+0000 7f7124f53640 1 --2- 172.21.15.112:0/1238738692 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f710806e660 0x7f7108070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7114007fd0 tx=0x7f7114009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:14.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.418+0000 7f711dffb640 1 -- 172.21.15.112:0/1238738692 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f71180777c0 con 0x7f7120102550 2024-09-19T09:39:14.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.609+0000 7f71279b8640 1 -- 172.21.15.112:0/1238738692 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f712004b720 con 0x7f710806e660 2024-09-19T09:39:14.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.610+0000 7f711dffb640 1 -- 172.21.15.112:0/1238738692 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f712004b720 con 0x7f710806e660 2024-09-19T09:39:14.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.614+0000 7f71279b8640 1 -- 172.21.15.112:0/1238738692 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f710806e660 msgr2=0x7f7108070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.614+0000 7f71279b8640 1 --2- 172.21.15.112:0/1238738692 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f710806e660 0x7f7108070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7114007fd0 tx=0x7f7114009e90 comp rx=0 tx=0).stop 2024-09-19T09:39:14.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.614+0000 7f71279b8640 1 -- 172.21.15.112:0/1238738692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7120102550 msgr2=0x7f7120113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.614+0000 7f71279b8640 1 --2- 172.21.15.112:0/1238738692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7120102550 0x7f7120113540 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f71180043d0 tx=0x7f7118009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.614+0000 7f71279b8640 1 -- 172.21.15.112:0/1238738692 shutdown_connections 2024-09-19T09:39:14.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.614+0000 7f71279b8640 1 --2- 172.21.15.112:0/1238738692 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f710806e660 0x7f7108070b10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.614+0000 7f71279b8640 1 --2- 172.21.15.112:0/1238738692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7120102ef0 0x7f7120113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.614+0000 7f71279b8640 1 --2- 172.21.15.112:0/1238738692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7120102550 0x7f7120113540 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.614+0000 7f71279b8640 1 -- 172.21.15.112:0/1238738692 >> 172.21.15.112:0/1238738692 conn(0x7f71200f80f0 msgr2=0x7f71200f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:14.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.614+0000 7f71279b8640 1 -- 172.21.15.112:0/1238738692 shutdown_connections 2024-09-19T09:39:14.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.614+0000 7f71279b8640 1 -- 172.21.15.112:0/1238738692 wait complete. 2024-09-19T09:39:14.624 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:39:14.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.693+0000 7f1bad4cd640 1 -- 172.21.15.112:0/3378715900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba8102530 msgr2=0x7f1ba8102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.693+0000 7f1bad4cd640 1 --2- 172.21.15.112:0/3378715900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba8102530 0x7f1ba8102900 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1b980048d0 tx=0x7f1b98009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.693+0000 7f1bad4cd640 1 -- 172.21.15.112:0/3378715900 shutdown_connections 2024-09-19T09:39:14.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.693+0000 7f1bad4cd640 1 --2- 172.21.15.112:0/3378715900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8102ed0 0x7f1ba80fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.693+0000 7f1bad4cd640 1 --2- 172.21.15.112:0/3378715900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba8102530 0x7f1ba8102900 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.693+0000 7f1bad4cd640 1 -- 172.21.15.112:0/3378715900 >> 172.21.15.112:0/3378715900 conn(0x7f1ba80f80f0 msgr2=0x7f1ba80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:14.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.693+0000 7f1bad4cd640 1 -- 172.21.15.112:0/3378715900 shutdown_connections 2024-09-19T09:39:14.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.693+0000 7f1bad4cd640 1 -- 172.21.15.112:0/3378715900 wait complete. 2024-09-19T09:39:14.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.693+0000 7f1bad4cd640 1 Processor -- start 2024-09-19T09:39:14.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.693+0000 7f1bad4cd640 1 -- start start 2024-09-19T09:39:14.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1bad4cd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba8102530 0x7f1ba8113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1bad4cd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8102ed0 0x7f1ba8113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1bad4cd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba8113d80 con 0x7f1ba8102530 2024-09-19T09:39:14.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1bad4cd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba810d1c0 con 0x7f1ba8102ed0 2024-09-19T09:39:14.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1ba6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba8102530 0x7f1ba8113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1ba6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba8102530 0x7f1ba8113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40418/0 (socket says 172.21.15.112:40418) 2024-09-19T09:39:14.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1ba6ffd640 1 -- 172.21.15.112:0/111803243 learned_addr learned my addr 172.21.15.112:0/111803243 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:39:14.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1ba67fc640 1 --2- 172.21.15.112:0/111803243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8102ed0 0x7f1ba8113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1ba67fc640 1 -- 172.21.15.112:0/111803243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8102ed0 msgr2=0x7f1ba8113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T09:39:14.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1ba67fc640 1 -- 172.21.15.112:0/111803243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8102ed0 msgr2=0x7f1ba8113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:39:14.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1ba67fc640 1 --2- 172.21.15.112:0/111803243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8102ed0 0x7f1ba8113780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-19T09:39:14.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1ba67fc640 1 --2- 172.21.15.112:0/111803243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8102ed0 0x7f1ba8113780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:39:14.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1ba6ffd640 1 -- 172.21.15.112:0/111803243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8102ed0 msgr2=0x7f1ba8113780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:39:14.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1ba6ffd640 1 --2- 172.21.15.112:0/111803243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8102ed0 0x7f1ba8113780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1ba6ffd640 1 -- 172.21.15.112:0/111803243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b98005040 con 0x7f1ba8102530 2024-09-19T09:39:14.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1ba6ffd640 1 --2- 172.21.15.112:0/111803243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba8102530 0x7f1ba8113240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1b98000c00 tx=0x7f1b98009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:14.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1b8f7fe640 1 -- 172.21.15.112:0/111803243 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b98038070 con 0x7f1ba8102530 2024-09-19T09:39:14.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1b8f7fe640 1 -- 172.21.15.112:0/111803243 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1b9802ade0 con 0x7f1ba8102530 2024-09-19T09:39:14.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1bad4cd640 1 -- 172.21.15.112:0/111803243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba810d440 con 0x7f1ba8102530 2024-09-19T09:39:14.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1b8f7fe640 1 -- 172.21.15.112:0/111803243 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b9802c7e0 con 0x7f1ba8102530 2024-09-19T09:39:14.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.694+0000 7f1bad4cd640 1 -- 172.21.15.112:0/111803243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba810d980 con 0x7f1ba8102530 2024-09-19T09:39:14.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.695+0000 7f1bad4cd640 1 -- 172.21.15.112:0/111803243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba80fdcb0 con 0x7f1ba8102530 2024-09-19T09:39:14.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.696+0000 7f1b8f7fe640 1 -- 172.21.15.112:0/111803243 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f1b98030020 con 0x7f1ba8102530 2024-09-19T09:39:14.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.696+0000 7f1b8f7fe640 1 --2- 172.21.15.112:0/111803243 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1b9006e660 0x7f1b90070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.696+0000 7f1b8f7fe640 1 -- 172.21.15.112:0/111803243 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1b980adec0 con 0x7f1ba8102530 2024-09-19T09:39:14.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.696+0000 7f1ba67fc640 1 --2- 172.21.15.112:0/111803243 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1b9006e660 0x7f1b90070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.697+0000 7f1ba67fc640 1 --2- 172.21.15.112:0/111803243 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1b9006e660 0x7f1b90070b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c007fd0 tx=0x7f1b9c009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:14.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.701+0000 7f1b8f7fe640 1 -- 172.21.15.112:0/111803243 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1b98076ff0 con 0x7f1ba8102530 2024-09-19T09:39:14.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.885+0000 7f1bad4cd640 1 -- 172.21.15.112:0/111803243 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ba81095a0 con 0x7f1b9006e660 2024-09-19T09:39:14.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.887+0000 7f1b8f7fe640 1 -- 172.21.15.112:0/111803243 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f1ba81095a0 con 0x7f1b9006e660 2024-09-19T09:39:14.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.889+0000 7f1bad4cd640 1 -- 172.21.15.112:0/111803243 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1b9006e660 msgr2=0x7f1b90070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.889+0000 7f1bad4cd640 1 --2- 172.21.15.112:0/111803243 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1b9006e660 0x7f1b90070b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c007fd0 tx=0x7f1b9c009e90 comp rx=0 tx=0).stop 2024-09-19T09:39:14.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.889+0000 7f1bad4cd640 1 -- 172.21.15.112:0/111803243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba8102530 msgr2=0x7f1ba8113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.889+0000 7f1bad4cd640 1 --2- 172.21.15.112:0/111803243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba8102530 0x7f1ba8113240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1b98000c00 tx=0x7f1b98009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.889+0000 7f1bad4cd640 1 -- 172.21.15.112:0/111803243 shutdown_connections 2024-09-19T09:39:14.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.889+0000 7f1bad4cd640 1 --2- 172.21.15.112:0/111803243 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1b9006e660 0x7f1b90070b10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.889+0000 7f1bad4cd640 1 --2- 172.21.15.112:0/111803243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8102ed0 0x7f1ba8113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.889+0000 7f1bad4cd640 1 --2- 172.21.15.112:0/111803243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba8102530 0x7f1ba8113240 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.889+0000 7f1bad4cd640 1 -- 172.21.15.112:0/111803243 >> 172.21.15.112:0/111803243 conn(0x7f1ba80f80f0 msgr2=0x7f1ba80f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:14.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.889+0000 7f1bad4cd640 1 -- 172.21.15.112:0/111803243 shutdown_connections 2024-09-19T09:39:14.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.889+0000 7f1bad4cd640 1 -- 172.21.15.112:0/111803243 wait complete. 2024-09-19T09:39:14.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.967+0000 7f8d81307640 1 -- 172.21.15.112:0/922818497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7c102ef0 msgr2=0x7f8d7c0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.967+0000 7f8d81307640 1 --2- 172.21.15.112:0/922818497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7c102ef0 0x7f8d7c0fc5b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8d700048d0 tx=0x7f8d70009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.967+0000 7f8d81307640 1 -- 172.21.15.112:0/922818497 shutdown_connections 2024-09-19T09:39:14.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.967+0000 7f8d81307640 1 --2- 172.21.15.112:0/922818497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7c102ef0 0x7f8d7c0fc5b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.967+0000 7f8d81307640 1 --2- 172.21.15.112:0/922818497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d7c102550 0x7f8d7c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.967+0000 7f8d81307640 1 -- 172.21.15.112:0/922818497 >> 172.21.15.112:0/922818497 conn(0x7f8d7c0f80f0 msgr2=0x7f8d7c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:14.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.967+0000 7f8d81307640 1 -- 172.21.15.112:0/922818497 shutdown_connections 2024-09-19T09:39:14.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.967+0000 7f8d81307640 1 -- 172.21.15.112:0/922818497 wait complete. 2024-09-19T09:39:14.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.968+0000 7f8d81307640 1 Processor -- start 2024-09-19T09:39:14.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.968+0000 7f8d81307640 1 -- start start 2024-09-19T09:39:14.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.968+0000 7f8d81307640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7c102550 0x7f8d7c1134f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.968+0000 7f8d81307640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d7c102ef0 0x7f8d7c113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.968+0000 7f8d81307640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c114080 con 0x7f8d7c102550 2024-09-19T09:39:14.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.968+0000 7f8d81307640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c10d490 con 0x7f8d7c102ef0 2024-09-19T09:39:14.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.968+0000 7f8d7affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7c102550 0x7f8d7c1134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.968+0000 7f8d7affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7c102550 0x7f8d7c1134f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40434/0 (socket says 172.21.15.112:40434) 2024-09-19T09:39:14.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.968+0000 7f8d7affd640 1 -- 172.21.15.112:0/3188229465 learned_addr learned my addr 172.21.15.112:0/3188229465 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:39:14.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.968+0000 7f8d7a7fc640 1 --2- 172.21.15.112:0/3188229465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d7c102ef0 0x7f8d7c113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.968+0000 7f8d7affd640 1 -- 172.21.15.112:0/3188229465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d7c102ef0 msgr2=0x7f8d7c113a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.968+0000 7f8d7affd640 1 --2- 172.21.15.112:0/3188229465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d7c102ef0 0x7f8d7c113a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.968+0000 7f8d7affd640 1 -- 172.21.15.112:0/3188229465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d70005040 con 0x7f8d7c102550 2024-09-19T09:39:14.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.968+0000 7f8d7affd640 1 --2- 172.21.15.112:0/3188229465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7c102550 0x7f8d7c1134f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0041d0 tx=0x7f8d6c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:14.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.969+0000 7f8d637fe640 1 -- 172.21.15.112:0/3188229465 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d6c007c30 con 0x7f8d7c102550 2024-09-19T09:39:14.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.969+0000 7f8d637fe640 1 -- 172.21.15.112:0/3188229465 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8d6c00f040 con 0x7f8d7c102550 2024-09-19T09:39:14.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.969+0000 7f8d81307640 1 -- 172.21.15.112:0/3188229465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c10d770 con 0x7f8d7c102550 2024-09-19T09:39:14.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.969+0000 7f8d637fe640 1 -- 172.21.15.112:0/3188229465 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d6c0095c0 con 0x7f8d7c102550 2024-09-19T09:39:14.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.969+0000 7f8d81307640 1 -- 172.21.15.112:0/3188229465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7c10dce0 con 0x7f8d7c102550 2024-09-19T09:39:14.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.970+0000 7f8d81307640 1 -- 172.21.15.112:0/3188229465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7c0fdcd0 con 0x7f8d7c102550 2024-09-19T09:39:14.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.970+0000 7f8d637fe640 1 -- 172.21.15.112:0/3188229465 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f8d6c009720 con 0x7f8d7c102550 2024-09-19T09:39:14.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.971+0000 7f8d637fe640 1 --2- 172.21.15.112:0/3188229465 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8d6406e660 0x7f8d64070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.971+0000 7f8d637fe640 1 -- 172.21.15.112:0/3188229465 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8d6c08db50 con 0x7f8d7c102550 2024-09-19T09:39:14.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.971+0000 7f8d7a7fc640 1 --2- 172.21.15.112:0/3188229465 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8d6406e660 0x7f8d64070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.971+0000 7f8d7a7fc640 1 --2- 172.21.15.112:0/3188229465 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8d6406e660 0x7f8d64070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8d70000c00 tx=0x7f8d70035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:14.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:14.976+0000 7f8d637fe640 1 -- 172.21.15.112:0/3188229465 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8d6c056b40 con 0x7f8d7c102550 2024-09-19T09:39:15.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.150+0000 7f8d81307640 1 -- 172.21.15.112:0/3188229465 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d7c04b7b0 con 0x7f8d6406e660 2024-09-19T09:39:15.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.159+0000 7f8d637fe640 1 -- 172.21.15.112:0/3188229465 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8d7c04b7b0 con 0x7f8d6406e660 2024-09-19T09:39:15.161 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:39:15.161 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (3m) 14s ago 12m 28.2M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:39:15.161 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (12m) 14s ago 12m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1513f1075df5 2024-09-19T09:39:15.161 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (11m) 2s ago 11m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6c313b300b35 2024-09-19T09:39:15.161 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (104s) 14s ago 11m 76.3M - 9.4.12 2bacad6d85d8 e462aca2b022 2024-09-19T09:39:15.161 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (6m) 14s ago 6m 154M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:39:15.161 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (6m) 14s ago 6m 106M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:39:15.162 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (6m) 2s ago 6m 13.4M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:39:15.162 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (6m) 2s ago 6m 15.9M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:39:15.162 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (3m) 14s ago 13m 473M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:39:15.162 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283,8765 running (2m) 2s ago 11m 438M - 19.1.1-361-g2f599a46 d2baa855c067 fddba1bee64a 2024-09-19T09:39:15.162 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (27s) 14s ago 13m 26.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 89dfb5de44c8 2024-09-19T09:39:15.162 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (5s) 2s ago 11m 23.1M 2048M 19.1.1-361-g2f599a46 d2baa855c067 3cab8f7cc27e 2024-09-19T09:39:15.162 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (4m) 14s ago 12m 16.0M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:39:15.162 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (3m) 2s ago 11m 15.6M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:39:15.162 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (10m) 14s ago 10m 230M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 621693067dce 2024-09-19T09:39:15.162 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (9m) 14s ago 9m 248M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1742e5964367 2024-09-19T09:39:15.162 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (9m) 14s ago 9m 212M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 4dcca18af229 2024-09-19T09:39:15.162 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (9m) 2s ago 9m 271M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:39:15.162 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (8m) 2s ago 8m 239M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:39:15.163 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (8m) 2s ago 8m 225M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:39:15.163 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (2m) 14s ago 11m 61.4M - 2.43.0 a07b618ecd1d 54850883a171 2024-09-19T09:39:15.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.161+0000 7f8d81307640 1 -- 172.21.15.112:0/3188229465 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8d6406e660 msgr2=0x7f8d64070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:15.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.161+0000 7f8d81307640 1 --2- 172.21.15.112:0/3188229465 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8d6406e660 0x7f8d64070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8d70000c00 tx=0x7f8d70035040 comp rx=0 tx=0).stop 2024-09-19T09:39:15.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.161+0000 7f8d81307640 1 -- 172.21.15.112:0/3188229465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7c102550 msgr2=0x7f8d7c1134f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:15.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.161+0000 7f8d81307640 1 --2- 172.21.15.112:0/3188229465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7c102550 0x7f8d7c1134f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0041d0 tx=0x7f8d6c004600 comp rx=0 tx=0).stop 2024-09-19T09:39:15.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.161+0000 7f8d81307640 1 -- 172.21.15.112:0/3188229465 shutdown_connections 2024-09-19T09:39:15.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.161+0000 7f8d81307640 1 --2- 172.21.15.112:0/3188229465 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8d6406e660 0x7f8d64070b10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.161+0000 7f8d81307640 1 --2- 172.21.15.112:0/3188229465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d7c102ef0 0x7f8d7c113a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.161+0000 7f8d81307640 1 --2- 172.21.15.112:0/3188229465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7c102550 0x7f8d7c1134f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.161+0000 7f8d81307640 1 -- 172.21.15.112:0/3188229465 >> 172.21.15.112:0/3188229465 conn(0x7f8d7c0f80f0 msgr2=0x7f8d7c0f9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:15.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.161+0000 7f8d81307640 1 -- 172.21.15.112:0/3188229465 shutdown_connections 2024-09-19T09:39:15.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.161+0000 7f8d81307640 1 -- 172.21.15.112:0/3188229465 wait complete. 2024-09-19T09:39:15.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.238+0000 7f30b28d4640 1 -- 172.21.15.112:0/776571781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30ac102fc0 msgr2=0x7f30ac0facf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:15.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.238+0000 7f30b28d4640 1 --2- 172.21.15.112:0/776571781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30ac102fc0 0x7f30ac0facf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f30940048d0 tx=0x7f3094009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.238+0000 7f30b28d4640 1 -- 172.21.15.112:0/776571781 shutdown_connections 2024-09-19T09:39:15.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.238+0000 7f30b28d4640 1 --2- 172.21.15.112:0/776571781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30ac102fc0 0x7f30ac0facf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.238+0000 7f30b28d4640 1 --2- 172.21.15.112:0/776571781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f30ac102620 0x7f30ac1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.238+0000 7f30b28d4640 1 -- 172.21.15.112:0/776571781 >> 172.21.15.112:0/776571781 conn(0x7f30ac070d50 msgr2=0x7f30ac071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:15.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.238+0000 7f30b28d4640 1 -- 172.21.15.112:0/776571781 shutdown_connections 2024-09-19T09:39:15.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.238+0000 7f30b28d4640 1 -- 172.21.15.112:0/776571781 wait complete. 2024-09-19T09:39:15.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.239+0000 7f30b28d4640 1 Processor -- start 2024-09-19T09:39:15.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.239+0000 7f30b28d4640 1 -- start start 2024-09-19T09:39:15.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.239+0000 7f30b28d4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f30ac102620 0x7f30ac113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:15.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.239+0000 7f30b28d4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30ac102fc0 0x7f30ac113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:15.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.239+0000 7f30b28d4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac113d80 con 0x7f30ac102fc0 2024-09-19T09:39:15.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.239+0000 7f30b28d4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac10d1c0 con 0x7f30ac102620 2024-09-19T09:39:15.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.239+0000 7f30ab7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30ac102fc0 0x7f30ac113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:15.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.239+0000 7f30ab7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30ac102fc0 0x7f30ac113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40454/0 (socket says 172.21.15.112:40454) 2024-09-19T09:39:15.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.239+0000 7f30ab7fe640 1 -- 172.21.15.112:0/1123691904 learned_addr learned my addr 172.21.15.112:0/1123691904 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:39:15.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.239+0000 7f30abfff640 1 --2- 172.21.15.112:0/1123691904 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f30ac102620 0x7f30ac113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:15.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.240+0000 7f30ab7fe640 1 -- 172.21.15.112:0/1123691904 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f30ac102620 msgr2=0x7f30ac113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:15.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.240+0000 7f30ab7fe640 1 --2- 172.21.15.112:0/1123691904 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f30ac102620 0x7f30ac113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.240+0000 7f30ab7fe640 1 -- 172.21.15.112:0/1123691904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3094005040 con 0x7f30ac102fc0 2024-09-19T09:39:15.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.240+0000 7f30ab7fe640 1 --2- 172.21.15.112:0/1123691904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30ac102fc0 0x7f30ac113780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f30940043d0 tx=0x7f3094009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:15.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.240+0000 7f30a8ff9640 1 -- 172.21.15.112:0/1123691904 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3094038070 con 0x7f30ac102fc0 2024-09-19T09:39:15.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.240+0000 7f30b28d4640 1 -- 172.21.15.112:0/1123691904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ac10d440 con 0x7f30ac102fc0 2024-09-19T09:39:15.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.240+0000 7f30a8ff9640 1 -- 172.21.15.112:0/1123691904 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f30940096e0 con 0x7f30ac102fc0 2024-09-19T09:39:15.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.240+0000 7f30a8ff9640 1 -- 172.21.15.112:0/1123691904 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f309402c8a0 con 0x7f30ac102fc0 2024-09-19T09:39:15.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.240+0000 7f30b28d4640 1 -- 172.21.15.112:0/1123691904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ac10d900 con 0x7f30ac102fc0 2024-09-19T09:39:15.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.242+0000 7f30b28d4640 1 -- 172.21.15.112:0/1123691904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ac0657c0 con 0x7f30ac102fc0 2024-09-19T09:39:15.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.242+0000 7f30a8ff9640 1 -- 172.21.15.112:0/1123691904 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f3094030020 con 0x7f30ac102fc0 2024-09-19T09:39:15.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.242+0000 7f30a8ff9640 1 --2- 172.21.15.112:0/1123691904 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f309806e660 0x7f3098070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:15.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.243+0000 7f30abfff640 1 --2- 172.21.15.112:0/1123691904 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f309806e660 0x7f3098070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:15.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.243+0000 7f30a8ff9640 1 -- 172.21.15.112:0/1123691904 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f30940adf20 con 0x7f30ac102fc0 2024-09-19T09:39:15.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.243+0000 7f30abfff640 1 --2- 172.21.15.112:0/1123691904 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f309806e660 0x7f3098070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f309c004eb0 tx=0x7f309c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:15.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.247+0000 7f30a8ff9640 1 -- 172.21.15.112:0/1123691904 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f30940e3210 con 0x7f30ac102fc0 2024-09-19T09:39:15.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.475+0000 7f30b28d4640 1 -- 172.21.15.112:0/1123691904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f30ac109610 con 0x7f30ac102fc0 2024-09-19T09:39:15.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.476+0000 7f30a8ff9640 1 -- 172.21.15.112:0/1123691904 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7f30940770d0 con 0x7f30ac102fc0 2024-09-19T09:39:15.478 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:39:15.478 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:39:15.478 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:39:15.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:39:15.478 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:39:15.478 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:39:15.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:39:15.478 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:39:15.479 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T09:39:15.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:39:15.479 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:39:15.479 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:39:15.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:39:15.479 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:39:15.479 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 10, 2024-09-19T09:39:15.479 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T09:39:15.479 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:39:15.479 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:39:15.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.478+0000 7f30b28d4640 1 -- 172.21.15.112:0/1123691904 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f309806e660 msgr2=0x7f3098070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:15.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.478+0000 7f30b28d4640 1 --2- 172.21.15.112:0/1123691904 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f309806e660 0x7f3098070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f309c004eb0 tx=0x7f309c00b040 comp rx=0 tx=0).stop 2024-09-19T09:39:15.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.478+0000 7f30b28d4640 1 -- 172.21.15.112:0/1123691904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30ac102fc0 msgr2=0x7f30ac113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:15.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.478+0000 7f30b28d4640 1 --2- 172.21.15.112:0/1123691904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30ac102fc0 0x7f30ac113780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f30940043d0 tx=0x7f3094009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.478+0000 7f30b28d4640 1 -- 172.21.15.112:0/1123691904 shutdown_connections 2024-09-19T09:39:15.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.478+0000 7f30b28d4640 1 --2- 172.21.15.112:0/1123691904 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f309806e660 0x7f3098070b10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.478+0000 7f30b28d4640 1 --2- 172.21.15.112:0/1123691904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30ac102fc0 0x7f30ac113780 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.478+0000 7f30b28d4640 1 --2- 172.21.15.112:0/1123691904 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f30ac102620 0x7f30ac113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.478+0000 7f30b28d4640 1 -- 172.21.15.112:0/1123691904 >> 172.21.15.112:0/1123691904 conn(0x7f30ac070d50 msgr2=0x7f30ac0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:15.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.478+0000 7f30b28d4640 1 -- 172.21.15.112:0/1123691904 shutdown_connections 2024-09-19T09:39:15.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.478+0000 7f30b28d4640 1 -- 172.21.15.112:0/1123691904 wait complete. 2024-09-19T09:39:15.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.555+0000 7f45496c7640 1 -- 172.21.15.112:0/1218817620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45440fd5c0 msgr2=0x7f45440fd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:15.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.555+0000 7f45496c7640 1 --2- 172.21.15.112:0/1218817620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45440fd5c0 0x7f45440fd990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f45340048d0 tx=0x7f4534009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.555+0000 7f45496c7640 1 -- 172.21.15.112:0/1218817620 shutdown_connections 2024-09-19T09:39:15.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.555+0000 7f45496c7640 1 --2- 172.21.15.112:0/1218817620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45440fdf60 0x7f4544106630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.555+0000 7f45496c7640 1 --2- 172.21.15.112:0/1218817620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45440fd5c0 0x7f45440fd990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.555+0000 7f45496c7640 1 -- 172.21.15.112:0/1218817620 >> 172.21.15.112:0/1218817620 conn(0x7f45440f7060 msgr2=0x7f45440f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:15.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.555+0000 7f45496c7640 1 -- 172.21.15.112:0/1218817620 shutdown_connections 2024-09-19T09:39:15.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.555+0000 7f45496c7640 1 -- 172.21.15.112:0/1218817620 wait complete. 2024-09-19T09:39:15.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.556+0000 7f45496c7640 1 Processor -- start 2024-09-19T09:39:15.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.556+0000 7f45496c7640 1 -- start start 2024-09-19T09:39:15.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.556+0000 7f45496c7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45440fd5c0 0x7f45441154b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:15.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.556+0000 7f45496c7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45440fdf60 0x7f45441159f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:15.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.556+0000 7f45496c7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45441160d0 con 0x7f45440fd5c0 2024-09-19T09:39:15.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.556+0000 7f45496c7640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454410f450 con 0x7f45440fdf60 2024-09-19T09:39:15.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.556+0000 7f4542ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45440fd5c0 0x7f45441154b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:15.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.556+0000 7f4542ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45440fd5c0 0x7f45441154b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40472/0 (socket says 172.21.15.112:40472) 2024-09-19T09:39:15.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.556+0000 7f4542ffd640 1 -- 172.21.15.112:0/4082431600 learned_addr learned my addr 172.21.15.112:0/4082431600 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:39:15.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.556+0000 7f45427fc640 1 --2- 172.21.15.112:0/4082431600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45440fdf60 0x7f45441159f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:15.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.556+0000 7f4542ffd640 1 -- 172.21.15.112:0/4082431600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45440fdf60 msgr2=0x7f45441159f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:15.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.556+0000 7f4542ffd640 1 --2- 172.21.15.112:0/4082431600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45440fdf60 0x7f45441159f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.556+0000 7f4542ffd640 1 -- 172.21.15.112:0/4082431600 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4534005040 con 0x7f45440fd5c0 2024-09-19T09:39:15.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.557+0000 7f4542ffd640 1 --2- 172.21.15.112:0/4082431600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45440fd5c0 0x7f45441154b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4534004930 tx=0x7f4534009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:15.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.557+0000 7f452b7fe640 1 -- 172.21.15.112:0/4082431600 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4534038070 con 0x7f45440fd5c0 2024-09-19T09:39:15.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.557+0000 7f452b7fe640 1 -- 172.21.15.112:0/4082431600 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4534032d00 con 0x7f45440fd5c0 2024-09-19T09:39:15.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.557+0000 7f45496c7640 1 -- 172.21.15.112:0/4082431600 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454410f680 con 0x7f45440fd5c0 2024-09-19T09:39:15.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.557+0000 7f452b7fe640 1 -- 172.21.15.112:0/4082431600 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45340095c0 con 0x7f45440fd5c0 2024-09-19T09:39:15.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.557+0000 7f45496c7640 1 -- 172.21.15.112:0/4082431600 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454410fb40 con 0x7f45440fd5c0 2024-09-19T09:39:15.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.558+0000 7f45496c7640 1 -- 172.21.15.112:0/4082431600 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4544066290 con 0x7f45440fd5c0 2024-09-19T09:39:15.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.558+0000 7f452b7fe640 1 -- 172.21.15.112:0/4082431600 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f4534030020 con 0x7f45440fd5c0 2024-09-19T09:39:15.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.559+0000 7f452b7fe640 1 --2- 172.21.15.112:0/4082431600 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f452c06e660 0x7f452c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:15.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.559+0000 7f452b7fe640 1 -- 172.21.15.112:0/4082431600 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f45340ae120 con 0x7f45440fd5c0 2024-09-19T09:39:15.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.559+0000 7f45427fc640 1 --2- 172.21.15.112:0/4082431600 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f452c06e660 0x7f452c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:15.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.560+0000 7f45427fc640 1 --2- 172.21.15.112:0/4082431600 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f452c06e660 0x7f452c070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4538006fd0 tx=0x7f4538008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:15.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.563+0000 7f452b7fe640 1 -- 172.21.15.112:0/4082431600 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f45340771a0 con 0x7f45440fd5c0 2024-09-19T09:39:15.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.761+0000 7f45496c7640 1 -- 172.21.15.112:0/4082431600 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f45440fac60 con 0x7f45440fd5c0 2024-09-19T09:39:15.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.761+0000 7f452b7fe640 1 -- 172.21.15.112:0/4082431600 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1949 (secure 0 0 0) 0x7f453403e080 con 0x7f45440fd5c0 2024-09-19T09:39:15.764 INFO:teuthology.orchestra.run.smithi112.stdout:e17 2024-09-19T09:39:15.764 INFO:teuthology.orchestra.run.smithi112.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:39:15.764 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:39:15.764 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:39:15.764 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-19T09:39:15.764 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:39:15.764 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:39:15.764 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-19T09:39:15.764 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 17 2024-09-19T09:39:15.764 INFO:teuthology.orchestra.run.smithi112.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:39:15.764 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:39:15.764 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-19T09:32:42.200999+0000 2024-09-19T09:39:15.765 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-19T09:39:15.765 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-19T09:39:15.765 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-19T09:39:15.765 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-19T09:39:15.765 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-19T09:39:15.765 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-19T09:39:15.765 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-19T09:39:15.765 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-19T09:39:15.765 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 45 2024-09-19T09:39:15.765 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:39:15.765 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-19T09:39:15.765 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-19T09:39:15.766 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14460} 2024-09-19T09:39:15.766 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-19T09:39:15.766 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-19T09:39:15.766 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-19T09:39:15.766 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-19T09:39:15.766 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-19T09:39:15.766 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data disabled 2024-09-19T09:39:15.766 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-19T09:39:15.766 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-19T09:39:15.766 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-19T09:39:15.766 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:39:15.766 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.hcoxjz{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:39:15.767 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ymjyok{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/3468750429,v1:172.21.15.112:6827/3468750429] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:39:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:39:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:39:15.767 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-19T09:39:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:39:15.767 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.qweljt{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:39:15.767 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.jjldod{-1:24281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6824/2759077122,v1:172.21.15.191:6825/2759077122] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:39:15.768 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2024-09-19T09:39:15.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.763+0000 7f45496c7640 1 -- 172.21.15.112:0/4082431600 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f452c06e660 msgr2=0x7f452c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:15.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.763+0000 7f45496c7640 1 --2- 172.21.15.112:0/4082431600 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f452c06e660 0x7f452c070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4538006fd0 tx=0x7f4538008040 comp rx=0 tx=0).stop 2024-09-19T09:39:15.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.763+0000 7f45496c7640 1 -- 172.21.15.112:0/4082431600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45440fd5c0 msgr2=0x7f45441154b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:15.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.763+0000 7f45496c7640 1 --2- 172.21.15.112:0/4082431600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45440fd5c0 0x7f45441154b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4534004930 tx=0x7f4534009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.763+0000 7f45496c7640 1 -- 172.21.15.112:0/4082431600 shutdown_connections 2024-09-19T09:39:15.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.763+0000 7f45496c7640 1 --2- 172.21.15.112:0/4082431600 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f452c06e660 0x7f452c070b10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.763+0000 7f45496c7640 1 --2- 172.21.15.112:0/4082431600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45440fdf60 0x7f45441159f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.763+0000 7f45496c7640 1 --2- 172.21.15.112:0/4082431600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45440fd5c0 0x7f45441154b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.764+0000 7f45496c7640 1 -- 172.21.15.112:0/4082431600 >> 172.21.15.112:0/4082431600 conn(0x7f45440f7060 msgr2=0x7f45440fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:15.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.764+0000 7f45496c7640 1 -- 172.21.15.112:0/4082431600 shutdown_connections 2024-09-19T09:39:15.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.764+0000 7f45496c7640 1 -- 172.21.15.112:0/4082431600 wait complete. 2024-09-19T09:39:15.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.842+0000 7f542b0a0640 1 -- 172.21.15.112:0/1411095335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54240fcf80 msgr2=0x7f54240fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:15.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.842+0000 7f542b0a0640 1 --2- 172.21.15.112:0/1411095335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54240fcf80 0x7f54240fd3d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f54100048d0 tx=0x7f5410009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.843+0000 7f542b0a0640 1 -- 172.21.15.112:0/1411095335 shutdown_connections 2024-09-19T09:39:15.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.843+0000 7f542b0a0640 1 --2- 172.21.15.112:0/1411095335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54240fcf80 0x7f54240fd3d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.843+0000 7f542b0a0640 1 --2- 172.21.15.112:0/1411095335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54240fb810 0x7f54240fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.843+0000 7f542b0a0640 1 -- 172.21.15.112:0/1411095335 >> 172.21.15.112:0/1411095335 conn(0x7f54240723b0 msgr2=0x7f54240727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:15.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.843+0000 7f542b0a0640 1 -- 172.21.15.112:0/1411095335 shutdown_connections 2024-09-19T09:39:15.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.843+0000 7f542b0a0640 1 -- 172.21.15.112:0/1411095335 wait complete. 2024-09-19T09:39:15.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.843+0000 7f542b0a0640 1 Processor -- start 2024-09-19T09:39:15.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.843+0000 7f542b0a0640 1 -- start start 2024-09-19T09:39:15.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f542b0a0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54240fb810 0x7f542410df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:15.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f542b0a0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54240fcf80 0x7f542410e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:15.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f542b0a0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542410eac0 con 0x7f54240fb810 2024-09-19T09:39:15.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f542b0a0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542410ec30 con 0x7f54240fcf80 2024-09-19T09:39:15.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f5428e3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54240fb810 0x7f542410df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f5428e3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54240fb810 0x7f542410df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40488/0 (socket says 172.21.15.112:40488) 2024-09-19T09:39:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f5428e3c640 1 -- 172.21.15.112:0/336180051 learned_addr learned my addr 172.21.15.112:0/336180051 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:39:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f5423fff640 1 --2- 172.21.15.112:0/336180051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54240fcf80 0x7f542410e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f5428e3c640 1 -- 172.21.15.112:0/336180051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54240fcf80 msgr2=0x7f542410e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f5428e3c640 1 --2- 172.21.15.112:0/336180051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54240fcf80 0x7f542410e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f5428e3c640 1 -- 172.21.15.112:0/336180051 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5410005040 con 0x7f54240fb810 2024-09-19T09:39:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f5428e3c640 1 --2- 172.21.15.112:0/336180051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54240fb810 0x7f542410df30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5418002a80 tx=0x7f5418004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f54217fa640 1 -- 172.21.15.112:0/336180051 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5418007c30 con 0x7f54240fb810 2024-09-19T09:39:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f54217fa640 1 -- 172.21.15.112:0/336180051 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f541800f040 con 0x7f54240fb810 2024-09-19T09:39:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f542b0a0640 1 -- 172.21.15.112:0/336180051 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5424116fa0 con 0x7f54240fb810 2024-09-19T09:39:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.844+0000 7f54217fa640 1 -- 172.21.15.112:0/336180051 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f541800dab0 con 0x7f54240fb810 2024-09-19T09:39:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.845+0000 7f542b0a0640 1 -- 172.21.15.112:0/336180051 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54241173e0 con 0x7f54240fb810 2024-09-19T09:39:15.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.845+0000 7f542b0a0640 1 -- 172.21.15.112:0/336180051 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54240fcbc0 con 0x7f54240fb810 2024-09-19T09:39:15.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.846+0000 7f54217fa640 1 -- 172.21.15.112:0/336180051 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f541800dc30 con 0x7f54240fb810 2024-09-19T09:39:15.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.846+0000 7f54217fa640 1 --2- 172.21.15.112:0/336180051 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f541406e660 0x7f5414070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:15.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.847+0000 7f54217fa640 1 -- 172.21.15.112:0/336180051 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f541808db60 con 0x7f54240fb810 2024-09-19T09:39:15.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.847+0000 7f5423fff640 1 --2- 172.21.15.112:0/336180051 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f541406e660 0x7f5414070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:15.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.847+0000 7f5423fff640 1 --2- 172.21.15.112:0/336180051 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f541406e660 0x7f5414070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5410000c00 tx=0x7f5410035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:15.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:15.851+0000 7f54217fa640 1 -- 172.21.15.112:0/336180051 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5418056b80 con 0x7f54240fb810 2024-09-19T09:39:16.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.036+0000 7f542b0a0640 1 -- 172.21.15.112:0/336180051 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5424065730 con 0x7f541406e660 2024-09-19T09:39:16.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.037+0000 7f54217fa640 1 -- 172.21.15.112:0/336180051 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f5424065730 con 0x7f541406e660 2024-09-19T09:39:16.039 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:39:16.039 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:39:16.039 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:39:16.039 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:39:16.039 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-19T09:39:16.039 INFO:teuthology.orchestra.run.smithi112.stdout: "mon", 2024-09-19T09:39:16.039 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr" 2024-09-19T09:39:16.039 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-19T09:39:16.039 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "4/21 daemons upgraded", 2024-09-19T09:39:16.039 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading mon daemons", 2024-09-19T09:39:16.039 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:39:16.040 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:39:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.039+0000 7f542b0a0640 1 -- 172.21.15.112:0/336180051 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f541406e660 msgr2=0x7f5414070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.039+0000 7f542b0a0640 1 --2- 172.21.15.112:0/336180051 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f541406e660 0x7f5414070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5410000c00 tx=0x7f5410035040 comp rx=0 tx=0).stop 2024-09-19T09:39:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.039+0000 7f542b0a0640 1 -- 172.21.15.112:0/336180051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54240fb810 msgr2=0x7f542410df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.039+0000 7f542b0a0640 1 --2- 172.21.15.112:0/336180051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54240fb810 0x7f542410df30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5418002a80 tx=0x7f5418004600 comp rx=0 tx=0).stop 2024-09-19T09:39:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.039+0000 7f542b0a0640 1 -- 172.21.15.112:0/336180051 shutdown_connections 2024-09-19T09:39:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.039+0000 7f542b0a0640 1 --2- 172.21.15.112:0/336180051 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f541406e660 0x7f5414070b10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.039+0000 7f542b0a0640 1 --2- 172.21.15.112:0/336180051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54240fcf80 0x7f542410e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.039+0000 7f542b0a0640 1 --2- 172.21.15.112:0/336180051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54240fb810 0x7f542410df30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.039+0000 7f542b0a0640 1 -- 172.21.15.112:0/336180051 >> 172.21.15.112:0/336180051 conn(0x7f54240723b0 msgr2=0x7f54240fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:16.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.039+0000 7f542b0a0640 1 -- 172.21.15.112:0/336180051 shutdown_connections 2024-09-19T09:39:16.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.039+0000 7f542b0a0640 1 -- 172.21.15.112:0/336180051 wait complete. 2024-09-19T09:39:16.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.116+0000 7f3bf1569640 1 -- 172.21.15.112:0/2324142620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bec0fae90 msgr2=0x7f3bec0fb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:16.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.116+0000 7f3bf1569640 1 --2- 172.21.15.112:0/2324142620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bec0fae90 0x7f3bec0fb260 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0048d0 tx=0x7f3bdc009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.116+0000 7f3bf1569640 1 -- 172.21.15.112:0/2324142620 shutdown_connections 2024-09-19T09:39:16.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.116+0000 7f3bf1569640 1 --2- 172.21.15.112:0/2324142620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bec0fb7a0 0x7f3bec10cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.116+0000 7f3bf1569640 1 --2- 172.21.15.112:0/2324142620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bec0fae90 0x7f3bec0fb260 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.116+0000 7f3bf1569640 1 -- 172.21.15.112:0/2324142620 >> 172.21.15.112:0/2324142620 conn(0x7f3bec070c80 msgr2=0x7f3bec071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:16.119 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:15 smithi112 ceph-mon[97503]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:16.119 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:15 smithi112 ceph-mon[97503]: pgmap v13: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:16.119 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:15 smithi112 ceph-mon[97503]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:16.119 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:15 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/1123691904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:16.119 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:15 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/4082431600' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:39:16.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.116+0000 7f3bf1569640 1 -- 172.21.15.112:0/2324142620 shutdown_connections 2024-09-19T09:39:16.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.116+0000 7f3bf1569640 1 -- 172.21.15.112:0/2324142620 wait complete. 2024-09-19T09:39:16.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.117+0000 7f3bf1569640 1 Processor -- start 2024-09-19T09:39:16.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.117+0000 7f3bf1569640 1 -- start start 2024-09-19T09:39:16.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.117+0000 7f3bf1569640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bec0fae90 0x7f3bec119780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:16.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.117+0000 7f3bf1569640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bec0fb7a0 0x7f3bec119cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:16.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.117+0000 7f3bf1569640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec11a310 con 0x7f3bec0fb7a0 2024-09-19T09:39:16.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.117+0000 7f3bf1569640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec113720 con 0x7f3bec0fae90 2024-09-19T09:39:16.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.117+0000 7f3be3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bec0fb7a0 0x7f3bec119cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:16.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.117+0000 7f3be3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bec0fb7a0 0x7f3bec119cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40518/0 (socket says 172.21.15.112:40518) 2024-09-19T09:39:16.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.117+0000 7f3be3fff640 1 -- 172.21.15.112:0/1409297857 learned_addr learned my addr 172.21.15.112:0/1409297857 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:39:16.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.117+0000 7f3beaffd640 1 --2- 172.21.15.112:0/1409297857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bec0fae90 0x7f3bec119780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:16.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.118+0000 7f3be3fff640 1 -- 172.21.15.112:0/1409297857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bec0fae90 msgr2=0x7f3bec119780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:16.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.118+0000 7f3be3fff640 1 --2- 172.21.15.112:0/1409297857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bec0fae90 0x7f3bec119780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.118+0000 7f3be3fff640 1 -- 172.21.15.112:0/1409297857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc005040 con 0x7f3bec0fb7a0 2024-09-19T09:39:16.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.118+0000 7f3beaffd640 1 --2- 172.21.15.112:0/1409297857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bec0fae90 0x7f3bec119780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:16.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.118+0000 7f3be3fff640 1 --2- 172.21.15.112:0/1409297857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bec0fb7a0 0x7f3bec119cc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400c830 tx=0x7f3bd4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:16.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.118+0000 7f3be37fe640 1 -- 172.21.15.112:0/1409297857 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bd400a850 con 0x7f3bec0fb7a0 2024-09-19T09:39:16.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.118+0000 7f3bf1569640 1 -- 172.21.15.112:0/1409297857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bec113a00 con 0x7f3bec0fb7a0 2024-09-19T09:39:16.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.118+0000 7f3be37fe640 1 -- 172.21.15.112:0/1409297857 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3bd400ae50 con 0x7f3bec0fb7a0 2024-09-19T09:39:16.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.118+0000 7f3be37fe640 1 -- 172.21.15.112:0/1409297857 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bd40113a0 con 0x7f3bec0fb7a0 2024-09-19T09:39:16.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.118+0000 7f3bf1569640 1 -- 172.21.15.112:0/1409297857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bec113fa0 con 0x7f3bec0fb7a0 2024-09-19T09:39:16.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.119+0000 7f3bf1569640 1 -- 172.21.15.112:0/1409297857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bec0fbc70 con 0x7f3bec0fb7a0 2024-09-19T09:39:16.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.120+0000 7f3be37fe640 1 -- 172.21.15.112:0/1409297857 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f3bd400a9b0 con 0x7f3bec0fb7a0 2024-09-19T09:39:16.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.120+0000 7f3be37fe640 1 --2- 172.21.15.112:0/1409297857 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3bd806e660 0x7f3bd8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:16.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.121+0000 7f3be37fe640 1 -- 172.21.15.112:0/1409297857 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3bd408e4b0 con 0x7f3bec0fb7a0 2024-09-19T09:39:16.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.121+0000 7f3beaffd640 1 --2- 172.21.15.112:0/1409297857 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3bd806e660 0x7f3bd8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:16.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.121+0000 7f3beaffd640 1 --2- 172.21.15.112:0/1409297857 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3bd806e660 0x7f3bd8070b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc000c00 tx=0x7f3bdc009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:16.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.125+0000 7f3be37fe640 1 -- 172.21.15.112:0/1409297857 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3bd40575b0 con 0x7f3bec0fb7a0 2024-09-19T09:39:16.165 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:15 smithi191 ceph-mon[77624]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:16.166 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:15 smithi191 ceph-mon[77624]: pgmap v13: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:16.166 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:15 smithi191 ceph-mon[77624]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:16.166 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:15 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/1123691904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:16.166 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:15 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/4082431600' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:39:16.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.356+0000 7f3bf1569640 1 -- 172.21.15.112:0/1409297857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3bec10fb90 con 0x7f3bec0fb7a0 2024-09-19T09:39:16.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.356+0000 7f3be37fe640 1 -- 172.21.15.112:0/1409297857 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3bd405ac70 con 0x7f3bec0fb7a0 2024-09-19T09:39:16.358 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_OK 2024-09-19T09:39:16.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.358+0000 7f3bf1569640 1 -- 172.21.15.112:0/1409297857 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3bd806e660 msgr2=0x7f3bd8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:16.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.358+0000 7f3bf1569640 1 --2- 172.21.15.112:0/1409297857 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3bd806e660 0x7f3bd8070b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc000c00 tx=0x7f3bdc009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.358+0000 7f3bf1569640 1 -- 172.21.15.112:0/1409297857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bec0fb7a0 msgr2=0x7f3bec119cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:16.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.358+0000 7f3bf1569640 1 --2- 172.21.15.112:0/1409297857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bec0fb7a0 0x7f3bec119cc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400c830 tx=0x7f3bd4004430 comp rx=0 tx=0).stop 2024-09-19T09:39:16.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.358+0000 7f3bf1569640 1 -- 172.21.15.112:0/1409297857 shutdown_connections 2024-09-19T09:39:16.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.358+0000 7f3bf1569640 1 --2- 172.21.15.112:0/1409297857 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3bd806e660 0x7f3bd8070b10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.358+0000 7f3bf1569640 1 --2- 172.21.15.112:0/1409297857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bec0fb7a0 0x7f3bec119cc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.358+0000 7f3bf1569640 1 --2- 172.21.15.112:0/1409297857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bec0fae90 0x7f3bec119780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.358+0000 7f3bf1569640 1 -- 172.21.15.112:0/1409297857 >> 172.21.15.112:0/1409297857 conn(0x7f3bec070c80 msgr2=0x7f3bec0f9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:16.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.359+0000 7f3bf1569640 1 -- 172.21.15.112:0/1409297857 shutdown_connections 2024-09-19T09:39:16.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:16.359+0000 7f3bf1569640 1 -- 172.21.15.112:0/1409297857 wait complete. 2024-09-19T09:39:17.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:16 smithi112 ceph-mon[97503]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:17.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:16 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/1409297857' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:39:17.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:16 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:17.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:16 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:17.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:16 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:17.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:16 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:39:17.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:16 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:17.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:16 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:39:17.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:16 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:39:17.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:16 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:17.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:16 smithi191 ceph-mon[77624]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:16 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/1409297857' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:39:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:16 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:16 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:16 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:16 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:39:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:16 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:16 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:39:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:16 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:39:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:16 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:18.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:17 smithi112 ceph-mon[97503]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:17 smithi112 ceph-mon[97503]: Detected new or changed devices on smithi191 2024-09-19T09:39:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:17 smithi112 ceph-mon[97503]: Reconfiguring mon.smithi112 (monmap changed)... 2024-09-19T09:39:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:17 smithi112 ceph-mon[97503]: Reconfiguring daemon mon.smithi112 on smithi112 2024-09-19T09:39:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:17 smithi112 ceph-mon[97503]: pgmap v14: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.puhuua", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:39:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:39:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:17 smithi191 ceph-mon[77624]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:17 smithi191 ceph-mon[77624]: Detected new or changed devices on smithi191 2024-09-19T09:39:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:17 smithi191 ceph-mon[77624]: Reconfiguring mon.smithi112 (monmap changed)... 2024-09-19T09:39:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:17 smithi191 ceph-mon[77624]: Reconfiguring daemon mon.smithi112 on smithi112 2024-09-19T09:39:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:17 smithi191 ceph-mon[77624]: pgmap v14: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.puhuua", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:39:18.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:39:18.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:19.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:18 smithi112 ceph-mon[97503]: Reconfiguring mgr.smithi112.puhuua (monmap changed)... 2024-09-19T09:39:19.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:18 smithi112 ceph-mon[97503]: Reconfiguring daemon mgr.smithi112.puhuua on smithi112 2024-09-19T09:39:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:18 smithi191 ceph-mon[77624]: Reconfiguring mgr.smithi112.puhuua (monmap changed)... 2024-09-19T09:39:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:18 smithi191 ceph-mon[77624]: Reconfiguring daemon mgr.smithi112.puhuua on smithi112 2024-09-19T09:39:20.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:19 smithi112 ceph-mon[97503]: pgmap v15: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:20.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:20.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:20.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:39:20.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:20.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:19 smithi191 ceph-mon[77624]: pgmap v15: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:20.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:20.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:20.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:39:20.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:21.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:20 smithi112 ceph-mon[97503]: Reconfiguring crash.smithi112 (monmap changed)... 2024-09-19T09:39:21.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:20 smithi112 ceph-mon[97503]: Reconfiguring daemon crash.smithi112 on smithi112 2024-09-19T09:39:21.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:20 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:21.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:20 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:21.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:20 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:39:21.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:20 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:21.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:20 smithi191 ceph-mon[77624]: Reconfiguring crash.smithi112 (monmap changed)... 2024-09-19T09:39:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:20 smithi191 ceph-mon[77624]: Reconfiguring daemon crash.smithi112 on smithi112 2024-09-19T09:39:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:20 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:20 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:20 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:39:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:20 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:22.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:21 smithi112 ceph-mon[97503]: Reconfiguring osd.0 (monmap changed)... 2024-09-19T09:39:22.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:21 smithi112 ceph-mon[97503]: Reconfiguring daemon osd.0 on smithi112 2024-09-19T09:39:22.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:21 smithi112 ceph-mon[97503]: pgmap v16: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:22.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:21 smithi191 ceph-mon[77624]: Reconfiguring osd.0 (monmap changed)... 2024-09-19T09:39:22.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:21 smithi191 ceph-mon[77624]: Reconfiguring daemon osd.0 on smithi112 2024-09-19T09:39:22.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:21 smithi191 ceph-mon[77624]: pgmap v16: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:23.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:23 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:23.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:23 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:23.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:23 smithi112 ceph-mon[97503]: Reconfiguring osd.1 (monmap changed)... 2024-09-19T09:39:23.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:23 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:39:23.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:23 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:23.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:23 smithi112 ceph-mon[97503]: Reconfiguring daemon osd.1 on smithi112 2024-09-19T09:39:23.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:23 smithi112 ceph-mon[97503]: pgmap v17: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:23.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:23 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:23.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:23 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:23.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:23 smithi191 ceph-mon[77624]: Reconfiguring osd.1 (monmap changed)... 2024-09-19T09:39:23.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:23 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:39:23.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:23 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:23.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:23 smithi191 ceph-mon[77624]: Reconfiguring daemon osd.1 on smithi112 2024-09-19T09:39:23.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:23 smithi191 ceph-mon[77624]: pgmap v17: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:25.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:24 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:25.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:24 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:25.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:24 smithi112 ceph-mon[97503]: Reconfiguring osd.2 (monmap changed)... 2024-09-19T09:39:25.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:24 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:39:25.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:24 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:25.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:24 smithi112 ceph-mon[97503]: Reconfiguring daemon osd.2 on smithi112 2024-09-19T09:39:25.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:24 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:39:25.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:24 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:25.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:24 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:25.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:24 smithi191 ceph-mon[77624]: Reconfiguring osd.2 (monmap changed)... 2024-09-19T09:39:25.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:24 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:39:25.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:24 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:25.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:24 smithi191 ceph-mon[77624]: Reconfiguring daemon osd.2 on smithi112 2024-09-19T09:39:25.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:24 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:39:25.919 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:25 smithi112 ceph-mon[97503]: pgmap v18: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:25.919 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:25.919 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:25.919 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.ymjyok", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:39:25.919 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:26.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:25 smithi191 ceph-mon[77624]: pgmap v18: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:26.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.ymjyok", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:39:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:26.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:26 smithi112 ceph-mon[97503]: Reconfiguring mds.cephfs.smithi112.ymjyok (monmap changed)... 2024-09-19T09:39:26.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:26 smithi112 ceph-mon[97503]: Reconfiguring daemon mds.cephfs.smithi112.ymjyok on smithi112 2024-09-19T09:39:26.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:26 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:26.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:26 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:26.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:26 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.hcoxjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:39:26.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:26 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:27.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:26 smithi191 ceph-mon[77624]: Reconfiguring mds.cephfs.smithi112.ymjyok (monmap changed)... 2024-09-19T09:39:27.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:26 smithi191 ceph-mon[77624]: Reconfiguring daemon mds.cephfs.smithi112.ymjyok on smithi112 2024-09-19T09:39:27.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:26 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:27.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:26 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:27.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:26 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.hcoxjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:39:27.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:26 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:28.072 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:27 smithi112 ceph-mon[97503]: Reconfiguring mds.cephfs.smithi112.hcoxjz (monmap changed)... 2024-09-19T09:39:28.072 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:27 smithi112 ceph-mon[97503]: Reconfiguring daemon mds.cephfs.smithi112.hcoxjz on smithi112 2024-09-19T09:39:28.072 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:27 smithi112 ceph-mon[97503]: pgmap v19: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:28.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:27 smithi191 ceph-mon[77624]: Reconfiguring mds.cephfs.smithi112.hcoxjz (monmap changed)... 2024-09-19T09:39:28.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:27 smithi191 ceph-mon[77624]: Reconfiguring daemon mds.cephfs.smithi112.hcoxjz on smithi112 2024-09-19T09:39:28.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:27 smithi191 ceph-mon[77624]: pgmap v19: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:29.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:29 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:29.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:29 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:29.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:29 smithi112 ceph-mon[97503]: Reconfiguring crash.smithi191 (monmap changed)... 2024-09-19T09:39:29.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:29 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi191", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:39:29.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:29 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:29.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:29 smithi112 ceph-mon[97503]: Reconfiguring daemon crash.smithi191 on smithi191 2024-09-19T09:39:29.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:29 smithi112 ceph-mon[97503]: pgmap v20: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:29 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:29 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:29 smithi191 ceph-mon[77624]: Reconfiguring crash.smithi191 (monmap changed)... 2024-09-19T09:39:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:29 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi191", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:39:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:29 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:29 smithi191 ceph-mon[77624]: Reconfiguring daemon crash.smithi191 on smithi191 2024-09-19T09:39:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:29 smithi191 ceph-mon[77624]: pgmap v20: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:30.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:30.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:30.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:30 smithi112 ceph-mon[97503]: Reconfiguring mgr.smithi191.xjpplx (monmap changed)... 2024-09-19T09:39:30.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi191.xjpplx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:39:30.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:39:30.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:30.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:30 smithi112 ceph-mon[97503]: Reconfiguring daemon mgr.smithi191.xjpplx on smithi191 2024-09-19T09:39:31.032 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:31.033 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:31.033 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:30 smithi191 ceph-mon[77624]: Reconfiguring mgr.smithi191.xjpplx (monmap changed)... 2024-09-19T09:39:31.033 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi191.xjpplx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:39:31.033 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:39:31.033 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:31.033 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:30 smithi191 ceph-mon[77624]: Reconfiguring daemon mgr.smithi191.xjpplx on smithi191 2024-09-19T09:39:31.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:31 smithi191 ceph-mon[77624]: pgmap v21: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:31.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:31 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:31.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:31 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:31.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:31 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:39:31.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:31 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:39:31.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:31 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:31.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:31 smithi112 ceph-mon[97503]: pgmap v21: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:31.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:31 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:31.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:31 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:31.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:31 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:39:31.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:31 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:39:31.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:31 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:32.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:32 smithi191 ceph-mon[77624]: Reconfiguring mon.smithi191 (monmap changed)... 2024-09-19T09:39:32.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:32 smithi191 ceph-mon[77624]: Reconfiguring daemon mon.smithi191 on smithi191 2024-09-19T09:39:32.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:32 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:32.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:32 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:32.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:32 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:39:32.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:32 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:32.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:32 smithi112 ceph-mon[97503]: Reconfiguring mon.smithi191 (monmap changed)... 2024-09-19T09:39:32.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:32 smithi112 ceph-mon[97503]: Reconfiguring daemon mon.smithi191 on smithi191 2024-09-19T09:39:32.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:32 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:32.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:32 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:32.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:32 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:39:32.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:32 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:33.821 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:33 smithi191 ceph-mon[77624]: Reconfiguring osd.3 (monmap changed)... 2024-09-19T09:39:33.822 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:33 smithi191 ceph-mon[77624]: Reconfiguring daemon osd.3 on smithi191 2024-09-19T09:39:33.822 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:33 smithi191 ceph-mon[77624]: pgmap v22: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:33.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:33 smithi112 ceph-mon[97503]: Reconfiguring osd.3 (monmap changed)... 2024-09-19T09:39:33.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:33 smithi112 ceph-mon[97503]: Reconfiguring daemon osd.3 on smithi191 2024-09-19T09:39:33.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:33 smithi112 ceph-mon[97503]: pgmap v22: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:35.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:34 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:35.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:34 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:35.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:34 smithi112 ceph-mon[97503]: Reconfiguring osd.4 (monmap changed)... 2024-09-19T09:39:35.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:34 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:39:35.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:34 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:35.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:34 smithi112 ceph-mon[97503]: Reconfiguring daemon osd.4 on smithi191 2024-09-19T09:39:35.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:34 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:35.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:34 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:35.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:34 smithi191 ceph-mon[77624]: Reconfiguring osd.4 (monmap changed)... 2024-09-19T09:39:35.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:34 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:39:35.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:34 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:35.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:34 smithi191 ceph-mon[77624]: Reconfiguring daemon osd.4 on smithi191 2024-09-19T09:39:36.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:35 smithi191 ceph-mon[77624]: pgmap v23: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:36.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:35 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:36.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:35 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:36.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:35 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:39:36.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:35 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:36.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:35 smithi112 ceph-mon[97503]: pgmap v23: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:36.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:35 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:36.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:35 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:36.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:35 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:39:36.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:35 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:37.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:36 smithi191 ceph-mon[77624]: Reconfiguring osd.5 (monmap changed)... 2024-09-19T09:39:37.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:36 smithi191 ceph-mon[77624]: Reconfiguring daemon osd.5 on smithi191 2024-09-19T09:39:37.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:36 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:37.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:36 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:37.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:36 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.jjldod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:39:37.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:36 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:37.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:36 smithi112 ceph-mon[97503]: Reconfiguring osd.5 (monmap changed)... 2024-09-19T09:39:37.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:36 smithi112 ceph-mon[97503]: Reconfiguring daemon osd.5 on smithi191 2024-09-19T09:39:37.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:36 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:37.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:36 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:37.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:36 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.jjldod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:39:37.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:36 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:38.154 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:37 smithi191 ceph-mon[77624]: pgmap v24: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:38.154 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:37 smithi191 ceph-mon[77624]: Reconfiguring mds.cephfs.smithi191.jjldod (monmap changed)... 2024-09-19T09:39:38.154 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:37 smithi191 ceph-mon[77624]: Reconfiguring daemon mds.cephfs.smithi191.jjldod on smithi191 2024-09-19T09:39:38.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:37 smithi112 ceph-mon[97503]: pgmap v24: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:38.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:37 smithi112 ceph-mon[97503]: Reconfiguring mds.cephfs.smithi191.jjldod (monmap changed)... 2024-09-19T09:39:38.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:37 smithi112 ceph-mon[97503]: Reconfiguring daemon mds.cephfs.smithi191.jjldod on smithi191 2024-09-19T09:39:39.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:39 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:39.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:39 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:39.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:39 smithi191 ceph-mon[77624]: Reconfiguring mds.cephfs.smithi191.qweljt (monmap changed)... 2024-09-19T09:39:39.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:39 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.qweljt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:39:39.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:39 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:39.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:39 smithi191 ceph-mon[77624]: Reconfiguring daemon mds.cephfs.smithi191.qweljt on smithi191 2024-09-19T09:39:39.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:39 smithi191 ceph-mon[77624]: pgmap v25: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:39.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:39 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:39.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:39 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:39.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:39 smithi112 ceph-mon[97503]: Reconfiguring mds.cephfs.smithi191.qweljt (monmap changed)... 2024-09-19T09:39:39.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:39 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.qweljt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:39:39.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:39 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:39.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:39 smithi112 ceph-mon[97503]: Reconfiguring daemon mds.cephfs.smithi191.qweljt on smithi191 2024-09-19T09:39:39.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:39 smithi112 ceph-mon[97503]: pgmap v25: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:40 smithi112 ceph-mon[97503]: Upgrade: Setting container_image for all mon 2024-09-19T09:39:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:40.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"}]: dispatch 2024-09-19T09:39:40.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"}]': finished 2024-09-19T09:39:40.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi191"}]: dispatch 2024-09-19T09:39:40.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi191"}]': finished 2024-09-19T09:39:40.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:39:41.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:41.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:41.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:41.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:41.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:41.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:40 smithi191 ceph-mon[77624]: Upgrade: Setting container_image for all mon 2024-09-19T09:39:41.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:41.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"}]: dispatch 2024-09-19T09:39:41.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"}]': finished 2024-09-19T09:39:41.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi191"}]: dispatch 2024-09-19T09:39:41.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi191"}]': finished 2024-09-19T09:39:41.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:39:41.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:41 smithi112 ceph-mon[97503]: pgmap v26: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:41.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:41 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:41.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:41 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:39:41.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:41 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:42.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:41 smithi191 ceph-mon[77624]: pgmap v26: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:42.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:41 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:42.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:41 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:39:42.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:41 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:42.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:42 smithi112 ceph-mon[97503]: Upgrade: Updating crash.smithi112 (1/2) 2024-09-19T09:39:42.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:42 smithi112 ceph-mon[97503]: Deploying daemon crash.smithi112 on smithi112 2024-09-19T09:39:43.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:42 smithi191 ceph-mon[77624]: Upgrade: Updating crash.smithi112 (1/2) 2024-09-19T09:39:43.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:42 smithi191 ceph-mon[77624]: Deploying daemon crash.smithi112 on smithi112 2024-09-19T09:39:43.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:43 smithi112 ceph-mon[97503]: pgmap v27: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:44.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:43 smithi191 ceph-mon[77624]: pgmap v27: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:45.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:45 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:45.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:45 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:45.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:45 smithi112 ceph-mon[97503]: pgmap v28: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:45.990 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:45 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:45.990 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:45 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:45.990 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:45 smithi191 ceph-mon[77624]: pgmap v28: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:46.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.450+0000 7f81af4f3640 1 -- 172.21.15.112:0/449035626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81a8102530 msgr2=0x7f81a8102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.450+0000 7f81af4f3640 1 --2- 172.21.15.112:0/449035626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81a8102530 0x7f81a8102900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8198009c50 tx=0x7f8198004d10 comp rx=0 tx=0).stop 2024-09-19T09:39:46.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.450+0000 7f81af4f3640 1 -- 172.21.15.112:0/449035626 shutdown_connections 2024-09-19T09:39:46.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.450+0000 7f81af4f3640 1 --2- 172.21.15.112:0/449035626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81a8102ed0 0x7f81a80fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.450+0000 7f81af4f3640 1 --2- 172.21.15.112:0/449035626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81a8102530 0x7f81a8102900 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.450+0000 7f81af4f3640 1 -- 172.21.15.112:0/449035626 >> 172.21.15.112:0/449035626 conn(0x7f81a80f80f0 msgr2=0x7f81a80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:46.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.450+0000 7f81af4f3640 1 -- 172.21.15.112:0/449035626 shutdown_connections 2024-09-19T09:39:46.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.450+0000 7f81af4f3640 1 -- 172.21.15.112:0/449035626 wait complete. 2024-09-19T09:39:46.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.451+0000 7f81af4f3640 1 Processor -- start 2024-09-19T09:39:46.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.451+0000 7f81af4f3640 1 -- start start 2024-09-19T09:39:46.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.451+0000 7f81af4f3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81a8102530 0x7f81a806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.451+0000 7f81af4f3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81a8102ed0 0x7f81a806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.451+0000 7f81af4f3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a8070490 con 0x7f81a8102ed0 2024-09-19T09:39:46.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.451+0000 7f81af4f3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a8070600 con 0x7f81a8102530 2024-09-19T09:39:46.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.451+0000 7f81aca8e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81a8102ed0 0x7f81a806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.451+0000 7f81aca8e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81a8102ed0 0x7f81a806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46520/0 (socket says 172.21.15.112:46520) 2024-09-19T09:39:46.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.451+0000 7f81aca8e640 1 -- 172.21.15.112:0/129558849 learned_addr learned my addr 172.21.15.112:0/129558849 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:39:46.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.451+0000 7f81ad28f640 1 --2- 172.21.15.112:0/129558849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81a8102530 0x7f81a806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.451+0000 7f81aca8e640 1 -- 172.21.15.112:0/129558849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81a8102530 msgr2=0x7f81a806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.451+0000 7f81aca8e640 1 --2- 172.21.15.112:0/129558849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81a8102530 0x7f81a806fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.451+0000 7f81aca8e640 1 -- 172.21.15.112:0/129558849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81980098b0 con 0x7f81a8102ed0 2024-09-19T09:39:46.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.451+0000 7f81ad28f640 1 --2- 172.21.15.112:0/129558849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81a8102530 0x7f81a806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:46.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.452+0000 7f81aca8e640 1 --2- 172.21.15.112:0/129558849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81a8102ed0 0x7f81a806ff50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f819c002870 tx=0x7f819c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:46.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.452+0000 7f81a5ffb640 1 -- 172.21.15.112:0/129558849 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f819c007c30 con 0x7f81a8102ed0 2024-09-19T09:39:46.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.452+0000 7f81a5ffb640 1 -- 172.21.15.112:0/129558849 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f819c00f040 con 0x7f81a8102ed0 2024-09-19T09:39:46.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.452+0000 7f81a5ffb640 1 -- 172.21.15.112:0/129558849 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f819c009640 con 0x7f81a8102ed0 2024-09-19T09:39:46.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.452+0000 7f81af4f3640 1 -- 172.21.15.112:0/129558849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a8070890 con 0x7f81a8102ed0 2024-09-19T09:39:46.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.452+0000 7f81af4f3640 1 -- 172.21.15.112:0/129558849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a81198c0 con 0x7f81a8102ed0 2024-09-19T09:39:46.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.453+0000 7f81af4f3640 1 -- 172.21.15.112:0/129558849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a80fdcb0 con 0x7f81a8102ed0 2024-09-19T09:39:46.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.454+0000 7f81a5ffb640 1 -- 172.21.15.112:0/129558849 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f819c0097a0 con 0x7f81a8102ed0 2024-09-19T09:39:46.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.454+0000 7f81a5ffb640 1 --2- 172.21.15.112:0/129558849 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f819006e660 0x7f8190070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.454+0000 7f81a5ffb640 1 -- 172.21.15.112:0/129558849 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f819c08e1c0 con 0x7f81a8102ed0 2024-09-19T09:39:46.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.454+0000 7f81ad28f640 1 --2- 172.21.15.112:0/129558849 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f819006e660 0x7f8190070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.455+0000 7f81ad28f640 1 --2- 172.21.15.112:0/129558849 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f819006e660 0x7f8190070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f81980048c0 tx=0x7f8198004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:46.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.459+0000 7f81a5ffb640 1 -- 172.21.15.112:0/129558849 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f819c0571b0 con 0x7f81a8102ed0 2024-09-19T09:39:46.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.641+0000 7f81af4f3640 1 -- 172.21.15.112:0/129558849 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f81a804b720 con 0x7f819006e660 2024-09-19T09:39:46.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.642+0000 7f81a5ffb640 1 -- 172.21.15.112:0/129558849 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f81a804b720 con 0x7f819006e660 2024-09-19T09:39:46.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.644+0000 7f81af4f3640 1 -- 172.21.15.112:0/129558849 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f819006e660 msgr2=0x7f8190070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.644+0000 7f81af4f3640 1 --2- 172.21.15.112:0/129558849 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f819006e660 0x7f8190070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f81980048c0 tx=0x7f8198004d10 comp rx=0 tx=0).stop 2024-09-19T09:39:46.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.644+0000 7f81af4f3640 1 -- 172.21.15.112:0/129558849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81a8102ed0 msgr2=0x7f81a806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.644+0000 7f81af4f3640 1 --2- 172.21.15.112:0/129558849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81a8102ed0 0x7f81a806ff50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f819c002870 tx=0x7f819c004600 comp rx=0 tx=0).stop 2024-09-19T09:39:46.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.645+0000 7f81af4f3640 1 -- 172.21.15.112:0/129558849 shutdown_connections 2024-09-19T09:39:46.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.645+0000 7f81af4f3640 1 --2- 172.21.15.112:0/129558849 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f819006e660 0x7f8190070b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.645+0000 7f81af4f3640 1 --2- 172.21.15.112:0/129558849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81a8102ed0 0x7f81a806ff50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.645+0000 7f81af4f3640 1 --2- 172.21.15.112:0/129558849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81a8102530 0x7f81a806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.645+0000 7f81af4f3640 1 -- 172.21.15.112:0/129558849 >> 172.21.15.112:0/129558849 conn(0x7f81a80f80f0 msgr2=0x7f81a80f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:46.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.645+0000 7f81af4f3640 1 -- 172.21.15.112:0/129558849 shutdown_connections 2024-09-19T09:39:46.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.645+0000 7f81af4f3640 1 -- 172.21.15.112:0/129558849 wait complete. 2024-09-19T09:39:46.655 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:39:46.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.723+0000 7f7f22ad6640 1 -- 172.21.15.112:0/2043458400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f1c0fb4a0 msgr2=0x7f7f1c0fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.723+0000 7f7f22ad6640 1 --2- 172.21.15.112:0/2043458400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f1c0fb4a0 0x7f7f1c0fb910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f080048d0 tx=0x7f7f08009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.723+0000 7f7f22ad6640 1 -- 172.21.15.112:0/2043458400 shutdown_connections 2024-09-19T09:39:46.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.723+0000 7f7f22ad6640 1 --2- 172.21.15.112:0/2043458400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f1c0fb4a0 0x7f7f1c0fb910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.723+0000 7f7f22ad6640 1 --2- 172.21.15.112:0/2043458400 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f1c1014e0 0x7f7f1c1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.723+0000 7f7f22ad6640 1 -- 172.21.15.112:0/2043458400 >> 172.21.15.112:0/2043458400 conn(0x7f7f1c0f7060 msgr2=0x7f7f1c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:46.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.723+0000 7f7f22ad6640 1 -- 172.21.15.112:0/2043458400 shutdown_connections 2024-09-19T09:39:46.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.723+0000 7f7f22ad6640 1 -- 172.21.15.112:0/2043458400 wait complete. 2024-09-19T09:39:46.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.724+0000 7f7f22ad6640 1 Processor -- start 2024-09-19T09:39:46.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.724+0000 7f7f22ad6640 1 -- start start 2024-09-19T09:39:46.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.724+0000 7f7f22ad6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f1c0fb4a0 0x7f7f1c113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.724+0000 7f7f22ad6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f1c1014e0 0x7f7f1c113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.724+0000 7f7f22ad6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c113d80 con 0x7f7f1c0fb4a0 2024-09-19T09:39:46.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.724+0000 7f7f22ad6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c10d1c0 con 0x7f7f1c1014e0 2024-09-19T09:39:46.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.724+0000 7f7f20872640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f1c0fb4a0 0x7f7f1c113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.724+0000 7f7f20872640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f1c0fb4a0 0x7f7f1c113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46540/0 (socket says 172.21.15.112:46540) 2024-09-19T09:39:46.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.724+0000 7f7f20872640 1 -- 172.21.15.112:0/1729413246 learned_addr learned my addr 172.21.15.112:0/1729413246 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:39:46.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.724+0000 7f7f1bfff640 1 --2- 172.21.15.112:0/1729413246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f1c1014e0 0x7f7f1c113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.725+0000 7f7f20872640 1 -- 172.21.15.112:0/1729413246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f1c1014e0 msgr2=0x7f7f1c113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.725+0000 7f7f20872640 1 --2- 172.21.15.112:0/1729413246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f1c1014e0 0x7f7f1c113780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.725+0000 7f7f20872640 1 -- 172.21.15.112:0/1729413246 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f08005040 con 0x7f7f1c0fb4a0 2024-09-19T09:39:46.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.725+0000 7f7f20872640 1 --2- 172.21.15.112:0/1729413246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f1c0fb4a0 0x7f7f1c113240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7f10002a50 tx=0x7f7f10004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:46.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.725+0000 7f7f197fa640 1 -- 172.21.15.112:0/1729413246 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f10007c30 con 0x7f7f1c0fb4a0 2024-09-19T09:39:46.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.725+0000 7f7f22ad6640 1 -- 172.21.15.112:0/1729413246 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1c10d4a0 con 0x7f7f1c0fb4a0 2024-09-19T09:39:46.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.725+0000 7f7f197fa640 1 -- 172.21.15.112:0/1729413246 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7f1000f040 con 0x7f7f1c0fb4a0 2024-09-19T09:39:46.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.725+0000 7f7f197fa640 1 -- 172.21.15.112:0/1729413246 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f1000dad0 con 0x7f7f1c0fb4a0 2024-09-19T09:39:46.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.725+0000 7f7f22ad6640 1 -- 172.21.15.112:0/1729413246 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c10d990 con 0x7f7f1c0fb4a0 2024-09-19T09:39:46.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.726+0000 7f7f22ad6640 1 -- 172.21.15.112:0/1729413246 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1c0fcbe0 con 0x7f7f1c0fb4a0 2024-09-19T09:39:46.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.727+0000 7f7f197fa640 1 -- 172.21.15.112:0/1729413246 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f7f1000dc30 con 0x7f7f1c0fb4a0 2024-09-19T09:39:46.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.727+0000 7f7f197fa640 1 --2- 172.21.15.112:0/1729413246 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7f0c06e660 0x7f7f0c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.727+0000 7f7f197fa640 1 -- 172.21.15.112:0/1729413246 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7f1008e1f0 con 0x7f7f1c0fb4a0 2024-09-19T09:39:46.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.727+0000 7f7f1bfff640 1 --2- 172.21.15.112:0/1729413246 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7f0c06e660 0x7f7f0c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.728+0000 7f7f1bfff640 1 --2- 172.21.15.112:0/1729413246 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7f0c06e660 0x7f7f0c070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009ac0 tx=0x7f7f08035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:46.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.732+0000 7f7f197fa640 1 -- 172.21.15.112:0/1729413246 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7f10057160 con 0x7f7f1c0fb4a0 2024-09-19T09:39:46.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.920+0000 7f7f22ad6640 1 -- 172.21.15.112:0/1729413246 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f1c04b720 con 0x7f7f0c06e660 2024-09-19T09:39:46.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.922+0000 7f7f197fa640 1 -- 172.21.15.112:0/1729413246 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f7f1c04b720 con 0x7f7f0c06e660 2024-09-19T09:39:46.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.924+0000 7f7f22ad6640 1 -- 172.21.15.112:0/1729413246 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7f0c06e660 msgr2=0x7f7f0c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.924+0000 7f7f22ad6640 1 --2- 172.21.15.112:0/1729413246 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7f0c06e660 0x7f7f0c070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009ac0 tx=0x7f7f08035040 comp rx=0 tx=0).stop 2024-09-19T09:39:46.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.924+0000 7f7f22ad6640 1 -- 172.21.15.112:0/1729413246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f1c0fb4a0 msgr2=0x7f7f1c113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.924+0000 7f7f22ad6640 1 --2- 172.21.15.112:0/1729413246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f1c0fb4a0 0x7f7f1c113240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7f10002a50 tx=0x7f7f10004600 comp rx=0 tx=0).stop 2024-09-19T09:39:46.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.924+0000 7f7f22ad6640 1 -- 172.21.15.112:0/1729413246 shutdown_connections 2024-09-19T09:39:46.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.924+0000 7f7f22ad6640 1 --2- 172.21.15.112:0/1729413246 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7f0c06e660 0x7f7f0c070b10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.924+0000 7f7f22ad6640 1 --2- 172.21.15.112:0/1729413246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f1c1014e0 0x7f7f1c113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.924+0000 7f7f22ad6640 1 --2- 172.21.15.112:0/1729413246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f1c0fb4a0 0x7f7f1c113240 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.924+0000 7f7f22ad6640 1 -- 172.21.15.112:0/1729413246 >> 172.21.15.112:0/1729413246 conn(0x7f7f1c0f7060 msgr2=0x7f7f1c065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:46.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.924+0000 7f7f22ad6640 1 -- 172.21.15.112:0/1729413246 shutdown_connections 2024-09-19T09:39:46.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:46.924+0000 7f7f22ad6640 1 -- 172.21.15.112:0/1729413246 wait complete. 2024-09-19T09:39:47.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.007+0000 7f5058298640 1 -- 172.21.15.112:0/3554612505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50500fb810 msgr2=0x7f50500fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.007+0000 7f5058298640 1 --2- 172.21.15.112:0/3554612505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50500fb810 0x7f50500fbbe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f504c0048d0 tx=0x7f504c009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.007+0000 7f5058298640 1 -- 172.21.15.112:0/3554612505 shutdown_connections 2024-09-19T09:39:47.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.007+0000 7f5058298640 1 --2- 172.21.15.112:0/3554612505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50500fcf80 0x7f50500fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.007+0000 7f5058298640 1 --2- 172.21.15.112:0/3554612505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50500fb810 0x7f50500fbbe0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.007+0000 7f5058298640 1 -- 172.21.15.112:0/3554612505 >> 172.21.15.112:0/3554612505 conn(0x7f50500723b0 msgr2=0x7f50500727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:47.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.007+0000 7f5058298640 1 -- 172.21.15.112:0/3554612505 shutdown_connections 2024-09-19T09:39:47.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.007+0000 7f5058298640 1 -- 172.21.15.112:0/3554612505 wait complete. 2024-09-19T09:39:47.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.007+0000 7f5058298640 1 Processor -- start 2024-09-19T09:39:47.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.007+0000 7f5058298640 1 -- start start 2024-09-19T09:39:47.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5058298640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50500fb810 0x7f505010e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:47.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5058298640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50500fcf80 0x7f505010e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:47.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5058298640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505010ed40 con 0x7f50500fb810 2024-09-19T09:39:47.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5058298640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505010eeb0 con 0x7f50500fcf80 2024-09-19T09:39:47.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5056034640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50500fb810 0x7f505010e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:47.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5056034640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50500fb810 0x7f505010e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46572/0 (socket says 172.21.15.112:46572) 2024-09-19T09:39:47.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5056034640 1 -- 172.21.15.112:0/3977576073 learned_addr learned my addr 172.21.15.112:0/3977576073 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:39:47.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5055833640 1 --2- 172.21.15.112:0/3977576073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50500fcf80 0x7f505010e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:47.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5056034640 1 -- 172.21.15.112:0/3977576073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50500fcf80 msgr2=0x7f505010e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5056034640 1 --2- 172.21.15.112:0/3977576073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50500fcf80 0x7f505010e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5056034640 1 -- 172.21.15.112:0/3977576073 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c005040 con 0x7f50500fb810 2024-09-19T09:39:47.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5056034640 1 --2- 172.21.15.112:0/3977576073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50500fb810 0x7f505010e1b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f504c0043d0 tx=0x7f504c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:47.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5046ffd640 1 -- 172.21.15.112:0/3977576073 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f504c038070 con 0x7f50500fb810 2024-09-19T09:39:47.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5058298640 1 -- 172.21.15.112:0/3977576073 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5050117220 con 0x7f50500fb810 2024-09-19T09:39:47.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5046ffd640 1 -- 172.21.15.112:0/3977576073 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f504c0096e0 con 0x7f50500fb810 2024-09-19T09:39:47.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.008+0000 7f5046ffd640 1 -- 172.21.15.112:0/3977576073 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f504c03d420 con 0x7f50500fb810 2024-09-19T09:39:47.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.009+0000 7f5058298640 1 -- 172.21.15.112:0/3977576073 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50501176e0 con 0x7f50500fb810 2024-09-19T09:39:47.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.009+0000 7f5058298640 1 -- 172.21.15.112:0/3977576073 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50500fcbc0 con 0x7f50500fb810 2024-09-19T09:39:47.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.010+0000 7f5046ffd640 1 -- 172.21.15.112:0/3977576073 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f504c030020 con 0x7f50500fb810 2024-09-19T09:39:47.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.010+0000 7f5046ffd640 1 --2- 172.21.15.112:0/3977576073 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f503c06e660 0x7f503c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:47.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.011+0000 7f5055833640 1 --2- 172.21.15.112:0/3977576073 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f503c06e660 0x7f503c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:47.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.011+0000 7f5046ffd640 1 -- 172.21.15.112:0/3977576073 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f504c0ae6b0 con 0x7f50500fb810 2024-09-19T09:39:47.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.011+0000 7f5055833640 1 --2- 172.21.15.112:0/3977576073 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f503c06e660 0x7f503c070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5050065980 tx=0x7f504000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:47.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.015+0000 7f5046ffd640 1 -- 172.21.15.112:0/3977576073 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f504c077730 con 0x7f50500fb810 2024-09-19T09:39:47.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.193+0000 7f5058298640 1 -- 172.21.15.112:0/3977576073 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5050065730 con 0x7f503c06e660 2024-09-19T09:39:47.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.201+0000 7f5046ffd640 1 -- 172.21.15.112:0/3977576073 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f5050065730 con 0x7f503c06e660 2024-09-19T09:39:47.203 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:39:47.203 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (4m) 46s ago 12m 28.2M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:39:47.203 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 starting - - - - 2024-09-19T09:39:47.203 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (11m) 34s ago 11m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6c313b300b35 2024-09-19T09:39:47.203 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (2m) 46s ago 12m 76.3M - 9.4.12 2bacad6d85d8 e462aca2b022 2024-09-19T09:39:47.204 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (7m) 46s ago 7m 154M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:39:47.204 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (7m) 46s ago 7m 106M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:39:47.204 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (7m) 34s ago 7m 13.4M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:39:47.204 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (7m) 34s ago 7m 15.9M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:39:47.204 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (3m) 46s ago 13m 473M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:39:47.204 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283,8765 running (2m) 34s ago 11m 438M - 19.1.1-361-g2f599a46 d2baa855c067 fddba1bee64a 2024-09-19T09:39:47.204 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (59s) 46s ago 14m 26.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 89dfb5de44c8 2024-09-19T09:39:47.204 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (37s) 34s ago 11m 23.1M 2048M 19.1.1-361-g2f599a46 d2baa855c067 3cab8f7cc27e 2024-09-19T09:39:47.204 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (4m) 46s ago 12m 16.0M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:39:47.204 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (3m) 34s ago 11m 15.6M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:39:47.204 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (10m) 46s ago 10m 230M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 621693067dce 2024-09-19T09:39:47.205 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (10m) 46s ago 10m 248M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1742e5964367 2024-09-19T09:39:47.205 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (10m) 46s ago 9m 212M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 4dcca18af229 2024-09-19T09:39:47.205 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (9m) 34s ago 9m 271M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:39:47.205 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (9m) 34s ago 9m 239M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:39:47.205 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (8m) 34s ago 8m 225M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:39:47.205 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (2m) 46s ago 12m 61.4M - 2.43.0 a07b618ecd1d 54850883a171 2024-09-19T09:39:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.203+0000 7f5058298640 1 -- 172.21.15.112:0/3977576073 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f503c06e660 msgr2=0x7f503c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.203+0000 7f5058298640 1 --2- 172.21.15.112:0/3977576073 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f503c06e660 0x7f503c070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5050065980 tx=0x7f504000b040 comp rx=0 tx=0).stop 2024-09-19T09:39:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.203+0000 7f5058298640 1 -- 172.21.15.112:0/3977576073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50500fb810 msgr2=0x7f505010e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.203+0000 7f5058298640 1 --2- 172.21.15.112:0/3977576073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50500fb810 0x7f505010e1b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f504c0043d0 tx=0x7f504c009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.203+0000 7f5058298640 1 -- 172.21.15.112:0/3977576073 shutdown_connections 2024-09-19T09:39:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.203+0000 7f5058298640 1 --2- 172.21.15.112:0/3977576073 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f503c06e660 0x7f503c070b10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.203+0000 7f5058298640 1 --2- 172.21.15.112:0/3977576073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50500fcf80 0x7f505010e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.203+0000 7f5058298640 1 --2- 172.21.15.112:0/3977576073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50500fb810 0x7f505010e1b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.203+0000 7f5058298640 1 -- 172.21.15.112:0/3977576073 >> 172.21.15.112:0/3977576073 conn(0x7f50500723b0 msgr2=0x7f50500fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.204+0000 7f5058298640 1 -- 172.21.15.112:0/3977576073 shutdown_connections 2024-09-19T09:39:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.204+0000 7f5058298640 1 -- 172.21.15.112:0/3977576073 wait complete. 2024-09-19T09:39:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.280+0000 7fb2f66ed640 1 -- 172.21.15.112:0/1590868341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2f00fd580 msgr2=0x7fb2f00fd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.280+0000 7fb2f66ed640 1 --2- 172.21.15.112:0/1590868341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2f00fd580 0x7fb2f00fd950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00048d0 tx=0x7fb2e0009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.280+0000 7fb2f66ed640 1 -- 172.21.15.112:0/1590868341 shutdown_connections 2024-09-19T09:39:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.280+0000 7fb2f66ed640 1 --2- 172.21.15.112:0/1590868341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2f00fdf20 0x7fb2f0106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.280+0000 7fb2f66ed640 1 --2- 172.21.15.112:0/1590868341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2f00fd580 0x7fb2f00fd950 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.280+0000 7fb2f66ed640 1 -- 172.21.15.112:0/1590868341 >> 172.21.15.112:0/1590868341 conn(0x7fb2f00f7010 msgr2=0x7fb2f00f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:47.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.280+0000 7fb2f66ed640 1 -- 172.21.15.112:0/1590868341 shutdown_connections 2024-09-19T09:39:47.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.280+0000 7fb2f66ed640 1 -- 172.21.15.112:0/1590868341 wait complete. 2024-09-19T09:39:47.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:47 smithi112 ceph-mon[97503]: Upgrade: Updating crash.smithi191 (2/2) 2024-09-19T09:39:47.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:47 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:47.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:47 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi191", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:39:47.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:47 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:47.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:47 smithi112 ceph-mon[97503]: Deploying daemon crash.smithi191 on smithi191 2024-09-19T09:39:47.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.280+0000 7fb2f66ed640 1 Processor -- start 2024-09-19T09:39:47.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.281+0000 7fb2f66ed640 1 -- start start 2024-09-19T09:39:47.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.281+0000 7fb2f66ed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2f00fd580 0x7fb2f0113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:47.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.281+0000 7fb2f66ed640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2f00fdf20 0x7fb2f0113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:47.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.281+0000 7fb2f66ed640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0113d70 con 0x7fb2f00fd580 2024-09-19T09:39:47.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.281+0000 7fb2f66ed640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f010d1b0 con 0x7fb2f00fdf20 2024-09-19T09:39:47.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.281+0000 7fb2effff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2f00fd580 0x7fb2f0113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.281+0000 7fb2effff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2f00fd580 0x7fb2f0113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46580/0 (socket says 172.21.15.112:46580) 2024-09-19T09:39:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.281+0000 7fb2effff640 1 -- 172.21.15.112:0/3849812148 learned_addr learned my addr 172.21.15.112:0/3849812148 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:39:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.281+0000 7fb2ef7fe640 1 --2- 172.21.15.112:0/3849812148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2f00fdf20 0x7fb2f0113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.281+0000 7fb2effff640 1 -- 172.21.15.112:0/3849812148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2f00fdf20 msgr2=0x7fb2f0113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.281+0000 7fb2effff640 1 --2- 172.21.15.112:0/3849812148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2f00fdf20 0x7fb2f0113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.281+0000 7fb2effff640 1 -- 172.21.15.112:0/3849812148 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e0005040 con 0x7fb2f00fd580 2024-09-19T09:39:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.282+0000 7fb2effff640 1 --2- 172.21.15.112:0/3849812148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2f00fd580 0x7fb2f0113230 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0003080 tx=0x7fb2e0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.282+0000 7fb2ecff9640 1 -- 172.21.15.112:0/3849812148 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e0038070 con 0x7fb2f00fd580 2024-09-19T09:39:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.282+0000 7fb2f66ed640 1 -- 172.21.15.112:0/3849812148 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f010d430 con 0x7fb2f00fd580 2024-09-19T09:39:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.282+0000 7fb2ecff9640 1 -- 172.21.15.112:0/3849812148 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb2e002ade0 con 0x7fb2f00fd580 2024-09-19T09:39:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.282+0000 7fb2ecff9640 1 -- 172.21.15.112:0/3849812148 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e002c880 con 0x7fb2f00fd580 2024-09-19T09:39:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.282+0000 7fb2f66ed640 1 -- 172.21.15.112:0/3849812148 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f010d890 con 0x7fb2f00fd580 2024-09-19T09:39:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.283+0000 7fb2f66ed640 1 -- 172.21.15.112:0/3849812148 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f00663b0 con 0x7fb2f00fd580 2024-09-19T09:39:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.284+0000 7fb2ecff9640 1 -- 172.21.15.112:0/3849812148 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fb2e0030020 con 0x7fb2f00fd580 2024-09-19T09:39:47.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.284+0000 7fb2ecff9640 1 --2- 172.21.15.112:0/3849812148 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb2d806e660 0x7fb2d8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:47.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.284+0000 7fb2ecff9640 1 -- 172.21.15.112:0/3849812148 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb2e00ae230 con 0x7fb2f00fd580 2024-09-19T09:39:47.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.284+0000 7fb2ef7fe640 1 --2- 172.21.15.112:0/3849812148 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb2d806e660 0x7fb2d8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:47.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.285+0000 7fb2ef7fe640 1 --2- 172.21.15.112:0/3849812148 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb2d806e660 0x7fb2d8070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2f010eaf0 tx=0x7fb2e4004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:47.288 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:47 smithi191 ceph-mon[77624]: Upgrade: Updating crash.smithi191 (2/2) 2024-09-19T09:39:47.288 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:47 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:47.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:47 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi191", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:39:47.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:47 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:47.289 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:47 smithi191 ceph-mon[77624]: Deploying daemon crash.smithi191 on smithi191 2024-09-19T09:39:47.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.289+0000 7fb2ecff9640 1 -- 172.21.15.112:0/3849812148 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb2e00772b0 con 0x7fb2f00fd580 2024-09-19T09:39:47.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.519+0000 7fb2f66ed640 1 -- 172.21.15.112:0/3849812148 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb2f010e8a0 con 0x7fb2f00fd580 2024-09-19T09:39:47.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.519+0000 7fb2ecff9640 1 -- 172.21.15.112:0/3849812148 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7fb2e00030d0 con 0x7fb2f00fd580 2024-09-19T09:39:47.524 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:39:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:39:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:39:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:39:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:39:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:39:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:39:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:39:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T09:39:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:39:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:39:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:39:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:39:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:39:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 10, 2024-09-19T09:39:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T09:39:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:39:47.525 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:39:47.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.521+0000 7fb2f66ed640 1 -- 172.21.15.112:0/3849812148 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb2d806e660 msgr2=0x7fb2d8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.521+0000 7fb2f66ed640 1 --2- 172.21.15.112:0/3849812148 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb2d806e660 0x7fb2d8070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2f010eaf0 tx=0x7fb2e4004330 comp rx=0 tx=0).stop 2024-09-19T09:39:47.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.521+0000 7fb2f66ed640 1 -- 172.21.15.112:0/3849812148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2f00fd580 msgr2=0x7fb2f0113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.521+0000 7fb2f66ed640 1 --2- 172.21.15.112:0/3849812148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2f00fd580 0x7fb2f0113230 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0003080 tx=0x7fb2e0009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.521+0000 7fb2f66ed640 1 -- 172.21.15.112:0/3849812148 shutdown_connections 2024-09-19T09:39:47.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.521+0000 7fb2f66ed640 1 --2- 172.21.15.112:0/3849812148 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb2d806e660 0x7fb2d8070b10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.521+0000 7fb2f66ed640 1 --2- 172.21.15.112:0/3849812148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2f00fdf20 0x7fb2f0113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.521+0000 7fb2f66ed640 1 --2- 172.21.15.112:0/3849812148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2f00fd580 0x7fb2f0113230 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.522+0000 7fb2f66ed640 1 -- 172.21.15.112:0/3849812148 >> 172.21.15.112:0/3849812148 conn(0x7fb2f00f7010 msgr2=0x7fb2f00f85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:47.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.522+0000 7fb2f66ed640 1 -- 172.21.15.112:0/3849812148 shutdown_connections 2024-09-19T09:39:47.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.522+0000 7fb2f66ed640 1 -- 172.21.15.112:0/3849812148 wait complete. 2024-09-19T09:39:47.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.599+0000 7fc3c7d50640 1 -- 172.21.15.112:0/367248565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c0102ed0 msgr2=0x7fc3c00fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.599+0000 7fc3c7d50640 1 --2- 172.21.15.112:0/367248565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c0102ed0 0x7fc3c00fc590 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0048d0 tx=0x7fc3bc009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.599+0000 7fc3c7d50640 1 -- 172.21.15.112:0/367248565 shutdown_connections 2024-09-19T09:39:47.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.599+0000 7fc3c7d50640 1 --2- 172.21.15.112:0/367248565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c0102ed0 0x7fc3c00fc590 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.599+0000 7fc3c7d50640 1 --2- 172.21.15.112:0/367248565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3c0102530 0x7fc3c0102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.599+0000 7fc3c7d50640 1 -- 172.21.15.112:0/367248565 >> 172.21.15.112:0/367248565 conn(0x7fc3c00f8110 msgr2=0x7fc3c00fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:47.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.599+0000 7fc3c7d50640 1 -- 172.21.15.112:0/367248565 shutdown_connections 2024-09-19T09:39:47.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.599+0000 7fc3c7d50640 1 -- 172.21.15.112:0/367248565 wait complete. 2024-09-19T09:39:47.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.600+0000 7fc3c7d50640 1 Processor -- start 2024-09-19T09:39:47.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.600+0000 7fc3c7d50640 1 -- start start 2024-09-19T09:39:47.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.600+0000 7fc3c7d50640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3c0102530 0x7fc3c006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:47.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.600+0000 7fc3c7d50640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c0102ed0 0x7fc3c006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:47.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.600+0000 7fc3c7d50640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c0070490 con 0x7fc3c0102ed0 2024-09-19T09:39:47.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.600+0000 7fc3c7d50640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c0070600 con 0x7fc3c0102530 2024-09-19T09:39:47.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.600+0000 7fc3c52eb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c0102ed0 0x7fc3c006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:47.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.600+0000 7fc3c52eb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c0102ed0 0x7fc3c006ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46590/0 (socket says 172.21.15.112:46590) 2024-09-19T09:39:47.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.600+0000 7fc3c5aec640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3c0102530 0x7fc3c006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:47.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.600+0000 7fc3c52eb640 1 -- 172.21.15.112:0/3803790457 learned_addr learned my addr 172.21.15.112:0/3803790457 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:39:47.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.600+0000 7fc3c52eb640 1 -- 172.21.15.112:0/3803790457 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3c0102530 msgr2=0x7fc3c006fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.600+0000 7fc3c52eb640 1 --2- 172.21.15.112:0/3803790457 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3c0102530 0x7fc3c006fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.600+0000 7fc3c52eb640 1 -- 172.21.15.112:0/3803790457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc005040 con 0x7fc3c0102ed0 2024-09-19T09:39:47.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.601+0000 7fc3c52eb640 1 --2- 172.21.15.112:0/3803790457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c0102ed0 0x7fc3c006ff50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc02a530 tx=0x7fc3bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:47.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.601+0000 7fc3b27fc640 1 -- 172.21.15.112:0/3803790457 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3bc038070 con 0x7fc3c0102ed0 2024-09-19T09:39:47.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.601+0000 7fc3b27fc640 1 -- 172.21.15.112:0/3803790457 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc3bc02ade0 con 0x7fc3c0102ed0 2024-09-19T09:39:47.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.601+0000 7fc3c7d50640 1 -- 172.21.15.112:0/3803790457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c0070830 con 0x7fc3c0102ed0 2024-09-19T09:39:47.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.601+0000 7fc3b27fc640 1 -- 172.21.15.112:0/3803790457 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3bc02c7a0 con 0x7fc3c0102ed0 2024-09-19T09:39:47.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.601+0000 7fc3c7d50640 1 -- 172.21.15.112:0/3803790457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c0119890 con 0x7fc3c0102ed0 2024-09-19T09:39:47.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.602+0000 7fc3c7d50640 1 -- 172.21.15.112:0/3803790457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c00fdcb0 con 0x7fc3c0102ed0 2024-09-19T09:39:47.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.603+0000 7fc3b27fc640 1 -- 172.21.15.112:0/3803790457 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fc3bc030020 con 0x7fc3c0102ed0 2024-09-19T09:39:47.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.604+0000 7fc3b27fc640 1 --2- 172.21.15.112:0/3803790457 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc3ac06e660 0x7fc3ac070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:47.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.604+0000 7fc3c5aec640 1 --2- 172.21.15.112:0/3803790457 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc3ac06e660 0x7fc3ac070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:47.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.604+0000 7fc3b27fc640 1 -- 172.21.15.112:0/3803790457 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc3bc0ae590 con 0x7fc3c0102ed0 2024-09-19T09:39:47.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.604+0000 7fc3c5aec640 1 --2- 172.21.15.112:0/3803790457 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc3ac06e660 0x7fc3ac070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009af0 tx=0x7fc3b400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:47.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.608+0000 7fc3b27fc640 1 -- 172.21.15.112:0/3803790457 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc3bc077690 con 0x7fc3c0102ed0 2024-09-19T09:39:47.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.809+0000 7fc3c7d50640 1 -- 172.21.15.112:0/3803790457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc3c00fbd30 con 0x7fc3c0102ed0 2024-09-19T09:39:47.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.810+0000 7fc3b27fc640 1 -- 172.21.15.112:0/3803790457 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1949 (secure 0 0 0) 0x7fc3bc07ad50 con 0x7fc3c0102ed0 2024-09-19T09:39:47.813 INFO:teuthology.orchestra.run.smithi112.stdout:e17 2024-09-19T09:39:47.813 INFO:teuthology.orchestra.run.smithi112.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:39:47.813 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:39:47.813 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:39:47.813 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-19T09:39:47.813 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:39:47.813 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:39:47.814 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-19T09:39:47.814 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 17 2024-09-19T09:39:47.814 INFO:teuthology.orchestra.run.smithi112.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:39:47.814 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:39:47.814 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-19T09:32:42.200999+0000 2024-09-19T09:39:47.814 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-19T09:39:47.814 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-19T09:39:47.814 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-19T09:39:47.814 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-19T09:39:47.814 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-19T09:39:47.815 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-19T09:39:47.815 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-19T09:39:47.815 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-19T09:39:47.815 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 45 2024-09-19T09:39:47.815 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:39:47.815 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-19T09:39:47.815 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-19T09:39:47.815 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14460} 2024-09-19T09:39:47.816 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-19T09:39:47.816 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-19T09:39:47.816 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-19T09:39:47.816 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-19T09:39:47.816 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-19T09:39:47.816 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data disabled 2024-09-19T09:39:47.816 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-19T09:39:47.816 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-19T09:39:47.816 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-19T09:39:47.816 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:39:47.816 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.hcoxjz{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:39:47.817 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ymjyok{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/3468750429,v1:172.21.15.112:6827/3468750429] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:39:47.817 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:39:47.817 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:39:47.817 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-19T09:39:47.817 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:39:47.817 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.qweljt{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:39:47.817 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.jjldod{-1:24281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6824/2759077122,v1:172.21.15.191:6825/2759077122] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:39:47.818 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2024-09-19T09:39:47.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.812+0000 7fc3c7d50640 1 -- 172.21.15.112:0/3803790457 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc3ac06e660 msgr2=0x7fc3ac070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.812+0000 7fc3c7d50640 1 --2- 172.21.15.112:0/3803790457 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc3ac06e660 0x7fc3ac070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009af0 tx=0x7fc3b400b040 comp rx=0 tx=0).stop 2024-09-19T09:39:47.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.812+0000 7fc3c7d50640 1 -- 172.21.15.112:0/3803790457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c0102ed0 msgr2=0x7fc3c006ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.812+0000 7fc3c7d50640 1 --2- 172.21.15.112:0/3803790457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c0102ed0 0x7fc3c006ff50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc02a530 tx=0x7fc3bc009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.812+0000 7fc3c7d50640 1 -- 172.21.15.112:0/3803790457 shutdown_connections 2024-09-19T09:39:47.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.812+0000 7fc3c7d50640 1 --2- 172.21.15.112:0/3803790457 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc3ac06e660 0x7fc3ac070b10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.812+0000 7fc3c7d50640 1 --2- 172.21.15.112:0/3803790457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c0102ed0 0x7fc3c006ff50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.812+0000 7fc3c7d50640 1 --2- 172.21.15.112:0/3803790457 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3c0102530 0x7fc3c006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.812+0000 7fc3c7d50640 1 -- 172.21.15.112:0/3803790457 >> 172.21.15.112:0/3803790457 conn(0x7fc3c00f8110 msgr2=0x7fc3c00f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:47.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.812+0000 7fc3c7d50640 1 -- 172.21.15.112:0/3803790457 shutdown_connections 2024-09-19T09:39:47.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.812+0000 7fc3c7d50640 1 -- 172.21.15.112:0/3803790457 wait complete. 2024-09-19T09:39:47.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.891+0000 7f29a73ba640 1 -- 172.21.15.112:0/513201639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a00fb480 msgr2=0x7f29a00fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.891+0000 7f29a73ba640 1 --2- 172.21.15.112:0/513201639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a00fb480 0x7f29a00fb8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f29900048d0 tx=0x7f2990009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.891+0000 7f29a73ba640 1 -- 172.21.15.112:0/513201639 shutdown_connections 2024-09-19T09:39:47.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.891+0000 7f29a73ba640 1 --2- 172.21.15.112:0/513201639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a00fb480 0x7f29a00fb8f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.891+0000 7f29a73ba640 1 --2- 172.21.15.112:0/513201639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29a01014c0 0x7f29a0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.891+0000 7f29a73ba640 1 -- 172.21.15.112:0/513201639 >> 172.21.15.112:0/513201639 conn(0x7f29a00f7000 msgr2=0x7f29a00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:47.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.891+0000 7f29a73ba640 1 -- 172.21.15.112:0/513201639 shutdown_connections 2024-09-19T09:39:47.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.891+0000 7f29a73ba640 1 -- 172.21.15.112:0/513201639 wait complete. 2024-09-19T09:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.892+0000 7f29a73ba640 1 Processor -- start 2024-09-19T09:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.892+0000 7f29a73ba640 1 -- start start 2024-09-19T09:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.892+0000 7f29a73ba640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29a00fb480 0x7f29a0115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.892+0000 7f29a73ba640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a01014c0 0x7f29a0115970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.892+0000 7f29a73ba640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a0115f70 con 0x7f29a01014c0 2024-09-19T09:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.892+0000 7f29a73ba640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a01160e0 con 0x7f29a00fb480 2024-09-19T09:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.892+0000 7f29a4955640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a01014c0 0x7f29a0115970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.892+0000 7f29a5156640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29a00fb480 0x7f29a0115430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.892+0000 7f29a4955640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a01014c0 0x7f29a0115970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46606/0 (socket says 172.21.15.112:46606) 2024-09-19T09:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.892+0000 7f29a4955640 1 -- 172.21.15.112:0/3265889201 learned_addr learned my addr 172.21.15.112:0/3265889201 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.892+0000 7f29a4955640 1 -- 172.21.15.112:0/3265889201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29a00fb480 msgr2=0x7f29a0115430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.892+0000 7f29a4955640 1 --2- 172.21.15.112:0/3265889201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29a00fb480 0x7f29a0115430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.893+0000 7f29a4955640 1 -- 172.21.15.112:0/3265889201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2990005040 con 0x7f29a01014c0 2024-09-19T09:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.893+0000 7f29a4955640 1 --2- 172.21.15.112:0/3265889201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a01014c0 0x7f29a0115970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2990000c00 tx=0x7f2990009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.893+0000 7f2995ffb640 1 -- 172.21.15.112:0/3265889201 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2990038070 con 0x7f29a01014c0 2024-09-19T09:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.893+0000 7f2995ffb640 1 -- 172.21.15.112:0/3265889201 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f299002ade0 con 0x7f29a01014c0 2024-09-19T09:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.893+0000 7f29a73ba640 1 -- 172.21.15.112:0/3265889201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a010f500 con 0x7f29a01014c0 2024-09-19T09:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.893+0000 7f2995ffb640 1 -- 172.21.15.112:0/3265889201 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f299002c7e0 con 0x7f29a01014c0 2024-09-19T09:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.893+0000 7f29a73ba640 1 -- 172.21.15.112:0/3265889201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a010f9c0 con 0x7f29a01014c0 2024-09-19T09:39:47.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.894+0000 7f29a73ba640 1 -- 172.21.15.112:0/3265889201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a00fcbc0 con 0x7f29a01014c0 2024-09-19T09:39:47.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.895+0000 7f2995ffb640 1 -- 172.21.15.112:0/3265889201 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f2990030020 con 0x7f29a01014c0 2024-09-19T09:39:47.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.896+0000 7f2995ffb640 1 --2- 172.21.15.112:0/3265889201 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f298c06e660 0x7f298c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:47.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.896+0000 7f2995ffb640 1 -- 172.21.15.112:0/3265889201 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f29900adec0 con 0x7f29a01014c0 2024-09-19T09:39:47.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.896+0000 7f29a5156640 1 --2- 172.21.15.112:0/3265889201 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f298c06e660 0x7f298c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:47.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.896+0000 7f29a5156640 1 --2- 172.21.15.112:0/3265889201 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f298c06e660 0x7f298c070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f299c004ed0 tx=0x7f299c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:47.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:47.900+0000 7f2995ffb640 1 -- 172.21.15.112:0/3265889201 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2990076ff0 con 0x7f29a01014c0 2024-09-19T09:39:48.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.083+0000 7f29a73ba640 1 -- 172.21.15.112:0/3265889201 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29a01084d0 con 0x7f298c06e660 2024-09-19T09:39:48.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.084+0000 7f2995ffb640 1 -- 172.21.15.112:0/3265889201 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f29a01084d0 con 0x7f298c06e660 2024-09-19T09:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-19T09:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "mon", 2024-09-19T09:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr" 2024-09-19T09:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-19T09:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "4/21 daemons upgraded", 2024-09-19T09:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading crash daemons", 2024-09-19T09:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:39:48.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.086+0000 7f29a73ba640 1 -- 172.21.15.112:0/3265889201 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f298c06e660 msgr2=0x7f298c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:48.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.086+0000 7f29a73ba640 1 --2- 172.21.15.112:0/3265889201 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f298c06e660 0x7f298c070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f299c004ed0 tx=0x7f299c00b040 comp rx=0 tx=0).stop 2024-09-19T09:39:48.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.086+0000 7f29a73ba640 1 -- 172.21.15.112:0/3265889201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a01014c0 msgr2=0x7f29a0115970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:48.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.086+0000 7f29a73ba640 1 --2- 172.21.15.112:0/3265889201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a01014c0 0x7f29a0115970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2990000c00 tx=0x7f2990009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:48.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.086+0000 7f29a73ba640 1 -- 172.21.15.112:0/3265889201 shutdown_connections 2024-09-19T09:39:48.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.086+0000 7f29a73ba640 1 --2- 172.21.15.112:0/3265889201 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f298c06e660 0x7f298c070b10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:48.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.086+0000 7f29a73ba640 1 --2- 172.21.15.112:0/3265889201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a01014c0 0x7f29a0115970 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:48.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.086+0000 7f29a73ba640 1 --2- 172.21.15.112:0/3265889201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29a00fb480 0x7f29a0115430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:48.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.086+0000 7f29a73ba640 1 -- 172.21.15.112:0/3265889201 >> 172.21.15.112:0/3265889201 conn(0x7f29a00f7000 msgr2=0x7f29a0065a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:48.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.086+0000 7f29a73ba640 1 -- 172.21.15.112:0/3265889201 shutdown_connections 2024-09-19T09:39:48.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.086+0000 7f29a73ba640 1 -- 172.21.15.112:0/3265889201 wait complete. 2024-09-19T09:39:48.148 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:48 smithi191 ceph-mon[77624]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:48.148 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:48 smithi191 ceph-mon[77624]: pgmap v29: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:48.148 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:48 smithi191 ceph-mon[77624]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:48.148 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:48 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3849812148' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:48.148 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:48 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3803790457' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:39:48.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.164+0000 7f6976f5e640 1 -- 172.21.15.112:0/754691045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69701014e0 msgr2=0x7f69701018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:48.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.164+0000 7f6976f5e640 1 --2- 172.21.15.112:0/754691045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69701014e0 0x7f69701018b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f69600048d0 tx=0x7f6960009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:48.166 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:48 smithi112 ceph-mon[97503]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:48.166 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:48 smithi112 ceph-mon[97503]: pgmap v29: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:48.166 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:48 smithi112 ceph-mon[97503]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:48.166 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:48 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3849812148' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:48.166 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:48 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3803790457' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:39:48.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.164+0000 7f6976f5e640 1 -- 172.21.15.112:0/754691045 shutdown_connections 2024-09-19T09:39:48.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.164+0000 7f6976f5e640 1 --2- 172.21.15.112:0/754691045 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69700fb4a0 0x7f69700fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:48.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.164+0000 7f6976f5e640 1 --2- 172.21.15.112:0/754691045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69701014e0 0x7f69701018b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:48.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.164+0000 7f6976f5e640 1 -- 172.21.15.112:0/754691045 >> 172.21.15.112:0/754691045 conn(0x7f69700f7060 msgr2=0x7f69700f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:48.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.164+0000 7f6976f5e640 1 -- 172.21.15.112:0/754691045 shutdown_connections 2024-09-19T09:39:48.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.164+0000 7f6976f5e640 1 -- 172.21.15.112:0/754691045 wait complete. 2024-09-19T09:39:48.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.164+0000 7f6976f5e640 1 Processor -- start 2024-09-19T09:39:48.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.164+0000 7f6976f5e640 1 -- start start 2024-09-19T09:39:48.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.165+0000 7f6976f5e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69700fb4a0 0x7f69701120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:48.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.165+0000 7f6976f5e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69701014e0 0x7f69701125e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:48.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.165+0000 7f6976f5e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6970112be0 con 0x7f69700fb4a0 2024-09-19T09:39:48.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.165+0000 7f6976f5e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697010c020 con 0x7f69701014e0 2024-09-19T09:39:48.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.165+0000 7f6974cfa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69700fb4a0 0x7f69701120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:48.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.165+0000 7f6974cfa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69700fb4a0 0x7f69701120a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46616/0 (socket says 172.21.15.112:46616) 2024-09-19T09:39:48.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.165+0000 7f6974cfa640 1 -- 172.21.15.112:0/3514264252 learned_addr learned my addr 172.21.15.112:0/3514264252 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:39:48.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.165+0000 7f6974cfa640 1 -- 172.21.15.112:0/3514264252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69701014e0 msgr2=0x7f69701125e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:48.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.165+0000 7f696ffff640 1 --2- 172.21.15.112:0/3514264252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69701014e0 0x7f69701125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:48.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.165+0000 7f6974cfa640 1 --2- 172.21.15.112:0/3514264252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69701014e0 0x7f69701125e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:48.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.165+0000 7f6974cfa640 1 -- 172.21.15.112:0/3514264252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6960005040 con 0x7f69700fb4a0 2024-09-19T09:39:48.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.166+0000 7f6974cfa640 1 --2- 172.21.15.112:0/3514264252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69700fb4a0 0x7f69701120a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6960000c00 tx=0x7f6960009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:48.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.166+0000 7f696d7fa640 1 -- 172.21.15.112:0/3514264252 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6960038070 con 0x7f69700fb4a0 2024-09-19T09:39:48.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.166+0000 7f696d7fa640 1 -- 172.21.15.112:0/3514264252 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f696002ade0 con 0x7f69700fb4a0 2024-09-19T09:39:48.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.166+0000 7f696d7fa640 1 -- 172.21.15.112:0/3514264252 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f696002c7e0 con 0x7f69700fb4a0 2024-09-19T09:39:48.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.166+0000 7f6976f5e640 1 -- 172.21.15.112:0/3514264252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697010c2a0 con 0x7f69700fb4a0 2024-09-19T09:39:48.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.166+0000 7f6976f5e640 1 -- 172.21.15.112:0/3514264252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697010c790 con 0x7f69700fb4a0 2024-09-19T09:39:48.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.167+0000 7f6976f5e640 1 -- 172.21.15.112:0/3514264252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69700fcbe0 con 0x7f69700fb4a0 2024-09-19T09:39:48.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.168+0000 7f696d7fa640 1 -- 172.21.15.112:0/3514264252 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f6960030020 con 0x7f69700fb4a0 2024-09-19T09:39:48.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.168+0000 7f696d7fa640 1 --2- 172.21.15.112:0/3514264252 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f695806e660 0x7f6958070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:48.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.168+0000 7f696d7fa640 1 -- 172.21.15.112:0/3514264252 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f69600adec0 con 0x7f69700fb4a0 2024-09-19T09:39:48.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.168+0000 7f696ffff640 1 --2- 172.21.15.112:0/3514264252 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f695806e660 0x7f6958070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:48.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.169+0000 7f696ffff640 1 --2- 172.21.15.112:0/3514264252 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f695806e660 0x7f6958070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f697010d960 tx=0x7f696400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:48.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.172+0000 7f696d7fa640 1 -- 172.21.15.112:0/3514264252 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6960076ff0 con 0x7f69700fb4a0 2024-09-19T09:39:48.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.402+0000 7f6976f5e640 1 -- 172.21.15.112:0/3514264252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f69700fac60 con 0x7f69700fb4a0 2024-09-19T09:39:48.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.403+0000 7f696d7fa640 1 -- 172.21.15.112:0/3514264252 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f696007a6b0 con 0x7f69700fb4a0 2024-09-19T09:39:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_OK 2024-09-19T09:39:48.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.405+0000 7f6976f5e640 1 -- 172.21.15.112:0/3514264252 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f695806e660 msgr2=0x7f6958070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:48.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.405+0000 7f6976f5e640 1 --2- 172.21.15.112:0/3514264252 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f695806e660 0x7f6958070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f697010d960 tx=0x7f696400b040 comp rx=0 tx=0).stop 2024-09-19T09:39:48.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.405+0000 7f6976f5e640 1 -- 172.21.15.112:0/3514264252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69700fb4a0 msgr2=0x7f69701120a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:48.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.405+0000 7f6976f5e640 1 --2- 172.21.15.112:0/3514264252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69700fb4a0 0x7f69701120a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6960000c00 tx=0x7f6960009da0 comp rx=0 tx=0).stop 2024-09-19T09:39:48.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.405+0000 7f6976f5e640 1 -- 172.21.15.112:0/3514264252 shutdown_connections 2024-09-19T09:39:48.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.405+0000 7f6976f5e640 1 --2- 172.21.15.112:0/3514264252 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f695806e660 0x7f6958070b10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:48.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.405+0000 7f6976f5e640 1 --2- 172.21.15.112:0/3514264252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69701014e0 0x7f69701125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:48.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.405+0000 7f6976f5e640 1 --2- 172.21.15.112:0/3514264252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69700fb4a0 0x7f69701120a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:48.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.405+0000 7f6976f5e640 1 -- 172.21.15.112:0/3514264252 >> 172.21.15.112:0/3514264252 conn(0x7f69700f7060 msgr2=0x7f69700f7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:48.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.405+0000 7f6976f5e640 1 -- 172.21.15.112:0/3514264252 shutdown_connections 2024-09-19T09:39:48.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:39:48.405+0000 7f6976f5e640 1 -- 172.21.15.112:0/3514264252 wait complete. 2024-09-19T09:39:49.215 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:49 smithi191 ceph-mon[77624]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:49.215 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:49 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3514264252' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:39:49.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:49 smithi112 ceph-mon[97503]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:49.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:49 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3514264252' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:39:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:50 smithi191 ceph-mon[77624]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:50 smithi191 ceph-mon[77624]: pgmap v30: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:50 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:50 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:50 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:50.316 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:50 smithi112 ceph-mon[97503]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:39:50.316 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:50 smithi112 ceph-mon[97503]: pgmap v30: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:50.317 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:50 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:50.317 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:50 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:50.317 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:50 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:52.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:52 smithi191 ceph-mon[77624]: pgmap v31: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:52.316 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:52 smithi112 ceph-mon[97503]: pgmap v31: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:53.332 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:53 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:53.332 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:53 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:53.332 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:53 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:53.332 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:53 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:53.332 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:53 smithi191 ceph-mon[77624]: pgmap v32: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:53.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:53 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:53.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:53 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:53.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:53 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:53.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:53 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:53.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:53 smithi112 ceph-mon[97503]: pgmap v32: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:55.513 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:55 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:55.513 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:55 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:55.513 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:55 smithi191 ceph-mon[77624]: pgmap v33: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:55.513 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:55 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:39:55.513 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:55 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:55.513 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:55 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:55.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:55.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:55.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:55 smithi112 ceph-mon[97503]: pgmap v33: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:55.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:39:55.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:55.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:56.995 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:56 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:56.995 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:56 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:57.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:56 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:57.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:56 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:58.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:57 smithi112 ceph-mon[97503]: pgmap v34: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:58.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:57 smithi191 ceph-mon[77624]: pgmap v34: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:39:59.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:59.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:59.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:59.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:39:59.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:59.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:59.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:59.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:59.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:59.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: Upgrade: Setting container_image for all crash 2024-09-19T09:39:59.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:59.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"}]: dispatch 2024-09-19T09:39:59.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"}]': finished 2024-09-19T09:39:59.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi191"}]: dispatch 2024-09-19T09:39:59.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi191"}]': finished 2024-09-19T09:39:59.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-19T09:39:59.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-19T09:39:59.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: Upgrade: osd.0 is safe to restart 2024-09-19T09:39:59.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:39:59 smithi112 ceph-mon[97503]: pgmap v35: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:59.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:59.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:59.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:59.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:39:59.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:59.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:59.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:59.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:59.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:39:59.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: Upgrade: Setting container_image for all crash 2024-09-19T09:39:59.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:39:59.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"}]: dispatch 2024-09-19T09:39:59.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"}]': finished 2024-09-19T09:39:59.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi191"}]: dispatch 2024-09-19T09:39:59.536 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi191"}]': finished 2024-09-19T09:39:59.536 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-19T09:39:59.536 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-19T09:39:59.536 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: Upgrade: osd.0 is safe to restart 2024-09-19T09:39:59.536 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:39:59 smithi191 ceph-mon[77624]: pgmap v35: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:40:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:00 smithi191 ceph-mon[77624]: Upgrade: Updating osd.0 2024-09-19T09:40:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:00 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:00 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:40:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:00 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:40:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:00 smithi191 ceph-mon[77624]: Deploying daemon osd.0 on smithi112 2024-09-19T09:40:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:00 smithi191 ceph-mon[77624]: overall HEALTH_OK 2024-09-19T09:40:01.117 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:00 smithi112 ceph-mon[97503]: Upgrade: Updating osd.0 2024-09-19T09:40:01.117 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:00 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:01.117 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:00 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:40:01.117 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:00 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:40:01.117 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:00 smithi112 ceph-mon[97503]: Deploying daemon osd.0 on smithi112 2024-09-19T09:40:01.117 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:00 smithi112 ceph-mon[97503]: overall HEALTH_OK 2024-09-19T09:40:02.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:01 smithi191 ceph-mon[77624]: pgmap v36: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:40:02.074 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:01 smithi112 ceph-mon[97503]: pgmap v36: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:40:03.054 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:02 smithi112 systemd[1]: Stopping Ceph osd.0 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:40:03.438 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:03 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0[45343]: 2024-09-19T09:40:03.052+0000 7fbb37cad640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:40:03.439 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:03 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0[45343]: 2024-09-19T09:40:03.052+0000 7fbb37cad640 -1 osd.0 48 *** Got signal Terminated *** 2024-09-19T09:40:03.439 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:03 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0[45343]: 2024-09-19T09:40:03.052+0000 7fbb37cad640 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:40:04.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:03 smithi112 ceph-mon[97503]: pgmap v37: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:40:04.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:03 smithi112 ceph-mon[97503]: osd.0 marked itself down and dead 2024-09-19T09:40:04.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:03 smithi191 ceph-mon[77624]: pgmap v37: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:40:04.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:03 smithi191 ceph-mon[77624]: osd.0 marked itself down and dead 2024-09-19T09:40:04.654 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:04 smithi112 podman[108162]: 2024-09-19 09:40:04.288226679 +0000 UTC m=+1.366812263 container died 621693067dce764a3dcd5f441342d0c49d07f39545ba5fb0a6933e77b44772ad (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, RELEASE=quincy-6e06d1e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:40:04.940 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:04 smithi112 ceph-mon[97503]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:40:04.941 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:04 smithi112 ceph-mon[97503]: osdmap e49: 6 total, 5 up, 6 in 2024-09-19T09:40:04.941 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:04 smithi112 podman[108162]: 2024-09-19 09:40:04.846602293 +0000 UTC m=+1.925187870 container cleanup 621693067dce764a3dcd5f441342d0c49d07f39545ba5fb0a6933e77b44772ad (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-6e06d1e, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T09:40:04.941 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:04 smithi112 bash[108162]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0 2024-09-19T09:40:05.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:04 smithi191 ceph-mon[77624]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:40:05.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:04 smithi191 ceph-mon[77624]: osdmap e49: 6 total, 5 up, 6 in 2024-09-19T09:40:05.438 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:05 smithi112 podman[108178]: 2024-09-19 09:40:05.171189339 +0000 UTC m=+0.886179398 container remove 621693067dce764a3dcd5f441342d0c49d07f39545ba5fb0a6933e77b44772ad (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=quincy-6e06d1e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T09:40:05.801 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:05 smithi112 podman[108266]: 2024-09-19 09:40:05.406441349 +0000 UTC m=+0.016449265 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:40:05.801 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:05 smithi112 podman[108266]: 2024-09-19 09:40:05.530392463 +0000 UTC m=+0.140400428 container create 117f5feb6fe878f9ba4332c26b113acecb9a7771fc147a4de64615a65c86c1c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T09:40:05.801 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:05 smithi112 podman[108266]: 2024-09-19 09:40:05.800057377 +0000 UTC m=+0.410065285 container init 117f5feb6fe878f9ba4332c26b113acecb9a7771fc147a4de64615a65c86c1c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T09:40:06.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:05 smithi112 ceph-mon[97503]: pgmap v39: 65 pgs: 9 stale+active+clean, 56 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-19T09:40:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:05 smithi112 ceph-mon[97503]: osdmap e50: 6 total, 5 up, 6 in 2024-09-19T09:40:06.189 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:05 smithi112 podman[108266]: 2024-09-19 09:40:05.803712055 +0000 UTC m=+0.413719963 container start 117f5feb6fe878f9ba4332c26b113acecb9a7771fc147a4de64615a65c86c1c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4) 2024-09-19T09:40:06.189 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:05 smithi112 podman[108266]: 2024-09-19 09:40:05.883241402 +0000 UTC m=+0.493249305 container attach 117f5feb6fe878f9ba4332c26b113acecb9a7771fc147a4de64615a65c86c1c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:40:06.189 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:05 smithi112 podman[108266]: 2024-09-19 09:40:05.999892216 +0000 UTC m=+0.609900124 container died 117f5feb6fe878f9ba4332c26b113acecb9a7771fc147a4de64615a65c86c1c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:40:06.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:05 smithi191 ceph-mon[77624]: pgmap v39: 65 pgs: 9 stale+active+clean, 56 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-19T09:40:06.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:05 smithi191 ceph-mon[77624]: osdmap e50: 6 total, 5 up, 6 in 2024-09-19T09:40:06.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:06 smithi112 ceph-mon[97503]: Health check failed: Degraded data redundancy: 46/225 objects degraded (20.444%), 17 pgs degraded (PG_DEGRADED) 2024-09-19T09:40:06.939 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:06 smithi112 podman[108289]: 2024-09-19 09:40:06.653585903 +0000 UTC m=+0.647800438 container remove 117f5feb6fe878f9ba4332c26b113acecb9a7771fc147a4de64615a65c86c1c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T09:40:06.939 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:06 smithi112 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-19T09:40:06.939 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:06 smithi112 systemd[1]: Stopped Ceph osd.0 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:40:06.939 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:06 smithi112 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.0.service: Consumed 55.370s CPU time. 2024-09-19T09:40:06.940 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:06 smithi112 systemd[1]: Starting Ceph osd.0 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:40:07.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:06 smithi191 ceph-mon[77624]: Health check failed: Degraded data redundancy: 46/225 objects degraded (20.444%), 17 pgs degraded (PG_DEGRADED) 2024-09-19T09:40:07.416 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:07 smithi112 podman[108388]: 2024-09-19 09:40:07.010228514 +0000 UTC m=+0.016509792 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:40:07.416 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:07 smithi112 podman[108388]: 2024-09-19 09:40:07.171459006 +0000 UTC m=+0.177740274 container create 7fde4f94b441c101978f7c2575e63fa87babf9a57a1ef5d628f1376dbfb1a61d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T09:40:07.416 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:07 smithi112 podman[108388]: 2024-09-19 09:40:07.415348531 +0000 UTC m=+0.421629799 container init 7fde4f94b441c101978f7c2575e63fa87babf9a57a1ef5d628f1376dbfb1a61d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-activate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:40:07.689 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:07 smithi112 podman[108388]: 2024-09-19 09:40:07.418867044 +0000 UTC m=+0.425148313 container start 7fde4f94b441c101978f7c2575e63fa87babf9a57a1ef5d628f1376dbfb1a61d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T09:40:07.689 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:07 smithi112 podman[108388]: 2024-09-19 09:40:07.51581892 +0000 UTC m=+0.522100198 container attach 7fde4f94b441c101978f7c2575e63fa87babf9a57a1ef5d628f1376dbfb1a61d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T09:40:07.689 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:07 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-activate[108402]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:40:07.689 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:07 smithi112 bash[108388]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:40:07.689 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:07 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-activate[108402]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:40:07.689 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:07 smithi112 bash[108388]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:40:08.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:07 smithi112 ceph-mon[97503]: pgmap v41: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:08.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:07 smithi191 ceph-mon[77624]: pgmap v41: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:08.444 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:08 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-activate[108402]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T09:40:08.445 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:08 smithi112 bash[108388]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T09:40:08.445 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:08 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-activate[108402]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-19T09:40:08.445 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:08 smithi112 bash[108388]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-19T09:40:08.904 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:08 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-activate[108402]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-19T09:40:08.904 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:08 smithi112 bash[108388]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-19T09:40:08.904 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:08 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-activate[108402]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-19T09:40:08.904 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:08 smithi112 bash[108388]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-19T09:40:08.904 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:08 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-activate[108402]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-19T09:40:08.905 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:08 smithi112 bash[108388]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-19T09:40:08.905 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:08 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-activate[108402]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T09:40:08.905 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:08 smithi112 bash[108388]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T09:40:08.905 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:08 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-activate[108402]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-19T09:40:08.905 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:08 smithi112 bash[108388]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-19T09:40:08.905 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:08 smithi112 podman[108388]: 2024-09-19 09:40:08.61262044 +0000 UTC m=+1.618901712 container died 7fde4f94b441c101978f7c2575e63fa87babf9a57a1ef5d628f1376dbfb1a61d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:40:09.480 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:09 smithi112 podman[108557]: 2024-09-19 09:40:09.219706076 +0000 UTC m=+0.600677513 container remove 7fde4f94b441c101978f7c2575e63fa87babf9a57a1ef5d628f1376dbfb1a61d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T09:40:09.480 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:09 smithi112 podman[108624]: 2024-09-19 09:40:09.326902758 +0000 UTC m=+0.016047174 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:40:09.480 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:09 smithi112 podman[108624]: 2024-09-19 09:40:09.479047303 +0000 UTC m=+0.168191706 container create 11a51e66388757b9a3eae260696481cd59ed6e2659a1d201d13687eecae633e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T09:40:09.765 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:09 smithi112 podman[108624]: 2024-09-19 09:40:09.681494032 +0000 UTC m=+0.370638440 container init 11a51e66388757b9a3eae260696481cd59ed6e2659a1d201d13687eecae633e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:40:09.766 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:09 smithi112 podman[108624]: 2024-09-19 09:40:09.684580159 +0000 UTC m=+0.373724566 container start 11a51e66388757b9a3eae260696481cd59ed6e2659a1d201d13687eecae633e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T09:40:09.766 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:09 smithi112 ceph-osd[108644]: -- 172.21.15.112:0/4280486948 <== mon.0 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e5e59621e0 con 0x55e5e58f8000 2024-09-19T09:40:10.189 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:09 smithi112 bash[108624]: 11a51e66388757b9a3eae260696481cd59ed6e2659a1d201d13687eecae633e8 2024-09-19T09:40:10.189 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:09 smithi112 systemd[1]: Started Ceph osd.0 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:40:10.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:09 smithi112 ceph-mon[97503]: pgmap v42: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:10.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:10.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:10.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:40:10.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:10.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:40:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:09 smithi191 ceph-mon[77624]: pgmap v42: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:40:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:40:11.900 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:11 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0[108640]: 2024-09-19T09:40:11.573+0000 7f8222011640 -1 Falling back to public interface 2024-09-19T09:40:12.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:11 smithi112 ceph-mon[97503]: pgmap v43: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:12.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:11 smithi191 ceph-mon[77624]: pgmap v43: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:14.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:13 smithi112 ceph-mon[97503]: pgmap v44: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:14.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:13 smithi191 ceph-mon[77624]: pgmap v44: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:16.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:15 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:16.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:15 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:16.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:15 smithi191 ceph-mon[77624]: pgmap v45: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:16.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:15 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:16.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:15 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:16.091 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:15 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:16.091 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:15 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:16.091 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:15 smithi112 ceph-mon[97503]: pgmap v45: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:16.091 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:15 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:16.091 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:15 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:17.539 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:17 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0[108640]: 2024-09-19T09:40:17.281+0000 7f8222011640 -1 osd.0 48 log_to_monitors true 2024-09-19T09:40:18.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:17 smithi112 ceph-mon[97503]: pgmap v46: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:17 smithi112 ceph-mon[97503]: from='osd.0 [v2:172.21.15.112:6802/3114563967,v1:172.21.15.112:6803/3114563967]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:40:18.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:17 smithi191 ceph-mon[77624]: pgmap v46: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:17 smithi191 ceph-mon[77624]: from='osd.0 [v2:172.21.15.112:6802/3114563967,v1:172.21.15.112:6803/3114563967]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:40:18.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.515+0000 7f7b0fac3640 1 -- 172.21.15.112:0/917595317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b080fb810 msgr2=0x7f7b080fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:18.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.515+0000 7f7b0fac3640 1 --2- 172.21.15.112:0/917595317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b080fb810 0x7f7b080fbbe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b040048d0 tx=0x7f7b04009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:18.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.515+0000 7f7b0fac3640 1 -- 172.21.15.112:0/917595317 shutdown_connections 2024-09-19T09:40:18.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.515+0000 7f7b0fac3640 1 --2- 172.21.15.112:0/917595317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b080fcf80 0x7f7b080fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:18.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.515+0000 7f7b0fac3640 1 --2- 172.21.15.112:0/917595317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b080fb810 0x7f7b080fbbe0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:18.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.515+0000 7f7b0fac3640 1 -- 172.21.15.112:0/917595317 >> 172.21.15.112:0/917595317 conn(0x7f7b080723b0 msgr2=0x7f7b080727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:18.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.515+0000 7f7b0fac3640 1 -- 172.21.15.112:0/917595317 shutdown_connections 2024-09-19T09:40:18.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.515+0000 7f7b0fac3640 1 -- 172.21.15.112:0/917595317 wait complete. 2024-09-19T09:40:18.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.516+0000 7f7b0fac3640 1 Processor -- start 2024-09-19T09:40:18.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.516+0000 7f7b0fac3640 1 -- start start 2024-09-19T09:40:18.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.516+0000 7f7b0fac3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b080fb810 0x7f7b081131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:18.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.516+0000 7f7b0fac3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b080fcf80 0x7f7b08113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:18.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.516+0000 7f7b0fac3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b08113d20 con 0x7f7b080fb810 2024-09-19T09:40:18.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.516+0000 7f7b0fac3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0810d160 con 0x7f7b080fcf80 2024-09-19T09:40:18.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.517+0000 7f7b0d85f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b080fb810 0x7f7b081131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:18.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.517+0000 7f7b0d85f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b080fb810 0x7f7b081131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41638/0 (socket says 172.21.15.112:41638) 2024-09-19T09:40:18.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.517+0000 7f7b0d85f640 1 -- 172.21.15.112:0/1267843054 learned_addr learned my addr 172.21.15.112:0/1267843054 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:40:18.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.517+0000 7f7b0d05e640 1 --2- 172.21.15.112:0/1267843054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b080fcf80 0x7f7b08113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:18.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.517+0000 7f7b0d85f640 1 -- 172.21.15.112:0/1267843054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b080fcf80 msgr2=0x7f7b08113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:18.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.517+0000 7f7b0d85f640 1 --2- 172.21.15.112:0/1267843054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b080fcf80 0x7f7b08113720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:18.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.517+0000 7f7b0d85f640 1 -- 172.21.15.112:0/1267843054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b04005040 con 0x7f7b080fb810 2024-09-19T09:40:18.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.517+0000 7f7b0d85f640 1 --2- 172.21.15.112:0/1267843054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b080fb810 0x7f7b081131e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7b04003080 tx=0x7f7b04009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:18.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.517+0000 7f7afe7fc640 1 -- 172.21.15.112:0/1267843054 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b04038070 con 0x7f7b080fb810 2024-09-19T09:40:18.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.517+0000 7f7b0fac3640 1 -- 172.21.15.112:0/1267843054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0810d3e0 con 0x7f7b080fb810 2024-09-19T09:40:18.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.517+0000 7f7afe7fc640 1 -- 172.21.15.112:0/1267843054 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7b040097e0 con 0x7f7b080fb810 2024-09-19T09:40:18.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.517+0000 7f7afe7fc640 1 -- 172.21.15.112:0/1267843054 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b0403d420 con 0x7f7b080fb810 2024-09-19T09:40:18.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.518+0000 7f7b0fac3640 1 -- 172.21.15.112:0/1267843054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0810d920 con 0x7f7b080fb810 2024-09-19T09:40:18.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.519+0000 7f7b0fac3640 1 -- 172.21.15.112:0/1267843054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b080fcbc0 con 0x7f7b080fb810 2024-09-19T09:40:18.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.519+0000 7f7afe7fc640 1 -- 172.21.15.112:0/1267843054 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f7b04030020 con 0x7f7b080fb810 2024-09-19T09:40:18.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.520+0000 7f7afe7fc640 1 --2- 172.21.15.112:0/1267843054 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7af406e660 0x7f7af4070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:18.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.520+0000 7f7afe7fc640 1 -- 172.21.15.112:0/1267843054 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7b040ae740 con 0x7f7b080fb810 2024-09-19T09:40:18.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.520+0000 7f7b0d05e640 1 --2- 172.21.15.112:0/1267843054 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7af406e660 0x7f7af4070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:18.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.521+0000 7f7b0d05e640 1 --2- 172.21.15.112:0/1267843054 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7af406e660 0x7f7af4070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7b0810eaa0 tx=0x7f7af8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:18.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.528+0000 7f7afe7fc640 1 -- 172.21.15.112:0/1267843054 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7b040777c0 con 0x7f7b080fb810 2024-09-19T09:40:18.801 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:40:18 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0[108640]: 2024-09-19T09:40:18.733+0000 7f8215da3640 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:40:18.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.798+0000 7f7b0fac3640 1 -- 172.21.15.112:0/1267843054 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b0804b720 con 0x7f7af406e660 2024-09-19T09:40:18.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.800+0000 7f7afe7fc640 1 -- 172.21.15.112:0/1267843054 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7b0804b720 con 0x7f7af406e660 2024-09-19T09:40:18.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.801+0000 7f7b0fac3640 1 -- 172.21.15.112:0/1267843054 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7af406e660 msgr2=0x7f7af4070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:18.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.801+0000 7f7b0fac3640 1 --2- 172.21.15.112:0/1267843054 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7af406e660 0x7f7af4070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7b0810eaa0 tx=0x7f7af8009040 comp rx=0 tx=0).stop 2024-09-19T09:40:18.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.801+0000 7f7b0fac3640 1 -- 172.21.15.112:0/1267843054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b080fb810 msgr2=0x7f7b081131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:18.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.801+0000 7f7b0fac3640 1 --2- 172.21.15.112:0/1267843054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b080fb810 0x7f7b081131e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7b04003080 tx=0x7f7b04009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:18.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.802+0000 7f7b0fac3640 1 -- 172.21.15.112:0/1267843054 shutdown_connections 2024-09-19T09:40:18.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.802+0000 7f7b0fac3640 1 --2- 172.21.15.112:0/1267843054 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7af406e660 0x7f7af4070b10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:18.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.802+0000 7f7b0fac3640 1 --2- 172.21.15.112:0/1267843054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b080fcf80 0x7f7b08113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:18.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.802+0000 7f7b0fac3640 1 --2- 172.21.15.112:0/1267843054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b080fb810 0x7f7b081131e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:18.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.802+0000 7f7b0fac3640 1 -- 172.21.15.112:0/1267843054 >> 172.21.15.112:0/1267843054 conn(0x7f7b080723b0 msgr2=0x7f7b080fa8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:18.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.802+0000 7f7b0fac3640 1 -- 172.21.15.112:0/1267843054 shutdown_connections 2024-09-19T09:40:18.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.802+0000 7f7b0fac3640 1 -- 172.21.15.112:0/1267843054 wait complete. 2024-09-19T09:40:18.812 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:40:18.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.881+0000 7f72978c0640 1 -- 172.21.15.112:0/2336250006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72901014b0 msgr2=0x7f7290101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:18.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.881+0000 7f72978c0640 1 --2- 172.21.15.112:0/2336250006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72901014b0 0x7f7290101880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f728c0048d0 tx=0x7f728c009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:18.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.882+0000 7f72978c0640 1 -- 172.21.15.112:0/2336250006 shutdown_connections 2024-09-19T09:40:18.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.882+0000 7f72978c0640 1 --2- 172.21.15.112:0/2336250006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72900fb470 0x7f72900fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:18.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.882+0000 7f72978c0640 1 --2- 172.21.15.112:0/2336250006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72901014b0 0x7f7290101880 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:18.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.882+0000 7f72978c0640 1 -- 172.21.15.112:0/2336250006 >> 172.21.15.112:0/2336250006 conn(0x7f72900f7030 msgr2=0x7f72900f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.882+0000 7f72978c0640 1 -- 172.21.15.112:0/2336250006 shutdown_connections 2024-09-19T09:40:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.882+0000 7f72978c0640 1 -- 172.21.15.112:0/2336250006 wait complete. 2024-09-19T09:40:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.882+0000 7f72978c0640 1 Processor -- start 2024-09-19T09:40:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.882+0000 7f72978c0640 1 -- start start 2024-09-19T09:40:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f72978c0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72900fb470 0x7f729010e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f72978c0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72901014b0 0x7f729010e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f72978c0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729010ed40 con 0x7f72900fb470 2024-09-19T09:40:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f72978c0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729010eeb0 con 0x7f72901014b0 2024-09-19T09:40:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f729565c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72900fb470 0x7f729010e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f729565c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72900fb470 0x7f729010e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41656/0 (socket says 172.21.15.112:41656) 2024-09-19T09:40:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f729565c640 1 -- 172.21.15.112:0/477903278 learned_addr learned my addr 172.21.15.112:0/477903278 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:40:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f7294e5b640 1 --2- 172.21.15.112:0/477903278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72901014b0 0x7f729010e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f729565c640 1 -- 172.21.15.112:0/477903278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72901014b0 msgr2=0x7f729010e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f729565c640 1 --2- 172.21.15.112:0/477903278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72901014b0 0x7f729010e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:18.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f729565c640 1 -- 172.21.15.112:0/477903278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c005040 con 0x7f72900fb470 2024-09-19T09:40:18.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f729565c640 1 --2- 172.21.15.112:0/477903278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72900fb470 0x7f729010e2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f728c000c00 tx=0x7f728c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:18.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f7285ffb640 1 -- 172.21.15.112:0/477903278 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f728c038070 con 0x7f72900fb470 2024-09-19T09:40:18.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f7285ffb640 1 -- 172.21.15.112:0/477903278 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f728c02ade0 con 0x7f72900fb470 2024-09-19T09:40:18.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f72978c0640 1 -- 172.21.15.112:0/477903278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7290117190 con 0x7f72900fb470 2024-09-19T09:40:18.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.883+0000 7f7285ffb640 1 -- 172.21.15.112:0/477903278 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f728c02c7e0 con 0x7f72900fb470 2024-09-19T09:40:18.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.884+0000 7f72978c0640 1 -- 172.21.15.112:0/477903278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7290117650 con 0x7f72900fb470 2024-09-19T09:40:18.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.884+0000 7f72978c0640 1 -- 172.21.15.112:0/477903278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72900fcbb0 con 0x7f72900fb470 2024-09-19T09:40:18.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.885+0000 7f7285ffb640 1 -- 172.21.15.112:0/477903278 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f728c030020 con 0x7f72900fb470 2024-09-19T09:40:18.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.885+0000 7f7285ffb640 1 --2- 172.21.15.112:0/477903278 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f727c06e660 0x7f727c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:18.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.885+0000 7f7285ffb640 1 -- 172.21.15.112:0/477903278 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f728c0adec0 con 0x7f72900fb470 2024-09-19T09:40:18.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.886+0000 7f7294e5b640 1 --2- 172.21.15.112:0/477903278 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f727c06e660 0x7f727c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:18.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.886+0000 7f7294e5b640 1 --2- 172.21.15.112:0/477903278 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f727c06e660 0x7f727c070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7280007fd0 tx=0x7f7280009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:18.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:18.890+0000 7f7285ffb640 1 -- 172.21.15.112:0/477903278 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f728c076ff0 con 0x7f72900fb470 2024-09-19T09:40:19.079 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:18 smithi112 ceph-mon[97503]: from='osd.0 [v2:172.21.15.112:6802/3114563967,v1:172.21.15.112:6803/3114563967]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:40:19.079 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:18 smithi112 ceph-mon[97503]: osdmap e51: 6 total, 5 up, 6 in 2024-09-19T09:40:19.079 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:18 smithi112 ceph-mon[97503]: from='osd.0 [v2:172.21.15.112:6802/3114563967,v1:172.21.15.112:6803/3114563967]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-19T09:40:19.079 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:18 smithi112 ceph-mon[97503]: from='osd.0 [v2:172.21.15.112:6802/3114563967,v1:172.21.15.112:6803/3114563967]' entity='osd.0' 2024-09-19T09:40:19.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.101+0000 7f72978c0640 1 -- 172.21.15.112:0/477903278 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7290066020 con 0x7f727c06e660 2024-09-19T09:40:19.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.102+0000 7f7285ffb640 1 -- 172.21.15.112:0/477903278 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7290066020 con 0x7f727c06e660 2024-09-19T09:40:19.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.105+0000 7f72978c0640 1 -- 172.21.15.112:0/477903278 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f727c06e660 msgr2=0x7f727c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.105+0000 7f72978c0640 1 --2- 172.21.15.112:0/477903278 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f727c06e660 0x7f727c070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7280007fd0 tx=0x7f7280009e90 comp rx=0 tx=0).stop 2024-09-19T09:40:19.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.105+0000 7f72978c0640 1 -- 172.21.15.112:0/477903278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72900fb470 msgr2=0x7f729010e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.105+0000 7f72978c0640 1 --2- 172.21.15.112:0/477903278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72900fb470 0x7f729010e2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f728c000c00 tx=0x7f728c009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.105+0000 7f72978c0640 1 -- 172.21.15.112:0/477903278 shutdown_connections 2024-09-19T09:40:19.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.105+0000 7f72978c0640 1 --2- 172.21.15.112:0/477903278 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f727c06e660 0x7f727c070b10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.105+0000 7f72978c0640 1 --2- 172.21.15.112:0/477903278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72901014b0 0x7f729010e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.105+0000 7f72978c0640 1 --2- 172.21.15.112:0/477903278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72900fb470 0x7f729010e2c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.105+0000 7f72978c0640 1 -- 172.21.15.112:0/477903278 >> 172.21.15.112:0/477903278 conn(0x7f72900f7030 msgr2=0x7f72900f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:19.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.105+0000 7f72978c0640 1 -- 172.21.15.112:0/477903278 shutdown_connections 2024-09-19T09:40:19.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.105+0000 7f72978c0640 1 -- 172.21.15.112:0/477903278 wait complete. 2024-09-19T09:40:19.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.182+0000 7f4868051640 1 -- 172.21.15.112:0/1040996958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48601014d0 msgr2=0x7f48601018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.182+0000 7f4868051640 1 --2- 172.21.15.112:0/1040996958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48601014d0 0x7f48601018a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f485c0048d0 tx=0x7f485c009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.182+0000 7f4868051640 1 -- 172.21.15.112:0/1040996958 shutdown_connections 2024-09-19T09:40:19.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.182+0000 7f4868051640 1 --2- 172.21.15.112:0/1040996958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48600fb490 0x7f48600fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.182+0000 7f4868051640 1 --2- 172.21.15.112:0/1040996958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48601014d0 0x7f48601018a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.182+0000 7f4868051640 1 -- 172.21.15.112:0/1040996958 >> 172.21.15.112:0/1040996958 conn(0x7f48600f7010 msgr2=0x7f48600f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:19.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.183+0000 7f4868051640 1 -- 172.21.15.112:0/1040996958 shutdown_connections 2024-09-19T09:40:19.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.183+0000 7f4868051640 1 -- 172.21.15.112:0/1040996958 wait complete. 2024-09-19T09:40:19.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.183+0000 7f4868051640 1 Processor -- start 2024-09-19T09:40:19.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.183+0000 7f4868051640 1 -- start start 2024-09-19T09:40:19.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.183+0000 7f4868051640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48600fb490 0x7f486010e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:19.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.183+0000 7f4868051640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48601014d0 0x7f486010e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:19.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.183+0000 7f4868051640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486010ed30 con 0x7f48600fb490 2024-09-19T09:40:19.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.183+0000 7f4868051640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486010eea0 con 0x7f48601014d0 2024-09-19T09:40:19.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.183+0000 7f4865ded640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48600fb490 0x7f486010e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:19.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.183+0000 7f4865ded640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48600fb490 0x7f486010e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41664/0 (socket says 172.21.15.112:41664) 2024-09-19T09:40:19.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.183+0000 7f4865ded640 1 -- 172.21.15.112:0/2449118297 learned_addr learned my addr 172.21.15.112:0/2449118297 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:40:19.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.183+0000 7f48655ec640 1 --2- 172.21.15.112:0/2449118297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48601014d0 0x7f486010e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:19.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.184+0000 7f4865ded640 1 -- 172.21.15.112:0/2449118297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48601014d0 msgr2=0x7f486010e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.184+0000 7f4865ded640 1 --2- 172.21.15.112:0/2449118297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48601014d0 0x7f486010e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.184+0000 7f4865ded640 1 -- 172.21.15.112:0/2449118297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c005040 con 0x7f48600fb490 2024-09-19T09:40:19.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.184+0000 7f4865ded640 1 --2- 172.21.15.112:0/2449118297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48600fb490 0x7f486010e1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f485c000c00 tx=0x7f485c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:19.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.184+0000 7f48567fc640 1 -- 172.21.15.112:0/2449118297 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f485c038070 con 0x7f48600fb490 2024-09-19T09:40:19.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.184+0000 7f4868051640 1 -- 172.21.15.112:0/2449118297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4860117210 con 0x7f48600fb490 2024-09-19T09:40:19.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.184+0000 7f48567fc640 1 -- 172.21.15.112:0/2449118297 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f485c02ade0 con 0x7f48600fb490 2024-09-19T09:40:19.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.184+0000 7f48567fc640 1 -- 172.21.15.112:0/2449118297 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f485c02c7e0 con 0x7f48600fb490 2024-09-19T09:40:19.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.184+0000 7f4868051640 1 -- 172.21.15.112:0/2449118297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4860117670 con 0x7f48600fb490 2024-09-19T09:40:19.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.185+0000 7f4868051640 1 -- 172.21.15.112:0/2449118297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48600fcbd0 con 0x7f48600fb490 2024-09-19T09:40:19.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.186+0000 7f48567fc640 1 -- 172.21.15.112:0/2449118297 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f485c030020 con 0x7f48600fb490 2024-09-19T09:40:19.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.186+0000 7f48567fc640 1 --2- 172.21.15.112:0/2449118297 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f484c06e660 0x7f484c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:19.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.186+0000 7f48655ec640 1 --2- 172.21.15.112:0/2449118297 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f484c06e660 0x7f484c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:19.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.186+0000 7f48567fc640 1 -- 172.21.15.112:0/2449118297 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f485c0addf0 con 0x7f48600fb490 2024-09-19T09:40:19.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.186+0000 7f48655ec640 1 --2- 172.21.15.112:0/2449118297 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f484c06e660 0x7f484c070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4850007fd0 tx=0x7f4850009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:19.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.190+0000 7f48567fc640 1 -- 172.21.15.112:0/2449118297 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f485c076fa0 con 0x7f48600fb490 2024-09-19T09:40:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:18 smithi191 ceph-mon[77624]: from='osd.0 [v2:172.21.15.112:6802/3114563967,v1:172.21.15.112:6803/3114563967]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:40:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:18 smithi191 ceph-mon[77624]: osdmap e51: 6 total, 5 up, 6 in 2024-09-19T09:40:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:18 smithi191 ceph-mon[77624]: from='osd.0 [v2:172.21.15.112:6802/3114563967,v1:172.21.15.112:6803/3114563967]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-19T09:40:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:18 smithi191 ceph-mon[77624]: from='osd.0 [v2:172.21.15.112:6802/3114563967,v1:172.21.15.112:6803/3114563967]' entity='osd.0' 2024-09-19T09:40:19.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.364+0000 7f4868051640 1 -- 172.21.15.112:0/2449118297 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4860066280 con 0x7f484c06e660 2024-09-19T09:40:19.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.373+0000 7f48567fc640 1 -- 172.21.15.112:0/2449118297 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4860066280 con 0x7f484c06e660 2024-09-19T09:40:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:40:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (4m) 4s ago 13m 26.9M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:40:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (35s) 4s ago 13m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 70bad8ff6ec4 2024-09-19T09:40:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (30s) 27s ago 12m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 6f8cb10f4c96 2024-09-19T09:40:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (2m) 4s ago 12m 80.3M - 9.4.12 2bacad6d85d8 e462aca2b022 2024-09-19T09:40:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (7m) 4s ago 7m 153M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:40:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (7m) 4s ago 7m 106M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:40:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (7m) 27s ago 7m 13.6M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:40:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (7m) 27s ago 7m 16.1M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:40:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (4m) 4s ago 14m 498M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:40:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283,8765 running (3m) 27s ago 12m 439M - 19.1.1-361-g2f599a46 d2baa855c067 fddba1bee64a 2024-09-19T09:40:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (91s) 4s ago 14m 41.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 89dfb5de44c8 2024-09-19T09:40:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (69s) 27s ago 12m 34.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 3cab8f7cc27e 2024-09-19T09:40:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (5m) 4s ago 13m 16.1M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:40:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (4m) 27s ago 12m 16.3M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:40:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (10s) 4s ago 11m 12.1M 1557M 19.1.1-361-g2f599a46 d2baa855c067 11a51e663887 2024-09-19T09:40:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (11m) 4s ago 11m 248M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 1742e5964367 2024-09-19T09:40:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (10m) 4s ago 10m 212M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 4dcca18af229 2024-09-19T09:40:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (10m) 27s ago 10m 271M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:40:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (9m) 27s ago 9m 239M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:40:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (9m) 27s ago 9m 226M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:40:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (3m) 4s ago 12m 63.6M - 2.43.0 a07b618ecd1d 54850883a171 2024-09-19T09:40:19.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.376+0000 7f4868051640 1 -- 172.21.15.112:0/2449118297 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f484c06e660 msgr2=0x7f484c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.376+0000 7f4868051640 1 --2- 172.21.15.112:0/2449118297 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f484c06e660 0x7f484c070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4850007fd0 tx=0x7f4850009e90 comp rx=0 tx=0).stop 2024-09-19T09:40:19.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.376+0000 7f4868051640 1 -- 172.21.15.112:0/2449118297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48600fb490 msgr2=0x7f486010e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.376+0000 7f4868051640 1 --2- 172.21.15.112:0/2449118297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48600fb490 0x7f486010e1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f485c000c00 tx=0x7f485c009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.376+0000 7f4868051640 1 -- 172.21.15.112:0/2449118297 shutdown_connections 2024-09-19T09:40:19.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.376+0000 7f4868051640 1 --2- 172.21.15.112:0/2449118297 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f484c06e660 0x7f484c070b10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.376+0000 7f4868051640 1 --2- 172.21.15.112:0/2449118297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48601014d0 0x7f486010e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.376+0000 7f4868051640 1 --2- 172.21.15.112:0/2449118297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48600fb490 0x7f486010e1a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.376+0000 7f4868051640 1 -- 172.21.15.112:0/2449118297 >> 172.21.15.112:0/2449118297 conn(0x7f48600f7010 msgr2=0x7f48600f8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:19.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.376+0000 7f4868051640 1 -- 172.21.15.112:0/2449118297 shutdown_connections 2024-09-19T09:40:19.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.376+0000 7f4868051640 1 -- 172.21.15.112:0/2449118297 wait complete. 2024-09-19T09:40:19.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.452+0000 7f377989b640 1 -- 172.21.15.112:0/3620771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37741025f0 msgr2=0x7f37741029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.452+0000 7f377989b640 1 --2- 172.21.15.112:0/3620771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37741025f0 0x7f37741029c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f37640048d0 tx=0x7f3764009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.452+0000 7f377989b640 1 -- 172.21.15.112:0/3620771 shutdown_connections 2024-09-19T09:40:19.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.452+0000 7f377989b640 1 --2- 172.21.15.112:0/3620771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37740fac60 0x7f37740fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.452+0000 7f377989b640 1 --2- 172.21.15.112:0/3620771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37741025f0 0x7f37741029c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.452+0000 7f377989b640 1 -- 172.21.15.112:0/3620771 >> 172.21.15.112:0/3620771 conn(0x7f3774070c80 msgr2=0x7f3774071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:19.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.452+0000 7f377989b640 1 -- 172.21.15.112:0/3620771 shutdown_connections 2024-09-19T09:40:19.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.452+0000 7f377989b640 1 -- 172.21.15.112:0/3620771 wait complete. 2024-09-19T09:40:19.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.453+0000 7f377989b640 1 Processor -- start 2024-09-19T09:40:19.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.453+0000 7f377989b640 1 -- start start 2024-09-19T09:40:19.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.453+0000 7f377989b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37740fac60 0x7f3774113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:19.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.453+0000 7f377989b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37741025f0 0x7f37741137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:19.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.453+0000 7f377989b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3774113e40 con 0x7f37740fac60 2024-09-19T09:40:19.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.453+0000 7f377989b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377410d1f0 con 0x7f37741025f0 2024-09-19T09:40:19.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.453+0000 7f3772ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37740fac60 0x7f3774113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:19.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.453+0000 7f3772ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37740fac60 0x7f3774113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41678/0 (socket says 172.21.15.112:41678) 2024-09-19T09:40:19.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.453+0000 7f3772ffd640 1 -- 172.21.15.112:0/2937901436 learned_addr learned my addr 172.21.15.112:0/2937901436 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:40:19.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.454+0000 7f3772ffd640 1 -- 172.21.15.112:0/2937901436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37741025f0 msgr2=0x7f37741137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.454+0000 7f3772ffd640 1 --2- 172.21.15.112:0/2937901436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37741025f0 0x7f37741137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.454+0000 7f3772ffd640 1 -- 172.21.15.112:0/2937901436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764005040 con 0x7f37740fac60 2024-09-19T09:40:19.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.454+0000 7f3772ffd640 1 --2- 172.21.15.112:0/2937901436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37740fac60 0x7f3774113270 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3764003080 tx=0x7f3764009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:19.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.454+0000 7f376bfff640 1 -- 172.21.15.112:0/2937901436 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3764038070 con 0x7f37740fac60 2024-09-19T09:40:19.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.454+0000 7f376bfff640 1 -- 172.21.15.112:0/2937901436 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f376402ade0 con 0x7f37740fac60 2024-09-19T09:40:19.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.454+0000 7f377989b640 1 -- 172.21.15.112:0/2937901436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377410d470 con 0x7f37740fac60 2024-09-19T09:40:19.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.454+0000 7f376bfff640 1 -- 172.21.15.112:0/2937901436 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f376402c880 con 0x7f37740fac60 2024-09-19T09:40:19.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.454+0000 7f377989b640 1 -- 172.21.15.112:0/2937901436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377410d8d0 con 0x7f37740fac60 2024-09-19T09:40:19.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.455+0000 7f377989b640 1 -- 172.21.15.112:0/2937901436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3774065810 con 0x7f37740fac60 2024-09-19T09:40:19.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.455+0000 7f376bfff640 1 -- 172.21.15.112:0/2937901436 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f3764030020 con 0x7f37740fac60 2024-09-19T09:40:19.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.456+0000 7f376bfff640 1 --2- 172.21.15.112:0/2937901436 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f376006e660 0x7f3760070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:19.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.456+0000 7f376bfff640 1 -- 172.21.15.112:0/2937901436 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f37640ae2f0 con 0x7f37740fac60 2024-09-19T09:40:19.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.456+0000 7f376a7fc640 1 --2- 172.21.15.112:0/2937901436 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f376006e660 0x7f3760070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:19.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.457+0000 7f376a7fc640 1 --2- 172.21.15.112:0/2937901436 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f376006e660 0x7f3760070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f377410eb30 tx=0x7f375c006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:19.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.460+0000 7f376bfff640 1 -- 172.21.15.112:0/2937901436 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3764077370 con 0x7f37740fac60 2024-09-19T09:40:19.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.692+0000 7f377989b640 1 -- 172.21.15.112:0/2937901436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3774109710 con 0x7f37740fac60 2024-09-19T09:40:19.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.692+0000 7f376bfff640 1 -- 172.21.15.112:0/2937901436 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+744 (secure 0 0 0) 0x7f376407aa30 con 0x7f37740fac60 2024-09-19T09:40:19.694 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:40:19.694 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:40:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:40:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:40:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:40:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:40:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:40:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:40:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 5 2024-09-19T09:40:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:40:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:40:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:40:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:40:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:40:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 9, 2024-09-19T09:40:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T09:40:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:40:19.696 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:40:19.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.694+0000 7f377989b640 1 -- 172.21.15.112:0/2937901436 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f376006e660 msgr2=0x7f3760070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.694+0000 7f377989b640 1 --2- 172.21.15.112:0/2937901436 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f376006e660 0x7f3760070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f377410eb30 tx=0x7f375c006d20 comp rx=0 tx=0).stop 2024-09-19T09:40:19.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.694+0000 7f377989b640 1 -- 172.21.15.112:0/2937901436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37740fac60 msgr2=0x7f3774113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.694+0000 7f377989b640 1 --2- 172.21.15.112:0/2937901436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37740fac60 0x7f3774113270 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3764003080 tx=0x7f3764009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.694+0000 7f377989b640 1 -- 172.21.15.112:0/2937901436 shutdown_connections 2024-09-19T09:40:19.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.694+0000 7f377989b640 1 --2- 172.21.15.112:0/2937901436 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f376006e660 0x7f3760070b10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.694+0000 7f377989b640 1 --2- 172.21.15.112:0/2937901436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37741025f0 0x7f37741137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.694+0000 7f377989b640 1 --2- 172.21.15.112:0/2937901436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37740fac60 0x7f3774113270 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.694+0000 7f377989b640 1 -- 172.21.15.112:0/2937901436 >> 172.21.15.112:0/2937901436 conn(0x7f3774070c80 msgr2=0x7f37740f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:19.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.695+0000 7f377989b640 1 -- 172.21.15.112:0/2937901436 shutdown_connections 2024-09-19T09:40:19.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.695+0000 7f377989b640 1 -- 172.21.15.112:0/2937901436 wait complete. 2024-09-19T09:40:19.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.786+0000 7f1a8a081640 1 -- 172.21.15.112:0/1487114566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a841014b0 msgr2=0x7f1a84101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.786+0000 7f1a8a081640 1 --2- 172.21.15.112:0/1487114566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a841014b0 0x7f1a84101880 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1a740048d0 tx=0x7f1a74009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.786+0000 7f1a8a081640 1 -- 172.21.15.112:0/1487114566 shutdown_connections 2024-09-19T09:40:19.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.786+0000 7f1a8a081640 1 --2- 172.21.15.112:0/1487114566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1a840fb470 0x7f1a840fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.786+0000 7f1a8a081640 1 --2- 172.21.15.112:0/1487114566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a841014b0 0x7f1a84101880 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.786+0000 7f1a8a081640 1 -- 172.21.15.112:0/1487114566 >> 172.21.15.112:0/1487114566 conn(0x7f1a840f7030 msgr2=0x7f1a840f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:19.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.786+0000 7f1a8a081640 1 -- 172.21.15.112:0/1487114566 shutdown_connections 2024-09-19T09:40:19.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.786+0000 7f1a8a081640 1 -- 172.21.15.112:0/1487114566 wait complete. 2024-09-19T09:40:19.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.786+0000 7f1a8a081640 1 Processor -- start 2024-09-19T09:40:19.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.786+0000 7f1a8a081640 1 -- start start 2024-09-19T09:40:19.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.787+0000 7f1a8a081640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a840fb470 0x7f1a84113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:19.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.787+0000 7f1a8a081640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1a841014b0 0x7f1a841136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:19.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.787+0000 7f1a8a081640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a84113cc0 con 0x7f1a840fb470 2024-09-19T09:40:19.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.787+0000 7f1a8a081640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8410d100 con 0x7f1a841014b0 2024-09-19T09:40:19.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.787+0000 7f1a837fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a840fb470 0x7f1a84113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:19.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.787+0000 7f1a837fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a840fb470 0x7f1a84113180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41688/0 (socket says 172.21.15.112:41688) 2024-09-19T09:40:19.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.787+0000 7f1a837fe640 1 -- 172.21.15.112:0/584429861 learned_addr learned my addr 172.21.15.112:0/584429861 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:40:19.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.787+0000 7f1a82ffd640 1 --2- 172.21.15.112:0/584429861 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1a841014b0 0x7f1a841136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:19.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.787+0000 7f1a837fe640 1 -- 172.21.15.112:0/584429861 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1a841014b0 msgr2=0x7f1a841136c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.787+0000 7f1a837fe640 1 --2- 172.21.15.112:0/584429861 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1a841014b0 0x7f1a841136c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.787+0000 7f1a837fe640 1 -- 172.21.15.112:0/584429861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74005040 con 0x7f1a840fb470 2024-09-19T09:40:19.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.787+0000 7f1a837fe640 1 --2- 172.21.15.112:0/584429861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a840fb470 0x7f1a84113180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a74003080 tx=0x7f1a74009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:19.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.787+0000 7f1a6bfff640 1 -- 172.21.15.112:0/584429861 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a74038070 con 0x7f1a840fb470 2024-09-19T09:40:19.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.788+0000 7f1a6bfff640 1 -- 172.21.15.112:0/584429861 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1a740097e0 con 0x7f1a840fb470 2024-09-19T09:40:19.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.788+0000 7f1a8a081640 1 -- 172.21.15.112:0/584429861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8410d380 con 0x7f1a840fb470 2024-09-19T09:40:19.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.788+0000 7f1a6bfff640 1 -- 172.21.15.112:0/584429861 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7403d420 con 0x7f1a840fb470 2024-09-19T09:40:19.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.788+0000 7f1a8a081640 1 -- 172.21.15.112:0/584429861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8410d8c0 con 0x7f1a840fb470 2024-09-19T09:40:19.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.789+0000 7f1a8a081640 1 -- 172.21.15.112:0/584429861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a840fcbb0 con 0x7f1a840fb470 2024-09-19T09:40:19.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.789+0000 7f1a6bfff640 1 -- 172.21.15.112:0/584429861 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f1a74030020 con 0x7f1a840fb470 2024-09-19T09:40:19.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.790+0000 7f1a6bfff640 1 --2- 172.21.15.112:0/584429861 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1a6c06e660 0x7f1a6c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:19.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.790+0000 7f1a6bfff640 1 -- 172.21.15.112:0/584429861 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1a740ae740 con 0x7f1a840fb470 2024-09-19T09:40:19.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.790+0000 7f1a82ffd640 1 --2- 172.21.15.112:0/584429861 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1a6c06e660 0x7f1a6c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:19.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.790+0000 7f1a82ffd640 1 --2- 172.21.15.112:0/584429861 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1a6c06e660 0x7f1a6c070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1a8410ea40 tx=0x7f1a78004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:19.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.794+0000 7f1a6bfff640 1 -- 172.21.15.112:0/584429861 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1a740777c0 con 0x7f1a840fb470 2024-09-19T09:40:20.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.998+0000 7f1a8a081640 1 -- 172.21.15.112:0/584429861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1a840fac30 con 0x7f1a840fb470 2024-09-19T09:40:20.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:19.998+0000 7f1a6bfff640 1 -- 172.21.15.112:0/584429861 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1949 (secure 0 0 0) 0x7f1a7407ae80 con 0x7f1a840fb470 2024-09-19T09:40:20.000 INFO:teuthology.orchestra.run.smithi112.stdout:e17 2024-09-19T09:40:20.000 INFO:teuthology.orchestra.run.smithi112.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:40:20.001 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:40:20.001 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:40:20.001 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-19T09:40:20.001 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:40:20.001 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:40:20.001 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-19T09:40:20.001 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 17 2024-09-19T09:40:20.001 INFO:teuthology.orchestra.run.smithi112.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:40:20.001 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:40:20.001 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-19T09:32:42.200999+0000 2024-09-19T09:40:20.001 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-19T09:40:20.001 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-19T09:40:20.002 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-19T09:40:20.002 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-19T09:40:20.002 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-19T09:40:20.002 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-19T09:40:20.002 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-19T09:40:20.002 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-19T09:40:20.002 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 45 2024-09-19T09:40:20.002 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:40:20.002 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-19T09:40:20.002 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-19T09:40:20.002 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14460} 2024-09-19T09:40:20.002 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-19T09:40:20.002 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-19T09:40:20.002 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-19T09:40:20.003 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-19T09:40:20.003 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-19T09:40:20.003 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data disabled 2024-09-19T09:40:20.003 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-19T09:40:20.003 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-19T09:40:20.003 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-19T09:40:20.003 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:40:20.003 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.hcoxjz{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:40:20.003 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ymjyok{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/3468750429,v1:172.21.15.112:6827/3468750429] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:40:20.003 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:40:20.003 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:40:20.003 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-19T09:40:20.003 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:40:20.003 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.qweljt{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:40:20.004 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.jjldod{-1:24281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6824/2759077122,v1:172.21.15.191:6825/2759077122] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:40:20.004 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2024-09-19T09:40:20.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.000+0000 7f1a8a081640 1 -- 172.21.15.112:0/584429861 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1a6c06e660 msgr2=0x7f1a6c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.000+0000 7f1a8a081640 1 --2- 172.21.15.112:0/584429861 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1a6c06e660 0x7f1a6c070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1a8410ea40 tx=0x7f1a78004330 comp rx=0 tx=0).stop 2024-09-19T09:40:20.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.000+0000 7f1a8a081640 1 -- 172.21.15.112:0/584429861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a840fb470 msgr2=0x7f1a84113180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.000+0000 7f1a8a081640 1 --2- 172.21.15.112:0/584429861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a840fb470 0x7f1a84113180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a74003080 tx=0x7f1a74009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.000+0000 7f1a8a081640 1 -- 172.21.15.112:0/584429861 shutdown_connections 2024-09-19T09:40:20.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.000+0000 7f1a8a081640 1 --2- 172.21.15.112:0/584429861 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1a6c06e660 0x7f1a6c070b10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.000+0000 7f1a8a081640 1 --2- 172.21.15.112:0/584429861 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1a841014b0 0x7f1a841136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.000+0000 7f1a8a081640 1 --2- 172.21.15.112:0/584429861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a840fb470 0x7f1a84113180 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.000+0000 7f1a8a081640 1 -- 172.21.15.112:0/584429861 >> 172.21.15.112:0/584429861 conn(0x7f1a840f7030 msgr2=0x7f1a840f7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:20.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.000+0000 7f1a8a081640 1 -- 172.21.15.112:0/584429861 shutdown_connections 2024-09-19T09:40:20.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.000+0000 7f1a8a081640 1 -- 172.21.15.112:0/584429861 wait complete. 2024-09-19T09:40:20.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.080+0000 7f1dcbba9640 1 -- 172.21.15.112:0/3514761054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc4102ef0 msgr2=0x7f1dc40fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.080+0000 7f1dcbba9640 1 --2- 172.21.15.112:0/3514761054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc4102ef0 0x7f1dc40fc5b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00048d0 tx=0x7f1dc0009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.080+0000 7f1dcbba9640 1 -- 172.21.15.112:0/3514761054 shutdown_connections 2024-09-19T09:40:20.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.080+0000 7f1dcbba9640 1 --2- 172.21.15.112:0/3514761054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc4102ef0 0x7f1dc40fc5b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.080+0000 7f1dcbba9640 1 --2- 172.21.15.112:0/3514761054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dc4102550 0x7f1dc4102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.080+0000 7f1dcbba9640 1 -- 172.21.15.112:0/3514761054 >> 172.21.15.112:0/3514761054 conn(0x7f1dc40f80f0 msgr2=0x7f1dc40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:20.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.080+0000 7f1dcbba9640 1 -- 172.21.15.112:0/3514761054 shutdown_connections 2024-09-19T09:40:20.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.080+0000 7f1dcbba9640 1 -- 172.21.15.112:0/3514761054 wait complete. 2024-09-19T09:40:20.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.080+0000 7f1dcbba9640 1 Processor -- start 2024-09-19T09:40:20.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.081+0000 7f1dcbba9640 1 -- start start 2024-09-19T09:40:20.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.081+0000 7f1dcbba9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dc4102550 0x7f1dc4113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.081+0000 7f1dcbba9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc4102ef0 0x7f1dc4113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.081+0000 7f1dcbba9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc41140b0 con 0x7f1dc4102ef0 2024-09-19T09:40:20.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.081+0000 7f1dcbba9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc410d4c0 con 0x7f1dc4102550 2024-09-19T09:40:20.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.081+0000 7f1dc9144640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc4102ef0 0x7f1dc4113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.081+0000 7f1dc9144640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc4102ef0 0x7f1dc4113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41708/0 (socket says 172.21.15.112:41708) 2024-09-19T09:40:20.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.081+0000 7f1dc9144640 1 -- 172.21.15.112:0/193641525 learned_addr learned my addr 172.21.15.112:0/193641525 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:40:20.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.081+0000 7f1dc9945640 1 --2- 172.21.15.112:0/193641525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dc4102550 0x7f1dc4113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.081+0000 7f1dc9144640 1 -- 172.21.15.112:0/193641525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dc4102550 msgr2=0x7f1dc4113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.081+0000 7f1dc9144640 1 --2- 172.21.15.112:0/193641525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dc4102550 0x7f1dc4113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.081+0000 7f1dc9144640 1 -- 172.21.15.112:0/193641525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc0005040 con 0x7f1dc4102ef0 2024-09-19T09:40:20.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.081+0000 7f1dc9144640 1 --2- 172.21.15.112:0/193641525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc4102ef0 0x7f1dc4113a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1dc002a530 tx=0x7f1dc0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:20.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.082+0000 7f1dba7fc640 1 -- 172.21.15.112:0/193641525 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dc0038070 con 0x7f1dc4102ef0 2024-09-19T09:40:20.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.082+0000 7f1dba7fc640 1 -- 172.21.15.112:0/193641525 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1dc002ade0 con 0x7f1dc4102ef0 2024-09-19T09:40:20.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.082+0000 7f1dba7fc640 1 -- 172.21.15.112:0/193641525 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dc002c810 con 0x7f1dc4102ef0 2024-09-19T09:40:20.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.082+0000 7f1dcbba9640 1 -- 172.21.15.112:0/193641525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc410d740 con 0x7f1dc4102ef0 2024-09-19T09:40:20.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.082+0000 7f1dcbba9640 1 -- 172.21.15.112:0/193641525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc410dc80 con 0x7f1dc4102ef0 2024-09-19T09:40:20.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.083+0000 7f1dcbba9640 1 -- 172.21.15.112:0/193641525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc40fdcd0 con 0x7f1dc4102ef0 2024-09-19T09:40:20.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.083+0000 7f1dba7fc640 1 -- 172.21.15.112:0/193641525 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f1dc0030020 con 0x7f1dc4102ef0 2024-09-19T09:40:20.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.084+0000 7f1dba7fc640 1 --2- 172.21.15.112:0/193641525 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1db006e660 0x7f1db0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.084+0000 7f1dba7fc640 1 -- 172.21.15.112:0/193641525 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1dc00adf50 con 0x7f1dc4102ef0 2024-09-19T09:40:20.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.084+0000 7f1dc9945640 1 --2- 172.21.15.112:0/193641525 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1db006e660 0x7f1db0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.084+0000 7f1dc9945640 1 --2- 172.21.15.112:0/193641525 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1db006e660 0x7f1db0070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1db4007fd0 tx=0x7f1db4009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:20.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.088+0000 7f1dba7fc640 1 -- 172.21.15.112:0/193641525 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1dc00e3210 con 0x7f1dc4102ef0 2024-09-19T09:40:20.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.269+0000 7f1dcbba9640 1 -- 172.21.15.112:0/193641525 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1dc4109580 con 0x7f1db006e660 2024-09-19T09:40:20.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: pgmap v48: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:20.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:20.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:20.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:20.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:40:20.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:40:20.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:20.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:40:20.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:20.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:20.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:20.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:40:20.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2937901436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:20.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:40:20.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: osd.0 [v2:172.21.15.112:6802/3114563967,v1:172.21.15.112:6803/3114563967] boot 2024-09-19T09:40:20.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: osdmap e52: 6 total, 6 up, 6 in 2024-09-19T09:40:20.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:40:20.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.270+0000 7f1dba7fc640 1 -- 172.21.15.112:0/193641525 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1dc4109580 con 0x7f1db006e660 2024-09-19T09:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-19T09:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "mon", 2024-09-19T09:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-19T09:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "crash" 2024-09-19T09:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-19T09:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "7/21 daemons upgraded", 2024-09-19T09:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T09:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:40:20.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.272+0000 7f1dcbba9640 1 -- 172.21.15.112:0/193641525 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1db006e660 msgr2=0x7f1db0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.272+0000 7f1dcbba9640 1 --2- 172.21.15.112:0/193641525 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1db006e660 0x7f1db0070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1db4007fd0 tx=0x7f1db4009e90 comp rx=0 tx=0).stop 2024-09-19T09:40:20.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.272+0000 7f1dcbba9640 1 -- 172.21.15.112:0/193641525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc4102ef0 msgr2=0x7f1dc4113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.272+0000 7f1dcbba9640 1 --2- 172.21.15.112:0/193641525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc4102ef0 0x7f1dc4113a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1dc002a530 tx=0x7f1dc0009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.272+0000 7f1dcbba9640 1 -- 172.21.15.112:0/193641525 shutdown_connections 2024-09-19T09:40:20.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.272+0000 7f1dcbba9640 1 --2- 172.21.15.112:0/193641525 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1db006e660 0x7f1db0070b10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.273+0000 7f1dcbba9640 1 --2- 172.21.15.112:0/193641525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc4102ef0 0x7f1dc4113a60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.273+0000 7f1dcbba9640 1 --2- 172.21.15.112:0/193641525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dc4102550 0x7f1dc4113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.273+0000 7f1dcbba9640 1 -- 172.21.15.112:0/193641525 >> 172.21.15.112:0/193641525 conn(0x7f1dc40f80f0 msgr2=0x7f1dc40f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:20.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.273+0000 7f1dcbba9640 1 -- 172.21.15.112:0/193641525 shutdown_connections 2024-09-19T09:40:20.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.273+0000 7f1dcbba9640 1 -- 172.21.15.112:0/193641525 wait complete. 2024-09-19T09:40:20.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: pgmap v48: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:20.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:20.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:20.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:20.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:40:20.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:40:20.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:20.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:40:20.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:20.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:20.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:20.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:40:20.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2937901436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:20.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:40:20.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: osd.0 [v2:172.21.15.112:6802/3114563967,v1:172.21.15.112:6803/3114563967] boot 2024-09-19T09:40:20.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: osdmap e52: 6 total, 6 up, 6 in 2024-09-19T09:40:20.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:40:20.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.350+0000 7fcc0eda4640 1 -- 172.21.15.112:0/4159753310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc081014e0 msgr2=0x7fcc081018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.350+0000 7fcc0eda4640 1 --2- 172.21.15.112:0/4159753310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc081014e0 0x7fcc081018b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80048d0 tx=0x7fcbf8009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.350+0000 7fcc0eda4640 1 -- 172.21.15.112:0/4159753310 shutdown_connections 2024-09-19T09:40:20.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.350+0000 7fcc0eda4640 1 --2- 172.21.15.112:0/4159753310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc080fb4a0 0x7fcc080fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.350+0000 7fcc0eda4640 1 --2- 172.21.15.112:0/4159753310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc081014e0 0x7fcc081018b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.350+0000 7fcc0eda4640 1 -- 172.21.15.112:0/4159753310 >> 172.21.15.112:0/4159753310 conn(0x7fcc080f7060 msgr2=0x7fcc080f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:20.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.351+0000 7fcc0eda4640 1 -- 172.21.15.112:0/4159753310 shutdown_connections 2024-09-19T09:40:20.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.351+0000 7fcc0eda4640 1 -- 172.21.15.112:0/4159753310 wait complete. 2024-09-19T09:40:20.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.351+0000 7fcc0eda4640 1 Processor -- start 2024-09-19T09:40:20.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.351+0000 7fcc0eda4640 1 -- start start 2024-09-19T09:40:20.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.351+0000 7fcc0eda4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc080fb4a0 0x7fcc081131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.351+0000 7fcc0eda4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc081014e0 0x7fcc081136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.351+0000 7fcc0eda4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc08113cf0 con 0x7fcc081014e0 2024-09-19T09:40:20.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.351+0000 7fcc0eda4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0810d130 con 0x7fcc080fb4a0 2024-09-19T09:40:20.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.352+0000 7fcc07fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc081014e0 0x7fcc081136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.352+0000 7fcc07fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc081014e0 0x7fcc081136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41734/0 (socket says 172.21.15.112:41734) 2024-09-19T09:40:20.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.352+0000 7fcc07fff640 1 -- 172.21.15.112:0/3838820227 learned_addr learned my addr 172.21.15.112:0/3838820227 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:40:20.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.352+0000 7fcc0cb40640 1 --2- 172.21.15.112:0/3838820227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc080fb4a0 0x7fcc081131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.352+0000 7fcc07fff640 1 -- 172.21.15.112:0/3838820227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc080fb4a0 msgr2=0x7fcc081131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.352+0000 7fcc07fff640 1 --2- 172.21.15.112:0/3838820227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc080fb4a0 0x7fcc081131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.352+0000 7fcc07fff640 1 -- 172.21.15.112:0/3838820227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf8005040 con 0x7fcc081014e0 2024-09-19T09:40:20.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.352+0000 7fcc07fff640 1 --2- 172.21.15.112:0/3838820227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc081014e0 0x7fcc081136f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc002a50 tx=0x7fcbfc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:20.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.352+0000 7fcc057fa640 1 -- 172.21.15.112:0/3838820227 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbfc007c30 con 0x7fcc081014e0 2024-09-19T09:40:20.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.352+0000 7fcc0eda4640 1 -- 172.21.15.112:0/3838820227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0810d410 con 0x7fcc081014e0 2024-09-19T09:40:20.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.352+0000 7fcc057fa640 1 -- 172.21.15.112:0/3838820227 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcbfc00f040 con 0x7fcc081014e0 2024-09-19T09:40:20.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.353+0000 7fcc057fa640 1 -- 172.21.15.112:0/3838820227 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbfc00da10 con 0x7fcc081014e0 2024-09-19T09:40:20.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.353+0000 7fcc0eda4640 1 -- 172.21.15.112:0/3838820227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0810d9b0 con 0x7fcc081014e0 2024-09-19T09:40:20.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.353+0000 7fcc0eda4640 1 -- 172.21.15.112:0/3838820227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc080fcbe0 con 0x7fcc081014e0 2024-09-19T09:40:20.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.354+0000 7fcc057fa640 1 -- 172.21.15.112:0/3838820227 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 39) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fcbfc00dca0 con 0x7fcc081014e0 2024-09-19T09:40:20.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.354+0000 7fcc057fa640 1 --2- 172.21.15.112:0/3838820227 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fcbf006e660 0x7fcbf0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.354+0000 7fcc057fa640 1 -- 172.21.15.112:0/3838820227 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcbfc08db10 con 0x7fcc081014e0 2024-09-19T09:40:20.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.354+0000 7fcc0cb40640 1 --2- 172.21.15.112:0/3838820227 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fcbf006e660 0x7fcbf0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.355+0000 7fcc0cb40640 1 --2- 172.21.15.112:0/3838820227 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fcbf006e660 0x7fcbf0070b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009ac0 tx=0x7fcbf8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:20.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.359+0000 7fcc057fa640 1 -- 172.21.15.112:0/3838820227 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fcbfc056b30 con 0x7fcc081014e0 2024-09-19T09:40:20.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.590+0000 7fcc0eda4640 1 -- 172.21.15.112:0/3838820227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcc080fac60 con 0x7fcc081014e0 2024-09-19T09:40:20.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.590+0000 7fcc057fa640 1 -- 172.21.15.112:0/3838820227 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1127 (secure 0 0 0) 0x7fcbfc05a1f0 con 0x7fcc081014e0 2024-09-19T09:40:20.592 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN Degraded data redundancy: 46/225 objects degraded (20.444%), 17 pgs degraded 2024-09-19T09:40:20.592 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 46/225 objects degraded (20.444%), 17 pgs degraded 2024-09-19T09:40:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-19T09:40:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-19T09:40:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-19T09:40:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-19T09:40:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-19T09:40:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-19T09:40:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-19T09:40:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-19T09:40:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-19T09:40:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-19T09:40:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-19T09:40:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-19T09:40:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-19T09:40:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-19T09:40:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-19T09:40:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-19T09:40:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-19T09:40:20.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.593+0000 7fcc0eda4640 1 -- 172.21.15.112:0/3838820227 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fcbf006e660 msgr2=0x7fcbf0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.593+0000 7fcc0eda4640 1 --2- 172.21.15.112:0/3838820227 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fcbf006e660 0x7fcbf0070b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009ac0 tx=0x7fcbf8035040 comp rx=0 tx=0).stop 2024-09-19T09:40:20.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.593+0000 7fcc0eda4640 1 -- 172.21.15.112:0/3838820227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc081014e0 msgr2=0x7fcc081136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.593+0000 7fcc0eda4640 1 --2- 172.21.15.112:0/3838820227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc081014e0 0x7fcc081136f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc002a50 tx=0x7fcbfc004600 comp rx=0 tx=0).stop 2024-09-19T09:40:20.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.593+0000 7fcc0eda4640 1 -- 172.21.15.112:0/3838820227 shutdown_connections 2024-09-19T09:40:20.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.593+0000 7fcc0eda4640 1 --2- 172.21.15.112:0/3838820227 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fcbf006e660 0x7fcbf0070b10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.593+0000 7fcc0eda4640 1 --2- 172.21.15.112:0/3838820227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc081014e0 0x7fcc081136f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.593+0000 7fcc0eda4640 1 --2- 172.21.15.112:0/3838820227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc080fb4a0 0x7fcc081131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.593+0000 7fcc0eda4640 1 -- 172.21.15.112:0/3838820227 >> 172.21.15.112:0/3838820227 conn(0x7fcc080f7060 msgr2=0x7fcc08065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:20.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.593+0000 7fcc0eda4640 1 -- 172.21.15.112:0/3838820227 shutdown_connections 2024-09-19T09:40:20.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:20.593+0000 7fcc0eda4640 1 -- 172.21.15.112:0/3838820227 wait complete. 2024-09-19T09:40:21.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:20 smithi191 ceph-mon[77624]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:40:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:20 smithi191 ceph-mon[77624]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-19T09:40:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:20 smithi191 ceph-mon[77624]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:20 smithi191 ceph-mon[77624]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:20 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/584429861' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:40:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:20 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3838820227' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:40:21.288 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:20 smithi191 ceph-mon[77624]: osdmap e53: 6 total, 6 up, 6 in 2024-09-19T09:40:21.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:20 smithi112 ceph-mon[97503]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:40:21.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:20 smithi112 ceph-mon[97503]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-19T09:40:21.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:20 smithi112 ceph-mon[97503]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:21.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:20 smithi112 ceph-mon[97503]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:21.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:20 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/584429861' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:40:21.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:20 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3838820227' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:40:21.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:20 smithi112 ceph-mon[97503]: osdmap e53: 6 total, 6 up, 6 in 2024-09-19T09:40:22.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:21 smithi191 ceph-mon[77624]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:22.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:21 smithi191 ceph-mon[77624]: pgmap v51: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:22.316 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:21 smithi112 ceph-mon[97503]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:22.316 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:21 smithi112 ceph-mon[97503]: pgmap v51: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 46/225 objects degraded (20.444%) 2024-09-19T09:40:23.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:23 smithi191 ceph-mon[77624]: Health check update: Degraded data redundancy: 6/225 objects degraded (2.667%), 2 pgs degraded (PG_DEGRADED) 2024-09-19T09:40:23.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:23 smithi112 ceph-mon[97503]: Health check update: Degraded data redundancy: 6/225 objects degraded (2.667%), 2 pgs degraded (PG_DEGRADED) 2024-09-19T09:40:24.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:24 smithi191 ceph-mon[77624]: pgmap v52: 65 pgs: 7 active+undersized, 2 active+undersized+degraded, 56 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 6/225 objects degraded (2.667%) 2024-09-19T09:40:24.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:24 smithi112 ceph-mon[97503]: pgmap v52: 65 pgs: 7 active+undersized, 2 active+undersized+degraded, 56 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 6/225 objects degraded (2.667%) 2024-09-19T09:40:26.087 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:25 smithi191 ceph-mon[77624]: pgmap v53: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 737 B/s rd, 1 op/s 2024-09-19T09:40:26.087 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:26.087 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:40:26.087 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:25 smithi191 ceph-mon[77624]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/225 objects degraded (2.667%), 2 pgs degraded) 2024-09-19T09:40:26.088 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:25 smithi191 ceph-mon[77624]: Cluster is now healthy 2024-09-19T09:40:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:25 smithi112 ceph-mon[97503]: pgmap v53: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 737 B/s rd, 1 op/s 2024-09-19T09:40:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:40:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:25 smithi112 ceph-mon[97503]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/225 objects degraded (2.667%), 2 pgs degraded) 2024-09-19T09:40:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:25 smithi112 ceph-mon[97503]: Cluster is now healthy 2024-09-19T09:40:27.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:27 smithi112 ceph-mon[97503]: pgmap v54: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-19T09:40:27.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:27 smithi112 ceph-mon[97503]: mgrmap e40: smithi112.puhuua(active, since 92s), standbys: smithi191.xjpplx 2024-09-19T09:40:28.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:27 smithi191 ceph-mon[77624]: pgmap v54: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-19T09:40:28.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:27 smithi191 ceph-mon[77624]: mgrmap e40: smithi112.puhuua(active, since 92s), standbys: smithi191.xjpplx 2024-09-19T09:40:30.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:29 smithi112 ceph-mon[97503]: pgmap v55: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 339 B/s wr, 2 op/s 2024-09-19T09:40:30.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:29 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:30.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:29 smithi191 ceph-mon[77624]: pgmap v55: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 339 B/s wr, 2 op/s 2024-09-19T09:40:30.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:29 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:32.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:31 smithi112 ceph-mon[97503]: pgmap v56: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 305 B/s wr, 2 op/s 2024-09-19T09:40:32.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:31 smithi191 ceph-mon[77624]: pgmap v56: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 305 B/s wr, 2 op/s 2024-09-19T09:40:34.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:33 smithi112 ceph-mon[97503]: pgmap v57: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:40:34.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:33 smithi191 ceph-mon[77624]: pgmap v57: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:40:35.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:34 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:40:35.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:34 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:40:36.128 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:35 smithi112 ceph-mon[97503]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:40:36.128 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:35 smithi112 ceph-mon[97503]: Upgrade: osd.1 is safe to restart 2024-09-19T09:40:36.129 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:35 smithi112 ceph-mon[97503]: pgmap v58: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T09:40:36.129 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:35 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:36.129 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:35 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:40:36.129 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:35 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:40:36.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:35 smithi191 ceph-mon[77624]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:40:36.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:35 smithi191 ceph-mon[77624]: Upgrade: osd.1 is safe to restart 2024-09-19T09:40:36.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:35 smithi191 ceph-mon[77624]: pgmap v58: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T09:40:36.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:35 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:36.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:35 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:40:36.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:35 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:40:37.128 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:36 smithi112 ceph-mon[97503]: Upgrade: Updating osd.1 2024-09-19T09:40:37.129 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:36 smithi112 ceph-mon[97503]: Deploying daemon osd.1 on smithi112 2024-09-19T09:40:37.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:36 smithi191 ceph-mon[77624]: Upgrade: Updating osd.1 2024-09-19T09:40:37.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:36 smithi191 ceph-mon[77624]: Deploying daemon osd.1 on smithi112 2024-09-19T09:40:38.132 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:37 smithi112 ceph-mon[97503]: pgmap v59: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:40:38.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:37 smithi191 ceph-mon[77624]: pgmap v59: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:40:38.778 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:38 smithi112 systemd[1]: Stopping Ceph osd.1 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:40:39.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:38 smithi112 ceph-mon[97503]: osd.1 marked itself down and dead 2024-09-19T09:40:39.189 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:38 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1[52992]: 2024-09-19T09:40:38.776+0000 7fe507c03640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:40:39.189 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:38 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1[52992]: 2024-09-19T09:40:38.776+0000 7fe507c03640 -1 osd.1 53 *** Got signal Terminated *** 2024-09-19T09:40:39.189 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:38 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1[52992]: 2024-09-19T09:40:38.776+0000 7fe507c03640 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:40:39.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:38 smithi191 ceph-mon[77624]: osd.1 marked itself down and dead 2024-09-19T09:40:39.663 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:39 smithi112 podman[113814]: 2024-09-19 09:40:39.379280572 +0000 UTC m=+0.726953496 container died 1742e5964367b1e71545e9afae6e4a1856d4aca8e790189efbcd62ce3aeb8a18 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=quincy-6e06d1e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:40:39.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:39 smithi112 ceph-mon[97503]: pgmap v60: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:40:39.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:39 smithi112 ceph-mon[97503]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:40:39.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:39 smithi112 ceph-mon[97503]: osdmap e54: 6 total, 5 up, 6 in 2024-09-19T09:40:39.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:39 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:39.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:39 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:40:39.939 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:39 smithi112 podman[113814]: 2024-09-19 09:40:39.851628063 +0000 UTC m=+1.199300976 container cleanup 1742e5964367b1e71545e9afae6e4a1856d4aca8e790189efbcd62ce3aeb8a18 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, RELEASE=quincy-6e06d1e, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T09:40:39.939 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:39 smithi112 bash[113814]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1 2024-09-19T09:40:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:39 smithi191 ceph-mon[77624]: pgmap v60: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:40:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:39 smithi191 ceph-mon[77624]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:40:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:39 smithi191 ceph-mon[77624]: osdmap e54: 6 total, 5 up, 6 in 2024-09-19T09:40:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:39 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:39 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:40:40.438 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:40 smithi112 podman[113829]: 2024-09-19 09:40:40.111666607 +0000 UTC m=+0.732903283 container remove 1742e5964367b1e71545e9afae6e4a1856d4aca8e790189efbcd62ce3aeb8a18 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=quincy-6e06d1e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T09:40:40.724 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:40 smithi112 podman[113929]: 2024-09-19 09:40:40.342144261 +0000 UTC m=+0.021879527 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:40:40.724 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:40 smithi112 podman[113929]: 2024-09-19 09:40:40.495921454 +0000 UTC m=+0.175656700 container create 7b1e7d89689d986160530e7269c5a393eb367afa9e381ff9e4d8027f34185f22 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:40:40.725 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:40 smithi112 podman[113929]: 2024-09-19 09:40:40.723589774 +0000 UTC m=+0.403325039 container init 7b1e7d89689d986160530e7269c5a393eb367afa9e381ff9e4d8027f34185f22 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T09:40:41.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:40 smithi112 ceph-mon[97503]: osdmap e55: 6 total, 5 up, 6 in 2024-09-19T09:40:41.189 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:40 smithi112 podman[113929]: 2024-09-19 09:40:40.726922011 +0000 UTC m=+0.406657265 container start 7b1e7d89689d986160530e7269c5a393eb367afa9e381ff9e4d8027f34185f22 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T09:40:41.189 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:40 smithi112 podman[113929]: 2024-09-19 09:40:40.84050846 +0000 UTC m=+0.520243711 container attach 7b1e7d89689d986160530e7269c5a393eb367afa9e381ff9e4d8027f34185f22 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T09:40:41.189 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:40 smithi112 podman[113929]: 2024-09-19 09:40:40.918994837 +0000 UTC m=+0.598730092 container died 7b1e7d89689d986160530e7269c5a393eb367afa9e381ff9e4d8027f34185f22 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2) 2024-09-19T09:40:41.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:40 smithi191 ceph-mon[77624]: osdmap e55: 6 total, 5 up, 6 in 2024-09-19T09:40:41.868 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:41 smithi112 podman[113954]: 2024-09-19 09:40:41.560690921 +0000 UTC m=+0.635579246 container remove 7b1e7d89689d986160530e7269c5a393eb367afa9e381ff9e4d8027f34185f22 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:40:41.868 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:41 smithi112 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-19T09:40:41.868 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:41 smithi112 systemd[1]: Stopped Ceph osd.1 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:40:41.868 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:41 smithi112 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 2.447s CPU time. 2024-09-19T09:40:41.868 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:41 smithi112 systemd[1]: Starting Ceph osd.1 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:40:42.135 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:41 smithi112 ceph-mon[97503]: pgmap v63: 65 pgs: 12 stale+active+clean, 53 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-19T09:40:42.135 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:41 smithi112 podman[114051]: 2024-09-19 09:40:41.901131707 +0000 UTC m=+0.015929274 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:40:42.135 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:42 smithi112 podman[114051]: 2024-09-19 09:40:42.011994658 +0000 UTC m=+0.126792225 container create e4e23f78429c172a1a46f10ff18cac65a39caacffb372417e9e605bdf4bc1a39 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-activate, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:40:42.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:41 smithi191 ceph-mon[77624]: pgmap v63: 65 pgs: 12 stale+active+clean, 53 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-19T09:40:42.405 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:42 smithi112 podman[114051]: 2024-09-19 09:40:42.273535491 +0000 UTC m=+0.388333071 container init e4e23f78429c172a1a46f10ff18cac65a39caacffb372417e9e605bdf4bc1a39 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-activate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T09:40:42.405 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:42 smithi112 podman[114051]: 2024-09-19 09:40:42.276947115 +0000 UTC m=+0.391744688 container start e4e23f78429c172a1a46f10ff18cac65a39caacffb372417e9e605bdf4bc1a39 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-activate, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:40:42.405 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:42 smithi112 podman[114051]: 2024-09-19 09:40:42.33993926 +0000 UTC m=+0.454736827 container attach e4e23f78429c172a1a46f10ff18cac65a39caacffb372417e9e605bdf4bc1a39 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T09:40:42.688 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:42 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-activate[114067]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:40:42.689 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:42 smithi112 bash[114051]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:40:42.689 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:42 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-activate[114067]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:40:42.689 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:42 smithi112 bash[114051]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:40:43.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:42 smithi112 ceph-mon[97503]: Health check failed: Degraded data redundancy: 30/225 objects degraded (13.333%), 11 pgs degraded (PG_DEGRADED) 2024-09-19T09:40:43.189 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:43 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-activate[114067]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T09:40:43.189 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:43 smithi112 bash[114051]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T09:40:43.189 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:43 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-activate[114067]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-19T09:40:43.189 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:43 smithi112 bash[114051]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-19T09:40:43.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:42 smithi191 ceph-mon[77624]: Health check failed: Degraded data redundancy: 30/225 objects degraded (13.333%), 11 pgs degraded (PG_DEGRADED) 2024-09-19T09:40:43.689 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:43 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-activate[114067]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-19T09:40:43.689 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:43 smithi112 bash[114051]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-19T09:40:43.689 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:43 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-activate[114067]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-19T09:40:43.689 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:43 smithi112 bash[114051]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-19T09:40:43.689 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:43 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-activate[114067]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-19T09:40:43.689 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:43 smithi112 bash[114051]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-19T09:40:43.689 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:43 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-activate[114067]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T09:40:43.690 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:43 smithi112 bash[114051]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T09:40:43.690 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:43 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-activate[114067]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-19T09:40:43.690 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:43 smithi112 bash[114051]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-19T09:40:43.690 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:43 smithi112 podman[114051]: 2024-09-19 09:40:43.44865333 +0000 UTC m=+1.563450899 container died e4e23f78429c172a1a46f10ff18cac65a39caacffb372417e9e605bdf4bc1a39 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-09-19T09:40:44.136 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:43 smithi112 ceph-mon[97503]: pgmap v64: 65 pgs: 18 active+undersized, 3 stale+active+clean, 11 active+undersized+degraded, 33 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 30/225 objects degraded (13.333%) 2024-09-19T09:40:44.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:43 smithi191 ceph-mon[77624]: pgmap v64: 65 pgs: 18 active+undersized, 3 stale+active+clean, 11 active+undersized+degraded, 33 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 30/225 objects degraded (13.333%) 2024-09-19T09:40:44.387 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:44 smithi112 podman[114216]: 2024-09-19 09:40:44.135193866 +0000 UTC m=+0.676372706 container remove e4e23f78429c172a1a46f10ff18cac65a39caacffb372417e9e605bdf4bc1a39 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-activate, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T09:40:44.387 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:44 smithi112 podman[114274]: 2024-09-19 09:40:44.241239583 +0000 UTC m=+0.016092382 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:40:44.387 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:44 smithi112 podman[114274]: 2024-09-19 09:40:44.386072677 +0000 UTC m=+0.160925468 container create bd616fcb189b9326ea47a8a88e3a566d191d1dbfeb15416bf11c7368555b3be7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:40:44.638 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:44 smithi112 podman[114274]: 2024-09-19 09:40:44.613308886 +0000 UTC m=+0.388161676 container init bd616fcb189b9326ea47a8a88e3a566d191d1dbfeb15416bf11c7368555b3be7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:40:44.639 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:44 smithi112 podman[114274]: 2024-09-19 09:40:44.616542318 +0000 UTC m=+0.391395109 container start bd616fcb189b9326ea47a8a88e3a566d191d1dbfeb15416bf11c7368555b3be7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T09:40:44.938 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:44 smithi112 ceph-osd[114292]: -- 172.21.15.112:0/3878488149 <== mon.0 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ad42a0a1e0 con 0x55ad429a0000 2024-09-19T09:40:44.939 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:44 smithi112 bash[114274]: bd616fcb189b9326ea47a8a88e3a566d191d1dbfeb15416bf11c7368555b3be7 2024-09-19T09:40:44.939 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:44 smithi112 systemd[1]: Started Ceph osd.1 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:40:46.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:45 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:45 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:45 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:40:46.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:45 smithi191 ceph-mon[77624]: pgmap v65: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 32/225 objects degraded (14.222%) 2024-09-19T09:40:46.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:45 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:46.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:45 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:46.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:45 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:40:46.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:45 smithi112 ceph-mon[97503]: pgmap v65: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 32/225 objects degraded (14.222%) 2024-09-19T09:40:46.688 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:46 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1[114288]: 2024-09-19T09:40:46.267+0000 7f54c7fb6640 -1 Falling back to public interface 2024-09-19T09:40:47.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:47 smithi112 ceph-mon[97503]: pgmap v66: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 32/225 objects degraded (14.222%) 2024-09-19T09:40:48.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:47 smithi191 ceph-mon[77624]: pgmap v66: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 32/225 objects degraded (14.222%) 2024-09-19T09:40:49.151 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:48 smithi112 ceph-mon[97503]: Health check update: Degraded data redundancy: 32/225 objects degraded (14.222%), 13 pgs degraded (PG_DEGRADED) 2024-09-19T09:40:49.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:48 smithi191 ceph-mon[77624]: Health check update: Degraded data redundancy: 32/225 objects degraded (14.222%), 13 pgs degraded (PG_DEGRADED) 2024-09-19T09:40:50.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:49 smithi112 ceph-mon[97503]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 927 B/s rd, 1 op/s; 32/225 objects degraded (14.222%) 2024-09-19T09:40:50.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:49 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:50.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:49 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:50.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:49 smithi191 ceph-mon[77624]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 927 B/s rd, 1 op/s; 32/225 objects degraded (14.222%) 2024-09-19T09:40:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:49 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:49 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:50.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.680+0000 7fd20352f640 1 -- 172.21.15.112:0/2114846475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1fc064fe0 msgr2=0x7fd1fc0653b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:50.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.680+0000 7fd20352f640 1 --2- 172.21.15.112:0/2114846475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1fc064fe0 0x7fd1fc0653b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec0048d0 tx=0x7fd1ec009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:50.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.680+0000 7fd20352f640 1 -- 172.21.15.112:0/2114846475 shutdown_connections 2024-09-19T09:40:50.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.680+0000 7fd20352f640 1 --2- 172.21.15.112:0/2114846475 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1fc0658f0 0x7fd1fc108b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:50.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.680+0000 7fd20352f640 1 --2- 172.21.15.112:0/2114846475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1fc064fe0 0x7fd1fc0653b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:50.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.680+0000 7fd20352f640 1 -- 172.21.15.112:0/2114846475 >> 172.21.15.112:0/2114846475 conn(0x7fd1fc0723b0 msgr2=0x7fd1fc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:50.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.680+0000 7fd20352f640 1 -- 172.21.15.112:0/2114846475 shutdown_connections 2024-09-19T09:40:50.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.680+0000 7fd20352f640 1 -- 172.21.15.112:0/2114846475 wait complete. 2024-09-19T09:40:50.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.681+0000 7fd20352f640 1 Processor -- start 2024-09-19T09:40:50.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.681+0000 7fd20352f640 1 -- start start 2024-09-19T09:40:50.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.681+0000 7fd20352f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1fc064fe0 0x7fd1fc1154e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:50.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.681+0000 7fd20352f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1fc0658f0 0x7fd1fc115a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:50.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.681+0000 7fd20352f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc116100 con 0x7fd1fc064fe0 2024-09-19T09:40:50.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.681+0000 7fd20352f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc10f480 con 0x7fd1fc0658f0 2024-09-19T09:40:50.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.682+0000 7fd2012cb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1fc064fe0 0x7fd1fc1154e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:50.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.682+0000 7fd2012cb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1fc064fe0 0x7fd1fc1154e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49932/0 (socket says 172.21.15.112:49932) 2024-09-19T09:40:50.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.682+0000 7fd2012cb640 1 -- 172.21.15.112:0/2085377832 learned_addr learned my addr 172.21.15.112:0/2085377832 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:40:50.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.682+0000 7fd200aca640 1 --2- 172.21.15.112:0/2085377832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1fc0658f0 0x7fd1fc115a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:50.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.682+0000 7fd2012cb640 1 -- 172.21.15.112:0/2085377832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1fc0658f0 msgr2=0x7fd1fc115a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:50.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.682+0000 7fd2012cb640 1 --2- 172.21.15.112:0/2085377832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1fc0658f0 0x7fd1fc115a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:50.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.682+0000 7fd2012cb640 1 -- 172.21.15.112:0/2085377832 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec005040 con 0x7fd1fc064fe0 2024-09-19T09:40:50.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.682+0000 7fd2012cb640 1 --2- 172.21.15.112:0/2085377832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1fc064fe0 0x7fd1fc1154e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec003080 tx=0x7fd1ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:50.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.682+0000 7fd1f1ffb640 1 -- 172.21.15.112:0/2085377832 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1ec038070 con 0x7fd1fc064fe0 2024-09-19T09:40:50.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.683+0000 7fd1f1ffb640 1 -- 172.21.15.112:0/2085377832 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd1ec02ade0 con 0x7fd1fc064fe0 2024-09-19T09:40:50.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.683+0000 7fd20352f640 1 -- 172.21.15.112:0/2085377832 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1fc10f6b0 con 0x7fd1fc064fe0 2024-09-19T09:40:50.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.683+0000 7fd1f1ffb640 1 -- 172.21.15.112:0/2085377832 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1ec02c880 con 0x7fd1fc064fe0 2024-09-19T09:40:50.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.683+0000 7fd20352f640 1 -- 172.21.15.112:0/2085377832 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1fc10fb10 con 0x7fd1fc064fe0 2024-09-19T09:40:50.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.684+0000 7fd20352f640 1 -- 172.21.15.112:0/2085377832 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1fc0fbad0 con 0x7fd1fc064fe0 2024-09-19T09:40:50.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.684+0000 7fd1f1ffb640 1 -- 172.21.15.112:0/2085377832 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd1ec030020 con 0x7fd1fc064fe0 2024-09-19T09:40:50.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.685+0000 7fd1f1ffb640 1 --2- 172.21.15.112:0/2085377832 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fd1e806e530 0x7fd1e80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:50.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.685+0000 7fd1f1ffb640 1 -- 172.21.15.112:0/2085377832 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd1ec0ae030 con 0x7fd1fc064fe0 2024-09-19T09:40:50.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.685+0000 7fd200aca640 1 --2- 172.21.15.112:0/2085377832 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fd1e806e530 0x7fd1e80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:50.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.685+0000 7fd200aca640 1 --2- 172.21.15.112:0/2085377832 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fd1e806e530 0x7fd1e80709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc110760 tx=0x7fd1f8009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:50.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.689+0000 7fd1f1ffb640 1 -- 172.21.15.112:0/2085377832 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd1ec077240 con 0x7fd1fc064fe0 2024-09-19T09:40:50.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.881+0000 7fd20352f640 1 -- 172.21.15.112:0/2085377832 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1fc110b50 con 0x7fd1e806e530 2024-09-19T09:40:50.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.882+0000 7fd1f1ffb640 1 -- 172.21.15.112:0/2085377832 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd1fc110b50 con 0x7fd1e806e530 2024-09-19T09:40:50.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.885+0000 7fd20352f640 1 -- 172.21.15.112:0/2085377832 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fd1e806e530 msgr2=0x7fd1e80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:50.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.885+0000 7fd20352f640 1 --2- 172.21.15.112:0/2085377832 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fd1e806e530 0x7fd1e80709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc110760 tx=0x7fd1f8009120 comp rx=0 tx=0).stop 2024-09-19T09:40:50.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.885+0000 7fd20352f640 1 -- 172.21.15.112:0/2085377832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1fc064fe0 msgr2=0x7fd1fc1154e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:50.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.885+0000 7fd20352f640 1 --2- 172.21.15.112:0/2085377832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1fc064fe0 0x7fd1fc1154e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec003080 tx=0x7fd1ec009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:50.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.885+0000 7fd20352f640 1 -- 172.21.15.112:0/2085377832 shutdown_connections 2024-09-19T09:40:50.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.885+0000 7fd20352f640 1 --2- 172.21.15.112:0/2085377832 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fd1e806e530 0x7fd1e80709e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:50.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.885+0000 7fd20352f640 1 --2- 172.21.15.112:0/2085377832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1fc0658f0 0x7fd1fc115a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:50.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.885+0000 7fd20352f640 1 --2- 172.21.15.112:0/2085377832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1fc064fe0 0x7fd1fc1154e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:50.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.885+0000 7fd20352f640 1 -- 172.21.15.112:0/2085377832 >> 172.21.15.112:0/2085377832 conn(0x7fd1fc0723b0 msgr2=0x7fd1fc103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:50.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.885+0000 7fd20352f640 1 -- 172.21.15.112:0/2085377832 shutdown_connections 2024-09-19T09:40:50.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.885+0000 7fd20352f640 1 -- 172.21.15.112:0/2085377832 wait complete. 2024-09-19T09:40:50.895 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:40:50.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.971+0000 7f9fb8b7e640 1 -- 172.21.15.112:0/1152302830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fb4064fc0 msgr2=0x7f9fb4065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:50.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.971+0000 7f9fb8b7e640 1 --2- 172.21.15.112:0/1152302830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fb4064fc0 0x7f9fb4065430 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0048d0 tx=0x7f9f9c009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:50.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.971+0000 7f9fb8b7e640 1 -- 172.21.15.112:0/1152302830 shutdown_connections 2024-09-19T09:40:50.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.971+0000 7f9fb8b7e640 1 --2- 172.21.15.112:0/1152302830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fb4064fc0 0x7f9fb4065430 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:50.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.971+0000 7f9fb8b7e640 1 --2- 172.21.15.112:0/1152302830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fb40fe460 0x7f9fb40fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:50.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.971+0000 7f9fb8b7e640 1 -- 172.21.15.112:0/1152302830 >> 172.21.15.112:0/1152302830 conn(0x7f9fb40723b0 msgr2=0x7f9fb40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:50.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.972+0000 7f9fb8b7e640 1 -- 172.21.15.112:0/1152302830 shutdown_connections 2024-09-19T09:40:50.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.972+0000 7f9fb8b7e640 1 -- 172.21.15.112:0/1152302830 wait complete. 2024-09-19T09:40:50.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.972+0000 7f9fb8b7e640 1 Processor -- start 2024-09-19T09:40:50.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.972+0000 7f9fb8b7e640 1 -- start start 2024-09-19T09:40:50.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.972+0000 7f9fb8b7e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fb4064fc0 0x7f9fb40fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:50.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.972+0000 7f9fb8b7e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fb40fe460 0x7f9fb40fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:50.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.972+0000 7f9fb8b7e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb40fbfe0 con 0x7f9fb4064fc0 2024-09-19T09:40:50.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.972+0000 7f9fb8b7e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb40fc150 con 0x7f9fb40fe460 2024-09-19T09:40:50.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.972+0000 7f9fb259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fb4064fc0 0x7f9fb40fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:50.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.972+0000 7f9fb259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fb4064fc0 0x7f9fb40fb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49946/0 (socket says 172.21.15.112:49946) 2024-09-19T09:40:50.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.972+0000 7f9fb259c640 1 -- 172.21.15.112:0/1325401048 learned_addr learned my addr 172.21.15.112:0/1325401048 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:40:50.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.973+0000 7f9fabfff640 1 --2- 172.21.15.112:0/1325401048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fb40fe460 0x7f9fb40fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:50.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.973+0000 7f9fb259c640 1 -- 172.21.15.112:0/1325401048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fb40fe460 msgr2=0x7f9fb40fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:50.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.973+0000 7f9fb259c640 1 --2- 172.21.15.112:0/1325401048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fb40fe460 0x7f9fb40fbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:50.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.973+0000 7f9fb259c640 1 -- 172.21.15.112:0/1325401048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c005040 con 0x7f9fb4064fc0 2024-09-19T09:40:50.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.973+0000 7f9fb259c640 1 --2- 172.21.15.112:0/1325401048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fb4064fc0 0x7f9fb40fb560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4002a50 tx=0x7f9fa4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:50.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.973+0000 7f9faaffd640 1 -- 172.21.15.112:0/1325401048 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fa4007c30 con 0x7f9fb4064fc0 2024-09-19T09:40:50.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.973+0000 7f9fb8b7e640 1 -- 172.21.15.112:0/1325401048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb4119540 con 0x7f9fb4064fc0 2024-09-19T09:40:50.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.973+0000 7f9faaffd640 1 -- 172.21.15.112:0/1325401048 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9fa400f040 con 0x7f9fb4064fc0 2024-09-19T09:40:50.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.973+0000 7f9faaffd640 1 -- 172.21.15.112:0/1325401048 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fa400da10 con 0x7f9fb4064fc0 2024-09-19T09:40:50.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.973+0000 7f9fb8b7e640 1 -- 172.21.15.112:0/1325401048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb4119940 con 0x7f9fb4064fc0 2024-09-19T09:40:50.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.975+0000 7f9fb8b7e640 1 -- 172.21.15.112:0/1325401048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb40fdcf0 con 0x7f9fb4064fc0 2024-09-19T09:40:50.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.975+0000 7f9faaffd640 1 -- 172.21.15.112:0/1325401048 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9fa400dc80 con 0x7f9fb4064fc0 2024-09-19T09:40:50.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.975+0000 7f9faaffd640 1 --2- 172.21.15.112:0/1325401048 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9fa006e530 0x7f9fa00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:50.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.976+0000 7f9faaffd640 1 -- 172.21.15.112:0/1325401048 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9fa408d8c0 con 0x7f9fb4064fc0 2024-09-19T09:40:50.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.976+0000 7f9fabfff640 1 --2- 172.21.15.112:0/1325401048 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9fa006e530 0x7f9fa00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:50.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.976+0000 7f9fabfff640 1 --2- 172.21.15.112:0/1325401048 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9fa006e530 0x7f9fa00709e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009ac0 tx=0x7f9f9c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:50.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:50.984+0000 7f9faaffd640 1 -- 172.21.15.112:0/1325401048 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9fa4056b00 con 0x7f9fb4064fc0 2024-09-19T09:40:51.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.180+0000 7f9fb8b7e640 1 -- 172.21.15.112:0/1325401048 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fb40fcc00 con 0x7f9fa006e530 2024-09-19T09:40:51.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.181+0000 7f9faaffd640 1 -- 172.21.15.112:0/1325401048 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9fb40fcc00 con 0x7f9fa006e530 2024-09-19T09:40:51.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.183+0000 7f9fb8b7e640 1 -- 172.21.15.112:0/1325401048 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9fa006e530 msgr2=0x7f9fa00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.183+0000 7f9fb8b7e640 1 --2- 172.21.15.112:0/1325401048 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9fa006e530 0x7f9fa00709e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009ac0 tx=0x7f9f9c035040 comp rx=0 tx=0).stop 2024-09-19T09:40:51.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.183+0000 7f9fb8b7e640 1 -- 172.21.15.112:0/1325401048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fb4064fc0 msgr2=0x7f9fb40fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.183+0000 7f9fb8b7e640 1 --2- 172.21.15.112:0/1325401048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fb4064fc0 0x7f9fb40fb560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4002a50 tx=0x7f9fa4004600 comp rx=0 tx=0).stop 2024-09-19T09:40:51.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.183+0000 7f9fb8b7e640 1 -- 172.21.15.112:0/1325401048 shutdown_connections 2024-09-19T09:40:51.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.183+0000 7f9fb8b7e640 1 --2- 172.21.15.112:0/1325401048 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9fa006e530 0x7f9fa00709e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.183+0000 7f9fb8b7e640 1 --2- 172.21.15.112:0/1325401048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fb40fe460 0x7f9fb40fbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.183+0000 7f9fb8b7e640 1 --2- 172.21.15.112:0/1325401048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fb4064fc0 0x7f9fb40fb560 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.183+0000 7f9fb8b7e640 1 -- 172.21.15.112:0/1325401048 >> 172.21.15.112:0/1325401048 conn(0x7f9fb40723b0 msgr2=0x7f9fb41053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:51.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.184+0000 7f9fb8b7e640 1 -- 172.21.15.112:0/1325401048 shutdown_connections 2024-09-19T09:40:51.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.184+0000 7f9fb8b7e640 1 -- 172.21.15.112:0/1325401048 wait complete. 2024-09-19T09:40:51.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.262+0000 7f628a3d6640 1 -- 172.21.15.112:0/492177887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62841047b0 msgr2=0x7f6284104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.262+0000 7f628a3d6640 1 --2- 172.21.15.112:0/492177887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62841047b0 0x7f6284104b80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f62740048d0 tx=0x7f6274009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.262+0000 7f628a3d6640 1 -- 172.21.15.112:0/492177887 shutdown_connections 2024-09-19T09:40:51.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.262+0000 7f628a3d6640 1 --2- 172.21.15.112:0/492177887 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62840fe790 0x7f62840fec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.262+0000 7f628a3d6640 1 --2- 172.21.15.112:0/492177887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62841047b0 0x7f6284104b80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.262+0000 7f628a3d6640 1 -- 172.21.15.112:0/492177887 >> 172.21.15.112:0/492177887 conn(0x7f62840fa2d0 msgr2=0x7f62840fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:51.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.262+0000 7f628a3d6640 1 -- 172.21.15.112:0/492177887 shutdown_connections 2024-09-19T09:40:51.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.262+0000 7f628a3d6640 1 -- 172.21.15.112:0/492177887 wait complete. 2024-09-19T09:40:51.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.263+0000 7f628a3d6640 1 Processor -- start 2024-09-19T09:40:51.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.263+0000 7f628a3d6640 1 -- start start 2024-09-19T09:40:51.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.263+0000 7f628a3d6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62840fe790 0x7f62841153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.263+0000 7f628a3d6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62841047b0 0x7f62841158f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.263+0000 7f628a3d6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6284115ef0 con 0x7f62841047b0 2024-09-19T09:40:51.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.263+0000 7f628a3d6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628410f330 con 0x7f62840fe790 2024-09-19T09:40:51.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.264+0000 7f62837fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62841047b0 0x7f62841158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.264+0000 7f62837fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62841047b0 0x7f62841158f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49964/0 (socket says 172.21.15.112:49964) 2024-09-19T09:40:51.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.264+0000 7f62837fe640 1 -- 172.21.15.112:0/1325190018 learned_addr learned my addr 172.21.15.112:0/1325190018 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:40:51.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.264+0000 7f6283fff640 1 --2- 172.21.15.112:0/1325190018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62840fe790 0x7f62841153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.264+0000 7f62837fe640 1 -- 172.21.15.112:0/1325190018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62840fe790 msgr2=0x7f62841153b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.264+0000 7f62837fe640 1 --2- 172.21.15.112:0/1325190018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62840fe790 0x7f62841153b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.264+0000 7f62837fe640 1 -- 172.21.15.112:0/1325190018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6274005040 con 0x7f62841047b0 2024-09-19T09:40:51.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.264+0000 7f62837fe640 1 --2- 172.21.15.112:0/1325190018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62841047b0 0x7f62841158f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f627800c790 tx=0x7f62780043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:51.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.264+0000 7f6280ff9640 1 -- 172.21.15.112:0/1325190018 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f627800a7a0 con 0x7f62841047b0 2024-09-19T09:40:51.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.264+0000 7f6280ff9640 1 -- 172.21.15.112:0/1325190018 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f627800ada0 con 0x7f62841047b0 2024-09-19T09:40:51.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.264+0000 7f628a3d6640 1 -- 172.21.15.112:0/1325190018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628410f610 con 0x7f62841047b0 2024-09-19T09:40:51.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.264+0000 7f6280ff9640 1 -- 172.21.15.112:0/1325190018 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62780113a0 con 0x7f62841047b0 2024-09-19T09:40:51.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.264+0000 7f628a3d6640 1 -- 172.21.15.112:0/1325190018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628410fbb0 con 0x7f62841047b0 2024-09-19T09:40:51.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.265+0000 7f628a3d6640 1 -- 172.21.15.112:0/1325190018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62840ffed0 con 0x7f62841047b0 2024-09-19T09:40:51.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.266+0000 7f6280ff9640 1 -- 172.21.15.112:0/1325190018 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f627800a900 con 0x7f62841047b0 2024-09-19T09:40:51.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.266+0000 7f6280ff9640 1 --2- 172.21.15.112:0/1325190018 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f626c06e530 0x7f626c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.266+0000 7f6280ff9640 1 -- 172.21.15.112:0/1325190018 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f627808e180 con 0x7f62841047b0 2024-09-19T09:40:51.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.266+0000 7f6283fff640 1 --2- 172.21.15.112:0/1325190018 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f626c06e530 0x7f626c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.267+0000 7f6283fff640 1 --2- 172.21.15.112:0/1325190018 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f626c06e530 0x7f626c0709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6274007ac0 tx=0x7f6274035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:51.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.271+0000 7f6280ff9640 1 -- 172.21.15.112:0/1325190018 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6278057430 con 0x7f62841047b0 2024-09-19T09:40:51.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.462+0000 7f628a3d6640 1 -- 172.21.15.112:0/1325190018 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f628410b760 con 0x7f626c06e530 2024-09-19T09:40:51.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.479+0000 7f6280ff9640 1 -- 172.21.15.112:0/1325190018 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f628410b760 con 0x7f626c06e530 2024-09-19T09:40:51.481 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:40:51.481 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (5m) 1s ago 13m 26.9M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:40:51.481 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (67s) 1s ago 13m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 70bad8ff6ec4 2024-09-19T09:40:51.481 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (62s) 59s ago 12m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 6f8cb10f4c96 2024-09-19T09:40:51.481 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (3m) 1s ago 13m 80.4M - 9.4.12 2bacad6d85d8 e462aca2b022 2024-09-19T09:40:51.481 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (8m) 1s ago 8m 153M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:40:51.481 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (8m) 1s ago 8m 106M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:40:51.481 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (8m) 59s ago 8m 13.6M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:40:51.481 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (8m) 59s ago 8m 16.1M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:40:51.481 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (4m) 1s ago 14m 499M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:40:51.481 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283,8765 running (3m) 59s ago 12m 439M - 19.1.1-361-g2f599a46 d2baa855c067 fddba1bee64a 2024-09-19T09:40:51.481 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (2m) 1s ago 15m 44.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 89dfb5de44c8 2024-09-19T09:40:51.482 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (101s) 59s ago 12m 34.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 3cab8f7cc27e 2024-09-19T09:40:51.482 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (5m) 1s ago 13m 15.9M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:40:51.482 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (4m) 59s ago 12m 16.3M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:40:51.482 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (42s) 1s ago 12m 98.9M 1557M 19.1.1-361-g2f599a46 d2baa855c067 11a51e663887 2024-09-19T09:40:51.482 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (7s) 1s ago 11m 14.3M 1557M 19.1.1-361-g2f599a46 d2baa855c067 bd616fcb189b 2024-09-19T09:40:51.482 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (11m) 1s ago 11m 210M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 4dcca18af229 2024-09-19T09:40:51.482 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (10m) 59s ago 10m 271M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:40:51.482 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (10m) 59s ago 10m 239M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:40:51.482 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (9m) 59s ago 9m 226M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:40:51.482 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (3m) 1s ago 13m 63.6M - 2.43.0 a07b618ecd1d 54850883a171 2024-09-19T09:40:51.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.481+0000 7f628a3d6640 1 -- 172.21.15.112:0/1325190018 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f626c06e530 msgr2=0x7f626c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.481+0000 7f628a3d6640 1 --2- 172.21.15.112:0/1325190018 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f626c06e530 0x7f626c0709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6274007ac0 tx=0x7f6274035040 comp rx=0 tx=0).stop 2024-09-19T09:40:51.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.481+0000 7f628a3d6640 1 -- 172.21.15.112:0/1325190018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62841047b0 msgr2=0x7f62841158f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.481+0000 7f628a3d6640 1 --2- 172.21.15.112:0/1325190018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62841047b0 0x7f62841158f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f627800c790 tx=0x7f62780043c0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.481+0000 7f628a3d6640 1 -- 172.21.15.112:0/1325190018 shutdown_connections 2024-09-19T09:40:51.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.481+0000 7f628a3d6640 1 --2- 172.21.15.112:0/1325190018 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f626c06e530 0x7f626c0709e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.481+0000 7f628a3d6640 1 --2- 172.21.15.112:0/1325190018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62841047b0 0x7f62841158f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.481+0000 7f628a3d6640 1 --2- 172.21.15.112:0/1325190018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62840fe790 0x7f62841153b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.481+0000 7f628a3d6640 1 -- 172.21.15.112:0/1325190018 >> 172.21.15.112:0/1325190018 conn(0x7f62840fa2d0 msgr2=0x7f62840fb360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:51.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.481+0000 7f628a3d6640 1 -- 172.21.15.112:0/1325190018 shutdown_connections 2024-09-19T09:40:51.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.481+0000 7f628a3d6640 1 -- 172.21.15.112:0/1325190018 wait complete. 2024-09-19T09:40:51.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.561+0000 7f373220e640 1 -- 172.21.15.112:0/1360663169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c0fcf80 msgr2=0x7f372c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.561+0000 7f373220e640 1 --2- 172.21.15.112:0/1360663169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c0fcf80 0x7f372c0fd3d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f37200048d0 tx=0x7f3720009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.561+0000 7f373220e640 1 -- 172.21.15.112:0/1360663169 shutdown_connections 2024-09-19T09:40:51.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.561+0000 7f373220e640 1 --2- 172.21.15.112:0/1360663169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c0fcf80 0x7f372c0fd3d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.561+0000 7f373220e640 1 --2- 172.21.15.112:0/1360663169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f372c0fb810 0x7f372c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.561+0000 7f373220e640 1 -- 172.21.15.112:0/1360663169 >> 172.21.15.112:0/1360663169 conn(0x7f372c0723b0 msgr2=0x7f372c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:51.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.561+0000 7f373220e640 1 -- 172.21.15.112:0/1360663169 shutdown_connections 2024-09-19T09:40:51.563 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:51 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:51.563 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:51 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:51.564 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:51 smithi112 ceph-mon[97503]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 843 B/s rd, 1 op/s; 32/225 objects degraded (14.222%) 2024-09-19T09:40:51.564 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:51 smithi112 ceph-mon[97503]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:51.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.561+0000 7f373220e640 1 -- 172.21.15.112:0/1360663169 wait complete. 2024-09-19T09:40:51.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.561+0000 7f373220e640 1 Processor -- start 2024-09-19T09:40:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.562+0000 7f373220e640 1 -- start start 2024-09-19T09:40:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.562+0000 7f373220e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c0fb810 0x7f372c113150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.562+0000 7f373220e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f372c0fcf80 0x7f372c113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.562+0000 7f373220e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c113c90 con 0x7f372c0fb810 2024-09-19T09:40:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.562+0000 7f373220e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c10d0d0 con 0x7f372c0fcf80 2024-09-19T09:40:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.562+0000 7f372b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c0fb810 0x7f372c113150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.562+0000 7f372b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c0fb810 0x7f372c113150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49992/0 (socket says 172.21.15.112:49992) 2024-09-19T09:40:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.562+0000 7f372b7fe640 1 -- 172.21.15.112:0/833848064 learned_addr learned my addr 172.21.15.112:0/833848064 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:40:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.562+0000 7f372affd640 1 --2- 172.21.15.112:0/833848064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f372c0fcf80 0x7f372c113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.562+0000 7f372b7fe640 1 -- 172.21.15.112:0/833848064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f372c0fcf80 msgr2=0x7f372c113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.562+0000 7f372b7fe640 1 --2- 172.21.15.112:0/833848064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f372c0fcf80 0x7f372c113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.562+0000 7f372b7fe640 1 -- 172.21.15.112:0/833848064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3720005040 con 0x7f372c0fb810 2024-09-19T09:40:51.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.562+0000 7f372b7fe640 1 --2- 172.21.15.112:0/833848064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c0fb810 0x7f372c113150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f371c002a50 tx=0x7f371c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:51.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.562+0000 7f3713fff640 1 -- 172.21.15.112:0/833848064 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371c007c30 con 0x7f372c0fb810 2024-09-19T09:40:51.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.563+0000 7f3713fff640 1 -- 172.21.15.112:0/833848064 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f371c00f040 con 0x7f372c0fb810 2024-09-19T09:40:51.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.563+0000 7f3713fff640 1 -- 172.21.15.112:0/833848064 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371c00da10 con 0x7f372c0fb810 2024-09-19T09:40:51.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.563+0000 7f373220e640 1 -- 172.21.15.112:0/833848064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372c10d3b0 con 0x7f372c0fb810 2024-09-19T09:40:51.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.563+0000 7f373220e640 1 -- 172.21.15.112:0/833848064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c10d8d0 con 0x7f372c0fb810 2024-09-19T09:40:51.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.564+0000 7f373220e640 1 -- 172.21.15.112:0/833848064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372c0fcbc0 con 0x7f372c0fb810 2024-09-19T09:40:51.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.564+0000 7f3713fff640 1 -- 172.21.15.112:0/833848064 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f371c00dc80 con 0x7f372c0fb810 2024-09-19T09:40:51.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.565+0000 7f3713fff640 1 --2- 172.21.15.112:0/833848064 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f371406e530 0x7f37140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.565+0000 7f3713fff640 1 -- 172.21.15.112:0/833848064 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f371c08d8c0 con 0x7f372c0fb810 2024-09-19T09:40:51.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.565+0000 7f372affd640 1 --2- 172.21.15.112:0/833848064 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f371406e530 0x7f37140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.565+0000 7f372affd640 1 --2- 172.21.15.112:0/833848064 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f371406e530 0x7f37140709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3720009ac0 tx=0x7f3720035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:51.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.571+0000 7f3713fff640 1 -- 172.21.15.112:0/833848064 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f371c056b00 con 0x7f372c0fb810 2024-09-19T09:40:51.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:51 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:51.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:51 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:51.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:51 smithi191 ceph-mon[77624]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 843 B/s rd, 1 op/s; 32/225 objects degraded (14.222%) 2024-09-19T09:40:51.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:51 smithi191 ceph-mon[77624]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:51.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.814+0000 7f373220e640 1 -- 172.21.15.112:0/833848064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f372c04b780 con 0x7f372c0fb810 2024-09-19T09:40:51.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.815+0000 7f3713fff640 1 -- 172.21.15.112:0/833848064 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f371c05a1c0 con 0x7f372c0fb810 2024-09-19T09:40:51.816 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:40:51.817 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:40:51.817 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:40:51.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:40:51.817 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:40:51.817 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:40:51.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:40:51.817 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:40:51.817 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4, 2024-09-19T09:40:51.817 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T09:40:51.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:40:51.817 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:40:51.817 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:40:51.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:40:51.818 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:40:51.818 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 8, 2024-09-19T09:40:51.818 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 5 2024-09-19T09:40:51.818 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:40:51.818 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:40:51.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.817+0000 7f373220e640 1 -- 172.21.15.112:0/833848064 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f371406e530 msgr2=0x7f37140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.817+0000 7f373220e640 1 --2- 172.21.15.112:0/833848064 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f371406e530 0x7f37140709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3720009ac0 tx=0x7f3720035040 comp rx=0 tx=0).stop 2024-09-19T09:40:51.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.817+0000 7f373220e640 1 -- 172.21.15.112:0/833848064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c0fb810 msgr2=0x7f372c113150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.817+0000 7f373220e640 1 --2- 172.21.15.112:0/833848064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c0fb810 0x7f372c113150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f371c002a50 tx=0x7f371c004600 comp rx=0 tx=0).stop 2024-09-19T09:40:51.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.817+0000 7f373220e640 1 -- 172.21.15.112:0/833848064 shutdown_connections 2024-09-19T09:40:51.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.817+0000 7f373220e640 1 --2- 172.21.15.112:0/833848064 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f371406e530 0x7f37140709e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.817+0000 7f373220e640 1 --2- 172.21.15.112:0/833848064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f372c0fcf80 0x7f372c113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.817+0000 7f373220e640 1 --2- 172.21.15.112:0/833848064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f372c0fb810 0x7f372c113150 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.817+0000 7f373220e640 1 -- 172.21.15.112:0/833848064 >> 172.21.15.112:0/833848064 conn(0x7f372c0723b0 msgr2=0x7f372c101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:51.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.817+0000 7f373220e640 1 -- 172.21.15.112:0/833848064 shutdown_connections 2024-09-19T09:40:51.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.817+0000 7f373220e640 1 -- 172.21.15.112:0/833848064 wait complete. 2024-09-19T09:40:51.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.899+0000 7f142897c640 1 -- 172.21.15.112:0/1112124502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14240fcf80 msgr2=0x7f14240fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.899+0000 7f142897c640 1 --2- 172.21.15.112:0/1112124502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14240fcf80 0x7f14240fd3d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f14180048d0 tx=0x7f1418009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.899+0000 7f142897c640 1 -- 172.21.15.112:0/1112124502 shutdown_connections 2024-09-19T09:40:51.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.899+0000 7f142897c640 1 --2- 172.21.15.112:0/1112124502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14240fcf80 0x7f14240fd3d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.899+0000 7f142897c640 1 --2- 172.21.15.112:0/1112124502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14240fb810 0x7f14240fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.899+0000 7f142897c640 1 -- 172.21.15.112:0/1112124502 >> 172.21.15.112:0/1112124502 conn(0x7f14240723b0 msgr2=0x7f14240727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:51.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.899+0000 7f142897c640 1 -- 172.21.15.112:0/1112124502 shutdown_connections 2024-09-19T09:40:51.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.899+0000 7f142897c640 1 -- 172.21.15.112:0/1112124502 wait complete. 2024-09-19T09:40:51.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.900+0000 7f142897c640 1 Processor -- start 2024-09-19T09:40:51.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.900+0000 7f142897c640 1 -- start start 2024-09-19T09:40:51.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.900+0000 7f142897c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14240fb810 0x7f142410e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.900+0000 7f142897c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14240fcf80 0x7f142410e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.900+0000 7f142897c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142410ed20 con 0x7f14240fcf80 2024-09-19T09:40:51.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.900+0000 7f142897c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142410ee90 con 0x7f14240fb810 2024-09-19T09:40:51.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.900+0000 7f1421d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14240fcf80 0x7f142410e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.900+0000 7f1421d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14240fcf80 0x7f142410e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50012/0 (socket says 172.21.15.112:50012) 2024-09-19T09:40:51.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.900+0000 7f1421d9b640 1 -- 172.21.15.112:0/2932310803 learned_addr learned my addr 172.21.15.112:0/2932310803 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:40:51.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.900+0000 7f142259c640 1 --2- 172.21.15.112:0/2932310803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14240fb810 0x7f142410e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.901+0000 7f1421d9b640 1 -- 172.21.15.112:0/2932310803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14240fb810 msgr2=0x7f142410e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.901+0000 7f1421d9b640 1 --2- 172.21.15.112:0/2932310803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14240fb810 0x7f142410e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.901+0000 7f1421d9b640 1 -- 172.21.15.112:0/2932310803 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1418005040 con 0x7f14240fcf80 2024-09-19T09:40:51.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.901+0000 7f1421d9b640 1 --2- 172.21.15.112:0/2932310803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14240fcf80 0x7f142410e6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1418003080 tx=0x7f1418009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:51.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.901+0000 7f1412ffd640 1 -- 172.21.15.112:0/2932310803 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1418038070 con 0x7f14240fcf80 2024-09-19T09:40:51.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.901+0000 7f142897c640 1 -- 172.21.15.112:0/2932310803 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1424117200 con 0x7f14240fcf80 2024-09-19T09:40:51.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.901+0000 7f1412ffd640 1 -- 172.21.15.112:0/2932310803 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f141802ade0 con 0x7f14240fcf80 2024-09-19T09:40:51.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.901+0000 7f1412ffd640 1 -- 172.21.15.112:0/2932310803 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141802c880 con 0x7f14240fcf80 2024-09-19T09:40:51.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.901+0000 7f142897c640 1 -- 172.21.15.112:0/2932310803 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142410c1a0 con 0x7f14240fcf80 2024-09-19T09:40:51.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.902+0000 7f1410ff9640 1 -- 172.21.15.112:0/2932310803 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1408005210 con 0x7f14240fcf80 2024-09-19T09:40:51.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.903+0000 7f1412ffd640 1 -- 172.21.15.112:0/2932310803 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1418030020 con 0x7f14240fcf80 2024-09-19T09:40:51.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.904+0000 7f1412ffd640 1 --2- 172.21.15.112:0/2932310803 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f140c072940 0x7f140c074df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.904+0000 7f1412ffd640 1 -- 172.21.15.112:0/2932310803 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f14180ae0c0 con 0x7f14240fcf80 2024-09-19T09:40:51.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.904+0000 7f142259c640 1 --2- 172.21.15.112:0/2932310803 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f140c072940 0x7f140c074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.904+0000 7f142259c640 1 --2- 172.21.15.112:0/2932310803 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f140c072940 0x7f140c074df0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f14140041d0 tx=0x7f1414004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:51.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:51.908+0000 7f1412ffd640 1 -- 172.21.15.112:0/2932310803 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1418077250 con 0x7f14240fcf80 2024-09-19T09:40:52.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.172+0000 7f1410ff9640 1 -- 172.21.15.112:0/2932310803 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1408005cd0 con 0x7f14240fcf80 2024-09-19T09:40:52.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.173+0000 7f1412ffd640 1 -- 172.21.15.112:0/2932310803 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1949 (secure 0 0 0) 0x7f141807a910 con 0x7f14240fcf80 2024-09-19T09:40:52.175 INFO:teuthology.orchestra.run.smithi112.stdout:e17 2024-09-19T09:40:52.175 INFO:teuthology.orchestra.run.smithi112.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:40:52.175 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:40:52.175 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:40:52.175 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-19T09:40:52.176 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:40:52.176 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:40:52.176 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-19T09:40:52.176 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 17 2024-09-19T09:40:52.176 INFO:teuthology.orchestra.run.smithi112.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:40:52.176 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:40:52.176 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-19T09:32:42.200999+0000 2024-09-19T09:40:52.176 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-19T09:40:52.176 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-19T09:40:52.176 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-19T09:40:52.176 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-19T09:40:52.176 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-19T09:40:52.176 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-19T09:40:52.177 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-19T09:40:52.177 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-19T09:40:52.177 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 45 2024-09-19T09:40:52.177 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:40:52.177 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-19T09:40:52.177 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-19T09:40:52.177 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14460} 2024-09-19T09:40:52.177 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-19T09:40:52.177 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-19T09:40:52.177 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-19T09:40:52.177 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-19T09:40:52.177 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-19T09:40:52.177 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data disabled 2024-09-19T09:40:52.177 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-19T09:40:52.178 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-19T09:40:52.178 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-19T09:40:52.178 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:40:52.178 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.hcoxjz{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:40:52.178 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ymjyok{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/3468750429,v1:172.21.15.112:6827/3468750429] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:40:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:40:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:40:52.178 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-19T09:40:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:40:52.178 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.qweljt{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:40:52.178 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.jjldod{-1:24281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6824/2759077122,v1:172.21.15.191:6825/2759077122] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:40:52.179 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2024-09-19T09:40:52.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.175+0000 7f1410ff9640 1 -- 172.21.15.112:0/2932310803 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f140c072940 msgr2=0x7f140c074df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:52.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.175+0000 7f1410ff9640 1 --2- 172.21.15.112:0/2932310803 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f140c072940 0x7f140c074df0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f14140041d0 tx=0x7f1414004330 comp rx=0 tx=0).stop 2024-09-19T09:40:52.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.175+0000 7f1410ff9640 1 -- 172.21.15.112:0/2932310803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14240fcf80 msgr2=0x7f142410e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:52.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.176+0000 7f1410ff9640 1 --2- 172.21.15.112:0/2932310803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14240fcf80 0x7f142410e6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1418003080 tx=0x7f1418009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.176+0000 7f1410ff9640 1 -- 172.21.15.112:0/2932310803 shutdown_connections 2024-09-19T09:40:52.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.176+0000 7f1410ff9640 1 --2- 172.21.15.112:0/2932310803 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f140c072940 0x7f140c074df0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.176+0000 7f1410ff9640 1 --2- 172.21.15.112:0/2932310803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14240fcf80 0x7f142410e6d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.176+0000 7f1410ff9640 1 --2- 172.21.15.112:0/2932310803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14240fb810 0x7f142410e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.176+0000 7f1410ff9640 1 -- 172.21.15.112:0/2932310803 >> 172.21.15.112:0/2932310803 conn(0x7f14240723b0 msgr2=0x7f14240fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:52.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.176+0000 7f1410ff9640 1 -- 172.21.15.112:0/2932310803 shutdown_connections 2024-09-19T09:40:52.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.176+0000 7f1410ff9640 1 -- 172.21.15.112:0/2932310803 wait complete. 2024-09-19T09:40:52.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.258+0000 7f061c488640 1 -- 172.21.15.112:0/2277237951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06141014e0 msgr2=0x7f06141018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:52.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.258+0000 7f061c488640 1 --2- 172.21.15.112:0/2277237951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06141014e0 0x7f06141018b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f06100048d0 tx=0x7f0610009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.258+0000 7f061c488640 1 -- 172.21.15.112:0/2277237951 shutdown_connections 2024-09-19T09:40:52.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.258+0000 7f061c488640 1 --2- 172.21.15.112:0/2277237951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06140fb4a0 0x7f06140fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.258+0000 7f061c488640 1 --2- 172.21.15.112:0/2277237951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06141014e0 0x7f06141018b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.258+0000 7f061c488640 1 -- 172.21.15.112:0/2277237951 >> 172.21.15.112:0/2277237951 conn(0x7f06140f7060 msgr2=0x7f06140f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:52.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.258+0000 7f061c488640 1 -- 172.21.15.112:0/2277237951 shutdown_connections 2024-09-19T09:40:52.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.258+0000 7f061c488640 1 -- 172.21.15.112:0/2277237951 wait complete. 2024-09-19T09:40:52.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.259+0000 7f061c488640 1 Processor -- start 2024-09-19T09:40:52.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.259+0000 7f061c488640 1 -- start start 2024-09-19T09:40:52.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.259+0000 7f061c488640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06140fb4a0 0x7f061410e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:52.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.259+0000 7f061c488640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06141014e0 0x7f061410e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:52.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.259+0000 7f061c488640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061410ed10 con 0x7f06140fb4a0 2024-09-19T09:40:52.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.259+0000 7f061c488640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061410ee80 con 0x7f06141014e0 2024-09-19T09:40:52.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.259+0000 7f061a224640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06140fb4a0 0x7f061410e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:52.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.259+0000 7f061a224640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06140fb4a0 0x7f061410e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50020/0 (socket says 172.21.15.112:50020) 2024-09-19T09:40:52.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.259+0000 7f061a224640 1 -- 172.21.15.112:0/2510197168 learned_addr learned my addr 172.21.15.112:0/2510197168 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:40:52.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.260+0000 7f0619a23640 1 --2- 172.21.15.112:0/2510197168 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06141014e0 0x7f061410e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:52.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.260+0000 7f061a224640 1 -- 172.21.15.112:0/2510197168 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06141014e0 msgr2=0x7f061410e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:52.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.260+0000 7f061a224640 1 --2- 172.21.15.112:0/2510197168 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06141014e0 0x7f061410e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.260+0000 7f061a224640 1 -- 172.21.15.112:0/2510197168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0610005040 con 0x7f06140fb4a0 2024-09-19T09:40:52.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.260+0000 7f0619a23640 1 --2- 172.21.15.112:0/2510197168 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06141014e0 0x7f061410e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:52.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.260+0000 7f061a224640 1 --2- 172.21.15.112:0/2510197168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06140fb4a0 0x7f061410e180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0610000c00 tx=0x7f0610009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:52.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.260+0000 7f060affd640 1 -- 172.21.15.112:0/2510197168 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0610038070 con 0x7f06140fb4a0 2024-09-19T09:40:52.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.260+0000 7f061c488640 1 -- 172.21.15.112:0/2510197168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06141171f0 con 0x7f06140fb4a0 2024-09-19T09:40:52.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.260+0000 7f061c488640 1 -- 172.21.15.112:0/2510197168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0614117650 con 0x7f06140fb4a0 2024-09-19T09:40:52.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.260+0000 7f060affd640 1 -- 172.21.15.112:0/2510197168 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f061002ade0 con 0x7f06140fb4a0 2024-09-19T09:40:52.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.260+0000 7f060affd640 1 -- 172.21.15.112:0/2510197168 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f061002c800 con 0x7f06140fb4a0 2024-09-19T09:40:52.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.261+0000 7f061c488640 1 -- 172.21.15.112:0/2510197168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06140fcbe0 con 0x7f06140fb4a0 2024-09-19T09:40:52.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.262+0000 7f060affd640 1 -- 172.21.15.112:0/2510197168 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0610030020 con 0x7f06140fb4a0 2024-09-19T09:40:52.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.262+0000 7f060affd640 1 --2- 172.21.15.112:0/2510197168 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f060006e530 0x7f06000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:52.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.262+0000 7f060affd640 1 -- 172.21.15.112:0/2510197168 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f06100adc90 con 0x7f06140fb4a0 2024-09-19T09:40:52.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.262+0000 7f0619a23640 1 --2- 172.21.15.112:0/2510197168 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f060006e530 0x7f06000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:52.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.263+0000 7f0619a23640 1 --2- 172.21.15.112:0/2510197168 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f060006e530 0x7f06000709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0614066470 tx=0x7f060400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:52.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.266+0000 7f060affd640 1 -- 172.21.15.112:0/2510197168 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0610076f50 con 0x7f06140fb4a0 2024-09-19T09:40:52.438 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:52 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1[114288]: 2024-09-19T09:40:52.184+0000 7f54c7fb6640 -1 osd.1 53 log_to_monitors true 2024-09-19T09:40:52.439 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:40:52 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1[114288]: 2024-09-19T09:40:52.396+0000 7f54bfd50640 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:40:52.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:52 smithi112 ceph-mon[97503]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:52.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:52 smithi112 ceph-mon[97503]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:52.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:52 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/833848064' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:52.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:52 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2932310803' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:40:52.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:52 smithi112 ceph-mon[97503]: from='osd.1 [v2:172.21.15.112:6810/880297501,v1:172.21.15.112:6811/880297501]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:40:52.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.463+0000 7f061c488640 1 -- 172.21.15.112:0/2510197168 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0614066220 con 0x7f060006e530 2024-09-19T09:40:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.465+0000 7f060affd640 1 -- 172.21.15.112:0/2510197168 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0614066220 con 0x7f060006e530 2024-09-19T09:40:52.467 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:40:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:40:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:40:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:40:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-19T09:40:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "mon", 2024-09-19T09:40:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-19T09:40:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "crash" 2024-09-19T09:40:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-19T09:40:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "8/21 daemons upgraded", 2024-09-19T09:40:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T09:40:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:40:52.467 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:40:52.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.467+0000 7f061c488640 1 -- 172.21.15.112:0/2510197168 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f060006e530 msgr2=0x7f06000709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:52.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.467+0000 7f061c488640 1 --2- 172.21.15.112:0/2510197168 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f060006e530 0x7f06000709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0614066470 tx=0x7f060400b040 comp rx=0 tx=0).stop 2024-09-19T09:40:52.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.467+0000 7f061c488640 1 -- 172.21.15.112:0/2510197168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06140fb4a0 msgr2=0x7f061410e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:52.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.467+0000 7f061c488640 1 --2- 172.21.15.112:0/2510197168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06140fb4a0 0x7f061410e180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0610000c00 tx=0x7f0610009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.467+0000 7f061c488640 1 -- 172.21.15.112:0/2510197168 shutdown_connections 2024-09-19T09:40:52.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.467+0000 7f061c488640 1 --2- 172.21.15.112:0/2510197168 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f060006e530 0x7f06000709e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.467+0000 7f061c488640 1 --2- 172.21.15.112:0/2510197168 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06141014e0 0x7f061410e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.467+0000 7f061c488640 1 --2- 172.21.15.112:0/2510197168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06140fb4a0 0x7f061410e180 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.467+0000 7f061c488640 1 -- 172.21.15.112:0/2510197168 >> 172.21.15.112:0/2510197168 conn(0x7f06140f7060 msgr2=0x7f06140f7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:52.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.467+0000 7f061c488640 1 -- 172.21.15.112:0/2510197168 shutdown_connections 2024-09-19T09:40:52.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.467+0000 7f061c488640 1 -- 172.21.15.112:0/2510197168 wait complete. 2024-09-19T09:40:52.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.545+0000 7f00ee9e9640 1 -- 172.21.15.112:0/3064132054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e80fac80 msgr2=0x7f00e80fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:52.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.545+0000 7f00ee9e9640 1 --2- 172.21.15.112:0/3064132054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e80fac80 0x7f00e80fb0f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0048d0 tx=0x7f00dc009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.545+0000 7f00ee9e9640 1 -- 172.21.15.112:0/3064132054 shutdown_connections 2024-09-19T09:40:52.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.545+0000 7f00ee9e9640 1 --2- 172.21.15.112:0/3064132054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e80fac80 0x7f00e80fb0f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.545+0000 7f00ee9e9640 1 --2- 172.21.15.112:0/3064132054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00e8102620 0x7f00e81029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.546+0000 7f00ee9e9640 1 -- 172.21.15.112:0/3064132054 >> 172.21.15.112:0/3064132054 conn(0x7f00e8070ce0 msgr2=0x7f00e80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:52.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.546+0000 7f00ee9e9640 1 -- 172.21.15.112:0/3064132054 shutdown_connections 2024-09-19T09:40:52.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.546+0000 7f00ee9e9640 1 -- 172.21.15.112:0/3064132054 wait complete. 2024-09-19T09:40:52.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.546+0000 7f00ee9e9640 1 Processor -- start 2024-09-19T09:40:52.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.546+0000 7f00ee9e9640 1 -- start start 2024-09-19T09:40:52.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.547+0000 7f00ee9e9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00e80fac80 0x7f00e81131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:52.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.547+0000 7f00ee9e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e8102620 0x7f00e81136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:52.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.547+0000 7f00ee9e9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e8113cf0 con 0x7f00e8102620 2024-09-19T09:40:52.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.547+0000 7f00ee9e9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e810d180 con 0x7f00e80fac80 2024-09-19T09:40:52.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.547+0000 7f00e77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e8102620 0x7f00e81136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:52.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.547+0000 7f00e77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e8102620 0x7f00e81136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50044/0 (socket says 172.21.15.112:50044) 2024-09-19T09:40:52.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.547+0000 7f00e77fe640 1 -- 172.21.15.112:0/3385978537 learned_addr learned my addr 172.21.15.112:0/3385978537 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:40:52.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.547+0000 7f00e7fff640 1 --2- 172.21.15.112:0/3385978537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00e80fac80 0x7f00e81131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:52.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.547+0000 7f00e77fe640 1 -- 172.21.15.112:0/3385978537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00e80fac80 msgr2=0x7f00e81131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:52.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.547+0000 7f00e77fe640 1 --2- 172.21.15.112:0/3385978537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00e80fac80 0x7f00e81131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.547+0000 7f00e77fe640 1 -- 172.21.15.112:0/3385978537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc005040 con 0x7f00e8102620 2024-09-19T09:40:52.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.547+0000 7f00e77fe640 1 --2- 172.21.15.112:0/3385978537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e8102620 0x7f00e81136f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f00dc000c00 tx=0x7f00dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:52.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.547+0000 7f00e4ff9640 1 -- 172.21.15.112:0/3385978537 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00dc038070 con 0x7f00e8102620 2024-09-19T09:40:52.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.547+0000 7f00e4ff9640 1 -- 172.21.15.112:0/3385978537 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f00dc02ade0 con 0x7f00e8102620 2024-09-19T09:40:52.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.547+0000 7f00ee9e9640 1 -- 172.21.15.112:0/3385978537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e810d400 con 0x7f00e8102620 2024-09-19T09:40:52.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.548+0000 7f00e4ff9640 1 -- 172.21.15.112:0/3385978537 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00dc02c7e0 con 0x7f00e8102620 2024-09-19T09:40:52.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.548+0000 7f00ee9e9640 1 -- 172.21.15.112:0/3385978537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e810d8c0 con 0x7f00e8102620 2024-09-19T09:40:52.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.548+0000 7f00ee9e9640 1 -- 172.21.15.112:0/3385978537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e80657b0 con 0x7f00e8102620 2024-09-19T09:40:52.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.549+0000 7f00e4ff9640 1 -- 172.21.15.112:0/3385978537 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f00dc030020 con 0x7f00e8102620 2024-09-19T09:40:52.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.549+0000 7f00e4ff9640 1 --2- 172.21.15.112:0/3385978537 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f00d006e530 0x7f00d00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:52.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.550+0000 7f00e4ff9640 1 -- 172.21.15.112:0/3385978537 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f00dc0add60 con 0x7f00e8102620 2024-09-19T09:40:52.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.550+0000 7f00e7fff640 1 --2- 172.21.15.112:0/3385978537 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f00d006e530 0x7f00d00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:52.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.550+0000 7f00e7fff640 1 --2- 172.21.15.112:0/3385978537 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f00d006e530 0x7f00d00709e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009470 tx=0x7f00d8009ed0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:52.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.554+0000 7f00e4ff9640 1 -- 172.21.15.112:0/3385978537 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f00dc076fa0 con 0x7f00e8102620 2024-09-19T09:40:52.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:52 smithi191 ceph-mon[77624]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:52.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:52 smithi191 ceph-mon[77624]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:52.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:52 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/833848064' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:52.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:52 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2932310803' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:40:52.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:52 smithi191 ceph-mon[77624]: from='osd.1 [v2:172.21.15.112:6810/880297501,v1:172.21.15.112:6811/880297501]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:40:52.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.797+0000 7f00ee9e9640 1 -- 172.21.15.112:0/3385978537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f00e8109570 con 0x7f00e8102620 2024-09-19T09:40:52.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.798+0000 7f00e4ff9640 1 -- 172.21.15.112:0/3385978537 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+992 (secure 0 0 0) 0x7f00dc07a660 con 0x7f00e8102620 2024-09-19T09:40:52.800 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 32/225 objects degraded (14.222%), 13 pgs degraded 2024-09-19T09:40:52.800 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-19T09:40:52.800 INFO:teuthology.orchestra.run.smithi112.stdout: osd.1 (root=default,host=smithi112) is down 2024-09-19T09:40:52.800 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 32/225 objects degraded (14.222%), 13 pgs degraded 2024-09-19T09:40:52.800 INFO:teuthology.orchestra.run.smithi112.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-19T09:40:52.800 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-19T09:40:52.800 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-19T09:40:52.800 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-19T09:40:52.800 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-19T09:40:52.801 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-19T09:40:52.801 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-19T09:40:52.801 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-19T09:40:52.801 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-19T09:40:52.801 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-19T09:40:52.801 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-19T09:40:52.801 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-19T09:40:52.801 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-19T09:40:52.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.801+0000 7f00ee9e9640 1 -- 172.21.15.112:0/3385978537 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f00d006e530 msgr2=0x7f00d00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.801+0000 7f00ee9e9640 1 --2- 172.21.15.112:0/3385978537 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f00d006e530 0x7f00d00709e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009470 tx=0x7f00d8009ed0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.801+0000 7f00ee9e9640 1 -- 172.21.15.112:0/3385978537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e8102620 msgr2=0x7f00e81136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.801+0000 7f00ee9e9640 1 --2- 172.21.15.112:0/3385978537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e8102620 0x7f00e81136f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f00dc000c00 tx=0x7f00dc009da0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.801+0000 7f00ee9e9640 1 -- 172.21.15.112:0/3385978537 shutdown_connections 2024-09-19T09:40:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.801+0000 7f00ee9e9640 1 --2- 172.21.15.112:0/3385978537 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f00d006e530 0x7f00d00709e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.801+0000 7f00ee9e9640 1 --2- 172.21.15.112:0/3385978537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e8102620 0x7f00e81136f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.801+0000 7f00ee9e9640 1 --2- 172.21.15.112:0/3385978537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00e80fac80 0x7f00e81131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.801+0000 7f00ee9e9640 1 -- 172.21.15.112:0/3385978537 >> 172.21.15.112:0/3385978537 conn(0x7f00e8070ce0 msgr2=0x7f00e8100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.801+0000 7f00ee9e9640 1 -- 172.21.15.112:0/3385978537 shutdown_connections 2024-09-19T09:40:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:40:52.801+0000 7f00ee9e9640 1 -- 172.21.15.112:0/3385978537 wait complete. 2024-09-19T09:40:53.487 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:53 smithi112 ceph-mon[97503]: from='osd.1 [v2:172.21.15.112:6810/880297501,v1:172.21.15.112:6811/880297501]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:40:53.487 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:53 smithi112 ceph-mon[97503]: osdmap e56: 6 total, 5 up, 6 in 2024-09-19T09:40:53.487 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:53 smithi112 ceph-mon[97503]: from='osd.1 [v2:172.21.15.112:6810/880297501,v1:172.21.15.112:6811/880297501]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-19T09:40:53.487 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:53 smithi112 ceph-mon[97503]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:53.487 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:53 smithi112 ceph-mon[97503]: pgmap v70: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 32/225 objects degraded (14.222%) 2024-09-19T09:40:53.487 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:53 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3385978537' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:40:53.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:53 smithi191 ceph-mon[77624]: from='osd.1 [v2:172.21.15.112:6810/880297501,v1:172.21.15.112:6811/880297501]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:40:53.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:53 smithi191 ceph-mon[77624]: osdmap e56: 6 total, 5 up, 6 in 2024-09-19T09:40:53.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:53 smithi191 ceph-mon[77624]: from='osd.1 [v2:172.21.15.112:6810/880297501,v1:172.21.15.112:6811/880297501]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-19T09:40:53.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:53 smithi191 ceph-mon[77624]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:40:53.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:53 smithi191 ceph-mon[77624]: pgmap v70: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 32/225 objects degraded (14.222%) 2024-09-19T09:40:53.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:53 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3385978537' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:40:54.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:54 smithi112 ceph-mon[97503]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:40:54.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:54 smithi112 ceph-mon[97503]: osd.1 [v2:172.21.15.112:6810/880297501,v1:172.21.15.112:6811/880297501] boot 2024-09-19T09:40:54.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:54 smithi112 ceph-mon[97503]: osdmap e57: 6 total, 6 up, 6 in 2024-09-19T09:40:54.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:40:54.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:54.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:54.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:40:54.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:40:54.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:54.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:40:54.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:54.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:54.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:54.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:40:54.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:54 smithi112 ceph-mon[97503]: osdmap e58: 6 total, 6 up, 6 in 2024-09-19T09:40:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:54 smithi191 ceph-mon[77624]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:40:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:54 smithi191 ceph-mon[77624]: osd.1 [v2:172.21.15.112:6810/880297501,v1:172.21.15.112:6811/880297501] boot 2024-09-19T09:40:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:54 smithi191 ceph-mon[77624]: osdmap e57: 6 total, 6 up, 6 in 2024-09-19T09:40:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:40:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:40:54.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:40:54.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:54.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:40:54.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:54.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:54.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:40:54.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:40:54.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:54 smithi191 ceph-mon[77624]: osdmap e58: 6 total, 6 up, 6 in 2024-09-19T09:40:56.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:55 smithi112 ceph-mon[97503]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:40:56.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:55 smithi112 ceph-mon[97503]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-19T09:40:56.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:55 smithi112 ceph-mon[97503]: pgmap v73: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 32/225 objects degraded (14.222%) 2024-09-19T09:40:56.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:56.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:40:56.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:55 smithi191 ceph-mon[77624]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:40:56.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:55 smithi191 ceph-mon[77624]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-19T09:40:56.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:55 smithi191 ceph-mon[77624]: pgmap v73: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 32/225 objects degraded (14.222%) 2024-09-19T09:40:56.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:55 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:40:56.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:55 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:40:57.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:56 smithi112 ceph-mon[97503]: Health check update: Degraded data redundancy: 16/225 objects degraded (7.111%), 7 pgs degraded (PG_DEGRADED) 2024-09-19T09:40:57.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:56 smithi191 ceph-mon[77624]: Health check update: Degraded data redundancy: 16/225 objects degraded (7.111%), 7 pgs degraded (PG_DEGRADED) 2024-09-19T09:40:57.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:57 smithi112 ceph-mon[97503]: pgmap v74: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 16/225 objects degraded (7.111%) 2024-09-19T09:40:58.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:57 smithi191 ceph-mon[77624]: pgmap v74: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 16/225 objects degraded (7.111%) 2024-09-19T09:40:59.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:58 smithi112 ceph-mon[97503]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/225 objects degraded (7.111%), 7 pgs degraded) 2024-09-19T09:40:59.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:58 smithi112 ceph-mon[97503]: Cluster is now healthy 2024-09-19T09:40:59.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:58 smithi191 ceph-mon[77624]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/225 objects degraded (7.111%), 7 pgs degraded) 2024-09-19T09:40:59.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:58 smithi191 ceph-mon[77624]: Cluster is now healthy 2024-09-19T09:41:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:40:59 smithi112 ceph-mon[97503]: pgmap v75: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 798 B/s rd, 1 op/s 2024-09-19T09:41:00.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:40:59 smithi191 ceph-mon[77624]: pgmap v75: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 798 B/s rd, 1 op/s 2024-09-19T09:41:02.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:01 smithi112 ceph-mon[97503]: pgmap v76: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-19T09:41:02.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:01 smithi191 ceph-mon[77624]: pgmap v76: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-19T09:41:04.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:03 smithi112 ceph-mon[97503]: pgmap v77: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T09:41:04.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:03 smithi191 ceph-mon[77624]: pgmap v77: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T09:41:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:05 smithi112 ceph-mon[97503]: pgmap v78: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 983 B/s rd, 1 op/s 2024-09-19T09:41:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:06.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:05 smithi191 ceph-mon[77624]: pgmap v78: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 983 B/s rd, 1 op/s 2024-09-19T09:41:06.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:07.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:07 smithi112 ceph-mon[97503]: pgmap v79: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:41:08.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:07 smithi191 ceph-mon[77624]: pgmap v79: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:41:09.894 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:09 smithi112 ceph-mon[97503]: pgmap v80: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:41:09.895 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:41:09.895 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:09.895 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:41:10.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:09 smithi191 ceph-mon[77624]: pgmap v80: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:41:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:41:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:41:10.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:10 smithi112 ceph-mon[97503]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:41:10.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:10 smithi112 ceph-mon[97503]: Upgrade: osd.2 is safe to restart 2024-09-19T09:41:10.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:10 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:10.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:10 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:41:10.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:10 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:41:11.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:10 smithi191 ceph-mon[77624]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:41:11.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:10 smithi191 ceph-mon[77624]: Upgrade: osd.2 is safe to restart 2024-09-19T09:41:11.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:10 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:11.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:10 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:41:11.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:10 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:41:12.109 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:11 smithi112 ceph-mon[97503]: Upgrade: Updating osd.2 2024-09-19T09:41:12.109 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:11 smithi112 ceph-mon[97503]: Deploying daemon osd.2 on smithi112 2024-09-19T09:41:12.110 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:11 smithi112 ceph-mon[97503]: pgmap v81: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:41:12.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:11 smithi191 ceph-mon[77624]: Upgrade: Updating osd.2 2024-09-19T09:41:12.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:11 smithi191 ceph-mon[77624]: Deploying daemon osd.2 on smithi112 2024-09-19T09:41:12.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:11 smithi191 ceph-mon[77624]: pgmap v81: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:41:14.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:13 smithi112 ceph-mon[97503]: pgmap v82: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:41:14.030 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:13 smithi112 systemd[1]: Stopping Ceph osd.2 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:41:14.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:13 smithi191 ceph-mon[77624]: pgmap v82: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:41:14.439 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:14 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2[60559]: 2024-09-19T09:41:14.027+0000 7fcbbf566640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:41:14.439 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:14 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2[60559]: 2024-09-19T09:41:14.027+0000 7fcbbf566640 -1 osd.2 58 *** Got signal Terminated *** 2024-09-19T09:41:14.439 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:14 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2[60559]: 2024-09-19T09:41:14.027+0000 7fcbbf566640 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:41:15.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:14 smithi112 ceph-mon[97503]: osd.2 marked itself down and dead 2024-09-19T09:41:15.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:14 smithi191 ceph-mon[77624]: osd.2 marked itself down and dead 2024-09-19T09:41:15.480 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:15 smithi112 podman[119445]: 2024-09-19 09:41:15.213076726 +0000 UTC m=+1.299742928 container died 4dcca18af229158b89cbc836abe85b56a82a979c7482438d01c303e6fe79a992 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=quincy-6e06d1e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:41:15.857 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:15 smithi112 podman[119445]: 2024-09-19 09:41:15.561174266 +0000 UTC m=+1.647840467 container cleanup 4dcca18af229158b89cbc836abe85b56a82a979c7482438d01c303e6fe79a992 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=quincy-6e06d1e) 2024-09-19T09:41:15.857 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:15 smithi112 bash[119445]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2 2024-09-19T09:41:16.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:15 smithi112 ceph-mon[97503]: pgmap v83: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:41:16.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:15 smithi112 ceph-mon[97503]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:41:16.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:15 smithi112 ceph-mon[97503]: osdmap e59: 6 total, 5 up, 6 in 2024-09-19T09:41:16.189 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:15 smithi112 podman[119460]: 2024-09-19 09:41:15.896143269 +0000 UTC m=+0.677058161 container remove 4dcca18af229158b89cbc836abe85b56a82a979c7482438d01c303e6fe79a992 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-6e06d1e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T09:41:16.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:15 smithi191 ceph-mon[77624]: pgmap v83: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:41:16.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:15 smithi191 ceph-mon[77624]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:41:16.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:15 smithi191 ceph-mon[77624]: osdmap e59: 6 total, 5 up, 6 in 2024-09-19T09:41:16.534 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:16 smithi112 podman[119551]: 2024-09-19 09:41:16.125268765 +0000 UTC m=+0.015960671 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:41:16.534 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:16 smithi112 podman[119551]: 2024-09-19 09:41:16.263836865 +0000 UTC m=+0.154528761 container create 50bfb30b9e90194aaad810a53714096040cfe579a8915632aefb063719a01c35 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T09:41:16.534 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:16 smithi112 podman[119551]: 2024-09-19 09:41:16.532913193 +0000 UTC m=+0.423605099 container init 50bfb30b9e90194aaad810a53714096040cfe579a8915632aefb063719a01c35 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T09:41:16.869 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:16 smithi112 podman[119551]: 2024-09-19 09:41:16.53638681 +0000 UTC m=+0.427078706 container start 50bfb30b9e90194aaad810a53714096040cfe579a8915632aefb063719a01c35 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T09:41:16.869 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:16 smithi112 podman[119551]: 2024-09-19 09:41:16.616324671 +0000 UTC m=+0.507016575 container attach 50bfb30b9e90194aaad810a53714096040cfe579a8915632aefb063719a01c35 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T09:41:16.869 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:16 smithi112 podman[119551]: 2024-09-19 09:41:16.725239881 +0000 UTC m=+0.615931787 container died 50bfb30b9e90194aaad810a53714096040cfe579a8915632aefb063719a01c35 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T09:41:17.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:16 smithi112 ceph-mon[97503]: osdmap e60: 6 total, 5 up, 6 in 2024-09-19T09:41:17.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:16 smithi191 ceph-mon[77624]: osdmap e60: 6 total, 5 up, 6 in 2024-09-19T09:41:17.645 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:17 smithi112 podman[119574]: 2024-09-19 09:41:17.28676905 +0000 UTC m=+0.551297307 container remove 50bfb30b9e90194aaad810a53714096040cfe579a8915632aefb063719a01c35 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T09:41:17.646 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:17 smithi112 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-19T09:41:17.646 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:17 smithi112 systemd[1]: Stopped Ceph osd.2 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:41:17.646 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:17 smithi112 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.2.service: Consumed 52.629s CPU time. 2024-09-19T09:41:17.646 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:17 smithi112 systemd[1]: Starting Ceph osd.2 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:41:17.897 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:17 smithi112 ceph-mon[97503]: pgmap v86: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-19T09:41:17.897 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:17 smithi112 ceph-mon[97503]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-19T09:41:17.897 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:17 smithi112 podman[119676]: 2024-09-19 09:41:17.627651995 +0000 UTC m=+0.015489338 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:41:17.897 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:17 smithi112 podman[119676]: 2024-09-19 09:41:17.754766741 +0000 UTC m=+0.142604076 container create 33fd12a595c1a94e7fe12fb167546ee9a32e4488af508302d51dc48a624dac0d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-activate, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T09:41:18.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:17 smithi191 ceph-mon[77624]: pgmap v86: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-19T09:41:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:17 smithi191 ceph-mon[77624]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-19T09:41:18.439 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:17 smithi112 podman[119676]: 2024-09-19 09:41:17.998944681 +0000 UTC m=+0.386782016 container init 33fd12a595c1a94e7fe12fb167546ee9a32e4488af508302d51dc48a624dac0d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T09:41:18.439 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:18 smithi112 podman[119676]: 2024-09-19 09:41:18.00241021 +0000 UTC m=+0.390247554 container start 33fd12a595c1a94e7fe12fb167546ee9a32e4488af508302d51dc48a624dac0d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T09:41:18.439 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:18 smithi112 podman[119676]: 2024-09-19 09:41:18.090446117 +0000 UTC m=+0.478283456 container attach 33fd12a595c1a94e7fe12fb167546ee9a32e4488af508302d51dc48a624dac0d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T09:41:18.439 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:18 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-activate[119692]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:41:18.439 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:18 smithi112 bash[119676]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:41:18.440 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:18 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-activate[119692]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:41:18.440 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:18 smithi112 bash[119676]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:41:19.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:18 smithi112 ceph-mon[97503]: Health check failed: Degraded data redundancy: 23/225 objects degraded (10.222%), 6 pgs degraded (PG_DEGRADED) 2024-09-19T09:41:19.158 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:18 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-activate[119692]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T09:41:19.158 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:18 smithi112 bash[119676]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T09:41:19.158 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:18 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-activate[119692]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-19T09:41:19.158 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:18 smithi112 bash[119676]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-19T09:41:19.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:18 smithi191 ceph-mon[77624]: Health check failed: Degraded data redundancy: 23/225 objects degraded (10.222%), 6 pgs degraded (PG_DEGRADED) 2024-09-19T09:41:19.439 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:19 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-activate[119692]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-19T09:41:19.439 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:19 smithi112 bash[119676]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-19T09:41:19.439 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:19 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-activate[119692]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-19T09:41:19.439 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:19 smithi112 bash[119676]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-19T09:41:19.439 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:19 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-activate[119692]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-19T09:41:19.439 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:19 smithi112 bash[119676]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-19T09:41:19.439 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:19 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-activate[119692]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T09:41:19.440 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:19 smithi112 bash[119676]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T09:41:19.440 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:19 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-activate[119692]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-19T09:41:19.440 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:19 smithi112 bash[119676]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-19T09:41:19.440 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:19 smithi112 podman[119676]: 2024-09-19 09:41:19.186658327 +0000 UTC m=+1.574495672 container died 33fd12a595c1a94e7fe12fb167546ee9a32e4488af508302d51dc48a624dac0d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T09:41:20.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:19 smithi112 ceph-mon[97503]: pgmap v87: 65 pgs: 9 active+undersized, 12 peering, 6 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 23/225 objects degraded (10.222%) 2024-09-19T09:41:20.189 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:19 smithi112 podman[119825]: 2024-09-19 09:41:19.868938692 +0000 UTC m=+0.676385437 container remove 33fd12a595c1a94e7fe12fb167546ee9a32e4488af508302d51dc48a624dac0d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:41:20.189 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:20 smithi112 podman[119885]: 2024-09-19 09:41:19.983596565 +0000 UTC m=+0.016458784 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:41:20.189 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:20 smithi112 podman[119885]: 2024-09-19 09:41:20.111789937 +0000 UTC m=+0.144652141 container create 4a651b62590fd59c8ac8ea4ac3a1464fe8742b0febf6d0daac6b900b4e61bb3a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T09:41:20.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:19 smithi191 ceph-mon[77624]: pgmap v87: 65 pgs: 9 active+undersized, 12 peering, 6 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 23/225 objects degraded (10.222%) 2024-09-19T09:41:20.641 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:20 smithi112 podman[119885]: 2024-09-19 09:41:20.355824233 +0000 UTC m=+0.388686452 container init 4a651b62590fd59c8ac8ea4ac3a1464fe8742b0febf6d0daac6b900b4e61bb3a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T09:41:20.641 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:20 smithi112 podman[119885]: 2024-09-19 09:41:20.358977167 +0000 UTC m=+0.391839372 container start 4a651b62590fd59c8ac8ea4ac3a1464fe8742b0febf6d0daac6b900b4e61bb3a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:41:20.641 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:20 smithi112 ceph-osd[119904]: -- 172.21.15.112:0/3410257157 <== mon.0 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5619860101e0 con 0x5619851bdc00 2024-09-19T09:41:20.642 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:20 smithi112 bash[119885]: 4a651b62590fd59c8ac8ea4ac3a1464fe8742b0febf6d0daac6b900b4e61bb3a 2024-09-19T09:41:20.642 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:20 smithi112 systemd[1]: Started Ceph osd.2 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:41:21.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:21 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:21.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:21 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:21.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:21 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:41:21.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:21 smithi191 ceph-mon[77624]: pgmap v88: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/225 objects degraded (13.778%) 2024-09-19T09:41:21.912 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:21 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:21.912 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:21 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:21.912 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:21 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:41:21.912 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:21 smithi112 ceph-mon[97503]: pgmap v88: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/225 objects degraded (13.778%) 2024-09-19T09:41:22.438 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:22 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2[119900]: 2024-09-19T09:41:22.239+0000 7f259ecf7640 -1 Falling back to public interface 2024-09-19T09:41:22.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:22 smithi112 ceph-mon[97503]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-19T09:41:22.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:22 smithi191 ceph-mon[77624]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-19T09:41:22.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.886+0000 7f504e9e0640 1 -- 172.21.15.112:0/2182750166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50481014c0 msgr2=0x7f5048101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:22.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.886+0000 7f504e9e0640 1 --2- 172.21.15.112:0/2182750166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50481014c0 0x7f5048101890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f50380048d0 tx=0x7f5038009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:22.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.886+0000 7f504e9e0640 1 -- 172.21.15.112:0/2182750166 shutdown_connections 2024-09-19T09:41:22.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.886+0000 7f504e9e0640 1 --2- 172.21.15.112:0/2182750166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50480fb480 0x7f50480fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:22.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.886+0000 7f504e9e0640 1 --2- 172.21.15.112:0/2182750166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50481014c0 0x7f5048101890 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:22.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.886+0000 7f504e9e0640 1 -- 172.21.15.112:0/2182750166 >> 172.21.15.112:0/2182750166 conn(0x7f50480f7000 msgr2=0x7f50480f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:22.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.886+0000 7f504e9e0640 1 -- 172.21.15.112:0/2182750166 shutdown_connections 2024-09-19T09:41:22.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.886+0000 7f504e9e0640 1 -- 172.21.15.112:0/2182750166 wait complete. 2024-09-19T09:41:22.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.886+0000 7f504e9e0640 1 Processor -- start 2024-09-19T09:41:22.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.886+0000 7f504e9e0640 1 -- start start 2024-09-19T09:41:22.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f504e9e0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50480fb480 0x7f50481120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:22.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f504e9e0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50481014c0 0x7f50481125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:22.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f504e9e0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048112bf0 con 0x7f50480fb480 2024-09-19T09:41:22.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f504e9e0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504810c030 con 0x7f50481014c0 2024-09-19T09:41:22.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f5047fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50480fb480 0x7f50481120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:22.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f5047fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50480fb480 0x7f50481120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48138/0 (socket says 172.21.15.112:48138) 2024-09-19T09:41:22.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f5047fff640 1 -- 172.21.15.112:0/4119003203 learned_addr learned my addr 172.21.15.112:0/4119003203 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:41:22.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f503ffff640 1 --2- 172.21.15.112:0/4119003203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50481014c0 0x7f50481125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:22.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f5047fff640 1 -- 172.21.15.112:0/4119003203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50481014c0 msgr2=0x7f50481125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:22.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f5047fff640 1 --2- 172.21.15.112:0/4119003203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50481014c0 0x7f50481125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:22.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f5047fff640 1 -- 172.21.15.112:0/4119003203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5038005040 con 0x7f50480fb480 2024-09-19T09:41:22.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f5047fff640 1 --2- 172.21.15.112:0/4119003203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50480fb480 0x7f50481120b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5038000c00 tx=0x7f5038009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:22.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f50457fa640 1 -- 172.21.15.112:0/4119003203 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5038038070 con 0x7f50480fb480 2024-09-19T09:41:22.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f50457fa640 1 -- 172.21.15.112:0/4119003203 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f503802ade0 con 0x7f50480fb480 2024-09-19T09:41:22.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f504e9e0640 1 -- 172.21.15.112:0/4119003203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504810c2b0 con 0x7f50480fb480 2024-09-19T09:41:22.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f50457fa640 1 -- 172.21.15.112:0/4119003203 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f503802c7b0 con 0x7f50480fb480 2024-09-19T09:41:22.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.887+0000 7f504e9e0640 1 -- 172.21.15.112:0/4119003203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504810c770 con 0x7f50480fb480 2024-09-19T09:41:22.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.888+0000 7f504e9e0640 1 -- 172.21.15.112:0/4119003203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50480fcbc0 con 0x7f50480fb480 2024-09-19T09:41:22.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.889+0000 7f50457fa640 1 -- 172.21.15.112:0/4119003203 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5038030020 con 0x7f50480fb480 2024-09-19T09:41:22.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.889+0000 7f50457fa640 1 --2- 172.21.15.112:0/4119003203 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f5034070740 0x7f5034072bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:22.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.890+0000 7f50457fa640 1 -- 172.21.15.112:0/4119003203 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f50380ae520 con 0x7f50480fb480 2024-09-19T09:41:22.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.890+0000 7f503ffff640 1 --2- 172.21.15.112:0/4119003203 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f5034070740 0x7f5034072bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:22.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.890+0000 7f503ffff640 1 --2- 172.21.15.112:0/4119003203 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f5034070740 0x7f5034072bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f504810d970 tx=0x7f503000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:22.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:22.894+0000 7f50457fa640 1 -- 172.21.15.112:0/4119003203 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f50380776b0 con 0x7f50480fb480 2024-09-19T09:41:23.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.083+0000 7f504e9e0640 1 -- 172.21.15.112:0/4119003203 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f504804b720 con 0x7f5034070740 2024-09-19T09:41:23.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.085+0000 7f50457fa640 1 -- 172.21.15.112:0/4119003203 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f504804b720 con 0x7f5034070740 2024-09-19T09:41:23.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.087+0000 7f504e9e0640 1 -- 172.21.15.112:0/4119003203 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f5034070740 msgr2=0x7f5034072bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:23.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.087+0000 7f504e9e0640 1 --2- 172.21.15.112:0/4119003203 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f5034070740 0x7f5034072bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f504810d970 tx=0x7f503000b040 comp rx=0 tx=0).stop 2024-09-19T09:41:23.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.087+0000 7f504e9e0640 1 -- 172.21.15.112:0/4119003203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50480fb480 msgr2=0x7f50481120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:23.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.087+0000 7f504e9e0640 1 --2- 172.21.15.112:0/4119003203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50480fb480 0x7f50481120b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5038000c00 tx=0x7f5038009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.087+0000 7f504e9e0640 1 -- 172.21.15.112:0/4119003203 shutdown_connections 2024-09-19T09:41:23.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.087+0000 7f504e9e0640 1 --2- 172.21.15.112:0/4119003203 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f5034070740 0x7f5034072bf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.087+0000 7f504e9e0640 1 --2- 172.21.15.112:0/4119003203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50481014c0 0x7f50481125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.087+0000 7f504e9e0640 1 --2- 172.21.15.112:0/4119003203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50480fb480 0x7f50481120b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.087+0000 7f504e9e0640 1 -- 172.21.15.112:0/4119003203 >> 172.21.15.112:0/4119003203 conn(0x7f50480f7000 msgr2=0x7f50480f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:23.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.087+0000 7f504e9e0640 1 -- 172.21.15.112:0/4119003203 shutdown_connections 2024-09-19T09:41:23.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.087+0000 7f504e9e0640 1 -- 172.21.15.112:0/4119003203 wait complete. 2024-09-19T09:41:23.102 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:41:23.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.177+0000 7f197216f640 1 -- 172.21.15.112:0/1726968461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196c102530 msgr2=0x7f196c102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:23.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.177+0000 7f197216f640 1 --2- 172.21.15.112:0/1726968461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196c102530 0x7f196c102900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f195c0048d0 tx=0x7f195c009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.177+0000 7f197216f640 1 -- 172.21.15.112:0/1726968461 shutdown_connections 2024-09-19T09:41:23.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.177+0000 7f197216f640 1 --2- 172.21.15.112:0/1726968461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f196c102ed0 0x7f196c0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.177+0000 7f197216f640 1 --2- 172.21.15.112:0/1726968461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196c102530 0x7f196c102900 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.177+0000 7f197216f640 1 -- 172.21.15.112:0/1726968461 >> 172.21.15.112:0/1726968461 conn(0x7f196c0f80f0 msgr2=0x7f196c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:23.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.177+0000 7f197216f640 1 -- 172.21.15.112:0/1726968461 shutdown_connections 2024-09-19T09:41:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.177+0000 7f197216f640 1 -- 172.21.15.112:0/1726968461 wait complete. 2024-09-19T09:41:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.177+0000 7f197216f640 1 Processor -- start 2024-09-19T09:41:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.177+0000 7f197216f640 1 -- start start 2024-09-19T09:41:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.177+0000 7f197216f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f196c102530 0x7f196c113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.177+0000 7f197216f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196c102ed0 0x7f196c113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.178+0000 7f197216f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c113d80 con 0x7f196c102ed0 2024-09-19T09:41:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.178+0000 7f197216f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c10d1c0 con 0x7f196c102530 2024-09-19T09:41:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.178+0000 7f1963fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196c102ed0 0x7f196c113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.178+0000 7f1963fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196c102ed0 0x7f196c113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48166/0 (socket says 172.21.15.112:48166) 2024-09-19T09:41:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.178+0000 7f1963fff640 1 -- 172.21.15.112:0/2373674715 learned_addr learned my addr 172.21.15.112:0/2373674715 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:41:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.178+0000 7f196b7fe640 1 --2- 172.21.15.112:0/2373674715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f196c102530 0x7f196c113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.178+0000 7f1963fff640 1 -- 172.21.15.112:0/2373674715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f196c102530 msgr2=0x7f196c113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.178+0000 7f1963fff640 1 --2- 172.21.15.112:0/2373674715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f196c102530 0x7f196c113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.178+0000 7f1963fff640 1 -- 172.21.15.112:0/2373674715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c005040 con 0x7f196c102ed0 2024-09-19T09:41:23.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.178+0000 7f1963fff640 1 --2- 172.21.15.112:0/2373674715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196c102ed0 0x7f196c113780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f195400eb40 tx=0x7f195400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:23.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.178+0000 7f1968ff9640 1 -- 172.21.15.112:0/2373674715 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1954007c30 con 0x7f196c102ed0 2024-09-19T09:41:23.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.178+0000 7f197216f640 1 -- 172.21.15.112:0/2373674715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c10d440 con 0x7f196c102ed0 2024-09-19T09:41:23.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.178+0000 7f1968ff9640 1 -- 172.21.15.112:0/2373674715 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f195400f040 con 0x7f196c102ed0 2024-09-19T09:41:23.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.178+0000 7f1968ff9640 1 -- 172.21.15.112:0/2373674715 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f195400ca90 con 0x7f196c102ed0 2024-09-19T09:41:23.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.178+0000 7f197216f640 1 -- 172.21.15.112:0/2373674715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c10d9e0 con 0x7f196c102ed0 2024-09-19T09:41:23.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.180+0000 7f197216f640 1 -- 172.21.15.112:0/2373674715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c0fdcb0 con 0x7f196c102ed0 2024-09-19T09:41:23.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.180+0000 7f1968ff9640 1 -- 172.21.15.112:0/2373674715 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f195400cc10 con 0x7f196c102ed0 2024-09-19T09:41:23.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.180+0000 7f1968ff9640 1 --2- 172.21.15.112:0/2373674715 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f195806e530 0x7f19580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:23.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.181+0000 7f1968ff9640 1 -- 172.21.15.112:0/2373674715 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f195408dca0 con 0x7f196c102ed0 2024-09-19T09:41:23.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.181+0000 7f196b7fe640 1 --2- 172.21.15.112:0/2373674715 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f195806e530 0x7f19580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:23.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.181+0000 7f196b7fe640 1 --2- 172.21.15.112:0/2373674715 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f195806e530 0x7f19580709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f195c004540 tx=0x7f195c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:23.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.185+0000 7f1968ff9640 1 -- 172.21.15.112:0/2373674715 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1954092070 con 0x7f196c102ed0 2024-09-19T09:41:23.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.372+0000 7f197216f640 1 -- 172.21.15.112:0/2373674715 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f196c1095a0 con 0x7f195806e530 2024-09-19T09:41:23.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.373+0000 7f1968ff9640 1 -- 172.21.15.112:0/2373674715 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f196c1095a0 con 0x7f195806e530 2024-09-19T09:41:23.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.375+0000 7f197216f640 1 -- 172.21.15.112:0/2373674715 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f195806e530 msgr2=0x7f19580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:23.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.375+0000 7f197216f640 1 --2- 172.21.15.112:0/2373674715 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f195806e530 0x7f19580709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f195c004540 tx=0x7f195c035040 comp rx=0 tx=0).stop 2024-09-19T09:41:23.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.375+0000 7f197216f640 1 -- 172.21.15.112:0/2373674715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196c102ed0 msgr2=0x7f196c113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:23.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.375+0000 7f197216f640 1 --2- 172.21.15.112:0/2373674715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196c102ed0 0x7f196c113780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f195400eb40 tx=0x7f195400b040 comp rx=0 tx=0).stop 2024-09-19T09:41:23.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.375+0000 7f197216f640 1 -- 172.21.15.112:0/2373674715 shutdown_connections 2024-09-19T09:41:23.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.376+0000 7f197216f640 1 --2- 172.21.15.112:0/2373674715 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f195806e530 0x7f19580709e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.376+0000 7f197216f640 1 --2- 172.21.15.112:0/2373674715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196c102ed0 0x7f196c113780 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.376+0000 7f197216f640 1 --2- 172.21.15.112:0/2373674715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f196c102530 0x7f196c113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.376+0000 7f197216f640 1 -- 172.21.15.112:0/2373674715 >> 172.21.15.112:0/2373674715 conn(0x7f196c0f80f0 msgr2=0x7f196c0f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:23.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.376+0000 7f197216f640 1 -- 172.21.15.112:0/2373674715 shutdown_connections 2024-09-19T09:41:23.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.376+0000 7f197216f640 1 -- 172.21.15.112:0/2373674715 wait complete. 2024-09-19T09:41:23.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.460+0000 7f79a3a81640 1 -- 172.21.15.112:0/3455766048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f799c0fd340 msgr2=0x7f799c0fd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:23.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.460+0000 7f79a3a81640 1 --2- 172.21.15.112:0/3455766048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f799c0fd340 0x7f799c0fd710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f79980048d0 tx=0x7f7998009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.460+0000 7f79a3a81640 1 -- 172.21.15.112:0/3455766048 shutdown_connections 2024-09-19T09:41:23.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.460+0000 7f79a3a81640 1 --2- 172.21.15.112:0/3455766048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f799c0fbcf0 0x7f799c0fc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.460+0000 7f79a3a81640 1 --2- 172.21.15.112:0/3455766048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f799c0fd340 0x7f799c0fd710 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.460+0000 7f79a3a81640 1 -- 172.21.15.112:0/3455766048 >> 172.21.15.112:0/3455766048 conn(0x7f799c071b00 msgr2=0x7f799c071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:23.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.461+0000 7f79a3a81640 1 -- 172.21.15.112:0/3455766048 shutdown_connections 2024-09-19T09:41:23.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.461+0000 7f79a3a81640 1 -- 172.21.15.112:0/3455766048 wait complete. 2024-09-19T09:41:23.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.461+0000 7f79a3a81640 1 Processor -- start 2024-09-19T09:41:23.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.461+0000 7f79a3a81640 1 -- start start 2024-09-19T09:41:23.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.461+0000 7f79a3a81640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f799c0fbcf0 0x7f799c10e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:23.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.461+0000 7f79a3a81640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f799c0fd340 0x7f799c10e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:23.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.461+0000 7f79a3a81640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c10ed70 con 0x7f799c0fbcf0 2024-09-19T09:41:23.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.461+0000 7f79a3a81640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c10eee0 con 0x7f799c0fd340 2024-09-19T09:41:23.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.462+0000 7f79a181d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f799c0fbcf0 0x7f799c10e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:23.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.462+0000 7f79a181d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f799c0fbcf0 0x7f799c10e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48194/0 (socket says 172.21.15.112:48194) 2024-09-19T09:41:23.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.462+0000 7f79a181d640 1 -- 172.21.15.112:0/3475672268 learned_addr learned my addr 172.21.15.112:0/3475672268 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:41:23.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.462+0000 7f79a101c640 1 --2- 172.21.15.112:0/3475672268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f799c0fd340 0x7f799c10e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.462+0000 7f79a181d640 1 -- 172.21.15.112:0/3475672268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f799c0fd340 msgr2=0x7f799c10e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.462+0000 7f79a181d640 1 --2- 172.21.15.112:0/3475672268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f799c0fd340 0x7f799c10e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.462+0000 7f79a181d640 1 -- 172.21.15.112:0/3475672268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7998005040 con 0x7f799c0fbcf0 2024-09-19T09:41:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.462+0000 7f79a181d640 1 --2- 172.21.15.112:0/3475672268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f799c0fbcf0 0x7f799c10e1c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7998000c00 tx=0x7f7998009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.462+0000 7f79927fc640 1 -- 172.21.15.112:0/3475672268 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7998038070 con 0x7f799c0fbcf0 2024-09-19T09:41:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.462+0000 7f79a3a81640 1 -- 172.21.15.112:0/3475672268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c117230 con 0x7f799c0fbcf0 2024-09-19T09:41:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.462+0000 7f79927fc640 1 -- 172.21.15.112:0/3475672268 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f799802ade0 con 0x7f799c0fbcf0 2024-09-19T09:41:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.462+0000 7f79927fc640 1 -- 172.21.15.112:0/3475672268 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f799802c7e0 con 0x7f799c0fbcf0 2024-09-19T09:41:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.462+0000 7f79a3a81640 1 -- 172.21.15.112:0/3475672268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c1176a0 con 0x7f799c0fbcf0 2024-09-19T09:41:23.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.463+0000 7f79a3a81640 1 -- 172.21.15.112:0/3475672268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c0fcd00 con 0x7f799c0fbcf0 2024-09-19T09:41:23.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.464+0000 7f79927fc640 1 -- 172.21.15.112:0/3475672268 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7998030020 con 0x7f799c0fbcf0 2024-09-19T09:41:23.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.464+0000 7f79927fc640 1 --2- 172.21.15.112:0/3475672268 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f798806e530 0x7f79880709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:23.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.464+0000 7f79927fc640 1 -- 172.21.15.112:0/3475672268 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f79980adcc0 con 0x7f799c0fbcf0 2024-09-19T09:41:23.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.464+0000 7f79a101c640 1 --2- 172.21.15.112:0/3475672268 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f798806e530 0x7f79880709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:23.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.465+0000 7f79a101c640 1 --2- 172.21.15.112:0/3475672268 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f798806e530 0x7f79880709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f799c0fb5e0 tx=0x7f798c009ed0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:23.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.468+0000 7f79927fc640 1 -- 172.21.15.112:0/3475672268 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7998076f00 con 0x7f799c0fbcf0 2024-09-19T09:41:23.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.662+0000 7f79a3a81640 1 -- 172.21.15.112:0/3475672268 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f799c04b790 con 0x7f798806e530 2024-09-19T09:41:23.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:23 smithi112 ceph-mon[97503]: pgmap v89: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/225 objects degraded (13.778%) 2024-09-19T09:41:23.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.671+0000 7f79927fc640 1 -- 172.21.15.112:0/3475672268 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f799c04b790 con 0x7f798806e530 2024-09-19T09:41:23.673 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:41:23.674 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (5m) 33s ago 14m 26.9M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:41:23.674 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (99s) 33s ago 14m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 70bad8ff6ec4 2024-09-19T09:41:23.674 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (94s) 91s ago 13m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 6f8cb10f4c96 2024-09-19T09:41:23.674 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (3m) 33s ago 13m 80.4M - 9.4.12 2bacad6d85d8 e462aca2b022 2024-09-19T09:41:23.674 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (8m) 33s ago 8m 153M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:41:23.674 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (8m) 33s ago 8m 106M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:41:23.674 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (8m) 91s ago 8m 13.6M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:41:23.674 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (8m) 91s ago 8m 16.1M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:41:23.674 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (5m) 33s ago 15m 499M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:41:23.674 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283,8765 running (4m) 91s ago 13m 439M - 19.1.1-361-g2f599a46 d2baa855c067 fddba1bee64a 2024-09-19T09:41:23.674 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (2m) 33s ago 15m 44.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 89dfb5de44c8 2024-09-19T09:41:23.674 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (2m) 91s ago 13m 34.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 3cab8f7cc27e 2024-09-19T09:41:23.675 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (6m) 33s ago 14m 15.9M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:41:23.675 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (5m) 91s ago 13m 16.3M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:41:23.675 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (74s) 33s ago 12m 98.9M 1557M 19.1.1-361-g2f599a46 d2baa855c067 11a51e663887 2024-09-19T09:41:23.675 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (39s) 33s ago 12m 14.3M 1557M 19.1.1-361-g2f599a46 d2baa855c067 bd616fcb189b 2024-09-19T09:41:23.675 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 starting - - - 1557M 2024-09-19T09:41:23.675 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (11m) 91s ago 11m 271M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 c74489fb67f3 2024-09-19T09:41:23.675 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (10m) 91s ago 10m 239M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:41:23.675 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (10m) 91s ago 10m 226M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:41:23.675 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (4m) 33s ago 13m 63.6M - 2.43.0 a07b618ecd1d 54850883a171 2024-09-19T09:41:23.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.673+0000 7f79a3a81640 1 -- 172.21.15.112:0/3475672268 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f798806e530 msgr2=0x7f79880709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:23.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.673+0000 7f79a3a81640 1 --2- 172.21.15.112:0/3475672268 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f798806e530 0x7f79880709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f799c0fb5e0 tx=0x7f798c009ed0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.673+0000 7f79a3a81640 1 -- 172.21.15.112:0/3475672268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f799c0fbcf0 msgr2=0x7f799c10e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:23.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.673+0000 7f79a3a81640 1 --2- 172.21.15.112:0/3475672268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f799c0fbcf0 0x7f799c10e1c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7998000c00 tx=0x7f7998009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.673+0000 7f79a3a81640 1 -- 172.21.15.112:0/3475672268 shutdown_connections 2024-09-19T09:41:23.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.673+0000 7f79a3a81640 1 --2- 172.21.15.112:0/3475672268 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f798806e530 0x7f79880709e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.673+0000 7f79a3a81640 1 --2- 172.21.15.112:0/3475672268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f799c0fd340 0x7f799c10e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.673+0000 7f79a3a81640 1 --2- 172.21.15.112:0/3475672268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f799c0fbcf0 0x7f799c10e1c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.673+0000 7f79a3a81640 1 -- 172.21.15.112:0/3475672268 >> 172.21.15.112:0/3475672268 conn(0x7f799c071b00 msgr2=0x7f799c0fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:23.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.674+0000 7f79a3a81640 1 -- 172.21.15.112:0/3475672268 shutdown_connections 2024-09-19T09:41:23.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.674+0000 7f79a3a81640 1 -- 172.21.15.112:0/3475672268 wait complete. 2024-09-19T09:41:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.751+0000 7f3bbd325640 1 -- 172.21.15.112:0/1484743298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102ed0 msgr2=0x7f3bb80fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.751+0000 7f3bbd325640 1 --2- 172.21.15.112:0/1484743298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102ed0 0x7f3bb80fc590 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00048d0 tx=0x7f3ba0009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.751+0000 7f3bbd325640 1 -- 172.21.15.112:0/1484743298 shutdown_connections 2024-09-19T09:41:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.751+0000 7f3bbd325640 1 --2- 172.21.15.112:0/1484743298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102ed0 0x7f3bb80fc590 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.751+0000 7f3bbd325640 1 --2- 172.21.15.112:0/1484743298 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb8102530 0x7f3bb8102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.751+0000 7f3bbd325640 1 -- 172.21.15.112:0/1484743298 >> 172.21.15.112:0/1484743298 conn(0x7f3bb80f80f0 msgr2=0x7f3bb80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.751+0000 7f3bbd325640 1 -- 172.21.15.112:0/1484743298 shutdown_connections 2024-09-19T09:41:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.752+0000 7f3bbd325640 1 -- 172.21.15.112:0/1484743298 wait complete. 2024-09-19T09:41:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.752+0000 7f3bbd325640 1 Processor -- start 2024-09-19T09:41:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.752+0000 7f3bbd325640 1 -- start start 2024-09-19T09:41:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.752+0000 7f3bbd325640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102530 0x7f3bb81131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.752+0000 7f3bbd325640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb8102ed0 0x7f3bb8113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.752+0000 7f3bbd325640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb8113d30 con 0x7f3bb8102530 2024-09-19T09:41:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.752+0000 7f3bbd325640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb810d170 con 0x7f3bb8102ed0 2024-09-19T09:41:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.752+0000 7f3bb6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102530 0x7f3bb81131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.753+0000 7f3bb6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102530 0x7f3bb81131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48208/0 (socket says 172.21.15.112:48208) 2024-09-19T09:41:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.753+0000 7f3bb6ffd640 1 -- 172.21.15.112:0/1659938249 learned_addr learned my addr 172.21.15.112:0/1659938249 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:41:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.753+0000 7f3bae7fc640 1 --2- 172.21.15.112:0/1659938249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb8102ed0 0x7f3bb8113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.753+0000 7f3bb6ffd640 1 -- 172.21.15.112:0/1659938249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb8102ed0 msgr2=0x7f3bb8113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.753+0000 7f3bb6ffd640 1 --2- 172.21.15.112:0/1659938249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb8102ed0 0x7f3bb8113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.753+0000 7f3bb6ffd640 1 -- 172.21.15.112:0/1659938249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba0005040 con 0x7f3bb8102530 2024-09-19T09:41:23.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.753+0000 7f3bae7fc640 1 --2- 172.21.15.112:0/1659938249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb8102ed0 0x7f3bb8113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:41:23.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.753+0000 7f3bb6ffd640 1 --2- 172.21.15.112:0/1659938249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102530 0x7f3bb81131f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8002a50 tx=0x7f3ba8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:23.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.753+0000 7f3baffff640 1 -- 172.21.15.112:0/1659938249 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba8007c30 con 0x7f3bb8102530 2024-09-19T09:41:23.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.753+0000 7f3bbd325640 1 -- 172.21.15.112:0/1659938249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb810d450 con 0x7f3bb8102530 2024-09-19T09:41:23.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.753+0000 7f3baffff640 1 -- 172.21.15.112:0/1659938249 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ba800f040 con 0x7f3bb8102530 2024-09-19T09:41:23.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.753+0000 7f3baffff640 1 -- 172.21.15.112:0/1659938249 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba800da90 con 0x7f3bb8102530 2024-09-19T09:41:23.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.753+0000 7f3bbd325640 1 -- 172.21.15.112:0/1659938249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb810d9c0 con 0x7f3bb8102530 2024-09-19T09:41:23.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.754+0000 7f3bbd325640 1 -- 172.21.15.112:0/1659938249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb80fdcb0 con 0x7f3bb8102530 2024-09-19T09:41:23.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.755+0000 7f3baffff640 1 -- 172.21.15.112:0/1659938249 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3ba800dd00 con 0x7f3bb8102530 2024-09-19T09:41:23.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.755+0000 7f3baffff640 1 --2- 172.21.15.112:0/1659938249 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3ba406e530 0x7f3ba40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:23.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.755+0000 7f3baffff640 1 -- 172.21.15.112:0/1659938249 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3ba808d9d0 con 0x7f3bb8102530 2024-09-19T09:41:23.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.755+0000 7f3bae7fc640 1 --2- 172.21.15.112:0/1659938249 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3ba406e530 0x7f3ba40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:23.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.756+0000 7f3bae7fc640 1 --2- 172.21.15.112:0/1659938249 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3ba406e530 0x7f3ba40709e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0000c00 tx=0x7f3ba0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:23.760+0000 7f3baffff640 1 -- 172.21.15.112:0/1659938249 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3ba8056b60 con 0x7f3bb8102530 2024-09-19T09:41:23.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:23 smithi191 ceph-mon[77624]: pgmap v89: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/225 objects degraded (13.778%) 2024-09-19T09:41:24.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.008+0000 7f3bbd325640 1 -- 172.21.15.112:0/1659938249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3bb804b750 con 0x7f3bb8102530 2024-09-19T09:41:24.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.009+0000 7f3baffff640 1 -- 172.21.15.112:0/1659938249 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f3ba805a220 con 0x7f3bb8102530 2024-09-19T09:41:24.011 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:41:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:41:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:41:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:41:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:41:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:41:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:41:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:41:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 3, 2024-09-19T09:41:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:41:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:41:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:41:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:41:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:41:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:41:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 7, 2024-09-19T09:41:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T09:41:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:41:24.012 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:41:24.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.011+0000 7f3bbd325640 1 -- 172.21.15.112:0/1659938249 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3ba406e530 msgr2=0x7f3ba40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:24.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.011+0000 7f3bbd325640 1 --2- 172.21.15.112:0/1659938249 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3ba406e530 0x7f3ba40709e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0000c00 tx=0x7f3ba0035040 comp rx=0 tx=0).stop 2024-09-19T09:41:24.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.011+0000 7f3bbd325640 1 -- 172.21.15.112:0/1659938249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102530 msgr2=0x7f3bb81131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:24.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.011+0000 7f3bbd325640 1 --2- 172.21.15.112:0/1659938249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102530 0x7f3bb81131f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8002a50 tx=0x7f3ba8004600 comp rx=0 tx=0).stop 2024-09-19T09:41:24.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.011+0000 7f3bbd325640 1 -- 172.21.15.112:0/1659938249 shutdown_connections 2024-09-19T09:41:24.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.011+0000 7f3bbd325640 1 --2- 172.21.15.112:0/1659938249 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3ba406e530 0x7f3ba40709e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.011+0000 7f3bbd325640 1 --2- 172.21.15.112:0/1659938249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb8102ed0 0x7f3bb8113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.011+0000 7f3bbd325640 1 --2- 172.21.15.112:0/1659938249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102530 0x7f3bb81131f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.011+0000 7f3bbd325640 1 -- 172.21.15.112:0/1659938249 >> 172.21.15.112:0/1659938249 conn(0x7f3bb80f80f0 msgr2=0x7f3bb80f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:24.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.011+0000 7f3bbd325640 1 -- 172.21.15.112:0/1659938249 shutdown_connections 2024-09-19T09:41:24.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.011+0000 7f3bbd325640 1 -- 172.21.15.112:0/1659938249 wait complete. 2024-09-19T09:41:24.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.090+0000 7f9cca7b6640 1 -- 172.21.15.112:0/3052839482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc4102570 msgr2=0x7f9cc4102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:24.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.090+0000 7f9cca7b6640 1 --2- 172.21.15.112:0/3052839482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc4102570 0x7f9cc4102940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40048d0 tx=0x7f9cb4009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.090+0000 7f9cca7b6640 1 -- 172.21.15.112:0/3052839482 shutdown_connections 2024-09-19T09:41:24.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.090+0000 7f9cca7b6640 1 --2- 172.21.15.112:0/3052839482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cc4102f10 0x7f9cc40fac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.090+0000 7f9cca7b6640 1 --2- 172.21.15.112:0/3052839482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc4102570 0x7f9cc4102940 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.090+0000 7f9cca7b6640 1 -- 172.21.15.112:0/3052839482 >> 172.21.15.112:0/3052839482 conn(0x7f9cc4070c80 msgr2=0x7f9cc4071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:24.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.090+0000 7f9cca7b6640 1 -- 172.21.15.112:0/3052839482 shutdown_connections 2024-09-19T09:41:24.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.090+0000 7f9cca7b6640 1 -- 172.21.15.112:0/3052839482 wait complete. 2024-09-19T09:41:24.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.091+0000 7f9cca7b6640 1 Processor -- start 2024-09-19T09:41:24.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.091+0000 7f9cca7b6640 1 -- start start 2024-09-19T09:41:24.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.091+0000 7f9cca7b6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cc4102570 0x7f9cc4115400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:24.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.091+0000 7f9cca7b6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc4102f10 0x7f9cc4115940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:24.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.091+0000 7f9cca7b6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc4115f40 con 0x7f9cc4102f10 2024-09-19T09:41:24.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.091+0000 7f9cca7b6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc41160b0 con 0x7f9cc4102570 2024-09-19T09:41:24.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.091+0000 7f9cc37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc4102f10 0x7f9cc4115940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:24.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.091+0000 7f9cc37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc4102f10 0x7f9cc4115940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48238/0 (socket says 172.21.15.112:48238) 2024-09-19T09:41:24.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.091+0000 7f9cc37fe640 1 -- 172.21.15.112:0/4021584918 learned_addr learned my addr 172.21.15.112:0/4021584918 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:41:24.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.092+0000 7f9cc3fff640 1 --2- 172.21.15.112:0/4021584918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cc4102570 0x7f9cc4115400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:24.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.092+0000 7f9cc37fe640 1 -- 172.21.15.112:0/4021584918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cc4102570 msgr2=0x7f9cc4115400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:24.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.092+0000 7f9cc37fe640 1 --2- 172.21.15.112:0/4021584918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cc4102570 0x7f9cc4115400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.092+0000 7f9cc37fe640 1 -- 172.21.15.112:0/4021584918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb4005040 con 0x7f9cc4102f10 2024-09-19T09:41:24.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.092+0000 7f9cc37fe640 1 --2- 172.21.15.112:0/4021584918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc4102f10 0x7f9cc4115940 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8002840 tx=0x7f9cb8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:24.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.092+0000 7f9cc0ff9640 1 -- 172.21.15.112:0/4021584918 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb8007c30 con 0x7f9cc4102f10 2024-09-19T09:41:24.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.092+0000 7f9cc0ff9640 1 -- 172.21.15.112:0/4021584918 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9cb800f040 con 0x7f9cc4102f10 2024-09-19T09:41:24.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.092+0000 7f9cca7b6640 1 -- 172.21.15.112:0/4021584918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc410f530 con 0x7f9cc4102f10 2024-09-19T09:41:24.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.092+0000 7f9cc0ff9640 1 -- 172.21.15.112:0/4021584918 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb8009410 con 0x7f9cc4102f10 2024-09-19T09:41:24.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.092+0000 7f9cca7b6640 1 -- 172.21.15.112:0/4021584918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc410fad0 con 0x7f9cc4102f10 2024-09-19T09:41:24.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.093+0000 7f9cca7b6640 1 -- 172.21.15.112:0/4021584918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc4065800 con 0x7f9cc4102f10 2024-09-19T09:41:24.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.093+0000 7f9cc0ff9640 1 -- 172.21.15.112:0/4021584918 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9cb80096d0 con 0x7f9cc4102f10 2024-09-19T09:41:24.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.094+0000 7f9cc0ff9640 1 --2- 172.21.15.112:0/4021584918 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9cac06e530 0x7f9cac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:24.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.094+0000 7f9cc0ff9640 1 -- 172.21.15.112:0/4021584918 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9cb808d9c0 con 0x7f9cc4102f10 2024-09-19T09:41:24.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.094+0000 7f9cc3fff640 1 --2- 172.21.15.112:0/4021584918 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9cac06e530 0x7f9cac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:24.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.094+0000 7f9cc3fff640 1 --2- 172.21.15.112:0/4021584918 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9cac06e530 0x7f9cac0709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009ac0 tx=0x7f9cb4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:24.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.098+0000 7f9cc0ff9640 1 -- 172.21.15.112:0/4021584918 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9cb8056b50 con 0x7f9cc4102f10 2024-09-19T09:41:24.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.310+0000 7f9cca7b6640 1 -- 172.21.15.112:0/4021584918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9cc4074c20 con 0x7f9cc4102f10 2024-09-19T09:41:24.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.310+0000 7f9cc0ff9640 1 -- 172.21.15.112:0/4021584918 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1949 (secure 0 0 0) 0x7f9cb805a210 con 0x7f9cc4102f10 2024-09-19T09:41:24.312 INFO:teuthology.orchestra.run.smithi112.stdout:e17 2024-09-19T09:41:24.312 INFO:teuthology.orchestra.run.smithi112.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:41:24.312 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:41:24.312 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-19T09:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-19T09:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 17 2024-09-19T09:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-19T09:32:42.200999+0000 2024-09-19T09:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-19T09:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-19T09:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-19T09:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-19T09:41:24.314 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-19T09:41:24.314 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-19T09:41:24.314 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-19T09:41:24.314 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-19T09:41:24.314 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 45 2024-09-19T09:41:24.314 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:41:24.314 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-19T09:41:24.314 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-19T09:41:24.314 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14460} 2024-09-19T09:41:24.314 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-19T09:41:24.314 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-19T09:41:24.314 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-19T09:41:24.314 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-19T09:41:24.315 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-19T09:41:24.315 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data disabled 2024-09-19T09:41:24.315 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-19T09:41:24.315 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-19T09:41:24.315 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-19T09:41:24.315 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:41:24.315 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.hcoxjz{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:41:24.315 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ymjyok{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/3468750429,v1:172.21.15.112:6827/3468750429] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:41:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:41:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:41:24.315 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-19T09:41:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:41:24.315 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.qweljt{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:41:24.315 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.jjldod{-1:24281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6824/2759077122,v1:172.21.15.191:6825/2759077122] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:41:24.316 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2024-09-19T09:41:24.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.313+0000 7f9cca7b6640 1 -- 172.21.15.112:0/4021584918 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9cac06e530 msgr2=0x7f9cac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:24.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.313+0000 7f9cca7b6640 1 --2- 172.21.15.112:0/4021584918 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9cac06e530 0x7f9cac0709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009ac0 tx=0x7f9cb4035040 comp rx=0 tx=0).stop 2024-09-19T09:41:24.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.313+0000 7f9cca7b6640 1 -- 172.21.15.112:0/4021584918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc4102f10 msgr2=0x7f9cc4115940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:24.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.313+0000 7f9cca7b6640 1 --2- 172.21.15.112:0/4021584918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc4102f10 0x7f9cc4115940 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8002840 tx=0x7f9cb8004570 comp rx=0 tx=0).stop 2024-09-19T09:41:24.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.313+0000 7f9cca7b6640 1 -- 172.21.15.112:0/4021584918 shutdown_connections 2024-09-19T09:41:24.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.313+0000 7f9cca7b6640 1 --2- 172.21.15.112:0/4021584918 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9cac06e530 0x7f9cac0709e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.313+0000 7f9cca7b6640 1 --2- 172.21.15.112:0/4021584918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc4102f10 0x7f9cc4115940 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.313+0000 7f9cca7b6640 1 --2- 172.21.15.112:0/4021584918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cc4102570 0x7f9cc4115400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.313+0000 7f9cca7b6640 1 -- 172.21.15.112:0/4021584918 >> 172.21.15.112:0/4021584918 conn(0x7f9cc4070c80 msgr2=0x7f9cc4103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:24.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.313+0000 7f9cca7b6640 1 -- 172.21.15.112:0/4021584918 shutdown_connections 2024-09-19T09:41:24.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.313+0000 7f9cca7b6640 1 -- 172.21.15.112:0/4021584918 wait complete. 2024-09-19T09:41:24.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.393+0000 7fedfced4640 1 -- 172.21.15.112:0/1130700568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedf80fcf80 msgr2=0x7fedf80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:24.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.393+0000 7fedfced4640 1 --2- 172.21.15.112:0/1130700568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedf80fcf80 0x7fedf80fd3d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fede00048d0 tx=0x7fede0009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.393+0000 7fedfced4640 1 -- 172.21.15.112:0/1130700568 shutdown_connections 2024-09-19T09:41:24.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.393+0000 7fedfced4640 1 --2- 172.21.15.112:0/1130700568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedf80fcf80 0x7fedf80fd3d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.393+0000 7fedfced4640 1 --2- 172.21.15.112:0/1130700568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fedf80fb810 0x7fedf80fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.393+0000 7fedfced4640 1 -- 172.21.15.112:0/1130700568 >> 172.21.15.112:0/1130700568 conn(0x7fedf80723b0 msgr2=0x7fedf80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:24.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.393+0000 7fedfced4640 1 -- 172.21.15.112:0/1130700568 shutdown_connections 2024-09-19T09:41:24.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.393+0000 7fedfced4640 1 -- 172.21.15.112:0/1130700568 wait complete. 2024-09-19T09:41:24.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.394+0000 7fedfced4640 1 Processor -- start 2024-09-19T09:41:24.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.394+0000 7fedfced4640 1 -- start start 2024-09-19T09:41:24.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.394+0000 7fedfced4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedf80fb810 0x7fedf8115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:24.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.394+0000 7fedfced4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fedf80fcf80 0x7fedf8115970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:24.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.394+0000 7fedfced4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8115f70 con 0x7fedf80fb810 2024-09-19T09:41:24.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.394+0000 7fedfced4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf810f380 con 0x7fedf80fcf80 2024-09-19T09:41:24.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.395+0000 7fedf659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedf80fb810 0x7fedf8115430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:24.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.395+0000 7fedf659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedf80fb810 0x7fedf8115430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48254/0 (socket says 172.21.15.112:48254) 2024-09-19T09:41:24.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.395+0000 7fedf659c640 1 -- 172.21.15.112:0/3126983462 learned_addr learned my addr 172.21.15.112:0/3126983462 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:41:24.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.395+0000 7fedf659c640 1 -- 172.21.15.112:0/3126983462 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fedf80fcf80 msgr2=0x7fedf8115970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:24.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.395+0000 7fedf659c640 1 --2- 172.21.15.112:0/3126983462 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fedf80fcf80 0x7fedf8115970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.395+0000 7fedf659c640 1 -- 172.21.15.112:0/3126983462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede0005040 con 0x7fedf80fb810 2024-09-19T09:41:24.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.395+0000 7fedf659c640 1 --2- 172.21.15.112:0/3126983462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedf80fb810 0x7fedf8115430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fede8002a50 tx=0x7fede8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:24.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.395+0000 7fedef7fe640 1 -- 172.21.15.112:0/3126983462 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede8007c30 con 0x7fedf80fb810 2024-09-19T09:41:24.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.395+0000 7fedef7fe640 1 -- 172.21.15.112:0/3126983462 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fede800f040 con 0x7fedf80fb810 2024-09-19T09:41:24.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.395+0000 7fedef7fe640 1 -- 172.21.15.112:0/3126983462 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede800da90 con 0x7fedf80fb810 2024-09-19T09:41:24.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.395+0000 7fedfced4640 1 -- 172.21.15.112:0/3126983462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf810f660 con 0x7fedf80fb810 2024-09-19T09:41:24.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.395+0000 7fedfced4640 1 -- 172.21.15.112:0/3126983462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf810fb80 con 0x7fedf80fb810 2024-09-19T09:41:24.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.396+0000 7fedfced4640 1 -- 172.21.15.112:0/3126983462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf80fcbc0 con 0x7fedf80fb810 2024-09-19T09:41:24.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.397+0000 7fedef7fe640 1 -- 172.21.15.112:0/3126983462 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fede800dd00 con 0x7fedf80fb810 2024-09-19T09:41:24.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.397+0000 7fedef7fe640 1 --2- 172.21.15.112:0/3126983462 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fede406e530 0x7fede40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:24.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.397+0000 7fedef7fe640 1 -- 172.21.15.112:0/3126983462 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fede808d9d0 con 0x7fedf80fb810 2024-09-19T09:41:24.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.397+0000 7fededd9b640 1 --2- 172.21.15.112:0/3126983462 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fede406e530 0x7fede40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:24.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.398+0000 7fededd9b640 1 --2- 172.21.15.112:0/3126983462 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fede406e530 0x7fede40709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fede002a530 tx=0x7fede0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:24.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.402+0000 7fedef7fe640 1 -- 172.21.15.112:0/3126983462 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fede8056b60 con 0x7fedf80fb810 2024-09-19T09:41:24.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.589+0000 7fedfced4640 1 -- 172.21.15.112:0/3126983462 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fedf804b7c0 con 0x7fede406e530 2024-09-19T09:41:24.591 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:24 smithi112 ceph-mon[97503]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:24.591 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:24 smithi112 ceph-mon[97503]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:24.591 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:24 smithi112 ceph-mon[97503]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:24.591 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:24 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/1659938249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:41:24.591 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:24 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/4021584918' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:41:24.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.590+0000 7fedef7fe640 1 -- 172.21.15.112:0/3126983462 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fede0008ee0 con 0x7fede406e530 2024-09-19T09:41:24.592 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:41:24.592 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:41:24.592 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:41:24.592 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:41:24.592 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-19T09:41:24.592 INFO:teuthology.orchestra.run.smithi112.stdout: "mon", 2024-09-19T09:41:24.592 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-19T09:41:24.592 INFO:teuthology.orchestra.run.smithi112.stdout: "crash" 2024-09-19T09:41:24.592 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-19T09:41:24.593 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "8/21 daemons upgraded", 2024-09-19T09:41:24.593 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T09:41:24.593 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:41:24.593 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:41:24.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.592+0000 7fedfced4640 1 -- 172.21.15.112:0/3126983462 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fede406e530 msgr2=0x7fede40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:24.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.592+0000 7fedfced4640 1 --2- 172.21.15.112:0/3126983462 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fede406e530 0x7fede40709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fede002a530 tx=0x7fede0009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.592+0000 7fedfced4640 1 -- 172.21.15.112:0/3126983462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedf80fb810 msgr2=0x7fedf8115430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:24.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.592+0000 7fedfced4640 1 --2- 172.21.15.112:0/3126983462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedf80fb810 0x7fedf8115430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fede8002a50 tx=0x7fede8004600 comp rx=0 tx=0).stop 2024-09-19T09:41:24.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.592+0000 7fedfced4640 1 -- 172.21.15.112:0/3126983462 shutdown_connections 2024-09-19T09:41:24.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.592+0000 7fedfced4640 1 --2- 172.21.15.112:0/3126983462 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fede406e530 0x7fede40709e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.592+0000 7fedfced4640 1 --2- 172.21.15.112:0/3126983462 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fedf80fcf80 0x7fedf8115970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.592+0000 7fedfced4640 1 --2- 172.21.15.112:0/3126983462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedf80fb810 0x7fedf8115430 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.592+0000 7fedfced4640 1 -- 172.21.15.112:0/3126983462 >> 172.21.15.112:0/3126983462 conn(0x7fedf80723b0 msgr2=0x7fedf8065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:24.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.592+0000 7fedfced4640 1 -- 172.21.15.112:0/3126983462 shutdown_connections 2024-09-19T09:41:24.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.592+0000 7fedfced4640 1 -- 172.21.15.112:0/3126983462 wait complete. 2024-09-19T09:41:24.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.681+0000 7f4590ead640 1 -- 172.21.15.112:0/2970783953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0fd530 msgr2=0x7f458c0fd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:24.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.681+0000 7f4590ead640 1 --2- 172.21.15.112:0/2970783953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0fd530 0x7f458c0fd900 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f457c004900 tx=0x7f457c009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.682+0000 7f4590ead640 1 -- 172.21.15.112:0/2970783953 shutdown_connections 2024-09-19T09:41:24.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.682+0000 7f4590ead640 1 --2- 172.21.15.112:0/2970783953 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c0fded0 0x7f458c1065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.682+0000 7f4590ead640 1 --2- 172.21.15.112:0/2970783953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0fd530 0x7f458c0fd900 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.682+0000 7f4590ead640 1 -- 172.21.15.112:0/2970783953 >> 172.21.15.112:0/2970783953 conn(0x7f458c0f7030 msgr2=0x7f458c0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:24.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.682+0000 7f4590ead640 1 -- 172.21.15.112:0/2970783953 shutdown_connections 2024-09-19T09:41:24.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.682+0000 7f4590ead640 1 -- 172.21.15.112:0/2970783953 wait complete. 2024-09-19T09:41:24.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.682+0000 7f4590ead640 1 Processor -- start 2024-09-19T09:41:24.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.682+0000 7f4590ead640 1 -- start start 2024-09-19T09:41:24.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.683+0000 7f4590ead640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c0fd530 0x7f458c0fb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:24.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.683+0000 7f4590ead640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0fded0 0x7f458c0fb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:24.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.683+0000 7f4590ead640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0fbe70 con 0x7f458c0fded0 2024-09-19T09:41:24.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.683+0000 7f4590ead640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0fbfe0 con 0x7f458c0fd530 2024-09-19T09:41:24.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.683+0000 7f4583fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0fded0 0x7f458c0fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:24.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.683+0000 7f458a59c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c0fd530 0x7f458c0fb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:24.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.683+0000 7f4583fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0fded0 0x7f458c0fb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48276/0 (socket says 172.21.15.112:48276) 2024-09-19T09:41:24.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.683+0000 7f4583fff640 1 -- 172.21.15.112:0/3579298838 learned_addr learned my addr 172.21.15.112:0/3579298838 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:41:24.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.683+0000 7f4583fff640 1 -- 172.21.15.112:0/3579298838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c0fd530 msgr2=0x7f458c0fb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:24.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.683+0000 7f4583fff640 1 --2- 172.21.15.112:0/3579298838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c0fd530 0x7f458c0fb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.683+0000 7f4583fff640 1 -- 172.21.15.112:0/3579298838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c005040 con 0x7f458c0fded0 2024-09-19T09:41:24.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.683+0000 7f458a59c640 1 --2- 172.21.15.112:0/3579298838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c0fd530 0x7f458c0fb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:24.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.684+0000 7f4583fff640 1 --2- 172.21.15.112:0/3579298838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0fded0 0x7f458c0fb930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4574002a50 tx=0x7f4574004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:24.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.684+0000 7f4582ffd640 1 -- 172.21.15.112:0/3579298838 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4574007c30 con 0x7f458c0fded0 2024-09-19T09:41:24.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.684+0000 7f4582ffd640 1 -- 172.21.15.112:0/3579298838 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f457400f040 con 0x7f458c0fded0 2024-09-19T09:41:24.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.684+0000 7f4582ffd640 1 -- 172.21.15.112:0/3579298838 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f457400dad0 con 0x7f458c0fded0 2024-09-19T09:41:24.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.684+0000 7f4590ead640 1 -- 172.21.15.112:0/3579298838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458c0fc270 con 0x7f458c0fded0 2024-09-19T09:41:24.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.684+0000 7f4590ead640 1 -- 172.21.15.112:0/3579298838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458c1198c0 con 0x7f458c0fded0 2024-09-19T09:41:24.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.685+0000 7f4590ead640 1 -- 172.21.15.112:0/3579298838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458c066090 con 0x7f458c0fded0 2024-09-19T09:41:24.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.687+0000 7f4582ffd640 1 -- 172.21.15.112:0/3579298838 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f457400dc30 con 0x7f458c0fded0 2024-09-19T09:41:24.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.687+0000 7f4582ffd640 1 --2- 172.21.15.112:0/3579298838 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f457806e530 0x7f45780709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:24.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.687+0000 7f4582ffd640 1 -- 172.21.15.112:0/3579298838 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f457408e500 con 0x7f458c0fded0 2024-09-19T09:41:24.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.687+0000 7f458a59c640 1 --2- 172.21.15.112:0/3579298838 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f457806e530 0x7f45780709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:24.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.688+0000 7f458a59c640 1 --2- 172.21.15.112:0/3579298838 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f457806e530 0x7f45780709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f457c000c00 tx=0x7f457c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:24.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.690+0000 7f4582ffd640 1 -- 172.21.15.112:0/3579298838 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f45740577b0 con 0x7f458c0fded0 2024-09-19T09:41:24.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:24 smithi191 ceph-mon[77624]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:24.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:24 smithi191 ceph-mon[77624]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:24.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:24 smithi191 ceph-mon[77624]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:24.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:24 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/1659938249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:41:24.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:24 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/4021584918' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:41:24.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.942+0000 7f4590ead640 1 -- 172.21.15.112:0/3579298838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f458c0fac30 con 0x7f458c0fded0 2024-09-19T09:41:24.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.942+0000 7f4582ffd640 1 -- 172.21.15.112:0/3579298838 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+884 (secure 0 0 0) 0x7f457405ae70 con 0x7f458c0fded0 2024-09-19T09:41:24.944 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 31/225 objects degraded (13.778%), 11 pgs degraded 2024-09-19T09:41:24.944 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-19T09:41:24.944 INFO:teuthology.orchestra.run.smithi112.stdout: osd.2 (root=default,host=smithi112) is down 2024-09-19T09:41:24.944 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 31/225 objects degraded (13.778%), 11 pgs degraded 2024-09-19T09:41:24.945 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-19T09:41:24.945 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-19T09:41:24.945 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-19T09:41:24.945 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-19T09:41:24.945 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-19T09:41:24.945 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-19T09:41:24.945 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-19T09:41:24.945 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-19T09:41:24.945 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-19T09:41:24.945 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-19T09:41:24.945 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-19T09:41:24.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.944+0000 7f4590ead640 1 -- 172.21.15.112:0/3579298838 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f457806e530 msgr2=0x7f45780709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:24.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.944+0000 7f4590ead640 1 --2- 172.21.15.112:0/3579298838 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f457806e530 0x7f45780709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f457c000c00 tx=0x7f457c035040 comp rx=0 tx=0).stop 2024-09-19T09:41:24.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.944+0000 7f4590ead640 1 -- 172.21.15.112:0/3579298838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0fded0 msgr2=0x7f458c0fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:24.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.944+0000 7f4590ead640 1 --2- 172.21.15.112:0/3579298838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0fded0 0x7f458c0fb930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4574002a50 tx=0x7f4574004600 comp rx=0 tx=0).stop 2024-09-19T09:41:24.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.945+0000 7f4590ead640 1 -- 172.21.15.112:0/3579298838 shutdown_connections 2024-09-19T09:41:24.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.945+0000 7f4590ead640 1 --2- 172.21.15.112:0/3579298838 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f457806e530 0x7f45780709e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.945+0000 7f4590ead640 1 --2- 172.21.15.112:0/3579298838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0fded0 0x7f458c0fb930 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.945+0000 7f4590ead640 1 --2- 172.21.15.112:0/3579298838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c0fd530 0x7f458c0fb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:24.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.945+0000 7f4590ead640 1 -- 172.21.15.112:0/3579298838 >> 172.21.15.112:0/3579298838 conn(0x7f458c0f7030 msgr2=0x7f458c0f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:24.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.945+0000 7f4590ead640 1 -- 172.21.15.112:0/3579298838 shutdown_connections 2024-09-19T09:41:24.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:24.945+0000 7f4590ead640 1 -- 172.21.15.112:0/3579298838 wait complete. 2024-09-19T09:41:26.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:25 smithi112 ceph-mon[97503]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:25 smithi112 ceph-mon[97503]: pgmap v90: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/225 objects degraded (13.778%) 2024-09-19T09:41:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:41:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:25 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3579298838' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:41:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:25 smithi191 ceph-mon[77624]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:25 smithi191 ceph-mon[77624]: pgmap v90: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/225 objects degraded (13.778%) 2024-09-19T09:41:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:41:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:25 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3579298838' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:41:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:27.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:27 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:27.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:27 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:27.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:27 smithi112 ceph-mon[97503]: pgmap v91: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/225 objects degraded (13.778%) 2024-09-19T09:41:27.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:27 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:27.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:27 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:27.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:27 smithi191 ceph-mon[77624]: pgmap v91: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/225 objects degraded (13.778%) 2024-09-19T09:41:28.184 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:27 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2[119900]: 2024-09-19T09:41:27.915+0000 7f259ecf7640 -1 osd.2 58 log_to_monitors true 2024-09-19T09:41:28.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:28 smithi112 ceph-mon[97503]: from='osd.2 [v2:172.21.15.112:6818/3850906033,v1:172.21.15.112:6819/3850906033]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:41:28.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:28 smithi191 ceph-mon[77624]: from='osd.2 [v2:172.21.15.112:6818/3850906033,v1:172.21.15.112:6819/3850906033]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:41:29.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:29 smithi112 ceph-mon[97503]: from='osd.2 [v2:172.21.15.112:6818/3850906033,v1:172.21.15.112:6819/3850906033]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:41:29.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:29 smithi112 ceph-mon[97503]: osdmap e61: 6 total, 5 up, 6 in 2024-09-19T09:41:29.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:29 smithi112 ceph-mon[97503]: from='osd.2 [v2:172.21.15.112:6818/3850906033,v1:172.21.15.112:6819/3850906033]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-19T09:41:29.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:29 smithi112 ceph-mon[97503]: Health check update: Degraded data redundancy: 31/225 objects degraded (13.778%), 11 pgs degraded (PG_DEGRADED) 2024-09-19T09:41:29.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:29 smithi112 ceph-mon[97503]: pgmap v93: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 31/225 objects degraded (13.778%) 2024-09-19T09:41:29.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:29 smithi112 ceph-mon[97503]: from='osd.2 [v2:172.21.15.112:6818/3850906033,v1:172.21.15.112:6819/3850906033]' entity='osd.2' 2024-09-19T09:41:29.414 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:41:29 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2[119900]: 2024-09-19T09:41:29.100+0000 7f2592a89640 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:41:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:29 smithi191 ceph-mon[77624]: from='osd.2 [v2:172.21.15.112:6818/3850906033,v1:172.21.15.112:6819/3850906033]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:41:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:29 smithi191 ceph-mon[77624]: osdmap e61: 6 total, 5 up, 6 in 2024-09-19T09:41:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:29 smithi191 ceph-mon[77624]: from='osd.2 [v2:172.21.15.112:6818/3850906033,v1:172.21.15.112:6819/3850906033]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-19T09:41:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:29 smithi191 ceph-mon[77624]: Health check update: Degraded data redundancy: 31/225 objects degraded (13.778%), 11 pgs degraded (PG_DEGRADED) 2024-09-19T09:41:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:29 smithi191 ceph-mon[77624]: pgmap v93: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 31/225 objects degraded (13.778%) 2024-09-19T09:41:29.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:29 smithi191 ceph-mon[77624]: from='osd.2 [v2:172.21.15.112:6818/3850906033,v1:172.21.15.112:6819/3850906033]' entity='osd.2' 2024-09-19T09:41:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:41:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:41:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:41:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:41:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:41:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:41:31.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:41:31.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:41:31.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-19T09:41:31.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:41:31.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: osd.2 [v2:172.21.15.112:6818/3850906033,v1:172.21.15.112:6819/3850906033] boot 2024-09-19T09:41:31.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: osdmap e62: 6 total, 6 up, 6 in 2024-09-19T09:41:31.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:41:31.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:31.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:31.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:41:31.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:41:31.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:31.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:41:31.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:41:31.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:41:31.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:41:31.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:41:31.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:41:31.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-19T09:41:31.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:41:31.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: osd.2 [v2:172.21.15.112:6818/3850906033,v1:172.21.15.112:6819/3850906033] boot 2024-09-19T09:41:31.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: osdmap e62: 6 total, 6 up, 6 in 2024-09-19T09:41:31.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:41:32.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:31 smithi191 ceph-mon[77624]: pgmap v95: 65 pgs: 10 peering, 10 active+undersized, 7 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 24/225 objects degraded (10.667%) 2024-09-19T09:41:32.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:31 smithi191 ceph-mon[77624]: osdmap e63: 6 total, 6 up, 6 in 2024-09-19T09:41:32.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:31 smithi112 ceph-mon[97503]: pgmap v95: 65 pgs: 10 peering, 10 active+undersized, 7 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 24/225 objects degraded (10.667%) 2024-09-19T09:41:32.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:31 smithi112 ceph-mon[97503]: osdmap e63: 6 total, 6 up, 6 in 2024-09-19T09:41:34.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:33 smithi112 ceph-mon[97503]: pgmap v97: 65 pgs: 10 peering, 8 active+undersized, 6 active+undersized+degraded, 41 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 21/225 objects degraded (9.333%) 2024-09-19T09:41:34.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:33 smithi112 ceph-mon[97503]: Health check update: Degraded data redundancy: 21/225 objects degraded (9.333%), 6 pgs degraded (PG_DEGRADED) 2024-09-19T09:41:34.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:33 smithi191 ceph-mon[77624]: pgmap v97: 65 pgs: 10 peering, 8 active+undersized, 6 active+undersized+degraded, 41 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 21/225 objects degraded (9.333%) 2024-09-19T09:41:34.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:33 smithi191 ceph-mon[77624]: Health check update: Degraded data redundancy: 21/225 objects degraded (9.333%), 6 pgs degraded (PG_DEGRADED) 2024-09-19T09:41:35.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:34 smithi112 ceph-mon[97503]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/225 objects degraded (9.333%), 6 pgs degraded) 2024-09-19T09:41:35.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:34 smithi112 ceph-mon[97503]: Cluster is now healthy 2024-09-19T09:41:35.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:34 smithi191 ceph-mon[77624]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/225 objects degraded (9.333%), 6 pgs degraded) 2024-09-19T09:41:35.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:34 smithi191 ceph-mon[77624]: Cluster is now healthy 2024-09-19T09:41:36.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:35 smithi112 ceph-mon[97503]: pgmap v98: 65 pgs: 10 peering, 55 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 774 B/s rd, 1 op/s 2024-09-19T09:41:36.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:35 smithi191 ceph-mon[77624]: pgmap v98: 65 pgs: 10 peering, 55 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 774 B/s rd, 1 op/s 2024-09-19T09:41:38.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:37 smithi112 ceph-mon[97503]: pgmap v99: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-19T09:41:38.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:37 smithi191 ceph-mon[77624]: pgmap v99: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-19T09:41:39.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:39 smithi112 ceph-mon[97503]: pgmap v100: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T09:41:39.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:39 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:39.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:39 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:41:40.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:39 smithi191 ceph-mon[77624]: pgmap v100: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T09:41:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:39 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:39 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:41:42.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:41 smithi112 ceph-mon[97503]: pgmap v101: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-19T09:41:42.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:41 smithi191 ceph-mon[77624]: pgmap v101: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-19T09:41:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:43 smithi112 ceph-mon[97503]: pgmap v102: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 874 B/s rd, 1 op/s 2024-09-19T09:41:44.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:43 smithi191 ceph-mon[77624]: pgmap v102: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 874 B/s rd, 1 op/s 2024-09-19T09:41:46.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:45 smithi112 ceph-mon[97503]: pgmap v103: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:41:46.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:45 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:46.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:45 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:41:46.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:45 smithi112 ceph-mon[97503]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:41:46.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:45 smithi112 ceph-mon[97503]: Upgrade: osd.3 is safe to restart 2024-09-19T09:41:46.237 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:45 smithi191 ceph-mon[77624]: pgmap v103: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:41:46.237 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:45 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:46.237 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:45 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:41:46.237 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:45 smithi191 ceph-mon[77624]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:41:46.237 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:45 smithi191 ceph-mon[77624]: Upgrade: osd.3 is safe to restart 2024-09-19T09:41:47.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:47 smithi191 ceph-mon[77624]: Upgrade: Updating osd.3 2024-09-19T09:41:47.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:47 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:47.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:47 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:41:47.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:47 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:41:47.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:47 smithi191 ceph-mon[77624]: Deploying daemon osd.3 on smithi191 2024-09-19T09:41:47.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:47 smithi191 ceph-mon[77624]: pgmap v104: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:41:47.645 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:47 smithi112 ceph-mon[97503]: Upgrade: Updating osd.3 2024-09-19T09:41:47.645 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:47 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:47.646 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:47 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:41:47.646 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:47 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:41:47.646 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:47 smithi112 ceph-mon[97503]: Deploying daemon osd.3 on smithi191 2024-09-19T09:41:47.646 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:47 smithi112 ceph-mon[97503]: pgmap v104: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:41:49.353 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:49 smithi191 systemd[1]: Stopping Ceph osd.3 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:41:49.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:49 smithi191 ceph-mon[77624]: pgmap v105: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:41:49.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:49 smithi191 ceph-mon[77624]: osd.3 marked itself down and dead 2024-09-19T09:41:49.785 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:49 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3[40258]: 2024-09-19T09:41:49.350+0000 7f743f6f2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:41:49.785 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:49 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3[40258]: 2024-09-19T09:41:49.350+0000 7f743f6f2640 -1 osd.3 63 *** Got signal Terminated *** 2024-09-19T09:41:49.785 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:49 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3[40258]: 2024-09-19T09:41:49.350+0000 7f743f6f2640 -1 osd.3 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:41:49.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:49 smithi112 ceph-mon[97503]: pgmap v105: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:41:49.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:49 smithi112 ceph-mon[97503]: osd.3 marked itself down and dead 2024-09-19T09:41:50.395 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:50 smithi191 podman[86849]: 2024-09-19 09:41:50.087052156 +0000 UTC m=+0.842138739 container died c74489fb67f393ef167caf39e501c141f94bbacd97291b790eaedabac2712089 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=quincy-6e06d1e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:41:50.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:50 smithi112 ceph-mon[97503]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:41:50.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:50 smithi112 ceph-mon[97503]: osdmap e64: 6 total, 5 up, 6 in 2024-09-19T09:41:50.784 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:50 smithi191 ceph-mon[77624]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:41:50.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:50 smithi191 ceph-mon[77624]: osdmap e64: 6 total, 5 up, 6 in 2024-09-19T09:41:50.785 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:50 smithi191 podman[86849]: 2024-09-19 09:41:50.39334671 +0000 UTC m=+1.148433286 container cleanup c74489fb67f393ef167caf39e501c141f94bbacd97291b790eaedabac2712089 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=quincy-6e06d1e, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:41:50.785 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:50 smithi191 bash[86849]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3 2024-09-19T09:41:50.785 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:50 smithi191 podman[86868]: 2024-09-19 09:41:50.62012909 +0000 UTC m=+0.530469950 container remove c74489fb67f393ef167caf39e501c141f94bbacd97291b790eaedabac2712089 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=quincy-6e06d1e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T09:41:51.233 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:50 smithi191 podman[86967]: 2024-09-19 09:41:50.882917367 +0000 UTC m=+0.016780236 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:41:51.233 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:50 smithi191 podman[86967]: 2024-09-19 09:41:50.987683388 +0000 UTC m=+0.121546244 container create a94a39abb1c48e4d14ed4a79c0159e53c1f2f2350361ee14c80c075eb60d6c23 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T09:41:51.233 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:51 smithi191 podman[86967]: 2024-09-19 09:41:51.231795664 +0000 UTC m=+0.365658534 container init a94a39abb1c48e4d14ed4a79c0159e53c1f2f2350361ee14c80c075eb60d6c23 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T09:41:51.535 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:51 smithi191 podman[86967]: 2024-09-19 09:41:51.236838541 +0000 UTC m=+0.370701399 container start a94a39abb1c48e4d14ed4a79c0159e53c1f2f2350361ee14c80c075eb60d6c23 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T09:41:51.535 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:51 smithi191 podman[86967]: 2024-09-19 09:41:51.382154402 +0000 UTC m=+0.516017272 container attach a94a39abb1c48e4d14ed4a79c0159e53c1f2f2350361ee14c80c075eb60d6c23 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T09:41:51.535 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:51 smithi191 podman[86967]: 2024-09-19 09:41:51.43876556 +0000 UTC m=+0.572628415 container died a94a39abb1c48e4d14ed4a79c0159e53c1f2f2350361ee14c80c075eb60d6c23 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:41:51.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:51 smithi112 ceph-mon[97503]: osdmap e65: 6 total, 5 up, 6 in 2024-09-19T09:41:51.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:51 smithi112 ceph-mon[97503]: pgmap v108: 65 pgs: 11 active+undersized, 6 stale+active+clean, 7 active+undersized+degraded, 41 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 23/225 objects degraded (10.222%) 2024-09-19T09:41:51.991 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:51 smithi191 ceph-mon[77624]: osdmap e65: 6 total, 5 up, 6 in 2024-09-19T09:41:51.991 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:51 smithi191 ceph-mon[77624]: pgmap v108: 65 pgs: 11 active+undersized, 6 stale+active+clean, 7 active+undersized+degraded, 41 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 23/225 objects degraded (10.222%) 2024-09-19T09:41:52.269 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:52 smithi191 podman[86992]: 2024-09-19 09:41:52.044276837 +0000 UTC m=+0.599308525 container remove a94a39abb1c48e4d14ed4a79c0159e53c1f2f2350361ee14c80c075eb60d6c23 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T09:41:52.269 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:52 smithi191 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-19T09:41:52.269 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:52 smithi191 systemd[1]: Stopped Ceph osd.3 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:41:52.269 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:52 smithi191 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 9.626s CPU time. 2024-09-19T09:41:52.535 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:52 smithi191 systemd[1]: Starting Ceph osd.3 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:41:52.535 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:52 smithi191 podman[87091]: 2024-09-19 09:41:52.379570138 +0000 UTC m=+0.015463723 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:41:52.535 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:52 smithi191 podman[87091]: 2024-09-19 09:41:52.487252777 +0000 UTC m=+0.123146391 container create edc48ef8eca110613b5d8505a2701901192c4d6c3a33caf020bd6a9042a2b2c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:41:52.865 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:52 smithi191 ceph-mon[77624]: Health check failed: Degraded data redundancy: 23/225 objects degraded (10.222%), 7 pgs degraded (PG_DEGRADED) 2024-09-19T09:41:52.866 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:52 smithi191 podman[87091]: 2024-09-19 09:41:52.781767192 +0000 UTC m=+0.417660773 container init edc48ef8eca110613b5d8505a2701901192c4d6c3a33caf020bd6a9042a2b2c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T09:41:52.866 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:52 smithi191 podman[87091]: 2024-09-19 09:41:52.785127913 +0000 UTC m=+0.421021487 container start edc48ef8eca110613b5d8505a2701901192c4d6c3a33caf020bd6a9042a2b2c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-activate, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:41:52.866 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:52 smithi191 podman[87091]: 2024-09-19 09:41:52.864927544 +0000 UTC m=+0.500821127 container attach edc48ef8eca110613b5d8505a2701901192c4d6c3a33caf020bd6a9042a2b2c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T09:41:52.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:52 smithi112 ceph-mon[97503]: Health check failed: Degraded data redundancy: 23/225 objects degraded (10.222%), 7 pgs degraded (PG_DEGRADED) 2024-09-19T09:41:53.285 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:52 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-activate[87106]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:41:53.285 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:52 smithi191 bash[87091]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:41:53.285 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:52 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-activate[87106]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:41:53.285 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:52 smithi191 bash[87091]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:41:53.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:53 smithi112 ceph-mon[97503]: pgmap v109: 65 pgs: 15 active+undersized, 4 stale+active+clean, 12 active+undersized+degraded, 34 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 36/225 objects degraded (16.000%) 2024-09-19T09:41:53.948 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:53 smithi191 ceph-mon[77624]: pgmap v109: 65 pgs: 15 active+undersized, 4 stale+active+clean, 12 active+undersized+degraded, 34 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 36/225 objects degraded (16.000%) 2024-09-19T09:41:53.948 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:53 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-activate[87106]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T09:41:53.948 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:53 smithi191 bash[87091]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T09:41:53.948 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:53 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-activate[87106]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-19T09:41:53.948 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:53 smithi191 bash[87091]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-19T09:41:54.269 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:53 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-activate[87106]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-19T09:41:54.269 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:53 smithi191 bash[87091]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-19T09:41:54.269 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:53 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-activate[87106]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-19T09:41:54.270 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:53 smithi191 bash[87091]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-19T09:41:54.270 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:53 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-activate[87106]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-19T09:41:54.270 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:53 smithi191 bash[87091]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-19T09:41:54.270 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:53 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-activate[87106]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T09:41:54.270 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:53 smithi191 bash[87091]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T09:41:54.270 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:53 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-activate[87106]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-19T09:41:54.270 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:53 smithi191 bash[87091]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-19T09:41:54.271 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:53 smithi191 podman[87091]: 2024-09-19 09:41:53.975452752 +0000 UTC m=+1.611346327 container died edc48ef8eca110613b5d8505a2701901192c4d6c3a33caf020bd6a9042a2b2c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T09:41:54.784 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:54 smithi191 podman[87251]: 2024-09-19 09:41:54.527288326 +0000 UTC m=+0.541242038 container remove edc48ef8eca110613b5d8505a2701901192c4d6c3a33caf020bd6a9042a2b2c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T09:41:54.785 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:54 smithi191 podman[87309]: 2024-09-19 09:41:54.63388426 +0000 UTC m=+0.015528762 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:41:54.785 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:54 smithi191 podman[87309]: 2024-09-19 09:41:54.736422356 +0000 UTC m=+0.118066848 container create 7f953c69160832b245eb2da1ddb2167ce05e7fbb4c3fb2b4cb6fc1d4aafb7815 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:41:55.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.037+0000 7f39db8e5640 1 -- 172.21.15.112:0/2222167249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fb810 msgr2=0x7f39d40fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.037+0000 7f39db8e5640 1 --2- 172.21.15.112:0/2222167249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fb810 0x7f39d40fbbe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f39d00048d0 tx=0x7f39d0009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.037+0000 7f39db8e5640 1 -- 172.21.15.112:0/2222167249 shutdown_connections 2024-09-19T09:41:55.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.037+0000 7f39db8e5640 1 --2- 172.21.15.112:0/2222167249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39d40fcf80 0x7f39d40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.037+0000 7f39db8e5640 1 --2- 172.21.15.112:0/2222167249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fb810 0x7f39d40fbbe0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.037+0000 7f39db8e5640 1 -- 172.21.15.112:0/2222167249 >> 172.21.15.112:0/2222167249 conn(0x7f39d40723b0 msgr2=0x7f39d40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:55.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.037+0000 7f39db8e5640 1 -- 172.21.15.112:0/2222167249 shutdown_connections 2024-09-19T09:41:55.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.037+0000 7f39db8e5640 1 -- 172.21.15.112:0/2222167249 wait complete. 2024-09-19T09:41:55.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.038+0000 7f39db8e5640 1 Processor -- start 2024-09-19T09:41:55.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.038+0000 7f39db8e5640 1 -- start start 2024-09-19T09:41:55.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.038+0000 7f39db8e5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39d40fb810 0x7f39d410bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.038+0000 7f39db8e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fcf80 0x7f39d410c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.038+0000 7f39db8e5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d410ca20 con 0x7f39d40fcf80 2024-09-19T09:41:55.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.038+0000 7f39db8e5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d410cb60 con 0x7f39d40fb810 2024-09-19T09:41:55.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.038+0000 7f39d8e80640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fcf80 0x7f39d410c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.038+0000 7f39d8e80640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fcf80 0x7f39d410c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45640/0 (socket says 172.21.15.112:45640) 2024-09-19T09:41:55.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.038+0000 7f39d8e80640 1 -- 172.21.15.112:0/981594051 learned_addr learned my addr 172.21.15.112:0/981594051 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:41:55.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.038+0000 7f39d9681640 1 --2- 172.21.15.112:0/981594051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39d40fb810 0x7f39d410bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.039+0000 7f39d8e80640 1 -- 172.21.15.112:0/981594051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39d40fb810 msgr2=0x7f39d410bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.039+0000 7f39d8e80640 1 --2- 172.21.15.112:0/981594051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39d40fb810 0x7f39d410bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.039+0000 7f39d8e80640 1 -- 172.21.15.112:0/981594051 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d0005040 con 0x7f39d40fcf80 2024-09-19T09:41:55.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.039+0000 7f39d8e80640 1 --2- 172.21.15.112:0/981594051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fcf80 0x7f39d410c4e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39c4002a50 tx=0x7f39c4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:55.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.039+0000 7f39c9ffb640 1 -- 172.21.15.112:0/981594051 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c4007c30 con 0x7f39d40fcf80 2024-09-19T09:41:55.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.039+0000 7f39c9ffb640 1 -- 172.21.15.112:0/981594051 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f39c400f040 con 0x7f39d40fcf80 2024-09-19T09:41:55.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.039+0000 7f39db8e5640 1 -- 172.21.15.112:0/981594051 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d4119610 con 0x7f39d40fcf80 2024-09-19T09:41:55.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.039+0000 7f39c9ffb640 1 -- 172.21.15.112:0/981594051 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c400da10 con 0x7f39d40fcf80 2024-09-19T09:41:55.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.039+0000 7f39db8e5640 1 -- 172.21.15.112:0/981594051 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d41199c0 con 0x7f39d40fcf80 2024-09-19T09:41:55.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.040+0000 7f39db8e5640 1 -- 172.21.15.112:0/981594051 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d40fcbc0 con 0x7f39d40fcf80 2024-09-19T09:41:55.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.041+0000 7f39c9ffb640 1 -- 172.21.15.112:0/981594051 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f39c400dbb0 con 0x7f39d40fcf80 2024-09-19T09:41:55.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.041+0000 7f39c9ffb640 1 --2- 172.21.15.112:0/981594051 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f39c006e530 0x7f39c00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.041+0000 7f39c9ffb640 1 -- 172.21.15.112:0/981594051 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f39c408d770 con 0x7f39d40fcf80 2024-09-19T09:41:55.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.041+0000 7f39d9681640 1 --2- 172.21.15.112:0/981594051 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f39c006e530 0x7f39c00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.042+0000 7f39d9681640 1 --2- 172.21.15.112:0/981594051 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f39c006e530 0x7f39c00709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009ac0 tx=0x7f39d0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:55.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.046+0000 7f39c9ffb640 1 -- 172.21.15.112:0/981594051 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f39c4056a30 con 0x7f39d40fcf80 2024-09-19T09:41:55.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.245+0000 7f39db8e5640 1 -- 172.21.15.112:0/981594051 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39d404b720 con 0x7f39c006e530 2024-09-19T09:41:55.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.246+0000 7f39c9ffb640 1 -- 172.21.15.112:0/981594051 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f39d404b720 con 0x7f39c006e530 2024-09-19T09:41:55.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.248+0000 7f39db8e5640 1 -- 172.21.15.112:0/981594051 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f39c006e530 msgr2=0x7f39c00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.248+0000 7f39db8e5640 1 --2- 172.21.15.112:0/981594051 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f39c006e530 0x7f39c00709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009ac0 tx=0x7f39d0035040 comp rx=0 tx=0).stop 2024-09-19T09:41:55.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.248+0000 7f39db8e5640 1 -- 172.21.15.112:0/981594051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fcf80 msgr2=0x7f39d410c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.248+0000 7f39db8e5640 1 --2- 172.21.15.112:0/981594051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fcf80 0x7f39d410c4e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39c4002a50 tx=0x7f39c4004600 comp rx=0 tx=0).stop 2024-09-19T09:41:55.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.248+0000 7f39db8e5640 1 -- 172.21.15.112:0/981594051 shutdown_connections 2024-09-19T09:41:55.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.248+0000 7f39db8e5640 1 --2- 172.21.15.112:0/981594051 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f39c006e530 0x7f39c00709e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.248+0000 7f39db8e5640 1 --2- 172.21.15.112:0/981594051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d40fcf80 0x7f39d410c4e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.248+0000 7f39db8e5640 1 --2- 172.21.15.112:0/981594051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39d40fb810 0x7f39d410bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.248+0000 7f39db8e5640 1 -- 172.21.15.112:0/981594051 >> 172.21.15.112:0/981594051 conn(0x7f39d40723b0 msgr2=0x7f39d40fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:55.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.248+0000 7f39db8e5640 1 -- 172.21.15.112:0/981594051 shutdown_connections 2024-09-19T09:41:55.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.248+0000 7f39db8e5640 1 -- 172.21.15.112:0/981594051 wait complete. 2024-09-19T09:41:55.259 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:41:55.284 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:54 smithi191 podman[87309]: 2024-09-19 09:41:54.95566156 +0000 UTC m=+0.337306059 container init 7f953c69160832b245eb2da1ddb2167ce05e7fbb4c3fb2b4cb6fc1d4aafb7815 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T09:41:55.285 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:54 smithi191 podman[87309]: 2024-09-19 09:41:54.959043908 +0000 UTC m=+0.340688407 container start 7f953c69160832b245eb2da1ddb2167ce05e7fbb4c3fb2b4cb6fc1d4aafb7815 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T09:41:55.285 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:54 smithi191 ceph-osd[87328]: -- 172.21.15.191:0/534149231 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f54050c1e0 con 0x55f54050a000 2024-09-19T09:41:55.285 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:55 smithi191 bash[87309]: 7f953c69160832b245eb2da1ddb2167ce05e7fbb4c3fb2b4cb6fc1d4aafb7815 2024-09-19T09:41:55.285 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:55 smithi191 systemd[1]: Started Ceph osd.3 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:41:55.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.327+0000 7f2220b25640 1 -- 172.21.15.112:0/775612468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f221c102ef0 msgr2=0x7f221c0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.327+0000 7f2220b25640 1 --2- 172.21.15.112:0/775612468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f221c102ef0 0x7f221c0fc5b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f22100048d0 tx=0x7f2210009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.327+0000 7f2220b25640 1 -- 172.21.15.112:0/775612468 shutdown_connections 2024-09-19T09:41:55.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.327+0000 7f2220b25640 1 --2- 172.21.15.112:0/775612468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f221c102ef0 0x7f221c0fc5b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.327+0000 7f2220b25640 1 --2- 172.21.15.112:0/775612468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221c102550 0x7f221c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.327+0000 7f2220b25640 1 -- 172.21.15.112:0/775612468 >> 172.21.15.112:0/775612468 conn(0x7f221c0f80f0 msgr2=0x7f221c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.327+0000 7f2220b25640 1 -- 172.21.15.112:0/775612468 shutdown_connections 2024-09-19T09:41:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.327+0000 7f2220b25640 1 -- 172.21.15.112:0/775612468 wait complete. 2024-09-19T09:41:55.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.328+0000 7f2220b25640 1 Processor -- start 2024-09-19T09:41:55.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.328+0000 7f2220b25640 1 -- start start 2024-09-19T09:41:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.328+0000 7f2220b25640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221c102550 0x7f221c113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.328+0000 7f2220b25640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f221c102ef0 0x7f221c113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.328+0000 7f2220b25640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1140b0 con 0x7f221c102ef0 2024-09-19T09:41:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.328+0000 7f2220b25640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c10d4c0 con 0x7f221c102550 2024-09-19T09:41:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.328+0000 7f2219d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f221c102ef0 0x7f221c113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.328+0000 7f2219d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f221c102ef0 0x7f221c113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45658/0 (socket says 172.21.15.112:45658) 2024-09-19T09:41:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.328+0000 7f2219d9b640 1 -- 172.21.15.112:0/55876616 learned_addr learned my addr 172.21.15.112:0/55876616 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:41:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.328+0000 7f221a59c640 1 --2- 172.21.15.112:0/55876616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221c102550 0x7f221c113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.329+0000 7f2219d9b640 1 -- 172.21.15.112:0/55876616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221c102550 msgr2=0x7f221c113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.329+0000 7f2219d9b640 1 --2- 172.21.15.112:0/55876616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221c102550 0x7f221c113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.329+0000 7f2219d9b640 1 -- 172.21.15.112:0/55876616 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2210005040 con 0x7f221c102ef0 2024-09-19T09:41:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.329+0000 7f2219d9b640 1 --2- 172.21.15.112:0/55876616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f221c102ef0 0x7f221c113a60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f221002a530 tx=0x7f2210009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.329+0000 7f220affd640 1 -- 172.21.15.112:0/55876616 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2210038070 con 0x7f221c102ef0 2024-09-19T09:41:55.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.329+0000 7f220affd640 1 -- 172.21.15.112:0/55876616 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f221002ade0 con 0x7f221c102ef0 2024-09-19T09:41:55.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.329+0000 7f2220b25640 1 -- 172.21.15.112:0/55876616 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c10d740 con 0x7f221c102ef0 2024-09-19T09:41:55.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.329+0000 7f220affd640 1 -- 172.21.15.112:0/55876616 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f221002c7a0 con 0x7f221c102ef0 2024-09-19T09:41:55.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.329+0000 7f2220b25640 1 -- 172.21.15.112:0/55876616 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c10dc30 con 0x7f221c102ef0 2024-09-19T09:41:55.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.330+0000 7f2220b25640 1 -- 172.21.15.112:0/55876616 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221c0fdcd0 con 0x7f221c102ef0 2024-09-19T09:41:55.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.331+0000 7f220affd640 1 -- 172.21.15.112:0/55876616 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2210030020 con 0x7f221c102ef0 2024-09-19T09:41:55.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.331+0000 7f220affd640 1 --2- 172.21.15.112:0/55876616 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f220406e530 0x7f22040709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.331+0000 7f220affd640 1 -- 172.21.15.112:0/55876616 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f22100ae500 con 0x7f221c102ef0 2024-09-19T09:41:55.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.331+0000 7f221a59c640 1 --2- 172.21.15.112:0/55876616 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f220406e530 0x7f22040709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.332+0000 7f221a59c640 1 --2- 172.21.15.112:0/55876616 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f220406e530 0x7f22040709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f220c009af0 tx=0x7f220c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:55.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.336+0000 7f220affd640 1 -- 172.21.15.112:0/55876616 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2210077690 con 0x7f221c102ef0 2024-09-19T09:41:55.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.519+0000 7f2220b25640 1 -- 172.21.15.112:0/55876616 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f221c109580 con 0x7f220406e530 2024-09-19T09:41:55.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.520+0000 7f220affd640 1 -- 172.21.15.112:0/55876616 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f221c109580 con 0x7f220406e530 2024-09-19T09:41:55.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.522+0000 7f2220b25640 1 -- 172.21.15.112:0/55876616 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f220406e530 msgr2=0x7f22040709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.522+0000 7f2220b25640 1 --2- 172.21.15.112:0/55876616 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f220406e530 0x7f22040709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f220c009af0 tx=0x7f220c00b040 comp rx=0 tx=0).stop 2024-09-19T09:41:55.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.522+0000 7f2220b25640 1 -- 172.21.15.112:0/55876616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f221c102ef0 msgr2=0x7f221c113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.522+0000 7f2220b25640 1 --2- 172.21.15.112:0/55876616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f221c102ef0 0x7f221c113a60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f221002a530 tx=0x7f2210009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.522+0000 7f2220b25640 1 -- 172.21.15.112:0/55876616 shutdown_connections 2024-09-19T09:41:55.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.522+0000 7f2220b25640 1 --2- 172.21.15.112:0/55876616 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f220406e530 0x7f22040709e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.522+0000 7f2220b25640 1 --2- 172.21.15.112:0/55876616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f221c102ef0 0x7f221c113a60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.522+0000 7f2220b25640 1 --2- 172.21.15.112:0/55876616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221c102550 0x7f221c113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.522+0000 7f2220b25640 1 -- 172.21.15.112:0/55876616 >> 172.21.15.112:0/55876616 conn(0x7f221c0f80f0 msgr2=0x7f221c0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:55.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.522+0000 7f2220b25640 1 -- 172.21.15.112:0/55876616 shutdown_connections 2024-09-19T09:41:55.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.522+0000 7f2220b25640 1 -- 172.21.15.112:0/55876616 wait complete. 2024-09-19T09:41:55.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.601+0000 7ff6d9f08640 1 -- 172.21.15.112:0/32273608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6d40fb810 msgr2=0x7ff6d40fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.601+0000 7ff6d9f08640 1 --2- 172.21.15.112:0/32273608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6d40fb810 0x7ff6d40fbbe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80048d0 tx=0x7ff6c8009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.601+0000 7ff6d9f08640 1 -- 172.21.15.112:0/32273608 shutdown_connections 2024-09-19T09:41:55.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.601+0000 7ff6d9f08640 1 --2- 172.21.15.112:0/32273608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6d40fcf80 0x7ff6d40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.601+0000 7ff6d9f08640 1 --2- 172.21.15.112:0/32273608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6d40fb810 0x7ff6d40fbbe0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.601+0000 7ff6d9f08640 1 -- 172.21.15.112:0/32273608 >> 172.21.15.112:0/32273608 conn(0x7ff6d40723b0 msgr2=0x7ff6d40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:55.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.601+0000 7ff6d9f08640 1 -- 172.21.15.112:0/32273608 shutdown_connections 2024-09-19T09:41:55.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.601+0000 7ff6d9f08640 1 -- 172.21.15.112:0/32273608 wait complete. 2024-09-19T09:41:55.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.601+0000 7ff6d9f08640 1 Processor -- start 2024-09-19T09:41:55.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.601+0000 7ff6d9f08640 1 -- start start 2024-09-19T09:41:55.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.602+0000 7ff6d9f08640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6d40fb810 0x7ff6d4113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.602+0000 7ff6d9f08640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6d40fcf80 0x7ff6d4113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.602+0000 7ff6d9f08640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d4113d40 con 0x7ff6d40fb810 2024-09-19T09:41:55.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.602+0000 7ff6d9f08640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d410d180 con 0x7ff6d40fcf80 2024-09-19T09:41:55.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.602+0000 7ff6d37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6d40fb810 0x7ff6d4113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.602+0000 7ff6d37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6d40fb810 0x7ff6d4113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45674/0 (socket says 172.21.15.112:45674) 2024-09-19T09:41:55.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.602+0000 7ff6d37fe640 1 -- 172.21.15.112:0/3538646997 learned_addr learned my addr 172.21.15.112:0/3538646997 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:41:55.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.602+0000 7ff6d2ffd640 1 --2- 172.21.15.112:0/3538646997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6d40fcf80 0x7ff6d4113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.602+0000 7ff6d37fe640 1 -- 172.21.15.112:0/3538646997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6d40fcf80 msgr2=0x7ff6d4113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.602+0000 7ff6d37fe640 1 --2- 172.21.15.112:0/3538646997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6d40fcf80 0x7ff6d4113740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.602+0000 7ff6d37fe640 1 -- 172.21.15.112:0/3538646997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c8005040 con 0x7ff6d40fb810 2024-09-19T09:41:55.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.602+0000 7ff6d37fe640 1 --2- 172.21.15.112:0/3538646997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6d40fb810 0x7ff6d4113200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8000c00 tx=0x7ff6c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:55.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.602+0000 7ff6bbfff640 1 -- 172.21.15.112:0/3538646997 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c8038070 con 0x7ff6d40fb810 2024-09-19T09:41:55.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.603+0000 7ff6d9f08640 1 -- 172.21.15.112:0/3538646997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d410d400 con 0x7ff6d40fb810 2024-09-19T09:41:55.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.603+0000 7ff6bbfff640 1 -- 172.21.15.112:0/3538646997 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff6c802ade0 con 0x7ff6d40fb810 2024-09-19T09:41:55.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.603+0000 7ff6bbfff640 1 -- 172.21.15.112:0/3538646997 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c802c7e0 con 0x7ff6d40fb810 2024-09-19T09:41:55.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.603+0000 7ff6d9f08640 1 -- 172.21.15.112:0/3538646997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d410d940 con 0x7ff6d40fb810 2024-09-19T09:41:55.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.604+0000 7ff6d9f08640 1 -- 172.21.15.112:0/3538646997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d40fcbc0 con 0x7ff6d40fb810 2024-09-19T09:41:55.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.604+0000 7ff6bbfff640 1 -- 172.21.15.112:0/3538646997 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff6c8030020 con 0x7ff6d40fb810 2024-09-19T09:41:55.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.604+0000 7ff6bbfff640 1 --2- 172.21.15.112:0/3538646997 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff6bc06e530 0x7ff6bc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.605+0000 7ff6bbfff640 1 -- 172.21.15.112:0/3538646997 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff6c80adcb0 con 0x7ff6d40fb810 2024-09-19T09:41:55.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.605+0000 7ff6d2ffd640 1 --2- 172.21.15.112:0/3538646997 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff6bc06e530 0x7ff6bc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.605+0000 7ff6d2ffd640 1 --2- 172.21.15.112:0/3538646997 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff6bc06e530 0x7ff6bc0709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6d410eac0 tx=0x7ff6c400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:55.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.609+0000 7ff6bbfff640 1 -- 172.21.15.112:0/3538646997 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff6c8076f70 con 0x7ff6d40fb810 2024-09-19T09:41:55.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.782+0000 7ff6d9f08640 1 -- 172.21.15.112:0/3538646997 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6d404b750 con 0x7ff6bc06e530 2024-09-19T09:41:55.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.790+0000 7ff6bbfff640 1 -- 172.21.15.112:0/3538646997 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff6d404b750 con 0x7ff6bc06e530 2024-09-19T09:41:55.792 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:41:55.793 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (6m) 30s ago 14m 26.9M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:41:55.793 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (2m) 30s ago 14m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 70bad8ff6ec4 2024-09-19T09:41:55.793 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (2m) 2m ago 14m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 6f8cb10f4c96 2024-09-19T09:41:55.793 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (4m) 30s ago 14m 79.1M - 9.4.12 2bacad6d85d8 e462aca2b022 2024-09-19T09:41:55.793 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (9m) 30s ago 9m 153M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:41:55.793 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (9m) 30s ago 9m 106M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:41:55.793 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (9m) 2m ago 9m 13.6M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:41:55.793 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (9m) 2m ago 9m 16.1M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:41:55.793 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (5m) 30s ago 16m 500M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:41:55.793 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283,8765 running (4m) 2m ago 13m 439M - 19.1.1-361-g2f599a46 d2baa855c067 fddba1bee64a 2024-09-19T09:41:55.793 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (3m) 30s ago 16m 45.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 89dfb5de44c8 2024-09-19T09:41:55.793 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (2m) 2m ago 13m 34.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 3cab8f7cc27e 2024-09-19T09:41:55.793 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (6m) 30s ago 14m 15.7M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:41:55.794 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (5m) 2m ago 13m 16.3M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:41:55.794 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (106s) 30s ago 13m 99.9M 1557M 19.1.1-361-g2f599a46 d2baa855c067 11a51e663887 2024-09-19T09:41:55.794 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (71s) 30s ago 12m 101M 1557M 19.1.1-361-g2f599a46 d2baa855c067 bd616fcb189b 2024-09-19T09:41:55.794 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (35s) 30s ago 12m 14.3M 1557M 19.1.1-361-g2f599a46 d2baa855c067 4a651b62590f 2024-09-19T09:41:55.794 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 starting - - - 2581M 2024-09-19T09:41:55.794 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (11m) 2m ago 11m 239M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bfa41c48a8a5 2024-09-19T09:41:55.794 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (10m) 2m ago 10m 226M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:41:55.794 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (4m) 30s ago 14m 63.6M - 2.43.0 a07b618ecd1d 54850883a171 2024-09-19T09:41:55.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.792+0000 7ff6d9f08640 1 -- 172.21.15.112:0/3538646997 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff6bc06e530 msgr2=0x7ff6bc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.792+0000 7ff6d9f08640 1 --2- 172.21.15.112:0/3538646997 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff6bc06e530 0x7ff6bc0709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6d410eac0 tx=0x7ff6c400b040 comp rx=0 tx=0).stop 2024-09-19T09:41:55.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.792+0000 7ff6d9f08640 1 -- 172.21.15.112:0/3538646997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6d40fb810 msgr2=0x7ff6d4113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.792+0000 7ff6d9f08640 1 --2- 172.21.15.112:0/3538646997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6d40fb810 0x7ff6d4113200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8000c00 tx=0x7ff6c8009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.792+0000 7ff6d9f08640 1 -- 172.21.15.112:0/3538646997 shutdown_connections 2024-09-19T09:41:55.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.792+0000 7ff6d9f08640 1 --2- 172.21.15.112:0/3538646997 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff6bc06e530 0x7ff6bc0709e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.792+0000 7ff6d9f08640 1 --2- 172.21.15.112:0/3538646997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6d40fcf80 0x7ff6d4113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.793+0000 7ff6d9f08640 1 --2- 172.21.15.112:0/3538646997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6d40fb810 0x7ff6d4113200 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.793+0000 7ff6d9f08640 1 -- 172.21.15.112:0/3538646997 >> 172.21.15.112:0/3538646997 conn(0x7ff6d40723b0 msgr2=0x7ff6d4064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:55.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.793+0000 7ff6d9f08640 1 -- 172.21.15.112:0/3538646997 shutdown_connections 2024-09-19T09:41:55.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.793+0000 7ff6d9f08640 1 -- 172.21.15.112:0/3538646997 wait complete. 2024-09-19T09:41:55.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.870+0000 7f91d7036640 1 -- 172.21.15.112:0/3806911470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91d01014e0 msgr2=0x7f91d01018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.870+0000 7f91d7036640 1 --2- 172.21.15.112:0/3806911470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91d01014e0 0x7f91d01018b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f91b80048d0 tx=0x7f91b8009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.870+0000 7f91d7036640 1 -- 172.21.15.112:0/3806911470 shutdown_connections 2024-09-19T09:41:55.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.870+0000 7f91d7036640 1 --2- 172.21.15.112:0/3806911470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91d00fb4a0 0x7f91d00fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.870+0000 7f91d7036640 1 --2- 172.21.15.112:0/3806911470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91d01014e0 0x7f91d01018b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.870+0000 7f91d7036640 1 -- 172.21.15.112:0/3806911470 >> 172.21.15.112:0/3806911470 conn(0x7f91d00f7060 msgr2=0x7f91d00f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:55.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.870+0000 7f91d7036640 1 -- 172.21.15.112:0/3806911470 shutdown_connections 2024-09-19T09:41:55.873 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:55 smithi112 ceph-mon[97503]: pgmap v110: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/225 objects degraded (21.778%) 2024-09-19T09:41:55.873 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:55.873 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:41:55.873 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:55.873 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:55.873 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:41:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.871+0000 7f91d7036640 1 -- 172.21.15.112:0/3806911470 wait complete. 2024-09-19T09:41:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.871+0000 7f91d7036640 1 Processor -- start 2024-09-19T09:41:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.871+0000 7f91d7036640 1 -- start start 2024-09-19T09:41:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.871+0000 7f91d7036640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91d00fb4a0 0x7f91d01131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.871+0000 7f91d7036640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91d01014e0 0x7f91d01136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.871+0000 7f91d7036640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d0113ce0 con 0x7f91d01014e0 2024-09-19T09:41:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.871+0000 7f91d7036640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d010d120 con 0x7f91d00fb4a0 2024-09-19T09:41:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.872+0000 7f91cffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91d01014e0 0x7f91d01136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.872+0000 7f91cffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91d01014e0 0x7f91d01136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45680/0 (socket says 172.21.15.112:45680) 2024-09-19T09:41:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.872+0000 7f91cffff640 1 -- 172.21.15.112:0/3367426843 learned_addr learned my addr 172.21.15.112:0/3367426843 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:41:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.872+0000 7f91d4dd2640 1 --2- 172.21.15.112:0/3367426843 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91d00fb4a0 0x7f91d01131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.872+0000 7f91cffff640 1 -- 172.21.15.112:0/3367426843 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91d00fb4a0 msgr2=0x7f91d01131a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.872+0000 7f91cffff640 1 --2- 172.21.15.112:0/3367426843 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91d00fb4a0 0x7f91d01131a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.872+0000 7f91cffff640 1 -- 172.21.15.112:0/3367426843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b8005040 con 0x7f91d01014e0 2024-09-19T09:41:55.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.872+0000 7f91cffff640 1 --2- 172.21.15.112:0/3367426843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91d01014e0 0x7f91d01136e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f91c0002a80 tx=0x7f91c0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:55.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.872+0000 7f91cd7fa640 1 -- 172.21.15.112:0/3367426843 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91c0007c30 con 0x7f91d01014e0 2024-09-19T09:41:55.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.872+0000 7f91d7036640 1 -- 172.21.15.112:0/3367426843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d010d400 con 0x7f91d01014e0 2024-09-19T09:41:55.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.872+0000 7f91cd7fa640 1 -- 172.21.15.112:0/3367426843 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f91c000f040 con 0x7f91d01014e0 2024-09-19T09:41:55.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.872+0000 7f91cd7fa640 1 -- 172.21.15.112:0/3367426843 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91c000dab0 con 0x7f91d01014e0 2024-09-19T09:41:55.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.872+0000 7f91d7036640 1 -- 172.21.15.112:0/3367426843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d010d920 con 0x7f91d01014e0 2024-09-19T09:41:55.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.873+0000 7f91d7036640 1 -- 172.21.15.112:0/3367426843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d00fcbe0 con 0x7f91d01014e0 2024-09-19T09:41:55.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.875+0000 7f91cd7fa640 1 -- 172.21.15.112:0/3367426843 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f91c000dc30 con 0x7f91d01014e0 2024-09-19T09:41:55.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.875+0000 7f91cd7fa640 1 --2- 172.21.15.112:0/3367426843 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f91bc06e530 0x7f91bc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.875+0000 7f91cd7fa640 1 -- 172.21.15.112:0/3367426843 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f91c008d8a0 con 0x7f91d01014e0 2024-09-19T09:41:55.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.875+0000 7f91d4dd2640 1 --2- 172.21.15.112:0/3367426843 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f91bc06e530 0x7f91bc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.876+0000 7f91d4dd2640 1 --2- 172.21.15.112:0/3367426843 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f91bc06e530 0x7f91bc0709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009ac0 tx=0x7f91b8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:55.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:55.879+0000 7f91cd7fa640 1 -- 172.21.15.112:0/3367426843 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f91c0056b60 con 0x7f91d01014e0 2024-09-19T09:41:56.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:55 smithi191 ceph-mon[77624]: pgmap v110: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/225 objects degraded (21.778%) 2024-09-19T09:41:56.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:55 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:56.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:55 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:41:56.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:55 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:56.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:55 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:56.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:55 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:41:56.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.121+0000 7f91d7036640 1 -- 172.21.15.112:0/3367426843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f91d00fac60 con 0x7f91d01014e0 2024-09-19T09:41:56.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.122+0000 7f91cd7fa640 1 -- 172.21.15.112:0/3367426843 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f91c005a220 con 0x7f91d01014e0 2024-09-19T09:41:56.124 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:41:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:41:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:41:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:41:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:41:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:41:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:41:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:41:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2, 2024-09-19T09:41:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 3 2024-09-19T09:41:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:41:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:41:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:41:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:41:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:41:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6, 2024-09-19T09:41:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 7 2024-09-19T09:41:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:41:56.126 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:41:56.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.124+0000 7f91d7036640 1 -- 172.21.15.112:0/3367426843 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f91bc06e530 msgr2=0x7f91bc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.124+0000 7f91d7036640 1 --2- 172.21.15.112:0/3367426843 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f91bc06e530 0x7f91bc0709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009ac0 tx=0x7f91b8035040 comp rx=0 tx=0).stop 2024-09-19T09:41:56.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.124+0000 7f91d7036640 1 -- 172.21.15.112:0/3367426843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91d01014e0 msgr2=0x7f91d01136e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.124+0000 7f91d7036640 1 --2- 172.21.15.112:0/3367426843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91d01014e0 0x7f91d01136e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f91c0002a80 tx=0x7f91c0004600 comp rx=0 tx=0).stop 2024-09-19T09:41:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.124+0000 7f91d7036640 1 -- 172.21.15.112:0/3367426843 shutdown_connections 2024-09-19T09:41:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.124+0000 7f91d7036640 1 --2- 172.21.15.112:0/3367426843 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f91bc06e530 0x7f91bc0709e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.124+0000 7f91d7036640 1 --2- 172.21.15.112:0/3367426843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91d01014e0 0x7f91d01136e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.124+0000 7f91d7036640 1 --2- 172.21.15.112:0/3367426843 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91d00fb4a0 0x7f91d01131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.124+0000 7f91d7036640 1 -- 172.21.15.112:0/3367426843 >> 172.21.15.112:0/3367426843 conn(0x7f91d00f7060 msgr2=0x7f91d0065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.124+0000 7f91d7036640 1 -- 172.21.15.112:0/3367426843 shutdown_connections 2024-09-19T09:41:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.124+0000 7f91d7036640 1 -- 172.21.15.112:0/3367426843 wait complete. 2024-09-19T09:41:56.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.202+0000 7f4bb6328640 1 -- 172.21.15.112:0/2528488714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fd5a0 msgr2=0x7f4bb00fd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.202+0000 7f4bb6328640 1 --2- 172.21.15.112:0/2528488714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fd5a0 0x7f4bb00fd970 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00048d0 tx=0x7f4ba0009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.202+0000 7f4bb6328640 1 -- 172.21.15.112:0/2528488714 shutdown_connections 2024-09-19T09:41:56.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.202+0000 7f4bb6328640 1 --2- 172.21.15.112:0/2528488714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bb00fdf40 0x7f4bb0106610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.202+0000 7f4bb6328640 1 --2- 172.21.15.112:0/2528488714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fd5a0 0x7f4bb00fd970 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.202+0000 7f4bb6328640 1 -- 172.21.15.112:0/2528488714 >> 172.21.15.112:0/2528488714 conn(0x7f4bb00f7000 msgr2=0x7f4bb00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:56.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.202+0000 7f4bb6328640 1 -- 172.21.15.112:0/2528488714 shutdown_connections 2024-09-19T09:41:56.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.202+0000 7f4bb6328640 1 -- 172.21.15.112:0/2528488714 wait complete. 2024-09-19T09:41:56.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.203+0000 7f4bb6328640 1 Processor -- start 2024-09-19T09:41:56.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.203+0000 7f4bb6328640 1 -- start start 2024-09-19T09:41:56.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.203+0000 7f4bb6328640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bb00fd5a0 0x7f4bb0113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.203+0000 7f4bb6328640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fdf40 0x7f4bb0113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.203+0000 7f4bb6328640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb0113d60 con 0x7f4bb00fdf40 2024-09-19T09:41:56.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.203+0000 7f4bb6328640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb010d1a0 con 0x7f4bb00fd5a0 2024-09-19T09:41:56.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.204+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fdf40 0x7f4bb0113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.204+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fdf40 0x7f4bb0113760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45696/0 (socket says 172.21.15.112:45696) 2024-09-19T09:41:56.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.204+0000 7f4baf7fe640 1 -- 172.21.15.112:0/2832080106 learned_addr learned my addr 172.21.15.112:0/2832080106 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:41:56.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.204+0000 7f4baffff640 1 --2- 172.21.15.112:0/2832080106 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bb00fd5a0 0x7f4bb0113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.204+0000 7f4baf7fe640 1 -- 172.21.15.112:0/2832080106 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bb00fd5a0 msgr2=0x7f4bb0113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.204+0000 7f4baf7fe640 1 --2- 172.21.15.112:0/2832080106 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bb00fd5a0 0x7f4bb0113220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.204+0000 7f4baf7fe640 1 -- 172.21.15.112:0/2832080106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba0005040 con 0x7f4bb00fdf40 2024-09-19T09:41:56.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.204+0000 7f4baf7fe640 1 --2- 172.21.15.112:0/2832080106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fdf40 0x7f4bb0113760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4002a50 tx=0x7f4ba4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.204+0000 7f4bacff9640 1 -- 172.21.15.112:0/2832080106 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ba4007c30 con 0x7f4bb00fdf40 2024-09-19T09:41:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.204+0000 7f4bacff9640 1 -- 172.21.15.112:0/2832080106 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4ba400f040 con 0x7f4bb00fdf40 2024-09-19T09:41:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.204+0000 7f4bb6328640 1 -- 172.21.15.112:0/2832080106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb010d480 con 0x7f4bb00fdf40 2024-09-19T09:41:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.204+0000 7f4bacff9640 1 -- 172.21.15.112:0/2832080106 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ba400dad0 con 0x7f4bb00fdf40 2024-09-19T09:41:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.204+0000 7f4bb6328640 1 -- 172.21.15.112:0/2832080106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb010d9a0 con 0x7f4bb00fdf40 2024-09-19T09:41:56.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.205+0000 7f4bb6328640 1 -- 172.21.15.112:0/2832080106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb0066270 con 0x7f4bb00fdf40 2024-09-19T09:41:56.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.206+0000 7f4bacff9640 1 -- 172.21.15.112:0/2832080106 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4ba400dc30 con 0x7f4bb00fdf40 2024-09-19T09:41:56.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.206+0000 7f4bacff9640 1 --2- 172.21.15.112:0/2832080106 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f4b9806e530 0x7f4b980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.206+0000 7f4bacff9640 1 -- 172.21.15.112:0/2832080106 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4ba408dfa0 con 0x7f4bb00fdf40 2024-09-19T09:41:56.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.206+0000 7f4baffff640 1 --2- 172.21.15.112:0/2832080106 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f4b9806e530 0x7f4b980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.207+0000 7f4baffff640 1 --2- 172.21.15.112:0/2832080106 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f4b9806e530 0x7f4b980709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0004540 tx=0x7f4ba0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:56.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.211+0000 7f4bacff9640 1 -- 172.21.15.112:0/2832080106 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4ba4057130 con 0x7f4bb00fdf40 2024-09-19T09:41:56.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.412+0000 7f4bb6328640 1 -- 172.21.15.112:0/2832080106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4bb00fac40 con 0x7f4bb00fdf40 2024-09-19T09:41:56.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.412+0000 7f4bacff9640 1 -- 172.21.15.112:0/2832080106 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1949 (secure 0 0 0) 0x7f4ba405a7f0 con 0x7f4bb00fdf40 2024-09-19T09:41:56.415 INFO:teuthology.orchestra.run.smithi112.stdout:e17 2024-09-19T09:41:56.415 INFO:teuthology.orchestra.run.smithi112.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:41:56.415 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:41:56.415 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:41:56.415 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-19T09:41:56.415 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:41:56.415 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:41:56.415 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-19T09:41:56.415 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 17 2024-09-19T09:41:56.415 INFO:teuthology.orchestra.run.smithi112.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:41:56.415 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:41:56.415 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-19T09:32:42.200999+0000 2024-09-19T09:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-19T09:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-19T09:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-19T09:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-19T09:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-19T09:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-19T09:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-19T09:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-19T09:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 45 2024-09-19T09:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-19T09:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-19T09:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14460} 2024-09-19T09:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-19T09:41:56.417 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-19T09:41:56.417 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-19T09:41:56.417 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-19T09:41:56.417 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-19T09:41:56.417 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data disabled 2024-09-19T09:41:56.417 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-19T09:41:56.417 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-19T09:41:56.417 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-19T09:41:56.417 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:41:56.417 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.hcoxjz{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:41:56.417 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ymjyok{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/3468750429,v1:172.21.15.112:6827/3468750429] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:41:56.417 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:41:56.417 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:41:56.417 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-19T09:41:56.418 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:41:56.418 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.qweljt{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:41:56.418 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.jjldod{-1:24281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6824/2759077122,v1:172.21.15.191:6825/2759077122] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:41:56.418 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2024-09-19T09:41:56.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.414+0000 7f4bb6328640 1 -- 172.21.15.112:0/2832080106 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f4b9806e530 msgr2=0x7f4b980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.414+0000 7f4bb6328640 1 --2- 172.21.15.112:0/2832080106 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f4b9806e530 0x7f4b980709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0004540 tx=0x7f4ba0035040 comp rx=0 tx=0).stop 2024-09-19T09:41:56.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.414+0000 7f4bb6328640 1 -- 172.21.15.112:0/2832080106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fdf40 msgr2=0x7f4bb0113760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.414+0000 7f4bb6328640 1 --2- 172.21.15.112:0/2832080106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fdf40 0x7f4bb0113760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4002a50 tx=0x7f4ba4004600 comp rx=0 tx=0).stop 2024-09-19T09:41:56.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.414+0000 7f4bb6328640 1 -- 172.21.15.112:0/2832080106 shutdown_connections 2024-09-19T09:41:56.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.414+0000 7f4bb6328640 1 --2- 172.21.15.112:0/2832080106 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f4b9806e530 0x7f4b980709e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.414+0000 7f4bb6328640 1 --2- 172.21.15.112:0/2832080106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb00fdf40 0x7f4bb0113760 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.414+0000 7f4bb6328640 1 --2- 172.21.15.112:0/2832080106 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bb00fd5a0 0x7f4bb0113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.414+0000 7f4bb6328640 1 -- 172.21.15.112:0/2832080106 >> 172.21.15.112:0/2832080106 conn(0x7f4bb00f7000 msgr2=0x7f4bb00f8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:56.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.415+0000 7f4bb6328640 1 -- 172.21.15.112:0/2832080106 shutdown_connections 2024-09-19T09:41:56.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.415+0000 7f4bb6328640 1 -- 172.21.15.112:0/2832080106 wait complete. 2024-09-19T09:41:56.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.495+0000 7f4e9f325640 1 -- 172.21.15.112:0/343242794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e98102530 msgr2=0x7f4e98102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.495+0000 7f4e9f325640 1 --2- 172.21.15.112:0/343242794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e98102530 0x7f4e98102900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e900048d0 tx=0x7f4e90009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.495+0000 7f4e9f325640 1 -- 172.21.15.112:0/343242794 shutdown_connections 2024-09-19T09:41:56.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.495+0000 7f4e9f325640 1 --2- 172.21.15.112:0/343242794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e98102ed0 0x7f4e980fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.495+0000 7f4e9f325640 1 --2- 172.21.15.112:0/343242794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e98102530 0x7f4e98102900 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.495+0000 7f4e9f325640 1 -- 172.21.15.112:0/343242794 >> 172.21.15.112:0/343242794 conn(0x7f4e980f80f0 msgr2=0x7f4e980fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:56.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.495+0000 7f4e9f325640 1 -- 172.21.15.112:0/343242794 shutdown_connections 2024-09-19T09:41:56.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.495+0000 7f4e9f325640 1 -- 172.21.15.112:0/343242794 wait complete. 2024-09-19T09:41:56.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.495+0000 7f4e9f325640 1 Processor -- start 2024-09-19T09:41:56.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.495+0000 7f4e9f325640 1 -- start start 2024-09-19T09:41:56.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e9f325640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e98102530 0x7f4e98113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e9f325640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e98102ed0 0x7f4e98113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e9f325640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e98113d80 con 0x7f4e98102ed0 2024-09-19T09:41:56.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e9f325640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9810d1c0 con 0x7f4e98102530 2024-09-19T09:41:56.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e9c8c0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e98102ed0 0x7f4e98113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e9c8c0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e98102ed0 0x7f4e98113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45702/0 (socket says 172.21.15.112:45702) 2024-09-19T09:41:56.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e9c8c0640 1 -- 172.21.15.112:0/897350712 learned_addr learned my addr 172.21.15.112:0/897350712 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:41:56.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e9d0c1640 1 --2- 172.21.15.112:0/897350712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e98102530 0x7f4e98113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e9c8c0640 1 -- 172.21.15.112:0/897350712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e98102530 msgr2=0x7f4e98113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e9c8c0640 1 --2- 172.21.15.112:0/897350712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e98102530 0x7f4e98113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e9c8c0640 1 -- 172.21.15.112:0/897350712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e90005040 con 0x7f4e98102ed0 2024-09-19T09:41:56.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e9c8c0640 1 --2- 172.21.15.112:0/897350712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e98102ed0 0x7f4e98113780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c002840 tx=0x7f4e8c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:56.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e95ffb640 1 -- 172.21.15.112:0/897350712 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e8c007c30 con 0x7f4e98102ed0 2024-09-19T09:41:56.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e95ffb640 1 -- 172.21.15.112:0/897350712 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4e8c00f040 con 0x7f4e98102ed0 2024-09-19T09:41:56.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e9f325640 1 -- 172.21.15.112:0/897350712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9810d4a0 con 0x7f4e98102ed0 2024-09-19T09:41:56.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.496+0000 7f4e95ffb640 1 -- 172.21.15.112:0/897350712 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e8c00d990 con 0x7f4e98102ed0 2024-09-19T09:41:56.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.497+0000 7f4e9f325640 1 -- 172.21.15.112:0/897350712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9810da40 con 0x7f4e98102ed0 2024-09-19T09:41:56.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.498+0000 7f4e9f325640 1 -- 172.21.15.112:0/897350712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e980fdcb0 con 0x7f4e98102ed0 2024-09-19T09:41:56.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.498+0000 7f4e95ffb640 1 -- 172.21.15.112:0/897350712 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4e8c009600 con 0x7f4e98102ed0 2024-09-19T09:41:56.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.499+0000 7f4e95ffb640 1 --2- 172.21.15.112:0/897350712 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f4e8006e530 0x7f4e800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.499+0000 7f4e9d0c1640 1 --2- 172.21.15.112:0/897350712 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f4e8006e530 0x7f4e800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.499+0000 7f4e95ffb640 1 -- 172.21.15.112:0/897350712 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4e8c08d790 con 0x7f4e98102ed0 2024-09-19T09:41:56.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.499+0000 7f4e9d0c1640 1 --2- 172.21.15.112:0/897350712 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f4e8006e530 0x7f4e800709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4e90009ac0 tx=0x7f4e90035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:56.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.503+0000 7f4e95ffb640 1 -- 172.21.15.112:0/897350712 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4e8c056a50 con 0x7f4e98102ed0 2024-09-19T09:41:56.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.686+0000 7f4e9f325640 1 -- 172.21.15.112:0/897350712 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e981095a0 con 0x7f4e8006e530 2024-09-19T09:41:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.687+0000 7f4e95ffb640 1 -- 172.21.15.112:0/897350712 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4e981095a0 con 0x7f4e8006e530 2024-09-19T09:41:56.689 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:41:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:41:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:41:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:41:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-19T09:41:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: "mon", 2024-09-19T09:41:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-19T09:41:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: "crash" 2024-09-19T09:41:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-19T09:41:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "9/21 daemons upgraded", 2024-09-19T09:41:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T09:41:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:41:56.690 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:41:56.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.689+0000 7f4e9f325640 1 -- 172.21.15.112:0/897350712 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f4e8006e530 msgr2=0x7f4e800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.689+0000 7f4e9f325640 1 --2- 172.21.15.112:0/897350712 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f4e8006e530 0x7f4e800709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4e90009ac0 tx=0x7f4e90035040 comp rx=0 tx=0).stop 2024-09-19T09:41:56.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.689+0000 7f4e9f325640 1 -- 172.21.15.112:0/897350712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e98102ed0 msgr2=0x7f4e98113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.689+0000 7f4e9f325640 1 --2- 172.21.15.112:0/897350712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e98102ed0 0x7f4e98113780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c002840 tx=0x7f4e8c004570 comp rx=0 tx=0).stop 2024-09-19T09:41:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.689+0000 7f4e9f325640 1 -- 172.21.15.112:0/897350712 shutdown_connections 2024-09-19T09:41:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.689+0000 7f4e9f325640 1 --2- 172.21.15.112:0/897350712 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f4e8006e530 0x7f4e800709e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.689+0000 7f4e9f325640 1 --2- 172.21.15.112:0/897350712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e98102ed0 0x7f4e98113780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.690+0000 7f4e9f325640 1 --2- 172.21.15.112:0/897350712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e98102530 0x7f4e98113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.690+0000 7f4e9f325640 1 -- 172.21.15.112:0/897350712 >> 172.21.15.112:0/897350712 conn(0x7f4e980f80f0 msgr2=0x7f4e980f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.690+0000 7f4e9f325640 1 -- 172.21.15.112:0/897350712 shutdown_connections 2024-09-19T09:41:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.690+0000 7f4e9f325640 1 -- 172.21.15.112:0/897350712 wait complete. 2024-09-19T09:41:56.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.768+0000 7ff8064e1640 1 -- 172.21.15.112:0/1098333960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8000fe460 msgr2=0x7ff8000fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.768+0000 7ff8064e1640 1 --2- 172.21.15.112:0/1098333960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8000fe460 0x7ff8000fe830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00048d0 tx=0x7ff7f0009da0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.768+0000 7ff8064e1640 1 -- 172.21.15.112:0/1098333960 shutdown_connections 2024-09-19T09:41:56.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.768+0000 7ff8064e1640 1 --2- 172.21.15.112:0/1098333960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff800064fc0 0x7ff800065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.768+0000 7ff8064e1640 1 --2- 172.21.15.112:0/1098333960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8000fe460 0x7ff8000fe830 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.768+0000 7ff8064e1640 1 -- 172.21.15.112:0/1098333960 >> 172.21.15.112:0/1098333960 conn(0x7ff8000723b0 msgr2=0x7ff8000727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:56.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.768+0000 7ff8064e1640 1 -- 172.21.15.112:0/1098333960 shutdown_connections 2024-09-19T09:41:56.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.768+0000 7ff8064e1640 1 -- 172.21.15.112:0/1098333960 wait complete. 2024-09-19T09:41:56.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.768+0000 7ff8064e1640 1 Processor -- start 2024-09-19T09:41:56.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.769+0000 7ff8064e1640 1 -- start start 2024-09-19T09:41:56.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.769+0000 7ff8064e1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff800064fc0 0x7ff8001131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.769+0000 7ff8064e1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8000fe460 0x7ff8001136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.769+0000 7ff8064e1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff800113cf0 con 0x7ff8000fe460 2024-09-19T09:41:56.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.769+0000 7ff8064e1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80010d130 con 0x7ff800064fc0 2024-09-19T09:41:56.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.769+0000 7ff7ff7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8000fe460 0x7ff8001136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.769+0000 7ff7ff7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8000fe460 0x7ff8001136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45714/0 (socket says 172.21.15.112:45714) 2024-09-19T09:41:56.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.769+0000 7ff7ff7fe640 1 -- 172.21.15.112:0/311540243 learned_addr learned my addr 172.21.15.112:0/311540243 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:41:56.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.769+0000 7ff7fffff640 1 --2- 172.21.15.112:0/311540243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff800064fc0 0x7ff8001131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.769+0000 7ff7ff7fe640 1 -- 172.21.15.112:0/311540243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff800064fc0 msgr2=0x7ff8001131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.769+0000 7ff7ff7fe640 1 --2- 172.21.15.112:0/311540243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff800064fc0 0x7ff8001131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.769+0000 7ff7ff7fe640 1 -- 172.21.15.112:0/311540243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0005040 con 0x7ff8000fe460 2024-09-19T09:41:56.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.770+0000 7ff7ff7fe640 1 --2- 172.21.15.112:0/311540243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8000fe460 0x7ff8001136f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4002a50 tx=0x7ff7f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:56.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.770+0000 7ff7fcff9640 1 -- 172.21.15.112:0/311540243 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f4007c30 con 0x7ff8000fe460 2024-09-19T09:41:56.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.770+0000 7ff8064e1640 1 -- 172.21.15.112:0/311540243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80010d410 con 0x7ff8000fe460 2024-09-19T09:41:56.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.770+0000 7ff7fcff9640 1 -- 172.21.15.112:0/311540243 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff7f400f040 con 0x7ff8000fe460 2024-09-19T09:41:56.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.770+0000 7ff7fcff9640 1 -- 172.21.15.112:0/311540243 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f400da10 con 0x7ff8000fe460 2024-09-19T09:41:56.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.770+0000 7ff8064e1640 1 -- 172.21.15.112:0/311540243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80010d9b0 con 0x7ff8000fe460 2024-09-19T09:41:56.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.771+0000 7ff8064e1640 1 -- 172.21.15.112:0/311540243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8000fdcf0 con 0x7ff8000fe460 2024-09-19T09:41:56.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.771+0000 7ff7fcff9640 1 -- 172.21.15.112:0/311540243 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff7f400dc80 con 0x7ff8000fe460 2024-09-19T09:41:56.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.772+0000 7ff7fcff9640 1 --2- 172.21.15.112:0/311540243 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff7e806e530 0x7ff7e80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.772+0000 7ff7fffff640 1 --2- 172.21.15.112:0/311540243 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff7e806e530 0x7ff7e80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.772+0000 7ff7fcff9640 1 -- 172.21.15.112:0/311540243 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff7f408d890 con 0x7ff8000fe460 2024-09-19T09:41:56.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.772+0000 7ff7fffff640 1 --2- 172.21.15.112:0/311540243 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff7e806e530 0x7ff7e80709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009ac0 tx=0x7ff7f0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:56.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:56.776+0000 7ff7fcff9640 1 -- 172.21.15.112:0/311540243 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff7f4056ad0 con 0x7ff8000fe460 2024-09-19T09:41:56.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:56 smithi112 ceph-mon[97503]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:56 smithi112 ceph-mon[97503]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:56 smithi112 ceph-mon[97503]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:56 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3367426843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:41:56.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:56 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2832080106' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:41:57.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:57.010+0000 7ff8064e1640 1 -- 172.21.15.112:0/311540243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff80010e850 con 0x7ff8000fe460 2024-09-19T09:41:57.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:57.010+0000 7ff7fcff9640 1 -- 172.21.15.112:0/311540243 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1216 (secure 0 0 0) 0x7ff7f405a190 con 0x7ff8000fe460 2024-09-19T09:41:57.013 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 49/225 objects degraded (21.778%), 17 pgs degraded 2024-09-19T09:41:57.013 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-19T09:41:57.013 INFO:teuthology.orchestra.run.smithi112.stdout: osd.3 (root=default,host=smithi191) is down 2024-09-19T09:41:57.013 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 49/225 objects degraded (21.778%), 17 pgs degraded 2024-09-19T09:41:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-19T09:41:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-19T09:41:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-19T09:41:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-19T09:41:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-19T09:41:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-19T09:41:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-19T09:41:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-19T09:41:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-19T09:41:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-19T09:41:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-19T09:41:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-19T09:41:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-19T09:41:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-19T09:41:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-19T09:41:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-19T09:41:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-19T09:41:57.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:57.012+0000 7ff8064e1640 1 -- 172.21.15.112:0/311540243 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff7e806e530 msgr2=0x7ff7e80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:57.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:57.012+0000 7ff8064e1640 1 --2- 172.21.15.112:0/311540243 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff7e806e530 0x7ff7e80709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009ac0 tx=0x7ff7f0035040 comp rx=0 tx=0).stop 2024-09-19T09:41:57.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:57.013+0000 7ff8064e1640 1 -- 172.21.15.112:0/311540243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8000fe460 msgr2=0x7ff8001136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:57.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:57.013+0000 7ff8064e1640 1 --2- 172.21.15.112:0/311540243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8000fe460 0x7ff8001136f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4002a50 tx=0x7ff7f4004600 comp rx=0 tx=0).stop 2024-09-19T09:41:57.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:57.013+0000 7ff8064e1640 1 -- 172.21.15.112:0/311540243 shutdown_connections 2024-09-19T09:41:57.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:57.013+0000 7ff8064e1640 1 --2- 172.21.15.112:0/311540243 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff7e806e530 0x7ff7e80709e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:57.013+0000 7ff8064e1640 1 --2- 172.21.15.112:0/311540243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8000fe460 0x7ff8001136f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:57.013+0000 7ff8064e1640 1 --2- 172.21.15.112:0/311540243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff800064fc0 0x7ff8001131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:57.013+0000 7ff8064e1640 1 -- 172.21.15.112:0/311540243 >> 172.21.15.112:0/311540243 conn(0x7ff8000723b0 msgr2=0x7ff800105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:57.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:57.013+0000 7ff8064e1640 1 -- 172.21.15.112:0/311540243 shutdown_connections 2024-09-19T09:41:57.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:41:57.013+0000 7ff8064e1640 1 -- 172.21.15.112:0/311540243 wait complete. 2024-09-19T09:41:57.285 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:41:56 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3[87324]: 2024-09-19T09:41:56.854+0000 7f495d097640 -1 Falling back to public interface 2024-09-19T09:41:57.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:56 smithi191 ceph-mon[77624]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:57.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:56 smithi191 ceph-mon[77624]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:57.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:56 smithi191 ceph-mon[77624]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:57.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:56 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3367426843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:41:57.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:56 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2832080106' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:41:57.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:57 smithi112 ceph-mon[97503]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:57 smithi112 ceph-mon[97503]: pgmap v111: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/225 objects degraded (21.778%) 2024-09-19T09:41:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:57 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/311540243' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:41:58.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:57 smithi191 ceph-mon[77624]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:41:58.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:57 smithi191 ceph-mon[77624]: pgmap v111: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/225 objects degraded (21.778%) 2024-09-19T09:41:58.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:57 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/311540243' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:41:59.180 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:58 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:59.180 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:58 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:59.180 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:58 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:59.180 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:58 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:59.180 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:58 smithi191 ceph-mon[77624]: Health check update: Degraded data redundancy: 49/225 objects degraded (21.778%), 17 pgs degraded (PG_DEGRADED) 2024-09-19T09:41:59.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:58 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:59.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:58 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:59.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:58 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:59.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:58 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:41:59.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:58 smithi112 ceph-mon[97503]: Health check update: Degraded data redundancy: 49/225 objects degraded (21.778%), 17 pgs degraded (PG_DEGRADED) 2024-09-19T09:42:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:41:59 smithi112 ceph-mon[97503]: pgmap v112: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/225 objects degraded (21.778%) 2024-09-19T09:42:00.229 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:41:59 smithi191 ceph-mon[77624]: pgmap v112: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/225 objects degraded (21.778%) 2024-09-19T09:42:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:01 smithi112 ceph-mon[97503]: pgmap v113: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/225 objects degraded (21.778%) 2024-09-19T09:42:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:01 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:01 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:01 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:42:02.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:01 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:42:02.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:01 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:02.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:01 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:42:02.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:01 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:42:02.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:01 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:42:02.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:01 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:42:02.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:01 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:42:02.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:01 smithi191 ceph-mon[77624]: pgmap v113: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/225 objects degraded (21.778%) 2024-09-19T09:42:02.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:01 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:02.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:01 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:02.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:01 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:42:02.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:01 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:42:02.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:01 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:02.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:01 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:42:02.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:01 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:42:02.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:01 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:42:02.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:01 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:42:02.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:01 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:42:03.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:02 smithi112 ceph-mon[97503]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:42:03.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:02 smithi112 ceph-mon[97503]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-19T09:42:03.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:02 smithi191 ceph-mon[77624]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:42:03.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:02 smithi191 ceph-mon[77624]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-19T09:42:03.285 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:42:03 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3[87324]: 2024-09-19T09:42:03.049+0000 7f495d097640 -1 osd.3 63 log_to_monitors true 2024-09-19T09:42:04.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:03 smithi112 ceph-mon[97503]: pgmap v114: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 49/225 objects degraded (21.778%) 2024-09-19T09:42:04.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:03 smithi112 ceph-mon[97503]: from='osd.3 [v2:172.21.15.191:6800/4224347388,v1:172.21.15.191:6801/4224347388]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:42:04.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:03 smithi112 ceph-mon[97503]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:42:04.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:03 smithi191 ceph-mon[77624]: pgmap v114: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 49/225 objects degraded (21.778%) 2024-09-19T09:42:04.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:03 smithi191 ceph-mon[77624]: from='osd.3 [v2:172.21.15.191:6800/4224347388,v1:172.21.15.191:6801/4224347388]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:42:04.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:03 smithi191 ceph-mon[77624]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:42:05.034 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:42:04 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3[87324]: 2024-09-19T09:42:04.687+0000 7f4950e29640 -1 osd.3 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:42:05.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:04 smithi191 ceph-mon[77624]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:42:05.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:04 smithi191 ceph-mon[77624]: osdmap e66: 6 total, 5 up, 6 in 2024-09-19T09:42:05.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:04 smithi191 ceph-mon[77624]: from='osd.3 [v2:172.21.15.191:6800/4224347388,v1:172.21.15.191:6801/4224347388]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:42:05.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:04 smithi191 ceph-mon[77624]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:42:05.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:04 smithi191 ceph-mon[77624]: from='osd.3 ' entity='osd.3' 2024-09-19T09:42:05.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:04 smithi112 ceph-mon[97503]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:42:05.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:04 smithi112 ceph-mon[97503]: osdmap e66: 6 total, 5 up, 6 in 2024-09-19T09:42:05.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:04 smithi112 ceph-mon[97503]: from='osd.3 [v2:172.21.15.191:6800/4224347388,v1:172.21.15.191:6801/4224347388]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:42:05.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:04 smithi112 ceph-mon[97503]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:42:05.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:04 smithi112 ceph-mon[97503]: from='osd.3 ' entity='osd.3' 2024-09-19T09:42:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:05 smithi112 ceph-mon[97503]: pgmap v116: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 49/225 objects degraded (21.778%) 2024-09-19T09:42:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:05 smithi112 ceph-mon[97503]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:42:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:05 smithi112 ceph-mon[97503]: osd.3 [v2:172.21.15.191:6800/4224347388,v1:172.21.15.191:6801/4224347388] boot 2024-09-19T09:42:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:05 smithi112 ceph-mon[97503]: osdmap e67: 6 total, 6 up, 6 in 2024-09-19T09:42:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:42:06.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:05 smithi191 ceph-mon[77624]: pgmap v116: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 49/225 objects degraded (21.778%) 2024-09-19T09:42:06.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:05 smithi191 ceph-mon[77624]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:42:06.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:05 smithi191 ceph-mon[77624]: osd.3 [v2:172.21.15.191:6800/4224347388,v1:172.21.15.191:6801/4224347388] boot 2024-09-19T09:42:06.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:05 smithi191 ceph-mon[77624]: osdmap e67: 6 total, 6 up, 6 in 2024-09-19T09:42:06.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:42:07.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:07 smithi112 ceph-mon[97503]: osdmap e68: 6 total, 6 up, 6 in 2024-09-19T09:42:07.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:07 smithi112 ceph-mon[97503]: pgmap v119: 65 pgs: 8 peering, 15 active+undersized, 15 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 43/225 objects degraded (19.111%) 2024-09-19T09:42:08.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:07 smithi191 ceph-mon[77624]: osdmap e68: 6 total, 6 up, 6 in 2024-09-19T09:42:08.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:07 smithi191 ceph-mon[77624]: pgmap v119: 65 pgs: 8 peering, 15 active+undersized, 15 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 43/225 objects degraded (19.111%) 2024-09-19T09:42:09.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:08 smithi191 ceph-mon[77624]: Health check update: Degraded data redundancy: 43/225 objects degraded (19.111%), 15 pgs degraded (PG_DEGRADED) 2024-09-19T09:42:09.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:08 smithi112 ceph-mon[97503]: Health check update: Degraded data redundancy: 43/225 objects degraded (19.111%), 15 pgs degraded (PG_DEGRADED) 2024-09-19T09:42:10.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:09 smithi191 ceph-mon[77624]: pgmap v120: 65 pgs: 8 peering, 8 active+undersized, 8 active+undersized+degraded, 41 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 24/225 objects degraded (10.667%) 2024-09-19T09:42:10.089 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:09 smithi112 ceph-mon[97503]: pgmap v120: 65 pgs: 8 peering, 8 active+undersized, 8 active+undersized+degraded, 41 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 24/225 objects degraded (10.667%) 2024-09-19T09:42:11.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:10 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:10 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:42:11.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:10 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:11.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:10 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:42:12.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:11 smithi112 ceph-mon[97503]: pgmap v121: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 886 B/s rd, 1 op/s 2024-09-19T09:42:12.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:11 smithi112 ceph-mon[97503]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/225 objects degraded (10.667%), 8 pgs degraded) 2024-09-19T09:42:12.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:11 smithi112 ceph-mon[97503]: Cluster is now healthy 2024-09-19T09:42:12.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:11 smithi191 ceph-mon[77624]: pgmap v121: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 886 B/s rd, 1 op/s 2024-09-19T09:42:12.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:11 smithi191 ceph-mon[77624]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/225 objects degraded (10.667%), 8 pgs degraded) 2024-09-19T09:42:12.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:11 smithi191 ceph-mon[77624]: Cluster is now healthy 2024-09-19T09:42:14.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:13 smithi112 ceph-mon[97503]: pgmap v122: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-19T09:42:14.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:13 smithi191 ceph-mon[77624]: pgmap v122: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-19T09:42:16.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:15 smithi112 ceph-mon[97503]: pgmap v123: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:42:16.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:15 smithi191 ceph-mon[77624]: pgmap v123: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:42:17.124 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:16 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:42:17.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:16 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:42:17.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:17 smithi112 ceph-mon[97503]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:42:17.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:17 smithi112 ceph-mon[97503]: Upgrade: osd.4 is safe to restart 2024-09-19T09:42:17.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:17 smithi112 ceph-mon[97503]: pgmap v124: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-19T09:42:18.155 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:17 smithi191 ceph-mon[77624]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:42:18.155 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:17 smithi191 ceph-mon[77624]: Upgrade: osd.4 is safe to restart 2024-09-19T09:42:18.155 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:17 smithi191 ceph-mon[77624]: pgmap v124: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-19T09:42:19.408 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:19 smithi191 ceph-mon[77624]: Upgrade: Updating osd.4 2024-09-19T09:42:19.408 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:19.408 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:42:19.409 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:42:19.409 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:19 smithi191 ceph-mon[77624]: Deploying daemon osd.4 on smithi191 2024-09-19T09:42:19.409 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:19 smithi191 ceph-mon[77624]: pgmap v125: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-19T09:42:19.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:19 smithi112 ceph-mon[97503]: Upgrade: Updating osd.4 2024-09-19T09:42:19.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:19.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:42:19.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:42:19.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:19 smithi112 ceph-mon[97503]: Deploying daemon osd.4 on smithi191 2024-09-19T09:42:19.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:19 smithi112 ceph-mon[97503]: pgmap v125: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-19T09:42:21.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:20 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:21.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:20 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:21.304 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:21 smithi191 systemd[1]: Stopping Ceph osd.4 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:42:21.784 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:21 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[46881]: 2024-09-19T09:42:21.301+0000 7f38a1393640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:42:21.785 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:21 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[46881]: 2024-09-19T09:42:21.301+0000 7f38a1393640 -1 osd.4 68 *** Got signal Terminated *** 2024-09-19T09:42:21.785 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:21 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[46881]: 2024-09-19T09:42:21.301+0000 7f38a1393640 -1 osd.4 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:42:22.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:21 smithi112 ceph-mon[97503]: pgmap v126: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-19T09:42:22.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:21 smithi112 ceph-mon[97503]: osd.4 marked itself down and dead 2024-09-19T09:42:22.223 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:21 smithi191 ceph-mon[77624]: pgmap v126: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-19T09:42:22.223 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:21 smithi191 ceph-mon[77624]: osd.4 marked itself down and dead 2024-09-19T09:42:22.488 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:22 smithi191 podman[91713]: 2024-09-19 09:42:22.221428509 +0000 UTC m=+1.029761442 container died bfa41c48a8a5dbc64fd1b8b31a0175fdd00e4eb4f9f88767cf0c9e7bf286a0f1 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=quincy-6e06d1e, ceph=True) 2024-09-19T09:42:22.784 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:22 smithi191 podman[91713]: 2024-09-19 09:42:22.587969139 +0000 UTC m=+1.396302058 container cleanup bfa41c48a8a5dbc64fd1b8b31a0175fdd00e4eb4f9f88767cf0c9e7bf286a0f1 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=quincy-6e06d1e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T09:42:22.785 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:22 smithi191 bash[91713]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4 2024-09-19T09:42:23.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:22 smithi112 ceph-mon[97503]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:42:23.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:22 smithi112 ceph-mon[97503]: osdmap e69: 6 total, 5 up, 6 in 2024-09-19T09:42:23.211 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:22 smithi191 podman[91730]: 2024-09-19 09:42:22.865885891 +0000 UTC m=+0.647385596 container remove bfa41c48a8a5dbc64fd1b8b31a0175fdd00e4eb4f9f88767cf0c9e7bf286a0f1 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=quincy-6e06d1e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T09:42:23.211 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:22 smithi191 ceph-mon[77624]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:42:23.211 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:22 smithi191 ceph-mon[77624]: osdmap e69: 6 total, 5 up, 6 in 2024-09-19T09:42:23.465 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:23 smithi191 podman[91819]: 2024-09-19 09:42:23.112842321 +0000 UTC m=+0.016154050 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:42:23.465 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:23 smithi191 podman[91819]: 2024-09-19 09:42:23.218152144 +0000 UTC m=+0.121463863 container create f2fea5773f345fced2f0183cc297d9e0c5ced1d5a16c6493b068ee5698abe2c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T09:42:23.465 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:23 smithi191 podman[91819]: 2024-09-19 09:42:23.463834081 +0000 UTC m=+0.367145804 container init f2fea5773f345fced2f0183cc297d9e0c5ced1d5a16c6493b068ee5698abe2c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T09:42:23.785 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:23 smithi191 podman[91819]: 2024-09-19 09:42:23.467461409 +0000 UTC m=+0.370773133 container start f2fea5773f345fced2f0183cc297d9e0c5ced1d5a16c6493b068ee5698abe2c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:42:23.785 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:23 smithi191 podman[91819]: 2024-09-19 09:42:23.555362216 +0000 UTC m=+0.458673938 container attach f2fea5773f345fced2f0183cc297d9e0c5ced1d5a16c6493b068ee5698abe2c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T09:42:23.785 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:23 smithi191 podman[91819]: 2024-09-19 09:42:23.656352318 +0000 UTC m=+0.559664037 container died f2fea5773f345fced2f0183cc297d9e0c5ced1d5a16c6493b068ee5698abe2c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T09:42:24.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:23 smithi112 ceph-mon[97503]: pgmap v128: 65 pgs: 8 peering, 5 stale+active+clean, 52 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-19T09:42:24.226 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:23 smithi112 ceph-mon[97503]: osdmap e70: 6 total, 5 up, 6 in 2024-09-19T09:42:24.226 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:23 smithi112 ceph-mon[97503]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T09:42:24.229 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:23 smithi191 ceph-mon[77624]: pgmap v128: 65 pgs: 8 peering, 5 stale+active+clean, 52 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-19T09:42:24.229 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:23 smithi191 ceph-mon[77624]: osdmap e70: 6 total, 5 up, 6 in 2024-09-19T09:42:24.229 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:23 smithi191 ceph-mon[77624]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T09:42:24.535 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:24 smithi191 podman[91842]: 2024-09-19 09:42:24.228423806 +0000 UTC m=+0.566005851 container remove f2fea5773f345fced2f0183cc297d9e0c5ced1d5a16c6493b068ee5698abe2c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T09:42:24.535 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:24 smithi191 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-19T09:42:24.535 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:24 smithi191 systemd[1]: Stopped Ceph osd.4 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:42:24.535 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:24 smithi191 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.4.service: Consumed 57.605s CPU time. 2024-09-19T09:42:24.535 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:24 smithi191 systemd[1]: Starting Ceph osd.4 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:42:24.917 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:24 smithi191 podman[91941]: 2024-09-19 09:42:24.567951009 +0000 UTC m=+0.015500352 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:42:24.918 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:24 smithi191 podman[91941]: 2024-09-19 09:42:24.671903459 +0000 UTC m=+0.119452799 container create 244bae57fb903c8f61c63ab8c4ed686c2ff530876badc8c5c1399b709c773972 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T09:42:25.285 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:24 smithi191 podman[91941]: 2024-09-19 09:42:24.916634761 +0000 UTC m=+0.364184095 container init 244bae57fb903c8f61c63ab8c4ed686c2ff530876badc8c5c1399b709c773972 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T09:42:25.285 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:24 smithi191 podman[91941]: 2024-09-19 09:42:24.920320145 +0000 UTC m=+0.367869482 container start 244bae57fb903c8f61c63ab8c4ed686c2ff530876badc8c5c1399b709c773972 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T09:42:25.285 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:24 smithi191 podman[91941]: 2024-09-19 09:42:24.999905712 +0000 UTC m=+0.447455061 container attach 244bae57fb903c8f61c63ab8c4ed686c2ff530876badc8c5c1399b709c773972 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T09:42:25.285 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:25 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-activate[91956]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:42:25.285 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:25 smithi191 bash[91941]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:42:25.285 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:25 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-activate[91956]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:42:25.285 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:25 smithi191 bash[91941]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:42:26.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:25 smithi191 ceph-mon[77624]: pgmap v130: 65 pgs: 8 active+undersized, 16 peering, 1 stale+active+clean, 5 active+undersized+degraded, 35 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 19/225 objects degraded (8.444%) 2024-09-19T09:42:26.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:26.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:42:26.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:25 smithi191 ceph-mon[77624]: Health check failed: Degraded data redundancy: 19/225 objects degraded (8.444%), 5 pgs degraded (PG_DEGRADED) 2024-09-19T09:42:26.035 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:25 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-activate[91956]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T09:42:26.035 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:25 smithi191 bash[91941]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T09:42:26.035 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:25 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-activate[91956]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-19T09:42:26.036 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:25 smithi191 bash[91941]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-19T09:42:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:25 smithi112 ceph-mon[97503]: pgmap v130: 65 pgs: 8 active+undersized, 16 peering, 1 stale+active+clean, 5 active+undersized+degraded, 35 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 19/225 objects degraded (8.444%) 2024-09-19T09:42:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:42:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:25 smithi112 ceph-mon[97503]: Health check failed: Degraded data redundancy: 19/225 objects degraded (8.444%), 5 pgs degraded (PG_DEGRADED) 2024-09-19T09:42:26.396 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:26 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-activate[91956]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-19T09:42:26.397 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:26 smithi191 bash[91941]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-19T09:42:26.397 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:26 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-activate[91956]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-19T09:42:26.397 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:26 smithi191 bash[91941]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-19T09:42:26.397 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:26 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-activate[91956]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-19T09:42:26.397 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:26 smithi191 bash[91941]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-19T09:42:26.397 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:26 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-activate[91956]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T09:42:26.397 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:26 smithi191 bash[91941]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T09:42:26.397 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:26 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-activate[91956]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-19T09:42:26.397 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:26 smithi191 bash[91941]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-19T09:42:26.397 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:26 smithi191 podman[91941]: 2024-09-19 09:42:26.096853008 +0000 UTC m=+1.544402349 container died 244bae57fb903c8f61c63ab8c4ed686c2ff530876badc8c5c1399b709c773972 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:42:27.035 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:26 smithi191 podman[92095]: 2024-09-19 09:42:26.714345273 +0000 UTC m=+0.611228379 container remove 244bae57fb903c8f61c63ab8c4ed686c2ff530876badc8c5c1399b709c773972 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:42:27.035 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:26 smithi191 podman[92153]: 2024-09-19 09:42:26.824775473 +0000 UTC m=+0.016025269 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:42:27.035 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:26 smithi191 podman[92153]: 2024-09-19 09:42:26.940294994 +0000 UTC m=+0.131544775 container create 3cd638400a3a5dc0677005c6f53ceffde898c74e409e03aa1745e4f3d6315a28 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T09:42:27.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.103+0000 7f3c11dbb640 1 -- 172.21.15.112:0/125147225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c102550 msgr2=0x7f3c0c102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.103+0000 7f3c11dbb640 1 --2- 172.21.15.112:0/125147225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c102550 0x7f3c0c102920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc0048d0 tx=0x7f3bfc009da0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.103+0000 7f3c11dbb640 1 -- 172.21.15.112:0/125147225 shutdown_connections 2024-09-19T09:42:27.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.103+0000 7f3c11dbb640 1 --2- 172.21.15.112:0/125147225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c0c102ef0 0x7f3c0c0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.103+0000 7f3c11dbb640 1 --2- 172.21.15.112:0/125147225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c102550 0x7f3c0c102920 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.103+0000 7f3c11dbb640 1 -- 172.21.15.112:0/125147225 >> 172.21.15.112:0/125147225 conn(0x7f3c0c0f80f0 msgr2=0x7f3c0c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:27.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.103+0000 7f3c11dbb640 1 -- 172.21.15.112:0/125147225 shutdown_connections 2024-09-19T09:42:27.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.103+0000 7f3c11dbb640 1 -- 172.21.15.112:0/125147225 wait complete. 2024-09-19T09:42:27.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.104+0000 7f3c11dbb640 1 Processor -- start 2024-09-19T09:42:27.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.104+0000 7f3c11dbb640 1 -- start start 2024-09-19T09:42:27.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.105+0000 7f3c11dbb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c102550 0x7f3c0c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.105+0000 7f3c11dbb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c0c102ef0 0x7f3c0c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.105+0000 7f3c11dbb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c070520 con 0x7f3c0c102550 2024-09-19T09:42:27.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.105+0000 7f3c11dbb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c070690 con 0x7f3c0c102ef0 2024-09-19T09:42:27.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.105+0000 7f3c0b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c102550 0x7f3c0c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.105+0000 7f3c0b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c102550 0x7f3c0c06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47602/0 (socket says 172.21.15.112:47602) 2024-09-19T09:42:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.105+0000 7f3c0b7fe640 1 -- 172.21.15.112:0/1625062452 learned_addr learned my addr 172.21.15.112:0/1625062452 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:42:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.105+0000 7f3c0affd640 1 --2- 172.21.15.112:0/1625062452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c0c102ef0 0x7f3c0c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.105+0000 7f3c0b7fe640 1 -- 172.21.15.112:0/1625062452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c0c102ef0 msgr2=0x7f3c0c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.105+0000 7f3c0b7fe640 1 --2- 172.21.15.112:0/1625062452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c0c102ef0 0x7f3c0c06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.105+0000 7f3c0b7fe640 1 -- 172.21.15.112:0/1625062452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc005040 con 0x7f3c0c102550 2024-09-19T09:42:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.106+0000 7f3c0b7fe640 1 --2- 172.21.15.112:0/1625062452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c102550 0x7f3c0c06fa10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc000c00 tx=0x7f3bfc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:27.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.106+0000 7f3bf3fff640 1 -- 172.21.15.112:0/1625062452 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bfc038070 con 0x7f3c0c102550 2024-09-19T09:42:27.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.106+0000 7f3c11dbb640 1 -- 172.21.15.112:0/1625062452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0c1198d0 con 0x7f3c0c102550 2024-09-19T09:42:27.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.106+0000 7f3bf3fff640 1 -- 172.21.15.112:0/1625062452 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3bfc03daf0 con 0x7f3c0c102550 2024-09-19T09:42:27.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.106+0000 7f3bf3fff640 1 -- 172.21.15.112:0/1625062452 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bfc033b50 con 0x7f3c0c102550 2024-09-19T09:42:27.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.106+0000 7f3c11dbb640 1 -- 172.21.15.112:0/1625062452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c119d30 con 0x7f3c0c102550 2024-09-19T09:42:27.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.107+0000 7f3c11dbb640 1 -- 172.21.15.112:0/1625062452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0c0fdcd0 con 0x7f3c0c102550 2024-09-19T09:42:27.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.107+0000 7f3bf3fff640 1 -- 172.21.15.112:0/1625062452 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3bfc030020 con 0x7f3c0c102550 2024-09-19T09:42:27.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.108+0000 7f3bf3fff640 1 --2- 172.21.15.112:0/1625062452 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3bf406e530 0x7f3bf40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.108+0000 7f3bf3fff640 1 -- 172.21.15.112:0/1625062452 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3bfc0ae2e0 con 0x7f3c0c102550 2024-09-19T09:42:27.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.108+0000 7f3c0affd640 1 --2- 172.21.15.112:0/1625062452 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3bf406e530 0x7f3bf40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.109+0000 7f3c0affd640 1 --2- 172.21.15.112:0/1625062452 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3bf406e530 0x7f3bf40709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c071350 tx=0x7f3c000090f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:27.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.113+0000 7f3bf3fff640 1 -- 172.21.15.112:0/1625062452 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3bfc077470 con 0x7f3c0c102550 2024-09-19T09:42:27.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.297+0000 7f3c11dbb640 1 -- 172.21.15.112:0/1625062452 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c0c071100 con 0x7f3bf406e530 2024-09-19T09:42:27.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.298+0000 7f3bf3fff640 1 -- 172.21.15.112:0/1625062452 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f3c0c071100 con 0x7f3bf406e530 2024-09-19T09:42:27.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.300+0000 7f3c11dbb640 1 -- 172.21.15.112:0/1625062452 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3bf406e530 msgr2=0x7f3bf40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.300+0000 7f3c11dbb640 1 --2- 172.21.15.112:0/1625062452 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3bf406e530 0x7f3bf40709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c071350 tx=0x7f3c000090f0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.300+0000 7f3c11dbb640 1 -- 172.21.15.112:0/1625062452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c102550 msgr2=0x7f3c0c06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.300+0000 7f3c11dbb640 1 --2- 172.21.15.112:0/1625062452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c102550 0x7f3c0c06fa10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc000c00 tx=0x7f3bfc009da0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.300+0000 7f3c11dbb640 1 -- 172.21.15.112:0/1625062452 shutdown_connections 2024-09-19T09:42:27.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.300+0000 7f3c11dbb640 1 --2- 172.21.15.112:0/1625062452 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3bf406e530 0x7f3bf40709e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.300+0000 7f3c11dbb640 1 --2- 172.21.15.112:0/1625062452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c0c102ef0 0x7f3c0c06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.300+0000 7f3c11dbb640 1 --2- 172.21.15.112:0/1625062452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c102550 0x7f3c0c06fa10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.300+0000 7f3c11dbb640 1 -- 172.21.15.112:0/1625062452 >> 172.21.15.112:0/1625062452 conn(0x7f3c0c0f80f0 msgr2=0x7f3c0c0f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:27.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.300+0000 7f3c11dbb640 1 -- 172.21.15.112:0/1625062452 shutdown_connections 2024-09-19T09:42:27.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.300+0000 7f3c11dbb640 1 -- 172.21.15.112:0/1625062452 wait complete. 2024-09-19T09:42:27.311 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:42:27.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.383+0000 7f29ff06b640 1 -- 172.21.15.112:0/2501673364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29f8102ed0 msgr2=0x7f29f80fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.383+0000 7f29ff06b640 1 --2- 172.21.15.112:0/2501673364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29f8102ed0 0x7f29f80fc590 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f29e40048d0 tx=0x7f29e4009da0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.383+0000 7f29ff06b640 1 -- 172.21.15.112:0/2501673364 shutdown_connections 2024-09-19T09:42:27.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.383+0000 7f29ff06b640 1 --2- 172.21.15.112:0/2501673364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29f8102ed0 0x7f29f80fc590 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.383+0000 7f29ff06b640 1 --2- 172.21.15.112:0/2501673364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29f8102530 0x7f29f8102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.383+0000 7f29ff06b640 1 -- 172.21.15.112:0/2501673364 >> 172.21.15.112:0/2501673364 conn(0x7f29f80f80f0 msgr2=0x7f29f80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:27.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.383+0000 7f29ff06b640 1 -- 172.21.15.112:0/2501673364 shutdown_connections 2024-09-19T09:42:27.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.383+0000 7f29ff06b640 1 -- 172.21.15.112:0/2501673364 wait complete. 2024-09-19T09:42:27.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.383+0000 7f29ff06b640 1 Processor -- start 2024-09-19T09:42:27.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.383+0000 7f29ff06b640 1 -- start start 2024-09-19T09:42:27.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.384+0000 7f29ff06b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29f8102530 0x7f29f806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.384+0000 7f29ff06b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29f8102ed0 0x7f29f806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.384+0000 7f29ff06b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f8070490 con 0x7f29f8102ed0 2024-09-19T09:42:27.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.384+0000 7f29ff06b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f8070600 con 0x7f29f8102530 2024-09-19T09:42:27.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.384+0000 7f29f7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29f8102ed0 0x7f29f806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.384+0000 7f29fce07640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29f8102530 0x7f29f806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.384+0000 7f29f7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29f8102ed0 0x7f29f806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47628/0 (socket says 172.21.15.112:47628) 2024-09-19T09:42:27.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.384+0000 7f29f7fff640 1 -- 172.21.15.112:0/4075650827 learned_addr learned my addr 172.21.15.112:0/4075650827 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:42:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.384+0000 7f29f7fff640 1 -- 172.21.15.112:0/4075650827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29f8102530 msgr2=0x7f29f806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.384+0000 7f29f7fff640 1 --2- 172.21.15.112:0/4075650827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29f8102530 0x7f29f806fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.384+0000 7f29f7fff640 1 -- 172.21.15.112:0/4075650827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4005040 con 0x7f29f8102ed0 2024-09-19T09:42:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.384+0000 7f29fce07640 1 --2- 172.21.15.112:0/4075650827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29f8102530 0x7f29f806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.385+0000 7f29f7fff640 1 --2- 172.21.15.112:0/4075650827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29f8102ed0 0x7f29f806ff50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f29e402a530 tx=0x7f29e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.385+0000 7f29f57fa640 1 -- 172.21.15.112:0/4075650827 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e4038070 con 0x7f29f8102ed0 2024-09-19T09:42:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.385+0000 7f29ff06b640 1 -- 172.21.15.112:0/4075650827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f8070830 con 0x7f29f8102ed0 2024-09-19T09:42:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.385+0000 7f29f57fa640 1 -- 172.21.15.112:0/4075650827 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f29e402ade0 con 0x7f29f8102ed0 2024-09-19T09:42:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.385+0000 7f29f57fa640 1 -- 172.21.15.112:0/4075650827 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e402c7a0 con 0x7f29f8102ed0 2024-09-19T09:42:27.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.386+0000 7f29ff06b640 1 -- 172.21.15.112:0/4075650827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f8119820 con 0x7f29f8102ed0 2024-09-19T09:42:27.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.387+0000 7f29f57fa640 1 -- 172.21.15.112:0/4075650827 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f29e4030020 con 0x7f29f8102ed0 2024-09-19T09:42:27.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.387+0000 7f29ff06b640 1 -- 172.21.15.112:0/4075650827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f80fdcb0 con 0x7f29f8102ed0 2024-09-19T09:42:27.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.387+0000 7f29f57fa640 1 --2- 172.21.15.112:0/4075650827 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f29e806e530 0x7f29e80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.387+0000 7f29f57fa640 1 -- 172.21.15.112:0/4075650827 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f29e40ae590 con 0x7f29f8102ed0 2024-09-19T09:42:27.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.387+0000 7f29fce07640 1 --2- 172.21.15.112:0/4075650827 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f29e806e530 0x7f29e80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.388+0000 7f29fce07640 1 --2- 172.21.15.112:0/4075650827 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f29e806e530 0x7f29e80709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f29ec004fd0 tx=0x7f29ec00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.392+0000 7f29f57fa640 1 -- 172.21.15.112:0/4075650827 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f29e4077680 con 0x7f29f8102ed0 2024-09-19T09:42:27.534 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:27 smithi191 podman[92153]: 2024-09-19 09:42:27.162571334 +0000 UTC m=+0.353821128 container init 3cd638400a3a5dc0677005c6f53ceffde898c74e409e03aa1745e4f3d6315a28 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T09:42:27.535 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:27 smithi191 podman[92153]: 2024-09-19 09:42:27.166302093 +0000 UTC m=+0.357551870 container start 3cd638400a3a5dc0677005c6f53ceffde898c74e409e03aa1745e4f3d6315a28 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T09:42:27.535 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:27 smithi191 ceph-osd[92172]: -- 172.21.15.191:0/2045193007 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f3795201e0 con 0x55f378735c00 2024-09-19T09:42:27.535 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:27 smithi191 bash[92153]: 3cd638400a3a5dc0677005c6f53ceffde898c74e409e03aa1745e4f3d6315a28 2024-09-19T09:42:27.535 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:27 smithi191 systemd[1]: Started Ceph osd.4 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:42:27.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.584+0000 7f29ff06b640 1 -- 172.21.15.112:0/4075650827 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29f804b720 con 0x7f29e806e530 2024-09-19T09:42:27.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.585+0000 7f29f57fa640 1 -- 172.21.15.112:0/4075650827 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f29f804b720 con 0x7f29e806e530 2024-09-19T09:42:27.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.587+0000 7f29ff06b640 1 -- 172.21.15.112:0/4075650827 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f29e806e530 msgr2=0x7f29e80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.587+0000 7f29ff06b640 1 --2- 172.21.15.112:0/4075650827 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f29e806e530 0x7f29e80709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f29ec004fd0 tx=0x7f29ec00b040 comp rx=0 tx=0).stop 2024-09-19T09:42:27.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.587+0000 7f29ff06b640 1 -- 172.21.15.112:0/4075650827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29f8102ed0 msgr2=0x7f29f806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.587+0000 7f29ff06b640 1 --2- 172.21.15.112:0/4075650827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29f8102ed0 0x7f29f806ff50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f29e402a530 tx=0x7f29e4009da0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.588+0000 7f29ff06b640 1 -- 172.21.15.112:0/4075650827 shutdown_connections 2024-09-19T09:42:27.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.588+0000 7f29ff06b640 1 --2- 172.21.15.112:0/4075650827 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f29e806e530 0x7f29e80709e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.588+0000 7f29ff06b640 1 --2- 172.21.15.112:0/4075650827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29f8102ed0 0x7f29f806ff50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.588+0000 7f29ff06b640 1 --2- 172.21.15.112:0/4075650827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29f8102530 0x7f29f806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.588+0000 7f29ff06b640 1 -- 172.21.15.112:0/4075650827 >> 172.21.15.112:0/4075650827 conn(0x7f29f80f80f0 msgr2=0x7f29f80f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:27.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.588+0000 7f29ff06b640 1 -- 172.21.15.112:0/4075650827 shutdown_connections 2024-09-19T09:42:27.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.588+0000 7f29ff06b640 1 -- 172.21.15.112:0/4075650827 wait complete. 2024-09-19T09:42:27.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.670+0000 7ff4fe9ca640 1 -- 172.21.15.112:0/991428540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f80fe460 msgr2=0x7ff4f80fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.670+0000 7ff4fe9ca640 1 --2- 172.21.15.112:0/991428540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f80fe460 0x7ff4f80fe830 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80048d0 tx=0x7ff4e8009da0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.670+0000 7ff4fe9ca640 1 -- 172.21.15.112:0/991428540 shutdown_connections 2024-09-19T09:42:27.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.670+0000 7ff4fe9ca640 1 --2- 172.21.15.112:0/991428540 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f8064fc0 0x7ff4f8065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.670+0000 7ff4fe9ca640 1 --2- 172.21.15.112:0/991428540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f80fe460 0x7ff4f80fe830 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.670+0000 7ff4fe9ca640 1 -- 172.21.15.112:0/991428540 >> 172.21.15.112:0/991428540 conn(0x7ff4f80723b0 msgr2=0x7ff4f80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:27.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.670+0000 7ff4fe9ca640 1 -- 172.21.15.112:0/991428540 shutdown_connections 2024-09-19T09:42:27.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.670+0000 7ff4fe9ca640 1 -- 172.21.15.112:0/991428540 wait complete. 2024-09-19T09:42:27.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.671+0000 7ff4fe9ca640 1 Processor -- start 2024-09-19T09:42:27.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.671+0000 7ff4fe9ca640 1 -- start start 2024-09-19T09:42:27.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.671+0000 7ff4fe9ca640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f8064fc0 0x7ff4f81131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.671+0000 7ff4fe9ca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f80fe460 0x7ff4f81136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.671+0000 7ff4fe9ca640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f8113cf0 con 0x7ff4f80fe460 2024-09-19T09:42:27.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.671+0000 7ff4fe9ca640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f810d130 con 0x7ff4f8064fc0 2024-09-19T09:42:27.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.671+0000 7ff4f77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f80fe460 0x7ff4f81136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.671+0000 7ff4f77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f80fe460 0x7ff4f81136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47644/0 (socket says 172.21.15.112:47644) 2024-09-19T09:42:27.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.671+0000 7ff4f77fe640 1 -- 172.21.15.112:0/1812472261 learned_addr learned my addr 172.21.15.112:0/1812472261 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:42:27.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.671+0000 7ff4f7fff640 1 --2- 172.21.15.112:0/1812472261 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f8064fc0 0x7ff4f81131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.672+0000 7ff4f77fe640 1 -- 172.21.15.112:0/1812472261 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f8064fc0 msgr2=0x7ff4f81131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.672+0000 7ff4f77fe640 1 --2- 172.21.15.112:0/1812472261 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f8064fc0 0x7ff4f81131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.672+0000 7ff4f77fe640 1 -- 172.21.15.112:0/1812472261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e8005040 con 0x7ff4f80fe460 2024-09-19T09:42:27.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.672+0000 7ff4f77fe640 1 --2- 172.21.15.112:0/1812472261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f80fe460 0x7ff4f81136f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec002a50 tx=0x7ff4ec004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:27.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.672+0000 7ff4f4ff9640 1 -- 172.21.15.112:0/1812472261 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4ec007c30 con 0x7ff4f80fe460 2024-09-19T09:42:27.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.672+0000 7ff4f4ff9640 1 -- 172.21.15.112:0/1812472261 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff4ec00f040 con 0x7ff4f80fe460 2024-09-19T09:42:27.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.672+0000 7ff4fe9ca640 1 -- 172.21.15.112:0/1812472261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f810d410 con 0x7ff4f80fe460 2024-09-19T09:42:27.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.672+0000 7ff4f4ff9640 1 -- 172.21.15.112:0/1812472261 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4ec00da10 con 0x7ff4f80fe460 2024-09-19T09:42:27.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.672+0000 7ff4fe9ca640 1 -- 172.21.15.112:0/1812472261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f810d9b0 con 0x7ff4f80fe460 2024-09-19T09:42:27.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.673+0000 7ff4fe9ca640 1 -- 172.21.15.112:0/1812472261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f80fdcf0 con 0x7ff4f80fe460 2024-09-19T09:42:27.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.674+0000 7ff4f4ff9640 1 -- 172.21.15.112:0/1812472261 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff4ec00dc80 con 0x7ff4f80fe460 2024-09-19T09:42:27.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.674+0000 7ff4f4ff9640 1 --2- 172.21.15.112:0/1812472261 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff4e006e530 0x7ff4e00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.674+0000 7ff4f4ff9640 1 -- 172.21.15.112:0/1812472261 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff4ec08d8c0 con 0x7ff4f80fe460 2024-09-19T09:42:27.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.674+0000 7ff4f7fff640 1 --2- 172.21.15.112:0/1812472261 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff4e006e530 0x7ff4e00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.675+0000 7ff4f7fff640 1 --2- 172.21.15.112:0/1812472261 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff4e006e530 0x7ff4e00709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009ac0 tx=0x7ff4e8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:27.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.679+0000 7ff4f4ff9640 1 -- 172.21.15.112:0/1812472261 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff4ec056b00 con 0x7ff4f80fe460 2024-09-19T09:42:27.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.856+0000 7ff4fe9ca640 1 -- 172.21.15.112:0/1812472261 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4f810e820 con 0x7ff4e006e530 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.865+0000 7ff4f4ff9640 1 -- 172.21.15.112:0/1812472261 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff4f810e820 con 0x7ff4e006e530 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (6m) 62s ago 15m 26.9M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (2m) 62s ago 15m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 70bad8ff6ec4 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (2m) 30s ago 14m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 6f8cb10f4c96 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (4m) 62s ago 15m 79.1M - 9.4.12 2bacad6d85d8 e462aca2b022 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (9m) 62s ago 9m 153M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (9m) 62s ago 9m 106M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (9m) 30s ago 9m 14.2M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (9m) 30s ago 9m 16.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (6m) 62s ago 16m 500M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283,8765 running (5m) 30s ago 14m 441M - 19.1.1-361-g2f599a46 d2baa855c067 fddba1bee64a 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (3m) 62s ago 16m 45.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 89dfb5de44c8 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (3m) 30s ago 14m 39.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 3cab8f7cc27e 2024-09-19T09:42:27.868 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (7m) 62s ago 15m 15.7M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:42:27.868 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (6m) 30s ago 14m 15.9M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:42:27.868 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (2m) 62s ago 13m 99.9M 1557M 19.1.1-361-g2f599a46 d2baa855c067 11a51e663887 2024-09-19T09:42:27.868 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (103s) 62s ago 13m 101M 1557M 19.1.1-361-g2f599a46 d2baa855c067 bd616fcb189b 2024-09-19T09:42:27.868 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (67s) 62s ago 12m 14.3M 1557M 19.1.1-361-g2f599a46 d2baa855c067 4a651b62590f 2024-09-19T09:42:27.868 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (33s) 30s ago 12m 12.1M 2581M 19.1.1-361-g2f599a46 d2baa855c067 7f953c691608 2024-09-19T09:42:27.868 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 starting - - - 2581M 2024-09-19T09:42:27.868 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (11m) 30s ago 11m 226M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 444e804432fd 2024-09-19T09:42:27.868 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (5m) 62s ago 14m 63.6M - 2.43.0 a07b618ecd1d 54850883a171 2024-09-19T09:42:27.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.867+0000 7ff4fe9ca640 1 -- 172.21.15.112:0/1812472261 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff4e006e530 msgr2=0x7ff4e00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.867+0000 7ff4fe9ca640 1 --2- 172.21.15.112:0/1812472261 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff4e006e530 0x7ff4e00709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009ac0 tx=0x7ff4e8035040 comp rx=0 tx=0).stop 2024-09-19T09:42:27.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.867+0000 7ff4fe9ca640 1 -- 172.21.15.112:0/1812472261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f80fe460 msgr2=0x7ff4f81136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.867+0000 7ff4fe9ca640 1 --2- 172.21.15.112:0/1812472261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f80fe460 0x7ff4f81136f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec002a50 tx=0x7ff4ec004600 comp rx=0 tx=0).stop 2024-09-19T09:42:27.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.867+0000 7ff4fe9ca640 1 -- 172.21.15.112:0/1812472261 shutdown_connections 2024-09-19T09:42:27.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.867+0000 7ff4fe9ca640 1 --2- 172.21.15.112:0/1812472261 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff4e006e530 0x7ff4e00709e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.867+0000 7ff4fe9ca640 1 --2- 172.21.15.112:0/1812472261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f80fe460 0x7ff4f81136f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.867+0000 7ff4fe9ca640 1 --2- 172.21.15.112:0/1812472261 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f8064fc0 0x7ff4f81131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.867+0000 7ff4fe9ca640 1 -- 172.21.15.112:0/1812472261 >> 172.21.15.112:0/1812472261 conn(0x7ff4f80723b0 msgr2=0x7ff4f8105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:27.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.867+0000 7ff4fe9ca640 1 -- 172.21.15.112:0/1812472261 shutdown_connections 2024-09-19T09:42:27.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.867+0000 7ff4fe9ca640 1 -- 172.21.15.112:0/1812472261 wait complete. 2024-09-19T09:42:27.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:27 smithi112 ceph-mon[97503]: pgmap v131: 65 pgs: 11 active+undersized, 16 peering, 7 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 23/225 objects degraded (10.222%) 2024-09-19T09:42:27.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:27 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:27.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:27 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:27.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:27 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:42:27.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.944+0000 7f7a8de6b640 1 -- 172.21.15.112:0/1393287330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a88102620 msgr2=0x7f7a881029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.944+0000 7f7a8de6b640 1 --2- 172.21.15.112:0/1393287330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a88102620 0x7f7a881029f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7a780048d0 tx=0x7f7a78009da0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.945+0000 7f7a8de6b640 1 -- 172.21.15.112:0/1393287330 shutdown_connections 2024-09-19T09:42:27.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.945+0000 7f7a8de6b640 1 --2- 172.21.15.112:0/1393287330 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a880fac80 0x7f7a880fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.945+0000 7f7a8de6b640 1 --2- 172.21.15.112:0/1393287330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a88102620 0x7f7a881029f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.945+0000 7f7a8de6b640 1 -- 172.21.15.112:0/1393287330 >> 172.21.15.112:0/1393287330 conn(0x7f7a88070ce0 msgr2=0x7f7a880710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.945+0000 7f7a8de6b640 1 -- 172.21.15.112:0/1393287330 shutdown_connections 2024-09-19T09:42:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.945+0000 7f7a8de6b640 1 -- 172.21.15.112:0/1393287330 wait complete. 2024-09-19T09:42:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.945+0000 7f7a8de6b640 1 Processor -- start 2024-09-19T09:42:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.945+0000 7f7a8de6b640 1 -- start start 2024-09-19T09:42:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.945+0000 7f7a8de6b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a880fac80 0x7f7a881131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.945+0000 7f7a8de6b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a88102620 0x7f7a88113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.945+0000 7f7a8de6b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a88113d00 con 0x7f7a88102620 2024-09-19T09:42:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.945+0000 7f7a8de6b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8810d140 con 0x7f7a880fac80 2024-09-19T09:42:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.945+0000 7f7a7ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a88102620 0x7f7a88113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.945+0000 7f7a7ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a88102620 0x7f7a88113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47658/0 (socket says 172.21.15.112:47658) 2024-09-19T09:42:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.945+0000 7f7a7ffff640 1 -- 172.21.15.112:0/2827018513 learned_addr learned my addr 172.21.15.112:0/2827018513 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:42:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.946+0000 7f7a877fe640 1 --2- 172.21.15.112:0/2827018513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a880fac80 0x7f7a881131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.946+0000 7f7a7ffff640 1 -- 172.21.15.112:0/2827018513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a880fac80 msgr2=0x7f7a881131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.946+0000 7f7a7ffff640 1 --2- 172.21.15.112:0/2827018513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a880fac80 0x7f7a881131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.946+0000 7f7a7ffff640 1 -- 172.21.15.112:0/2827018513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a78005040 con 0x7f7a88102620 2024-09-19T09:42:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.946+0000 7f7a7ffff640 1 --2- 172.21.15.112:0/2827018513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a88102620 0x7f7a88113700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000eb70 tx=0x7f7a7000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.946+0000 7f7a84ff9640 1 -- 172.21.15.112:0/2827018513 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a70007c30 con 0x7f7a88102620 2024-09-19T09:42:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.946+0000 7f7a84ff9640 1 -- 172.21.15.112:0/2827018513 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7a7000f040 con 0x7f7a88102620 2024-09-19T09:42:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.946+0000 7f7a84ff9640 1 -- 172.21.15.112:0/2827018513 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a7000ca60 con 0x7f7a88102620 2024-09-19T09:42:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.946+0000 7f7a8de6b640 1 -- 172.21.15.112:0/2827018513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8810d3c0 con 0x7f7a88102620 2024-09-19T09:42:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.946+0000 7f7a8de6b640 1 -- 172.21.15.112:0/2827018513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8810d960 con 0x7f7a88102620 2024-09-19T09:42:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.947+0000 7f7a8de6b640 1 -- 172.21.15.112:0/2827018513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a880657b0 con 0x7f7a88102620 2024-09-19T09:42:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.948+0000 7f7a84ff9640 1 -- 172.21.15.112:0/2827018513 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7a7000cbc0 con 0x7f7a88102620 2024-09-19T09:42:27.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.948+0000 7f7a84ff9640 1 --2- 172.21.15.112:0/2827018513 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7a7406e530 0x7f7a740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.948+0000 7f7a84ff9640 1 -- 172.21.15.112:0/2827018513 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7a7008dc50 con 0x7f7a88102620 2024-09-19T09:42:27.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.948+0000 7f7a877fe640 1 --2- 172.21.15.112:0/2827018513 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7a7406e530 0x7f7a740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.949+0000 7f7a877fe640 1 --2- 172.21.15.112:0/2827018513 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7a7406e530 0x7f7a740709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a78004540 tx=0x7f7a78035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:27.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:27.952+0000 7f7a84ff9640 1 -- 172.21.15.112:0/2827018513 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7a70056f10 con 0x7f7a88102620 2024-09-19T09:42:28.080 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:27 smithi191 ceph-mon[77624]: pgmap v131: 65 pgs: 11 active+undersized, 16 peering, 7 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 23/225 objects degraded (10.222%) 2024-09-19T09:42:28.080 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:27 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:28.080 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:27 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:28.080 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:27 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:42:28.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.181+0000 7f7a8de6b640 1 -- 172.21.15.112:0/2827018513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7a88109620 con 0x7f7a88102620 2024-09-19T09:42:28.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.181+0000 7f7a84ff9640 1 -- 172.21.15.112:0/2827018513 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f7a7005a5d0 con 0x7f7a88102620 2024-09-19T09:42:28.183 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:42:28.183 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:42:28.183 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:42:28.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:42:28.183 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:42:28.184 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:42:28.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:42:28.184 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:42:28.184 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 1, 2024-09-19T09:42:28.184 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T09:42:28.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:42:28.184 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:42:28.184 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:42:28.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:42:28.184 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:42:28.184 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 5, 2024-09-19T09:42:28.185 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 8 2024-09-19T09:42:28.185 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:42:28.185 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:42:28.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.183+0000 7f7a8de6b640 1 -- 172.21.15.112:0/2827018513 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7a7406e530 msgr2=0x7f7a740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:28.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.183+0000 7f7a8de6b640 1 --2- 172.21.15.112:0/2827018513 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7a7406e530 0x7f7a740709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a78004540 tx=0x7f7a78035040 comp rx=0 tx=0).stop 2024-09-19T09:42:28.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.183+0000 7f7a8de6b640 1 -- 172.21.15.112:0/2827018513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a88102620 msgr2=0x7f7a88113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:28.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.183+0000 7f7a8de6b640 1 --2- 172.21.15.112:0/2827018513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a88102620 0x7f7a88113700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000eb70 tx=0x7f7a7000b040 comp rx=0 tx=0).stop 2024-09-19T09:42:28.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.183+0000 7f7a8de6b640 1 -- 172.21.15.112:0/2827018513 shutdown_connections 2024-09-19T09:42:28.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.183+0000 7f7a8de6b640 1 --2- 172.21.15.112:0/2827018513 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f7a7406e530 0x7f7a740709e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.183+0000 7f7a8de6b640 1 --2- 172.21.15.112:0/2827018513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a88102620 0x7f7a88113700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.183+0000 7f7a8de6b640 1 --2- 172.21.15.112:0/2827018513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a880fac80 0x7f7a881131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.183+0000 7f7a8de6b640 1 -- 172.21.15.112:0/2827018513 >> 172.21.15.112:0/2827018513 conn(0x7f7a88070ce0 msgr2=0x7f7a88105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:28.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.183+0000 7f7a8de6b640 1 -- 172.21.15.112:0/2827018513 shutdown_connections 2024-09-19T09:42:28.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.183+0000 7f7a8de6b640 1 -- 172.21.15.112:0/2827018513 wait complete. 2024-09-19T09:42:28.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.262+0000 7f3c2ad36640 1 -- 172.21.15.112:0/2733920603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c24102ef0 msgr2=0x7f3c240fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:28.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.262+0000 7f3c2ad36640 1 --2- 172.21.15.112:0/2733920603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c24102ef0 0x7f3c240fc5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c100048d0 tx=0x7f3c10009da0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.262+0000 7f3c2ad36640 1 -- 172.21.15.112:0/2733920603 shutdown_connections 2024-09-19T09:42:28.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.262+0000 7f3c2ad36640 1 --2- 172.21.15.112:0/2733920603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c24102ef0 0x7f3c240fc5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.262+0000 7f3c2ad36640 1 --2- 172.21.15.112:0/2733920603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c24102550 0x7f3c24102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.262+0000 7f3c2ad36640 1 -- 172.21.15.112:0/2733920603 >> 172.21.15.112:0/2733920603 conn(0x7f3c240f80f0 msgr2=0x7f3c240fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:28.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.262+0000 7f3c2ad36640 1 -- 172.21.15.112:0/2733920603 shutdown_connections 2024-09-19T09:42:28.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.262+0000 7f3c2ad36640 1 -- 172.21.15.112:0/2733920603 wait complete. 2024-09-19T09:42:28.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.263+0000 7f3c2ad36640 1 Processor -- start 2024-09-19T09:42:28.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.263+0000 7f3c2ad36640 1 -- start start 2024-09-19T09:42:28.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.263+0000 7f3c2ad36640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c24102550 0x7f3c24113550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:28.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.263+0000 7f3c2ad36640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c24102ef0 0x7f3c24113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:28.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.263+0000 7f3c2ad36640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c241140e0 con 0x7f3c24102550 2024-09-19T09:42:28.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.263+0000 7f3c2ad36640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2410d4f0 con 0x7f3c24102ef0 2024-09-19T09:42:28.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.263+0000 7f3c28ad2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c24102550 0x7f3c24113550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:28.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.263+0000 7f3c28ad2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c24102550 0x7f3c24113550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47668/0 (socket says 172.21.15.112:47668) 2024-09-19T09:42:28.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.263+0000 7f3c28ad2640 1 -- 172.21.15.112:0/3236214943 learned_addr learned my addr 172.21.15.112:0/3236214943 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:42:28.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.264+0000 7f3c23fff640 1 --2- 172.21.15.112:0/3236214943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c24102ef0 0x7f3c24113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:28.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.264+0000 7f3c28ad2640 1 -- 172.21.15.112:0/3236214943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c24102ef0 msgr2=0x7f3c24113a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:28.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.264+0000 7f3c28ad2640 1 --2- 172.21.15.112:0/3236214943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c24102ef0 0x7f3c24113a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.264+0000 7f3c28ad2640 1 -- 172.21.15.112:0/3236214943 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c10005040 con 0x7f3c24102550 2024-09-19T09:42:28.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.264+0000 7f3c28ad2640 1 --2- 172.21.15.112:0/3236214943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c24102550 0x7f3c24113550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800eb70 tx=0x7f3c1800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:28.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.264+0000 7f3c217fa640 1 -- 172.21.15.112:0/3236214943 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c18007c30 con 0x7f3c24102550 2024-09-19T09:42:28.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.264+0000 7f3c2ad36640 1 -- 172.21.15.112:0/3236214943 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2410d770 con 0x7f3c24102550 2024-09-19T09:42:28.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.264+0000 7f3c217fa640 1 -- 172.21.15.112:0/3236214943 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c1800f040 con 0x7f3c24102550 2024-09-19T09:42:28.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.264+0000 7f3c217fa640 1 -- 172.21.15.112:0/3236214943 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c1800ca60 con 0x7f3c24102550 2024-09-19T09:42:28.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.264+0000 7f3c2ad36640 1 -- 172.21.15.112:0/3236214943 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2410dce0 con 0x7f3c24102550 2024-09-19T09:42:28.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.265+0000 7f3c2ad36640 1 -- 172.21.15.112:0/3236214943 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c240fdcd0 con 0x7f3c24102550 2024-09-19T09:42:28.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.266+0000 7f3c217fa640 1 -- 172.21.15.112:0/3236214943 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3c1800cbc0 con 0x7f3c24102550 2024-09-19T09:42:28.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.266+0000 7f3c217fa640 1 --2- 172.21.15.112:0/3236214943 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c1406e530 0x7f3c140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:28.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.267+0000 7f3c23fff640 1 --2- 172.21.15.112:0/3236214943 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c1406e530 0x7f3c140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:28.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.267+0000 7f3c217fa640 1 -- 172.21.15.112:0/3236214943 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3c1808dd30 con 0x7f3c24102550 2024-09-19T09:42:28.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.267+0000 7f3c23fff640 1 --2- 172.21.15.112:0/3236214943 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c1406e530 0x7f3c140709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c10000c00 tx=0x7f3c10035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:28.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.271+0000 7f3c217fa640 1 -- 172.21.15.112:0/3236214943 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3c18056f70 con 0x7f3c24102550 2024-09-19T09:42:28.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.473+0000 7f3c2ad36640 1 -- 172.21.15.112:0/3236214943 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3c2404b720 con 0x7f3c24102550 2024-09-19T09:42:28.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.473+0000 7f3c217fa640 1 -- 172.21.15.112:0/3236214943 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1949 (secure 0 0 0) 0x7f3c1805a630 con 0x7f3c24102550 2024-09-19T09:42:28.475 INFO:teuthology.orchestra.run.smithi112.stdout:e17 2024-09-19T09:42:28.475 INFO:teuthology.orchestra.run.smithi112.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:42:28.475 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:42:28.476 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:42:28.476 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-19T09:42:28.476 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:42:28.476 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:42:28.476 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-19T09:42:28.476 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 17 2024-09-19T09:42:28.476 INFO:teuthology.orchestra.run.smithi112.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:42:28.476 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:42:28.476 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-19T09:32:42.200999+0000 2024-09-19T09:42:28.476 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-19T09:42:28.476 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-19T09:42:28.476 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-19T09:42:28.476 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-19T09:42:28.477 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-19T09:42:28.477 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-19T09:42:28.477 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-19T09:42:28.477 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-19T09:42:28.477 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 45 2024-09-19T09:42:28.477 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:42:28.477 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-19T09:42:28.477 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-19T09:42:28.477 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14460} 2024-09-19T09:42:28.477 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-19T09:42:28.477 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-19T09:42:28.477 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-19T09:42:28.477 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-19T09:42:28.478 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-19T09:42:28.478 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data disabled 2024-09-19T09:42:28.478 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-19T09:42:28.478 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-19T09:42:28.478 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-19T09:42:28.478 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:42:28.478 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.hcoxjz{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:42:28.478 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ymjyok{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/3468750429,v1:172.21.15.112:6827/3468750429] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:42:28.478 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:42:28.478 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:42:28.478 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-19T09:42:28.478 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:42:28.478 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.qweljt{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:42:28.478 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.jjldod{-1:24281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6824/2759077122,v1:172.21.15.191:6825/2759077122] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:42:28.479 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2024-09-19T09:42:28.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.475+0000 7f3c2ad36640 1 -- 172.21.15.112:0/3236214943 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c1406e530 msgr2=0x7f3c140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:28.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.475+0000 7f3c2ad36640 1 --2- 172.21.15.112:0/3236214943 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c1406e530 0x7f3c140709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c10000c00 tx=0x7f3c10035040 comp rx=0 tx=0).stop 2024-09-19T09:42:28.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.475+0000 7f3c2ad36640 1 -- 172.21.15.112:0/3236214943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c24102550 msgr2=0x7f3c24113550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:28.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.475+0000 7f3c2ad36640 1 --2- 172.21.15.112:0/3236214943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c24102550 0x7f3c24113550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800eb70 tx=0x7f3c1800b040 comp rx=0 tx=0).stop 2024-09-19T09:42:28.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.475+0000 7f3c2ad36640 1 -- 172.21.15.112:0/3236214943 shutdown_connections 2024-09-19T09:42:28.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.475+0000 7f3c2ad36640 1 --2- 172.21.15.112:0/3236214943 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c1406e530 0x7f3c140709e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.475+0000 7f3c2ad36640 1 --2- 172.21.15.112:0/3236214943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c24102ef0 0x7f3c24113a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.475+0000 7f3c2ad36640 1 --2- 172.21.15.112:0/3236214943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c24102550 0x7f3c24113550 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.475+0000 7f3c2ad36640 1 -- 172.21.15.112:0/3236214943 >> 172.21.15.112:0/3236214943 conn(0x7f3c240f80f0 msgr2=0x7f3c240f90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:28.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.475+0000 7f3c2ad36640 1 -- 172.21.15.112:0/3236214943 shutdown_connections 2024-09-19T09:42:28.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.475+0000 7f3c2ad36640 1 -- 172.21.15.112:0/3236214943 wait complete. 2024-09-19T09:42:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.555+0000 7f183fb29640 1 -- 172.21.15.112:0/3719402353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18380fb550 msgr2=0x7f18380fb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.555+0000 7f183fb29640 1 --2- 172.21.15.112:0/3719402353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18380fb550 0x7f18380fb920 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f18340048d0 tx=0x7f1834009da0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.555+0000 7f183fb29640 1 -- 172.21.15.112:0/3719402353 shutdown_connections 2024-09-19T09:42:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.555+0000 7f183fb29640 1 --2- 172.21.15.112:0/3719402353 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18380fbef0 0x7f1838100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.555+0000 7f183fb29640 1 --2- 172.21.15.112:0/3719402353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18380fb550 0x7f18380fb920 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.555+0000 7f183fb29640 1 -- 172.21.15.112:0/3719402353 >> 172.21.15.112:0/3719402353 conn(0x7f18380f7030 msgr2=0x7f18380f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.555+0000 7f183fb29640 1 -- 172.21.15.112:0/3719402353 shutdown_connections 2024-09-19T09:42:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.555+0000 7f183fb29640 1 -- 172.21.15.112:0/3719402353 wait complete. 2024-09-19T09:42:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.556+0000 7f183fb29640 1 Processor -- start 2024-09-19T09:42:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.556+0000 7f183fb29640 1 -- start start 2024-09-19T09:42:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.556+0000 7f183fb29640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18380fb550 0x7f18381198e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:28.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.556+0000 7f183fb29640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18380fbef0 0x7f1838119e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:28.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.556+0000 7f183fb29640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183811a470 con 0x7f18380fbef0 2024-09-19T09:42:28.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.556+0000 7f183fb29640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1838113880 con 0x7f18380fb550 2024-09-19T09:42:28.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.556+0000 7f183d0c4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18380fbef0 0x7f1838119e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:28.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.556+0000 7f183d8c5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18380fb550 0x7f18381198e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:28.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.556+0000 7f183d0c4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18380fbef0 0x7f1838119e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54020/0 (socket says 172.21.15.112:54020) 2024-09-19T09:42:28.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.556+0000 7f183d0c4640 1 -- 172.21.15.112:0/2720189914 learned_addr learned my addr 172.21.15.112:0/2720189914 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:42:28.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.556+0000 7f183d0c4640 1 -- 172.21.15.112:0/2720189914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18380fb550 msgr2=0x7f18381198e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:28.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.556+0000 7f183d0c4640 1 --2- 172.21.15.112:0/2720189914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18380fb550 0x7f18381198e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.556+0000 7f183d0c4640 1 -- 172.21.15.112:0/2720189914 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1834005040 con 0x7f18380fbef0 2024-09-19T09:42:28.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.557+0000 7f183d0c4640 1 --2- 172.21.15.112:0/2720189914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18380fbef0 0x7f1838119e20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1828002840 tx=0x7f1828004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:28.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.557+0000 7f182e7fc640 1 -- 172.21.15.112:0/2720189914 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1828007c30 con 0x7f18380fbef0 2024-09-19T09:42:28.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.557+0000 7f182e7fc640 1 -- 172.21.15.112:0/2720189914 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f182800f040 con 0x7f18380fbef0 2024-09-19T09:42:28.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.557+0000 7f183fb29640 1 -- 172.21.15.112:0/2720189914 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1838113b60 con 0x7f18380fbef0 2024-09-19T09:42:28.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.557+0000 7f182e7fc640 1 -- 172.21.15.112:0/2720189914 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f182800d990 con 0x7f18380fbef0 2024-09-19T09:42:28.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.557+0000 7f183fb29640 1 -- 172.21.15.112:0/2720189914 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1838114100 con 0x7f18380fbef0 2024-09-19T09:42:28.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.558+0000 7f183fb29640 1 -- 172.21.15.112:0/2720189914 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18380fac90 con 0x7f18380fbef0 2024-09-19T09:42:28.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.559+0000 7f182e7fc640 1 -- 172.21.15.112:0/2720189914 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1828009600 con 0x7f18380fbef0 2024-09-19T09:42:28.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.559+0000 7f182e7fc640 1 --2- 172.21.15.112:0/2720189914 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f182406e530 0x7f18240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:28.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.559+0000 7f182e7fc640 1 -- 172.21.15.112:0/2720189914 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f182808de80 con 0x7f18380fbef0 2024-09-19T09:42:28.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.559+0000 7f183d8c5640 1 --2- 172.21.15.112:0/2720189914 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f182406e530 0x7f18240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:28.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.560+0000 7f183d8c5640 1 --2- 172.21.15.112:0/2720189914 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f182406e530 0x7f18240709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1834009ac0 tx=0x7f1834035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:28.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.565+0000 7f182e7fc640 1 -- 172.21.15.112:0/2720189914 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1828057010 con 0x7f18380fbef0 2024-09-19T09:42:28.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.746+0000 7f183fb29640 1 -- 172.21.15.112:0/2720189914 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f183804b720 con 0x7f182406e530 2024-09-19T09:42:28.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.747+0000 7f182e7fc640 1 -- 172.21.15.112:0/2720189914 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f183804b720 con 0x7f182406e530 2024-09-19T09:42:28.749 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:42:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:42:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:42:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:42:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-19T09:42:28.750 INFO:teuthology.orchestra.run.smithi112.stdout: "mon", 2024-09-19T09:42:28.750 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-19T09:42:28.750 INFO:teuthology.orchestra.run.smithi112.stdout: "crash" 2024-09-19T09:42:28.750 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-19T09:42:28.750 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "10/21 daemons upgraded", 2024-09-19T09:42:28.750 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T09:42:28.750 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:42:28.750 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:42:28.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.749+0000 7f183fb29640 1 -- 172.21.15.112:0/2720189914 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f182406e530 msgr2=0x7f18240709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:28.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.749+0000 7f183fb29640 1 --2- 172.21.15.112:0/2720189914 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f182406e530 0x7f18240709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1834009ac0 tx=0x7f1834035040 comp rx=0 tx=0).stop 2024-09-19T09:42:28.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.749+0000 7f183fb29640 1 -- 172.21.15.112:0/2720189914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18380fbef0 msgr2=0x7f1838119e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:28.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.749+0000 7f183fb29640 1 --2- 172.21.15.112:0/2720189914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18380fbef0 0x7f1838119e20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1828002840 tx=0x7f1828004570 comp rx=0 tx=0).stop 2024-09-19T09:42:28.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.749+0000 7f183fb29640 1 -- 172.21.15.112:0/2720189914 shutdown_connections 2024-09-19T09:42:28.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.749+0000 7f183fb29640 1 --2- 172.21.15.112:0/2720189914 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f182406e530 0x7f18240709e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.749+0000 7f183fb29640 1 --2- 172.21.15.112:0/2720189914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18380fbef0 0x7f1838119e20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.749+0000 7f183fb29640 1 --2- 172.21.15.112:0/2720189914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18380fb550 0x7f18381198e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.749+0000 7f183fb29640 1 -- 172.21.15.112:0/2720189914 >> 172.21.15.112:0/2720189914 conn(0x7f18380f7030 msgr2=0x7f18380f8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:28.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.750+0000 7f183fb29640 1 -- 172.21.15.112:0/2720189914 shutdown_connections 2024-09-19T09:42:28.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.750+0000 7f183fb29640 1 -- 172.21.15.112:0/2720189914 wait complete. 2024-09-19T09:42:28.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.830+0000 7f26bdf2b640 1 -- 172.21.15.112:0/960046287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26b80fdf00 msgr2=0x7f26b8106540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:28.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.830+0000 7f26bdf2b640 1 --2- 172.21.15.112:0/960046287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26b80fdf00 0x7f26b8106540 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0048d0 tx=0x7f26ac009da0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.830+0000 7f26bdf2b640 1 -- 172.21.15.112:0/960046287 shutdown_connections 2024-09-19T09:42:28.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.830+0000 7f26bdf2b640 1 --2- 172.21.15.112:0/960046287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26b80fdf00 0x7f26b8106540 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.830+0000 7f26bdf2b640 1 --2- 172.21.15.112:0/960046287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26b80fd560 0x7f26b80fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.830+0000 7f26bdf2b640 1 -- 172.21.15.112:0/960046287 >> 172.21.15.112:0/960046287 conn(0x7f26b80f7030 msgr2=0x7f26b80f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:28.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.830+0000 7f26bdf2b640 1 -- 172.21.15.112:0/960046287 shutdown_connections 2024-09-19T09:42:28.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.830+0000 7f26bdf2b640 1 -- 172.21.15.112:0/960046287 wait complete. 2024-09-19T09:42:28.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.831+0000 7f26bdf2b640 1 Processor -- start 2024-09-19T09:42:28.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.831+0000 7f26bdf2b640 1 -- start start 2024-09-19T09:42:28.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.831+0000 7f26bdf2b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26b80fd560 0x7f26b8113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:28.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.831+0000 7f26bdf2b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26b80fdf00 0x7f26b81136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:28.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.831+0000 7f26bdf2b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b8113cc0 con 0x7f26b80fd560 2024-09-19T09:42:28.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.831+0000 7f26bdf2b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b8113e30 con 0x7f26b80fdf00 2024-09-19T09:42:28.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.831+0000 7f26b77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26b80fd560 0x7f26b8113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:28.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.831+0000 7f26b77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26b80fd560 0x7f26b8113180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54044/0 (socket says 172.21.15.112:54044) 2024-09-19T09:42:28.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.831+0000 7f26b77fe640 1 -- 172.21.15.112:0/3552065152 learned_addr learned my addr 172.21.15.112:0/3552065152 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:42:28.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.831+0000 7f26b6ffd640 1 --2- 172.21.15.112:0/3552065152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26b80fdf00 0x7f26b81136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:28.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.832+0000 7f26b77fe640 1 -- 172.21.15.112:0/3552065152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26b80fdf00 msgr2=0x7f26b81136c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:28.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.832+0000 7f26b77fe640 1 --2- 172.21.15.112:0/3552065152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26b80fdf00 0x7f26b81136c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:28.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.832+0000 7f26b77fe640 1 -- 172.21.15.112:0/3552065152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac005040 con 0x7f26b80fd560 2024-09-19T09:42:28.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.832+0000 7f26b77fe640 1 --2- 172.21.15.112:0/3552065152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26b80fd560 0x7f26b8113180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f26a800eb70 tx=0x7f26a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:28.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.832+0000 7f269ffff640 1 -- 172.21.15.112:0/3552065152 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a8007c30 con 0x7f26b80fd560 2024-09-19T09:42:28.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.832+0000 7f26bdf2b640 1 -- 172.21.15.112:0/3552065152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b810d2c0 con 0x7f26b80fd560 2024-09-19T09:42:28.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.832+0000 7f269ffff640 1 -- 172.21.15.112:0/3552065152 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f26a800f040 con 0x7f26b80fd560 2024-09-19T09:42:28.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.832+0000 7f269ffff640 1 -- 172.21.15.112:0/3552065152 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a800ca60 con 0x7f26b80fd560 2024-09-19T09:42:28.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.832+0000 7f26bdf2b640 1 -- 172.21.15.112:0/3552065152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b810d7e0 con 0x7f26b80fd560 2024-09-19T09:42:28.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.833+0000 7f26bdf2b640 1 -- 172.21.15.112:0/3552065152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b80660f0 con 0x7f26b80fd560 2024-09-19T09:42:28.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.833+0000 7f269ffff640 1 -- 172.21.15.112:0/3552065152 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f26a800cbc0 con 0x7f26b80fd560 2024-09-19T09:42:28.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.834+0000 7f269ffff640 1 --2- 172.21.15.112:0/3552065152 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f26a006e530 0x7f26a00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:28.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.834+0000 7f269ffff640 1 -- 172.21.15.112:0/3552065152 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f26a808dd30 con 0x7f26b80fd560 2024-09-19T09:42:28.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.834+0000 7f26b6ffd640 1 --2- 172.21.15.112:0/3552065152 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f26a006e530 0x7f26a00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:28.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.834+0000 7f26b6ffd640 1 --2- 172.21.15.112:0/3552065152 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f26a006e530 0x7f26a00709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f26b8101f40 tx=0x7f26ac035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:28.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:28.838+0000 7f269ffff640 1 -- 172.21.15.112:0/3552065152 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f26a8056f70 con 0x7f26b80fd560 2024-09-19T09:42:29.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:29.080+0000 7f26bdf2b640 1 -- 172.21.15.112:0/3552065152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f26b8109560 con 0x7f26b80fd560 2024-09-19T09:42:29.082 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:28 smithi112 ceph-mon[97503]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:42:29.082 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:28 smithi112 ceph-mon[97503]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:42:29.082 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:28 smithi112 ceph-mon[97503]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:42:29.082 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:28 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2827018513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:42:29.082 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:28 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3236214943' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:42:29.083 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:28 smithi112 ceph-mon[97503]: Health check update: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-19T09:42:29.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:29.080+0000 7f269ffff640 1 -- 172.21.15.112:0/3552065152 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1050 (secure 0 0 0) 0x7f26a805a630 con 0x7f26b80fd560 2024-09-19T09:42:29.083 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 37/225 objects degraded (16.444%), 14 pgs degraded 2024-09-19T09:42:29.083 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-19T09:42:29.083 INFO:teuthology.orchestra.run.smithi112.stdout: osd.4 (root=default,host=smithi191) is down 2024-09-19T09:42:29.083 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 37/225 objects degraded (16.444%), 14 pgs degraded 2024-09-19T09:42:29.083 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-19T09:42:29.083 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-19T09:42:29.084 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-19T09:42:29.084 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-19T09:42:29.084 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-19T09:42:29.084 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-19T09:42:29.084 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-19T09:42:29.084 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-19T09:42:29.084 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-19T09:42:29.084 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-19T09:42:29.084 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-19T09:42:29.084 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-19T09:42:29.084 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-19T09:42:29.084 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-19T09:42:29.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:29.082+0000 7f26bdf2b640 1 -- 172.21.15.112:0/3552065152 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f26a006e530 msgr2=0x7f26a00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:29.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:29.082+0000 7f26bdf2b640 1 --2- 172.21.15.112:0/3552065152 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f26a006e530 0x7f26a00709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f26b8101f40 tx=0x7f26ac035040 comp rx=0 tx=0).stop 2024-09-19T09:42:29.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:29.082+0000 7f26bdf2b640 1 -- 172.21.15.112:0/3552065152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26b80fd560 msgr2=0x7f26b8113180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:29.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:29.082+0000 7f26bdf2b640 1 --2- 172.21.15.112:0/3552065152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26b80fd560 0x7f26b8113180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f26a800eb70 tx=0x7f26a800b040 comp rx=0 tx=0).stop 2024-09-19T09:42:29.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:29.082+0000 7f26bdf2b640 1 -- 172.21.15.112:0/3552065152 shutdown_connections 2024-09-19T09:42:29.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:29.083+0000 7f26bdf2b640 1 --2- 172.21.15.112:0/3552065152 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f26a006e530 0x7f26a00709e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:29.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:29.083+0000 7f26bdf2b640 1 --2- 172.21.15.112:0/3552065152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26b80fdf00 0x7f26b81136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:29.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:29.083+0000 7f26bdf2b640 1 --2- 172.21.15.112:0/3552065152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26b80fd560 0x7f26b8113180 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:29.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:29.083+0000 7f26bdf2b640 1 -- 172.21.15.112:0/3552065152 >> 172.21.15.112:0/3552065152 conn(0x7f26b80f7030 msgr2=0x7f26b80f8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:29.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:29.083+0000 7f26bdf2b640 1 -- 172.21.15.112:0/3552065152 shutdown_connections 2024-09-19T09:42:29.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:29.083+0000 7f26bdf2b640 1 -- 172.21.15.112:0/3552065152 wait complete. 2024-09-19T09:42:29.285 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:29 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[92168]: 2024-09-19T09:42:29.040+0000 7fb7a80bd640 -1 Falling back to public interface 2024-09-19T09:42:29.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:28 smithi191 ceph-mon[77624]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:42:29.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:28 smithi191 ceph-mon[77624]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:42:29.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:28 smithi191 ceph-mon[77624]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:42:29.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:28 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2827018513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:42:29.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:28 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3236214943' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:42:29.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:28 smithi191 ceph-mon[77624]: Health check update: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-19T09:42:30.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:29 smithi112 ceph-mon[97503]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:42:30.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:29 smithi112 ceph-mon[97503]: pgmap v132: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 37/225 objects degraded (16.444%) 2024-09-19T09:42:30.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:29 smithi112 ceph-mon[97503]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-19T09:42:30.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:29 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3552065152' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:42:30.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:29 smithi191 ceph-mon[77624]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:42:30.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:29 smithi191 ceph-mon[77624]: pgmap v132: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 37/225 objects degraded (16.444%) 2024-09-19T09:42:30.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:29 smithi191 ceph-mon[77624]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-19T09:42:30.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:29 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3552065152' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:42:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:31.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:31.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:31.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:31.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:32.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:31 smithi191 ceph-mon[77624]: pgmap v133: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 228 B/s rd, 1 op/s; 37/225 objects degraded (16.444%) 2024-09-19T09:42:32.315 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:31 smithi112 ceph-mon[97503]: pgmap v133: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 228 B/s rd, 1 op/s; 37/225 objects degraded (16.444%) 2024-09-19T09:42:34.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:33 smithi191 ceph-mon[77624]: pgmap v134: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 1 op/s; 37/225 objects degraded (16.444%) 2024-09-19T09:42:34.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:33 smithi191 ceph-mon[77624]: Health check update: Degraded data redundancy: 37/225 objects degraded (16.444%), 14 pgs degraded (PG_DEGRADED) 2024-09-19T09:42:34.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:33 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:34.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:33 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:34.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:33 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:42:34.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:33 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:42:34.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:33 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:34.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:33 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:42:34.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:33 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:42:34.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:33 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:42:34.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:33 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:42:34.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:33 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:42:34.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:33 smithi112 ceph-mon[97503]: pgmap v134: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 1 op/s; 37/225 objects degraded (16.444%) 2024-09-19T09:42:34.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:33 smithi112 ceph-mon[97503]: Health check update: Degraded data redundancy: 37/225 objects degraded (16.444%), 14 pgs degraded (PG_DEGRADED) 2024-09-19T09:42:34.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:33 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:34.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:33 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:34.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:33 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:42:34.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:33 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:42:34.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:33 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:34.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:33 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:42:34.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:33 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:42:34.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:33 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:42:34.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:33 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:42:34.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:33 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:42:35.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:34 smithi191 ceph-mon[77624]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:42:35.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:34 smithi191 ceph-mon[77624]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-19T09:42:35.285 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:35 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[92168]: 2024-09-19T09:42:35.244+0000 7fb7a80bd640 -1 osd.4 68 log_to_monitors true 2024-09-19T09:42:35.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:34 smithi112 ceph-mon[97503]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:42:35.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:34 smithi112 ceph-mon[97503]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-19T09:42:36.285 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:42:36 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[92168]: 2024-09-19T09:42:36.026+0000 7fb79fe57640 -1 osd.4 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:42:36.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:36 smithi191 ceph-mon[77624]: pgmap v135: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 599 B/s rd, 1 op/s; 37/225 objects degraded (16.444%) 2024-09-19T09:42:36.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:36 smithi191 ceph-mon[77624]: from='osd.4 [v2:172.21.15.191:6808/1585804761,v1:172.21.15.191:6809/1585804761]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:42:36.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:36 smithi191 ceph-mon[77624]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:42:36.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:36 smithi112 ceph-mon[97503]: pgmap v135: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 599 B/s rd, 1 op/s; 37/225 objects degraded (16.444%) 2024-09-19T09:42:36.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:36 smithi112 ceph-mon[97503]: from='osd.4 [v2:172.21.15.191:6808/1585804761,v1:172.21.15.191:6809/1585804761]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:42:36.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:36 smithi112 ceph-mon[97503]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:42:37.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:37 smithi191 ceph-mon[77624]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:42:37.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:37 smithi191 ceph-mon[77624]: from='osd.4 [v2:172.21.15.191:6808/1585804761,v1:172.21.15.191:6809/1585804761]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:42:37.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:37 smithi191 ceph-mon[77624]: osdmap e71: 6 total, 5 up, 6 in 2024-09-19T09:42:37.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:37 smithi191 ceph-mon[77624]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:42:37.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:37 smithi112 ceph-mon[97503]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:42:37.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:37 smithi112 ceph-mon[97503]: from='osd.4 [v2:172.21.15.191:6808/1585804761,v1:172.21.15.191:6809/1585804761]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:42:37.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:37 smithi112 ceph-mon[97503]: osdmap e71: 6 total, 5 up, 6 in 2024-09-19T09:42:37.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:37 smithi112 ceph-mon[97503]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:42:38.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:38 smithi191 ceph-mon[77624]: pgmap v137: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 37/225 objects degraded (16.444%) 2024-09-19T09:42:38.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:38 smithi191 ceph-mon[77624]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:42:38.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:38 smithi191 ceph-mon[77624]: osd.4 [v2:172.21.15.191:6808/1585804761,v1:172.21.15.191:6809/1585804761] boot 2024-09-19T09:42:38.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:38 smithi191 ceph-mon[77624]: osdmap e72: 6 total, 6 up, 6 in 2024-09-19T09:42:38.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:38 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:42:38.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:38 smithi191 ceph-mon[77624]: osdmap e73: 6 total, 6 up, 6 in 2024-09-19T09:42:38.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:38 smithi112 ceph-mon[97503]: pgmap v137: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 37/225 objects degraded (16.444%) 2024-09-19T09:42:38.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:38 smithi112 ceph-mon[97503]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:42:38.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:38 smithi112 ceph-mon[97503]: osd.4 [v2:172.21.15.191:6808/1585804761,v1:172.21.15.191:6809/1585804761] boot 2024-09-19T09:42:38.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:38 smithi112 ceph-mon[97503]: osdmap e72: 6 total, 6 up, 6 in 2024-09-19T09:42:38.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:38 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:42:38.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:38 smithi112 ceph-mon[97503]: osdmap e73: 6 total, 6 up, 6 in 2024-09-19T09:42:39.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:39 smithi112 ceph-mon[97503]: pgmap v140: 65 pgs: 13 peering, 12 active+undersized, 8 active+undersized+degraded, 32 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s; 25/225 objects degraded (11.111%) 2024-09-19T09:42:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:39 smithi112 ceph-mon[97503]: Health check update: Degraded data redundancy: 25/225 objects degraded (11.111%), 8 pgs degraded (PG_DEGRADED) 2024-09-19T09:42:39.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:39 smithi191 ceph-mon[77624]: pgmap v140: 65 pgs: 13 peering, 12 active+undersized, 8 active+undersized+degraded, 32 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s; 25/225 objects degraded (11.111%) 2024-09-19T09:42:39.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:39 smithi191 ceph-mon[77624]: Health check update: Degraded data redundancy: 25/225 objects degraded (11.111%), 8 pgs degraded (PG_DEGRADED) 2024-09-19T09:42:41.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:41.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:42:41.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:41.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:42:42.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:41 smithi112 ceph-mon[97503]: pgmap v141: 65 pgs: 13 peering, 4 active+undersized, 2 active+undersized+degraded, 46 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 3/225 objects degraded (1.333%) 2024-09-19T09:42:42.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:41 smithi191 ceph-mon[77624]: pgmap v141: 65 pgs: 13 peering, 4 active+undersized, 2 active+undersized+degraded, 46 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 3/225 objects degraded (1.333%) 2024-09-19T09:42:43.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:42 smithi112 ceph-mon[97503]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/225 objects degraded (1.333%), 2 pgs degraded) 2024-09-19T09:42:43.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:42 smithi112 ceph-mon[97503]: Cluster is now healthy 2024-09-19T09:42:43.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:42 smithi191 ceph-mon[77624]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/225 objects degraded (1.333%), 2 pgs degraded) 2024-09-19T09:42:43.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:42 smithi191 ceph-mon[77624]: Cluster is now healthy 2024-09-19T09:42:44.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:43 smithi112 ceph-mon[97503]: pgmap v142: 65 pgs: 6 peering, 59 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 450 B/s rd, 1 op/s 2024-09-19T09:42:44.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:43 smithi191 ceph-mon[77624]: pgmap v142: 65 pgs: 6 peering, 59 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 450 B/s rd, 1 op/s 2024-09-19T09:42:46.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:45 smithi112 ceph-mon[97503]: pgmap v143: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s 2024-09-19T09:42:46.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:45 smithi191 ceph-mon[77624]: pgmap v143: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s 2024-09-19T09:42:47.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:47 smithi112 ceph-mon[97503]: pgmap v144: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 835 B/s rd, 1 op/s 2024-09-19T09:42:48.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:47 smithi191 ceph-mon[77624]: pgmap v144: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 835 B/s rd, 1 op/s 2024-09-19T09:42:50.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:49 smithi112 ceph-mon[97503]: pgmap v145: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 758 B/s rd, 2 op/s 2024-09-19T09:42:50.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:49 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:42:50.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:49 smithi112 ceph-mon[97503]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:42:50.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:49 smithi112 ceph-mon[97503]: Upgrade: osd.5 is safe to restart 2024-09-19T09:42:50.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:49 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:50.224 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:49 smithi191 ceph-mon[77624]: pgmap v145: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 758 B/s rd, 2 op/s 2024-09-19T09:42:50.224 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:49 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:42:50.225 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:49 smithi191 ceph-mon[77624]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:42:50.225 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:49 smithi191 ceph-mon[77624]: Upgrade: osd.5 is safe to restart 2024-09-19T09:42:50.225 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:49 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:51.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:51 smithi191 ceph-mon[77624]: Upgrade: Updating osd.5 2024-09-19T09:42:51.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:51 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:51.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:51 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:42:51.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:51 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:42:51.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:51 smithi191 ceph-mon[77624]: Deploying daemon osd.5 on smithi191 2024-09-19T09:42:51.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:51 smithi191 ceph-mon[77624]: pgmap v146: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-19T09:42:51.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:51 smithi112 ceph-mon[97503]: Upgrade: Updating osd.5 2024-09-19T09:42:51.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:51 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:51.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:51 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:42:51.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:51 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:42:51.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:51 smithi112 ceph-mon[97503]: Deploying daemon osd.5 on smithi191 2024-09-19T09:42:51.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:51 smithi112 ceph-mon[97503]: pgmap v146: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-19T09:42:53.383 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:53 smithi191 systemd[1]: Stopping Ceph osd.5 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:42:53.784 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:53 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[53570]: 2024-09-19T09:42:53.519+0000 7ff1d4037640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:42:53.785 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:53 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[53570]: 2024-09-19T09:42:53.519+0000 7ff1d4037640 -1 osd.5 73 *** Got signal Terminated *** 2024-09-19T09:42:53.785 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:53 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[53570]: 2024-09-19T09:42:53.519+0000 7ff1d4037640 -1 osd.5 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:42:54.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:53 smithi112 ceph-mon[97503]: pgmap v147: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:42:54.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:53 smithi112 ceph-mon[97503]: osd.5 marked itself down and dead 2024-09-19T09:42:54.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:53 smithi191 ceph-mon[77624]: pgmap v147: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:42:54.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:53 smithi191 ceph-mon[77624]: osd.5 marked itself down and dead 2024-09-19T09:42:54.580 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:54 smithi191 podman[96558]: 2024-09-19 09:42:54.295914314 +0000 UTC m=+1.034021863 container died 444e804432fdb9fbdcd52f2a78011c4fa3d8b4d7c6439aa7f8ab021ac8c94ebf (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=quincy-6e06d1e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T09:42:54.890 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:54 smithi191 podman[96558]: 2024-09-19 09:42:54.669049775 +0000 UTC m=+1.407157322 container cleanup 444e804432fdb9fbdcd52f2a78011c4fa3d8b4d7c6439aa7f8ab021ac8c94ebf (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=quincy-6e06d1e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T09:42:54.890 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:54 smithi191 bash[96558]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5 2024-09-19T09:42:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:42:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-19T09:42:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: osdmap e74: 6 total, 5 up, 6 in 2024-09-19T09:42:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 5]}]: dispatch 2024-09-19T09:42:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 2]}]: dispatch 2024-09-19T09:42:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 5]}]: dispatch 2024-09-19T09:42:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 2]}]: dispatch 2024-09-19T09:42:55.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [3, 2]}]: dispatch 2024-09-19T09:42:55.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]: dispatch 2024-09-19T09:42:55.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [1, 5]}]: dispatch 2024-09-19T09:42:55.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 5]}]: dispatch 2024-09-19T09:42:55.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [1, 2, 4, 0]}]: dispatch 2024-09-19T09:42:55.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:55.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:42:55.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 5]}]': finished 2024-09-19T09:42:55.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 2]}]': finished 2024-09-19T09:42:55.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 5]}]': finished 2024-09-19T09:42:55.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 2]}]': finished 2024-09-19T09:42:55.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [3, 2]}]': finished 2024-09-19T09:42:55.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]': finished 2024-09-19T09:42:55.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [1, 5]}]': finished 2024-09-19T09:42:55.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 5]}]': finished 2024-09-19T09:42:55.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [1, 2, 4, 0]}]': finished 2024-09-19T09:42:55.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:54 smithi112 ceph-mon[97503]: osdmap e75: 6 total, 5 up, 6 in 2024-09-19T09:42:55.282 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:54 smithi191 podman[96577]: 2024-09-19 09:42:54.962995687 +0000 UTC m=+0.656110844 container remove 444e804432fdb9fbdcd52f2a78011c4fa3d8b4d7c6439aa7f8ab021ac8c94ebf (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=quincy-6e06d1e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T09:42:55.283 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:42:55.283 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-19T09:42:55.283 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: osdmap e74: 6 total, 5 up, 6 in 2024-09-19T09:42:55.283 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 5]}]: dispatch 2024-09-19T09:42:55.283 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 2]}]: dispatch 2024-09-19T09:42:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 5]}]: dispatch 2024-09-19T09:42:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 2]}]: dispatch 2024-09-19T09:42:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [3, 2]}]: dispatch 2024-09-19T09:42:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]: dispatch 2024-09-19T09:42:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [1, 5]}]: dispatch 2024-09-19T09:42:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 5]}]: dispatch 2024-09-19T09:42:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [1, 2, 4, 0]}]: dispatch 2024-09-19T09:42:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:42:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:42:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 5]}]': finished 2024-09-19T09:42:55.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 2]}]': finished 2024-09-19T09:42:55.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 5]}]': finished 2024-09-19T09:42:55.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 2]}]': finished 2024-09-19T09:42:55.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [3, 2]}]': finished 2024-09-19T09:42:55.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]': finished 2024-09-19T09:42:55.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [1, 5]}]': finished 2024-09-19T09:42:55.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 5]}]': finished 2024-09-19T09:42:55.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [1, 2, 4, 0]}]': finished 2024-09-19T09:42:55.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:54 smithi191 ceph-mon[77624]: osdmap e75: 6 total, 5 up, 6 in 2024-09-19T09:42:55.534 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:55 smithi191 podman[96668]: 2024-09-19 09:42:55.18410168 +0000 UTC m=+0.015864340 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:42:55.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:55 smithi191 podman[96668]: 2024-09-19 09:42:55.297008098 +0000 UTC m=+0.128770746 container create b254366478c5fbe37126145fce668149db2cc1fc72b87cc4fa7de171962a7967 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T09:42:55.890 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:55 smithi191 podman[96668]: 2024-09-19 09:42:55.549445007 +0000 UTC m=+0.381207675 container init b254366478c5fbe37126145fce668149db2cc1fc72b87cc4fa7de171962a7967 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:42:55.890 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:55 smithi191 podman[96668]: 2024-09-19 09:42:55.552883324 +0000 UTC m=+0.384645972 container start b254366478c5fbe37126145fce668149db2cc1fc72b87cc4fa7de171962a7967 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:42:55.890 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:55 smithi191 podman[96668]: 2024-09-19 09:42:55.633054652 +0000 UTC m=+0.464817300 container attach b254366478c5fbe37126145fce668149db2cc1fc72b87cc4fa7de171962a7967 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T09:42:55.890 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:55 smithi191 podman[96668]: 2024-09-19 09:42:55.736089497 +0000 UTC m=+0.567852145 container died b254366478c5fbe37126145fce668149db2cc1fc72b87cc4fa7de171962a7967 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T09:42:56.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:55 smithi112 ceph-mon[97503]: pgmap v149: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 1 op/s 2024-09-19T09:42:56.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:55 smithi112 ceph-mon[97503]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-19T09:42:56.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:55 smithi112 ceph-mon[97503]: osdmap e76: 6 total, 5 up, 6 in 2024-09-19T09:42:56.271 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:55 smithi191 ceph-mon[77624]: pgmap v149: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 1 op/s 2024-09-19T09:42:56.271 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:55 smithi191 ceph-mon[77624]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-19T09:42:56.271 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:55 smithi191 ceph-mon[77624]: osdmap e76: 6 total, 5 up, 6 in 2024-09-19T09:42:56.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:56 smithi191 podman[96691]: 2024-09-19 09:42:56.270139444 +0000 UTC m=+0.528274918 container remove b254366478c5fbe37126145fce668149db2cc1fc72b87cc4fa7de171962a7967 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T09:42:56.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:56 smithi191 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-19T09:42:56.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:56 smithi191 systemd[1]: Stopped Ceph osd.5 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:42:56.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:56 smithi191 systemd[1]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.5.service: Consumed 1min 909ms CPU time. 2024-09-19T09:42:56.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:56 smithi191 systemd[1]: Starting Ceph osd.5 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:42:56.950 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:56 smithi191 podman[96790]: 2024-09-19 09:42:56.679980369 +0000 UTC m=+0.101947567 container create bbcd9ffe3cd3d178c40e9743edc35e243f4a4297a7f15e4e2d311b015ed82420 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T09:42:56.951 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:56 smithi191 podman[96790]: 2024-09-19 09:42:56.593608865 +0000 UTC m=+0.015576028 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:42:57.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:56 smithi191 podman[96790]: 2024-09-19 09:42:56.949537758 +0000 UTC m=+0.371504919 container init bbcd9ffe3cd3d178c40e9743edc35e243f4a4297a7f15e4e2d311b015ed82420 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:42:57.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:56 smithi191 podman[96790]: 2024-09-19 09:42:56.953402863 +0000 UTC m=+0.375370021 container start bbcd9ffe3cd3d178c40e9743edc35e243f4a4297a7f15e4e2d311b015ed82420 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T09:42:57.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:57 smithi191 podman[96790]: 2024-09-19 09:42:57.057681129 +0000 UTC m=+0.479648292 container attach bbcd9ffe3cd3d178c40e9743edc35e243f4a4297a7f15e4e2d311b015ed82420 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T09:42:57.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:57 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-activate[96804]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:42:57.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:57 smithi191 bash[96790]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:42:57.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:57 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-activate[96804]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:42:57.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:57 smithi191 bash[96790]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:42:57.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:57 smithi112 ceph-mon[97503]: pgmap v152: 65 pgs: 2 active+undersized, 3 remapped+peering, 10 peering, 8 stale+active+clean, 2 active+undersized+degraded, 40 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 3/225 objects degraded (1.333%) 2024-09-19T09:42:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:57 smithi112 ceph-mon[97503]: osdmap e77: 6 total, 5 up, 6 in 2024-09-19T09:42:57.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:57 smithi112 ceph-mon[97503]: Health check failed: Degraded data redundancy: 3/225 objects degraded (1.333%), 2 pgs degraded (PG_DEGRADED) 2024-09-19T09:42:58.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:57 smithi191 ceph-mon[77624]: pgmap v152: 65 pgs: 2 active+undersized, 3 remapped+peering, 10 peering, 8 stale+active+clean, 2 active+undersized+degraded, 40 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 3/225 objects degraded (1.333%) 2024-09-19T09:42:58.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:57 smithi191 ceph-mon[77624]: osdmap e77: 6 total, 5 up, 6 in 2024-09-19T09:42:58.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:57 smithi191 ceph-mon[77624]: Health check failed: Degraded data redundancy: 3/225 objects degraded (1.333%), 2 pgs degraded (PG_DEGRADED) 2024-09-19T09:42:58.035 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:57 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-activate[96804]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T09:42:58.035 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:57 smithi191 bash[96790]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T09:42:58.035 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:57 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-activate[96804]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-19T09:42:58.035 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:57 smithi191 bash[96790]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-19T09:42:58.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:58 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-activate[96804]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-19T09:42:58.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:58 smithi191 bash[96790]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-19T09:42:58.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:58 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-activate[96804]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-19T09:42:58.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:58 smithi191 bash[96790]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-19T09:42:58.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:58 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-activate[96804]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-19T09:42:58.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:58 smithi191 bash[96790]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-19T09:42:58.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:58 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-activate[96804]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T09:42:58.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:58 smithi191 bash[96790]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T09:42:58.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:58 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-activate[96804]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-19T09:42:58.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:58 smithi191 bash[96790]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-19T09:42:58.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:58 smithi191 podman[96790]: 2024-09-19 09:42:58.15955657 +0000 UTC m=+1.581523737 container died bbcd9ffe3cd3d178c40e9743edc35e243f4a4297a7f15e4e2d311b015ed82420 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:42:59.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.179+0000 7f6831bb0640 1 -- 172.21.15.112:0/1554182686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f682c0fb470 msgr2=0x7f682c0fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:59.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.179+0000 7f6831bb0640 1 --2- 172.21.15.112:0/1554182686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f682c0fb470 0x7f682c0fb8e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f68200048d0 tx=0x7f6820009da0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.179+0000 7f6831bb0640 1 -- 172.21.15.112:0/1554182686 shutdown_connections 2024-09-19T09:42:59.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.179+0000 7f6831bb0640 1 --2- 172.21.15.112:0/1554182686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f682c0fb470 0x7f682c0fb8e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.179+0000 7f6831bb0640 1 --2- 172.21.15.112:0/1554182686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f682c1014b0 0x7f682c101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.179+0000 7f6831bb0640 1 -- 172.21.15.112:0/1554182686 >> 172.21.15.112:0/1554182686 conn(0x7f682c0f7030 msgr2=0x7f682c0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:59.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.179+0000 7f6831bb0640 1 -- 172.21.15.112:0/1554182686 shutdown_connections 2024-09-19T09:42:59.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.179+0000 7f6831bb0640 1 -- 172.21.15.112:0/1554182686 wait complete. 2024-09-19T09:42:59.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:58 smithi112 ceph-mon[97503]: osdmap e78: 6 total, 5 up, 6 in 2024-09-19T09:42:59.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:58 smithi112 ceph-mon[97503]: osdmap e79: 6 total, 5 up, 6 in 2024-09-19T09:42:59.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.180+0000 7f6831bb0640 1 Processor -- start 2024-09-19T09:42:59.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.180+0000 7f6831bb0640 1 -- start start 2024-09-19T09:42:59.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.180+0000 7f6831bb0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f682c0fb470 0x7f682c10e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:59.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.180+0000 7f6831bb0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f682c1014b0 0x7f682c10e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:59.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.180+0000 7f6831bb0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c10ecd0 con 0x7f682c1014b0 2024-09-19T09:42:59.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.180+0000 7f6831bb0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c10ee40 con 0x7f682c0fb470 2024-09-19T09:42:59.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.180+0000 7f682affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f682c1014b0 0x7f682c10e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:59.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.181+0000 7f682affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f682c1014b0 0x7f682c10e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54266/0 (socket says 172.21.15.112:54266) 2024-09-19T09:42:59.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.181+0000 7f682affd640 1 -- 172.21.15.112:0/820559885 learned_addr learned my addr 172.21.15.112:0/820559885 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:42:59.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.181+0000 7f682b7fe640 1 --2- 172.21.15.112:0/820559885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f682c0fb470 0x7f682c10e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:59.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.181+0000 7f682affd640 1 -- 172.21.15.112:0/820559885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f682c0fb470 msgr2=0x7f682c10e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:59.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.181+0000 7f682affd640 1 --2- 172.21.15.112:0/820559885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f682c0fb470 0x7f682c10e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.181+0000 7f682affd640 1 -- 172.21.15.112:0/820559885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6820005040 con 0x7f682c1014b0 2024-09-19T09:42:59.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.181+0000 7f682affd640 1 --2- 172.21.15.112:0/820559885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f682c1014b0 0x7f682c10e680 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6820000c00 tx=0x7f6820009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:59.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.181+0000 7f6813fff640 1 -- 172.21.15.112:0/820559885 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6820038070 con 0x7f682c1014b0 2024-09-19T09:42:59.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.181+0000 7f6813fff640 1 -- 172.21.15.112:0/820559885 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f682002ade0 con 0x7f682c1014b0 2024-09-19T09:42:59.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.181+0000 7f6831bb0640 1 -- 172.21.15.112:0/820559885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682c1171b0 con 0x7f682c1014b0 2024-09-19T09:42:59.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.181+0000 7f6813fff640 1 -- 172.21.15.112:0/820559885 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f682002c7e0 con 0x7f682c1014b0 2024-09-19T09:42:59.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.182+0000 7f6831bb0640 1 -- 172.21.15.112:0/820559885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682c117590 con 0x7f682c1014b0 2024-09-19T09:42:59.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.183+0000 7f6831bb0640 1 -- 172.21.15.112:0/820559885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682c0fcbb0 con 0x7f682c1014b0 2024-09-19T09:42:59.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.183+0000 7f6813fff640 1 -- 172.21.15.112:0/820559885 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6820030020 con 0x7f682c1014b0 2024-09-19T09:42:59.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.184+0000 7f6813fff640 1 --2- 172.21.15.112:0/820559885 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f681406e530 0x7f68140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:59.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.184+0000 7f6813fff640 1 -- 172.21.15.112:0/820559885 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6882+0+0 (secure 0 0 0) 0x7f68200adee0 con 0x7f682c1014b0 2024-09-19T09:42:59.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.184+0000 7f682b7fe640 1 --2- 172.21.15.112:0/820559885 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f681406e530 0x7f68140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:59.187 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:58 smithi191 ceph-mon[77624]: osdmap e78: 6 total, 5 up, 6 in 2024-09-19T09:42:59.187 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:58 smithi191 ceph-mon[77624]: osdmap e79: 6 total, 5 up, 6 in 2024-09-19T09:42:59.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.185+0000 7f682b7fe640 1 --2- 172.21.15.112:0/820559885 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f681406e530 0x7f68140709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f681c009fd0 tx=0x7f681c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:59.187 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:58 smithi191 podman[96933]: 2024-09-19 09:42:58.871672116 +0000 UTC m=+0.700634271 container remove bbcd9ffe3cd3d178c40e9743edc35e243f4a4297a7f15e4e2d311b015ed82420 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:42:59.187 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:59 smithi191 podman[96995]: 2024-09-19 09:42:58.978658155 +0000 UTC m=+0.015898215 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:42:59.187 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:59 smithi191 podman[96995]: 2024-09-19 09:42:59.081056813 +0000 UTC m=+0.118296872 container create 901aaba16a54589b205073b7555de0722ff3687282291562311b26fd0d8cd09a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T09:42:59.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.189+0000 7f6813fff640 1 -- 172.21.15.112:0/820559885 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6820076f70 con 0x7f682c1014b0 2024-09-19T09:42:59.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.434+0000 7f6831bb0640 1 -- 172.21.15.112:0/820559885 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f682c04b720 con 0x7f681406e530 2024-09-19T09:42:59.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.436+0000 7f6813fff640 1 -- 172.21.15.112:0/820559885 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f682c04b720 con 0x7f681406e530 2024-09-19T09:42:59.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.438+0000 7f6831bb0640 1 -- 172.21.15.112:0/820559885 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f681406e530 msgr2=0x7f68140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:59.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.438+0000 7f6831bb0640 1 --2- 172.21.15.112:0/820559885 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f681406e530 0x7f68140709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f681c009fd0 tx=0x7f681c00b040 comp rx=0 tx=0).stop 2024-09-19T09:42:59.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.438+0000 7f6831bb0640 1 -- 172.21.15.112:0/820559885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f682c1014b0 msgr2=0x7f682c10e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:59.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.438+0000 7f6831bb0640 1 --2- 172.21.15.112:0/820559885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f682c1014b0 0x7f682c10e680 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6820000c00 tx=0x7f6820009da0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.438+0000 7f6831bb0640 1 -- 172.21.15.112:0/820559885 shutdown_connections 2024-09-19T09:42:59.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.438+0000 7f6831bb0640 1 --2- 172.21.15.112:0/820559885 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f681406e530 0x7f68140709e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.438+0000 7f6831bb0640 1 --2- 172.21.15.112:0/820559885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f682c1014b0 0x7f682c10e680 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.438+0000 7f6831bb0640 1 --2- 172.21.15.112:0/820559885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f682c0fb470 0x7f682c10e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.438+0000 7f6831bb0640 1 -- 172.21.15.112:0/820559885 >> 172.21.15.112:0/820559885 conn(0x7f682c0f7030 msgr2=0x7f682c0f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:59.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.438+0000 7f6831bb0640 1 -- 172.21.15.112:0/820559885 shutdown_connections 2024-09-19T09:42:59.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.438+0000 7f6831bb0640 1 -- 172.21.15.112:0/820559885 wait complete. 2024-09-19T09:42:59.451 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:42:59.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:59 smithi191 podman[96995]: 2024-09-19 09:42:59.30863656 +0000 UTC m=+0.345876624 container init 901aaba16a54589b205073b7555de0722ff3687282291562311b26fd0d8cd09a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T09:42:59.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:59 smithi191 podman[96995]: 2024-09-19 09:42:59.311792499 +0000 UTC m=+0.349032563 container start 901aaba16a54589b205073b7555de0722ff3687282291562311b26fd0d8cd09a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True) 2024-09-19T09:42:59.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:59 smithi191 ceph-osd[97013]: -- 172.21.15.191:0/4117881076 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e1879b61e0 con 0x55e1879b4000 2024-09-19T09:42:59.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:59 smithi191 bash[96995]: 901aaba16a54589b205073b7555de0722ff3687282291562311b26fd0d8cd09a 2024-09-19T09:42:59.535 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:42:59 smithi191 systemd[1]: Started Ceph osd.5 for 0bd98d30-7669-11ef-bceb-c7b262605968. 2024-09-19T09:42:59.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.539+0000 7f70770f5640 1 -- 172.21.15.112:0/1544750458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070102ef0 msgr2=0x7f70700fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:59.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.539+0000 7f70770f5640 1 --2- 172.21.15.112:0/1544750458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070102ef0 0x7f70700fc5b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f70600048d0 tx=0x7f7060009da0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.539+0000 7f70770f5640 1 -- 172.21.15.112:0/1544750458 shutdown_connections 2024-09-19T09:42:59.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.539+0000 7f70770f5640 1 --2- 172.21.15.112:0/1544750458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070102ef0 0x7f70700fc5b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.539+0000 7f70770f5640 1 --2- 172.21.15.112:0/1544750458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7070102550 0x7f7070102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.539+0000 7f70770f5640 1 -- 172.21.15.112:0/1544750458 >> 172.21.15.112:0/1544750458 conn(0x7f70700f80f0 msgr2=0x7f70700fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:59.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.540+0000 7f70770f5640 1 -- 172.21.15.112:0/1544750458 shutdown_connections 2024-09-19T09:42:59.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.540+0000 7f70770f5640 1 -- 172.21.15.112:0/1544750458 wait complete. 2024-09-19T09:42:59.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.540+0000 7f70770f5640 1 Processor -- start 2024-09-19T09:42:59.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.540+0000 7f70770f5640 1 -- start start 2024-09-19T09:42:59.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.541+0000 7f70770f5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070102550 0x7f7070115740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:59.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.541+0000 7f70770f5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7070102ef0 0x7f7070115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:59.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.541+0000 7f70770f5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70701162d0 con 0x7f7070102550 2024-09-19T09:42:59.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.541+0000 7f70770f5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707010f6e0 con 0x7f7070102ef0 2024-09-19T09:42:59.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.541+0000 7f7074e91640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070102550 0x7f7070115740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:59.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.541+0000 7f7074e91640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070102550 0x7f7070115740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54282/0 (socket says 172.21.15.112:54282) 2024-09-19T09:42:59.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.541+0000 7f7074e91640 1 -- 172.21.15.112:0/4234755981 learned_addr learned my addr 172.21.15.112:0/4234755981 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:42:59.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.541+0000 7f7067fff640 1 --2- 172.21.15.112:0/4234755981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7070102ef0 0x7f7070115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:59.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.541+0000 7f7074e91640 1 -- 172.21.15.112:0/4234755981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7070102ef0 msgr2=0x7f7070115c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:59.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.541+0000 7f7074e91640 1 --2- 172.21.15.112:0/4234755981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7070102ef0 0x7f7070115c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.541+0000 7f7074e91640 1 -- 172.21.15.112:0/4234755981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7060005040 con 0x7f7070102550 2024-09-19T09:42:59.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.541+0000 7f7074e91640 1 --2- 172.21.15.112:0/4234755981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070102550 0x7f7070115740 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f706c00eb70 tx=0x7f706c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:59.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.542+0000 7f70657fa640 1 -- 172.21.15.112:0/4234755981 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f706c007c30 con 0x7f7070102550 2024-09-19T09:42:59.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.542+0000 7f70657fa640 1 -- 172.21.15.112:0/4234755981 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f706c00f040 con 0x7f7070102550 2024-09-19T09:42:59.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.542+0000 7f70770f5640 1 -- 172.21.15.112:0/4234755981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707010f960 con 0x7f7070102550 2024-09-19T09:42:59.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.542+0000 7f70657fa640 1 -- 172.21.15.112:0/4234755981 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f706c00ca60 con 0x7f7070102550 2024-09-19T09:42:59.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.542+0000 7f70770f5640 1 -- 172.21.15.112:0/4234755981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707010fed0 con 0x7f7070102550 2024-09-19T09:42:59.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.543+0000 7f70770f5640 1 -- 172.21.15.112:0/4234755981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70700fdcd0 con 0x7f7070102550 2024-09-19T09:42:59.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.543+0000 7f70657fa640 1 -- 172.21.15.112:0/4234755981 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f706c00cbc0 con 0x7f7070102550 2024-09-19T09:42:59.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.544+0000 7f70657fa640 1 --2- 172.21.15.112:0/4234755981 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f705806e530 0x7f70580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:59.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.544+0000 7f70657fa640 1 -- 172.21.15.112:0/4234755981 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6882+0+0 (secure 0 0 0) 0x7f706c08de80 con 0x7f7070102550 2024-09-19T09:42:59.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.544+0000 7f7067fff640 1 --2- 172.21.15.112:0/4234755981 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f705806e530 0x7f70580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:59.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.545+0000 7f7067fff640 1 --2- 172.21.15.112:0/4234755981 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f705806e530 0x7f70580709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7060000c00 tx=0x7f7060035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:59.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.550+0000 7f70657fa640 1 -- 172.21.15.112:0/4234755981 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f706c056f10 con 0x7f7070102550 2024-09-19T09:42:59.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.832+0000 7f70770f5640 1 -- 172.21.15.112:0/4234755981 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7070109580 con 0x7f705806e530 2024-09-19T09:42:59.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.833+0000 7f70657fa640 1 -- 172.21.15.112:0/4234755981 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f7070109580 con 0x7f705806e530 2024-09-19T09:42:59.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.836+0000 7f70770f5640 1 -- 172.21.15.112:0/4234755981 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f705806e530 msgr2=0x7f70580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:59.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.836+0000 7f70770f5640 1 --2- 172.21.15.112:0/4234755981 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f705806e530 0x7f70580709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7060000c00 tx=0x7f7060035040 comp rx=0 tx=0).stop 2024-09-19T09:42:59.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.836+0000 7f70770f5640 1 -- 172.21.15.112:0/4234755981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070102550 msgr2=0x7f7070115740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:59.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.836+0000 7f70770f5640 1 --2- 172.21.15.112:0/4234755981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070102550 0x7f7070115740 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f706c00eb70 tx=0x7f706c00b040 comp rx=0 tx=0).stop 2024-09-19T09:42:59.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.836+0000 7f70770f5640 1 -- 172.21.15.112:0/4234755981 shutdown_connections 2024-09-19T09:42:59.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.836+0000 7f70770f5640 1 --2- 172.21.15.112:0/4234755981 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f705806e530 0x7f70580709e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.836+0000 7f70770f5640 1 --2- 172.21.15.112:0/4234755981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7070102ef0 0x7f7070115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.836+0000 7f70770f5640 1 --2- 172.21.15.112:0/4234755981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070102550 0x7f7070115740 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.836+0000 7f70770f5640 1 -- 172.21.15.112:0/4234755981 >> 172.21.15.112:0/4234755981 conn(0x7f70700f80f0 msgr2=0x7f70700f9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:59.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.836+0000 7f70770f5640 1 -- 172.21.15.112:0/4234755981 shutdown_connections 2024-09-19T09:42:59.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.836+0000 7f70770f5640 1 -- 172.21.15.112:0/4234755981 wait complete. 2024-09-19T09:42:59.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.932+0000 7f056406a640 1 -- 172.21.15.112:0/110505016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f055c0fcf80 msgr2=0x7f055c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:59.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.932+0000 7f056406a640 1 --2- 172.21.15.112:0/110505016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f055c0fcf80 0x7f055c0fd3d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f054c0048d0 tx=0x7f054c009da0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.932+0000 7f056406a640 1 -- 172.21.15.112:0/110505016 shutdown_connections 2024-09-19T09:42:59.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.932+0000 7f056406a640 1 --2- 172.21.15.112:0/110505016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f055c0fcf80 0x7f055c0fd3d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.932+0000 7f056406a640 1 --2- 172.21.15.112:0/110505016 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f055c0fb810 0x7f055c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.932+0000 7f056406a640 1 -- 172.21.15.112:0/110505016 >> 172.21.15.112:0/110505016 conn(0x7f055c0723b0 msgr2=0x7f055c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:59.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.932+0000 7f056406a640 1 -- 172.21.15.112:0/110505016 shutdown_connections 2024-09-19T09:42:59.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.932+0000 7f056406a640 1 -- 172.21.15.112:0/110505016 wait complete. 2024-09-19T09:42:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.933+0000 7f056406a640 1 Processor -- start 2024-09-19T09:42:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.933+0000 7f056406a640 1 -- start start 2024-09-19T09:42:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.933+0000 7f056406a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f055c0fb810 0x7f055c113160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.933+0000 7f056406a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f055c0fcf80 0x7f055c1136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.933+0000 7f056406a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c113ca0 con 0x7f055c0fb810 2024-09-19T09:42:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.933+0000 7f056406a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c10d0e0 con 0x7f055c0fcf80 2024-09-19T09:42:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.933+0000 7f0561e06640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f055c0fb810 0x7f055c113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.933+0000 7f0561e06640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f055c0fb810 0x7f055c113160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54308/0 (socket says 172.21.15.112:54308) 2024-09-19T09:42:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.933+0000 7f0561e06640 1 -- 172.21.15.112:0/3667121800 learned_addr learned my addr 172.21.15.112:0/3667121800 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:42:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.933+0000 7f0561605640 1 --2- 172.21.15.112:0/3667121800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f055c0fcf80 0x7f055c1136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.933+0000 7f0561e06640 1 -- 172.21.15.112:0/3667121800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f055c0fcf80 msgr2=0x7f055c1136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.933+0000 7f0561e06640 1 --2- 172.21.15.112:0/3667121800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f055c0fcf80 0x7f055c1136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.933+0000 7f0561e06640 1 -- 172.21.15.112:0/3667121800 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c005040 con 0x7f055c0fb810 2024-09-19T09:42:59.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.934+0000 7f0561e06640 1 --2- 172.21.15.112:0/3667121800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f055c0fb810 0x7f055c113160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0558002a50 tx=0x7f0558004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:59.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.934+0000 7f05527fc640 1 -- 172.21.15.112:0/3667121800 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0558007c30 con 0x7f055c0fb810 2024-09-19T09:42:59.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.934+0000 7f056406a640 1 -- 172.21.15.112:0/3667121800 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c10d3c0 con 0x7f055c0fb810 2024-09-19T09:42:59.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.934+0000 7f05527fc640 1 -- 172.21.15.112:0/3667121800 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f055800f040 con 0x7f055c0fb810 2024-09-19T09:42:59.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.934+0000 7f05527fc640 1 -- 172.21.15.112:0/3667121800 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f055800dad0 con 0x7f055c0fb810 2024-09-19T09:42:59.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.934+0000 7f056406a640 1 -- 172.21.15.112:0/3667121800 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c10d930 con 0x7f055c0fb810 2024-09-19T09:42:59.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.935+0000 7f056406a640 1 -- 172.21.15.112:0/3667121800 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055c0fcbc0 con 0x7f055c0fb810 2024-09-19T09:42:59.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.936+0000 7f05527fc640 1 -- 172.21.15.112:0/3667121800 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f055800dc30 con 0x7f055c0fb810 2024-09-19T09:42:59.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.936+0000 7f05527fc640 1 --2- 172.21.15.112:0/3667121800 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f054806e530 0x7f05480709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:59.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.937+0000 7f05527fc640 1 -- 172.21.15.112:0/3667121800 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6853+0+0 (secure 0 0 0) 0x7f055808e0a0 con 0x7f055c0fb810 2024-09-19T09:42:59.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.937+0000 7f0561605640 1 --2- 172.21.15.112:0/3667121800 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f054806e530 0x7f05480709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:59.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.937+0000 7f0561605640 1 --2- 172.21.15.112:0/3667121800 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f054806e530 0x7f05480709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f054c009ac0 tx=0x7f054c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:59.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:42:59.943+0000 7f05527fc640 1 -- 172.21.15.112:0/3667121800 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f05580570a0 con 0x7f055c0fb810 2024-09-19T09:43:00.168 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:59 smithi191 ceph-mon[77624]: pgmap v156: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 3 active+clean+remapped, 9 active+undersized, 4 remapped+peering, 9 peering, 1 active+recovering+undersized+remapped, 6 active+undersized+degraded, 32 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 699/225 objects degraded (310.667%); 691/225 objects misplaced (307.111%); 4.1 MiB/s, 70 objects/s recovering 2024-09-19T09:43:00.168 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:00.169 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:00.169 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:00.169 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:42:59 smithi191 ceph-mon[77624]: osdmap e80: 6 total, 5 up, 6 in 2024-09-19T09:43:00.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.182+0000 7f056406a640 1 -- 172.21.15.112:0/3667121800 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f055c04b750 con 0x7f054806e530 2024-09-19T09:43:00.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:59 smithi112 ceph-mon[97503]: pgmap v156: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 3 active+clean+remapped, 9 active+undersized, 4 remapped+peering, 9 peering, 1 active+recovering+undersized+remapped, 6 active+undersized+degraded, 32 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 699/225 objects degraded (310.667%); 691/225 objects misplaced (307.111%); 4.1 MiB/s, 70 objects/s recovering 2024-09-19T09:43:00.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:00.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:00.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:00.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:42:59 smithi112 ceph-mon[97503]: osdmap e80: 6 total, 5 up, 6 in 2024-09-19T09:43:00.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.190+0000 7f05527fc640 1 -- 172.21.15.112:0/3667121800 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f055c04b750 con 0x7f054806e530 2024-09-19T09:43:00.192 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:43:00.192 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (7m) 94s ago 15m 26.9M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:43:00.193 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (3m) 94s ago 16m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 70bad8ff6ec4 2024-09-19T09:43:00.193 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (3m) 30s ago 15m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 6f8cb10f4c96 2024-09-19T09:43:00.193 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (5m) 94s ago 15m 79.1M - 9.4.12 2bacad6d85d8 e462aca2b022 2024-09-19T09:43:00.193 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (10m) 94s ago 10m 153M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:43:00.193 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (10m) 94s ago 10m 106M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ce5d0e40c569 2024-09-19T09:43:00.193 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (10m) 30s ago 10m 14.3M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:43:00.193 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (10m) 30s ago 10m 16.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:43:00.193 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (6m) 94s ago 17m 500M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:43:00.193 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283,8765 running (5m) 30s ago 14m 441M - 19.1.1-361-g2f599a46 d2baa855c067 fddba1bee64a 2024-09-19T09:43:00.193 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (4m) 94s ago 17m 45.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 89dfb5de44c8 2024-09-19T09:43:00.193 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (3m) 30s ago 14m 38.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 3cab8f7cc27e 2024-09-19T09:43:00.193 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (7m) 94s ago 15m 15.7M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:43:00.193 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (7m) 30s ago 15m 15.9M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:43:00.194 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (2m) 94s ago 14m 99.9M 1557M 19.1.1-361-g2f599a46 d2baa855c067 11a51e663887 2024-09-19T09:43:00.194 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (2m) 94s ago 13m 101M 1557M 19.1.1-361-g2f599a46 d2baa855c067 bd616fcb189b 2024-09-19T09:43:00.194 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (100s) 94s ago 13m 14.3M 1557M 19.1.1-361-g2f599a46 d2baa855c067 4a651b62590f 2024-09-19T09:43:00.194 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (65s) 30s ago 12m 110M 2581M 19.1.1-361-g2f599a46 d2baa855c067 7f953c691608 2024-09-19T09:43:00.194 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (33s) 30s ago 12m 12.1M 2581M 19.1.1-361-g2f599a46 d2baa855c067 3cd638400a3a 2024-09-19T09:43:00.194 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 starting - - - 2581M 2024-09-19T09:43:00.194 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (5m) 94s ago 15m 63.6M - 2.43.0 a07b618ecd1d 54850883a171 2024-09-19T09:43:00.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.193+0000 7f056406a640 1 -- 172.21.15.112:0/3667121800 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f054806e530 msgr2=0x7f05480709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:00.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.193+0000 7f056406a640 1 --2- 172.21.15.112:0/3667121800 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f054806e530 0x7f05480709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f054c009ac0 tx=0x7f054c035040 comp rx=0 tx=0).stop 2024-09-19T09:43:00.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.193+0000 7f056406a640 1 -- 172.21.15.112:0/3667121800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f055c0fb810 msgr2=0x7f055c113160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:00.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.193+0000 7f056406a640 1 --2- 172.21.15.112:0/3667121800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f055c0fb810 0x7f055c113160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0558002a50 tx=0x7f0558004600 comp rx=0 tx=0).stop 2024-09-19T09:43:00.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.193+0000 7f056406a640 1 -- 172.21.15.112:0/3667121800 shutdown_connections 2024-09-19T09:43:00.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.193+0000 7f056406a640 1 --2- 172.21.15.112:0/3667121800 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f054806e530 0x7f05480709e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.193+0000 7f056406a640 1 --2- 172.21.15.112:0/3667121800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f055c0fcf80 0x7f055c1136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.193+0000 7f056406a640 1 --2- 172.21.15.112:0/3667121800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f055c0fb810 0x7f055c113160 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.193+0000 7f056406a640 1 -- 172.21.15.112:0/3667121800 >> 172.21.15.112:0/3667121800 conn(0x7f055c0723b0 msgr2=0x7f055c065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:00.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.193+0000 7f056406a640 1 -- 172.21.15.112:0/3667121800 shutdown_connections 2024-09-19T09:43:00.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.193+0000 7f056406a640 1 -- 172.21.15.112:0/3667121800 wait complete. 2024-09-19T09:43:00.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.269+0000 7f04480ab640 1 -- 172.21.15.112:0/2179916388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0440102530 msgr2=0x7f0440102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:00.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.269+0000 7f04480ab640 1 --2- 172.21.15.112:0/2179916388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0440102530 0x7f0440102900 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f043c0048d0 tx=0x7f043c009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.269+0000 7f04480ab640 1 -- 172.21.15.112:0/2179916388 shutdown_connections 2024-09-19T09:43:00.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.269+0000 7f04480ab640 1 --2- 172.21.15.112:0/2179916388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0440102ed0 0x7f04400fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.269+0000 7f04480ab640 1 --2- 172.21.15.112:0/2179916388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0440102530 0x7f0440102900 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.269+0000 7f04480ab640 1 -- 172.21.15.112:0/2179916388 >> 172.21.15.112:0/2179916388 conn(0x7f04400f80f0 msgr2=0x7f04400fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:00.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.269+0000 7f04480ab640 1 -- 172.21.15.112:0/2179916388 shutdown_connections 2024-09-19T09:43:00.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.269+0000 7f04480ab640 1 -- 172.21.15.112:0/2179916388 wait complete. 2024-09-19T09:43:00.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.270+0000 7f04480ab640 1 Processor -- start 2024-09-19T09:43:00.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.270+0000 7f04480ab640 1 -- start start 2024-09-19T09:43:00.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.270+0000 7f04480ab640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0440102530 0x7f0440113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:00.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.270+0000 7f04480ab640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0440102ed0 0x7f0440113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:00.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.270+0000 7f04480ab640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0440113d80 con 0x7f0440102530 2024-09-19T09:43:00.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.270+0000 7f04480ab640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044010d1c0 con 0x7f0440102ed0 2024-09-19T09:43:00.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.270+0000 7f0445e47640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0440102530 0x7f0440113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:00.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.270+0000 7f0445e47640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0440102530 0x7f0440113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54338/0 (socket says 172.21.15.112:54338) 2024-09-19T09:43:00.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.270+0000 7f0445e47640 1 -- 172.21.15.112:0/2961150675 learned_addr learned my addr 172.21.15.112:0/2961150675 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:43:00.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.270+0000 7f0445e47640 1 -- 172.21.15.112:0/2961150675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0440102ed0 msgr2=0x7f0440113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:00.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.270+0000 7f0445e47640 1 --2- 172.21.15.112:0/2961150675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0440102ed0 0x7f0440113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.270+0000 7f0445e47640 1 -- 172.21.15.112:0/2961150675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c005040 con 0x7f0440102530 2024-09-19T09:43:00.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.271+0000 7f0445e47640 1 --2- 172.21.15.112:0/2961150675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0440102530 0x7f0440113240 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f043c003080 tx=0x7f043c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:00.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.271+0000 7f04367fc640 1 -- 172.21.15.112:0/2961150675 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f043c038070 con 0x7f0440102530 2024-09-19T09:43:00.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.271+0000 7f04480ab640 1 -- 172.21.15.112:0/2961150675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044010d440 con 0x7f0440102530 2024-09-19T09:43:00.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.271+0000 7f04367fc640 1 -- 172.21.15.112:0/2961150675 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f043c0097e0 con 0x7f0440102530 2024-09-19T09:43:00.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.271+0000 7f04367fc640 1 -- 172.21.15.112:0/2961150675 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f043c03d420 con 0x7f0440102530 2024-09-19T09:43:00.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.271+0000 7f04480ab640 1 -- 172.21.15.112:0/2961150675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044010d980 con 0x7f0440102530 2024-09-19T09:43:00.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.272+0000 7f04480ab640 1 -- 172.21.15.112:0/2961150675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04400fdcb0 con 0x7f0440102530 2024-09-19T09:43:00.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.272+0000 7f04367fc640 1 -- 172.21.15.112:0/2961150675 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f043c030020 con 0x7f0440102530 2024-09-19T09:43:00.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.273+0000 7f04367fc640 1 --2- 172.21.15.112:0/2961150675 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f042c06e530 0x7f042c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:00.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.273+0000 7f0445646640 1 --2- 172.21.15.112:0/2961150675 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f042c06e530 0x7f042c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:00.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.273+0000 7f04367fc640 1 -- 172.21.15.112:0/2961150675 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6853+0+0 (secure 0 0 0) 0x7f043c0ae890 con 0x7f0440102530 2024-09-19T09:43:00.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.273+0000 7f0445646640 1 --2- 172.21.15.112:0/2961150675 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f042c06e530 0x7f042c0709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f044010eb00 tx=0x7f0430007cb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:00.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.277+0000 7f04367fc640 1 -- 172.21.15.112:0/2961150675 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f043c077810 con 0x7f0440102530 2024-09-19T09:43:00.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.507+0000 7f04480ab640 1 -- 172.21.15.112:0/2961150675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f04401095a0 con 0x7f0440102530 2024-09-19T09:43:00.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.508+0000 7f04367fc640 1 -- 172.21.15.112:0/2961150675 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7f043c07aed0 con 0x7f0440102530 2024-09-19T09:43:00.510 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:43:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:43:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:43:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:43:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:43:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:43:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:43:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:43:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 5 2024-09-19T09:43:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:43:00.511 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:43:00.511 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T09:43:00.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:43:00.511 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:43:00.511 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4, 2024-09-19T09:43:00.511 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 9 2024-09-19T09:43:00.511 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:43:00.511 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:43:00.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.510+0000 7f04480ab640 1 -- 172.21.15.112:0/2961150675 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f042c06e530 msgr2=0x7f042c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:00.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.510+0000 7f04480ab640 1 --2- 172.21.15.112:0/2961150675 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f042c06e530 0x7f042c0709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f044010eb00 tx=0x7f0430007cb0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.510+0000 7f04480ab640 1 -- 172.21.15.112:0/2961150675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0440102530 msgr2=0x7f0440113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:00.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.510+0000 7f04480ab640 1 --2- 172.21.15.112:0/2961150675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0440102530 0x7f0440113240 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f043c003080 tx=0x7f043c009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.510+0000 7f04480ab640 1 -- 172.21.15.112:0/2961150675 shutdown_connections 2024-09-19T09:43:00.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.510+0000 7f04480ab640 1 --2- 172.21.15.112:0/2961150675 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f042c06e530 0x7f042c0709e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.510+0000 7f04480ab640 1 --2- 172.21.15.112:0/2961150675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0440102ed0 0x7f0440113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.510+0000 7f04480ab640 1 --2- 172.21.15.112:0/2961150675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0440102530 0x7f0440113240 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.510+0000 7f04480ab640 1 -- 172.21.15.112:0/2961150675 >> 172.21.15.112:0/2961150675 conn(0x7f04400f80f0 msgr2=0x7f04400f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:00.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.510+0000 7f04480ab640 1 -- 172.21.15.112:0/2961150675 shutdown_connections 2024-09-19T09:43:00.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.510+0000 7f04480ab640 1 -- 172.21.15.112:0/2961150675 wait complete. 2024-09-19T09:43:00.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.587+0000 7ff705928640 1 -- 172.21.15.112:0/2444436960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7000fcf80 msgr2=0x7ff7000fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:00.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.587+0000 7ff705928640 1 --2- 172.21.15.112:0/2444436960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7000fcf80 0x7ff7000fd3d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80048d0 tx=0x7ff6e8009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.587+0000 7ff705928640 1 -- 172.21.15.112:0/2444436960 shutdown_connections 2024-09-19T09:43:00.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.587+0000 7ff705928640 1 --2- 172.21.15.112:0/2444436960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7000fcf80 0x7ff7000fd3d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.587+0000 7ff705928640 1 --2- 172.21.15.112:0/2444436960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7000fb810 0x7ff7000fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.587+0000 7ff705928640 1 -- 172.21.15.112:0/2444436960 >> 172.21.15.112:0/2444436960 conn(0x7ff7000723b0 msgr2=0x7ff7000727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:00.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.587+0000 7ff705928640 1 -- 172.21.15.112:0/2444436960 shutdown_connections 2024-09-19T09:43:00.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.587+0000 7ff705928640 1 -- 172.21.15.112:0/2444436960 wait complete. 2024-09-19T09:43:00.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.588+0000 7ff705928640 1 Processor -- start 2024-09-19T09:43:00.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.588+0000 7ff705928640 1 -- start start 2024-09-19T09:43:00.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.588+0000 7ff705928640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7000fb810 0x7ff70010e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:00.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.588+0000 7ff705928640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7000fcf80 0x7ff70010e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:00.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.588+0000 7ff705928640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70010ed20 con 0x7ff7000fb810 2024-09-19T09:43:00.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.588+0000 7ff705928640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70010ee90 con 0x7ff7000fcf80 2024-09-19T09:43:00.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.588+0000 7ff6feffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7000fb810 0x7ff70010e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:00.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.588+0000 7ff6feffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7000fb810 0x7ff70010e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54356/0 (socket says 172.21.15.112:54356) 2024-09-19T09:43:00.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.588+0000 7ff6feffd640 1 -- 172.21.15.112:0/2507773517 learned_addr learned my addr 172.21.15.112:0/2507773517 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:43:00.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.589+0000 7ff6f67fc640 1 --2- 172.21.15.112:0/2507773517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7000fcf80 0x7ff70010e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:00.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.589+0000 7ff6feffd640 1 -- 172.21.15.112:0/2507773517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7000fcf80 msgr2=0x7ff70010e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:00.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.589+0000 7ff6feffd640 1 --2- 172.21.15.112:0/2507773517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7000fcf80 0x7ff70010e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.589+0000 7ff6feffd640 1 -- 172.21.15.112:0/2507773517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e8005040 con 0x7ff7000fb810 2024-09-19T09:43:00.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.589+0000 7ff6feffd640 1 --2- 172.21.15.112:0/2507773517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7000fb810 0x7ff70010e190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0002a50 tx=0x7ff6f0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:00.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.591+0000 7ff6f7fff640 1 -- 172.21.15.112:0/2507773517 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6f0007c30 con 0x7ff7000fb810 2024-09-19T09:43:00.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.591+0000 7ff6f7fff640 1 -- 172.21.15.112:0/2507773517 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff6f000f040 con 0x7ff7000fb810 2024-09-19T09:43:00.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.591+0000 7ff6f7fff640 1 -- 172.21.15.112:0/2507773517 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6f000da10 con 0x7ff7000fb810 2024-09-19T09:43:00.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.591+0000 7ff705928640 1 -- 172.21.15.112:0/2507773517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70010bf80 con 0x7ff7000fb810 2024-09-19T09:43:00.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.591+0000 7ff705928640 1 -- 172.21.15.112:0/2507773517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70010c520 con 0x7ff7000fb810 2024-09-19T09:43:00.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.593+0000 7ff705928640 1 -- 172.21.15.112:0/2507773517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7000fcbc0 con 0x7ff7000fb810 2024-09-19T09:43:00.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.594+0000 7ff6f7fff640 1 -- 172.21.15.112:0/2507773517 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff6f000dbb0 con 0x7ff7000fb810 2024-09-19T09:43:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.595+0000 7ff6f7fff640 1 --2- 172.21.15.112:0/2507773517 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff6ec072940 0x7ff6ec074df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.595+0000 7ff6f7fff640 1 -- 172.21.15.112:0/2507773517 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6857+0+0 (secure 0 0 0) 0x7ff6f008db20 con 0x7ff7000fb810 2024-09-19T09:43:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.595+0000 7ff6f67fc640 1 --2- 172.21.15.112:0/2507773517 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff6ec072940 0x7ff6ec074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.596+0000 7ff6f67fc640 1 --2- 172.21.15.112:0/2507773517 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff6ec072940 0x7ff6ec074df0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff700065980 tx=0x7ff6e8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:00.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.599+0000 7ff6f7fff640 1 -- 172.21.15.112:0/2507773517 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff6f0056a80 con 0x7ff7000fb810 2024-09-19T09:43:00.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.801+0000 7ff705928640 1 -- 172.21.15.112:0/2507773517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff70004b720 con 0x7ff7000fb810 2024-09-19T09:43:00.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.801+0000 7ff6f7fff640 1 -- 172.21.15.112:0/2507773517 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1949 (secure 0 0 0) 0x7ff6f00177b0 con 0x7ff7000fb810 2024-09-19T09:43:00.803 INFO:teuthology.orchestra.run.smithi112.stdout:e17 2024-09-19T09:43:00.803 INFO:teuthology.orchestra.run.smithi112.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:43:00.803 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:43:00.803 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:43:00.803 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-19T09:43:00.803 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:43:00.804 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:43:00.804 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-19T09:43:00.804 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 17 2024-09-19T09:43:00.804 INFO:teuthology.orchestra.run.smithi112.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:43:00.804 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:43:00.804 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-19T09:32:42.200999+0000 2024-09-19T09:43:00.804 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-19T09:43:00.804 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-19T09:43:00.804 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-19T09:43:00.804 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-19T09:43:00.804 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-19T09:43:00.804 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-19T09:43:00.804 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-19T09:43:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-19T09:43:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 45 2024-09-19T09:43:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:43:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-19T09:43:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-19T09:43:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14460} 2024-09-19T09:43:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-19T09:43:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-19T09:43:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-19T09:43:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-19T09:43:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-19T09:43:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data disabled 2024-09-19T09:43:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-19T09:43:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-19T09:43:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-19T09:43:00.806 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:43:00.806 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.hcoxjz{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/165136062,v1:172.21.15.112:6829/165136062] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:43:00.806 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ymjyok{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/3468750429,v1:172.21.15.112:6827/3468750429] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:43:00.806 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:43:00.806 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:43:00.806 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-19T09:43:00.806 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:43:00.806 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.qweljt{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:43:00.806 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.jjldod{-1:24281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6824/2759077122,v1:172.21.15.191:6825/2759077122] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:43:00.807 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2024-09-19T09:43:00.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.803+0000 7ff705928640 1 -- 172.21.15.112:0/2507773517 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff6ec072940 msgr2=0x7ff6ec074df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:00.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.803+0000 7ff705928640 1 --2- 172.21.15.112:0/2507773517 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff6ec072940 0x7ff6ec074df0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff700065980 tx=0x7ff6e8035040 comp rx=0 tx=0).stop 2024-09-19T09:43:00.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.803+0000 7ff705928640 1 -- 172.21.15.112:0/2507773517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7000fb810 msgr2=0x7ff70010e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:00.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.803+0000 7ff705928640 1 --2- 172.21.15.112:0/2507773517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7000fb810 0x7ff70010e190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0002a50 tx=0x7ff6f0004600 comp rx=0 tx=0).stop 2024-09-19T09:43:00.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.803+0000 7ff705928640 1 -- 172.21.15.112:0/2507773517 shutdown_connections 2024-09-19T09:43:00.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.803+0000 7ff705928640 1 --2- 172.21.15.112:0/2507773517 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff6ec072940 0x7ff6ec074df0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.803+0000 7ff705928640 1 --2- 172.21.15.112:0/2507773517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7000fcf80 0x7ff70010e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.803+0000 7ff705928640 1 --2- 172.21.15.112:0/2507773517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7000fb810 0x7ff70010e190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.803+0000 7ff705928640 1 -- 172.21.15.112:0/2507773517 >> 172.21.15.112:0/2507773517 conn(0x7ff7000723b0 msgr2=0x7ff7000fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:00.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.803+0000 7ff705928640 1 -- 172.21.15.112:0/2507773517 shutdown_connections 2024-09-19T09:43:00.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.803+0000 7ff705928640 1 -- 172.21.15.112:0/2507773517 wait complete. 2024-09-19T09:43:00.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.883+0000 7f0b8df41640 1 -- 172.21.15.112:0/3442237929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b881014c0 msgr2=0x7f0b88101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:00.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.883+0000 7f0b8df41640 1 --2- 172.21.15.112:0/3442237929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b881014c0 0x7f0b88101890 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0b780048d0 tx=0x7f0b78009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.883+0000 7f0b8df41640 1 -- 172.21.15.112:0/3442237929 shutdown_connections 2024-09-19T09:43:00.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.883+0000 7f0b8df41640 1 --2- 172.21.15.112:0/3442237929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b880fb480 0x7f0b880fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.883+0000 7f0b8df41640 1 --2- 172.21.15.112:0/3442237929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b881014c0 0x7f0b88101890 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.883+0000 7f0b8df41640 1 -- 172.21.15.112:0/3442237929 >> 172.21.15.112:0/3442237929 conn(0x7f0b880f7000 msgr2=0x7f0b880f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:00.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.883+0000 7f0b8df41640 1 -- 172.21.15.112:0/3442237929 shutdown_connections 2024-09-19T09:43:00.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.883+0000 7f0b8df41640 1 -- 172.21.15.112:0/3442237929 wait complete. 2024-09-19T09:43:00.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.884+0000 7f0b8df41640 1 Processor -- start 2024-09-19T09:43:00.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.884+0000 7f0b8df41640 1 -- start start 2024-09-19T09:43:00.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.884+0000 7f0b8df41640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b880fb480 0x7f0b881120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:00.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.884+0000 7f0b8df41640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b881014c0 0x7f0b88112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:00.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.884+0000 7f0b8df41640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b88112c10 con 0x7f0b881014c0 2024-09-19T09:43:00.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.884+0000 7f0b8df41640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8810c050 con 0x7f0b880fb480 2024-09-19T09:43:00.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.884+0000 7f0b86ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b881014c0 0x7f0b88112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:00.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.884+0000 7f0b86ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b881014c0 0x7f0b88112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54362/0 (socket says 172.21.15.112:54362) 2024-09-19T09:43:00.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.884+0000 7f0b86ffd640 1 -- 172.21.15.112:0/744629322 learned_addr learned my addr 172.21.15.112:0/744629322 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:43:00.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.884+0000 7f0b877fe640 1 --2- 172.21.15.112:0/744629322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b880fb480 0x7f0b881120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:00.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.884+0000 7f0b86ffd640 1 -- 172.21.15.112:0/744629322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b880fb480 msgr2=0x7f0b881120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:00.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.884+0000 7f0b86ffd640 1 --2- 172.21.15.112:0/744629322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b880fb480 0x7f0b881120d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.884+0000 7f0b86ffd640 1 -- 172.21.15.112:0/744629322 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b78005040 con 0x7f0b881014c0 2024-09-19T09:43:00.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.885+0000 7f0b86ffd640 1 --2- 172.21.15.112:0/744629322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b881014c0 0x7f0b88112610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00ea20 tx=0x7f0b7c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:00.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.885+0000 7f0b6ffff640 1 -- 172.21.15.112:0/744629322 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b7c00cd10 con 0x7f0b881014c0 2024-09-19T09:43:00.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.885+0000 7f0b8df41640 1 -- 172.21.15.112:0/744629322 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8810c2d0 con 0x7f0b881014c0 2024-09-19T09:43:00.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.885+0000 7f0b6ffff640 1 -- 172.21.15.112:0/744629322 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0b7c00ce70 con 0x7f0b881014c0 2024-09-19T09:43:00.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.885+0000 7f0b6ffff640 1 -- 172.21.15.112:0/744629322 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b7c019950 con 0x7f0b881014c0 2024-09-19T09:43:00.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.885+0000 7f0b8df41640 1 -- 172.21.15.112:0/744629322 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8810c870 con 0x7f0b881014c0 2024-09-19T09:43:00.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.886+0000 7f0b8df41640 1 -- 172.21.15.112:0/744629322 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b880fcbc0 con 0x7f0b881014c0 2024-09-19T09:43:00.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.886+0000 7f0b6ffff640 1 -- 172.21.15.112:0/744629322 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0b7c011c80 con 0x7f0b881014c0 2024-09-19T09:43:00.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.887+0000 7f0b6ffff640 1 --2- 172.21.15.112:0/744629322 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f0b7006e530 0x7f0b700709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:00.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.887+0000 7f0b6ffff640 1 -- 172.21.15.112:0/744629322 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6857+0+0 (secure 0 0 0) 0x7f0b7c015070 con 0x7f0b881014c0 2024-09-19T09:43:00.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.887+0000 7f0b877fe640 1 --2- 172.21.15.112:0/744629322 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f0b7006e530 0x7f0b700709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:00.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.887+0000 7f0b877fe640 1 --2- 172.21.15.112:0/744629322 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f0b7006e530 0x7f0b700709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009ac0 tx=0x7f0b78035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:00.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:00.891+0000 7f0b6ffff640 1 -- 172.21.15.112:0/744629322 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0b7c059ad0 con 0x7f0b881014c0 2024-09-19T09:43:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:00 smithi191 ceph-mon[77624]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:00 smithi191 ceph-mon[77624]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:00 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2961150675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:00 smithi191 ceph-mon[77624]: osdmap e81: 6 total, 5 up, 6 in 2024-09-19T09:43:01.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:00 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2507773517' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:43:01.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.076+0000 7f0b8df41640 1 -- 172.21.15.112:0/744629322 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b88108460 con 0x7f0b7006e530 2024-09-19T09:43:01.078 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:00 smithi112 ceph-mon[97503]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:01.078 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:00 smithi112 ceph-mon[97503]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:01.078 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:00 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2961150675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:01.078 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:00 smithi112 ceph-mon[97503]: osdmap e81: 6 total, 5 up, 6 in 2024-09-19T09:43:01.079 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:00 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2507773517' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:43:01.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.078+0000 7f0b6ffff640 1 -- 172.21.15.112:0/744629322 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0b88108460 con 0x7f0b7006e530 2024-09-19T09:43:01.079 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:43:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:43:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:43:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:43:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-19T09:43:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: "mon", 2024-09-19T09:43:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-19T09:43:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: "crash" 2024-09-19T09:43:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-19T09:43:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "11/21 daemons upgraded", 2024-09-19T09:43:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T09:43:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:43:01.081 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:43:01.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.080+0000 7f0b8df41640 1 -- 172.21.15.112:0/744629322 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f0b7006e530 msgr2=0x7f0b700709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:01.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.080+0000 7f0b8df41640 1 --2- 172.21.15.112:0/744629322 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f0b7006e530 0x7f0b700709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009ac0 tx=0x7f0b78035040 comp rx=0 tx=0).stop 2024-09-19T09:43:01.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.080+0000 7f0b8df41640 1 -- 172.21.15.112:0/744629322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b881014c0 msgr2=0x7f0b88112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:01.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.080+0000 7f0b8df41640 1 --2- 172.21.15.112:0/744629322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b881014c0 0x7f0b88112610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00ea20 tx=0x7f0b7c004470 comp rx=0 tx=0).stop 2024-09-19T09:43:01.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.080+0000 7f0b8df41640 1 -- 172.21.15.112:0/744629322 shutdown_connections 2024-09-19T09:43:01.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.080+0000 7f0b8df41640 1 --2- 172.21.15.112:0/744629322 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f0b7006e530 0x7f0b700709e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.080+0000 7f0b8df41640 1 --2- 172.21.15.112:0/744629322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b881014c0 0x7f0b88112610 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.080+0000 7f0b8df41640 1 --2- 172.21.15.112:0/744629322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b880fb480 0x7f0b881120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.080+0000 7f0b8df41640 1 -- 172.21.15.112:0/744629322 >> 172.21.15.112:0/744629322 conn(0x7f0b880f7000 msgr2=0x7f0b880f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:01.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.080+0000 7f0b8df41640 1 -- 172.21.15.112:0/744629322 shutdown_connections 2024-09-19T09:43:01.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.080+0000 7f0b8df41640 1 -- 172.21.15.112:0/744629322 wait complete. 2024-09-19T09:43:01.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.158+0000 7fc28acd1640 1 -- 172.21.15.112:0/2383482103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2840fcf80 msgr2=0x7fc2840fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:01.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.158+0000 7fc28acd1640 1 --2- 172.21.15.112:0/2383482103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2840fcf80 0x7fc2840fd3d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0048d0 tx=0x7fc26c009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.159+0000 7fc28acd1640 1 -- 172.21.15.112:0/2383482103 shutdown_connections 2024-09-19T09:43:01.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.159+0000 7fc28acd1640 1 --2- 172.21.15.112:0/2383482103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2840fcf80 0x7fc2840fd3d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.159+0000 7fc28acd1640 1 --2- 172.21.15.112:0/2383482103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2840fb810 0x7fc2840fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.159+0000 7fc28acd1640 1 -- 172.21.15.112:0/2383482103 >> 172.21.15.112:0/2383482103 conn(0x7fc2840723b0 msgr2=0x7fc2840727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:01.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.159+0000 7fc28acd1640 1 -- 172.21.15.112:0/2383482103 shutdown_connections 2024-09-19T09:43:01.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.159+0000 7fc28acd1640 1 -- 172.21.15.112:0/2383482103 wait complete. 2024-09-19T09:43:01.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.159+0000 7fc28acd1640 1 Processor -- start 2024-09-19T09:43:01.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.159+0000 7fc28acd1640 1 -- start start 2024-09-19T09:43:01.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.159+0000 7fc28acd1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2840fb810 0x7fc28410e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:01.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.159+0000 7fc28acd1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2840fcf80 0x7fc28410e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:01.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.159+0000 7fc28acd1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28410ed50 con 0x7fc2840fcf80 2024-09-19T09:43:01.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.159+0000 7fc28acd1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28410eec0 con 0x7fc2840fb810 2024-09-19T09:43:01.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.160+0000 7fc283fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2840fcf80 0x7fc28410e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:01.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.160+0000 7fc283fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2840fcf80 0x7fc28410e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54370/0 (socket says 172.21.15.112:54370) 2024-09-19T09:43:01.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.160+0000 7fc283fff640 1 -- 172.21.15.112:0/1824885304 learned_addr learned my addr 172.21.15.112:0/1824885304 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:43:01.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.160+0000 7fc288a6d640 1 --2- 172.21.15.112:0/1824885304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2840fb810 0x7fc28410e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:01.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.160+0000 7fc283fff640 1 -- 172.21.15.112:0/1824885304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2840fb810 msgr2=0x7fc28410e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:01.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.160+0000 7fc283fff640 1 --2- 172.21.15.112:0/1824885304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2840fb810 0x7fc28410e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.160+0000 7fc283fff640 1 -- 172.21.15.112:0/1824885304 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c005040 con 0x7fc2840fcf80 2024-09-19T09:43:01.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.160+0000 7fc283fff640 1 --2- 172.21.15.112:0/1824885304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2840fcf80 0x7fc28410e810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc26c000c00 tx=0x7fc26c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:01.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.160+0000 7fc2817fa640 1 -- 172.21.15.112:0/1824885304 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc26c038070 con 0x7fc2840fcf80 2024-09-19T09:43:01.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.160+0000 7fc28acd1640 1 -- 172.21.15.112:0/1824885304 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2841171a0 con 0x7fc2840fcf80 2024-09-19T09:43:01.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.160+0000 7fc2817fa640 1 -- 172.21.15.112:0/1824885304 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc26c02ade0 con 0x7fc2840fcf80 2024-09-19T09:43:01.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.160+0000 7fc2817fa640 1 -- 172.21.15.112:0/1824885304 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc26c02c7e0 con 0x7fc2840fcf80 2024-09-19T09:43:01.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.160+0000 7fc28acd1640 1 -- 172.21.15.112:0/1824885304 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc284117660 con 0x7fc2840fcf80 2024-09-19T09:43:01.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.161+0000 7fc28acd1640 1 -- 172.21.15.112:0/1824885304 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2840fcbc0 con 0x7fc2840fcf80 2024-09-19T09:43:01.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.162+0000 7fc2817fa640 1 -- 172.21.15.112:0/1824885304 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc26c030020 con 0x7fc2840fcf80 2024-09-19T09:43:01.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.162+0000 7fc2817fa640 1 --2- 172.21.15.112:0/1824885304 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc27006e530 0x7fc2700709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:01.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.162+0000 7fc2817fa640 1 -- 172.21.15.112:0/1824885304 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6857+0+0 (secure 0 0 0) 0x7fc26c0adf60 con 0x7fc2840fcf80 2024-09-19T09:43:01.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.162+0000 7fc288a6d640 1 --2- 172.21.15.112:0/1824885304 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc27006e530 0x7fc2700709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:01.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.163+0000 7fc288a6d640 1 --2- 172.21.15.112:0/1824885304 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc27006e530 0x7fc2700709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc274004ed0 tx=0x7fc27400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:01.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.166+0000 7fc2817fa640 1 -- 172.21.15.112:0/1824885304 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc26c0e3210 con 0x7fc2840fcf80 2024-09-19T09:43:01.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.400+0000 7fc28acd1640 1 -- 172.21.15.112:0/1824885304 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc284065790 con 0x7fc2840fcf80 2024-09-19T09:43:01.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.401+0000 7fc2817fa640 1 -- 172.21.15.112:0/1824885304 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1440 (secure 0 0 0) 0x7fc26c076f90 con 0x7fc2840fcf80 2024-09-19T09:43:01.403 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Reduced data availability: 5 pgs peering; Degraded data redundancy: 699/225 objects degraded (310.667%), 7 pgs degraded 2024-09-19T09:43:01.403 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-19T09:43:01.403 INFO:teuthology.orchestra.run.smithi112.stdout: osd.5 (root=default,host=smithi191) is down 2024-09-19T09:43:01.403 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-19T09:43:01.403 INFO:teuthology.orchestra.run.smithi112.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-19T09:43:01.403 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 5 pgs peering 2024-09-19T09:43:01.403 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.16 is stuck peering for 6m, current state peering, last acting [3,2] 2024-09-19T09:43:01.403 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.18 is stuck peering for 6m, current state remapped+peering, last acting [4,3] 2024-09-19T09:43:01.403 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.19 is stuck peering for 2m, current state remapped+peering, last acting [4,2,0] 2024-09-19T09:43:01.404 INFO:teuthology.orchestra.run.smithi112.stdout: pg 3.f is stuck peering for 6m, current state peering, last acting [3,0] 2024-09-19T09:43:01.404 INFO:teuthology.orchestra.run.smithi112.stdout: pg 3.16 is stuck peering for 6m, current state peering, last acting [3,1] 2024-09-19T09:43:01.404 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 699/225 objects degraded (310.667%), 7 pgs degraded 2024-09-19T09:43:01.404 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-19T09:43:01.404 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-19T09:43:01.404 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-19T09:43:01.404 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-19T09:43:01.404 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-19T09:43:01.404 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-19T09:43:01.404 INFO:teuthology.orchestra.run.smithi112.stdout: pg 3.1d is active+recovery_wait+undersized+degraded+remapped, acting [1,0] 2024-09-19T09:43:01.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.403+0000 7fc28acd1640 1 -- 172.21.15.112:0/1824885304 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc27006e530 msgr2=0x7fc2700709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:01.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.403+0000 7fc28acd1640 1 --2- 172.21.15.112:0/1824885304 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc27006e530 0x7fc2700709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc274004ed0 tx=0x7fc27400b040 comp rx=0 tx=0).stop 2024-09-19T09:43:01.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.403+0000 7fc28acd1640 1 -- 172.21.15.112:0/1824885304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2840fcf80 msgr2=0x7fc28410e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:01.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.403+0000 7fc28acd1640 1 --2- 172.21.15.112:0/1824885304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2840fcf80 0x7fc28410e810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc26c000c00 tx=0x7fc26c009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.403+0000 7fc28acd1640 1 -- 172.21.15.112:0/1824885304 shutdown_connections 2024-09-19T09:43:01.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.403+0000 7fc28acd1640 1 --2- 172.21.15.112:0/1824885304 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc27006e530 0x7fc2700709e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.403+0000 7fc28acd1640 1 --2- 172.21.15.112:0/1824885304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2840fcf80 0x7fc28410e810 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.403+0000 7fc28acd1640 1 --2- 172.21.15.112:0/1824885304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2840fb810 0x7fc28410e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.403+0000 7fc28acd1640 1 -- 172.21.15.112:0/1824885304 >> 172.21.15.112:0/1824885304 conn(0x7fc2840723b0 msgr2=0x7fc2840fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:01.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.403+0000 7fc28acd1640 1 -- 172.21.15.112:0/1824885304 shutdown_connections 2024-09-19T09:43:01.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:01.403+0000 7fc28acd1640 1 -- 172.21.15.112:0/1824885304 wait complete. 2024-09-19T09:43:01.534 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:43:01 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:43:01.194+0000 7fde12b43640 -1 Falling back to public interface 2024-09-19T09:43:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:01 smithi112 ceph-mon[97503]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:01 smithi112 ceph-mon[97503]: pgmap v159: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 3 active+clean+remapped, 14 active+undersized, 4 remapped+peering, 1 active+recovering+undersized+remapped, 10 active+undersized+degraded, 32 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 713/225 objects degraded (316.889%); 691/225 objects misplaced (307.111%); 4.1 MiB/s, 70 objects/s recovering 2024-09-19T09:43:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:01 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/1824885304' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:43:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:01 smithi112 ceph-mon[97503]: Health check update: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-19T09:43:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:01 smithi112 ceph-mon[97503]: osdmap e82: 6 total, 5 up, 6 in 2024-09-19T09:43:02.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:01 smithi191 ceph-mon[77624]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:02.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:01 smithi191 ceph-mon[77624]: pgmap v159: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 3 active+clean+remapped, 14 active+undersized, 4 remapped+peering, 1 active+recovering+undersized+remapped, 10 active+undersized+degraded, 32 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 713/225 objects degraded (316.889%); 691/225 objects misplaced (307.111%); 4.1 MiB/s, 70 objects/s recovering 2024-09-19T09:43:02.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:01 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/1824885304' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:43:02.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:01 smithi191 ceph-mon[77624]: Health check update: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-19T09:43:02.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:01 smithi191 ceph-mon[77624]: osdmap e82: 6 total, 5 up, 6 in 2024-09-19T09:43:03.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:02 smithi112 ceph-mon[97503]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:03.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:02 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:03.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:02 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:03.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:02 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:03.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:02 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:03.217 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:02 smithi191 ceph-mon[77624]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:03.217 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:02 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:03.217 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:02 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:03.217 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:02 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:03.217 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:02 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:04.020 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:03 smithi191 ceph-mon[77624]: pgmap v161: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 5 active+clean+remapped, 14 active+undersized, 1 remapped+peering, 1 active+recovering+undersized+remapped, 10 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 966 B/s rd, 0 op/s; 713/225 objects degraded (316.889%); 694/225 objects misplaced (308.444%); 2.8 MiB/s, 178 objects/s recovering 2024-09-19T09:43:04.020 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:03 smithi191 ceph-mon[77624]: Health check update: Degraded data redundancy: 713/225 objects degraded (316.889%), 11 pgs degraded (PG_DEGRADED) 2024-09-19T09:43:04.020 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:03 smithi191 ceph-mon[77624]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-19T09:43:04.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:03 smithi112 ceph-mon[97503]: pgmap v161: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 5 active+clean+remapped, 14 active+undersized, 1 remapped+peering, 1 active+recovering+undersized+remapped, 10 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 966 B/s rd, 0 op/s; 713/225 objects degraded (316.889%); 694/225 objects misplaced (308.444%); 2.8 MiB/s, 178 objects/s recovering 2024-09-19T09:43:04.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:03 smithi112 ceph-mon[97503]: Health check update: Degraded data redundancy: 713/225 objects degraded (316.889%), 11 pgs degraded (PG_DEGRADED) 2024-09-19T09:43:04.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:03 smithi112 ceph-mon[97503]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-19T09:43:06.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: pgmap v162: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 10 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 23/225 objects degraded (10.222%); 8/225 objects misplaced (3.556%); 2.0 MiB/s, 196 objects/s recovering 2024-09-19T09:43:06.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:06.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:06.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:06.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:06.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:06.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:06.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:06.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:06.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:06.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:06.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:06.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-19T09:43:06.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-19T09:43:06.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-19T09:43:06.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-19T09:43:06.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-19T09:43:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: pgmap v162: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 10 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 23/225 objects degraded (10.222%); 8/225 objects misplaced (3.556%); 2.0 MiB/s, 196 objects/s recovering 2024-09-19T09:43:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:06.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:06.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:06.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:06.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-19T09:43:06.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-19T09:43:06.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-19T09:43:06.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-19T09:43:06.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-19T09:43:07.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:06 smithi112 ceph-mon[97503]: Upgrade: Setting container_image for all osd 2024-09-19T09:43:07.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:06 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-19T09:43:07.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:06 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-19T09:43:07.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:06 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-19T09:43:07.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:06 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-19T09:43:07.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:06 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-19T09:43:07.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:06 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-19T09:43:07.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:06 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-19T09:43:07.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:06 smithi112 ceph-mon[97503]: Upgrade: Setting require_osd_release to 19 squid 2024-09-19T09:43:07.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:06 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-19T09:43:07.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:06 smithi112 ceph-mon[97503]: from='osd.5 [v2:172.21.15.191:6816/4085744094,v1:172.21.15.191:6817/4085744094]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:43:07.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:06 smithi112 ceph-mon[97503]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:43:07.284 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:43:06 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:43:06.844+0000 7fde12b43640 -1 osd.5 73 log_to_monitors true 2024-09-19T09:43:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:06 smithi191 ceph-mon[77624]: Upgrade: Setting container_image for all osd 2024-09-19T09:43:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:06 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-19T09:43:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:06 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-19T09:43:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:06 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-19T09:43:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:06 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-19T09:43:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:06 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-19T09:43:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:06 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-19T09:43:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:06 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-19T09:43:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:06 smithi191 ceph-mon[77624]: Upgrade: Setting require_osd_release to 19 squid 2024-09-19T09:43:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:06 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-19T09:43:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:06 smithi191 ceph-mon[77624]: from='osd.5 [v2:172.21.15.191:6816/4085744094,v1:172.21.15.191:6817/4085744094]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:43:07.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:06 smithi191 ceph-mon[77624]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:43:08.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:07 smithi112 ceph-mon[97503]: pgmap v163: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 10 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 707 B/s rd, 1 op/s; 23/225 objects degraded (10.222%); 8/225 objects misplaced (3.556%); 1.7 MiB/s, 163 objects/s recovering 2024-09-19T09:43:08.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:07 smithi112 ceph-mon[97503]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-19T09:43:08.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:07 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-19T09:43:08.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:07 smithi112 ceph-mon[97503]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:43:08.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:07 smithi112 ceph-mon[97503]: from='osd.5 [v2:172.21.15.191:6816/4085744094,v1:172.21.15.191:6817/4085744094]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:43:08.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:07 smithi112 ceph-mon[97503]: osdmap e83: 6 total, 5 up, 6 in 2024-09-19T09:43:08.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:07 smithi112 ceph-mon[97503]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:43:08.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:07 smithi112 ceph-mon[97503]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-19T09:43:08.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:07 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:08.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:07 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-19T09:43:08.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:07 smithi112 ceph-mon[97503]: from='osd.5 ' entity='osd.5' 2024-09-19T09:43:08.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:07 smithi112 ceph-mon[97503]: osdmap e84: 6 total, 5 up, 6 in 2024-09-19T09:43:08.284 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:43:07 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:43:07.841+0000 7fde068d5640 -1 osd.5 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:43:08.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:07 smithi191 ceph-mon[77624]: pgmap v163: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 10 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 707 B/s rd, 1 op/s; 23/225 objects degraded (10.222%); 8/225 objects misplaced (3.556%); 1.7 MiB/s, 163 objects/s recovering 2024-09-19T09:43:08.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:07 smithi191 ceph-mon[77624]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-19T09:43:08.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:07 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-19T09:43:08.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:07 smithi191 ceph-mon[77624]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:43:08.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:07 smithi191 ceph-mon[77624]: from='osd.5 [v2:172.21.15.191:6816/4085744094,v1:172.21.15.191:6817/4085744094]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:43:08.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:07 smithi191 ceph-mon[77624]: osdmap e83: 6 total, 5 up, 6 in 2024-09-19T09:43:08.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:07 smithi191 ceph-mon[77624]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-19T09:43:08.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:07 smithi191 ceph-mon[77624]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-19T09:43:08.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:07 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:08.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:07 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-19T09:43:08.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:07 smithi191 ceph-mon[77624]: from='osd.5 ' entity='osd.5' 2024-09-19T09:43:08.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:07 smithi191 ceph-mon[77624]: osdmap e84: 6 total, 5 up, 6 in 2024-09-19T09:43:09.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-19T09:43:09.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 2 up:standby 2024-09-19T09:43:09.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:09.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:09.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:09.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:09.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:09.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:09.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:09.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:09.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:09.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: Health check update: Degraded data redundancy: 23/225 objects degraded (10.222%), 10 pgs degraded (PG_DEGRADED) 2024-09-19T09:43:09.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:43:09.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: osd.5 [v2:172.21.15.191:6816/4085744094,v1:172.21.15.191:6817/4085744094] boot 2024-09-19T09:43:09.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: osdmap e85: 6 total, 6 up, 6 in 2024-09-19T09:43:09.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:08 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:43:09.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-19T09:43:09.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 2 up:standby 2024-09-19T09:43:09.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:09.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:09.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:09.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:09.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:09.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:09.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:09.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:09.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:09.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: Health check update: Degraded data redundancy: 23/225 objects degraded (10.222%), 10 pgs degraded (PG_DEGRADED) 2024-09-19T09:43:09.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:43:09.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: osd.5 [v2:172.21.15.191:6816/4085744094,v1:172.21.15.191:6817/4085744094] boot 2024-09-19T09:43:09.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: osdmap e85: 6 total, 6 up, 6 in 2024-09-19T09:43:09.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:08 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:43:10.154 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:09 smithi112 ceph-mon[97503]: pgmap v166: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 10 active+undersized+degraded, 33 active+clean; 202 MiB data, 842 MiB used, 536 GiB / 536 GiB avail; 708 B/s rd, 1 op/s; 23/225 objects degraded (10.222%); 8/225 objects misplaced (3.556%); 0 B/s, 58 objects/s recovering 2024-09-19T09:43:10.154 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:09 smithi112 ceph-mon[97503]: mds.? [v2:172.21.15.112:6826/426090252,v1:172.21.15.112:6827/426090252] up:boot 2024-09-19T09:43:10.154 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:09 smithi112 ceph-mon[97503]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 3 up:standby 2024-09-19T09:43:10.154 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:43:10.154 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:10.154 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.ymjyok", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:43:10.154 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:10.154 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:10.154 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:43:10.154 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:09 smithi112 ceph-mon[97503]: osdmap e86: 6 total, 6 up, 6 in 2024-09-19T09:43:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:09 smithi191 ceph-mon[77624]: pgmap v166: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 10 active+undersized+degraded, 33 active+clean; 202 MiB data, 842 MiB used, 536 GiB / 536 GiB avail; 708 B/s rd, 1 op/s; 23/225 objects degraded (10.222%); 8/225 objects misplaced (3.556%); 0 B/s, 58 objects/s recovering 2024-09-19T09:43:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:09 smithi191 ceph-mon[77624]: mds.? [v2:172.21.15.112:6826/426090252,v1:172.21.15.112:6827/426090252] up:boot 2024-09-19T09:43:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:09 smithi191 ceph-mon[77624]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 3 up:standby 2024-09-19T09:43:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:43:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.ymjyok", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:43:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:43:10.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:09 smithi191 ceph-mon[77624]: osdmap e86: 6 total, 6 up, 6 in 2024-09-19T09:43:11.166 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:10 smithi112 ceph-mon[97503]: Upgrade: Updating mds.cephfs.smithi112.ymjyok 2024-09-19T09:43:11.166 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:10 smithi112 ceph-mon[97503]: Deploying daemon mds.cephfs.smithi112.ymjyok on smithi112 2024-09-19T09:43:11.166 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:10 smithi112 ceph-mon[97503]: osdmap e87: 6 total, 6 up, 6 in 2024-09-19T09:43:11.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:10 smithi191 ceph-mon[77624]: Upgrade: Updating mds.cephfs.smithi112.ymjyok 2024-09-19T09:43:11.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:10 smithi191 ceph-mon[77624]: Deploying daemon mds.cephfs.smithi112.ymjyok on smithi112 2024-09-19T09:43:11.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:10 smithi191 ceph-mon[77624]: osdmap e87: 6 total, 6 up, 6 in 2024-09-19T09:43:12.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:11 smithi191 ceph-mon[77624]: pgmap v169: 65 pgs: 6 peering, 8 active+clean+remapped, 11 active+undersized, 7 active+undersized+degraded, 33 active+clean; 202 MiB data, 842 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 12/225 objects degraded (5.333%); 8/225 objects misplaced (3.556%) 2024-09-19T09:43:12.315 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:11 smithi112 ceph-mon[97503]: pgmap v169: 65 pgs: 6 peering, 8 active+clean+remapped, 11 active+undersized, 7 active+undersized+degraded, 33 active+clean; 202 MiB data, 842 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 12/225 objects degraded (5.333%); 8/225 objects misplaced (3.556%) 2024-09-19T09:43:13.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:12 smithi191 ceph-mon[77624]: osdmap e88: 6 total, 6 up, 6 in 2024-09-19T09:43:13.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:12 smithi191 ceph-mon[77624]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 2 up:standby 2024-09-19T09:43:13.425 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:12 smithi112 ceph-mon[97503]: osdmap e88: 6 total, 6 up, 6 in 2024-09-19T09:43:13.425 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:12 smithi112 ceph-mon[97503]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 2 up:standby 2024-09-19T09:43:14.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:13 smithi191 ceph-mon[77624]: pgmap v172: 65 pgs: 1 active+undersized+remapped, 7 peering, 3 active+clean+remapped, 2 active+undersized, 1 active+undersized+degraded, 51 active+clean; 202 MiB data, 858 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 0 op/s; 3/225 objects degraded (1.333%); 4/225 objects misplaced (1.778%); 0 B/s, 6 objects/s recovering 2024-09-19T09:43:14.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:13 smithi191 ceph-mon[77624]: osdmap e89: 6 total, 6 up, 6 in 2024-09-19T09:43:14.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:13 smithi191 ceph-mon[77624]: Health check update: Degraded data redundancy: 3/225 objects degraded (1.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T09:43:14.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:13 smithi191 ceph-mon[77624]: osdmap e90: 6 total, 6 up, 6 in 2024-09-19T09:43:14.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:13 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:43:14.390 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:13 smithi112 ceph-mon[97503]: pgmap v172: 65 pgs: 1 active+undersized+remapped, 7 peering, 3 active+clean+remapped, 2 active+undersized, 1 active+undersized+degraded, 51 active+clean; 202 MiB data, 858 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 0 op/s; 3/225 objects degraded (1.333%); 4/225 objects misplaced (1.778%); 0 B/s, 6 objects/s recovering 2024-09-19T09:43:14.390 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:13 smithi112 ceph-mon[97503]: osdmap e89: 6 total, 6 up, 6 in 2024-09-19T09:43:14.390 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:13 smithi112 ceph-mon[97503]: Health check update: Degraded data redundancy: 3/225 objects degraded (1.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T09:43:14.390 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:13 smithi112 ceph-mon[97503]: osdmap e90: 6 total, 6 up, 6 in 2024-09-19T09:43:14.390 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:13 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:43:15.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:15 smithi112 ceph-mon[97503]: osdmap e91: 6 total, 6 up, 6 in 2024-09-19T09:43:15.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:15 smithi112 ceph-mon[97503]: pgmap v176: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+undersized+remapped, 2 peering, 61 active+clean; 202 MiB data, 831 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 297 objects/s recovering 2024-09-19T09:43:16.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:15 smithi191 ceph-mon[77624]: osdmap e91: 6 total, 6 up, 6 in 2024-09-19T09:43:16.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:15 smithi191 ceph-mon[77624]: pgmap v176: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+undersized+remapped, 2 peering, 61 active+clean; 202 MiB data, 831 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 297 objects/s recovering 2024-09-19T09:43:16.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:16 smithi112 ceph-mon[97503]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/225 objects degraded (1.333%), 1 pg degraded) 2024-09-19T09:43:16.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:16 smithi112 ceph-mon[97503]: Cluster is now healthy 2024-09-19T09:43:17.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:16 smithi191 ceph-mon[77624]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/225 objects degraded (1.333%), 1 pg degraded) 2024-09-19T09:43:17.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:16 smithi191 ceph-mon[77624]: Cluster is now healthy 2024-09-19T09:43:17.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:17 smithi112 ceph-mon[97503]: pgmap v177: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+undersized+remapped, 2 peering, 61 active+clean; 202 MiB data, 831 MiB used, 536 GiB / 536 GiB avail; 843 KiB/s, 243 objects/s recovering 2024-09-19T09:43:17.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:17.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:17.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:18.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:17 smithi191 ceph-mon[77624]: pgmap v177: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+undersized+remapped, 2 peering, 61 active+clean; 202 MiB data, 831 MiB used, 536 GiB / 536 GiB avail; 843 KiB/s, 243 objects/s recovering 2024-09-19T09:43:18.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:18.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:18.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:18.849 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:18 smithi112 ceph-mon[97503]: mds.? [v2:172.21.15.112:6826/1711973242,v1:172.21.15.112:6827/1711973242] up:boot 2024-09-19T09:43:18.849 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:18 smithi112 ceph-mon[97503]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 3 up:standby 2024-09-19T09:43:18.850 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:18 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:43:19.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:18 smithi191 ceph-mon[77624]: mds.? [v2:172.21.15.112:6826/1711973242,v1:172.21.15.112:6827/1711973242] up:boot 2024-09-19T09:43:19.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:18 smithi191 ceph-mon[77624]: fsmap cephfs:1 {0=cephfs.smithi112.hcoxjz=up:active} 3 up:standby 2024-09-19T09:43:19.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:18 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:43:19.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:19 smithi112 ceph-mon[97503]: pgmap v178: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 237 objects/s recovering 2024-09-19T09:43:20.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:19 smithi191 ceph-mon[77624]: pgmap v178: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 237 objects/s recovering 2024-09-19T09:43:22.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:21 smithi112 ceph-mon[97503]: pgmap v179: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 128 objects/s recovering 2024-09-19T09:43:22.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:21 smithi191 ceph-mon[77624]: pgmap v179: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 128 objects/s recovering 2024-09-19T09:43:23.383 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:23 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:23.383 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:23 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:23.383 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:23 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:23.383 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:23 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:23.383 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:23 smithi112 ceph-mon[97503]: pgmap v180: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 28 objects/s recovering 2024-09-19T09:43:23.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:23 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:23.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:23 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:23.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:23 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:23.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:23 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:23.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:23 smithi191 ceph-mon[77624]: pgmap v180: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 28 objects/s recovering 2024-09-19T09:43:25.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:25.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:43:25.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:25 smithi112 ceph-mon[97503]: pgmap v181: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 25 objects/s recovering 2024-09-19T09:43:25.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:26.238 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:26.238 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:43:26.238 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:25 smithi191 ceph-mon[77624]: pgmap v181: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 25 objects/s recovering 2024-09-19T09:43:26.238 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:27.646 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:27 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:27.647 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:27 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:27.647 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:27 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:27.647 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:27 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:27.647 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:27 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:27.648 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:27 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:27.648 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:27 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:27.648 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:27 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:27.648 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:27 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:27.648 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:27 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:27.649 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:27 smithi112 ceph-mon[97503]: pgmap v182: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 21 objects/s recovering 2024-09-19T09:43:27.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:27 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:27.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:27 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:27.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:27 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:27.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:27 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:27.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:27 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:27.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:27 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:27.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:27 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:27.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:27 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:27.786 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:27 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:27.787 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:27 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:27.787 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:27 smithi191 ceph-mon[77624]: pgmap v182: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 21 objects/s recovering 2024-09-19T09:43:29.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:28 smithi112 ceph-mon[97503]: Upgrade: Updating mds.cephfs.smithi112.hcoxjz 2024-09-19T09:43:29.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:28 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:29.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:28 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.hcoxjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:43:29.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:28 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:29.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:28 smithi112 ceph-mon[97503]: Deploying daemon mds.cephfs.smithi112.hcoxjz on smithi112 2024-09-19T09:43:29.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:28 smithi191 ceph-mon[77624]: Upgrade: Updating mds.cephfs.smithi112.hcoxjz 2024-09-19T09:43:29.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:28 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:29.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:28 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.hcoxjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:43:29.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:28 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:29.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:28 smithi191 ceph-mon[77624]: Deploying daemon mds.cephfs.smithi112.hcoxjz on smithi112 2024-09-19T09:43:30.255 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:29 smithi112 ceph-mon[97503]: pgmap v183: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 21 objects/s recovering 2024-09-19T09:43:30.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:29 smithi191 ceph-mon[77624]: pgmap v183: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 21 objects/s recovering 2024-09-19T09:43:30.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:30 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112[97499]: 2024-09-19T09:43:30.253+0000 7fb07784d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:43:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:30 smithi191 ceph-mon[77624]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:43:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:30 smithi191 ceph-mon[77624]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:43:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:30 smithi191 ceph-mon[77624]: osdmap e92: 6 total, 6 up, 6 in 2024-09-19T09:43:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:30 smithi191 ceph-mon[77624]: Standby daemon mds.cephfs.smithi191.qweljt assigned to filesystem cephfs as rank 0 2024-09-19T09:43:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:30 smithi191 ceph-mon[77624]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:43:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:30 smithi191 ceph-mon[77624]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-19T09:43:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:30 smithi191 ceph-mon[77624]: fsmap cephfs:1/1 {0=cephfs.smithi191.qweljt=up:replay} 2 up:standby 2024-09-19T09:43:31.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:30 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.hcoxjz"}]: dispatch 2024-09-19T09:43:31.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:30 smithi112 ceph-mon[97503]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:43:31.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:30 smithi112 ceph-mon[97503]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:43:31.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:30 smithi112 ceph-mon[97503]: osdmap e92: 6 total, 6 up, 6 in 2024-09-19T09:43:31.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:30 smithi112 ceph-mon[97503]: Standby daemon mds.cephfs.smithi191.qweljt assigned to filesystem cephfs as rank 0 2024-09-19T09:43:31.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:30 smithi112 ceph-mon[97503]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:43:31.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:30 smithi112 ceph-mon[97503]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-19T09:43:31.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:30 smithi112 ceph-mon[97503]: fsmap cephfs:1/1 {0=cephfs.smithi191.qweljt=up:replay} 2 up:standby 2024-09-19T09:43:31.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:30 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.hcoxjz"}]: dispatch 2024-09-19T09:43:31.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.492+0000 7f62601be640 1 -- 172.21.15.112:0/338039605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6258102ef0 msgr2=0x7f62580fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:31.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.492+0000 7f62601be640 1 --2- 172.21.15.112:0/338039605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6258102ef0 0x7f62580fc5b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f62480048d0 tx=0x7f6248009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.492+0000 7f62601be640 1 -- 172.21.15.112:0/338039605 shutdown_connections 2024-09-19T09:43:31.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.492+0000 7f62601be640 1 --2- 172.21.15.112:0/338039605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6258102ef0 0x7f62580fc5b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.492+0000 7f62601be640 1 --2- 172.21.15.112:0/338039605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6258102550 0x7f6258102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.492+0000 7f62601be640 1 -- 172.21.15.112:0/338039605 >> 172.21.15.112:0/338039605 conn(0x7f62580f80f0 msgr2=0x7f62580fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:31.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.492+0000 7f62601be640 1 -- 172.21.15.112:0/338039605 shutdown_connections 2024-09-19T09:43:31.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.492+0000 7f62601be640 1 -- 172.21.15.112:0/338039605 wait complete. 2024-09-19T09:43:31.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.493+0000 7f62601be640 1 Processor -- start 2024-09-19T09:43:31.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.493+0000 7f62601be640 1 -- start start 2024-09-19T09:43:31.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.493+0000 7f62601be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6258102550 0x7f6258113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:31.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.493+0000 7f62601be640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6258102ef0 0x7f6258113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:31.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.493+0000 7f62601be640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62581140b0 con 0x7f6258102550 2024-09-19T09:43:31.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.493+0000 7f62601be640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625810d4c0 con 0x7f6258102ef0 2024-09-19T09:43:31.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.493+0000 7f625df5a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6258102550 0x7f6258113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:31.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.493+0000 7f625df5a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6258102550 0x7f6258113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53822/0 (socket says 172.21.15.112:53822) 2024-09-19T09:43:31.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.493+0000 7f625df5a640 1 -- 172.21.15.112:0/1777767660 learned_addr learned my addr 172.21.15.112:0/1777767660 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:43:31.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.494+0000 7f625d759640 1 --2- 172.21.15.112:0/1777767660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6258102ef0 0x7f6258113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:31.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.494+0000 7f625df5a640 1 -- 172.21.15.112:0/1777767660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6258102ef0 msgr2=0x7f6258113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:31.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.494+0000 7f625df5a640 1 --2- 172.21.15.112:0/1777767660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6258102ef0 0x7f6258113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.494+0000 7f625df5a640 1 -- 172.21.15.112:0/1777767660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6248005040 con 0x7f6258102550 2024-09-19T09:43:31.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.494+0000 7f625df5a640 1 --2- 172.21.15.112:0/1777767660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6258102550 0x7f6258113520 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f625400ece0 tx=0x7f625400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:31.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.494+0000 7f624e7fc640 1 -- 172.21.15.112:0/1777767660 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f625400ee40 con 0x7f6258102550 2024-09-19T09:43:31.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.494+0000 7f624e7fc640 1 -- 172.21.15.112:0/1777767660 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f625400f040 con 0x7f6258102550 2024-09-19T09:43:31.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.494+0000 7f624e7fc640 1 -- 172.21.15.112:0/1777767660 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6254009580 con 0x7f6258102550 2024-09-19T09:43:31.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.494+0000 7f62601be640 1 -- 172.21.15.112:0/1777767660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625810d7a0 con 0x7f6258102550 2024-09-19T09:43:31.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.494+0000 7f62601be640 1 -- 172.21.15.112:0/1777767660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625810dd10 con 0x7f6258102550 2024-09-19T09:43:31.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.495+0000 7f62601be640 1 -- 172.21.15.112:0/1777767660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62580fdcd0 con 0x7f6258102550 2024-09-19T09:43:31.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.496+0000 7f624e7fc640 1 -- 172.21.15.112:0/1777767660 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f625400ccc0 con 0x7f6258102550 2024-09-19T09:43:31.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.496+0000 7f624e7fc640 1 --2- 172.21.15.112:0/1777767660 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f624406e530 0x7f62440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:31.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.496+0000 7f624e7fc640 1 -- 172.21.15.112:0/1777767660 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6679+0+0 (secure 0 0 0) 0x7f625408e7b0 con 0x7f6258102550 2024-09-19T09:43:31.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.496+0000 7f625d759640 1 --2- 172.21.15.112:0/1777767660 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f624406e530 0x7f62440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:31.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.497+0000 7f625d759640 1 --2- 172.21.15.112:0/1777767660 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f624406e530 0x7f62440709e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6248000c00 tx=0x7f6248035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:31.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.501+0000 7f624e7fc640 1 -- 172.21.15.112:0/1777767660 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6254057860 con 0x7f6258102550 2024-09-19T09:43:31.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.684+0000 7f62601be640 1 -- 172.21.15.112:0/1777767660 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f625804b750 con 0x7f624406e530 2024-09-19T09:43:31.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.685+0000 7f624e7fc640 1 -- 172.21.15.112:0/1777767660 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f625804b750 con 0x7f624406e530 2024-09-19T09:43:31.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.687+0000 7f62601be640 1 -- 172.21.15.112:0/1777767660 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f624406e530 msgr2=0x7f62440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:31.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.687+0000 7f62601be640 1 --2- 172.21.15.112:0/1777767660 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f624406e530 0x7f62440709e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6248000c00 tx=0x7f6248035040 comp rx=0 tx=0).stop 2024-09-19T09:43:31.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.687+0000 7f62601be640 1 -- 172.21.15.112:0/1777767660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6258102550 msgr2=0x7f6258113520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:31.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.687+0000 7f62601be640 1 --2- 172.21.15.112:0/1777767660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6258102550 0x7f6258113520 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f625400ece0 tx=0x7f625400b040 comp rx=0 tx=0).stop 2024-09-19T09:43:31.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.687+0000 7f62601be640 1 -- 172.21.15.112:0/1777767660 shutdown_connections 2024-09-19T09:43:31.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.687+0000 7f62601be640 1 --2- 172.21.15.112:0/1777767660 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f624406e530 0x7f62440709e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.687+0000 7f62601be640 1 --2- 172.21.15.112:0/1777767660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6258102ef0 0x7f6258113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.687+0000 7f62601be640 1 --2- 172.21.15.112:0/1777767660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6258102550 0x7f6258113520 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.687+0000 7f62601be640 1 -- 172.21.15.112:0/1777767660 >> 172.21.15.112:0/1777767660 conn(0x7f62580f80f0 msgr2=0x7f62580f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:31.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.688+0000 7f62601be640 1 -- 172.21.15.112:0/1777767660 shutdown_connections 2024-09-19T09:43:31.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.688+0000 7f62601be640 1 -- 172.21.15.112:0/1777767660 wait complete. 2024-09-19T09:43:31.698 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:43:31.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.766+0000 7ff8e1c5f640 1 -- 172.21.15.112:0/3246746539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8dc102ef0 msgr2=0x7ff8dc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:31.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.766+0000 7ff8e1c5f640 1 --2- 172.21.15.112:0/3246746539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8dc102ef0 0x7ff8dc0fc5b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40048d0 tx=0x7ff8c4009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.766+0000 7ff8e1c5f640 1 -- 172.21.15.112:0/3246746539 shutdown_connections 2024-09-19T09:43:31.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.767+0000 7ff8e1c5f640 1 --2- 172.21.15.112:0/3246746539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8dc102ef0 0x7ff8dc0fc5b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.767+0000 7ff8e1c5f640 1 --2- 172.21.15.112:0/3246746539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8dc102550 0x7ff8dc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.767+0000 7ff8e1c5f640 1 -- 172.21.15.112:0/3246746539 >> 172.21.15.112:0/3246746539 conn(0x7ff8dc0f80f0 msgr2=0x7ff8dc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:31.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.767+0000 7ff8e1c5f640 1 -- 172.21.15.112:0/3246746539 shutdown_connections 2024-09-19T09:43:31.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.767+0000 7ff8e1c5f640 1 -- 172.21.15.112:0/3246746539 wait complete. 2024-09-19T09:43:31.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.767+0000 7ff8e1c5f640 1 Processor -- start 2024-09-19T09:43:31.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.767+0000 7ff8e1c5f640 1 -- start start 2024-09-19T09:43:31.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.767+0000 7ff8e1c5f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8dc102550 0x7ff8dc113530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:31.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.768+0000 7ff8e1c5f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8dc102ef0 0x7ff8dc113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:31.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.768+0000 7ff8e1c5f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc1140c0 con 0x7ff8dc102ef0 2024-09-19T09:43:31.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.768+0000 7ff8e1c5f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc10d4d0 con 0x7ff8dc102550 2024-09-19T09:43:31.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.768+0000 7ff8d3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8dc102ef0 0x7ff8dc113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:31.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.768+0000 7ff8d3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8dc102ef0 0x7ff8dc113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53834/0 (socket says 172.21.15.112:53834) 2024-09-19T09:43:31.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.768+0000 7ff8d3fff640 1 -- 172.21.15.112:0/805404013 learned_addr learned my addr 172.21.15.112:0/805404013 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:43:31.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.768+0000 7ff8db7fe640 1 --2- 172.21.15.112:0/805404013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8dc102550 0x7ff8dc113530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:31.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.768+0000 7ff8d3fff640 1 -- 172.21.15.112:0/805404013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8dc102550 msgr2=0x7ff8dc113530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:31.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.768+0000 7ff8d3fff640 1 --2- 172.21.15.112:0/805404013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8dc102550 0x7ff8dc113530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.768+0000 7ff8d3fff640 1 -- 172.21.15.112:0/805404013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4005040 con 0x7ff8dc102ef0 2024-09-19T09:43:31.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.768+0000 7ff8d3fff640 1 --2- 172.21.15.112:0/805404013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8dc102ef0 0x7ff8dc113a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40043d0 tx=0x7ff8c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:31.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.768+0000 7ff8d8ff9640 1 -- 172.21.15.112:0/805404013 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8c4038070 con 0x7ff8dc102ef0 2024-09-19T09:43:31.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.768+0000 7ff8d8ff9640 1 -- 172.21.15.112:0/805404013 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff8c40096e0 con 0x7ff8dc102ef0 2024-09-19T09:43:31.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.768+0000 7ff8e1c5f640 1 -- 172.21.15.112:0/805404013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc10d750 con 0x7ff8dc102ef0 2024-09-19T09:43:31.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.768+0000 7ff8d8ff9640 1 -- 172.21.15.112:0/805404013 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8c402c8a0 con 0x7ff8dc102ef0 2024-09-19T09:43:31.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.769+0000 7ff8e1c5f640 1 -- 172.21.15.112:0/805404013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc10dc90 con 0x7ff8dc102ef0 2024-09-19T09:43:31.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.769+0000 7ff8e1c5f640 1 -- 172.21.15.112:0/805404013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc0fdcd0 con 0x7ff8dc102ef0 2024-09-19T09:43:31.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.770+0000 7ff8d8ff9640 1 -- 172.21.15.112:0/805404013 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff8c4030020 con 0x7ff8dc102ef0 2024-09-19T09:43:31.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.771+0000 7ff8d8ff9640 1 --2- 172.21.15.112:0/805404013 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff8c806e530 0x7ff8c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:31.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.771+0000 7ff8db7fe640 1 --2- 172.21.15.112:0/805404013 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff8c806e530 0x7ff8c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:31.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.771+0000 7ff8d8ff9640 1 -- 172.21.15.112:0/805404013 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6679+0+0 (secure 0 0 0) 0x7ff8c40ae2c0 con 0x7ff8dc102ef0 2024-09-19T09:43:31.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.772+0000 7ff8db7fe640 1 --2- 172.21.15.112:0/805404013 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff8c806e530 0x7ff8c80709e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc004ed0 tx=0x7ff8cc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:31.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.775+0000 7ff8d8ff9640 1 -- 172.21.15.112:0/805404013 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff8c4077580 con 0x7ff8dc102ef0 2024-09-19T09:43:31.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.959+0000 7ff8e1c5f640 1 -- 172.21.15.112:0/805404013 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8dc109580 con 0x7ff8c806e530 2024-09-19T09:43:31.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.960+0000 7ff8d8ff9640 1 -- 172.21.15.112:0/805404013 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff8dc109580 con 0x7ff8c806e530 2024-09-19T09:43:31.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.962+0000 7ff8e1c5f640 1 -- 172.21.15.112:0/805404013 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff8c806e530 msgr2=0x7ff8c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:31.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.962+0000 7ff8e1c5f640 1 --2- 172.21.15.112:0/805404013 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff8c806e530 0x7ff8c80709e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc004ed0 tx=0x7ff8cc00b040 comp rx=0 tx=0).stop 2024-09-19T09:43:31.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.963+0000 7ff8e1c5f640 1 -- 172.21.15.112:0/805404013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8dc102ef0 msgr2=0x7ff8dc113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:31.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.963+0000 7ff8e1c5f640 1 --2- 172.21.15.112:0/805404013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8dc102ef0 0x7ff8dc113a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40043d0 tx=0x7ff8c4009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.963+0000 7ff8e1c5f640 1 -- 172.21.15.112:0/805404013 shutdown_connections 2024-09-19T09:43:31.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.963+0000 7ff8e1c5f640 1 --2- 172.21.15.112:0/805404013 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff8c806e530 0x7ff8c80709e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.963+0000 7ff8e1c5f640 1 --2- 172.21.15.112:0/805404013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8dc102ef0 0x7ff8dc113a70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.963+0000 7ff8e1c5f640 1 --2- 172.21.15.112:0/805404013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8dc102550 0x7ff8dc113530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.963+0000 7ff8e1c5f640 1 -- 172.21.15.112:0/805404013 >> 172.21.15.112:0/805404013 conn(0x7ff8dc0f80f0 msgr2=0x7ff8dc0f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:31.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.963+0000 7ff8e1c5f640 1 -- 172.21.15.112:0/805404013 shutdown_connections 2024-09-19T09:43:31.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:31.963+0000 7ff8e1c5f640 1 -- 172.21.15.112:0/805404013 wait complete. 2024-09-19T09:43:32.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.040+0000 7fe7725d3640 1 -- 172.21.15.112:0/3951150712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c064fe0 msgr2=0x7fe76c065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.040+0000 7fe7725d3640 1 --2- 172.21.15.112:0/3951150712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c064fe0 0x7fe76c065430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe7600048d0 tx=0x7fe760009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.040+0000 7fe7725d3640 1 -- 172.21.15.112:0/3951150712 shutdown_connections 2024-09-19T09:43:32.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.040+0000 7fe7725d3640 1 --2- 172.21.15.112:0/3951150712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c064fe0 0x7fe76c065430 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.041+0000 7fe7725d3640 1 --2- 172.21.15.112:0/3951150712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe76c0fe450 0x7fe76c0fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.041+0000 7fe7725d3640 1 -- 172.21.15.112:0/3951150712 >> 172.21.15.112:0/3951150712 conn(0x7fe76c0723b0 msgr2=0x7fe76c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:32.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:31 smithi112 ceph-mon[97503]: pgmap v185: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:43:32.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.041+0000 7fe7725d3640 1 -- 172.21.15.112:0/3951150712 shutdown_connections 2024-09-19T09:43:32.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.041+0000 7fe7725d3640 1 -- 172.21.15.112:0/3951150712 wait complete. 2024-09-19T09:43:32.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.041+0000 7fe7725d3640 1 Processor -- start 2024-09-19T09:43:32.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.041+0000 7fe7725d3640 1 -- start start 2024-09-19T09:43:32.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe7725d3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c064fe0 0x7fe76c115490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe7725d3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe76c0fe450 0x7fe76c1159d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe7725d3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c115fd0 con 0x7fe76c064fe0 2024-09-19T09:43:32.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe7725d3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c10f3e0 con 0x7fe76c0fe450 2024-09-19T09:43:32.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe76bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c064fe0 0x7fe76c115490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe76bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c064fe0 0x7fe76c115490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53846/0 (socket says 172.21.15.112:53846) 2024-09-19T09:43:32.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe76bfff640 1 -- 172.21.15.112:0/3205457971 learned_addr learned my addr 172.21.15.112:0/3205457971 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:43:32.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe76b7fe640 1 --2- 172.21.15.112:0/3205457971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe76c0fe450 0x7fe76c1159d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe76bfff640 1 -- 172.21.15.112:0/3205457971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe76c0fe450 msgr2=0x7fe76c1159d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe76bfff640 1 --2- 172.21.15.112:0/3205457971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe76c0fe450 0x7fe76c1159d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe76bfff640 1 -- 172.21.15.112:0/3205457971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe760005040 con 0x7fe76c064fe0 2024-09-19T09:43:32.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe76bfff640 1 --2- 172.21.15.112:0/3205457971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c064fe0 0x7fe76c115490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe75c002a50 tx=0x7fe75c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:32.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe768ff9640 1 -- 172.21.15.112:0/3205457971 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe75c007c30 con 0x7fe76c064fe0 2024-09-19T09:43:32.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe768ff9640 1 -- 172.21.15.112:0/3205457971 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe75c00f040 con 0x7fe76c064fe0 2024-09-19T09:43:32.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe7725d3640 1 -- 172.21.15.112:0/3205457971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76c10f6c0 con 0x7fe76c064fe0 2024-09-19T09:43:32.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe768ff9640 1 -- 172.21.15.112:0/3205457971 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe75c00da10 con 0x7fe76c064fe0 2024-09-19T09:43:32.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.042+0000 7fe7725d3640 1 -- 172.21.15.112:0/3205457971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c10fbb0 con 0x7fe76c064fe0 2024-09-19T09:43:32.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.044+0000 7fe7725d3640 1 -- 172.21.15.112:0/3205457971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76c0fdce0 con 0x7fe76c064fe0 2024-09-19T09:43:32.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.045+0000 7fe768ff9640 1 -- 172.21.15.112:0/3205457971 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe75c00dc50 con 0x7fe76c064fe0 2024-09-19T09:43:32.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.045+0000 7fe768ff9640 1 --2- 172.21.15.112:0/3205457971 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe75406e530 0x7fe7540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.045+0000 7fe768ff9640 1 -- 172.21.15.112:0/3205457971 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6679+0+0 (secure 0 0 0) 0x7fe75c08d970 con 0x7fe76c064fe0 2024-09-19T09:43:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.045+0000 7fe76b7fe640 1 --2- 172.21.15.112:0/3205457971 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe75406e530 0x7fe7540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.046+0000 7fe76b7fe640 1 --2- 172.21.15.112:0/3205457971 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe75406e530 0x7fe7540709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe760009ac0 tx=0x7fe760035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:32.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.049+0000 7fe768ff9640 1 -- 172.21.15.112:0/3205457971 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe75c056ad0 con 0x7fe76c064fe0 2024-09-19T09:43:32.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.227+0000 7fe7725d3640 1 -- 172.21.15.112:0/3205457971 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe76c04b750 con 0x7fe75406e530 2024-09-19T09:43:32.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.236+0000 7fe768ff9640 1 -- 172.21.15.112:0/3205457971 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe76c04b750 con 0x7fe75406e530 2024-09-19T09:43:32.237 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:43:32.238 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (7m) 10s ago 16m 26.5M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:43:32.238 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (3m) 10s ago 16m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 70bad8ff6ec4 2024-09-19T09:43:32.238 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (3m) 30s ago 15m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 6f8cb10f4c96 2024-09-19T09:43:32.238 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (6m) 10s ago 16m 79.1M - 9.4.12 2bacad6d85d8 e462aca2b022 2024-09-19T09:43:32.238 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (10m) 10s ago 10m 153M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8396a91f8223 2024-09-19T09:43:32.238 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (15s) 10s ago 11m 10.9M - 19.1.1-361-g2f599a46 d2baa855c067 3964ad1a1679 2024-09-19T09:43:32.238 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (11m) 30s ago 10m 14.5M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5758255da414 2024-09-19T09:43:32.238 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (10m) 30s ago 10m 16.9M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:43:32.238 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (7m) 10s ago 17m 505M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:43:32.238 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283,8765 running (6m) 30s ago 15m 441M - 19.1.1-361-g2f599a46 d2baa855c067 fddba1bee64a 2024-09-19T09:43:32.238 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (4m) 10s ago 17m 49.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 89dfb5de44c8 2024-09-19T09:43:32.238 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (4m) 30s ago 15m 38.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 3cab8f7cc27e 2024-09-19T09:43:32.238 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (8m) 10s ago 16m 15.5M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:43:32.239 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (7m) 30s ago 15m 16.5M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:43:32.239 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (3m) 10s ago 14m 150M 1557M 19.1.1-361-g2f599a46 d2baa855c067 11a51e663887 2024-09-19T09:43:32.239 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (2m) 10s ago 14m 194M 1557M 19.1.1-361-g2f599a46 d2baa855c067 bd616fcb189b 2024-09-19T09:43:32.239 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (2m) 10s ago 13m 173M 1557M 19.1.1-361-g2f599a46 d2baa855c067 4a651b62590f 2024-09-19T09:43:32.239 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (97s) 30s ago 13m 117M 2581M 19.1.1-361-g2f599a46 d2baa855c067 7f953c691608 2024-09-19T09:43:32.239 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (65s) 30s ago 12m 139M 2581M 19.1.1-361-g2f599a46 d2baa855c067 3cd638400a3a 2024-09-19T09:43:32.239 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (33s) 30s ago 12m 14.3M 2581M 19.1.1-361-g2f599a46 d2baa855c067 901aaba16a54 2024-09-19T09:43:32.239 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (6m) 10s ago 15m 63.7M - 2.43.0 a07b618ecd1d 54850883a171 2024-09-19T09:43:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.238+0000 7fe7725d3640 1 -- 172.21.15.112:0/3205457971 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe75406e530 msgr2=0x7fe7540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.238+0000 7fe7725d3640 1 --2- 172.21.15.112:0/3205457971 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe75406e530 0x7fe7540709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe760009ac0 tx=0x7fe760035040 comp rx=0 tx=0).stop 2024-09-19T09:43:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.238+0000 7fe7725d3640 1 -- 172.21.15.112:0/3205457971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c064fe0 msgr2=0x7fe76c115490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.238+0000 7fe7725d3640 1 --2- 172.21.15.112:0/3205457971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c064fe0 0x7fe76c115490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe75c002a50 tx=0x7fe75c004600 comp rx=0 tx=0).stop 2024-09-19T09:43:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.238+0000 7fe7725d3640 1 -- 172.21.15.112:0/3205457971 shutdown_connections 2024-09-19T09:43:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.238+0000 7fe7725d3640 1 --2- 172.21.15.112:0/3205457971 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe75406e530 0x7fe7540709e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.238+0000 7fe7725d3640 1 --2- 172.21.15.112:0/3205457971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe76c0fe450 0x7fe76c1159d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.238+0000 7fe7725d3640 1 --2- 172.21.15.112:0/3205457971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c064fe0 0x7fe76c115490 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.238+0000 7fe7725d3640 1 -- 172.21.15.112:0/3205457971 >> 172.21.15.112:0/3205457971 conn(0x7fe76c0723b0 msgr2=0x7fe76c103380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:32.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.238+0000 7fe7725d3640 1 -- 172.21.15.112:0/3205457971 shutdown_connections 2024-09-19T09:43:32.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.238+0000 7fe7725d3640 1 -- 172.21.15.112:0/3205457971 wait complete. 2024-09-19T09:43:32.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:31 smithi191 ceph-mon[77624]: pgmap v185: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:43:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.315+0000 7fd0201b0640 1 -- 172.21.15.112:0/2017829512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd018102550 msgr2=0x7fd018102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.315+0000 7fd0201b0640 1 --2- 172.21.15.112:0/2017829512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd018102550 0x7fd018102920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd0100048d0 tx=0x7fd010009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.315+0000 7fd0201b0640 1 -- 172.21.15.112:0/2017829512 shutdown_connections 2024-09-19T09:43:32.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.315+0000 7fd0201b0640 1 --2- 172.21.15.112:0/2017829512 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd018102ef0 0x7fd0180fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.315+0000 7fd0201b0640 1 --2- 172.21.15.112:0/2017829512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd018102550 0x7fd018102920 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.315+0000 7fd0201b0640 1 -- 172.21.15.112:0/2017829512 >> 172.21.15.112:0/2017829512 conn(0x7fd0180f80f0 msgr2=0x7fd0180fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:32.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.315+0000 7fd0201b0640 1 -- 172.21.15.112:0/2017829512 shutdown_connections 2024-09-19T09:43:32.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.315+0000 7fd0201b0640 1 -- 172.21.15.112:0/2017829512 wait complete. 2024-09-19T09:43:32.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.316+0000 7fd0201b0640 1 Processor -- start 2024-09-19T09:43:32.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.316+0000 7fd0201b0640 1 -- start start 2024-09-19T09:43:32.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.316+0000 7fd0201b0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd018102550 0x7fd018115740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.316+0000 7fd0201b0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd018102ef0 0x7fd018115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.316+0000 7fd0201b0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0181162d0 con 0x7fd018102ef0 2024-09-19T09:43:32.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.316+0000 7fd0201b0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01810f6e0 con 0x7fd018102550 2024-09-19T09:43:32.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.316+0000 7fd01d74b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd018102ef0 0x7fd018115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.316+0000 7fd01d74b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd018102ef0 0x7fd018115c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53876/0 (socket says 172.21.15.112:53876) 2024-09-19T09:43:32.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.316+0000 7fd01d74b640 1 -- 172.21.15.112:0/2085060939 learned_addr learned my addr 172.21.15.112:0/2085060939 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:43:32.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.316+0000 7fd01df4c640 1 --2- 172.21.15.112:0/2085060939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd018102550 0x7fd018115740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.316+0000 7fd01d74b640 1 -- 172.21.15.112:0/2085060939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd018102550 msgr2=0x7fd018115740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.316+0000 7fd01d74b640 1 --2- 172.21.15.112:0/2085060939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd018102550 0x7fd018115740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.316+0000 7fd01d74b640 1 -- 172.21.15.112:0/2085060939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd010005040 con 0x7fd018102ef0 2024-09-19T09:43:32.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.317+0000 7fd01d74b640 1 --2- 172.21.15.112:0/2085060939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd018102ef0 0x7fd018115c80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00eb40 tx=0x7fd00c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:32.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.317+0000 7fd0167fc640 1 -- 172.21.15.112:0/2085060939 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd00c007c30 con 0x7fd018102ef0 2024-09-19T09:43:32.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.317+0000 7fd0167fc640 1 -- 172.21.15.112:0/2085060939 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd00c00f040 con 0x7fd018102ef0 2024-09-19T09:43:32.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.317+0000 7fd0201b0640 1 -- 172.21.15.112:0/2085060939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd01810f960 con 0x7fd018102ef0 2024-09-19T09:43:32.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.317+0000 7fd0167fc640 1 -- 172.21.15.112:0/2085060939 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd00c00ca90 con 0x7fd018102ef0 2024-09-19T09:43:32.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.317+0000 7fd0201b0640 1 -- 172.21.15.112:0/2085060939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01810ff00 con 0x7fd018102ef0 2024-09-19T09:43:32.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.318+0000 7fd0201b0640 1 -- 172.21.15.112:0/2085060939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0180fdcd0 con 0x7fd018102ef0 2024-09-19T09:43:32.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.318+0000 7fd0167fc640 1 -- 172.21.15.112:0/2085060939 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd00c00cc10 con 0x7fd018102ef0 2024-09-19T09:43:32.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.319+0000 7fd0167fc640 1 --2- 172.21.15.112:0/2085060939 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fd00006e530 0x7fd0000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.319+0000 7fd0167fc640 1 -- 172.21.15.112:0/2085060939 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6679+0+0 (secure 0 0 0) 0x7fd00c08de00 con 0x7fd018102ef0 2024-09-19T09:43:32.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.319+0000 7fd01df4c640 1 --2- 172.21.15.112:0/2085060939 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fd00006e530 0x7fd0000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.319+0000 7fd01df4c640 1 --2- 172.21.15.112:0/2085060939 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fd00006e530 0x7fd0000709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd010004540 tx=0x7fd010035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:32.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.323+0000 7fd0167fc640 1 -- 172.21.15.112:0/2085060939 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd00c057030 con 0x7fd018102ef0 2024-09-19T09:43:32.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.560+0000 7fd0201b0640 1 -- 172.21.15.112:0/2085060939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd0180fbd50 con 0x7fd018102ef0 2024-09-19T09:43:32.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.561+0000 7fd0167fc640 1 -- 172.21.15.112:0/2085060939 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7fd00c05a6f0 con 0x7fd018102ef0 2024-09-19T09:43:32.563 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:43:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:43:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:43:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:43:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:43:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:43:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:43:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:43:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T09:43:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:43:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:43:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2, 2024-09-19T09:43:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T09:43:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:43:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:43:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2, 2024-09-19T09:43:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 11 2024-09-19T09:43:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:43:32.564 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:43:32.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.563+0000 7fd0201b0640 1 -- 172.21.15.112:0/2085060939 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fd00006e530 msgr2=0x7fd0000709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.563+0000 7fd0201b0640 1 --2- 172.21.15.112:0/2085060939 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fd00006e530 0x7fd0000709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd010004540 tx=0x7fd010035040 comp rx=0 tx=0).stop 2024-09-19T09:43:32.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.563+0000 7fd0201b0640 1 -- 172.21.15.112:0/2085060939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd018102ef0 msgr2=0x7fd018115c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.563+0000 7fd0201b0640 1 --2- 172.21.15.112:0/2085060939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd018102ef0 0x7fd018115c80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00eb40 tx=0x7fd00c00b040 comp rx=0 tx=0).stop 2024-09-19T09:43:32.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.563+0000 7fd0201b0640 1 -- 172.21.15.112:0/2085060939 shutdown_connections 2024-09-19T09:43:32.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.563+0000 7fd0201b0640 1 --2- 172.21.15.112:0/2085060939 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fd00006e530 0x7fd0000709e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.563+0000 7fd0201b0640 1 --2- 172.21.15.112:0/2085060939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd018102ef0 0x7fd018115c80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.563+0000 7fd0201b0640 1 --2- 172.21.15.112:0/2085060939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd018102550 0x7fd018115740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.563+0000 7fd0201b0640 1 -- 172.21.15.112:0/2085060939 >> 172.21.15.112:0/2085060939 conn(0x7fd0180f80f0 msgr2=0x7fd01806fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:32.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.563+0000 7fd0201b0640 1 -- 172.21.15.112:0/2085060939 shutdown_connections 2024-09-19T09:43:32.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.563+0000 7fd0201b0640 1 -- 172.21.15.112:0/2085060939 wait complete. 2024-09-19T09:43:32.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.643+0000 7f5212a6a640 1 -- 172.21.15.112:0/3152695430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f520c1025f0 msgr2=0x7f520c1029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.643+0000 7f5212a6a640 1 --2- 172.21.15.112:0/3152695430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f520c1025f0 0x7f520c1029c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0048d0 tx=0x7f51fc009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.643+0000 7f5212a6a640 1 -- 172.21.15.112:0/3152695430 shutdown_connections 2024-09-19T09:43:32.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.643+0000 7f5212a6a640 1 --2- 172.21.15.112:0/3152695430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f520c0fac60 0x7f520c0fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.643+0000 7f5212a6a640 1 --2- 172.21.15.112:0/3152695430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f520c1025f0 0x7f520c1029c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.643+0000 7f5212a6a640 1 -- 172.21.15.112:0/3152695430 >> 172.21.15.112:0/3152695430 conn(0x7f520c070c80 msgr2=0x7f520c071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:32.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.644+0000 7f5212a6a640 1 -- 172.21.15.112:0/3152695430 shutdown_connections 2024-09-19T09:43:32.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.644+0000 7f5212a6a640 1 -- 172.21.15.112:0/3152695430 wait complete. 2024-09-19T09:43:32.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.644+0000 7f5212a6a640 1 Processor -- start 2024-09-19T09:43:32.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.644+0000 7f5212a6a640 1 -- start start 2024-09-19T09:43:32.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f5212a6a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f520c0fac60 0x7f520c0fbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f5212a6a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f520c1025f0 0x7f520c0fc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f5212a6a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0fc910 con 0x7f520c1025f0 2024-09-19T09:43:32.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f5212a6a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0fca80 con 0x7f520c0fac60 2024-09-19T09:43:32.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f520bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f520c1025f0 0x7f520c0fc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f520bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f520c1025f0 0x7f520c0fc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53900/0 (socket says 172.21.15.112:53900) 2024-09-19T09:43:32.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f520bfff640 1 -- 172.21.15.112:0/3986374498 learned_addr learned my addr 172.21.15.112:0/3986374498 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:43:32.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f5210806640 1 --2- 172.21.15.112:0/3986374498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f520c0fac60 0x7f520c0fbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f520bfff640 1 -- 172.21.15.112:0/3986374498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f520c0fac60 msgr2=0x7f520c0fbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f520bfff640 1 --2- 172.21.15.112:0/3986374498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f520c0fac60 0x7f520c0fbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f520bfff640 1 -- 172.21.15.112:0/3986374498 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc005040 con 0x7f520c1025f0 2024-09-19T09:43:32.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f520bfff640 1 --2- 172.21.15.112:0/3986374498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f520c1025f0 0x7f520c0fc380 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f520000eb70 tx=0x7f520000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f52097fa640 1 -- 172.21.15.112:0/3986374498 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5200007c30 con 0x7f520c1025f0 2024-09-19T09:43:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f5212a6a640 1 -- 172.21.15.112:0/3986374498 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c119590 con 0x7f520c1025f0 2024-09-19T09:43:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f52097fa640 1 -- 172.21.15.112:0/3986374498 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f520000f040 con 0x7f520c1025f0 2024-09-19T09:43:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.645+0000 7f52097fa640 1 -- 172.21.15.112:0/3986374498 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f520000ca60 con 0x7f520c1025f0 2024-09-19T09:43:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.646+0000 7f5212a6a640 1 -- 172.21.15.112:0/3986374498 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c119970 con 0x7f520c1025f0 2024-09-19T09:43:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.647+0000 7f5212a6a640 1 -- 172.21.15.112:0/3986374498 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c065810 con 0x7f520c1025f0 2024-09-19T09:43:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.647+0000 7f52097fa640 1 -- 172.21.15.112:0/3986374498 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f520000cbc0 con 0x7f520c1025f0 2024-09-19T09:43:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.648+0000 7f52097fa640 1 --2- 172.21.15.112:0/3986374498 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f51f406e530 0x7f51f40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.648+0000 7f52097fa640 1 -- 172.21.15.112:0/3986374498 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6679+0+0 (secure 0 0 0) 0x7f520008de90 con 0x7f520c1025f0 2024-09-19T09:43:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.648+0000 7f5210806640 1 --2- 172.21.15.112:0/3986374498 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f51f406e530 0x7f51f40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.648+0000 7f5210806640 1 --2- 172.21.15.112:0/3986374498 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f51f406e530 0x7f51f40709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51fc004540 tx=0x7f51fc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:32.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.652+0000 7f52097fa640 1 -- 172.21.15.112:0/3986374498 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5200056f70 con 0x7f520c1025f0 2024-09-19T09:43:32.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.853+0000 7f5212a6a640 1 -- 172.21.15.112:0/3986374498 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f520c109650 con 0x7f520c1025f0 2024-09-19T09:43:32.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.854+0000 7f52097fa640 1 -- 172.21.15.112:0/3986374498 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1747 (secure 0 0 0) 0x7f520005a630 con 0x7f520c1025f0 2024-09-19T09:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout:e23 2024-09-19T09:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-19T09:43:30:259011+0000 2024-09-19T09:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-19T09:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-19T09:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 23 2024-09-19T09:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T09:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-19T09:43:30.258998+0000 2024-09-19T09:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-19T09:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-19T09:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-19T09:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-19T09:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-19T09:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-19T09:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-19T09:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-19T09:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 92 2024-09-19T09:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-19T09:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-19T09:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=24275} 2024-09-19T09:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-19T09:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-19T09:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-19T09:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-19T09:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-19T09:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data disabled 2024-09-19T09:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-19T09:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-19T09:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-19T09:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.qweljt{0:24275} state up:replay seq 2 join_fscid=1 addr [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-19T09:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.jjldod{-1:24281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6824/2759077122,v1:172.21.15.191:6825/2759077122] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ymjyok{-1:34384} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/1711973242,v1:172.21.15.112:6827/1711973242] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:43:32.860 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 23 2024-09-19T09:43:32.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.856+0000 7f5212a6a640 1 -- 172.21.15.112:0/3986374498 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f51f406e530 msgr2=0x7f51f40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.856+0000 7f5212a6a640 1 --2- 172.21.15.112:0/3986374498 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f51f406e530 0x7f51f40709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51fc004540 tx=0x7f51fc035040 comp rx=0 tx=0).stop 2024-09-19T09:43:32.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.856+0000 7f5212a6a640 1 -- 172.21.15.112:0/3986374498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f520c1025f0 msgr2=0x7f520c0fc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.856+0000 7f5212a6a640 1 --2- 172.21.15.112:0/3986374498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f520c1025f0 0x7f520c0fc380 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f520000eb70 tx=0x7f520000b040 comp rx=0 tx=0).stop 2024-09-19T09:43:32.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.856+0000 7f5212a6a640 1 -- 172.21.15.112:0/3986374498 shutdown_connections 2024-09-19T09:43:32.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.856+0000 7f5212a6a640 1 --2- 172.21.15.112:0/3986374498 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f51f406e530 0x7f51f40709e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.856+0000 7f5212a6a640 1 --2- 172.21.15.112:0/3986374498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f520c1025f0 0x7f520c0fc380 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.856+0000 7f5212a6a640 1 --2- 172.21.15.112:0/3986374498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f520c0fac60 0x7f520c0fbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.856+0000 7f5212a6a640 1 -- 172.21.15.112:0/3986374498 >> 172.21.15.112:0/3986374498 conn(0x7f520c070c80 msgr2=0x7f520c0f9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:32.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.856+0000 7f5212a6a640 1 -- 172.21.15.112:0/3986374498 shutdown_connections 2024-09-19T09:43:32.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.856+0000 7f5212a6a640 1 -- 172.21.15.112:0/3986374498 wait complete. 2024-09-19T09:43:32.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.937+0000 7faee187b640 1 -- 172.21.15.112:0/3039529626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faedc064fc0 msgr2=0x7faedc065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.937+0000 7faee187b640 1 --2- 172.21.15.112:0/3039529626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faedc064fc0 0x7faedc065430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faec40048d0 tx=0x7faec4009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.938+0000 7faee187b640 1 -- 172.21.15.112:0/3039529626 shutdown_connections 2024-09-19T09:43:32.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.938+0000 7faee187b640 1 --2- 172.21.15.112:0/3039529626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faedc064fc0 0x7faedc065430 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.938+0000 7faee187b640 1 --2- 172.21.15.112:0/3039529626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faedc0fe460 0x7faedc0fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.938+0000 7faee187b640 1 -- 172.21.15.112:0/3039529626 >> 172.21.15.112:0/3039529626 conn(0x7faedc0723b0 msgr2=0x7faedc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:32.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.938+0000 7faee187b640 1 -- 172.21.15.112:0/3039529626 shutdown_connections 2024-09-19T09:43:32.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.938+0000 7faee187b640 1 -- 172.21.15.112:0/3039529626 wait complete. 2024-09-19T09:43:32.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.938+0000 7faee187b640 1 Processor -- start 2024-09-19T09:43:32.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.938+0000 7faee187b640 1 -- start start 2024-09-19T09:43:32.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.939+0000 7faee187b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faedc064fc0 0x7faedc1131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.939+0000 7faee187b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faedc0fe460 0x7faedc1136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.939+0000 7faee187b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc113cf0 con 0x7faedc0fe460 2024-09-19T09:43:32.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.939+0000 7faee187b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc10d180 con 0x7faedc064fc0 2024-09-19T09:43:32.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.939+0000 7faeda7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faedc0fe460 0x7faedc1136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.939+0000 7faeda7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faedc0fe460 0x7faedc1136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53904/0 (socket says 172.21.15.112:53904) 2024-09-19T09:43:32.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.939+0000 7faedaffd640 1 --2- 172.21.15.112:0/136194071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faedc064fc0 0x7faedc1131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.939+0000 7faeda7fc640 1 -- 172.21.15.112:0/136194071 learned_addr learned my addr 172.21.15.112:0/136194071 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:43:32.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.939+0000 7faeda7fc640 1 -- 172.21.15.112:0/136194071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faedc064fc0 msgr2=0x7faedc1131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.939+0000 7faeda7fc640 1 --2- 172.21.15.112:0/136194071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faedc064fc0 0x7faedc1131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.939+0000 7faeda7fc640 1 -- 172.21.15.112:0/136194071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec4005040 con 0x7faedc0fe460 2024-09-19T09:43:32.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.939+0000 7faeda7fc640 1 --2- 172.21.15.112:0/136194071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faedc0fe460 0x7faedc1136f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faec4000c00 tx=0x7faec4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:32.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.939+0000 7faed37fe640 1 -- 172.21.15.112:0/136194071 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec4038070 con 0x7faedc0fe460 2024-09-19T09:43:32.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.940+0000 7faed37fe640 1 -- 172.21.15.112:0/136194071 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faec402ade0 con 0x7faedc0fe460 2024-09-19T09:43:32.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.940+0000 7faee187b640 1 -- 172.21.15.112:0/136194071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc10d400 con 0x7faedc0fe460 2024-09-19T09:43:32.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.940+0000 7faed37fe640 1 -- 172.21.15.112:0/136194071 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec402c7e0 con 0x7faedc0fe460 2024-09-19T09:43:32.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.940+0000 7faee187b640 1 -- 172.21.15.112:0/136194071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faedc10d8c0 con 0x7faedc0fe460 2024-09-19T09:43:32.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.941+0000 7faee187b640 1 -- 172.21.15.112:0/136194071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faedc0fdcf0 con 0x7faedc0fe460 2024-09-19T09:43:32.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.942+0000 7faed37fe640 1 -- 172.21.15.112:0/136194071 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7faec4030020 con 0x7faedc0fe460 2024-09-19T09:43:32.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.942+0000 7faed37fe640 1 --2- 172.21.15.112:0/136194071 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7faec806e530 0x7faec80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.942+0000 7faed37fe640 1 -- 172.21.15.112:0/136194071 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6679+0+0 (secure 0 0 0) 0x7faec40adeb0 con 0x7faedc0fe460 2024-09-19T09:43:32.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.942+0000 7faedaffd640 1 --2- 172.21.15.112:0/136194071 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7faec806e530 0x7faec80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.943+0000 7faedaffd640 1 --2- 172.21.15.112:0/136194071 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7faec806e530 0x7faec80709e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faed40102e0 tx=0x7faed4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:32.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:32.946+0000 7faed37fe640 1 -- 172.21.15.112:0/136194071 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7faec4076f90 con 0x7faedc0fe460 2024-09-19T09:43:33.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.138+0000 7faee187b640 1 -- 172.21.15.112:0/136194071 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faedc10e820 con 0x7faec806e530 2024-09-19T09:43:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.139+0000 7faed37fe640 1 -- 172.21.15.112:0/136194071 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7faedc10e820 con 0x7faec806e530 2024-09-19T09:43:33.141 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:43:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:43:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:43:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:43:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-19T09:43:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: "mon", 2024-09-19T09:43:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: "osd", 2024-09-19T09:43:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-19T09:43:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: "crash" 2024-09-19T09:43:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-19T09:43:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "13/21 daemons upgraded", 2024-09-19T09:43:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T09:43:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:43:33.141 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:43:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.141+0000 7faee187b640 1 -- 172.21.15.112:0/136194071 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7faec806e530 msgr2=0x7faec80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.141+0000 7faee187b640 1 --2- 172.21.15.112:0/136194071 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7faec806e530 0x7faec80709e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faed40102e0 tx=0x7faed4009040 comp rx=0 tx=0).stop 2024-09-19T09:43:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.141+0000 7faee187b640 1 -- 172.21.15.112:0/136194071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faedc0fe460 msgr2=0x7faedc1136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.141+0000 7faee187b640 1 --2- 172.21.15.112:0/136194071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faedc0fe460 0x7faedc1136f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faec4000c00 tx=0x7faec4009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.141+0000 7faee187b640 1 -- 172.21.15.112:0/136194071 shutdown_connections 2024-09-19T09:43:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.141+0000 7faee187b640 1 --2- 172.21.15.112:0/136194071 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7faec806e530 0x7faec80709e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.141+0000 7faee187b640 1 --2- 172.21.15.112:0/136194071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faedc0fe460 0x7faedc1136f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.141+0000 7faee187b640 1 --2- 172.21.15.112:0/136194071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faedc064fc0 0x7faedc1131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.141+0000 7faee187b640 1 -- 172.21.15.112:0/136194071 >> 172.21.15.112:0/136194071 conn(0x7faedc0723b0 msgr2=0x7faedc1053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:33.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.141+0000 7faee187b640 1 -- 172.21.15.112:0/136194071 shutdown_connections 2024-09-19T09:43:33.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.141+0000 7faee187b640 1 -- 172.21.15.112:0/136194071 wait complete. 2024-09-19T09:43:33.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.219+0000 7f2f3eb83640 1 -- 172.21.15.112:0/1473645341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f38102ef0 msgr2=0x7f2f380fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.219+0000 7f2f3eb83640 1 --2- 172.21.15.112:0/1473645341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f38102ef0 0x7f2f380fc5b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2f280048d0 tx=0x7f2f28009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.219+0000 7f2f3eb83640 1 -- 172.21.15.112:0/1473645341 shutdown_connections 2024-09-19T09:43:33.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.219+0000 7f2f3eb83640 1 --2- 172.21.15.112:0/1473645341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f38102ef0 0x7f2f380fc5b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.219+0000 7f2f3eb83640 1 --2- 172.21.15.112:0/1473645341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f38102550 0x7f2f38102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.219+0000 7f2f3eb83640 1 -- 172.21.15.112:0/1473645341 >> 172.21.15.112:0/1473645341 conn(0x7f2f380f80f0 msgr2=0x7f2f380fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:33.222 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:32 smithi112 ceph-mon[97503]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:33.222 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:32 smithi112 ceph-mon[97503]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:33.222 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:32 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2085060939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:33.222 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:32 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3986374498' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:43:33.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.219+0000 7f2f3eb83640 1 -- 172.21.15.112:0/1473645341 shutdown_connections 2024-09-19T09:43:33.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.219+0000 7f2f3eb83640 1 -- 172.21.15.112:0/1473645341 wait complete. 2024-09-19T09:43:33.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.220+0000 7f2f3eb83640 1 Processor -- start 2024-09-19T09:43:33.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.220+0000 7f2f3eb83640 1 -- start start 2024-09-19T09:43:33.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.220+0000 7f2f3eb83640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f38102550 0x7f2f3806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.220+0000 7f2f3eb83640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f38102ef0 0x7f2f3806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.220+0000 7f2f3eb83640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f38070490 con 0x7f2f38102ef0 2024-09-19T09:43:33.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.220+0000 7f2f3eb83640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f38070600 con 0x7f2f38102550 2024-09-19T09:43:33.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.220+0000 7f2f2ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f38102ef0 0x7f2f3806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.220+0000 7f2f2ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f38102ef0 0x7f2f3806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53926/0 (socket says 172.21.15.112:53926) 2024-09-19T09:43:33.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.220+0000 7f2f2ffff640 1 -- 172.21.15.112:0/2526093537 learned_addr learned my addr 172.21.15.112:0/2526093537 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:43:33.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.220+0000 7f2f3c91f640 1 --2- 172.21.15.112:0/2526093537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f38102550 0x7f2f3806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.221+0000 7f2f2ffff640 1 -- 172.21.15.112:0/2526093537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f38102550 msgr2=0x7f2f3806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.221+0000 7f2f2ffff640 1 --2- 172.21.15.112:0/2526093537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f38102550 0x7f2f3806fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.221+0000 7f2f2ffff640 1 -- 172.21.15.112:0/2526093537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f28005040 con 0x7f2f38102ef0 2024-09-19T09:43:33.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.221+0000 7f2f2ffff640 1 --2- 172.21.15.112:0/2526093537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f38102ef0 0x7f2f3806ff50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2f280043d0 tx=0x7f2f28009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:33.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.221+0000 7f2f2d7fa640 1 -- 172.21.15.112:0/2526093537 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f28038070 con 0x7f2f38102ef0 2024-09-19T09:43:33.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.221+0000 7f2f2d7fa640 1 -- 172.21.15.112:0/2526093537 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2f280096e0 con 0x7f2f38102ef0 2024-09-19T09:43:33.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.221+0000 7f2f2d7fa640 1 -- 172.21.15.112:0/2526093537 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f2802c8a0 con 0x7f2f38102ef0 2024-09-19T09:43:33.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.221+0000 7f2f3eb83640 1 -- 172.21.15.112:0/2526093537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f38070830 con 0x7f2f38102ef0 2024-09-19T09:43:33.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.222+0000 7f2f3eb83640 1 -- 172.21.15.112:0/2526093537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f38119b70 con 0x7f2f38102ef0 2024-09-19T09:43:33.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.223+0000 7f2f3eb83640 1 -- 172.21.15.112:0/2526093537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f380fdcd0 con 0x7f2f38102ef0 2024-09-19T09:43:33.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.223+0000 7f2f2d7fa640 1 -- 172.21.15.112:0/2526093537 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2f28030020 con 0x7f2f38102ef0 2024-09-19T09:43:33.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.224+0000 7f2f2d7fa640 1 --2- 172.21.15.112:0/2526093537 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f2f2006e530 0x7f2f200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.224+0000 7f2f2d7fa640 1 -- 172.21.15.112:0/2526093537 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6679+0+0 (secure 0 0 0) 0x7f2f280adf20 con 0x7f2f38102ef0 2024-09-19T09:43:33.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.224+0000 7f2f3c91f640 1 --2- 172.21.15.112:0/2526093537 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f2f2006e530 0x7f2f200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.224+0000 7f2f3c91f640 1 --2- 172.21.15.112:0/2526093537 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f2f2006e530 0x7f2f200709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2f34004ed0 tx=0x7f2f3400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:33.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.228+0000 7f2f2d7fa640 1 -- 172.21.15.112:0/2526093537 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2f280e3210 con 0x7f2f38102ef0 2024-09-19T09:43:33.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:32 smithi191 ceph-mon[77624]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:33.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:32 smithi191 ceph-mon[77624]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:33.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:32 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2085060939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:33.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:32 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3986374498' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:43:33.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.457+0000 7f2f3eb83640 1 -- 172.21.15.112:0/2526093537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2f380fbd50 con 0x7f2f38102ef0 2024-09-19T09:43:33.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.458+0000 7f2f2d7fa640 1 -- 172.21.15.112:0/2526093537 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f2f28077000 con 0x7f2f38102ef0 2024-09-19T09:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 filesystem is degraded 2024-09-19T09:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T09:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs is degraded 2024-09-19T09:43:33.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.460+0000 7f2f3eb83640 1 -- 172.21.15.112:0/2526093537 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f2f2006e530 msgr2=0x7f2f200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.460+0000 7f2f3eb83640 1 --2- 172.21.15.112:0/2526093537 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f2f2006e530 0x7f2f200709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2f34004ed0 tx=0x7f2f3400b040 comp rx=0 tx=0).stop 2024-09-19T09:43:33.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.460+0000 7f2f3eb83640 1 -- 172.21.15.112:0/2526093537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f38102ef0 msgr2=0x7f2f3806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.460+0000 7f2f3eb83640 1 --2- 172.21.15.112:0/2526093537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f38102ef0 0x7f2f3806ff50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2f280043d0 tx=0x7f2f28009da0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.460+0000 7f2f3eb83640 1 -- 172.21.15.112:0/2526093537 shutdown_connections 2024-09-19T09:43:33.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.460+0000 7f2f3eb83640 1 --2- 172.21.15.112:0/2526093537 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f2f2006e530 0x7f2f200709e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.460+0000 7f2f3eb83640 1 --2- 172.21.15.112:0/2526093537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f38102ef0 0x7f2f3806ff50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.460+0000 7f2f3eb83640 1 --2- 172.21.15.112:0/2526093537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f38102550 0x7f2f3806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.460+0000 7f2f3eb83640 1 -- 172.21.15.112:0/2526093537 >> 172.21.15.112:0/2526093537 conn(0x7f2f380f80f0 msgr2=0x7f2f380f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:33.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.460+0000 7f2f3eb83640 1 -- 172.21.15.112:0/2526093537 shutdown_connections 2024-09-19T09:43:33.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:43:33.460+0000 7f2f3eb83640 1 -- 172.21.15.112:0/2526093537 wait complete. 2024-09-19T09:43:34.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:33 smithi191 ceph-mon[77624]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:34.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:33 smithi191 ceph-mon[77624]: pgmap v186: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 1 op/s 2024-09-19T09:43:34.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:33 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2526093537' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:43:34.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:33 smithi112 ceph-mon[97503]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:34.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:33 smithi112 ceph-mon[97503]: pgmap v186: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 1 op/s 2024-09-19T09:43:34.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:33 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2526093537' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:43:35.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:34 smithi191 ceph-mon[77624]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:35.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:34 smithi112 ceph-mon[97503]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:36.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:35 smithi191 ceph-mon[77624]: pgmap v187: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-19T09:43:36.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:35 smithi112 ceph-mon[97503]: pgmap v187: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-19T09:43:38.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:37 smithi112 ceph-mon[97503]: pgmap v188: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-19T09:43:38.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:37 smithi191 ceph-mon[77624]: pgmap v188: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-19T09:43:39.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:38 smithi191 ceph-mon[77624]: reconnect by client.14500 v1:192.168.0.1:0/3618400098 after 0 2024-09-19T09:43:39.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:38 smithi191 ceph-mon[77624]: reconnect by client.14506 v1:172.21.15.191:0/3203645647 after 0 2024-09-19T09:43:39.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:38 smithi191 ceph-mon[77624]: mds.? [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] up:reconnect 2024-09-19T09:43:39.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:38 smithi191 ceph-mon[77624]: fsmap cephfs:1/1 {0=cephfs.smithi191.qweljt=up:reconnect} 2 up:standby 2024-09-19T09:43:39.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:38 smithi112 ceph-mon[97503]: reconnect by client.14500 v1:192.168.0.1:0/3618400098 after 0 2024-09-19T09:43:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:38 smithi112 ceph-mon[97503]: reconnect by client.14506 v1:172.21.15.191:0/3203645647 after 0 2024-09-19T09:43:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:38 smithi112 ceph-mon[97503]: mds.? [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] up:reconnect 2024-09-19T09:43:39.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:38 smithi112 ceph-mon[97503]: fsmap cephfs:1/1 {0=cephfs.smithi191.qweljt=up:reconnect} 2 up:standby 2024-09-19T09:43:40.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:39 smithi112 ceph-mon[97503]: pgmap v189: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-19T09:43:40.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:39 smithi112 ceph-mon[97503]: mds.? [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] up:rejoin 2024-09-19T09:43:40.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:39 smithi112 ceph-mon[97503]: fsmap cephfs:1/1 {0=cephfs.smithi191.qweljt=up:rejoin} 2 up:standby 2024-09-19T09:43:40.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:39 smithi112 ceph-mon[97503]: daemon mds.cephfs.smithi191.qweljt is now active in filesystem cephfs as rank 0 2024-09-19T09:43:40.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:39 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:40.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:39 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:40.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:39 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:40.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:39 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:40.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:39 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:43:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:39 smithi191 ceph-mon[77624]: pgmap v189: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-19T09:43:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:39 smithi191 ceph-mon[77624]: mds.? [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] up:rejoin 2024-09-19T09:43:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:39 smithi191 ceph-mon[77624]: fsmap cephfs:1/1 {0=cephfs.smithi191.qweljt=up:rejoin} 2 up:standby 2024-09-19T09:43:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:39 smithi191 ceph-mon[77624]: daemon mds.cephfs.smithi191.qweljt is now active in filesystem cephfs as rank 0 2024-09-19T09:43:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:39 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:39 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:39 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:39 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:39 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:43:41.288 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:40 smithi191 ceph-mon[77624]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:43:41.288 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:40 smithi191 ceph-mon[77624]: Cluster is now healthy 2024-09-19T09:43:41.288 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:40 smithi191 ceph-mon[77624]: mds.? [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] up:active 2024-09-19T09:43:41.288 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:40 smithi191 ceph-mon[77624]: mds.? [v2:172.21.15.112:6828/742383802,v1:172.21.15.112:6829/742383802] up:boot 2024-09-19T09:43:41.288 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:40 smithi191 ceph-mon[77624]: fsmap cephfs:1 {0=cephfs.smithi191.qweljt=up:active} 3 up:standby 2024-09-19T09:43:41.288 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.hcoxjz"}]: dispatch 2024-09-19T09:43:41.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:40 smithi112 ceph-mon[97503]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:43:41.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:40 smithi112 ceph-mon[97503]: Cluster is now healthy 2024-09-19T09:43:41.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:40 smithi112 ceph-mon[97503]: mds.? [v2:172.21.15.191:6826/1382170395,v1:172.21.15.191:6827/1382170395] up:active 2024-09-19T09:43:41.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:40 smithi112 ceph-mon[97503]: mds.? [v2:172.21.15.112:6828/742383802,v1:172.21.15.112:6829/742383802] up:boot 2024-09-19T09:43:41.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:40 smithi112 ceph-mon[97503]: fsmap cephfs:1 {0=cephfs.smithi191.qweljt=up:active} 3 up:standby 2024-09-19T09:43:41.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.hcoxjz"}]: dispatch 2024-09-19T09:43:42.126 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:41 smithi112 ceph-mon[97503]: pgmap v190: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-19T09:43:42.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:41 smithi191 ceph-mon[77624]: pgmap v190: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-19T09:43:44.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:43 smithi191 ceph-mon[77624]: pgmap v191: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T09:43:44.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:43 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:44.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:43 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:44.421 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:43 smithi112 ceph-mon[97503]: pgmap v191: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T09:43:44.421 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:43 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:44.421 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:43 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:45.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:45 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:45.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:45 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:45.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:45 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:45.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:45 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:46.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:46 smithi191 ceph-mon[77624]: pgmap v192: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-09-19T09:43:46.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:46 smithi112 ceph-mon[97503]: pgmap v192: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-09-19T09:43:48.195 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:48 smithi191 ceph-mon[77624]: pgmap v193: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-19T09:43:48.196 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:48 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:48.196 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:48 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:48.196 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:48 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:48.196 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:48 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:48.196 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:48 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:48.196 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:48 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:48.196 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:48 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:48.196 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:48 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:48.196 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:48 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:48.196 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:48 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:48.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:48 smithi112 ceph-mon[97503]: pgmap v193: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-19T09:43:48.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:48 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:48.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:48 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:48.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:48 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:48.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:48 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:48.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:48 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:48.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:48 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:48.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:48 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:48.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:48 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:48.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:48 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:48.441 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:48 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:43:50.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:49 smithi112 ceph-mon[97503]: pgmap v194: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 5.9 MiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-19T09:43:50.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:49 smithi112 ceph-mon[97503]: Upgrade: Updating mds.cephfs.smithi191.jjldod 2024-09-19T09:43:50.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:49 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:50.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:49 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.jjldod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:43:50.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:49 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:50.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:49 smithi112 ceph-mon[97503]: Deploying daemon mds.cephfs.smithi191.jjldod on smithi191 2024-09-19T09:43:50.206 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:49 smithi191 ceph-mon[77624]: pgmap v194: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 5.9 MiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-19T09:43:50.206 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:49 smithi191 ceph-mon[77624]: Upgrade: Updating mds.cephfs.smithi191.jjldod 2024-09-19T09:43:50.207 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:49 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:50.207 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:49 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.jjldod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:43:50.207 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:49 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:50.207 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:49 smithi191 ceph-mon[77624]: Deploying daemon mds.cephfs.smithi191.jjldod on smithi191 2024-09-19T09:43:52.180 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:51 smithi191 ceph-mon[77624]: pgmap v195: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2024-09-19T09:43:52.180 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:51 smithi191 ceph-mon[77624]: osdmap e93: 6 total, 6 up, 6 in 2024-09-19T09:43:52.180 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:51 smithi191 ceph-mon[77624]: fsmap cephfs:1 {0=cephfs.smithi191.qweljt=up:active} 2 up:standby 2024-09-19T09:43:52.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:51 smithi112 ceph-mon[97503]: pgmap v195: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2024-09-19T09:43:52.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:51 smithi112 ceph-mon[97503]: osdmap e93: 6 total, 6 up, 6 in 2024-09-19T09:43:52.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:51 smithi112 ceph-mon[97503]: fsmap cephfs:1 {0=cephfs.smithi191.qweljt=up:active} 2 up:standby 2024-09-19T09:43:54.169 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:53 smithi191 ceph-mon[77624]: pgmap v197: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-09-19T09:43:54.170 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:53 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:54.170 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:53 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:54.170 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:53 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:54.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:53 smithi112 ceph-mon[97503]: pgmap v197: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-09-19T09:43:54.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:53 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:54.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:53 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:54.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:53 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:55.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:54 smithi191 ceph-mon[77624]: mds.? [v2:172.21.15.191:6824/3336467092,v1:172.21.15.191:6825/3336467092] up:boot 2024-09-19T09:43:55.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:54 smithi191 ceph-mon[77624]: fsmap cephfs:1 {0=cephfs.smithi191.qweljt=up:active} 3 up:standby 2024-09-19T09:43:55.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.jjldod"}]: dispatch 2024-09-19T09:43:55.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:55.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:43:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:54 smithi112 ceph-mon[97503]: mds.? [v2:172.21.15.191:6824/3336467092,v1:172.21.15.191:6825/3336467092] up:boot 2024-09-19T09:43:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:54 smithi112 ceph-mon[97503]: fsmap cephfs:1 {0=cephfs.smithi191.qweljt=up:active} 3 up:standby 2024-09-19T09:43:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.jjldod"}]: dispatch 2024-09-19T09:43:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:55.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:43:56.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:55 smithi191 ceph-mon[77624]: pgmap v198: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-19T09:43:56.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:55 smithi112 ceph-mon[97503]: pgmap v198: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-19T09:43:57.404 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:57 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:57.404 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:57 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:57.405 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:57 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:57.405 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:57 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:57.405 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:57 smithi191 ceph-mon[77624]: pgmap v199: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-19T09:43:57.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:57 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:57.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:57 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:57.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:57 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:57.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:57 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:43:57.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:57 smithi112 ceph-mon[97503]: pgmap v199: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-19T09:44:00.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:59 smithi191 ceph-mon[77624]: pgmap v200: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:44:00.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:00.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:00.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:00.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:00.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:43:59 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:59 smithi112 ceph-mon[97503]: pgmap v200: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:44:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:43:59 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:01.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:00 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:01.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:00 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:01.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:00 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:01.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:00 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:01.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:00 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:01.273 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:00 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:01.274 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:00 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:01.274 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:00 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:01.274 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:00 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:01.274 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:00 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:01.985 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:01 smithi191 ceph-mon[77624]: pgmap v201: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:44:01.985 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:01 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:01.985 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:01 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.qweljt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:44:01.985 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:01 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:01 smithi112 ceph-mon[97503]: pgmap v201: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:44:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:01 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:01 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi191.qweljt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:44:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:01 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:03.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:02 smithi191 ceph-mon[77624]: Upgrade: Updating mds.cephfs.smithi191.qweljt 2024-09-19T09:44:03.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:02 smithi191 ceph-mon[77624]: Deploying daemon mds.cephfs.smithi191.qweljt on smithi191 2024-09-19T09:44:03.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:02 smithi112 ceph-mon[97503]: Upgrade: Updating mds.cephfs.smithi191.qweljt 2024-09-19T09:44:03.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:02 smithi112 ceph-mon[97503]: Deploying daemon mds.cephfs.smithi191.qweljt on smithi191 2024-09-19T09:44:03.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:03 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112[97499]: 2024-09-19T09:44:03.166+0000 7fb07784d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:44:03.534 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:44:03 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3[87324]: 2024-09-19T09:44:03.189+0000 7f493e5fb640 -1 bdev(0x55f540568c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 8 2024-09-19T09:44:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.557+0000 7fb0ceb2d640 1 -- 172.21.15.112:0/165204819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0c80fe460 msgr2=0x7fb0c80fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.557+0000 7fb0ceb2d640 1 --2- 172.21.15.112:0/165204819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0c80fe460 0x7fb0c80fe830 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0048d0 tx=0x7fb0bc009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.557+0000 7fb0ceb2d640 1 -- 172.21.15.112:0/165204819 shutdown_connections 2024-09-19T09:44:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.557+0000 7fb0ceb2d640 1 --2- 172.21.15.112:0/165204819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0c8064fc0 0x7fb0c8065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.557+0000 7fb0ceb2d640 1 --2- 172.21.15.112:0/165204819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0c80fe460 0x7fb0c80fe830 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.557+0000 7fb0ceb2d640 1 -- 172.21.15.112:0/165204819 >> 172.21.15.112:0/165204819 conn(0x7fb0c80723b0 msgr2=0x7fb0c80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.557+0000 7fb0ceb2d640 1 -- 172.21.15.112:0/165204819 shutdown_connections 2024-09-19T09:44:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.557+0000 7fb0ceb2d640 1 -- 172.21.15.112:0/165204819 wait complete. 2024-09-19T09:44:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.558+0000 7fb0ceb2d640 1 Processor -- start 2024-09-19T09:44:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.558+0000 7fb0ceb2d640 1 -- start start 2024-09-19T09:44:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.558+0000 7fb0ceb2d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0c8064fc0 0x7fb0c810ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.558+0000 7fb0ceb2d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0c80fe460 0x7fb0c8110470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.558+0000 7fb0ceb2d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c8110ac0 con 0x7fb0c8064fc0 2024-09-19T09:44:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.558+0000 7fb0ceb2d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c810af80 con 0x7fb0c80fe460 2024-09-19T09:44:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.558+0000 7fb0cc8c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0c8064fc0 0x7fb0c810ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.558+0000 7fb0cc8c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0c8064fc0 0x7fb0c810ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39098/0 (socket says 172.21.15.112:39098) 2024-09-19T09:44:03.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.558+0000 7fb0cc8c9640 1 -- 172.21.15.112:0/3673572589 learned_addr learned my addr 172.21.15.112:0/3673572589 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:44:03.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.558+0000 7fb0c7fff640 1 --2- 172.21.15.112:0/3673572589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0c80fe460 0x7fb0c8110470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:03.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.559+0000 7fb0cc8c9640 1 -- 172.21.15.112:0/3673572589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0c80fe460 msgr2=0x7fb0c8110470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:03.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.559+0000 7fb0cc8c9640 1 --2- 172.21.15.112:0/3673572589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0c80fe460 0x7fb0c8110470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:03.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.559+0000 7fb0cc8c9640 1 -- 172.21.15.112:0/3673572589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc005040 con 0x7fb0c8064fc0 2024-09-19T09:44:03.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.559+0000 7fb0c7fff640 1 --2- 172.21.15.112:0/3673572589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0c80fe460 0x7fb0c8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:03.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.559+0000 7fb0cc8c9640 1 --2- 172.21.15.112:0/3673572589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0c8064fc0 0x7fb0c810ff10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc003080 tx=0x7fb0bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:03.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.559+0000 7fb0c57fa640 1 -- 172.21.15.112:0/3673572589 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0bc038070 con 0x7fb0c8064fc0 2024-09-19T09:44:03.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.559+0000 7fb0ceb2d640 1 -- 172.21.15.112:0/3673572589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c810b200 con 0x7fb0c8064fc0 2024-09-19T09:44:03.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.559+0000 7fb0c57fa640 1 -- 172.21.15.112:0/3673572589 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb0bc0097e0 con 0x7fb0c8064fc0 2024-09-19T09:44:03.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.559+0000 7fb0c57fa640 1 -- 172.21.15.112:0/3673572589 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0bc03d420 con 0x7fb0c8064fc0 2024-09-19T09:44:03.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.559+0000 7fb0ceb2d640 1 -- 172.21.15.112:0/3673572589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c810b6c0 con 0x7fb0c8064fc0 2024-09-19T09:44:03.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.560+0000 7fb0ceb2d640 1 -- 172.21.15.112:0/3673572589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c80fdcf0 con 0x7fb0c8064fc0 2024-09-19T09:44:03.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.561+0000 7fb0c57fa640 1 -- 172.21.15.112:0/3673572589 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb0bc030020 con 0x7fb0c8064fc0 2024-09-19T09:44:03.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.561+0000 7fb0c57fa640 1 --2- 172.21.15.112:0/3673572589 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb0b806e530 0x7fb0b80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:03.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.561+0000 7fb0c57fa640 1 -- 172.21.15.112:0/3673572589 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7fb0bc0ae830 con 0x7fb0c8064fc0 2024-09-19T09:44:03.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.562+0000 7fb0c7fff640 1 --2- 172.21.15.112:0/3673572589 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb0b806e530 0x7fb0b80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:03.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.562+0000 7fb0c7fff640 1 --2- 172.21.15.112:0/3673572589 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb0b806e530 0x7fb0b80709e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb0c810c870 tx=0x7fb0b4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:03.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.570+0000 7fb0c57fa640 1 -- 172.21.15.112:0/3673572589 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb0bc077810 con 0x7fb0c8064fc0 2024-09-19T09:44:03.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.762+0000 7fb0ceb2d640 1 -- 172.21.15.112:0/3673572589 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0c810c620 con 0x7fb0b806e530 2024-09-19T09:44:03.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.764+0000 7fb0c57fa640 1 -- 172.21.15.112:0/3673572589 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb0c810c620 con 0x7fb0b806e530 2024-09-19T09:44:03.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.767+0000 7fb0ceb2d640 1 -- 172.21.15.112:0/3673572589 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb0b806e530 msgr2=0x7fb0b80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:03.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.767+0000 7fb0ceb2d640 1 --2- 172.21.15.112:0/3673572589 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb0b806e530 0x7fb0b80709e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb0c810c870 tx=0x7fb0b4009040 comp rx=0 tx=0).stop 2024-09-19T09:44:03.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.767+0000 7fb0ceb2d640 1 -- 172.21.15.112:0/3673572589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0c8064fc0 msgr2=0x7fb0c810ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:03.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.767+0000 7fb0ceb2d640 1 --2- 172.21.15.112:0/3673572589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0c8064fc0 0x7fb0c810ff10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc003080 tx=0x7fb0bc009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:03.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.768+0000 7fb0ceb2d640 1 -- 172.21.15.112:0/3673572589 shutdown_connections 2024-09-19T09:44:03.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.768+0000 7fb0ceb2d640 1 --2- 172.21.15.112:0/3673572589 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb0b806e530 0x7fb0b80709e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:03.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.768+0000 7fb0ceb2d640 1 --2- 172.21.15.112:0/3673572589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0c80fe460 0x7fb0c8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:03.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.768+0000 7fb0ceb2d640 1 --2- 172.21.15.112:0/3673572589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0c8064fc0 0x7fb0c810ff10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:03.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.768+0000 7fb0ceb2d640 1 -- 172.21.15.112:0/3673572589 >> 172.21.15.112:0/3673572589 conn(0x7fb0c80723b0 msgr2=0x7fb0c8103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:03.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.768+0000 7fb0ceb2d640 1 -- 172.21.15.112:0/3673572589 shutdown_connections 2024-09-19T09:44:03.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.768+0000 7fb0ceb2d640 1 -- 172.21.15.112:0/3673572589 wait complete. 2024-09-19T09:44:03.781 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:44:03.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.853+0000 7f3c376a9640 1 -- 172.21.15.112:0/762747027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c300fcf80 msgr2=0x7f3c300fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:03.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.853+0000 7f3c376a9640 1 --2- 172.21.15.112:0/762747027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c300fcf80 0x7f3c300fd3d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3c200048d0 tx=0x7f3c20009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:03.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.853+0000 7f3c376a9640 1 -- 172.21.15.112:0/762747027 shutdown_connections 2024-09-19T09:44:03.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.853+0000 7f3c376a9640 1 --2- 172.21.15.112:0/762747027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c300fcf80 0x7f3c300fd3d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:03.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.853+0000 7f3c376a9640 1 --2- 172.21.15.112:0/762747027 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c300fb810 0x7f3c300fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:03.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.853+0000 7f3c376a9640 1 -- 172.21.15.112:0/762747027 >> 172.21.15.112:0/762747027 conn(0x7f3c300723b0 msgr2=0x7f3c300727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:03.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.853+0000 7f3c376a9640 1 -- 172.21.15.112:0/762747027 shutdown_connections 2024-09-19T09:44:03.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.853+0000 7f3c376a9640 1 -- 172.21.15.112:0/762747027 wait complete. 2024-09-19T09:44:03.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.854+0000 7f3c376a9640 1 Processor -- start 2024-09-19T09:44:03.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.854+0000 7f3c376a9640 1 -- start start 2024-09-19T09:44:03.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.854+0000 7f3c376a9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c300fb810 0x7f3c3010bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:03.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.854+0000 7f3c376a9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c300fcf80 0x7f3c3010c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:03.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.854+0000 7f3c376a9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3010ca80 con 0x7f3c300fcf80 2024-09-19T09:44:03.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.854+0000 7f3c376a9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3010cbf0 con 0x7f3c300fb810 2024-09-19T09:44:03.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.854+0000 7f3c34c44640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c300fcf80 0x7f3c3010c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:03.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.854+0000 7f3c34c44640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c300fcf80 0x7f3c3010c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39112/0 (socket says 172.21.15.112:39112) 2024-09-19T09:44:03.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.854+0000 7f3c34c44640 1 -- 172.21.15.112:0/1097716761 learned_addr learned my addr 172.21.15.112:0/1097716761 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:44:03.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.854+0000 7f3c35445640 1 --2- 172.21.15.112:0/1097716761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c300fb810 0x7f3c3010bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:03.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.855+0000 7f3c34c44640 1 -- 172.21.15.112:0/1097716761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c300fb810 msgr2=0x7f3c3010bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:03.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.855+0000 7f3c34c44640 1 --2- 172.21.15.112:0/1097716761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c300fb810 0x7f3c3010bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:03.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.855+0000 7f3c34c44640 1 -- 172.21.15.112:0/1097716761 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c20005040 con 0x7f3c300fcf80 2024-09-19T09:44:03.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.855+0000 7f3c34c44640 1 --2- 172.21.15.112:0/1097716761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c300fcf80 0x7f3c3010c480 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3c20000c00 tx=0x7f3c20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:03.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.855+0000 7f3c25ffb640 1 -- 172.21.15.112:0/1097716761 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c20038070 con 0x7f3c300fcf80 2024-09-19T09:44:03.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.855+0000 7f3c376a9640 1 -- 172.21.15.112:0/1097716761 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c30110f90 con 0x7f3c300fcf80 2024-09-19T09:44:03.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.855+0000 7f3c25ffb640 1 -- 172.21.15.112:0/1097716761 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c2002ade0 con 0x7f3c300fcf80 2024-09-19T09:44:03.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.855+0000 7f3c25ffb640 1 -- 172.21.15.112:0/1097716761 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c2002c7e0 con 0x7f3c300fcf80 2024-09-19T09:44:03.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.855+0000 7f3c376a9640 1 -- 172.21.15.112:0/1097716761 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c30111450 con 0x7f3c300fcf80 2024-09-19T09:44:03.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.857+0000 7f3c376a9640 1 -- 172.21.15.112:0/1097716761 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3010cdb0 con 0x7f3c300fcf80 2024-09-19T09:44:03.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.857+0000 7f3c25ffb640 1 -- 172.21.15.112:0/1097716761 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3c20030020 con 0x7f3c300fcf80 2024-09-19T09:44:03.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.858+0000 7f3c25ffb640 1 --2- 172.21.15.112:0/1097716761 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c1c06e530 0x7f3c1c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:03.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.858+0000 7f3c25ffb640 1 -- 172.21.15.112:0/1097716761 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f3c200ade60 con 0x7f3c300fcf80 2024-09-19T09:44:03.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.858+0000 7f3c35445640 1 --2- 172.21.15.112:0/1097716761 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c1c06e530 0x7f3c1c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:03.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.859+0000 7f3c35445640 1 --2- 172.21.15.112:0/1097716761 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c1c06e530 0x7f3c1c0709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009fd0 tx=0x7f3c2c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:03.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:03.864+0000 7f3c25ffb640 1 -- 172.21.15.112:0/1097716761 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3c3010cdb0 con 0x7f3c300fcf80 2024-09-19T09:44:04.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.100+0000 7f3c376a9640 1 -- 172.21.15.112:0/1097716761 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c3010cdb0 con 0x7f3c1c06e530 2024-09-19T09:44:04.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.102+0000 7f3c25ffb640 1 -- 172.21.15.112:0/1097716761 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3c3010cdb0 con 0x7f3c1c06e530 2024-09-19T09:44:04.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.104+0000 7f3c376a9640 1 -- 172.21.15.112:0/1097716761 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c1c06e530 msgr2=0x7f3c1c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.104+0000 7f3c376a9640 1 --2- 172.21.15.112:0/1097716761 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c1c06e530 0x7f3c1c0709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009fd0 tx=0x7f3c2c00b040 comp rx=0 tx=0).stop 2024-09-19T09:44:04.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.104+0000 7f3c376a9640 1 -- 172.21.15.112:0/1097716761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c300fcf80 msgr2=0x7f3c3010c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.104+0000 7f3c376a9640 1 --2- 172.21.15.112:0/1097716761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c300fcf80 0x7f3c3010c480 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3c20000c00 tx=0x7f3c20009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.106 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:03 smithi112 ceph-mon[97503]: pgmap v202: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:44:04.107 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:03 smithi112 ceph-mon[97503]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:44:04.107 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:03 smithi112 ceph-mon[97503]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:44:04.107 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:03 smithi112 ceph-mon[97503]: osdmap e94: 6 total, 6 up, 6 in 2024-09-19T09:44:04.107 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:03 smithi112 ceph-mon[97503]: Standby daemon mds.cephfs.smithi112.ymjyok assigned to filesystem cephfs as rank 0 2024-09-19T09:44:04.107 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:03 smithi112 ceph-mon[97503]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:44:04.107 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:03 smithi112 ceph-mon[97503]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-19T09:44:04.107 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:03 smithi112 ceph-mon[97503]: fsmap cephfs:1/1 {0=cephfs.smithi112.ymjyok=up:replay} 2 up:standby 2024-09-19T09:44:04.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.104+0000 7f3c376a9640 1 -- 172.21.15.112:0/1097716761 shutdown_connections 2024-09-19T09:44:04.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.104+0000 7f3c376a9640 1 --2- 172.21.15.112:0/1097716761 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c1c06e530 0x7f3c1c0709e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.104+0000 7f3c376a9640 1 --2- 172.21.15.112:0/1097716761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c300fcf80 0x7f3c3010c480 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.104+0000 7f3c376a9640 1 --2- 172.21.15.112:0/1097716761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c300fb810 0x7f3c3010bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.104+0000 7f3c376a9640 1 -- 172.21.15.112:0/1097716761 >> 172.21.15.112:0/1097716761 conn(0x7f3c300723b0 msgr2=0x7f3c300fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:04.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.104+0000 7f3c376a9640 1 -- 172.21.15.112:0/1097716761 shutdown_connections 2024-09-19T09:44:04.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.104+0000 7f3c376a9640 1 -- 172.21.15.112:0/1097716761 wait complete. 2024-09-19T09:44:04.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.184+0000 7f9d1c888640 1 -- 172.21.15.112:0/2009172832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d180facf0 msgr2=0x7f9d180fb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.184+0000 7f9d1c888640 1 --2- 172.21.15.112:0/2009172832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d180facf0 0x7f9d180fb160 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0048d0 tx=0x7f9d0c009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.184+0000 7f9d1c888640 1 -- 172.21.15.112:0/2009172832 shutdown_connections 2024-09-19T09:44:04.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.184+0000 7f9d1c888640 1 --2- 172.21.15.112:0/2009172832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d180facf0 0x7f9d180fb160 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.184+0000 7f9d1c888640 1 --2- 172.21.15.112:0/2009172832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d18102680 0x7f9d18102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.184+0000 7f9d1c888640 1 -- 172.21.15.112:0/2009172832 >> 172.21.15.112:0/2009172832 conn(0x7f9d18070d50 msgr2=0x7f9d18071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:04.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.184+0000 7f9d1c888640 1 -- 172.21.15.112:0/2009172832 shutdown_connections 2024-09-19T09:44:04.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.184+0000 7f9d1c888640 1 -- 172.21.15.112:0/2009172832 wait complete. 2024-09-19T09:44:04.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.185+0000 7f9d1c888640 1 Processor -- start 2024-09-19T09:44:04.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.185+0000 7f9d1c888640 1 -- start start 2024-09-19T09:44:04.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.185+0000 7f9d1c888640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d180facf0 0x7f9d18115500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:04.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.185+0000 7f9d1c888640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d18102680 0x7f9d18115a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:04.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.185+0000 7f9d1c888640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d18116090 con 0x7f9d18102680 2024-09-19T09:44:04.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.185+0000 7f9d1c888640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1810f4a0 con 0x7f9d180facf0 2024-09-19T09:44:04.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.185+0000 7f9d15d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d18102680 0x7f9d18115a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:04.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.185+0000 7f9d15d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d18102680 0x7f9d18115a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39128/0 (socket says 172.21.15.112:39128) 2024-09-19T09:44:04.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.185+0000 7f9d15d9b640 1 -- 172.21.15.112:0/3200594294 learned_addr learned my addr 172.21.15.112:0/3200594294 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:44:04.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.185+0000 7f9d1659c640 1 --2- 172.21.15.112:0/3200594294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d180facf0 0x7f9d18115500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:04.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.185+0000 7f9d15d9b640 1 -- 172.21.15.112:0/3200594294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d180facf0 msgr2=0x7f9d18115500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.185+0000 7f9d15d9b640 1 --2- 172.21.15.112:0/3200594294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d180facf0 0x7f9d18115500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.185+0000 7f9d15d9b640 1 -- 172.21.15.112:0/3200594294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c005040 con 0x7f9d18102680 2024-09-19T09:44:04.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.185+0000 7f9d15d9b640 1 --2- 172.21.15.112:0/3200594294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d18102680 0x7f9d18115a40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c000c00 tx=0x7f9d0c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:04.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.186+0000 7f9d06ffd640 1 -- 172.21.15.112:0/3200594294 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d0c038070 con 0x7f9d18102680 2024-09-19T09:44:04.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.186+0000 7f9d06ffd640 1 -- 172.21.15.112:0/3200594294 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9d0c02ade0 con 0x7f9d18102680 2024-09-19T09:44:04.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.186+0000 7f9d1c888640 1 -- 172.21.15.112:0/3200594294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1810f720 con 0x7f9d18102680 2024-09-19T09:44:04.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.186+0000 7f9d1c888640 1 -- 172.21.15.112:0/3200594294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1810fbe0 con 0x7f9d18102680 2024-09-19T09:44:04.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.186+0000 7f9d06ffd640 1 -- 172.21.15.112:0/3200594294 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d0c02c7e0 con 0x7f9d18102680 2024-09-19T09:44:04.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.187+0000 7f9d1c888640 1 -- 172.21.15.112:0/3200594294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf8005210 con 0x7f9d18102680 2024-09-19T09:44:04.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.187+0000 7f9d06ffd640 1 -- 172.21.15.112:0/3200594294 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9d0c030020 con 0x7f9d18102680 2024-09-19T09:44:04.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.188+0000 7f9d06ffd640 1 --2- 172.21.15.112:0/3200594294 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9d0006e530 0x7f9d000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:04.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.188+0000 7f9d06ffd640 1 -- 172.21.15.112:0/3200594294 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f9d0c0add60 con 0x7f9d18102680 2024-09-19T09:44:04.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.188+0000 7f9d1659c640 1 --2- 172.21.15.112:0/3200594294 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9d0006e530 0x7f9d000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:04.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.188+0000 7f9d1659c640 1 --2- 172.21.15.112:0/3200594294 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9d0006e530 0x7f9d000709e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d08004ed0 tx=0x7f9d0800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:04.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.196+0000 7f9d06ffd640 1 -- 172.21.15.112:0/3200594294 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9d0c076e70 con 0x7f9d18102680 2024-09-19T09:44:04.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:03 smithi191 ceph-mon[77624]: pgmap v202: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:44:04.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:03 smithi191 ceph-mon[77624]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:44:04.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:03 smithi191 ceph-mon[77624]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:44:04.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:03 smithi191 ceph-mon[77624]: osdmap e94: 6 total, 6 up, 6 in 2024-09-19T09:44:04.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:03 smithi191 ceph-mon[77624]: Standby daemon mds.cephfs.smithi112.ymjyok assigned to filesystem cephfs as rank 0 2024-09-19T09:44:04.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:03 smithi191 ceph-mon[77624]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:44:04.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:03 smithi191 ceph-mon[77624]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-19T09:44:04.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:03 smithi191 ceph-mon[77624]: fsmap cephfs:1/1 {0=cephfs.smithi112.ymjyok=up:replay} 2 up:standby 2024-09-19T09:44:04.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.396+0000 7f9d1c888640 1 -- 172.21.15.112:0/3200594294 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cf8000bc0 con 0x7f9d0006e530 2024-09-19T09:44:04.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.405+0000 7f9d06ffd640 1 -- 172.21.15.112:0/3200594294 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9cf8000bc0 con 0x7f9d0006e530 2024-09-19T09:44:04.407 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:44:04.407 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (8m) 21s ago 16m 26.7M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:44:04.407 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (4m) 21s ago 17m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 70bad8ff6ec4 2024-09-19T09:44:04.407 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (4m) 8s ago 16m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 6f8cb10f4c96 2024-09-19T09:44:04.407 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (6m) 21s ago 16m 75.4M - 9.4.12 2bacad6d85d8 e462aca2b022 2024-09-19T09:44:04.407 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (25s) 21s ago 11m 14.1M - 19.1.1-361-g2f599a46 d2baa855c067 3267e6b8a90d 2024-09-19T09:44:04.408 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (47s) 21s ago 11m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 3964ad1a1679 2024-09-19T09:44:04.408 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (11s) 8s ago 11m 10.7M - 19.1.1-361-g2f599a46 d2baa855c067 8ee53b5b95cf 2024-09-19T09:44:04.408 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (11m) 8s ago 11m 85.6M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0232d076f19d 2024-09-19T09:44:04.408 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (7m) 21s ago 18m 505M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:44:04.408 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283,8765 running (6m) 8s ago 16m 442M - 19.1.1-361-g2f599a46 d2baa855c067 fddba1bee64a 2024-09-19T09:44:04.408 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (5m) 21s ago 18m 49.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 89dfb5de44c8 2024-09-19T09:44:04.408 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (4m) 8s ago 15m 40.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 3cab8f7cc27e 2024-09-19T09:44:04.408 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (8m) 21s ago 17m 15.5M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:44:04.408 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (8m) 8s ago 16m 16.5M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:44:04.408 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (3m) 21s ago 15m 153M 1557M 19.1.1-361-g2f599a46 d2baa855c067 11a51e663887 2024-09-19T09:44:04.409 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (3m) 21s ago 14m 200M 1557M 19.1.1-361-g2f599a46 d2baa855c067 bd616fcb189b 2024-09-19T09:44:04.409 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (2m) 21s ago 14m 166M 1557M 19.1.1-361-g2f599a46 d2baa855c067 4a651b62590f 2024-09-19T09:44:04.409 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (2m) 8s ago 13m 121M 2581M 19.1.1-361-g2f599a46 d2baa855c067 7f953c691608 2024-09-19T09:44:04.409 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (97s) 8s ago 13m 141M 2581M 19.1.1-361-g2f599a46 d2baa855c067 3cd638400a3a 2024-09-19T09:44:04.409 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (65s) 8s ago 13m 123M 2581M 19.1.1-361-g2f599a46 d2baa855c067 901aaba16a54 2024-09-19T09:44:04.409 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (6m) 21s ago 16m 63.7M - 2.43.0 a07b618ecd1d 54850883a171 2024-09-19T09:44:04.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.408+0000 7f9d1c888640 1 -- 172.21.15.112:0/3200594294 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9d0006e530 msgr2=0x7f9d000709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.408+0000 7f9d1c888640 1 --2- 172.21.15.112:0/3200594294 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9d0006e530 0x7f9d000709e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d08004ed0 tx=0x7f9d0800b040 comp rx=0 tx=0).stop 2024-09-19T09:44:04.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.408+0000 7f9d1c888640 1 -- 172.21.15.112:0/3200594294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d18102680 msgr2=0x7f9d18115a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.408+0000 7f9d1c888640 1 --2- 172.21.15.112:0/3200594294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d18102680 0x7f9d18115a40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c000c00 tx=0x7f9d0c009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.408+0000 7f9d1c888640 1 -- 172.21.15.112:0/3200594294 shutdown_connections 2024-09-19T09:44:04.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.408+0000 7f9d1c888640 1 --2- 172.21.15.112:0/3200594294 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9d0006e530 0x7f9d000709e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.408+0000 7f9d1c888640 1 --2- 172.21.15.112:0/3200594294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d18102680 0x7f9d18115a40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.408+0000 7f9d1c888640 1 --2- 172.21.15.112:0/3200594294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d180facf0 0x7f9d18115500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.408+0000 7f9d1c888640 1 -- 172.21.15.112:0/3200594294 >> 172.21.15.112:0/3200594294 conn(0x7f9d18070d50 msgr2=0x7f9d180fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:04.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.408+0000 7f9d1c888640 1 -- 172.21.15.112:0/3200594294 shutdown_connections 2024-09-19T09:44:04.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.408+0000 7f9d1c888640 1 -- 172.21.15.112:0/3200594294 wait complete. 2024-09-19T09:44:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.487+0000 7fe09e1e8640 1 -- 172.21.15.112:0/4284298887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0980fe460 msgr2=0x7fe0980fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.487+0000 7fe09e1e8640 1 --2- 172.21.15.112:0/4284298887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0980fe460 0x7fe0980fe830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe0880048d0 tx=0x7fe088009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.487+0000 7fe09e1e8640 1 -- 172.21.15.112:0/4284298887 shutdown_connections 2024-09-19T09:44:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.487+0000 7fe09e1e8640 1 --2- 172.21.15.112:0/4284298887 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe098064fc0 0x7fe098065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.487+0000 7fe09e1e8640 1 --2- 172.21.15.112:0/4284298887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0980fe460 0x7fe0980fe830 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.487+0000 7fe09e1e8640 1 -- 172.21.15.112:0/4284298887 >> 172.21.15.112:0/4284298887 conn(0x7fe0980723b0 msgr2=0x7fe0980727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.487+0000 7fe09e1e8640 1 -- 172.21.15.112:0/4284298887 shutdown_connections 2024-09-19T09:44:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.487+0000 7fe09e1e8640 1 -- 172.21.15.112:0/4284298887 wait complete. 2024-09-19T09:44:04.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.488+0000 7fe09e1e8640 1 Processor -- start 2024-09-19T09:44:04.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.488+0000 7fe09e1e8640 1 -- start start 2024-09-19T09:44:04.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.488+0000 7fe09e1e8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe098064fc0 0x7fe098113150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:04.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.488+0000 7fe09e1e8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0980fe460 0x7fe098113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:04.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.489+0000 7fe09e1e8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe098113d20 con 0x7fe0980fe460 2024-09-19T09:44:04.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.489+0000 7fe09e1e8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09810d180 con 0x7fe098064fc0 2024-09-19T09:44:04.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.489+0000 7fe096ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0980fe460 0x7fe098113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:04.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.489+0000 7fe096ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0980fe460 0x7fe098113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39156/0 (socket says 172.21.15.112:39156) 2024-09-19T09:44:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.489+0000 7fe096ffd640 1 -- 172.21.15.112:0/2756322743 learned_addr learned my addr 172.21.15.112:0/2756322743 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:44:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.489+0000 7fe0977fe640 1 --2- 172.21.15.112:0/2756322743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe098064fc0 0x7fe098113150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.489+0000 7fe096ffd640 1 -- 172.21.15.112:0/2756322743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe098064fc0 msgr2=0x7fe098113150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.489+0000 7fe096ffd640 1 --2- 172.21.15.112:0/2756322743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe098064fc0 0x7fe098113150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.489+0000 7fe096ffd640 1 -- 172.21.15.112:0/2756322743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe088005040 con 0x7fe0980fe460 2024-09-19T09:44:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.489+0000 7fe0977fe640 1 --2- 172.21.15.112:0/2756322743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe098064fc0 0x7fe098113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.489+0000 7fe096ffd640 1 --2- 172.21.15.112:0/2756322743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0980fe460 0x7fe098113690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00b790 tx=0x7fe08c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.489+0000 7fe07ffff640 1 -- 172.21.15.112:0/2756322743 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe08c00c700 con 0x7fe0980fe460 2024-09-19T09:44:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.489+0000 7fe07ffff640 1 -- 172.21.15.112:0/2756322743 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe08c00cd00 con 0x7fe0980fe460 2024-09-19T09:44:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.489+0000 7fe09e1e8640 1 -- 172.21.15.112:0/2756322743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09810d460 con 0x7fe0980fe460 2024-09-19T09:44:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.490+0000 7fe07ffff640 1 -- 172.21.15.112:0/2756322743 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe08c015e70 con 0x7fe0980fe460 2024-09-19T09:44:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.490+0000 7fe09e1e8640 1 -- 172.21.15.112:0/2756322743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09810d980 con 0x7fe0980fe460 2024-09-19T09:44:04.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.491+0000 7fe09e1e8640 1 -- 172.21.15.112:0/2756322743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0980fdcf0 con 0x7fe0980fe460 2024-09-19T09:44:04.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.491+0000 7fe07ffff640 1 -- 172.21.15.112:0/2756322743 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe08c012070 con 0x7fe0980fe460 2024-09-19T09:44:04.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.492+0000 7fe07ffff640 1 --2- 172.21.15.112:0/2756322743 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe08006e530 0x7fe0800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:04.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.492+0000 7fe07ffff640 1 -- 172.21.15.112:0/2756322743 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7fe08c08dd70 con 0x7fe0980fe460 2024-09-19T09:44:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.492+0000 7fe0977fe640 1 --2- 172.21.15.112:0/2756322743 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe08006e530 0x7fe0800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.492+0000 7fe0977fe640 1 --2- 172.21.15.112:0/2756322743 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe08006e530 0x7fe0800709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe088007ac0 tx=0x7fe088035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:04.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.496+0000 7fe07ffff640 1 -- 172.21.15.112:0/2756322743 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe08c056dd0 con 0x7fe0980fe460 2024-09-19T09:44:04.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.742+0000 7fe09e1e8640 1 -- 172.21.15.112:0/2756322743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe09810e8a0 con 0x7fe0980fe460 2024-09-19T09:44:04.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.743+0000 7fe07ffff640 1 -- 172.21.15.112:0/2756322743 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fe08c05a490 con 0x7fe0980fe460 2024-09-19T09:44:04.745 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:44:04.745 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:44:04.745 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:44:04.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:44:04.745 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:44:04.745 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:44:04.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:44:04.746 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:44:04.746 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T09:44:04.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:44:04.746 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:44:04.746 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 3 2024-09-19T09:44:04.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:44:04.746 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:44:04.746 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 13 2024-09-19T09:44:04.746 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:44:04.746 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:44:04.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.746+0000 7fe09e1e8640 1 -- 172.21.15.112:0/2756322743 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe08006e530 msgr2=0x7fe0800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.746+0000 7fe09e1e8640 1 --2- 172.21.15.112:0/2756322743 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe08006e530 0x7fe0800709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe088007ac0 tx=0x7fe088035040 comp rx=0 tx=0).stop 2024-09-19T09:44:04.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.746+0000 7fe09e1e8640 1 -- 172.21.15.112:0/2756322743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0980fe460 msgr2=0x7fe098113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.746+0000 7fe09e1e8640 1 --2- 172.21.15.112:0/2756322743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0980fe460 0x7fe098113690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00b790 tx=0x7fe08c0091d0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.746+0000 7fe09e1e8640 1 -- 172.21.15.112:0/2756322743 shutdown_connections 2024-09-19T09:44:04.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.746+0000 7fe09e1e8640 1 --2- 172.21.15.112:0/2756322743 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe08006e530 0x7fe0800709e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.746+0000 7fe09e1e8640 1 --2- 172.21.15.112:0/2756322743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0980fe460 0x7fe098113690 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.746+0000 7fe09e1e8640 1 --2- 172.21.15.112:0/2756322743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe098064fc0 0x7fe098113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.746+0000 7fe09e1e8640 1 -- 172.21.15.112:0/2756322743 >> 172.21.15.112:0/2756322743 conn(0x7fe0980723b0 msgr2=0x7fe098105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:04.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.746+0000 7fe09e1e8640 1 -- 172.21.15.112:0/2756322743 shutdown_connections 2024-09-19T09:44:04.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.746+0000 7fe09e1e8640 1 -- 172.21.15.112:0/2756322743 wait complete. 2024-09-19T09:44:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.826+0000 7fb6f9776640 1 -- 172.21.15.112:0/2413348925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6f40fe450 msgr2=0x7fb6f40fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.826+0000 7fb6f9776640 1 --2- 172.21.15.112:0/2413348925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6f40fe450 0x7fb6f40fe820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40048d0 tx=0x7fb6e4009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.826+0000 7fb6f9776640 1 -- 172.21.15.112:0/2413348925 shutdown_connections 2024-09-19T09:44:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.826+0000 7fb6f9776640 1 --2- 172.21.15.112:0/2413348925 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6f4064fe0 0x7fb6f4065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.826+0000 7fb6f9776640 1 --2- 172.21.15.112:0/2413348925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6f40fe450 0x7fb6f40fe820 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.826+0000 7fb6f9776640 1 -- 172.21.15.112:0/2413348925 >> 172.21.15.112:0/2413348925 conn(0x7fb6f40723b0 msgr2=0x7fb6f40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:04.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.826+0000 7fb6f9776640 1 -- 172.21.15.112:0/2413348925 shutdown_connections 2024-09-19T09:44:04.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.826+0000 7fb6f9776640 1 -- 172.21.15.112:0/2413348925 wait complete. 2024-09-19T09:44:04.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.827+0000 7fb6f9776640 1 Processor -- start 2024-09-19T09:44:04.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.827+0000 7fb6f9776640 1 -- start start 2024-09-19T09:44:04.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.827+0000 7fb6f9776640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6f4064fe0 0x7fb6f41131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:04.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.827+0000 7fb6f9776640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6f40fe450 0x7fb6f4113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:04.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.827+0000 7fb6f9776640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f4113d10 con 0x7fb6f40fe450 2024-09-19T09:44:04.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.827+0000 7fb6f9776640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f410d150 con 0x7fb6f4064fe0 2024-09-19T09:44:04.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.827+0000 7fb6f27fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6f40fe450 0x7fb6f4113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:04.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.827+0000 7fb6f27fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6f40fe450 0x7fb6f4113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39174/0 (socket says 172.21.15.112:39174) 2024-09-19T09:44:04.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.827+0000 7fb6f27fc640 1 -- 172.21.15.112:0/3290914407 learned_addr learned my addr 172.21.15.112:0/3290914407 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:44:04.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.827+0000 7fb6f2ffd640 1 --2- 172.21.15.112:0/3290914407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6f4064fe0 0x7fb6f41131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:04.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.828+0000 7fb6f27fc640 1 -- 172.21.15.112:0/3290914407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6f4064fe0 msgr2=0x7fb6f41131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.828+0000 7fb6f27fc640 1 --2- 172.21.15.112:0/3290914407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6f4064fe0 0x7fb6f41131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.828+0000 7fb6f27fc640 1 -- 172.21.15.112:0/3290914407 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e4005040 con 0x7fb6f40fe450 2024-09-19T09:44:04.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.828+0000 7fb6f27fc640 1 --2- 172.21.15.112:0/3290914407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6f40fe450 0x7fb6f4113710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8002a80 tx=0x7fb6e8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:04.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.828+0000 7fb6db7fe640 1 -- 172.21.15.112:0/3290914407 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6e8007c30 con 0x7fb6f40fe450 2024-09-19T09:44:04.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.828+0000 7fb6db7fe640 1 -- 172.21.15.112:0/3290914407 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb6e800f040 con 0x7fb6f40fe450 2024-09-19T09:44:04.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.828+0000 7fb6f9776640 1 -- 172.21.15.112:0/3290914407 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f410d430 con 0x7fb6f40fe450 2024-09-19T09:44:04.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.828+0000 7fb6db7fe640 1 -- 172.21.15.112:0/3290914407 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6e800dab0 con 0x7fb6f40fe450 2024-09-19T09:44:04.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.828+0000 7fb6f9776640 1 -- 172.21.15.112:0/3290914407 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f410d950 con 0x7fb6f40fe450 2024-09-19T09:44:04.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.830+0000 7fb6f9776640 1 -- 172.21.15.112:0/3290914407 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f40fdce0 con 0x7fb6f40fe450 2024-09-19T09:44:04.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.830+0000 7fb6db7fe640 1 -- 172.21.15.112:0/3290914407 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb6e800dc10 con 0x7fb6f40fe450 2024-09-19T09:44:04.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.830+0000 7fb6db7fe640 1 --2- 172.21.15.112:0/3290914407 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb6dc06e530 0x7fb6dc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:04.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.830+0000 7fb6db7fe640 1 -- 172.21.15.112:0/3290914407 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7fb6e808dab0 con 0x7fb6f40fe450 2024-09-19T09:44:04.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.830+0000 7fb6f2ffd640 1 --2- 172.21.15.112:0/3290914407 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb6dc06e530 0x7fb6dc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:04.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.831+0000 7fb6f2ffd640 1 --2- 172.21.15.112:0/3290914407 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb6dc06e530 0x7fb6dc0709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009ac0 tx=0x7fb6e4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:04.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:04.835+0000 7fb6db7fe640 1 -- 172.21.15.112:0/3290914407 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb6e8056c30 con 0x7fb6f40fe450 2024-09-19T09:44:05.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.045+0000 7fb6f9776640 1 -- 172.21.15.112:0/3290914407 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb6f410e870 con 0x7fb6f40fe450 2024-09-19T09:44:05.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:04 smithi112 ceph-mon[97503]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:05.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:04 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2756322743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:05.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.046+0000 7fb6db7fe640 1 -- 172.21.15.112:0/3290914407 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1791 (secure 0 0 0) 0x7fb6e805a2f0 con 0x7fb6f40fe450 2024-09-19T09:44:05.049 INFO:teuthology.orchestra.run.smithi112.stdout:e30 2024-09-19T09:44:05.049 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-19T09:44:03:173796+0000 2024-09-19T09:44:05.049 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:44:05.049 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:44:05.049 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-19T09:44:05.049 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:44:05.049 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:44:05.049 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-19T09:44:05.049 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 30 2024-09-19T09:44:05.049 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T09:44:05.049 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:44:05.049 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-19T09:44:03.173779+0000 2024-09-19T09:44:05.050 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-19T09:44:05.050 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-19T09:44:05.050 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-19T09:44:05.050 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-19T09:44:05.050 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-19T09:44:05.050 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-19T09:44:05.050 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-19T09:44:05.050 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-19T09:44:05.050 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 94 2024-09-19T09:44:05.050 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:44:05.050 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-19T09:44:05.050 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-19T09:44:05.050 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=34384} 2024-09-19T09:44:05.051 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-19T09:44:05.051 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-19T09:44:05.051 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-19T09:44:05.051 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-19T09:44:05.051 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-19T09:44:05.051 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data disabled 2024-09-19T09:44:05.051 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-19T09:44:05.051 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-19T09:44:05.052 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-19T09:44:05.052 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:44:05.052 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ymjyok{0:34384} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/1711973242,v1:172.21.15.112:6827/1711973242] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:44:05.052 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:44:05.053 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:44:05.053 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-19T09:44:05.053 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:44:05.053 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.hcoxjz{-1:34416} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6828/742383802,v1:172.21.15.112:6829/742383802] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:44:05.053 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.jjldod{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6824/3336467092,v1:172.21.15.191:6825/3336467092] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:44:05.056 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 30 2024-09-19T09:44:05.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.048+0000 7fb6f9776640 1 -- 172.21.15.112:0/3290914407 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb6dc06e530 msgr2=0x7fb6dc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:05.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.048+0000 7fb6f9776640 1 --2- 172.21.15.112:0/3290914407 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb6dc06e530 0x7fb6dc0709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009ac0 tx=0x7fb6e4035040 comp rx=0 tx=0).stop 2024-09-19T09:44:05.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.048+0000 7fb6f9776640 1 -- 172.21.15.112:0/3290914407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6f40fe450 msgr2=0x7fb6f4113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:05.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.048+0000 7fb6f9776640 1 --2- 172.21.15.112:0/3290914407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6f40fe450 0x7fb6f4113710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8002a80 tx=0x7fb6e8004600 comp rx=0 tx=0).stop 2024-09-19T09:44:05.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.048+0000 7fb6f9776640 1 -- 172.21.15.112:0/3290914407 shutdown_connections 2024-09-19T09:44:05.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.048+0000 7fb6f9776640 1 --2- 172.21.15.112:0/3290914407 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb6dc06e530 0x7fb6dc0709e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.048+0000 7fb6f9776640 1 --2- 172.21.15.112:0/3290914407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6f40fe450 0x7fb6f4113710 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.048+0000 7fb6f9776640 1 --2- 172.21.15.112:0/3290914407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6f4064fe0 0x7fb6f41131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.048+0000 7fb6f9776640 1 -- 172.21.15.112:0/3290914407 >> 172.21.15.112:0/3290914407 conn(0x7fb6f40723b0 msgr2=0x7fb6f40fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.049+0000 7fb6f9776640 1 -- 172.21.15.112:0/3290914407 shutdown_connections 2024-09-19T09:44:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.049+0000 7fb6f9776640 1 -- 172.21.15.112:0/3290914407 wait complete. 2024-09-19T09:44:05.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.136+0000 7f6d33b75640 1 -- 172.21.15.112:0/3434169672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d2c0fe460 msgr2=0x7f6d2c0fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:05.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.136+0000 7f6d33b75640 1 --2- 172.21.15.112:0/3434169672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d2c0fe460 0x7f6d2c0fe830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6d280048d0 tx=0x7f6d28009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.136+0000 7f6d33b75640 1 -- 172.21.15.112:0/3434169672 shutdown_connections 2024-09-19T09:44:05.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.136+0000 7f6d33b75640 1 --2- 172.21.15.112:0/3434169672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d2c064fc0 0x7f6d2c065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.136+0000 7f6d33b75640 1 --2- 172.21.15.112:0/3434169672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d2c0fe460 0x7f6d2c0fe830 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.136+0000 7f6d33b75640 1 -- 172.21.15.112:0/3434169672 >> 172.21.15.112:0/3434169672 conn(0x7f6d2c0723b0 msgr2=0x7f6d2c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:05.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.136+0000 7f6d33b75640 1 -- 172.21.15.112:0/3434169672 shutdown_connections 2024-09-19T09:44:05.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.136+0000 7f6d33b75640 1 -- 172.21.15.112:0/3434169672 wait complete. 2024-09-19T09:44:05.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.137+0000 7f6d33b75640 1 Processor -- start 2024-09-19T09:44:05.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.137+0000 7f6d33b75640 1 -- start start 2024-09-19T09:44:05.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.137+0000 7f6d33b75640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d2c064fc0 0x7f6d2c113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:05.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.137+0000 7f6d33b75640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d2c0fe460 0x7f6d2c1136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:05.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.137+0000 7f6d33b75640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c113cd0 con 0x7f6d2c064fc0 2024-09-19T09:44:05.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.137+0000 7f6d33b75640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c10d110 con 0x7f6d2c0fe460 2024-09-19T09:44:05.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.137+0000 7f6d31911640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d2c064fc0 0x7f6d2c113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:05.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.137+0000 7f6d31911640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d2c064fc0 0x7f6d2c113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39200/0 (socket says 172.21.15.112:39200) 2024-09-19T09:44:05.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.137+0000 7f6d31911640 1 -- 172.21.15.112:0/2517523084 learned_addr learned my addr 172.21.15.112:0/2517523084 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:44:05.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.137+0000 7f6d31110640 1 --2- 172.21.15.112:0/2517523084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d2c0fe460 0x7f6d2c1136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:05.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.137+0000 7f6d31911640 1 -- 172.21.15.112:0/2517523084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d2c0fe460 msgr2=0x7f6d2c1136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:05.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.137+0000 7f6d31911640 1 --2- 172.21.15.112:0/2517523084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d2c0fe460 0x7f6d2c1136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.137+0000 7f6d31911640 1 -- 172.21.15.112:0/2517523084 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d28005040 con 0x7f6d2c064fc0 2024-09-19T09:44:05.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.138+0000 7f6d31911640 1 --2- 172.21.15.112:0/2517523084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d2c064fc0 0x7f6d2c113190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6d28003080 tx=0x7f6d28009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:05.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.138+0000 7f6d227fc640 1 -- 172.21.15.112:0/2517523084 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d28038070 con 0x7f6d2c064fc0 2024-09-19T09:44:05.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.138+0000 7f6d227fc640 1 -- 172.21.15.112:0/2517523084 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6d280097e0 con 0x7f6d2c064fc0 2024-09-19T09:44:05.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.138+0000 7f6d227fc640 1 -- 172.21.15.112:0/2517523084 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d2803d420 con 0x7f6d2c064fc0 2024-09-19T09:44:05.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.138+0000 7f6d33b75640 1 -- 172.21.15.112:0/2517523084 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2c10d390 con 0x7f6d2c064fc0 2024-09-19T09:44:05.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.138+0000 7f6d33b75640 1 -- 172.21.15.112:0/2517523084 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2c10d8d0 con 0x7f6d2c064fc0 2024-09-19T09:44:05.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.139+0000 7f6d33b75640 1 -- 172.21.15.112:0/2517523084 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2c0fdcf0 con 0x7f6d2c064fc0 2024-09-19T09:44:05.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.140+0000 7f6d227fc640 1 -- 172.21.15.112:0/2517523084 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6d28030020 con 0x7f6d2c064fc0 2024-09-19T09:44:05.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.141+0000 7f6d227fc640 1 --2- 172.21.15.112:0/2517523084 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f6d1806e530 0x7f6d180709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:05.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.141+0000 7f6d227fc640 1 -- 172.21.15.112:0/2517523084 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f6d280ae6f0 con 0x7f6d2c064fc0 2024-09-19T09:44:05.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.141+0000 7f6d31110640 1 --2- 172.21.15.112:0/2517523084 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f6d1806e530 0x7f6d180709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:05.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.142+0000 7f6d31110640 1 --2- 172.21.15.112:0/2517523084 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f6d1806e530 0x7f6d180709e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c10ea50 tx=0x7f6d1c004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:05.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.145+0000 7f6d227fc640 1 -- 172.21.15.112:0/2517523084 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6d28077750 con 0x7f6d2c064fc0 2024-09-19T09:44:05.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:04 smithi191 ceph-mon[77624]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:05.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:04 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2756322743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:05.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.357+0000 7f6d33b75640 1 -- 172.21.15.112:0/2517523084 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d2c04b720 con 0x7f6d1806e530 2024-09-19T09:44:05.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.359+0000 7f6d227fc640 1 -- 172.21.15.112:0/2517523084 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6d2c04b720 con 0x7f6d1806e530 2024-09-19T09:44:05.361 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:44:05.361 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:44:05.361 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-19T09:44:05.361 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-19T09:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: "mon", 2024-09-19T09:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: "osd", 2024-09-19T09:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-19T09:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: "crash" 2024-09-19T09:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-19T09:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "15/21 daemons upgraded", 2024-09-19T09:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T09:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:44:05.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.361+0000 7f6d33b75640 1 -- 172.21.15.112:0/2517523084 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f6d1806e530 msgr2=0x7f6d180709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:05.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.361+0000 7f6d33b75640 1 --2- 172.21.15.112:0/2517523084 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f6d1806e530 0x7f6d180709e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c10ea50 tx=0x7f6d1c004330 comp rx=0 tx=0).stop 2024-09-19T09:44:05.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.361+0000 7f6d33b75640 1 -- 172.21.15.112:0/2517523084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d2c064fc0 msgr2=0x7f6d2c113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:05.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.361+0000 7f6d33b75640 1 --2- 172.21.15.112:0/2517523084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d2c064fc0 0x7f6d2c113190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6d28003080 tx=0x7f6d28009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.361+0000 7f6d33b75640 1 -- 172.21.15.112:0/2517523084 shutdown_connections 2024-09-19T09:44:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.361+0000 7f6d33b75640 1 --2- 172.21.15.112:0/2517523084 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f6d1806e530 0x7f6d180709e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.361+0000 7f6d33b75640 1 --2- 172.21.15.112:0/2517523084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d2c0fe460 0x7f6d2c1136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.361+0000 7f6d33b75640 1 --2- 172.21.15.112:0/2517523084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d2c064fc0 0x7f6d2c113190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.361+0000 7f6d33b75640 1 -- 172.21.15.112:0/2517523084 >> 172.21.15.112:0/2517523084 conn(0x7f6d2c0723b0 msgr2=0x7f6d2c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.362+0000 7f6d33b75640 1 -- 172.21.15.112:0/2517523084 shutdown_connections 2024-09-19T09:44:05.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.362+0000 7f6d33b75640 1 -- 172.21.15.112:0/2517523084 wait complete. 2024-09-19T09:44:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.441+0000 7f7420712640 1 -- 172.21.15.112:0/3197204775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7418064fc0 msgr2=0x7f7418065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:05.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.441+0000 7f7420712640 1 --2- 172.21.15.112:0/3197204775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7418064fc0 0x7f7418065430 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f74080048d0 tx=0x7f7408009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.441+0000 7f7420712640 1 -- 172.21.15.112:0/3197204775 shutdown_connections 2024-09-19T09:44:05.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.442+0000 7f7420712640 1 --2- 172.21.15.112:0/3197204775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7418064fc0 0x7f7418065430 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.442+0000 7f7420712640 1 --2- 172.21.15.112:0/3197204775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74180fe460 0x7f74180fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.442+0000 7f7420712640 1 -- 172.21.15.112:0/3197204775 >> 172.21.15.112:0/3197204775 conn(0x7f74180723b0 msgr2=0x7f74180727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:05.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.442+0000 7f7420712640 1 -- 172.21.15.112:0/3197204775 shutdown_connections 2024-09-19T09:44:05.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.442+0000 7f7420712640 1 -- 172.21.15.112:0/3197204775 wait complete. 2024-09-19T09:44:05.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.442+0000 7f7420712640 1 Processor -- start 2024-09-19T09:44:05.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.442+0000 7f7420712640 1 -- start start 2024-09-19T09:44:05.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.442+0000 7f7420712640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7418064fc0 0x7f74180fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:05.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.442+0000 7f7420712640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74180fe460 0x7f74180fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.442+0000 7f7420712640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180fc070 con 0x7f7418064fc0 2024-09-19T09:44:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.442+0000 7f7420712640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180fc1e0 con 0x7f74180fe460 2024-09-19T09:44:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.442+0000 7f741e4ae640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7418064fc0 0x7f74180fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.443+0000 7f741e4ae640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7418064fc0 0x7f74180fb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39214/0 (socket says 172.21.15.112:39214) 2024-09-19T09:44:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.443+0000 7f741e4ae640 1 -- 172.21.15.112:0/3444009262 learned_addr learned my addr 172.21.15.112:0/3444009262 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:44:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.443+0000 7f741dcad640 1 --2- 172.21.15.112:0/3444009262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74180fe460 0x7f74180fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.443+0000 7f741e4ae640 1 -- 172.21.15.112:0/3444009262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74180fe460 msgr2=0x7f74180fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.443+0000 7f741e4ae640 1 --2- 172.21.15.112:0/3444009262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74180fe460 0x7f74180fbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.443+0000 7f741e4ae640 1 -- 172.21.15.112:0/3444009262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7408005040 con 0x7f7418064fc0 2024-09-19T09:44:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.443+0000 7f741e4ae640 1 --2- 172.21.15.112:0/3444009262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7418064fc0 0x7f74180fb560 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f741400b790 tx=0x7f74140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.443+0000 7f740effd640 1 -- 172.21.15.112:0/3444009262 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f741400c700 con 0x7f7418064fc0 2024-09-19T09:44:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.443+0000 7f7420712640 1 -- 172.21.15.112:0/3444009262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7418119550 con 0x7f7418064fc0 2024-09-19T09:44:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.443+0000 7f740effd640 1 -- 172.21.15.112:0/3444009262 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f741400cd00 con 0x7f7418064fc0 2024-09-19T09:44:05.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.443+0000 7f740effd640 1 -- 172.21.15.112:0/3444009262 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7414015e80 con 0x7f7418064fc0 2024-09-19T09:44:05.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.443+0000 7f7420712640 1 -- 172.21.15.112:0/3444009262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7418119990 con 0x7f7418064fc0 2024-09-19T09:44:05.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.444+0000 7f7420712640 1 -- 172.21.15.112:0/3444009262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74180fdcf0 con 0x7f7418064fc0 2024-09-19T09:44:05.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.445+0000 7f740effd640 1 -- 172.21.15.112:0/3444009262 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7414012070 con 0x7f7418064fc0 2024-09-19T09:44:05.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.446+0000 7f740effd640 1 --2- 172.21.15.112:0/3444009262 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f740406e530 0x7f74040709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:05.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.446+0000 7f740effd640 1 -- 172.21.15.112:0/3444009262 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f741408dbf0 con 0x7f7418064fc0 2024-09-19T09:44:05.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.446+0000 7f741dcad640 1 --2- 172.21.15.112:0/3444009262 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f740406e530 0x7f74040709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:05.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.446+0000 7f741dcad640 1 --2- 172.21.15.112:0/3444009262 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f740406e530 0x7f74040709e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f74180fcea0 tx=0x7f7408035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:05.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.454+0000 7f740effd640 1 -- 172.21.15.112:0/3444009262 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7414056bd0 con 0x7f7418064fc0 2024-09-19T09:44:05.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.697+0000 7f7420712640 1 -- 172.21.15.112:0/3444009262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f741804b780 con 0x7f7418064fc0 2024-09-19T09:44:05.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.697+0000 7f740effd640 1 -- 172.21.15.112:0/3444009262 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f741405a290 con 0x7f7418064fc0 2024-09-19T09:44:05.699 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 filesystem is degraded 2024-09-19T09:44:05.699 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T09:44:05.699 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs is degraded 2024-09-19T09:44:05.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.699+0000 7f7420712640 1 -- 172.21.15.112:0/3444009262 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f740406e530 msgr2=0x7f74040709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:05.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.699+0000 7f7420712640 1 --2- 172.21.15.112:0/3444009262 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f740406e530 0x7f74040709e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f74180fcea0 tx=0x7f7408035040 comp rx=0 tx=0).stop 2024-09-19T09:44:05.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.699+0000 7f7420712640 1 -- 172.21.15.112:0/3444009262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7418064fc0 msgr2=0x7f74180fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:05.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.699+0000 7f7420712640 1 --2- 172.21.15.112:0/3444009262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7418064fc0 0x7f74180fb560 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f741400b790 tx=0x7f74140091d0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.699+0000 7f7420712640 1 -- 172.21.15.112:0/3444009262 shutdown_connections 2024-09-19T09:44:05.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.699+0000 7f7420712640 1 --2- 172.21.15.112:0/3444009262 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f740406e530 0x7f74040709e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.699+0000 7f7420712640 1 --2- 172.21.15.112:0/3444009262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74180fe460 0x7f74180fbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.699+0000 7f7420712640 1 --2- 172.21.15.112:0/3444009262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7418064fc0 0x7f74180fb560 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:05.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.700+0000 7f7420712640 1 -- 172.21.15.112:0/3444009262 >> 172.21.15.112:0/3444009262 conn(0x7f74180723b0 msgr2=0x7f7418105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:05.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.700+0000 7f7420712640 1 -- 172.21.15.112:0/3444009262 shutdown_connections 2024-09-19T09:44:05.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:05.700+0000 7f7420712640 1 -- 172.21.15.112:0/3444009262 wait complete. 2024-09-19T09:44:06.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:05 smithi112 ceph-mon[97503]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:05 smithi112 ceph-mon[97503]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:05 smithi112 ceph-mon[97503]: pgmap v204: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 1 op/s 2024-09-19T09:44:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:05 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3290914407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:44:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:05 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3444009262' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:44:06.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:05 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.qweljt"}]: dispatch 2024-09-19T09:44:06.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:05 smithi191 ceph-mon[77624]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:06.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:05 smithi191 ceph-mon[77624]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:06.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:05 smithi191 ceph-mon[77624]: pgmap v204: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 1 op/s 2024-09-19T09:44:06.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:05 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3290914407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:44:06.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:05 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3444009262' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:44:06.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:05 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.qweljt"}]: dispatch 2024-09-19T09:44:07.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:06 smithi112 ceph-mon[97503]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:06 smithi191 ceph-mon[77624]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:08.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:07 smithi112 ceph-mon[97503]: pgmap v205: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 1 op/s 2024-09-19T09:44:08.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:07 smithi191 ceph-mon[77624]: pgmap v205: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 1 op/s 2024-09-19T09:44:09.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:09 smithi112 ceph-mon[97503]: pgmap v206: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-19T09:44:10.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:09 smithi191 ceph-mon[77624]: pgmap v206: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-19T09:44:11.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:10 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:11.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:10 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:44:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:10 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:11.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:10 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:44:12.034 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:11 smithi191 ceph-mon[77624]: reconnect by client.14500 v1:192.168.0.1:0/3618400098 after 0 2024-09-19T09:44:12.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:11 smithi191 ceph-mon[77624]: reconnect by client.14506 v1:172.21.15.191:0/3203645647 after 0.000999973 2024-09-19T09:44:12.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:11 smithi191 ceph-mon[77624]: mds.? [v2:172.21.15.112:6826/1711973242,v1:172.21.15.112:6827/1711973242] up:reconnect 2024-09-19T09:44:12.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:11 smithi191 ceph-mon[77624]: fsmap cephfs:1/1 {0=cephfs.smithi112.ymjyok=up:reconnect} 2 up:standby 2024-09-19T09:44:12.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:11 smithi191 ceph-mon[77624]: pgmap v207: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-19T09:44:12.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:11 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:12.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:11 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:12.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:11 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:12.101 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:11 smithi112 ceph-mon[97503]: reconnect by client.14500 v1:192.168.0.1:0/3618400098 after 0 2024-09-19T09:44:12.101 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:11 smithi112 ceph-mon[97503]: reconnect by client.14506 v1:172.21.15.191:0/3203645647 after 0.000999973 2024-09-19T09:44:12.101 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:11 smithi112 ceph-mon[97503]: mds.? [v2:172.21.15.112:6826/1711973242,v1:172.21.15.112:6827/1711973242] up:reconnect 2024-09-19T09:44:12.101 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:11 smithi112 ceph-mon[97503]: fsmap cephfs:1/1 {0=cephfs.smithi112.ymjyok=up:reconnect} 2 up:standby 2024-09-19T09:44:12.101 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:11 smithi112 ceph-mon[97503]: pgmap v207: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-19T09:44:12.101 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:11 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:12.101 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:11 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:12.101 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:11 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:13.125 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:12 smithi191 ceph-mon[77624]: mds.? [v2:172.21.15.112:6826/1711973242,v1:172.21.15.112:6827/1711973242] up:rejoin 2024-09-19T09:44:13.126 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:12 smithi191 ceph-mon[77624]: mds.? [v2:172.21.15.191:6826/1878602887,v1:172.21.15.191:6827/1878602887] up:boot 2024-09-19T09:44:13.126 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:12 smithi191 ceph-mon[77624]: fsmap cephfs:1/1 {0=cephfs.smithi112.ymjyok=up:rejoin} 3 up:standby 2024-09-19T09:44:13.126 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:12 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.qweljt"}]: dispatch 2024-09-19T09:44:13.126 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:12 smithi191 ceph-mon[77624]: daemon mds.cephfs.smithi112.ymjyok is now active in filesystem cephfs as rank 0 2024-09-19T09:44:13.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:12 smithi112 ceph-mon[97503]: mds.? [v2:172.21.15.112:6826/1711973242,v1:172.21.15.112:6827/1711973242] up:rejoin 2024-09-19T09:44:13.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:12 smithi112 ceph-mon[97503]: mds.? [v2:172.21.15.191:6826/1878602887,v1:172.21.15.191:6827/1878602887] up:boot 2024-09-19T09:44:13.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:12 smithi112 ceph-mon[97503]: fsmap cephfs:1/1 {0=cephfs.smithi112.ymjyok=up:rejoin} 3 up:standby 2024-09-19T09:44:13.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:12 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi191.qweljt"}]: dispatch 2024-09-19T09:44:13.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:12 smithi112 ceph-mon[97503]: daemon mds.cephfs.smithi112.ymjyok is now active in filesystem cephfs as rank 0 2024-09-19T09:44:14.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:13 smithi112 ceph-mon[97503]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:44:14.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:13 smithi112 ceph-mon[97503]: Cluster is now healthy 2024-09-19T09:44:14.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:13 smithi112 ceph-mon[97503]: pgmap v208: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-19T09:44:14.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:13 smithi112 ceph-mon[97503]: mds.? [v2:172.21.15.112:6826/1711973242,v1:172.21.15.112:6827/1711973242] up:active 2024-09-19T09:44:14.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:13 smithi112 ceph-mon[97503]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 3 up:standby 2024-09-19T09:44:14.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:13 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:14.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:13 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:14.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:13 smithi191 ceph-mon[77624]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:44:14.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:13 smithi191 ceph-mon[77624]: Cluster is now healthy 2024-09-19T09:44:14.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:13 smithi191 ceph-mon[77624]: pgmap v208: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-19T09:44:14.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:13 smithi191 ceph-mon[77624]: mds.? [v2:172.21.15.112:6826/1711973242,v1:172.21.15.112:6827/1711973242] up:active 2024-09-19T09:44:14.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:13 smithi191 ceph-mon[77624]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 3 up:standby 2024-09-19T09:44:14.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:13 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:14.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:13 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:15.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:15 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:15.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:15 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:15.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:15 smithi191 ceph-mon[77624]: pgmap v209: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 175 B/s wr, 8 op/s 2024-09-19T09:44:15.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:15 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:15.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:15 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:15.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:15 smithi112 ceph-mon[97503]: pgmap v209: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 175 B/s wr, 8 op/s 2024-09-19T09:44:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: pgmap v210: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-19T09:44:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:18.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:18.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:18.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:18.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:18.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:18.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:18.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:18.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:18.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.hcoxjz"}]: dispatch 2024-09-19T09:44:18.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.hcoxjz"}]': finished 2024-09-19T09:44:18.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:44:18.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.ymjyok"}]': finished 2024-09-19T09:44:18.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi191.jjldod"}]: dispatch 2024-09-19T09:44:18.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi191.jjldod"}]': finished 2024-09-19T09:44:18.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi191.qweljt"}]: dispatch 2024-09-19T09:44:18.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi191.qweljt"}]': finished 2024-09-19T09:44:18.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:17 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-19T09:44:18.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: pgmap v210: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-19T09:44:18.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:18.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:18.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:18.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:18.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:18.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:18.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:18.291 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:18.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:18.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:18.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:18.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:18.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.hcoxjz"}]: dispatch 2024-09-19T09:44:18.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.hcoxjz"}]': finished 2024-09-19T09:44:18.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.ymjyok"}]: dispatch 2024-09-19T09:44:18.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.ymjyok"}]': finished 2024-09-19T09:44:18.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi191.jjldod"}]: dispatch 2024-09-19T09:44:18.292 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi191.jjldod"}]': finished 2024-09-19T09:44:18.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi191.qweljt"}]: dispatch 2024-09-19T09:44:18.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi191.qweljt"}]': finished 2024-09-19T09:44:18.293 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:17 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-19T09:44:19.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:18 smithi112 ceph-mon[97503]: Upgrade: Setting container_image for all mds 2024-09-19T09:44:19.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:18 smithi112 ceph-mon[97503]: Upgrade: Setting filesystem cephfs Joinable 2024-09-19T09:44:19.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:18 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-19T09:44:19.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:18 smithi112 ceph-mon[97503]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 3 up:standby 2024-09-19T09:44:19.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:18 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-19T09:44:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:18 smithi191 ceph-mon[77624]: Upgrade: Setting container_image for all mds 2024-09-19T09:44:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:18 smithi191 ceph-mon[77624]: Upgrade: Setting filesystem cephfs Joinable 2024-09-19T09:44:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:18 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-19T09:44:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:18 smithi191 ceph-mon[77624]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 3 up:standby 2024-09-19T09:44:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:18 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-19T09:44:20.034 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3[87324]: 2024-09-19T09:44:19.755+0000 7f493a5f3640 -1 bdev(0x55f540568c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 7 2024-09-19T09:44:20.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-19T09:44:20.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: pgmap v211: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-09-19T09:44:20.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-19T09:44:20.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 3 up:standby 2024-09-19T09:44:20.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 1 up:standby-replay 2 up:standby 2024-09-19T09:44:20.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.036 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.037 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.038 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.038 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.038 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.038 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.038 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.038 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.038 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.038 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.038 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.038 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-19T09:44:20.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-19T09:44:20.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-19T09:44:20.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-19T09:44:20.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-19T09:44:20.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-19T09:44:20.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-19T09:44:20.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-19T09:44:20.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-19T09:44:20.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-19T09:44:20.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-19T09:44:20.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-19T09:44:20.039 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-19T09:44:20.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-19T09:44:20.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-19T09:44:20.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-19T09:44:20.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-19T09:44:20.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-19T09:44:20.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-19T09:44:20.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-19T09:44:20.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-19T09:44:20.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.040 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.041 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.041 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.041 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-19T09:44:20.041 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-19T09:44:20.041 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:20.041 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.041 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:20.041 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:20.041 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:19 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-19T09:44:20.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: pgmap v211: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-09-19T09:44:20.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-19T09:44:20.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 3 up:standby 2024-09-19T09:44:20.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: fsmap cephfs:1 {0=cephfs.smithi112.ymjyok=up:active} 1 up:standby-replay 2 up:standby 2024-09-19T09:44:20.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.191 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.192 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:20.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-19T09:44:20.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-19T09:44:20.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-19T09:44:20.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-19T09:44:20.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-19T09:44:20.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-19T09:44:20.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-19T09:44:20.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-19T09:44:20.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-19T09:44:20.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-19T09:44:20.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-19T09:44:20.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-19T09:44:20.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-19T09:44:20.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-19T09:44:20.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-19T09:44:20.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-19T09:44:20.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-19T09:44:20.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-19T09:44:20.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-19T09:44:20.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-19T09:44:20.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-19T09:44:20.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:44:20.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-19T09:44:20.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-19T09:44:20.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:20.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:20.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:20.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:20.195 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:19 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:21.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:20 smithi112 ceph-mon[97503]: Upgrade: Setting container_image for all rgw 2024-09-19T09:44:21.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:20 smithi112 ceph-mon[97503]: Upgrade: Setting container_image for all rbd-mirror 2024-09-19T09:44:21.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:20 smithi112 ceph-mon[97503]: Upgrade: Setting container_image for all ceph-exporter 2024-09-19T09:44:21.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:20 smithi112 ceph-mon[97503]: Upgrade: Setting container_image for all iscsi 2024-09-19T09:44:21.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:20 smithi112 ceph-mon[97503]: Upgrade: Setting container_image for all nfs 2024-09-19T09:44:21.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:20 smithi112 ceph-mon[97503]: Upgrade: Setting container_image for all nvmeof 2024-09-19T09:44:21.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:20 smithi112 ceph-mon[97503]: Upgrade: Finalizing container_image settings 2024-09-19T09:44:21.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:20 smithi112 ceph-mon[97503]: Upgrade: Complete! 2024-09-19T09:44:21.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:20 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:21.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:20 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:21.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:20 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:21.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:20 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:20 smithi191 ceph-mon[77624]: Upgrade: Setting container_image for all rgw 2024-09-19T09:44:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:20 smithi191 ceph-mon[77624]: Upgrade: Setting container_image for all rbd-mirror 2024-09-19T09:44:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:20 smithi191 ceph-mon[77624]: Upgrade: Setting container_image for all ceph-exporter 2024-09-19T09:44:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:20 smithi191 ceph-mon[77624]: Upgrade: Setting container_image for all iscsi 2024-09-19T09:44:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:20 smithi191 ceph-mon[77624]: Upgrade: Setting container_image for all nfs 2024-09-19T09:44:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:20 smithi191 ceph-mon[77624]: Upgrade: Setting container_image for all nvmeof 2024-09-19T09:44:21.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:20 smithi191 ceph-mon[77624]: Upgrade: Finalizing container_image settings 2024-09-19T09:44:21.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:20 smithi191 ceph-mon[77624]: Upgrade: Complete! 2024-09-19T09:44:21.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:20 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:21.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:20 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:21.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:20 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:21.286 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:20 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:22.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:22 smithi191 ceph-mon[77624]: pgmap v212: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-09-19T09:44:22.315 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:22 smithi112 ceph-mon[97503]: pgmap v212: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-09-19T09:44:24.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:24 smithi191 ceph-mon[77624]: pgmap v213: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 6.9 MiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-19T09:44:24.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:24 smithi112 ceph-mon[97503]: pgmap v213: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 6.9 MiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-19T09:44:26.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:44:26.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:25 smithi112 ceph-mon[97503]: pgmap v214: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-09-19T09:44:26.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:44:26.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:44:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:25 smithi191 ceph-mon[77624]: pgmap v214: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-09-19T09:44:28.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:27 smithi112 ceph-mon[97503]: pgmap v215: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 3.9 KiB/s wr, 6 op/s 2024-09-19T09:44:28.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:27 smithi191 ceph-mon[77624]: pgmap v215: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 3.9 KiB/s wr, 6 op/s 2024-09-19T09:44:30.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:29 smithi112 ceph-mon[97503]: pgmap v216: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 3.9 KiB/s wr, 7 op/s 2024-09-19T09:44:30.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:29 smithi191 ceph-mon[77624]: pgmap v216: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 3.9 KiB/s wr, 7 op/s 2024-09-19T09:44:32.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:31 smithi112 ceph-mon[97503]: pgmap v217: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-19T09:44:32.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:31 smithi191 ceph-mon[77624]: pgmap v217: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-19T09:44:34.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:33 smithi112 ceph-mon[97503]: pgmap v218: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-19T09:44:34.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:33 smithi191 ceph-mon[77624]: pgmap v218: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-19T09:44:35.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.791+0000 7f66a6d10640 1 -- 172.21.15.112:0/4083676788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a00fb810 msgr2=0x7f66a00fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:35.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.791+0000 7f66a6d10640 1 --2- 172.21.15.112:0/4083676788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a00fb810 0x7f66a00fbbe0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f66900048d0 tx=0x7f6690009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:35.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.791+0000 7f66a6d10640 1 -- 172.21.15.112:0/4083676788 shutdown_connections 2024-09-19T09:44:35.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.791+0000 7f66a6d10640 1 --2- 172.21.15.112:0/4083676788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66a00fcf80 0x7f66a00fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:35.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.791+0000 7f66a6d10640 1 --2- 172.21.15.112:0/4083676788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a00fb810 0x7f66a00fbbe0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:35.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.791+0000 7f66a6d10640 1 -- 172.21.15.112:0/4083676788 >> 172.21.15.112:0/4083676788 conn(0x7f66a00723b0 msgr2=0x7f66a00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:35.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.791+0000 7f66a6d10640 1 -- 172.21.15.112:0/4083676788 shutdown_connections 2024-09-19T09:44:35.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.791+0000 7f66a6d10640 1 -- 172.21.15.112:0/4083676788 wait complete. 2024-09-19T09:44:35.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.792+0000 7f66a6d10640 1 Processor -- start 2024-09-19T09:44:35.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.792+0000 7f66a6d10640 1 -- start start 2024-09-19T09:44:35.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.792+0000 7f66a6d10640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66a00fb810 0x7f66a01131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:35.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.792+0000 7f66a6d10640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a00fcf80 0x7f66a0113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:35.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.792+0000 7f66a6d10640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0113d20 con 0x7f66a00fcf80 2024-09-19T09:44:35.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.792+0000 7f66a6d10640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a010d160 con 0x7f66a00fb810 2024-09-19T09:44:35.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.792+0000 7f669ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a00fcf80 0x7f66a0113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:35.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.792+0000 7f669ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a00fcf80 0x7f66a0113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55730/0 (socket says 172.21.15.112:55730) 2024-09-19T09:44:35.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.792+0000 7f669ffff640 1 -- 172.21.15.112:0/2638524959 learned_addr learned my addr 172.21.15.112:0/2638524959 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:44:35.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.792+0000 7f66a4aac640 1 --2- 172.21.15.112:0/2638524959 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66a00fb810 0x7f66a01131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:35.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.793+0000 7f669ffff640 1 -- 172.21.15.112:0/2638524959 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66a00fb810 msgr2=0x7f66a01131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:35.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.793+0000 7f669ffff640 1 --2- 172.21.15.112:0/2638524959 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66a00fb810 0x7f66a01131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:35.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.793+0000 7f669ffff640 1 -- 172.21.15.112:0/2638524959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6690005040 con 0x7f66a00fcf80 2024-09-19T09:44:35.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.793+0000 7f669ffff640 1 --2- 172.21.15.112:0/2638524959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a00fcf80 0x7f66a0113720 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f669400c830 tx=0x7f6694004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:35.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.793+0000 7f669d7fa640 1 -- 172.21.15.112:0/2638524959 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f669400a7d0 con 0x7f66a00fcf80 2024-09-19T09:44:35.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.793+0000 7f669d7fa640 1 -- 172.21.15.112:0/2638524959 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f669400add0 con 0x7f66a00fcf80 2024-09-19T09:44:35.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.793+0000 7f66a6d10640 1 -- 172.21.15.112:0/2638524959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a010d440 con 0x7f66a00fcf80 2024-09-19T09:44:35.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.793+0000 7f669d7fa640 1 -- 172.21.15.112:0/2638524959 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66940113a0 con 0x7f66a00fcf80 2024-09-19T09:44:35.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.793+0000 7f66a6d10640 1 -- 172.21.15.112:0/2638524959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a010d9e0 con 0x7f66a00fcf80 2024-09-19T09:44:35.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.794+0000 7f66a6d10640 1 -- 172.21.15.112:0/2638524959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a00fcbc0 con 0x7f66a00fcf80 2024-09-19T09:44:35.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.795+0000 7f669d7fa640 1 -- 172.21.15.112:0/2638524959 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6694012400 con 0x7f66a00fcf80 2024-09-19T09:44:35.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.795+0000 7f669d7fa640 1 --2- 172.21.15.112:0/2638524959 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f668806e530 0x7f66880709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:35.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.795+0000 7f669d7fa640 1 -- 172.21.15.112:0/2638524959 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f669408e2a0 con 0x7f66a00fcf80 2024-09-19T09:44:35.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.795+0000 7f66a4aac640 1 --2- 172.21.15.112:0/2638524959 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f668806e530 0x7f66880709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:35.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.796+0000 7f66a4aac640 1 --2- 172.21.15.112:0/2638524959 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f668806e530 0x7f66880709e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6690009ac0 tx=0x7f6690035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:35.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.800+0000 7f669d7fa640 1 -- 172.21.15.112:0/2638524959 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f66940573a0 con 0x7f66a00fcf80 2024-09-19T09:44:35.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.984+0000 7f66a6d10640 1 -- 172.21.15.112:0/2638524959 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f66a010e850 con 0x7f668806e530 2024-09-19T09:44:35.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.985+0000 7f669d7fa640 1 -- 172.21.15.112:0/2638524959 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f66a010e850 con 0x7f668806e530 2024-09-19T09:44:35.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.987+0000 7f66a6d10640 1 -- 172.21.15.112:0/2638524959 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f668806e530 msgr2=0x7f66880709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:35.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.987+0000 7f66a6d10640 1 --2- 172.21.15.112:0/2638524959 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f668806e530 0x7f66880709e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6690009ac0 tx=0x7f6690035040 comp rx=0 tx=0).stop 2024-09-19T09:44:35.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.987+0000 7f66a6d10640 1 -- 172.21.15.112:0/2638524959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a00fcf80 msgr2=0x7f66a0113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:35.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.987+0000 7f66a6d10640 1 --2- 172.21.15.112:0/2638524959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a00fcf80 0x7f66a0113720 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f669400c830 tx=0x7f6694004430 comp rx=0 tx=0).stop 2024-09-19T09:44:35.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.988+0000 7f66a6d10640 1 -- 172.21.15.112:0/2638524959 shutdown_connections 2024-09-19T09:44:35.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.988+0000 7f66a6d10640 1 --2- 172.21.15.112:0/2638524959 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f668806e530 0x7f66880709e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:35.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.988+0000 7f66a6d10640 1 --2- 172.21.15.112:0/2638524959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a00fcf80 0x7f66a0113720 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:35.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.988+0000 7f66a6d10640 1 --2- 172.21.15.112:0/2638524959 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66a00fb810 0x7f66a01131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:35.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.988+0000 7f66a6d10640 1 -- 172.21.15.112:0/2638524959 >> 172.21.15.112:0/2638524959 conn(0x7f66a00723b0 msgr2=0x7f66a00fa8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:35.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.988+0000 7f66a6d10640 1 -- 172.21.15.112:0/2638524959 shutdown_connections 2024-09-19T09:44:35.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:35.988+0000 7f66a6d10640 1 -- 172.21.15.112:0/2638524959 wait complete. 2024-09-19T09:44:36.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:35 smithi112 ceph-mon[97503]: pgmap v219: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-19T09:44:36.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:35 smithi191 ceph-mon[77624]: pgmap v219: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-19T09:44:36.677 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch ps' 2024-09-19T09:44:36.968 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:44:37.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:36 smithi112 ceph-mon[97503]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:37.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:36 smithi191 ceph-mon[77624]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:38.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:37 smithi112 ceph-mon[97503]: pgmap v220: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 4.9 MiB/s rd, 2 op/s 2024-09-19T09:44:38.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:37 smithi191 ceph-mon[77624]: pgmap v220: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 4.9 MiB/s rd, 2 op/s 2024-09-19T09:44:38.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.646+0000 7fc6cd4d8640 1 -- 172.21.15.112:0/2704632060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c8101db0 msgr2=0x7fc6c80fb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:38.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.646+0000 7fc6cd4d8640 1 --2- 172.21.15.112:0/2704632060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c8101db0 0x7fc6c80fb440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0048d0 tx=0x7fc6bc009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:38.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.646+0000 7fc6cd4d8640 1 -- 172.21.15.112:0/2704632060 shutdown_connections 2024-09-19T09:44:38.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.646+0000 7fc6cd4d8640 1 --2- 172.21.15.112:0/2704632060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c8101db0 0x7fc6c80fb440 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:38.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.646+0000 7fc6cd4d8640 1 --2- 172.21.15.112:0/2704632060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6c8101410 0x7fc6c81017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:38.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.646+0000 7fc6cd4d8640 1 -- 172.21.15.112:0/2704632060 >> 172.21.15.112:0/2704632060 conn(0x7fc6c80f7000 msgr2=0x7fc6c80f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:38.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.646+0000 7fc6cd4d8640 1 -- 172.21.15.112:0/2704632060 shutdown_connections 2024-09-19T09:44:38.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.646+0000 7fc6cd4d8640 1 -- 172.21.15.112:0/2704632060 wait complete. 2024-09-19T09:44:38.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.647+0000 7fc6cd4d8640 1 Processor -- start 2024-09-19T09:44:38.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.647+0000 7fc6cd4d8640 1 -- start start 2024-09-19T09:44:38.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.647+0000 7fc6cd4d8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c8101410 0x7fc6c8112060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:38.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.647+0000 7fc6cd4d8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6c8101db0 0x7fc6c81125a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:38.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.647+0000 7fc6cd4d8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8112ba0 con 0x7fc6c8101410 2024-09-19T09:44:38.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.647+0000 7fc6cd4d8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c810bfe0 con 0x7fc6c8101db0 2024-09-19T09:44:38.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.647+0000 7fc6c6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c8101410 0x7fc6c8112060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:38.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.647+0000 7fc6c6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c8101410 0x7fc6c8112060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48118/0 (socket says 172.21.15.112:48118) 2024-09-19T09:44:38.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.647+0000 7fc6c6ffd640 1 -- 172.21.15.112:0/1773991539 learned_addr learned my addr 172.21.15.112:0/1773991539 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:44:38.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.648+0000 7fc6c67fc640 1 --2- 172.21.15.112:0/1773991539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6c8101db0 0x7fc6c81125a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:38.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.648+0000 7fc6c6ffd640 1 -- 172.21.15.112:0/1773991539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6c8101db0 msgr2=0x7fc6c81125a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:38.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.648+0000 7fc6c6ffd640 1 --2- 172.21.15.112:0/1773991539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6c8101db0 0x7fc6c81125a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:38.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.648+0000 7fc6c6ffd640 1 -- 172.21.15.112:0/1773991539 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc005040 con 0x7fc6c8101410 2024-09-19T09:44:38.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.648+0000 7fc6c67fc640 1 --2- 172.21.15.112:0/1773991539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6c8101db0 0x7fc6c81125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:44:38.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.648+0000 7fc6c6ffd640 1 --2- 172.21.15.112:0/1773991539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c8101410 0x7fc6c8112060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8002a50 tx=0x7fc6b8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.648+0000 7fc6af7fe640 1 -- 172.21.15.112:0/1773991539 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6b8007c30 con 0x7fc6c8101410 2024-09-19T09:44:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.648+0000 7fc6af7fe640 1 -- 172.21.15.112:0/1773991539 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc6b800f040 con 0x7fc6c8101410 2024-09-19T09:44:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.648+0000 7fc6cd4d8640 1 -- 172.21.15.112:0/1773991539 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c810c2c0 con 0x7fc6c8101410 2024-09-19T09:44:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.648+0000 7fc6af7fe640 1 -- 172.21.15.112:0/1773991539 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6b800db50 con 0x7fc6c8101410 2024-09-19T09:44:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.648+0000 7fc6cd4d8640 1 -- 172.21.15.112:0/1773991539 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c810c860 con 0x7fc6c8101410 2024-09-19T09:44:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.649+0000 7fc6cd4d8640 1 -- 172.21.15.112:0/1773991539 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c80fcb80 con 0x7fc6c8101410 2024-09-19T09:44:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.650+0000 7fc6af7fe640 1 -- 172.21.15.112:0/1773991539 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc6b800dcb0 con 0x7fc6c8101410 2024-09-19T09:44:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.650+0000 7fc6af7fe640 1 --2- 172.21.15.112:0/1773991539 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc6b006e530 0x7fc6b00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.650+0000 7fc6af7fe640 1 -- 172.21.15.112:0/1773991539 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7fc6b808e270 con 0x7fc6c8101410 2024-09-19T09:44:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.650+0000 7fc6c67fc640 1 --2- 172.21.15.112:0/1773991539 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc6b006e530 0x7fc6b00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.651+0000 7fc6c67fc640 1 --2- 172.21.15.112:0/1773991539 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc6b006e530 0x7fc6b00709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00b020 tx=0x7fc6bc009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.655+0000 7fc6af7fe640 1 -- 172.21.15.112:0/1773991539 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc6b8057250 con 0x7fc6c8101410 2024-09-19T09:44:38.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.831+0000 7fc6cd4d8640 1 -- 172.21.15.112:0/1773991539 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6c804b750 con 0x7fc6b006e530 2024-09-19T09:44:38.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.840+0000 7fc6af7fe640 1 -- 172.21.15.112:0/1773991539 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fc6c804b750 con 0x7fc6b006e530 2024-09-19T09:44:38.842 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:44:38.842 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (8m) 55s ago 17m 26.7M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:44:38.842 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (4m) 55s ago 17m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 70bad8ff6ec4 2024-09-19T09:44:38.842 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (4m) 25s ago 16m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 6f8cb10f4c96 2024-09-19T09:44:38.842 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (7m) 55s ago 17m 75.4M - 9.4.12 2bacad6d85d8 e462aca2b022 2024-09-19T09:44:38.842 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (60s) 55s ago 12m 14.1M - 19.1.1-361-g2f599a46 d2baa855c067 3267e6b8a90d 2024-09-19T09:44:38.842 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (82s) 55s ago 12m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 3964ad1a1679 2024-09-19T09:44:38.842 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (45s) 25s ago 12m 12.1M - 19.1.1-361-g2f599a46 d2baa855c067 8ee53b5b95cf 2024-09-19T09:44:38.842 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (27s) 25s ago 12m 15.2M - 19.1.1-361-g2f599a46 d2baa855c067 6dfc4559157f 2024-09-19T09:44:38.843 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (8m) 55s ago 18m 505M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:44:38.843 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283,8765 running (7m) 25s ago 16m 442M - 19.1.1-361-g2f599a46 d2baa855c067 fddba1bee64a 2024-09-19T09:44:38.843 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (5m) 55s ago 18m 49.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 89dfb5de44c8 2024-09-19T09:44:38.843 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (5m) 25s ago 16m 41.0M 2048M 19.1.1-361-g2f599a46 d2baa855c067 3cab8f7cc27e 2024-09-19T09:44:38.843 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (9m) 55s ago 17m 15.5M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:44:38.843 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (8m) 25s ago 16m 15.9M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:44:38.843 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (4m) 55s ago 15m 153M 1557M 19.1.1-361-g2f599a46 d2baa855c067 11a51e663887 2024-09-19T09:44:38.843 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (3m) 55s ago 15m 200M 1557M 19.1.1-361-g2f599a46 d2baa855c067 bd616fcb189b 2024-09-19T09:44:38.843 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (3m) 55s ago 14m 166M 1557M 19.1.1-361-g2f599a46 d2baa855c067 4a651b62590f 2024-09-19T09:44:38.843 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (2m) 25s ago 14m 124M 2581M 19.1.1-361-g2f599a46 d2baa855c067 7f953c691608 2024-09-19T09:44:38.843 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (2m) 25s ago 14m 141M 2581M 19.1.1-361-g2f599a46 d2baa855c067 3cd638400a3a 2024-09-19T09:44:38.843 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (99s) 25s ago 13m 123M 2581M 19.1.1-361-g2f599a46 d2baa855c067 901aaba16a54 2024-09-19T09:44:38.844 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (7m) 55s ago 17m 63.7M - 2.43.0 a07b618ecd1d 54850883a171 2024-09-19T09:44:38.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.842+0000 7fc6cd4d8640 1 -- 172.21.15.112:0/1773991539 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc6b006e530 msgr2=0x7fc6b00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:38.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.842+0000 7fc6cd4d8640 1 --2- 172.21.15.112:0/1773991539 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc6b006e530 0x7fc6b00709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00b020 tx=0x7fc6bc009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:38.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.842+0000 7fc6cd4d8640 1 -- 172.21.15.112:0/1773991539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c8101410 msgr2=0x7fc6c8112060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:38.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.842+0000 7fc6cd4d8640 1 --2- 172.21.15.112:0/1773991539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c8101410 0x7fc6c8112060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8002a50 tx=0x7fc6b8004600 comp rx=0 tx=0).stop 2024-09-19T09:44:38.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.842+0000 7fc6cd4d8640 1 -- 172.21.15.112:0/1773991539 shutdown_connections 2024-09-19T09:44:38.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.842+0000 7fc6cd4d8640 1 --2- 172.21.15.112:0/1773991539 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fc6b006e530 0x7fc6b00709e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:38.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.842+0000 7fc6cd4d8640 1 --2- 172.21.15.112:0/1773991539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6c8101db0 0x7fc6c81125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:38.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.842+0000 7fc6cd4d8640 1 --2- 172.21.15.112:0/1773991539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c8101410 0x7fc6c8112060 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:38.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.842+0000 7fc6cd4d8640 1 -- 172.21.15.112:0/1773991539 >> 172.21.15.112:0/1773991539 conn(0x7fc6c80f7000 msgr2=0x7fc6c80f8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:38.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.842+0000 7fc6cd4d8640 1 -- 172.21.15.112:0/1773991539 shutdown_connections 2024-09-19T09:44:38.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:38.843+0000 7fc6cd4d8640 1 -- 172.21.15.112:0/1773991539 wait complete. 2024-09-19T09:44:39.532 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch upgrade status' 2024-09-19T09:44:39.778 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:44:40.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:39 smithi112 ceph-mon[97503]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:40.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:39 smithi112 ceph-mon[97503]: pgmap v221: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 2 op/s 2024-09-19T09:44:40.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:39 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:44:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:39 smithi191 ceph-mon[77624]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:39 smithi191 ceph-mon[77624]: pgmap v221: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 2 op/s 2024-09-19T09:44:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:39 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:44:41.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.452+0000 7ff3567c2640 1 -- 172.21.15.112:0/4185271362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff350064fc0 msgr2=0x7ff350065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:41.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.452+0000 7ff3567c2640 1 --2- 172.21.15.112:0/4185271362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff350064fc0 0x7ff350065430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff3440048d0 tx=0x7ff344009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.452+0000 7ff3567c2640 1 -- 172.21.15.112:0/4185271362 shutdown_connections 2024-09-19T09:44:41.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.452+0000 7ff3567c2640 1 --2- 172.21.15.112:0/4185271362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff350064fc0 0x7ff350065430 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.452+0000 7ff3567c2640 1 --2- 172.21.15.112:0/4185271362 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3500fe460 0x7ff3500fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.452+0000 7ff3567c2640 1 -- 172.21.15.112:0/4185271362 >> 172.21.15.112:0/4185271362 conn(0x7ff3500723b0 msgr2=0x7ff3500727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:41.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.452+0000 7ff3567c2640 1 -- 172.21.15.112:0/4185271362 shutdown_connections 2024-09-19T09:44:41.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.452+0000 7ff3567c2640 1 -- 172.21.15.112:0/4185271362 wait complete. 2024-09-19T09:44:41.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.452+0000 7ff3567c2640 1 Processor -- start 2024-09-19T09:44:41.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.453+0000 7ff3567c2640 1 -- start start 2024-09-19T09:44:41.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.453+0000 7ff3567c2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff350064fc0 0x7ff3501131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.453+0000 7ff3567c2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3500fe460 0x7ff350113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.453+0000 7ff3567c2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff350113d10 con 0x7ff3500fe460 2024-09-19T09:44:41.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.453+0000 7ff3567c2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35010d1a0 con 0x7ff350064fc0 2024-09-19T09:44:41.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.453+0000 7ff34f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3500fe460 0x7ff350113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.453+0000 7ff34f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3500fe460 0x7ff350113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48140/0 (socket says 172.21.15.112:48140) 2024-09-19T09:44:41.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.453+0000 7ff34f7fe640 1 -- 172.21.15.112:0/1960250933 learned_addr learned my addr 172.21.15.112:0/1960250933 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:44:41.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.453+0000 7ff34ffff640 1 --2- 172.21.15.112:0/1960250933 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff350064fc0 0x7ff3501131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.453+0000 7ff34f7fe640 1 -- 172.21.15.112:0/1960250933 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff350064fc0 msgr2=0x7ff3501131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:41.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.453+0000 7ff34f7fe640 1 --2- 172.21.15.112:0/1960250933 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff350064fc0 0x7ff3501131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.453+0000 7ff34f7fe640 1 -- 172.21.15.112:0/1960250933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff344005040 con 0x7ff3500fe460 2024-09-19T09:44:41.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.454+0000 7ff34f7fe640 1 --2- 172.21.15.112:0/1960250933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3500fe460 0x7ff350113710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff344000c00 tx=0x7ff344009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:41.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.454+0000 7ff34cff9640 1 -- 172.21.15.112:0/1960250933 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff344038070 con 0x7ff3500fe460 2024-09-19T09:44:41.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.454+0000 7ff34cff9640 1 -- 172.21.15.112:0/1960250933 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff34402ade0 con 0x7ff3500fe460 2024-09-19T09:44:41.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.454+0000 7ff3567c2640 1 -- 172.21.15.112:0/1960250933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35010d420 con 0x7ff3500fe460 2024-09-19T09:44:41.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.454+0000 7ff34cff9640 1 -- 172.21.15.112:0/1960250933 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff34402c7e0 con 0x7ff3500fe460 2024-09-19T09:44:41.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.454+0000 7ff3567c2640 1 -- 172.21.15.112:0/1960250933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35010d960 con 0x7ff3500fe460 2024-09-19T09:44:41.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.455+0000 7ff3567c2640 1 -- 172.21.15.112:0/1960250933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3500fdcf0 con 0x7ff3500fe460 2024-09-19T09:44:41.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.455+0000 7ff34cff9640 1 -- 172.21.15.112:0/1960250933 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff344030020 con 0x7ff3500fe460 2024-09-19T09:44:41.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.456+0000 7ff34cff9640 1 --2- 172.21.15.112:0/1960250933 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff33806e530 0x7ff3380709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.456+0000 7ff34cff9640 1 -- 172.21.15.112:0/1960250933 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7ff3440adfa0 con 0x7ff3500fe460 2024-09-19T09:44:41.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.456+0000 7ff34ffff640 1 --2- 172.21.15.112:0/1960250933 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff33806e530 0x7ff3380709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.456+0000 7ff34ffff640 1 --2- 172.21.15.112:0/1960250933 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff33806e530 0x7ff3380709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff340004ce0 tx=0x7ff34000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:41.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.460+0000 7ff34cff9640 1 -- 172.21.15.112:0/1960250933 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff344076f90 con 0x7ff3500fe460 2024-09-19T09:44:41.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.641+0000 7ff3567c2640 1 -- 172.21.15.112:0/1960250933 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff35010e870 con 0x7ff33806e530 2024-09-19T09:44:41.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.642+0000 7ff34cff9640 1 -- 172.21.15.112:0/1960250933 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7ff35010e870 con 0x7ff33806e530 2024-09-19T09:44:41.644 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:44:41.644 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": null, 2024-09-19T09:44:41.644 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": false, 2024-09-19T09:44:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "", 2024-09-19T09:44:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [], 2024-09-19T09:44:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": null, 2024-09-19T09:44:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "", 2024-09-19T09:44:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-19T09:44:41.645 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:44:41.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.644+0000 7ff3567c2640 1 -- 172.21.15.112:0/1960250933 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff33806e530 msgr2=0x7ff3380709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:41.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.644+0000 7ff3567c2640 1 --2- 172.21.15.112:0/1960250933 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff33806e530 0x7ff3380709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff340004ce0 tx=0x7ff34000b040 comp rx=0 tx=0).stop 2024-09-19T09:44:41.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.644+0000 7ff3567c2640 1 -- 172.21.15.112:0/1960250933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3500fe460 msgr2=0x7ff350113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:41.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.644+0000 7ff3567c2640 1 --2- 172.21.15.112:0/1960250933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3500fe460 0x7ff350113710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff344000c00 tx=0x7ff344009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.645+0000 7ff3567c2640 1 -- 172.21.15.112:0/1960250933 shutdown_connections 2024-09-19T09:44:41.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.645+0000 7ff3567c2640 1 --2- 172.21.15.112:0/1960250933 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff33806e530 0x7ff3380709e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.645+0000 7ff3567c2640 1 --2- 172.21.15.112:0/1960250933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3500fe460 0x7ff350113710 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.645+0000 7ff3567c2640 1 --2- 172.21.15.112:0/1960250933 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff350064fc0 0x7ff3501131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.645+0000 7ff3567c2640 1 -- 172.21.15.112:0/1960250933 >> 172.21.15.112:0/1960250933 conn(0x7ff3500723b0 msgr2=0x7ff3501053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:41.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.645+0000 7ff3567c2640 1 -- 172.21.15.112:0/1960250933 shutdown_connections 2024-09-19T09:44:41.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:41.645+0000 7ff3567c2640 1 -- 172.21.15.112:0/1960250933 wait complete. 2024-09-19T09:44:42.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:41 smithi112 ceph-mon[97503]: pgmap v222: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 1 op/s 2024-09-19T09:44:42.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:41 smithi191 ceph-mon[77624]: pgmap v222: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 1 op/s 2024-09-19T09:44:42.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph health detail' 2024-09-19T09:44:42.581 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:44:43.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:42 smithi112 ceph-mon[97503]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:43.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:42 smithi191 ceph-mon[77624]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:44.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:43 smithi112 ceph-mon[97503]: pgmap v223: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:44:44.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:43 smithi191 ceph-mon[77624]: pgmap v223: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:44:44.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.416+0000 7f43a54d1640 1 -- 172.21.15.112:0/2613037986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43a0102ef0 msgr2=0x7f43a00fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:44.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.416+0000 7f43a54d1640 1 --2- 172.21.15.112:0/2613037986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43a0102ef0 0x7f43a00fc5b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f43880048d0 tx=0x7f4388009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:44.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.416+0000 7f43a54d1640 1 -- 172.21.15.112:0/2613037986 shutdown_connections 2024-09-19T09:44:44.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.416+0000 7f43a54d1640 1 --2- 172.21.15.112:0/2613037986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43a0102ef0 0x7f43a00fc5b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:44.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.416+0000 7f43a54d1640 1 --2- 172.21.15.112:0/2613037986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43a0102550 0x7f43a0102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:44.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.416+0000 7f43a54d1640 1 -- 172.21.15.112:0/2613037986 >> 172.21.15.112:0/2613037986 conn(0x7f43a00f80f0 msgr2=0x7f43a00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:44.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.416+0000 7f43a54d1640 1 -- 172.21.15.112:0/2613037986 shutdown_connections 2024-09-19T09:44:44.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.416+0000 7f43a54d1640 1 -- 172.21.15.112:0/2613037986 wait complete. 2024-09-19T09:44:44.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.416+0000 7f43a54d1640 1 Processor -- start 2024-09-19T09:44:44.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.416+0000 7f43a54d1640 1 -- start start 2024-09-19T09:44:44.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f43a54d1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43a0102550 0x7f43a006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:44.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f43a54d1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43a0102ef0 0x7f43a006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:44.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f43a54d1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a0070520 con 0x7f43a0102ef0 2024-09-19T09:44:44.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f43a54d1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a0070690 con 0x7f43a0102550 2024-09-19T09:44:44.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f4397fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43a0102ef0 0x7f43a006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:44.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f4397fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43a0102ef0 0x7f43a006ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48172/0 (socket says 172.21.15.112:48172) 2024-09-19T09:44:44.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f4397fff640 1 -- 172.21.15.112:0/2688921965 learned_addr learned my addr 172.21.15.112:0/2688921965 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:44:44.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f439effd640 1 --2- 172.21.15.112:0/2688921965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43a0102550 0x7f43a006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:44.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f4397fff640 1 -- 172.21.15.112:0/2688921965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43a0102550 msgr2=0x7f43a006fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:44.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f4397fff640 1 --2- 172.21.15.112:0/2688921965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43a0102550 0x7f43a006fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:44.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f4397fff640 1 -- 172.21.15.112:0/2688921965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4388005040 con 0x7f43a0102ef0 2024-09-19T09:44:44.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f4397fff640 1 --2- 172.21.15.112:0/2688921965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43a0102ef0 0x7f43a006ff50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4388003080 tx=0x7f4388009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:44.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f43977fe640 1 -- 172.21.15.112:0/2688921965 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4388038070 con 0x7f43a0102ef0 2024-09-19T09:44:44.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f43a54d1640 1 -- 172.21.15.112:0/2688921965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a01198d0 con 0x7f43a0102ef0 2024-09-19T09:44:44.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f43977fe640 1 -- 172.21.15.112:0/2688921965 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4388009760 con 0x7f43a0102ef0 2024-09-19T09:44:44.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f43977fe640 1 -- 172.21.15.112:0/2688921965 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f438803d420 con 0x7f43a0102ef0 2024-09-19T09:44:44.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.417+0000 7f43a54d1640 1 -- 172.21.15.112:0/2688921965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a0119c50 con 0x7f43a0102ef0 2024-09-19T09:44:44.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.418+0000 7f43a54d1640 1 -- 172.21.15.112:0/2688921965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a00fdcd0 con 0x7f43a0102ef0 2024-09-19T09:44:44.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.419+0000 7f43977fe640 1 -- 172.21.15.112:0/2688921965 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4388030020 con 0x7f43a0102ef0 2024-09-19T09:44:44.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.419+0000 7f43977fe640 1 --2- 172.21.15.112:0/2688921965 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f438c06e530 0x7f438c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:44.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.419+0000 7f43977fe640 1 -- 172.21.15.112:0/2688921965 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f43880ae7a0 con 0x7f43a0102ef0 2024-09-19T09:44:44.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.419+0000 7f439effd640 1 --2- 172.21.15.112:0/2688921965 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f438c06e530 0x7f438c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:44.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.420+0000 7f439effd640 1 --2- 172.21.15.112:0/2688921965 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f438c06e530 0x7f438c0709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4390006fd0 tx=0x7f4390008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:44.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.424+0000 7f43977fe640 1 -- 172.21.15.112:0/2688921965 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4388077780 con 0x7f43a0102ef0 2024-09-19T09:44:44.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.667+0000 7f43a54d1640 1 -- 172.21.15.112:0/2688921965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f43a004b720 con 0x7f43a0102ef0 2024-09-19T09:44:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.667+0000 7f43977fe640 1 -- 172.21.15.112:0/2688921965 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f438807ae40 con 0x7f43a0102ef0 2024-09-19T09:44:44.670 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_OK 2024-09-19T09:44:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.669+0000 7f43a54d1640 1 -- 172.21.15.112:0/2688921965 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f438c06e530 msgr2=0x7f438c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.669+0000 7f43a54d1640 1 --2- 172.21.15.112:0/2688921965 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f438c06e530 0x7f438c0709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4390006fd0 tx=0x7f4390008040 comp rx=0 tx=0).stop 2024-09-19T09:44:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.669+0000 7f43a54d1640 1 -- 172.21.15.112:0/2688921965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43a0102ef0 msgr2=0x7f43a006ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.669+0000 7f43a54d1640 1 --2- 172.21.15.112:0/2688921965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43a0102ef0 0x7f43a006ff50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4388003080 tx=0x7f4388009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.669+0000 7f43a54d1640 1 -- 172.21.15.112:0/2688921965 shutdown_connections 2024-09-19T09:44:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.669+0000 7f43a54d1640 1 --2- 172.21.15.112:0/2688921965 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f438c06e530 0x7f438c0709e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.669+0000 7f43a54d1640 1 --2- 172.21.15.112:0/2688921965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43a0102ef0 0x7f43a006ff50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.669+0000 7f43a54d1640 1 --2- 172.21.15.112:0/2688921965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43a0102550 0x7f43a006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.670+0000 7f43a54d1640 1 -- 172.21.15.112:0/2688921965 >> 172.21.15.112:0/2688921965 conn(0x7f43a00f80f0 msgr2=0x7f43a00f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.670+0000 7f43a54d1640 1 -- 172.21.15.112:0/2688921965 shutdown_connections 2024-09-19T09:44:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:44.670+0000 7f43a54d1640 1 -- 172.21.15.112:0/2688921965 wait complete. 2024-09-19T09:44:45.211 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:44 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2688921965' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:44:45.235 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions' 2024-09-19T09:44:45.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:44 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2688921965' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:44:45.481 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:44:46.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:45 smithi112 ceph-mon[97503]: pgmap v224: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:44:46.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:45 smithi191 ceph-mon[77624]: pgmap v224: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:44:47.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.076+0000 7f34d622e640 1 -- 172.21.15.112:0/2401221295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d00fbef0 msgr2=0x7f34d0100370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:47.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.076+0000 7f34d622e640 1 --2- 172.21.15.112:0/2401221295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d00fbef0 0x7f34d0100370 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f34c40048d0 tx=0x7f34c4009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.076+0000 7f34d622e640 1 -- 172.21.15.112:0/2401221295 shutdown_connections 2024-09-19T09:44:47.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.076+0000 7f34d622e640 1 --2- 172.21.15.112:0/2401221295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d00fbef0 0x7f34d0100370 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.076+0000 7f34d622e640 1 --2- 172.21.15.112:0/2401221295 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34d00fb550 0x7f34d00fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.076+0000 7f34d622e640 1 -- 172.21.15.112:0/2401221295 >> 172.21.15.112:0/2401221295 conn(0x7f34d00f7030 msgr2=0x7f34d00f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:47.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.076+0000 7f34d622e640 1 -- 172.21.15.112:0/2401221295 shutdown_connections 2024-09-19T09:44:47.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.076+0000 7f34d622e640 1 -- 172.21.15.112:0/2401221295 wait complete. 2024-09-19T09:44:47.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.077+0000 7f34d622e640 1 Processor -- start 2024-09-19T09:44:47.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.077+0000 7f34d622e640 1 -- start start 2024-09-19T09:44:47.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.077+0000 7f34d622e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34d00fb550 0x7f34d0119990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.077+0000 7f34d622e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d00fbef0 0x7f34d0119ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.077+0000 7f34d622e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d011a520 con 0x7f34d00fbef0 2024-09-19T09:44:47.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.077+0000 7f34d622e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d0113930 con 0x7f34d00fb550 2024-09-19T09:44:47.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.077+0000 7f34ceffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d00fbef0 0x7f34d0119ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.077+0000 7f34ceffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d00fbef0 0x7f34d0119ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48194/0 (socket says 172.21.15.112:48194) 2024-09-19T09:44:47.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.077+0000 7f34ceffd640 1 -- 172.21.15.112:0/4253762826 learned_addr learned my addr 172.21.15.112:0/4253762826 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:44:47.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.078+0000 7f34cf7fe640 1 --2- 172.21.15.112:0/4253762826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34d00fb550 0x7f34d0119990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.078+0000 7f34ceffd640 1 -- 172.21.15.112:0/4253762826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34d00fb550 msgr2=0x7f34d0119990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:47.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.078+0000 7f34ceffd640 1 --2- 172.21.15.112:0/4253762826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34d00fb550 0x7f34d0119990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.078+0000 7f34ceffd640 1 -- 172.21.15.112:0/4253762826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c4005040 con 0x7f34d00fbef0 2024-09-19T09:44:47.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.078+0000 7f34cf7fe640 1 --2- 172.21.15.112:0/4253762826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34d00fb550 0x7f34d0119990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:44:47.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.078+0000 7f34ceffd640 1 --2- 172.21.15.112:0/4253762826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d00fbef0 0x7f34d0119ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f34c4003080 tx=0x7f34c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:47.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.078+0000 7f34b7fff640 1 -- 172.21.15.112:0/4253762826 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34c4038070 con 0x7f34d00fbef0 2024-09-19T09:44:47.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.078+0000 7f34b7fff640 1 -- 172.21.15.112:0/4253762826 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f34c4009760 con 0x7f34d00fbef0 2024-09-19T09:44:47.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.078+0000 7f34d622e640 1 -- 172.21.15.112:0/4253762826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d0113bb0 con 0x7f34d00fbef0 2024-09-19T09:44:47.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.078+0000 7f34b7fff640 1 -- 172.21.15.112:0/4253762826 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34c4033420 con 0x7f34d00fbef0 2024-09-19T09:44:47.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.078+0000 7f34d622e640 1 -- 172.21.15.112:0/4253762826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d0114010 con 0x7f34d00fbef0 2024-09-19T09:44:47.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.079+0000 7f34d622e640 1 -- 172.21.15.112:0/4253762826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d00fac90 con 0x7f34d00fbef0 2024-09-19T09:44:47.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.080+0000 7f34b7fff640 1 -- 172.21.15.112:0/4253762826 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f34c4030020 con 0x7f34d00fbef0 2024-09-19T09:44:47.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.080+0000 7f34b7fff640 1 --2- 172.21.15.112:0/4253762826 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f34b806e530 0x7f34b80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.080+0000 7f34cf7fe640 1 --2- 172.21.15.112:0/4253762826 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f34b806e530 0x7f34b80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.080+0000 7f34b7fff640 1 -- 172.21.15.112:0/4253762826 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f34c40ae060 con 0x7f34d00fbef0 2024-09-19T09:44:47.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.080+0000 7f34cf7fe640 1 --2- 172.21.15.112:0/4253762826 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f34b806e530 0x7f34b80709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f34c0004c80 tx=0x7f34c0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:47.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.084+0000 7f34b7fff640 1 -- 172.21.15.112:0/4253762826 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f34c4077040 con 0x7f34d00fbef0 2024-09-19T09:44:47.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.316+0000 7f34d622e640 1 -- 172.21.15.112:0/4253762826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f34d004b720 con 0x7f34d00fbef0 2024-09-19T09:44:47.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.316+0000 7f34b7fff640 1 -- 172.21.15.112:0/4253762826 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f34c407a700 con 0x7f34d00fbef0 2024-09-19T09:44:47.318 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:44:47.319 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:44:47.319 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:44:47.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:44:47.319 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:44:47.319 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:44:47.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:44:47.319 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:44:47.319 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T09:44:47.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:44:47.319 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:44:47.319 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T09:44:47.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:44:47.319 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:44:47.320 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T09:44:47.320 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:44:47.320 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:44:47.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.318+0000 7f34d622e640 1 -- 172.21.15.112:0/4253762826 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f34b806e530 msgr2=0x7f34b80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:47.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.318+0000 7f34d622e640 1 --2- 172.21.15.112:0/4253762826 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f34b806e530 0x7f34b80709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f34c0004c80 tx=0x7f34c0009040 comp rx=0 tx=0).stop 2024-09-19T09:44:47.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.318+0000 7f34d622e640 1 -- 172.21.15.112:0/4253762826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d00fbef0 msgr2=0x7f34d0119ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:47.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.318+0000 7f34d622e640 1 --2- 172.21.15.112:0/4253762826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d00fbef0 0x7f34d0119ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f34c4003080 tx=0x7f34c4009da0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.318+0000 7f34d622e640 1 -- 172.21.15.112:0/4253762826 shutdown_connections 2024-09-19T09:44:47.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.318+0000 7f34d622e640 1 --2- 172.21.15.112:0/4253762826 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f34b806e530 0x7f34b80709e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.318+0000 7f34d622e640 1 --2- 172.21.15.112:0/4253762826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d00fbef0 0x7f34d0119ed0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.318+0000 7f34d622e640 1 --2- 172.21.15.112:0/4253762826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34d00fb550 0x7f34d0119990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.318+0000 7f34d622e640 1 -- 172.21.15.112:0/4253762826 >> 172.21.15.112:0/4253762826 conn(0x7f34d00f7030 msgr2=0x7f34d00f8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:47.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.319+0000 7f34d622e640 1 -- 172.21.15.112:0/4253762826 shutdown_connections 2024-09-19T09:44:47.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:44:47.319+0000 7f34d622e640 1 -- 172.21.15.112:0/4253762826 wait complete. 2024-09-19T09:44:47.967 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-19T09:44:48.212 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:44:48.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:47 smithi191 ceph-mon[77624]: pgmap v225: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:44:48.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:47 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/4253762826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:48.332 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:47 smithi112 ceph-mon[97503]: pgmap v225: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:44:48.333 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:47 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/4253762826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:44:49.851 INFO:teuthology.orchestra.run.smithi112.stdout:wait for servicemap items w/ changing names to refresh 2024-09-19T09:44:50.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:49 smithi191 ceph-mon[77624]: pgmap v226: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:44:50.337 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:49 smithi112 ceph-mon[97503]: pgmap v226: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:44:50.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'sleep 60' 2024-09-19T09:44:50.832 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:44:52.235 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:51 smithi112 ceph-mon[97503]: pgmap v227: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:44:52.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:51 smithi191 ceph-mon[77624]: pgmap v227: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:44:54.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:53 smithi191 ceph-mon[77624]: pgmap v228: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:44:54.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:53 smithi112 ceph-mon[97503]: pgmap v228: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:44:55.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:44:55.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:44:56.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:55 smithi191 ceph-mon[77624]: pgmap v229: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:44:56.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:55 smithi112 ceph-mon[97503]: pgmap v229: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:44:58.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:57 smithi191 ceph-mon[77624]: pgmap v230: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:44:58.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:57 smithi112 ceph-mon[97503]: pgmap v230: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:00.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:44:59 smithi191 ceph-mon[77624]: pgmap v231: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:45:00.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:44:59 smithi112 ceph-mon[97503]: pgmap v231: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:45:02.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:01 smithi191 ceph-mon[77624]: pgmap v232: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:02.315 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:01 smithi112 ceph-mon[97503]: pgmap v232: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:04.287 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:03 smithi191 ceph-mon[77624]: pgmap v233: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:04.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:03 smithi112 ceph-mon[97503]: pgmap v233: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:06.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:05 smithi191 ceph-mon[77624]: pgmap v234: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:06.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:05 smithi112 ceph-mon[97503]: pgmap v234: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:08.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:07 smithi191 ceph-mon[77624]: pgmap v235: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:08.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:07 smithi112 ceph-mon[97503]: pgmap v235: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:09 smithi191 ceph-mon[77624]: pgmap v236: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:45:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:45:10.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:09 smithi112 ceph-mon[97503]: pgmap v236: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:45:10.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:45:12.241 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:11 smithi112 ceph-mon[97503]: pgmap v237: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:12.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:11 smithi191 ceph-mon[77624]: pgmap v237: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:14.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:13 smithi191 ceph-mon[77624]: pgmap v238: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:14.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:13 smithi112 ceph-mon[97503]: pgmap v238: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:16.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:15 smithi191 ceph-mon[77624]: pgmap v239: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:16.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:15 smithi112 ceph-mon[97503]: pgmap v239: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:18.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:17 smithi191 ceph-mon[77624]: pgmap v240: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:18.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:17 smithi112 ceph-mon[97503]: pgmap v240: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:20.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:19 smithi191 ceph-mon[77624]: pgmap v241: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:45:20.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:19 smithi112 ceph-mon[97503]: pgmap v241: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:45:21.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:20 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:20 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:20 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:20 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:45:21.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:20 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:21.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:20 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:21.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:20 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:21.440 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:20 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:45:22.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:21 smithi191 ceph-mon[77624]: pgmap v242: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:22.316 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:21 smithi112 ceph-mon[97503]: pgmap v242: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:24.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:24 smithi191 ceph-mon[77624]: pgmap v243: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:24.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:24 smithi112 ceph-mon[97503]: pgmap v243: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:25.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:25 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:45:25.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:25 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:45:26.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:26 smithi191 ceph-mon[77624]: pgmap v244: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:26.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:26 smithi112 ceph-mon[97503]: pgmap v244: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:28.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:28 smithi191 ceph-mon[77624]: pgmap v245: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:28.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:28 smithi112 ceph-mon[97503]: pgmap v245: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:30.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:30 smithi191 ceph-mon[77624]: pgmap v246: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:45:30.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:30 smithi112 ceph-mon[97503]: pgmap v246: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:45:32.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:32 smithi191 ceph-mon[77624]: pgmap v247: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:32.316 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:32 smithi112 ceph-mon[97503]: pgmap v247: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:34.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:34 smithi191 ceph-mon[77624]: pgmap v248: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:34.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:34 smithi112 ceph-mon[97503]: pgmap v248: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:36.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:36 smithi191 ceph-mon[77624]: pgmap v249: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:36.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:36 smithi112 ceph-mon[97503]: pgmap v249: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:38.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:38 smithi191 ceph-mon[77624]: pgmap v250: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:38.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:38 smithi112 ceph-mon[97503]: pgmap v250: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:40.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:40 smithi191 ceph-mon[77624]: pgmap v251: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:45:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:45:40.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:40 smithi112 ceph-mon[97503]: pgmap v251: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:45:40.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:45:42.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:42 smithi191 ceph-mon[77624]: pgmap v252: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:42.316 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:42 smithi112 ceph-mon[97503]: pgmap v252: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:44.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:44 smithi112 ceph-mon[97503]: pgmap v253: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:44.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:44 smithi191 ceph-mon[77624]: pgmap v253: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:46.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:46 smithi112 ceph-mon[97503]: pgmap v254: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:46.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:46 smithi191 ceph-mon[77624]: pgmap v254: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:48.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:48 smithi112 ceph-mon[97503]: pgmap v255: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:48.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:48 smithi191 ceph-mon[77624]: pgmap v255: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:49.939 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:49 smithi112 ceph-mon[97503]: pgmap v256: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:45:50.035 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:49 smithi191 ceph-mon[77624]: pgmap v256: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:45:52.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:51 smithi112 ceph-mon[97503]: pgmap v257: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:52.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:51 smithi191 ceph-mon[77624]: pgmap v257: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:53.172 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch ps' 2024-09-19T09:45:53.427 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:45:54.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:53 smithi112 ceph-mon[97503]: pgmap v258: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:54.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:53 smithi191 ceph-mon[77624]: pgmap v258: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:55.180 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:54 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:45:55.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.169+0000 7f9b998fd640 1 -- 172.21.15.112:0/2039671658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b940fe460 msgr2=0x7f9b940fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.169+0000 7f9b998fd640 1 --2- 172.21.15.112:0/2039671658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b940fe460 0x7f9b940fe830 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9b840048d0 tx=0x7f9b84009da0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.169+0000 7f9b998fd640 1 -- 172.21.15.112:0/2039671658 shutdown_connections 2024-09-19T09:45:55.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.169+0000 7f9b998fd640 1 --2- 172.21.15.112:0/2039671658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b94064fc0 0x7f9b94065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.169+0000 7f9b998fd640 1 --2- 172.21.15.112:0/2039671658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b940fe460 0x7f9b940fe830 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.169+0000 7f9b998fd640 1 -- 172.21.15.112:0/2039671658 >> 172.21.15.112:0/2039671658 conn(0x7f9b940723b0 msgr2=0x7f9b940727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:55.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.169+0000 7f9b998fd640 1 -- 172.21.15.112:0/2039671658 shutdown_connections 2024-09-19T09:45:55.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.169+0000 7f9b998fd640 1 -- 172.21.15.112:0/2039671658 wait complete. 2024-09-19T09:45:55.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.169+0000 7f9b998fd640 1 Processor -- start 2024-09-19T09:45:55.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.169+0000 7f9b998fd640 1 -- start start 2024-09-19T09:45:55.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.169+0000 7f9b998fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b94064fc0 0x7f9b940fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.169+0000 7f9b998fd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b940fe460 0x7f9b940fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.169+0000 7f9b998fd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940fd310 con 0x7f9b94064fc0 2024-09-19T09:45:55.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.169+0000 7f9b998fd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940fd480 con 0x7f9b940fe460 2024-09-19T09:45:55.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.170+0000 7f9b92ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b94064fc0 0x7f9b940fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.170+0000 7f9b92ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b94064fc0 0x7f9b940fb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49168/0 (socket says 172.21.15.112:49168) 2024-09-19T09:45:55.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.170+0000 7f9b92ffd640 1 -- 172.21.15.112:0/2251318046 learned_addr learned my addr 172.21.15.112:0/2251318046 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:45:55.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.170+0000 7f9b8bfff640 1 --2- 172.21.15.112:0/2251318046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b940fe460 0x7f9b940fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.170+0000 7f9b92ffd640 1 -- 172.21.15.112:0/2251318046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b940fe460 msgr2=0x7f9b940fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.170+0000 7f9b92ffd640 1 --2- 172.21.15.112:0/2251318046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b940fe460 0x7f9b940fbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.170+0000 7f9b92ffd640 1 -- 172.21.15.112:0/2251318046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b84005040 con 0x7f9b94064fc0 2024-09-19T09:45:55.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.170+0000 7f9b8bfff640 1 --2- 172.21.15.112:0/2251318046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b940fe460 0x7f9b940fbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:45:55.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.170+0000 7f9b92ffd640 1 --2- 172.21.15.112:0/2251318046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b94064fc0 0x7f9b940fb560 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9b840043d0 tx=0x7f9b84009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.170+0000 7f9b8b7fe640 1 -- 172.21.15.112:0/2251318046 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b84038070 con 0x7f9b94064fc0 2024-09-19T09:45:55.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.170+0000 7f9b998fd640 1 -- 172.21.15.112:0/2251318046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b940fc040 con 0x7f9b94064fc0 2024-09-19T09:45:55.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.170+0000 7f9b8b7fe640 1 -- 172.21.15.112:0/2251318046 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9b840096e0 con 0x7f9b94064fc0 2024-09-19T09:45:55.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.170+0000 7f9b8b7fe640 1 -- 172.21.15.112:0/2251318046 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b8403d420 con 0x7f9b94064fc0 2024-09-19T09:45:55.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.170+0000 7f9b998fd640 1 -- 172.21.15.112:0/2251318046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9411dca0 con 0x7f9b94064fc0 2024-09-19T09:45:55.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.171+0000 7f9b998fd640 1 -- 172.21.15.112:0/2251318046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b940fdcf0 con 0x7f9b94064fc0 2024-09-19T09:45:55.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.172+0000 7f9b8b7fe640 1 -- 172.21.15.112:0/2251318046 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9b84030020 con 0x7f9b94064fc0 2024-09-19T09:45:55.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.172+0000 7f9b8b7fe640 1 --2- 172.21.15.112:0/2251318046 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9b8006e530 0x7f9b800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.172+0000 7f9b8b7fe640 1 -- 172.21.15.112:0/2251318046 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f9b840ae840 con 0x7f9b94064fc0 2024-09-19T09:45:55.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.172+0000 7f9b8bfff640 1 --2- 172.21.15.112:0/2251318046 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9b8006e530 0x7f9b800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.173+0000 7f9b8bfff640 1 --2- 172.21.15.112:0/2251318046 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9b8006e530 0x7f9b800709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9b940fcea0 tx=0x7f9b7c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.177+0000 7f9b8b7fe640 1 -- 172.21.15.112:0/2251318046 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9b84077820 con 0x7f9b94064fc0 2024-09-19T09:45:55.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:54 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:45:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.354+0000 7f9b998fd640 1 -- 172.21.15.112:0/2251318046 --> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b940fcc50 con 0x7f9b8006e530 2024-09-19T09:45:55.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.363+0000 7f9b8b7fe640 1 -- 172.21.15.112:0/2251318046 <== mgr.34104 v2:172.21.15.112:6800/3742350100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9b940fcc50 con 0x7f9b8006e530 2024-09-19T09:45:55.366 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:45:55.366 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (10m) 2m ago 18m 26.7M - 0.25.0 c8568f914cd2 863e6b5790d0 2024-09-19T09:45:55.366 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (6m) 2m ago 18m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 70bad8ff6ec4 2024-09-19T09:45:55.367 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi191 smithi191 running (6m) 101s ago 18m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 6f8cb10f4c96 2024-09-19T09:45:55.367 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (8m) 2m ago 18m 75.4M - 9.4.12 2bacad6d85d8 e462aca2b022 2024-09-19T09:45:55.367 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.hcoxjz smithi112 running (2m) 2m ago 13m 14.1M - 19.1.1-361-g2f599a46 d2baa855c067 3267e6b8a90d 2024-09-19T09:45:55.367 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ymjyok smithi112 running (2m) 2m ago 13m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 3964ad1a1679 2024-09-19T09:45:55.367 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.jjldod smithi191 running (2m) 101s ago 13m 12.1M - 19.1.1-361-g2f599a46 d2baa855c067 8ee53b5b95cf 2024-09-19T09:45:55.367 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi191.qweljt smithi191 running (104s) 101s ago 13m 15.2M - 19.1.1-361-g2f599a46 d2baa855c067 6dfc4559157f 2024-09-19T09:45:55.367 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.puhuua smithi112 *:8443,9283,8765 running (9m) 2m ago 20m 505M - 19.1.1-361-g2f599a46 d2baa855c067 10e5354994b6 2024-09-19T09:45:55.367 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi191.xjpplx smithi191 *:8443,9283,8765 running (8m) 101s ago 17m 442M - 19.1.1-361-g2f599a46 d2baa855c067 fddba1bee64a 2024-09-19T09:45:55.367 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (7m) 2m ago 20m 49.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 89dfb5de44c8 2024-09-19T09:45:55.367 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi191 smithi191 running (6m) 101s ago 17m 41.0M 2048M 19.1.1-361-g2f599a46 d2baa855c067 3cab8f7cc27e 2024-09-19T09:45:55.367 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (10m) 2m ago 18m 15.5M - 1.5.0 0da6a335fe13 c6729efe890a 2024-09-19T09:45:55.367 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi191 smithi191 *:9100 running (9m) 101s ago 17m 15.9M - 1.5.0 0da6a335fe13 f7039139a2b7 2024-09-19T09:45:55.367 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (5m) 2m ago 17m 153M 1557M 19.1.1-361-g2f599a46 d2baa855c067 11a51e663887 2024-09-19T09:45:55.368 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (5m) 2m ago 16m 200M 1557M 19.1.1-361-g2f599a46 d2baa855c067 bd616fcb189b 2024-09-19T09:45:55.368 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (4m) 2m ago 16m 166M 1557M 19.1.1-361-g2f599a46 d2baa855c067 4a651b62590f 2024-09-19T09:45:55.368 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi191 running (4m) 101s ago 15m 124M 2581M 19.1.1-361-g2f599a46 d2baa855c067 7f953c691608 2024-09-19T09:45:55.368 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi191 running (3m) 101s ago 15m 141M 2581M 19.1.1-361-g2f599a46 d2baa855c067 3cd638400a3a 2024-09-19T09:45:55.368 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi191 running (2m) 101s ago 14m 123M 2581M 19.1.1-361-g2f599a46 d2baa855c067 901aaba16a54 2024-09-19T09:45:55.368 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (8m) 2m ago 18m 63.7M - 2.43.0 a07b618ecd1d 54850883a171 2024-09-19T09:45:55.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.366+0000 7f9b998fd640 1 -- 172.21.15.112:0/2251318046 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9b8006e530 msgr2=0x7f9b800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.366+0000 7f9b998fd640 1 --2- 172.21.15.112:0/2251318046 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9b8006e530 0x7f9b800709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9b940fcea0 tx=0x7f9b7c00b040 comp rx=0 tx=0).stop 2024-09-19T09:45:55.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.366+0000 7f9b998fd640 1 -- 172.21.15.112:0/2251318046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b94064fc0 msgr2=0x7f9b940fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.366+0000 7f9b998fd640 1 --2- 172.21.15.112:0/2251318046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b94064fc0 0x7f9b940fb560 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9b840043d0 tx=0x7f9b84009da0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.366+0000 7f9b998fd640 1 -- 172.21.15.112:0/2251318046 shutdown_connections 2024-09-19T09:45:55.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.366+0000 7f9b998fd640 1 --2- 172.21.15.112:0/2251318046 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9b8006e530 0x7f9b800709e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.366+0000 7f9b998fd640 1 --2- 172.21.15.112:0/2251318046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b940fe460 0x7f9b940fbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.366+0000 7f9b998fd640 1 --2- 172.21.15.112:0/2251318046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b94064fc0 0x7f9b940fb560 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.366+0000 7f9b998fd640 1 -- 172.21.15.112:0/2251318046 >> 172.21.15.112:0/2251318046 conn(0x7f9b940723b0 msgr2=0x7f9b94105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:55.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.366+0000 7f9b998fd640 1 -- 172.21.15.112:0/2251318046 shutdown_connections 2024-09-19T09:45:55.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:55.366+0000 7f9b998fd640 1 -- 172.21.15.112:0/2251318046 wait complete. 2024-09-19T09:45:56.166 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions' 2024-09-19T09:45:56.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:55 smithi112 ceph-mon[97503]: pgmap v259: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:56.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:55 smithi191 ceph-mon[77624]: pgmap v259: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:45:56.420 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:45:57.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:56 smithi112 ceph-mon[97503]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:45:57.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:56 smithi191 ceph-mon[77624]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:45:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.109+0000 7ff14e122640 1 -- 172.21.15.112:0/190002325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff148102550 msgr2=0x7ff148102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.109+0000 7ff14e122640 1 --2- 172.21.15.112:0/190002325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff148102550 0x7ff148102920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff1380048d0 tx=0x7ff138009da0 comp rx=0 tx=0).stop 2024-09-19T09:45:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.109+0000 7ff14e122640 1 -- 172.21.15.112:0/190002325 shutdown_connections 2024-09-19T09:45:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.109+0000 7ff14e122640 1 --2- 172.21.15.112:0/190002325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff148102ef0 0x7ff1480fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.109+0000 7ff14e122640 1 --2- 172.21.15.112:0/190002325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff148102550 0x7ff148102920 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.109+0000 7ff14e122640 1 -- 172.21.15.112:0/190002325 >> 172.21.15.112:0/190002325 conn(0x7ff1480f80f0 msgr2=0x7ff1480fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.109+0000 7ff14e122640 1 -- 172.21.15.112:0/190002325 shutdown_connections 2024-09-19T09:45:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.109+0000 7ff14e122640 1 -- 172.21.15.112:0/190002325 wait complete. 2024-09-19T09:45:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.110+0000 7ff14e122640 1 Processor -- start 2024-09-19T09:45:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.110+0000 7ff14e122640 1 -- start start 2024-09-19T09:45:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.110+0000 7ff14e122640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff148102550 0x7ff1481135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.110+0000 7ff14e122640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff148102ef0 0x7ff148113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.110+0000 7ff14e122640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1481141d0 con 0x7ff148102ef0 2024-09-19T09:45:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.110+0000 7ff14e122640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14810d550 con 0x7ff148102550 2024-09-19T09:45:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.110+0000 7ff146ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff148102ef0 0x7ff148113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.110+0000 7ff146ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff148102ef0 0x7ff148113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49196/0 (socket says 172.21.15.112:49196) 2024-09-19T09:45:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.110+0000 7ff146ffd640 1 -- 172.21.15.112:0/2671094053 learned_addr learned my addr 172.21.15.112:0/2671094053 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:45:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.110+0000 7ff1477fe640 1 --2- 172.21.15.112:0/2671094053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff148102550 0x7ff1481135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.110+0000 7ff146ffd640 1 -- 172.21.15.112:0/2671094053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff148102550 msgr2=0x7ff1481135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.110+0000 7ff146ffd640 1 --2- 172.21.15.112:0/2671094053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff148102550 0x7ff1481135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.110+0000 7ff146ffd640 1 -- 172.21.15.112:0/2671094053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138005040 con 0x7ff148102ef0 2024-09-19T09:45:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.110+0000 7ff146ffd640 1 --2- 172.21.15.112:0/2671094053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff148102ef0 0x7ff148113af0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00b540 tx=0x7ff13c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.111+0000 7ff12ffff640 1 -- 172.21.15.112:0/2671094053 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13c00f6f0 con 0x7ff148102ef0 2024-09-19T09:45:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.111+0000 7ff12ffff640 1 -- 172.21.15.112:0/2671094053 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff13c00fcf0 con 0x7ff148102ef0 2024-09-19T09:45:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.111+0000 7ff14e122640 1 -- 172.21.15.112:0/2671094053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14810d7e0 con 0x7ff148102ef0 2024-09-19T09:45:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.111+0000 7ff12ffff640 1 -- 172.21.15.112:0/2671094053 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13c011e80 con 0x7ff148102ef0 2024-09-19T09:45:58.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.111+0000 7ff14e122640 1 -- 172.21.15.112:0/2671094053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14810dd00 con 0x7ff148102ef0 2024-09-19T09:45:58.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.112+0000 7ff14e122640 1 -- 172.21.15.112:0/2671094053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1480fdcd0 con 0x7ff148102ef0 2024-09-19T09:45:58.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.112+0000 7ff12ffff640 1 -- 172.21.15.112:0/2671094053 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff13c0116b0 con 0x7ff148102ef0 2024-09-19T09:45:58.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.113+0000 7ff12ffff640 1 --2- 172.21.15.112:0/2671094053 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff13006e530 0x7ff1300709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:58.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.113+0000 7ff12ffff640 1 -- 172.21.15.112:0/2671094053 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7ff13c08e1a0 con 0x7ff148102ef0 2024-09-19T09:45:58.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.113+0000 7ff1477fe640 1 --2- 172.21.15.112:0/2671094053 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff13006e530 0x7ff1300709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:58.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.113+0000 7ff1477fe640 1 --2- 172.21.15.112:0/2671094053 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff13006e530 0x7ff1300709e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff1380043d0 tx=0x7ff138009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:58.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.117+0000 7ff12ffff640 1 -- 172.21.15.112:0/2671094053 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff13c057220 con 0x7ff148102ef0 2024-09-19T09:45:58.186 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:57 smithi191 ceph-mon[77624]: pgmap v260: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:58.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:57 smithi112 ceph-mon[97503]: pgmap v260: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:45:58.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.351+0000 7ff14e122640 1 -- 172.21.15.112:0/2671094053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff1480fbd50 con 0x7ff148102ef0 2024-09-19T09:45:58.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.352+0000 7ff12ffff640 1 -- 172.21.15.112:0/2671094053 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7ff13c05a8e0 con 0x7ff148102ef0 2024-09-19T09:45:58.354 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-19T09:45:58.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-19T09:45:58.354 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:45:58.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:45:58.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-19T09:45:58.354 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:45:58.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:45:58.354 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-19T09:45:58.354 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T09:45:58.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:45:58.355 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-19T09:45:58.355 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T09:45:58.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-19T09:45:58.355 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-19T09:45:58.355 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T09:45:58.355 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-19T09:45:58.355 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-19T09:45:58.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.354+0000 7ff14e122640 1 -- 172.21.15.112:0/2671094053 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff13006e530 msgr2=0x7ff1300709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:58.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.354+0000 7ff14e122640 1 --2- 172.21.15.112:0/2671094053 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff13006e530 0x7ff1300709e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff1380043d0 tx=0x7ff138009da0 comp rx=0 tx=0).stop 2024-09-19T09:45:58.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.354+0000 7ff14e122640 1 -- 172.21.15.112:0/2671094053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff148102ef0 msgr2=0x7ff148113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:58.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.354+0000 7ff14e122640 1 --2- 172.21.15.112:0/2671094053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff148102ef0 0x7ff148113af0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00b540 tx=0x7ff13c0091a0 comp rx=0 tx=0).stop 2024-09-19T09:45:58.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.354+0000 7ff14e122640 1 -- 172.21.15.112:0/2671094053 shutdown_connections 2024-09-19T09:45:58.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.354+0000 7ff14e122640 1 --2- 172.21.15.112:0/2671094053 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff13006e530 0x7ff1300709e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:58.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.354+0000 7ff14e122640 1 --2- 172.21.15.112:0/2671094053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff148102ef0 0x7ff148113af0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:58.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.354+0000 7ff14e122640 1 --2- 172.21.15.112:0/2671094053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff148102550 0x7ff1481135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:58.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.354+0000 7ff14e122640 1 -- 172.21.15.112:0/2671094053 >> 172.21.15.112:0/2671094053 conn(0x7ff1480f80f0 msgr2=0x7ff1480f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:58.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.354+0000 7ff14e122640 1 -- 172.21.15.112:0/2671094053 shutdown_connections 2024-09-19T09:45:58.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:45:58.354+0000 7ff14e122640 1 -- 172.21.15.112:0/2671094053 wait complete. 2024-09-19T09:45:59.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:58 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2671094053' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:45:59.054 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-19T09:45:59.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:58 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2671094053' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:45:59.340 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:45:59 smithi112 ceph-mon[97503]: pgmap v261: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:46:00.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:45:59 smithi191 ceph-mon[77624]: pgmap v261: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:46:00.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.973+0000 7f5ff9d49640 1 -- 172.21.15.112:0/272044382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ff4102550 msgr2=0x7f5ff4102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:00.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.973+0000 7f5ff9d49640 1 --2- 172.21.15.112:0/272044382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ff4102550 0x7f5ff4102920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5fe40048d0 tx=0x7f5fe4009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:00.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.973+0000 7f5ff9d49640 1 -- 172.21.15.112:0/272044382 shutdown_connections 2024-09-19T09:46:00.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.973+0000 7f5ff9d49640 1 --2- 172.21.15.112:0/272044382 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ff4102ef0 0x7f5ff40fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:00.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.973+0000 7f5ff9d49640 1 --2- 172.21.15.112:0/272044382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ff4102550 0x7f5ff4102920 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:00.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.973+0000 7f5ff9d49640 1 -- 172.21.15.112:0/272044382 >> 172.21.15.112:0/272044382 conn(0x7f5ff40f80f0 msgr2=0x7f5ff40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:00.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.973+0000 7f5ff9d49640 1 -- 172.21.15.112:0/272044382 shutdown_connections 2024-09-19T09:46:00.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.973+0000 7f5ff9d49640 1 -- 172.21.15.112:0/272044382 wait complete. 2024-09-19T09:46:00.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.974+0000 7f5ff9d49640 1 Processor -- start 2024-09-19T09:46:00.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.974+0000 7f5ff9d49640 1 -- start start 2024-09-19T09:46:00.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.974+0000 7f5ff9d49640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ff4102550 0x7f5ff41135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.974+0000 7f5ff9d49640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ff4102ef0 0x7f5ff4113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.974+0000 7f5ff9d49640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff41141d0 con 0x7f5ff4102550 2024-09-19T09:46:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.974+0000 7f5ff9d49640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff410d550 con 0x7f5ff4102ef0 2024-09-19T09:46:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.974+0000 7f5ff37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ff4102550 0x7f5ff41135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.974+0000 7f5ff37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ff4102550 0x7f5ff41135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35058/0 (socket says 172.21.15.112:35058) 2024-09-19T09:46:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.974+0000 7f5ff37fe640 1 -- 172.21.15.112:0/1242059161 learned_addr learned my addr 172.21.15.112:0/1242059161 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.974+0000 7f5ff2ffd640 1 --2- 172.21.15.112:0/1242059161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ff4102ef0 0x7f5ff4113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.974+0000 7f5ff37fe640 1 -- 172.21.15.112:0/1242059161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ff4102ef0 msgr2=0x7f5ff4113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.974+0000 7f5ff37fe640 1 --2- 172.21.15.112:0/1242059161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ff4102ef0 0x7f5ff4113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.974+0000 7f5ff37fe640 1 -- 172.21.15.112:0/1242059161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe4005040 con 0x7f5ff4102550 2024-09-19T09:46:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.975+0000 7f5ff37fe640 1 --2- 172.21.15.112:0/1242059161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ff4102550 0x7f5ff41135b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4000c00 tx=0x7f5fe4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.975+0000 7f5fdbfff640 1 -- 172.21.15.112:0/1242059161 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fe4038070 con 0x7f5ff4102550 2024-09-19T09:46:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.975+0000 7f5fdbfff640 1 -- 172.21.15.112:0/1242059161 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5fe403daf0 con 0x7f5ff4102550 2024-09-19T09:46:00.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.975+0000 7f5fdbfff640 1 -- 172.21.15.112:0/1242059161 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fe4033b20 con 0x7f5ff4102550 2024-09-19T09:46:00.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.975+0000 7f5ff9d49640 1 -- 172.21.15.112:0/1242059161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff410d780 con 0x7f5ff4102550 2024-09-19T09:46:00.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.975+0000 7f5ff9d49640 1 -- 172.21.15.112:0/1242059161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff410dc50 con 0x7f5ff4102550 2024-09-19T09:46:00.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.976+0000 7f5ff9d49640 1 -- 172.21.15.112:0/1242059161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff40fdcd0 con 0x7f5ff4102550 2024-09-19T09:46:00.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.977+0000 7f5fdbfff640 1 -- 172.21.15.112:0/1242059161 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5fe4030020 con 0x7f5ff4102550 2024-09-19T09:46:00.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.977+0000 7f5fdbfff640 1 --2- 172.21.15.112:0/1242059161 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f5fdc06e530 0x7f5fdc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:00.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.977+0000 7f5fdbfff640 1 -- 172.21.15.112:0/1242059161 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f5fe40ae4e0 con 0x7f5ff4102550 2024-09-19T09:46:00.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.977+0000 7f5ff2ffd640 1 --2- 172.21.15.112:0/1242059161 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f5fdc06e530 0x7f5fdc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:00.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.977+0000 7f5ff2ffd640 1 --2- 172.21.15.112:0/1242059161 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f5fdc06e530 0x7f5fdc0709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8006fd0 tx=0x7f5fe8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:00.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:00.982+0000 7f5fdbfff640 1 -- 172.21.15.112:0/1242059161 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5fe4077570 con 0x7f5ff4102550 2024-09-19T09:46:01.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:01.212+0000 7f5ff9d49640 1 -- 172.21.15.112:0/1242059161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5ff410ec20 con 0x7f5ff4102550 2024-09-19T09:46:01.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:01.213+0000 7f5fdbfff640 1 -- 172.21.15.112:0/1242059161 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f5fe407ac30 con 0x7f5ff4102550 2024-09-19T09:46:01.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:01.215+0000 7f5ff9d49640 1 -- 172.21.15.112:0/1242059161 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f5fdc06e530 msgr2=0x7f5fdc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:01.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:01.215+0000 7f5ff9d49640 1 --2- 172.21.15.112:0/1242059161 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f5fdc06e530 0x7f5fdc0709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8006fd0 tx=0x7f5fe8008040 comp rx=0 tx=0).stop 2024-09-19T09:46:01.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:01.215+0000 7f5ff9d49640 1 -- 172.21.15.112:0/1242059161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ff4102550 msgr2=0x7f5ff41135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:01.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:01.215+0000 7f5ff9d49640 1 --2- 172.21.15.112:0/1242059161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ff4102550 0x7f5ff41135b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4000c00 tx=0x7f5fe4009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:01.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:01.215+0000 7f5ff9d49640 1 -- 172.21.15.112:0/1242059161 shutdown_connections 2024-09-19T09:46:01.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:01.215+0000 7f5ff9d49640 1 --2- 172.21.15.112:0/1242059161 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f5fdc06e530 0x7f5fdc0709e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:01.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:01.215+0000 7f5ff9d49640 1 --2- 172.21.15.112:0/1242059161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ff4102ef0 0x7f5ff4113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:01.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:01.215+0000 7f5ff9d49640 1 --2- 172.21.15.112:0/1242059161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ff4102550 0x7f5ff41135b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:01.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:01.215+0000 7f5ff9d49640 1 -- 172.21.15.112:0/1242059161 >> 172.21.15.112:0/1242059161 conn(0x7f5ff40f80f0 msgr2=0x7f5ff40f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:01.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:01.215+0000 7f5ff9d49640 1 -- 172.21.15.112:0/1242059161 shutdown_connections 2024-09-19T09:46:01.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:01.215+0000 7f5ff9d49640 1 -- 172.21.15.112:0/1242059161 wait complete. 2024-09-19T09:46:01.226 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-19T09:46:01.919 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-19T09:46:02.166 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:02.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:01 smithi112 ceph-mon[97503]: pgmap v262: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:02.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:01 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/1242059161' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:46:02.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:01 smithi191 ceph-mon[77624]: pgmap v262: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:02.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:01 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/1242059161' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:46:03.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.780+0000 7f9f53040640 1 -- 172.21.15.112:0/3532134860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f4c1025f0 msgr2=0x7f9f4c1029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:03.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.780+0000 7f9f53040640 1 --2- 172.21.15.112:0/3532134860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f4c1025f0 0x7f9f4c1029c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9f400048d0 tx=0x7f9f40009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:03.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.780+0000 7f9f53040640 1 -- 172.21.15.112:0/3532134860 shutdown_connections 2024-09-19T09:46:03.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.780+0000 7f9f53040640 1 --2- 172.21.15.112:0/3532134860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f4c0fac60 0x7f9f4c0fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:03.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.780+0000 7f9f53040640 1 --2- 172.21.15.112:0/3532134860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f4c1025f0 0x7f9f4c1029c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:03.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.780+0000 7f9f53040640 1 -- 172.21.15.112:0/3532134860 >> 172.21.15.112:0/3532134860 conn(0x7f9f4c070c80 msgr2=0x7f9f4c071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:03.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.780+0000 7f9f53040640 1 -- 172.21.15.112:0/3532134860 shutdown_connections 2024-09-19T09:46:03.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.780+0000 7f9f53040640 1 -- 172.21.15.112:0/3532134860 wait complete. 2024-09-19T09:46:03.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.781+0000 7f9f53040640 1 Processor -- start 2024-09-19T09:46:03.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.781+0000 7f9f53040640 1 -- start start 2024-09-19T09:46:03.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.781+0000 7f9f53040640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f4c0fac60 0x7f9f4c113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:03.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.781+0000 7f9f53040640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f4c1025f0 0x7f9f4c1137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:03.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.781+0000 7f9f53040640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c113e40 con 0x7f9f4c1025f0 2024-09-19T09:46:03.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.781+0000 7f9f53040640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c10d1f0 con 0x7f9f4c0fac60 2024-09-19T09:46:03.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.781+0000 7f9f4bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f4c1025f0 0x7f9f4c1137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:03.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.781+0000 7f9f4bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f4c1025f0 0x7f9f4c1137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35064/0 (socket says 172.21.15.112:35064) 2024-09-19T09:46:03.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.781+0000 7f9f4bfff640 1 -- 172.21.15.112:0/4041061734 learned_addr learned my addr 172.21.15.112:0/4041061734 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:03.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.782+0000 7f9f50ddc640 1 --2- 172.21.15.112:0/4041061734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f4c0fac60 0x7f9f4c113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:03.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.782+0000 7f9f4bfff640 1 -- 172.21.15.112:0/4041061734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f4c0fac60 msgr2=0x7f9f4c113270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:03.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.782+0000 7f9f4bfff640 1 --2- 172.21.15.112:0/4041061734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f4c0fac60 0x7f9f4c113270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:03.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.782+0000 7f9f4bfff640 1 -- 172.21.15.112:0/4041061734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f40005040 con 0x7f9f4c1025f0 2024-09-19T09:46:03.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.782+0000 7f9f4bfff640 1 --2- 172.21.15.112:0/4041061734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f4c1025f0 0x7f9f4c1137b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800b790 tx=0x7f9f380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:03.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.782+0000 7f9f497fa640 1 -- 172.21.15.112:0/4041061734 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f3800c700 con 0x7f9f4c1025f0 2024-09-19T09:46:03.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.782+0000 7f9f53040640 1 -- 172.21.15.112:0/4041061734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4c10d4d0 con 0x7f9f4c1025f0 2024-09-19T09:46:03.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.782+0000 7f9f497fa640 1 -- 172.21.15.112:0/4041061734 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9f3800cd00 con 0x7f9f4c1025f0 2024-09-19T09:46:03.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.782+0000 7f9f497fa640 1 -- 172.21.15.112:0/4041061734 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f38015e80 con 0x7f9f4c1025f0 2024-09-19T09:46:03.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.782+0000 7f9f53040640 1 -- 172.21.15.112:0/4041061734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4c10d9f0 con 0x7f9f4c1025f0 2024-09-19T09:46:03.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.783+0000 7f9f53040640 1 -- 172.21.15.112:0/4041061734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4c065810 con 0x7f9f4c1025f0 2024-09-19T09:46:03.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.784+0000 7f9f497fa640 1 -- 172.21.15.112:0/4041061734 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9f38012070 con 0x7f9f4c1025f0 2024-09-19T09:46:03.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.784+0000 7f9f497fa640 1 --2- 172.21.15.112:0/4041061734 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9f3c06e530 0x7f9f3c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:03.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.784+0000 7f9f497fa640 1 -- 172.21.15.112:0/4041061734 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f9f3808db70 con 0x7f9f4c1025f0 2024-09-19T09:46:03.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.784+0000 7f9f50ddc640 1 --2- 172.21.15.112:0/4041061734 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9f3c06e530 0x7f9f3c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:03.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.785+0000 7f9f50ddc640 1 --2- 172.21.15.112:0/4041061734 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9f3c06e530 0x7f9f3c0709e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009ac0 tx=0x7f9f40035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:03.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:03.789+0000 7f9f497fa640 1 -- 172.21.15.112:0/4041061734 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9f38056b50 con 0x7f9f4c1025f0 2024-09-19T09:46:04.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:04.024+0000 7f9f53040640 1 -- 172.21.15.112:0/4041061734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9f4c109680 con 0x7f9f4c1025f0 2024-09-19T09:46:04.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:04.024+0000 7f9f497fa640 1 -- 172.21.15.112:0/4041061734 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f9f3805a210 con 0x7f9f4c1025f0 2024-09-19T09:46:04.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:04.026+0000 7f9f53040640 1 -- 172.21.15.112:0/4041061734 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9f3c06e530 msgr2=0x7f9f3c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:04.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:04.026+0000 7f9f53040640 1 --2- 172.21.15.112:0/4041061734 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9f3c06e530 0x7f9f3c0709e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009ac0 tx=0x7f9f40035040 comp rx=0 tx=0).stop 2024-09-19T09:46:04.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:04.026+0000 7f9f53040640 1 -- 172.21.15.112:0/4041061734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f4c1025f0 msgr2=0x7f9f4c1137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:04.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:04.026+0000 7f9f53040640 1 --2- 172.21.15.112:0/4041061734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f4c1025f0 0x7f9f4c1137b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800b790 tx=0x7f9f380091d0 comp rx=0 tx=0).stop 2024-09-19T09:46:04.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:04.027+0000 7f9f53040640 1 -- 172.21.15.112:0/4041061734 shutdown_connections 2024-09-19T09:46:04.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:04.027+0000 7f9f53040640 1 --2- 172.21.15.112:0/4041061734 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9f3c06e530 0x7f9f3c0709e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:04.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:04.027+0000 7f9f53040640 1 --2- 172.21.15.112:0/4041061734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f4c1025f0 0x7f9f4c1137b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:04.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:04.027+0000 7f9f53040640 1 --2- 172.21.15.112:0/4041061734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f4c0fac60 0x7f9f4c113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:04.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:04.027+0000 7f9f53040640 1 -- 172.21.15.112:0/4041061734 >> 172.21.15.112:0/4041061734 conn(0x7f9f4c070c80 msgr2=0x7f9f4c0f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:04.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:04.027+0000 7f9f53040640 1 -- 172.21.15.112:0/4041061734 shutdown_connections 2024-09-19T09:46:04.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:04.027+0000 7f9f53040640 1 -- 172.21.15.112:0/4041061734 wait complete. 2024-09-19T09:46:04.037 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)" 2024-09-19T09:46:04.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:03 smithi191 ceph-mon[77624]: pgmap v263: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:04.324 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:03 smithi112 ceph-mon[97503]: pgmap v263: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:04.648 DEBUG:teuthology.parallel:result is None 2024-09-19T09:46:04.649 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:46:04.660 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-19T09:46:04.660 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T09:46:04.907 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:05.227 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:04 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/4041061734' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:46:05.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:04 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/4041061734' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:46:06.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:05 smithi191 ceph-mon[77624]: pgmap v264: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:06.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:05 smithi112 ceph-mon[97503]: pgmap v264: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:06.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.518+0000 7f8a9d5d1640 1 -- 172.21.15.112:0/637952787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a980fcf80 msgr2=0x7f8a980fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:06.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.518+0000 7f8a9d5d1640 1 --2- 172.21.15.112:0/637952787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a980fcf80 0x7f8a980fd3d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a800048d0 tx=0x7f8a80009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:06.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.518+0000 7f8a9d5d1640 1 -- 172.21.15.112:0/637952787 shutdown_connections 2024-09-19T09:46:06.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.518+0000 7f8a9d5d1640 1 --2- 172.21.15.112:0/637952787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a980fcf80 0x7f8a980fd3d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:06.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.518+0000 7f8a9d5d1640 1 --2- 172.21.15.112:0/637952787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a980fb810 0x7f8a980fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:06.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.518+0000 7f8a9d5d1640 1 -- 172.21.15.112:0/637952787 >> 172.21.15.112:0/637952787 conn(0x7f8a980723b0 msgr2=0x7f8a980727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:06.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.518+0000 7f8a9d5d1640 1 -- 172.21.15.112:0/637952787 shutdown_connections 2024-09-19T09:46:06.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.518+0000 7f8a9d5d1640 1 -- 172.21.15.112:0/637952787 wait complete. 2024-09-19T09:46:06.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.519+0000 7f8a9d5d1640 1 Processor -- start 2024-09-19T09:46:06.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.519+0000 7f8a9d5d1640 1 -- start start 2024-09-19T09:46:06.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.519+0000 7f8a9d5d1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a980fb810 0x7f8a98113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:06.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.519+0000 7f8a9d5d1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a980fcf80 0x7f8a981136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:06.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.519+0000 7f8a9d5d1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a98113cc0 con 0x7f8a980fcf80 2024-09-19T09:46:06.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.519+0000 7f8a9d5d1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9810d100 con 0x7f8a980fb810 2024-09-19T09:46:06.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.519+0000 7f8a8e7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a980fcf80 0x7f8a981136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:06.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.520+0000 7f8a8e7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a980fcf80 0x7f8a981136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35094/0 (socket says 172.21.15.112:35094) 2024-09-19T09:46:06.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.520+0000 7f8a8e7fc640 1 -- 172.21.15.112:0/3158181151 learned_addr learned my addr 172.21.15.112:0/3158181151 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:06.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.520+0000 7f8a96ffd640 1 --2- 172.21.15.112:0/3158181151 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a980fb810 0x7f8a98113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:06.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.520+0000 7f8a8e7fc640 1 -- 172.21.15.112:0/3158181151 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a980fb810 msgr2=0x7f8a98113180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:06.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.520+0000 7f8a8e7fc640 1 --2- 172.21.15.112:0/3158181151 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a980fb810 0x7f8a98113180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:06.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.520+0000 7f8a8e7fc640 1 -- 172.21.15.112:0/3158181151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a80005040 con 0x7f8a980fcf80 2024-09-19T09:46:06.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.520+0000 7f8a8e7fc640 1 --2- 172.21.15.112:0/3158181151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a980fcf80 0x7f8a981136c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a80000c00 tx=0x7f8a80009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:06.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.520+0000 7f8a8ffff640 1 -- 172.21.15.112:0/3158181151 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a80038070 con 0x7f8a980fcf80 2024-09-19T09:46:06.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.520+0000 7f8a8ffff640 1 -- 172.21.15.112:0/3158181151 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8a8002ade0 con 0x7f8a980fcf80 2024-09-19T09:46:06.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.520+0000 7f8a9d5d1640 1 -- 172.21.15.112:0/3158181151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9810d380 con 0x7f8a980fcf80 2024-09-19T09:46:06.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.520+0000 7f8a8ffff640 1 -- 172.21.15.112:0/3158181151 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a8002c7e0 con 0x7f8a980fcf80 2024-09-19T09:46:06.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.520+0000 7f8a9d5d1640 1 -- 172.21.15.112:0/3158181151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9810d8c0 con 0x7f8a980fcf80 2024-09-19T09:46:06.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.521+0000 7f8a9d5d1640 1 -- 172.21.15.112:0/3158181151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a980fcbc0 con 0x7f8a980fcf80 2024-09-19T09:46:06.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.522+0000 7f8a8ffff640 1 -- 172.21.15.112:0/3158181151 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8a80030020 con 0x7f8a980fcf80 2024-09-19T09:46:06.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.522+0000 7f8a8ffff640 1 --2- 172.21.15.112:0/3158181151 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8a8406e530 0x7f8a840709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:06.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.522+0000 7f8a8ffff640 1 -- 172.21.15.112:0/3158181151 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f8a800adf00 con 0x7f8a980fcf80 2024-09-19T09:46:06.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.522+0000 7f8a96ffd640 1 --2- 172.21.15.112:0/3158181151 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8a8406e530 0x7f8a840709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:06.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.523+0000 7f8a96ffd640 1 --2- 172.21.15.112:0/3158181151 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8a8406e530 0x7f8a840709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a88007fd0 tx=0x7f8a88009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:06.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.526+0000 7f8a8ffff640 1 -- 172.21.15.112:0/3158181151 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8a80076f90 con 0x7f8a980fcf80 2024-09-19T09:46:06.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.731+0000 7f8a9d5d1640 1 -- 172.21.15.112:0/3158181151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8a9810e7f0 con 0x7f8a980fcf80 2024-09-19T09:46:06.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.731+0000 7f8a8ffff640 1 -- 172.21.15.112:0/3158181151 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+2007 (secure 0 0 0) 0x7f8a8007a650 con 0x7f8a980fcf80 2024-09-19T09:46:06.734 INFO:teuthology.orchestra.run.smithi112.stdout:e36 2024-09-19T09:46:06.734 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-19T09:44:19:739626+0000 2024-09-19T09:46:06.734 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:46:06.734 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:46:06.734 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-19T09:46:06.734 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:06.735 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:46:06.735 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-19T09:46:06.735 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 36 2024-09-19T09:46:06.735 INFO:teuthology.orchestra.run.smithi112.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:46:06.735 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-19T09:32:24.989350+0000 2024-09-19T09:46:06.735 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-19T09:44:19.739614+0000 2024-09-19T09:46:06.735 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-19T09:46:06.735 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-19T09:46:06.735 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-19T09:46:06.735 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-19T09:46:06.735 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-19T09:46:06.735 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-19T09:46:06.736 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-19T09:46:06.736 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-19T09:46:06.736 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 94 2024-09-19T09:46:06.736 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:46:06.736 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-19T09:46:06.736 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-19T09:46:06.736 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=34384} 2024-09-19T09:46:06.736 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-19T09:46:06.736 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-19T09:46:06.736 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-19T09:46:06.736 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-19T09:46:06.736 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-19T09:46:06.736 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data disabled 2024-09-19T09:46:06.737 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-19T09:46:06.737 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-19T09:46:06.737 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-19T09:46:06.737 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 34384 members: 34384 2024-09-19T09:46:06.737 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ymjyok{0:34384} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.112:6826/1711973242,v1:172.21.15.112:6827/1711973242] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:46:06.737 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.hcoxjz{0:34416} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.112:6828/742383802,v1:172.21.15.112:6829/742383802] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:46:06.737 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:06.737 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:06.737 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-19T09:46:06.737 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:06.737 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.jjldod{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6824/3336467092,v1:172.21.15.191:6825/3336467092] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:46:06.737 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi191.qweljt{-1:44353} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.191:6826/1878602887,v1:172.21.15.191:6827/1878602887] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:46:06.738 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 36 2024-09-19T09:46:06.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.733+0000 7f8a9d5d1640 1 -- 172.21.15.112:0/3158181151 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8a8406e530 msgr2=0x7f8a840709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:06.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.733+0000 7f8a9d5d1640 1 --2- 172.21.15.112:0/3158181151 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8a8406e530 0x7f8a840709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a88007fd0 tx=0x7f8a88009e90 comp rx=0 tx=0).stop 2024-09-19T09:46:06.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.733+0000 7f8a9d5d1640 1 -- 172.21.15.112:0/3158181151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a980fcf80 msgr2=0x7f8a981136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:06.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.733+0000 7f8a9d5d1640 1 --2- 172.21.15.112:0/3158181151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a980fcf80 0x7f8a981136c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a80000c00 tx=0x7f8a80009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:06.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.733+0000 7f8a9d5d1640 1 -- 172.21.15.112:0/3158181151 shutdown_connections 2024-09-19T09:46:06.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.733+0000 7f8a9d5d1640 1 --2- 172.21.15.112:0/3158181151 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8a8406e530 0x7f8a840709e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:06.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.733+0000 7f8a9d5d1640 1 --2- 172.21.15.112:0/3158181151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a980fcf80 0x7f8a981136c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:06.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.733+0000 7f8a9d5d1640 1 --2- 172.21.15.112:0/3158181151 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a980fb810 0x7f8a98113180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:06.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.733+0000 7f8a9d5d1640 1 -- 172.21.15.112:0/3158181151 >> 172.21.15.112:0/3158181151 conn(0x7f8a980723b0 msgr2=0x7f8a98065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:06.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.733+0000 7f8a9d5d1640 1 -- 172.21.15.112:0/3158181151 shutdown_connections 2024-09-19T09:46:06.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:06.733+0000 7f8a9d5d1640 1 -- 172.21.15.112:0/3158181151 wait complete. 2024-09-19T09:46:07.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:06 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3158181151' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:46:07.413 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:06 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3158181151' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:46:07.437 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-19T09:46:07.449 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:46:07.694 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:08.074 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:07 smithi112 ceph-mon[97503]: pgmap v265: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:08.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:07 smithi191 ceph-mon[77624]: pgmap v265: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:09.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.339+0000 7f83748a3640 1 -- 172.21.15.112:0/172130090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83700fe460 msgr2=0x7f83700fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:09.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.339+0000 7f83748a3640 1 --2- 172.21.15.112:0/172130090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83700fe460 0x7f83700fe830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f83600048d0 tx=0x7f8360009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.339+0000 7f83748a3640 1 -- 172.21.15.112:0/172130090 shutdown_connections 2024-09-19T09:46:09.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.339+0000 7f83748a3640 1 --2- 172.21.15.112:0/172130090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8370064fc0 0x7f8370065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.339+0000 7f83748a3640 1 --2- 172.21.15.112:0/172130090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83700fe460 0x7f83700fe830 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.339+0000 7f83748a3640 1 -- 172.21.15.112:0/172130090 >> 172.21.15.112:0/172130090 conn(0x7f83700723b0 msgr2=0x7f83700727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:09.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.339+0000 7f83748a3640 1 -- 172.21.15.112:0/172130090 shutdown_connections 2024-09-19T09:46:09.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.339+0000 7f83748a3640 1 -- 172.21.15.112:0/172130090 wait complete. 2024-09-19T09:46:09.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.339+0000 7f83748a3640 1 Processor -- start 2024-09-19T09:46:09.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.339+0000 7f83748a3640 1 -- start start 2024-09-19T09:46:09.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f83748a3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8370064fc0 0x7f8370113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:09.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f83748a3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83700fe460 0x7f8370113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:09.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f83748a3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8370113dd0 con 0x7f83700fe460 2024-09-19T09:46:09.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f83748a3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837010d180 con 0x7f8370064fc0 2024-09-19T09:46:09.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f836dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83700fe460 0x7f8370113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:09.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f836dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83700fe460 0x7f8370113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34380/0 (socket says 172.21.15.112:34380) 2024-09-19T09:46:09.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f836dd9b640 1 -- 172.21.15.112:0/3441770808 learned_addr learned my addr 172.21.15.112:0/3441770808 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:09.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f836e59c640 1 --2- 172.21.15.112:0/3441770808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8370064fc0 0x7f8370113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:09.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f836dd9b640 1 -- 172.21.15.112:0/3441770808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8370064fc0 msgr2=0x7f8370113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:09.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f836dd9b640 1 --2- 172.21.15.112:0/3441770808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8370064fc0 0x7f8370113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f836dd9b640 1 -- 172.21.15.112:0/3441770808 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8360005040 con 0x7f83700fe460 2024-09-19T09:46:09.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f836dd9b640 1 --2- 172.21.15.112:0/3441770808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83700fe460 0x7f8370113740 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f836400b790 tx=0x7f83640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:09.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f835effd640 1 -- 172.21.15.112:0/3441770808 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f836400c700 con 0x7f83700fe460 2024-09-19T09:46:09.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f835effd640 1 -- 172.21.15.112:0/3441770808 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f836400cd00 con 0x7f83700fe460 2024-09-19T09:46:09.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f83748a3640 1 -- 172.21.15.112:0/3441770808 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837010d460 con 0x7f83700fe460 2024-09-19T09:46:09.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f835effd640 1 -- 172.21.15.112:0/3441770808 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8364015e80 con 0x7f83700fe460 2024-09-19T09:46:09.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.340+0000 7f83748a3640 1 -- 172.21.15.112:0/3441770808 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837010d980 con 0x7f83700fe460 2024-09-19T09:46:09.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.341+0000 7f83748a3640 1 -- 172.21.15.112:0/3441770808 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83700fdcf0 con 0x7f83700fe460 2024-09-19T09:46:09.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.342+0000 7f835effd640 1 -- 172.21.15.112:0/3441770808 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8364012070 con 0x7f83700fe460 2024-09-19T09:46:09.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.342+0000 7f835effd640 1 --2- 172.21.15.112:0/3441770808 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f835806e530 0x7f83580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:09.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.343+0000 7f835effd640 1 -- 172.21.15.112:0/3441770808 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f836408db70 con 0x7f83700fe460 2024-09-19T09:46:09.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.343+0000 7f836e59c640 1 --2- 172.21.15.112:0/3441770808 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f835806e530 0x7f83580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:09.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.343+0000 7f836e59c640 1 --2- 172.21.15.112:0/3441770808 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f835806e530 0x7f83580709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8360009ac0 tx=0x7f8360035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:09.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.347+0000 7f835effd640 1 -- 172.21.15.112:0/3441770808 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8364056b50 con 0x7f83700fe460 2024-09-19T09:46:09.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.547+0000 7f83748a3640 1 -- 172.21.15.112:0/3441770808 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8370072ec0 con 0x7f83700fe460 2024-09-19T09:46:09.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.547+0000 7f835effd640 1 -- 172.21.15.112:0/3441770808 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+5266 (secure 0 0 0) 0x7f836405a210 con 0x7f83700fe460 2024-09-19T09:46:09.549 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:09.550 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":36,"btime":"2024-09-19T09:44:19:739626+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44329,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/3336467092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":3336467092},{"type":"v1","addr":"172.21.15.191:6825","nonce":3336467092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44353,"name":"cephfs.smithi191.qweljt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6827/1878602887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1878602887},{"type":"v1","addr":"172.21.15.191:6827","nonce":1878602887}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:44:19.739614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":0,"incarnation":30,"state":"up:active","state_seq":17,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34416":{"gid":34416,"name":"cephfs.smithi112.hcoxjz","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6829/742383802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":742383802},{"type":"v1","addr":"172.21.15.112:6829","nonce":742383802}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34384,"qdb_cluster":[34384]},"id":1}]} 2024-09-19T09:46:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 36 2024-09-19T09:46:09.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.549+0000 7f83748a3640 1 -- 172.21.15.112:0/3441770808 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f835806e530 msgr2=0x7f83580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:09.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.549+0000 7f83748a3640 1 --2- 172.21.15.112:0/3441770808 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f835806e530 0x7f83580709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8360009ac0 tx=0x7f8360035040 comp rx=0 tx=0).stop 2024-09-19T09:46:09.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.549+0000 7f83748a3640 1 -- 172.21.15.112:0/3441770808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83700fe460 msgr2=0x7f8370113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:09.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.549+0000 7f83748a3640 1 --2- 172.21.15.112:0/3441770808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83700fe460 0x7f8370113740 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f836400b790 tx=0x7f83640091d0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.549+0000 7f83748a3640 1 -- 172.21.15.112:0/3441770808 shutdown_connections 2024-09-19T09:46:09.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.549+0000 7f83748a3640 1 --2- 172.21.15.112:0/3441770808 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f835806e530 0x7f83580709e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.550+0000 7f83748a3640 1 --2- 172.21.15.112:0/3441770808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83700fe460 0x7f8370113740 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.550+0000 7f83748a3640 1 --2- 172.21.15.112:0/3441770808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8370064fc0 0x7f8370113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.550+0000 7f83748a3640 1 -- 172.21.15.112:0/3441770808 >> 172.21.15.112:0/3441770808 conn(0x7f83700723b0 msgr2=0x7f8370105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:09.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.550+0000 7f83748a3640 1 -- 172.21.15.112:0/3441770808 shutdown_connections 2024-09-19T09:46:09.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:09.550+0000 7f83748a3640 1 -- 172.21.15.112:0/3441770808 wait complete. 2024-09-19T09:46:10.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:09 smithi112 ceph-mon[97503]: pgmap v266: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:46:10.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:09 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3441770808' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:46:10.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:09 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:46:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:09 smithi191 ceph-mon[77624]: pgmap v266: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:46:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:09 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3441770808' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:46:10.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:09 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:46:10.293 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 17, 'max_mds': 1, 'flags': 50} 2024-09-19T09:46:10.294 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-19T09:46:10.538 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:12.081 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:11 smithi112 ceph-mon[97503]: pgmap v267: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:12.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:11 smithi191 ceph-mon[77624]: pgmap v267: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:12.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.301+0000 7fe9a6c6c640 1 -- 172.21.15.112:0/429038332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9a0102530 msgr2=0x7fe9a0102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:12.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.301+0000 7fe9a6c6c640 1 --2- 172.21.15.112:0/429038332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9a0102530 0x7fe9a0102900 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe9940048d0 tx=0x7fe994009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.301+0000 7fe9a6c6c640 1 -- 172.21.15.112:0/429038332 shutdown_connections 2024-09-19T09:46:12.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.301+0000 7fe9a6c6c640 1 --2- 172.21.15.112:0/429038332 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9a0102ed0 0x7fe9a00fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.301+0000 7fe9a6c6c640 1 --2- 172.21.15.112:0/429038332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9a0102530 0x7fe9a0102900 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.301+0000 7fe9a6c6c640 1 -- 172.21.15.112:0/429038332 >> 172.21.15.112:0/429038332 conn(0x7fe9a00f80f0 msgr2=0x7fe9a00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:12.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.301+0000 7fe9a6c6c640 1 -- 172.21.15.112:0/429038332 shutdown_connections 2024-09-19T09:46:12.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.301+0000 7fe9a6c6c640 1 -- 172.21.15.112:0/429038332 wait complete. 2024-09-19T09:46:12.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.302+0000 7fe9a6c6c640 1 Processor -- start 2024-09-19T09:46:12.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.302+0000 7fe9a6c6c640 1 -- start start 2024-09-19T09:46:12.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.302+0000 7fe9a6c6c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9a0102530 0x7fe9a0113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.302+0000 7fe9a6c6c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9a0102ed0 0x7fe9a0113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.302+0000 7fe9a6c6c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a0113d50 con 0x7fe9a0102530 2024-09-19T09:46:12.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.302+0000 7fe9a6c6c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a010d190 con 0x7fe9a0102ed0 2024-09-19T09:46:12.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.302+0000 7fe9a4a08640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9a0102530 0x7fe9a0113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.302+0000 7fe9a4a08640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9a0102530 0x7fe9a0113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34386/0 (socket says 172.21.15.112:34386) 2024-09-19T09:46:12.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.302+0000 7fe9a4a08640 1 -- 172.21.15.112:0/1087496729 learned_addr learned my addr 172.21.15.112:0/1087496729 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:12.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.302+0000 7fe99ffff640 1 --2- 172.21.15.112:0/1087496729 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9a0102ed0 0x7fe9a0113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.302+0000 7fe9a4a08640 1 -- 172.21.15.112:0/1087496729 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9a0102ed0 msgr2=0x7fe9a0113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:12.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.302+0000 7fe9a4a08640 1 --2- 172.21.15.112:0/1087496729 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9a0102ed0 0x7fe9a0113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.302+0000 7fe9a4a08640 1 -- 172.21.15.112:0/1087496729 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe994005040 con 0x7fe9a0102530 2024-09-19T09:46:12.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.303+0000 7fe9a4a08640 1 --2- 172.21.15.112:0/1087496729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9a0102530 0x7fe9a0113210 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe994003080 tx=0x7fe994009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:12.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.303+0000 7fe99d7fa640 1 -- 172.21.15.112:0/1087496729 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe994038070 con 0x7fe9a0102530 2024-09-19T09:46:12.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.303+0000 7fe99d7fa640 1 -- 172.21.15.112:0/1087496729 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe9940097e0 con 0x7fe9a0102530 2024-09-19T09:46:12.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.303+0000 7fe9a6c6c640 1 -- 172.21.15.112:0/1087496729 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a010d410 con 0x7fe9a0102530 2024-09-19T09:46:12.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.303+0000 7fe99d7fa640 1 -- 172.21.15.112:0/1087496729 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe99403d420 con 0x7fe9a0102530 2024-09-19T09:46:12.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.303+0000 7fe9a6c6c640 1 -- 172.21.15.112:0/1087496729 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a010d950 con 0x7fe9a0102530 2024-09-19T09:46:12.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.304+0000 7fe9a6c6c640 1 -- 172.21.15.112:0/1087496729 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a00fdcb0 con 0x7fe9a0102530 2024-09-19T09:46:12.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.304+0000 7fe99d7fa640 1 -- 172.21.15.112:0/1087496729 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe994030020 con 0x7fe9a0102530 2024-09-19T09:46:12.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.305+0000 7fe99d7fa640 1 --2- 172.21.15.112:0/1087496729 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe99006e530 0x7fe9900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.305+0000 7fe99d7fa640 1 -- 172.21.15.112:0/1087496729 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7fe9940ae830 con 0x7fe9a0102530 2024-09-19T09:46:12.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.305+0000 7fe99ffff640 1 --2- 172.21.15.112:0/1087496729 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe99006e530 0x7fe9900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.305+0000 7fe99ffff640 1 --2- 172.21.15.112:0/1087496729 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe99006e530 0x7fe9900709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe98c007fd0 tx=0x7fe98c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:12.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.309+0000 7fe99d7fa640 1 -- 172.21.15.112:0/1087496729 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe994077810 con 0x7fe9a0102530 2024-09-19T09:46:12.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.518+0000 7fe9a6c6c640 1 -- 172.21.15.112:0/1087496729 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7fe9a004b720 con 0x7fe9a0102530 2024-09-19T09:46:12.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.520+0000 7fe99d7fa640 1 -- 172.21.15.112:0/1087496729 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v36) v1 ==== 107+0+4136 (secure 0 0 0) 0x7fe99407aed0 con 0x7fe9a0102530 2024-09-19T09:46:12.522 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:12.522 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"btime":"2024-09-19T09:43:07:938223+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi191.qweljt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.191:6827/1382170395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1382170395},{"type":"v1","addr":"172.21.15.191:6827","nonce":1382170395}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24281,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/2759077122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2759077122},{"type":"v1","addr":"172.21.15.191:6825","nonce":2759077122}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:43:07.938222+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi112.hcoxjz","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6829/165136062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":165136062},{"type":"v1","addr":"172.21.15.112:6829","nonce":165136062}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14460,"qdb_cluster":[14460]},"id":1}]} 2024-09-19T09:46:12.522 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 18 2024-09-19T09:46:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.522+0000 7fe9a6c6c640 1 -- 172.21.15.112:0/1087496729 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe99006e530 msgr2=0x7fe9900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.522+0000 7fe9a6c6c640 1 --2- 172.21.15.112:0/1087496729 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe99006e530 0x7fe9900709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe98c007fd0 tx=0x7fe98c009040 comp rx=0 tx=0).stop 2024-09-19T09:46:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.522+0000 7fe9a6c6c640 1 -- 172.21.15.112:0/1087496729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9a0102530 msgr2=0x7fe9a0113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.522+0000 7fe9a6c6c640 1 --2- 172.21.15.112:0/1087496729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9a0102530 0x7fe9a0113210 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe994003080 tx=0x7fe994009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.522+0000 7fe9a6c6c640 1 -- 172.21.15.112:0/1087496729 shutdown_connections 2024-09-19T09:46:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.522+0000 7fe9a6c6c640 1 --2- 172.21.15.112:0/1087496729 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe99006e530 0x7fe9900709e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.522+0000 7fe9a6c6c640 1 --2- 172.21.15.112:0/1087496729 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9a0102ed0 0x7fe9a0113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.522+0000 7fe9a6c6c640 1 --2- 172.21.15.112:0/1087496729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9a0102530 0x7fe9a0113210 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.522+0000 7fe9a6c6c640 1 -- 172.21.15.112:0/1087496729 >> 172.21.15.112:0/1087496729 conn(0x7fe9a00f80f0 msgr2=0x7fe9a00f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.522+0000 7fe9a6c6c640 1 -- 172.21.15.112:0/1087496729 shutdown_connections 2024-09-19T09:46:12.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:12.522+0000 7fe9a6c6c640 1 -- 172.21.15.112:0/1087496729 wait complete. 2024-09-19T09:46:13.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:12 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/1087496729' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-19T09:46:13.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:12 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/1087496729' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-19T09:46:13.311 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-09-19T09:46:13.312 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-19T09:46:13.559 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:14.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:13 smithi191 ceph-mon[77624]: pgmap v268: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:14.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:13 smithi112 ceph-mon[97503]: pgmap v268: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:15.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.228+0000 7faf9d19c640 1 -- 172.21.15.112:0/2599386924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf98102550 msgr2=0x7faf98102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:15.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.228+0000 7faf9d19c640 1 --2- 172.21.15.112:0/2599386924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf98102550 0x7faf98102920 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faf880048d0 tx=0x7faf88009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:15.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.228+0000 7faf9d19c640 1 -- 172.21.15.112:0/2599386924 shutdown_connections 2024-09-19T09:46:15.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.228+0000 7faf9d19c640 1 --2- 172.21.15.112:0/2599386924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf98102ef0 0x7faf980fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:15.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.228+0000 7faf9d19c640 1 --2- 172.21.15.112:0/2599386924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf98102550 0x7faf98102920 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:15.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.228+0000 7faf9d19c640 1 -- 172.21.15.112:0/2599386924 >> 172.21.15.112:0/2599386924 conn(0x7faf980f80f0 msgr2=0x7faf980fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:15.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.228+0000 7faf9d19c640 1 -- 172.21.15.112:0/2599386924 shutdown_connections 2024-09-19T09:46:15.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.228+0000 7faf9d19c640 1 -- 172.21.15.112:0/2599386924 wait complete. 2024-09-19T09:46:15.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.229+0000 7faf9d19c640 1 Processor -- start 2024-09-19T09:46:15.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.229+0000 7faf9d19c640 1 -- start start 2024-09-19T09:46:15.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.229+0000 7faf9d19c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf98102550 0x7faf981135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:15.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.229+0000 7faf9d19c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf98102ef0 0x7faf98113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:15.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.229+0000 7faf9d19c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf981141d0 con 0x7faf98102ef0 2024-09-19T09:46:15.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.229+0000 7faf9d19c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9810d550 con 0x7faf98102550 2024-09-19T09:46:15.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.229+0000 7faf9659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf98102ef0 0x7faf98113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:15.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.229+0000 7faf9659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf98102ef0 0x7faf98113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34396/0 (socket says 172.21.15.112:34396) 2024-09-19T09:46:15.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.229+0000 7faf9659c640 1 -- 172.21.15.112:0/3726798126 learned_addr learned my addr 172.21.15.112:0/3726798126 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:15.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.229+0000 7faf96d9d640 1 --2- 172.21.15.112:0/3726798126 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf98102550 0x7faf981135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.229+0000 7faf9659c640 1 -- 172.21.15.112:0/3726798126 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf98102550 msgr2=0x7faf981135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.229+0000 7faf9659c640 1 --2- 172.21.15.112:0/3726798126 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf98102550 0x7faf981135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.229+0000 7faf9659c640 1 -- 172.21.15.112:0/3726798126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf88005040 con 0x7faf98102ef0 2024-09-19T09:46:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.229+0000 7faf96d9d640 1 --2- 172.21.15.112:0/3726798126 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf98102550 0x7faf981135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:46:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.229+0000 7faf9659c640 1 --2- 172.21.15.112:0/3726798126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf98102ef0 0x7faf98113af0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00b540 tx=0x7faf8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.230+0000 7faf7f7fe640 1 -- 172.21.15.112:0/3726798126 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf8c00f6f0 con 0x7faf98102ef0 2024-09-19T09:46:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.230+0000 7faf9d19c640 1 -- 172.21.15.112:0/3726798126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9810d7e0 con 0x7faf98102ef0 2024-09-19T09:46:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.230+0000 7faf7f7fe640 1 -- 172.21.15.112:0/3726798126 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faf8c00fcf0 con 0x7faf98102ef0 2024-09-19T09:46:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.230+0000 7faf7f7fe640 1 -- 172.21.15.112:0/3726798126 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf8c0103a0 con 0x7faf98102ef0 2024-09-19T09:46:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.230+0000 7faf9d19c640 1 -- 172.21.15.112:0/3726798126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9810dd00 con 0x7faf98102ef0 2024-09-19T09:46:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.231+0000 7faf9d19c640 1 -- 172.21.15.112:0/3726798126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf980fdcd0 con 0x7faf98102ef0 2024-09-19T09:46:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.231+0000 7faf7f7fe640 1 -- 172.21.15.112:0/3726798126 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7faf8c00f850 con 0x7faf98102ef0 2024-09-19T09:46:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.232+0000 7faf7f7fe640 1 --2- 172.21.15.112:0/3726798126 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7faf8006e530 0x7faf800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.232+0000 7faf7f7fe640 1 -- 172.21.15.112:0/3726798126 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7faf8c08e0d0 con 0x7faf98102ef0 2024-09-19T09:46:15.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.232+0000 7faf96d9d640 1 --2- 172.21.15.112:0/3726798126 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7faf8006e530 0x7faf800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:15.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.232+0000 7faf96d9d640 1 --2- 172.21.15.112:0/3726798126 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7faf8006e530 0x7faf800709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faf880043d0 tx=0x7faf88009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:15.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.236+0000 7faf7f7fe640 1 -- 172.21.15.112:0/3726798126 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7faf8c0571d0 con 0x7faf98102ef0 2024-09-19T09:46:15.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.439+0000 7faf9d19c640 1 -- 172.21.15.112:0/3726798126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7faf980fbd50 con 0x7faf98102ef0 2024-09-19T09:46:15.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.440+0000 7faf7f7fe640 1 -- 172.21.15.112:0/3726798126 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v36) v1 ==== 107+0+4915 (secure 0 0 0) 0x7faf8c05a890 con 0x7faf98102ef0 2024-09-19T09:46:15.442 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:15.442 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":19,"btime":"2024-09-19T09:43:08:949728+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi191.qweljt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.191:6827/1382170395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1382170395},{"type":"v1","addr":"172.21.15.191:6827","nonce":1382170395}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24281,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/2759077122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2759077122},{"type":"v1","addr":"172.21.15.191:6825","nonce":2759077122}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34380,"name":"cephfs.smithi112.ymjyok","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/426090252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":426090252},{"type":"v1","addr":"172.21.15.112:6827","nonce":426090252}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:43:07.938222+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi112.hcoxjz","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6829/165136062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":165136062},{"type":"v1","addr":"172.21.15.112:6829","nonce":165136062}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14460,"qdb_cluster":[14460]},"id":1}]} 2024-09-19T09:46:15.442 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 19 2024-09-19T09:46:15.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.442+0000 7faf9d19c640 1 -- 172.21.15.112:0/3726798126 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7faf8006e530 msgr2=0x7faf800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:15.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.442+0000 7faf9d19c640 1 --2- 172.21.15.112:0/3726798126 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7faf8006e530 0x7faf800709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faf880043d0 tx=0x7faf88009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:15.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.442+0000 7faf9d19c640 1 -- 172.21.15.112:0/3726798126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf98102ef0 msgr2=0x7faf98113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:15.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.442+0000 7faf9d19c640 1 --2- 172.21.15.112:0/3726798126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf98102ef0 0x7faf98113af0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00b540 tx=0x7faf8c0091a0 comp rx=0 tx=0).stop 2024-09-19T09:46:15.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.442+0000 7faf9d19c640 1 -- 172.21.15.112:0/3726798126 shutdown_connections 2024-09-19T09:46:15.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.442+0000 7faf9d19c640 1 --2- 172.21.15.112:0/3726798126 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7faf8006e530 0x7faf800709e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:15.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.442+0000 7faf9d19c640 1 --2- 172.21.15.112:0/3726798126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf98102ef0 0x7faf98113af0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:15.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.442+0000 7faf9d19c640 1 --2- 172.21.15.112:0/3726798126 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf98102550 0x7faf981135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:15.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.442+0000 7faf9d19c640 1 -- 172.21.15.112:0/3726798126 >> 172.21.15.112:0/3726798126 conn(0x7faf980f80f0 msgr2=0x7faf980f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:15.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.442+0000 7faf9d19c640 1 -- 172.21.15.112:0/3726798126 shutdown_connections 2024-09-19T09:46:15.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:15.442+0000 7faf9d19c640 1 -- 172.21.15.112:0/3726798126 wait complete. 2024-09-19T09:46:16.149 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:15 smithi112 ceph-mon[97503]: pgmap v269: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:16.150 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:15 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3726798126' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-19T09:46:16.174 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-09-19T09:46:16.174 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-19T09:46:16.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:15 smithi191 ceph-mon[77624]: pgmap v269: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:16.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:15 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3726798126' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-19T09:46:16.419 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:18.167 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:17 smithi112 ceph-mon[97503]: pgmap v270: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:18.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.243+0000 7fbe03557640 1 -- 172.21.15.112:0/409356152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc06fa50 msgr2=0x7fbdfc06fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:18.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.243+0000 7fbe03557640 1 --2- 172.21.15.112:0/409356152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc06fa50 0x7fbdfc06fe20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80048d0 tx=0x7fbdf8009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:18.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.243+0000 7fbe03557640 1 -- 172.21.15.112:0/409356152 shutdown_connections 2024-09-19T09:46:18.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.243+0000 7fbe03557640 1 --2- 172.21.15.112:0/409356152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdfc070360 0x7fbdfc108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.243+0000 7fbe03557640 1 --2- 172.21.15.112:0/409356152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc06fa50 0x7fbdfc06fe20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.243+0000 7fbe03557640 1 -- 172.21.15.112:0/409356152 >> 172.21.15.112:0/409356152 conn(0x7fbdfc0f8100 msgr2=0x7fbdfc0fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.243+0000 7fbe03557640 1 -- 172.21.15.112:0/409356152 shutdown_connections 2024-09-19T09:46:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.243+0000 7fbe03557640 1 -- 172.21.15.112:0/409356152 wait complete. 2024-09-19T09:46:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.244+0000 7fbe03557640 1 Processor -- start 2024-09-19T09:46:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.244+0000 7fbe03557640 1 -- start start 2024-09-19T09:46:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.244+0000 7fbe03557640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdfc06fa50 0x7fbdfc1154b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.244+0000 7fbe03557640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc070360 0x7fbdfc1159f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.244+0000 7fbe03557640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc116040 con 0x7fbdfc070360 2024-09-19T09:46:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.244+0000 7fbe03557640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc10f450 con 0x7fbdfc06fa50 2024-09-19T09:46:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.244+0000 7fbe00af2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc070360 0x7fbdfc1159f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.244+0000 7fbe00af2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc070360 0x7fbdfc1159f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34412/0 (socket says 172.21.15.112:34412) 2024-09-19T09:46:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.244+0000 7fbe00af2640 1 -- 172.21.15.112:0/792150194 learned_addr learned my addr 172.21.15.112:0/792150194 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:18.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.244+0000 7fbe012f3640 1 --2- 172.21.15.112:0/792150194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdfc06fa50 0x7fbdfc1154b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:18.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.245+0000 7fbe00af2640 1 -- 172.21.15.112:0/792150194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdfc06fa50 msgr2=0x7fbdfc1154b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:18.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.245+0000 7fbe00af2640 1 --2- 172.21.15.112:0/792150194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdfc06fa50 0x7fbdfc1154b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:18.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.245+0000 7fbe00af2640 1 -- 172.21.15.112:0/792150194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf8005040 con 0x7fbdfc070360 2024-09-19T09:46:18.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.245+0000 7fbe00af2640 1 --2- 172.21.15.112:0/792150194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc070360 0x7fbdfc1159f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00c790 tx=0x7fbdec0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:18.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.245+0000 7fbdf1ffb640 1 -- 172.21.15.112:0/792150194 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdec00a820 con 0x7fbdfc070360 2024-09-19T09:46:18.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.245+0000 7fbdf1ffb640 1 -- 172.21.15.112:0/792150194 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbdec00ae20 con 0x7fbdfc070360 2024-09-19T09:46:18.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.245+0000 7fbe03557640 1 -- 172.21.15.112:0/792150194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc10f730 con 0x7fbdfc070360 2024-09-19T09:46:18.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.245+0000 7fbdf1ffb640 1 -- 172.21.15.112:0/792150194 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdec0113a0 con 0x7fbdfc070360 2024-09-19T09:46:18.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.245+0000 7fbe03557640 1 -- 172.21.15.112:0/792150194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc10fc50 con 0x7fbdfc070360 2024-09-19T09:46:18.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.246+0000 7fbe03557640 1 -- 172.21.15.112:0/792150194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdfc071190 con 0x7fbdfc070360 2024-09-19T09:46:18.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.246+0000 7fbdf1ffb640 1 -- 172.21.15.112:0/792150194 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fbdec012400 con 0x7fbdfc070360 2024-09-19T09:46:18.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.247+0000 7fbdf1ffb640 1 --2- 172.21.15.112:0/792150194 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fbde806e530 0x7fbde80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:18.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.247+0000 7fbdf1ffb640 1 -- 172.21.15.112:0/792150194 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7fbdec08e430 con 0x7fbdfc070360 2024-09-19T09:46:18.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.247+0000 7fbe012f3640 1 --2- 172.21.15.112:0/792150194 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fbde806e530 0x7fbde80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:18.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.247+0000 7fbe012f3640 1 --2- 172.21.15.112:0/792150194 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fbde806e530 0x7fbde80709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009ac0 tx=0x7fbdf8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:18.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.251+0000 7fbdf1ffb640 1 -- 172.21.15.112:0/792150194 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fbdec057490 con 0x7fbdfc070360 2024-09-19T09:46:18.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:17 smithi191 ceph-mon[77624]: pgmap v270: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:18.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.458+0000 7fbe03557640 1 -- 172.21.15.112:0/792150194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fbdfc10b790 con 0x7fbdfc070360 2024-09-19T09:46:18.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.459+0000 7fbdf1ffb640 1 -- 172.21.15.112:0/792150194 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v36) v1 ==== 107+0+4136 (secure 0 0 0) 0x7fbdec00a980 con 0x7fbdfc070360 2024-09-19T09:46:18.461 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:18.461 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"btime":"2024-09-19T09:43:11:965062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi191.qweljt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.191:6827/1382170395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1382170395},{"type":"v1","addr":"172.21.15.191:6827","nonce":1382170395}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24281,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/2759077122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2759077122},{"type":"v1","addr":"172.21.15.191:6825","nonce":2759077122}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:43:07.938222+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi112.hcoxjz","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6829/165136062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":165136062},{"type":"v1","addr":"172.21.15.112:6829","nonce":165136062}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14460,"qdb_cluster":[14460]},"id":1}]} 2024-09-19T09:46:18.461 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 20 2024-09-19T09:46:18.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.461+0000 7fbe03557640 1 -- 172.21.15.112:0/792150194 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fbde806e530 msgr2=0x7fbde80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:18.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.461+0000 7fbe03557640 1 --2- 172.21.15.112:0/792150194 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fbde806e530 0x7fbde80709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009ac0 tx=0x7fbdf8035040 comp rx=0 tx=0).stop 2024-09-19T09:46:18.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.461+0000 7fbe03557640 1 -- 172.21.15.112:0/792150194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc070360 msgr2=0x7fbdfc1159f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:18.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.461+0000 7fbe03557640 1 --2- 172.21.15.112:0/792150194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc070360 0x7fbdfc1159f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00c790 tx=0x7fbdec0043c0 comp rx=0 tx=0).stop 2024-09-19T09:46:18.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.461+0000 7fbe03557640 1 -- 172.21.15.112:0/792150194 shutdown_connections 2024-09-19T09:46:18.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.461+0000 7fbe03557640 1 --2- 172.21.15.112:0/792150194 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fbde806e530 0x7fbde80709e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:18.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.461+0000 7fbe03557640 1 --2- 172.21.15.112:0/792150194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc070360 0x7fbdfc1159f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:18.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.461+0000 7fbe03557640 1 --2- 172.21.15.112:0/792150194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdfc06fa50 0x7fbdfc1154b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:18.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.461+0000 7fbe03557640 1 -- 172.21.15.112:0/792150194 >> 172.21.15.112:0/792150194 conn(0x7fbdfc0f8100 msgr2=0x7fbdfc0f9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:18.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.461+0000 7fbe03557640 1 -- 172.21.15.112:0/792150194 shutdown_connections 2024-09-19T09:46:18.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:18.461+0000 7fbe03557640 1 -- 172.21.15.112:0/792150194 wait complete. 2024-09-19T09:46:19.130 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:18 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/792150194' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-19T09:46:19.155 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-19T09:46:19.155 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-19T09:46:19.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:18 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/792150194' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-19T09:46:19.399 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:20.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:19 smithi112 ceph-mon[97503]: pgmap v271: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:46:20.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:19 smithi191 ceph-mon[77624]: pgmap v271: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:46:21.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.117+0000 7fae7b321640 1 -- 172.21.15.112:0/3786901141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae74102ef0 msgr2=0x7fae740fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.117+0000 7fae7b321640 1 --2- 172.21.15.112:0/3786901141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae74102ef0 0x7fae740fc5b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fae640048d0 tx=0x7fae64009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.117+0000 7fae7b321640 1 -- 172.21.15.112:0/3786901141 shutdown_connections 2024-09-19T09:46:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.117+0000 7fae7b321640 1 --2- 172.21.15.112:0/3786901141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae74102ef0 0x7fae740fc5b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.117+0000 7fae7b321640 1 --2- 172.21.15.112:0/3786901141 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae74102550 0x7fae74102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.117+0000 7fae7b321640 1 -- 172.21.15.112:0/3786901141 >> 172.21.15.112:0/3786901141 conn(0x7fae740f80f0 msgr2=0x7fae740fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.117+0000 7fae7b321640 1 -- 172.21.15.112:0/3786901141 shutdown_connections 2024-09-19T09:46:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.117+0000 7fae7b321640 1 -- 172.21.15.112:0/3786901141 wait complete. 2024-09-19T09:46:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.117+0000 7fae7b321640 1 Processor -- start 2024-09-19T09:46:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.117+0000 7fae7b321640 1 -- start start 2024-09-19T09:46:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.117+0000 7fae7b321640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae74102550 0x7fae74113530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.117+0000 7fae7b321640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae74102ef0 0x7fae74113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:21.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.117+0000 7fae7b321640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae741140c0 con 0x7fae74102ef0 2024-09-19T09:46:21.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.117+0000 7fae7b321640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7410d4d0 con 0x7fae74102550 2024-09-19T09:46:21.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.118+0000 7fae788bc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae74102ef0 0x7fae74113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:21.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.118+0000 7fae790bd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae74102550 0x7fae74113530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:21.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.118+0000 7fae788bc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae74102ef0 0x7fae74113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46894/0 (socket says 172.21.15.112:46894) 2024-09-19T09:46:21.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.118+0000 7fae788bc640 1 -- 172.21.15.112:0/2694734016 learned_addr learned my addr 172.21.15.112:0/2694734016 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:21.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.118+0000 7fae788bc640 1 -- 172.21.15.112:0/2694734016 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae74102550 msgr2=0x7fae74113530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:21.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.118+0000 7fae788bc640 1 --2- 172.21.15.112:0/2694734016 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae74102550 0x7fae74113530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:21.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.118+0000 7fae788bc640 1 -- 172.21.15.112:0/2694734016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae64005040 con 0x7fae74102ef0 2024-09-19T09:46:21.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.118+0000 7fae790bd640 1 --2- 172.21.15.112:0/2694734016 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae74102550 0x7fae74113530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:46:21.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.118+0000 7fae788bc640 1 --2- 172.21.15.112:0/2694734016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae74102ef0 0x7fae74113a70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fae6402a530 tx=0x7fae64009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:21.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.118+0000 7fae69ffb640 1 -- 172.21.15.112:0/2694734016 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae64038070 con 0x7fae74102ef0 2024-09-19T09:46:21.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.118+0000 7fae69ffb640 1 -- 172.21.15.112:0/2694734016 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fae6402ade0 con 0x7fae74102ef0 2024-09-19T09:46:21.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.118+0000 7fae7b321640 1 -- 172.21.15.112:0/2694734016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7410d750 con 0x7fae74102ef0 2024-09-19T09:46:21.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.118+0000 7fae69ffb640 1 -- 172.21.15.112:0/2694734016 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae6402c7a0 con 0x7fae74102ef0 2024-09-19T09:46:21.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.119+0000 7fae7b321640 1 -- 172.21.15.112:0/2694734016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7410dc90 con 0x7fae74102ef0 2024-09-19T09:46:21.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.119+0000 7fae7b321640 1 -- 172.21.15.112:0/2694734016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae740fdcd0 con 0x7fae74102ef0 2024-09-19T09:46:21.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.120+0000 7fae69ffb640 1 -- 172.21.15.112:0/2694734016 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fae64030020 con 0x7fae74102ef0 2024-09-19T09:46:21.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.120+0000 7fae69ffb640 1 --2- 172.21.15.112:0/2694734016 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fae6006e530 0x7fae600709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:21.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.120+0000 7fae69ffb640 1 -- 172.21.15.112:0/2694734016 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7fae640ae6b0 con 0x7fae74102ef0 2024-09-19T09:46:21.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.120+0000 7fae790bd640 1 --2- 172.21.15.112:0/2694734016 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fae6006e530 0x7fae600709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:21.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.121+0000 7fae790bd640 1 --2- 172.21.15.112:0/2694734016 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fae6006e530 0x7fae600709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fae70004fd0 tx=0x7fae7000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:21.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.125+0000 7fae69ffb640 1 -- 172.21.15.112:0/2694734016 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fae64077690 con 0x7fae74102ef0 2024-09-19T09:46:21.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:20 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:21.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:20 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:21.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.341+0000 7fae7b321640 1 -- 172.21.15.112:0/2694734016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fae740fbd50 con 0x7fae74102ef0 2024-09-19T09:46:21.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.341+0000 7fae69ffb640 1 -- 172.21.15.112:0/2694734016 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v36) v1 ==== 107+0+4986 (secure 0 0 0) 0x7fae6407ad50 con 0x7fae74102ef0 2024-09-19T09:46:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:21.344 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":21,"btime":"2024-09-19T09:43:17:595098+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi191.qweljt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.191:6827/1382170395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1382170395},{"type":"v1","addr":"172.21.15.191:6827","nonce":1382170395}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24281,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/2759077122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2759077122},{"type":"v1","addr":"172.21.15.191:6825","nonce":2759077122}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:43:07.938222+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi112.hcoxjz","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6829/165136062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":165136062},{"type":"v1","addr":"172.21.15.112:6829","nonce":165136062}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14460,"qdb_cluster":[14460]},"id":1}]} 2024-09-19T09:46:21.344 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 21 2024-09-19T09:46:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.343+0000 7fae7b321640 1 -- 172.21.15.112:0/2694734016 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fae6006e530 msgr2=0x7fae600709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.343+0000 7fae7b321640 1 --2- 172.21.15.112:0/2694734016 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fae6006e530 0x7fae600709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fae70004fd0 tx=0x7fae7000b040 comp rx=0 tx=0).stop 2024-09-19T09:46:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.343+0000 7fae7b321640 1 -- 172.21.15.112:0/2694734016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae74102ef0 msgr2=0x7fae74113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.343+0000 7fae7b321640 1 --2- 172.21.15.112:0/2694734016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae74102ef0 0x7fae74113a70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fae6402a530 tx=0x7fae64009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.344+0000 7fae7b321640 1 -- 172.21.15.112:0/2694734016 shutdown_connections 2024-09-19T09:46:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.344+0000 7fae7b321640 1 --2- 172.21.15.112:0/2694734016 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fae6006e530 0x7fae600709e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.344+0000 7fae7b321640 1 --2- 172.21.15.112:0/2694734016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae74102ef0 0x7fae74113a70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:21.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.344+0000 7fae7b321640 1 --2- 172.21.15.112:0/2694734016 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae74102550 0x7fae74113530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:21.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.344+0000 7fae7b321640 1 -- 172.21.15.112:0/2694734016 >> 172.21.15.112:0/2694734016 conn(0x7fae740f80f0 msgr2=0x7fae740f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:21.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.344+0000 7fae7b321640 1 -- 172.21.15.112:0/2694734016 shutdown_connections 2024-09-19T09:46:21.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:21.344+0000 7fae7b321640 1 -- 172.21.15.112:0/2694734016 wait complete. 2024-09-19T09:46:21.986 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-19T09:46:21.986 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-19T09:46:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:22.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:21 smithi191 ceph-mon[77624]: pgmap v272: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:22.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:21 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:22.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:21 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:22.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:21 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:46:22.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:21 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2694734016' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-19T09:46:22.317 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:21 smithi112 ceph-mon[97503]: pgmap v272: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:22.317 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:21 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:22.317 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:21 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:22.317 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:21 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' 2024-09-19T09:46:22.317 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:21 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2694734016' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-19T09:46:23.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.888+0000 7fcc055d8640 1 -- 172.21.15.112:0/1750723726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc00102550 msgr2=0x7fcc00102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:23.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.888+0000 7fcc055d8640 1 --2- 172.21.15.112:0/1750723726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc00102550 0x7fcc00102920 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00048d0 tx=0x7fcbf0009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:23.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.888+0000 7fcc055d8640 1 -- 172.21.15.112:0/1750723726 shutdown_connections 2024-09-19T09:46:23.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.888+0000 7fcc055d8640 1 --2- 172.21.15.112:0/1750723726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc00102ef0 0x7fcc000fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:23.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.888+0000 7fcc055d8640 1 --2- 172.21.15.112:0/1750723726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc00102550 0x7fcc00102920 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:23.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.888+0000 7fcc055d8640 1 -- 172.21.15.112:0/1750723726 >> 172.21.15.112:0/1750723726 conn(0x7fcc000f80f0 msgr2=0x7fcc000fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:23.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.888+0000 7fcc055d8640 1 -- 172.21.15.112:0/1750723726 shutdown_connections 2024-09-19T09:46:23.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.888+0000 7fcc055d8640 1 -- 172.21.15.112:0/1750723726 wait complete. 2024-09-19T09:46:23.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.889+0000 7fcc055d8640 1 Processor -- start 2024-09-19T09:46:23.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.889+0000 7fcc055d8640 1 -- start start 2024-09-19T09:46:23.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.889+0000 7fcc055d8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc00102550 0x7fcc00113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:23.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.889+0000 7fcc055d8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc00102ef0 0x7fcc00113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:23.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.889+0000 7fcc055d8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00114100 con 0x7fcc00102ef0 2024-09-19T09:46:23.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.889+0000 7fcc055d8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0010d510 con 0x7fcc00102550 2024-09-19T09:46:23.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.889+0000 7fcbf67fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc00102ef0 0x7fcc00113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:23.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.889+0000 7fcbf67fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc00102ef0 0x7fcc00113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46914/0 (socket says 172.21.15.112:46914) 2024-09-19T09:46:23.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.889+0000 7fcbf67fc640 1 -- 172.21.15.112:0/1556150918 learned_addr learned my addr 172.21.15.112:0/1556150918 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:23.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.890+0000 7fcbfeffd640 1 --2- 172.21.15.112:0/1556150918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc00102550 0x7fcc00113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:23.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.890+0000 7fcbf67fc640 1 -- 172.21.15.112:0/1556150918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc00102550 msgr2=0x7fcc00113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:23.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.890+0000 7fcbf67fc640 1 --2- 172.21.15.112:0/1556150918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc00102550 0x7fcc00113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:23.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.890+0000 7fcbf67fc640 1 -- 172.21.15.112:0/1556150918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf0005040 con 0x7fcc00102ef0 2024-09-19T09:46:23.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.890+0000 7fcbfeffd640 1 --2- 172.21.15.112:0/1556150918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc00102550 0x7fcc00113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:46:23.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.890+0000 7fcbf67fc640 1 --2- 172.21.15.112:0/1556150918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc00102ef0 0x7fcc00113ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8002870 tx=0x7fcbe8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:23.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.890+0000 7fcbf7fff640 1 -- 172.21.15.112:0/1556150918 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe8007c30 con 0x7fcc00102ef0 2024-09-19T09:46:23.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.890+0000 7fcbf7fff640 1 -- 172.21.15.112:0/1556150918 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcbe800f040 con 0x7fcc00102ef0 2024-09-19T09:46:23.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.890+0000 7fcc055d8640 1 -- 172.21.15.112:0/1556150918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0010d7f0 con 0x7fcc00102ef0 2024-09-19T09:46:23.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.890+0000 7fcbf7fff640 1 -- 172.21.15.112:0/1556150918 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe8009640 con 0x7fcc00102ef0 2024-09-19T09:46:23.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.890+0000 7fcc055d8640 1 -- 172.21.15.112:0/1556150918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0010dd10 con 0x7fcc00102ef0 2024-09-19T09:46:23.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.891+0000 7fcc055d8640 1 -- 172.21.15.112:0/1556150918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc000fdcd0 con 0x7fcc00102ef0 2024-09-19T09:46:23.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.892+0000 7fcbf7fff640 1 -- 172.21.15.112:0/1556150918 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fcbe80097a0 con 0x7fcc00102ef0 2024-09-19T09:46:23.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.892+0000 7fcbf7fff640 1 --2- 172.21.15.112:0/1556150918 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fcbec06e530 0x7fcbec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:23.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.892+0000 7fcbf7fff640 1 -- 172.21.15.112:0/1556150918 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7fcbe808e200 con 0x7fcc00102ef0 2024-09-19T09:46:23.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.892+0000 7fcbfeffd640 1 --2- 172.21.15.112:0/1556150918 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fcbec06e530 0x7fcbec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:23.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.893+0000 7fcbfeffd640 1 --2- 172.21.15.112:0/1556150918 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fcbec06e530 0x7fcbec0709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000b020 tx=0x7fcbf0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:23.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:23.897+0000 7fcbf7fff640 1 -- 172.21.15.112:0/1556150918 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fcbe8057290 con 0x7fcc00102ef0 2024-09-19T09:46:24.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:24.097+0000 7fcc055d8640 1 -- 172.21.15.112:0/1556150918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fcc001095a0 con 0x7fcc00102ef0 2024-09-19T09:46:24.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:24.098+0000 7fcbf7fff640 1 -- 172.21.15.112:0/1556150918 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v36) v1 ==== 107+0+4188 (secure 0 0 0) 0x7fcbe805a950 con 0x7fcc00102ef0 2024-09-19T09:46:24.100 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:24.100 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":22,"btime":"2024-09-19T09:43:30:254563+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi191.qweljt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.191:6827/1382170395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1382170395},{"type":"v1","addr":"172.21.15.191:6827","nonce":1382170395}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24281,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/2759077122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2759077122},{"type":"v1","addr":"172.21.15.191:6825","nonce":2759077122}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:43:30.254562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T09:46:24.101 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 22 2024-09-19T09:46:24.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:24.100+0000 7fcc055d8640 1 -- 172.21.15.112:0/1556150918 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fcbec06e530 msgr2=0x7fcbec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:24.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:24.100+0000 7fcc055d8640 1 --2- 172.21.15.112:0/1556150918 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fcbec06e530 0x7fcbec0709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000b020 tx=0x7fcbf0009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:24.100+0000 7fcc055d8640 1 -- 172.21.15.112:0/1556150918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc00102ef0 msgr2=0x7fcc00113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:24.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:24.100+0000 7fcc055d8640 1 --2- 172.21.15.112:0/1556150918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc00102ef0 0x7fcc00113ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8002870 tx=0x7fcbe8004600 comp rx=0 tx=0).stop 2024-09-19T09:46:24.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:24.100+0000 7fcc055d8640 1 -- 172.21.15.112:0/1556150918 shutdown_connections 2024-09-19T09:46:24.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:24.100+0000 7fcc055d8640 1 --2- 172.21.15.112:0/1556150918 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fcbec06e530 0x7fcbec0709e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:24.100+0000 7fcc055d8640 1 --2- 172.21.15.112:0/1556150918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc00102ef0 0x7fcc00113ab0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:24.100+0000 7fcc055d8640 1 --2- 172.21.15.112:0/1556150918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc00102550 0x7fcc00113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:24.100+0000 7fcc055d8640 1 -- 172.21.15.112:0/1556150918 >> 172.21.15.112:0/1556150918 conn(0x7fcc000f80f0 msgr2=0x7fcc000f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:24.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:24.100+0000 7fcc055d8640 1 -- 172.21.15.112:0/1556150918 shutdown_connections 2024-09-19T09:46:24.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:24.101+0000 7fcc055d8640 1 -- 172.21.15.112:0/1556150918 wait complete. 2024-09-19T09:46:24.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:23 smithi191 ceph-mon[77624]: pgmap v273: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:24.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:23 smithi112 ceph-mon[97503]: pgmap v273: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:24.839 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-19T09:46:24.840 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-19T09:46:25.085 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:25.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:24 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/1556150918' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-19T09:46:25.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:24 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:46:25.326 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:24 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/1556150918' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-19T09:46:25.326 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:24 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:46:26.132 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:25 smithi112 ceph-mon[97503]: pgmap v274: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:26.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:25 smithi191 ceph-mon[77624]: pgmap v274: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:26.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.619+0000 7f6826869640 1 -- 172.21.15.112:0/3866513244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200fcf80 msgr2=0x7f68200fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:26.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.619+0000 7f6826869640 1 --2- 172.21.15.112:0/3866513244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200fcf80 0x7f68200fd3d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f68080048d0 tx=0x7f6808009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.620+0000 7f6826869640 1 -- 172.21.15.112:0/3866513244 shutdown_connections 2024-09-19T09:46:26.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.620+0000 7f6826869640 1 --2- 172.21.15.112:0/3866513244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200fcf80 0x7f68200fd3d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.620+0000 7f6826869640 1 --2- 172.21.15.112:0/3866513244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68200fb810 0x7f68200fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.620+0000 7f6826869640 1 -- 172.21.15.112:0/3866513244 >> 172.21.15.112:0/3866513244 conn(0x7f68200723b0 msgr2=0x7f68200727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:26.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.620+0000 7f6826869640 1 -- 172.21.15.112:0/3866513244 shutdown_connections 2024-09-19T09:46:26.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.620+0000 7f6826869640 1 -- 172.21.15.112:0/3866513244 wait complete. 2024-09-19T09:46:26.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.620+0000 7f6826869640 1 Processor -- start 2024-09-19T09:46:26.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.620+0000 7f6826869640 1 -- start start 2024-09-19T09:46:26.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.620+0000 7f6826869640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68200fb810 0x7f6820113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:26.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.620+0000 7f6826869640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200fcf80 0x7f68201137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:26.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.620+0000 7f6826869640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6820113e30 con 0x7f68200fcf80 2024-09-19T09:46:26.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.620+0000 7f6826869640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682010d1e0 con 0x7f68200fb810 2024-09-19T09:46:26.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.621+0000 7f681f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200fcf80 0x7f68201137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:26.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.621+0000 7f681f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200fcf80 0x7f68201137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46928/0 (socket says 172.21.15.112:46928) 2024-09-19T09:46:26.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.621+0000 7f681f7fe640 1 -- 172.21.15.112:0/3919464473 learned_addr learned my addr 172.21.15.112:0/3919464473 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:26.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.621+0000 7f681ffff640 1 --2- 172.21.15.112:0/3919464473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68200fb810 0x7f6820113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:26.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.621+0000 7f681f7fe640 1 -- 172.21.15.112:0/3919464473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68200fb810 msgr2=0x7f6820113260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:26.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.621+0000 7f681f7fe640 1 --2- 172.21.15.112:0/3919464473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68200fb810 0x7f6820113260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.621+0000 7f681f7fe640 1 -- 172.21.15.112:0/3919464473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6808005040 con 0x7f68200fcf80 2024-09-19T09:46:26.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.621+0000 7f681f7fe640 1 --2- 172.21.15.112:0/3919464473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200fcf80 0x7f68201137a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6808003080 tx=0x7f6808009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:26.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.621+0000 7f681cff9640 1 -- 172.21.15.112:0/3919464473 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6808038070 con 0x7f68200fcf80 2024-09-19T09:46:26.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.621+0000 7f681cff9640 1 -- 172.21.15.112:0/3919464473 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f68080097e0 con 0x7f68200fcf80 2024-09-19T09:46:26.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.621+0000 7f681cff9640 1 -- 172.21.15.112:0/3919464473 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f680803d420 con 0x7f68200fcf80 2024-09-19T09:46:26.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.621+0000 7f6826869640 1 -- 172.21.15.112:0/3919464473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682010d460 con 0x7f68200fcf80 2024-09-19T09:46:26.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.621+0000 7f6826869640 1 -- 172.21.15.112:0/3919464473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682010d920 con 0x7f68200fcf80 2024-09-19T09:46:26.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.623+0000 7f6826869640 1 -- 172.21.15.112:0/3919464473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68200fcbc0 con 0x7f68200fcf80 2024-09-19T09:46:26.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.623+0000 7f681cff9640 1 -- 172.21.15.112:0/3919464473 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6808030020 con 0x7f68200fcf80 2024-09-19T09:46:26.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.624+0000 7f681cff9640 1 --2- 172.21.15.112:0/3919464473 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f680c06e530 0x7f680c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:26.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.624+0000 7f681cff9640 1 -- 172.21.15.112:0/3919464473 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f68080ae7c0 con 0x7f68200fcf80 2024-09-19T09:46:26.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.624+0000 7f681ffff640 1 --2- 172.21.15.112:0/3919464473 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f680c06e530 0x7f680c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:26.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.624+0000 7f681ffff640 1 --2- 172.21.15.112:0/3919464473 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f680c06e530 0x7f680c0709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6810006fd0 tx=0x7f6810008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:26.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.628+0000 7f681cff9640 1 -- 172.21.15.112:0/3919464473 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f68080777a0 con 0x7f68200fcf80 2024-09-19T09:46:26.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.829+0000 7f6826869640 1 -- 172.21.15.112:0/3919464473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f682010e900 con 0x7f68200fcf80 2024-09-19T09:46:26.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.830+0000 7f681cff9640 1 -- 172.21.15.112:0/3919464473 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v36) v1 ==== 107+0+4199 (secure 0 0 0) 0x7f680807ae60 con 0x7f68200fcf80 2024-09-19T09:46:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:26.832 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":23,"btime":"2024-09-19T09:43:30:259011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/2759077122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2759077122},{"type":"v1","addr":"172.21.15.191:6825","nonce":2759077122}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:43:30.258998+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi191.qweljt","rank":0,"incarnation":23,"state":"up:replay","state_seq":2,"addr":"172.21.15.191:6827/1382170395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1382170395},{"type":"v1","addr":"172.21.15.191:6827","nonce":1382170395}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T09:46:26.833 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 23 2024-09-19T09:46:26.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.832+0000 7f6826869640 1 -- 172.21.15.112:0/3919464473 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f680c06e530 msgr2=0x7f680c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:26.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.832+0000 7f6826869640 1 --2- 172.21.15.112:0/3919464473 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f680c06e530 0x7f680c0709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6810006fd0 tx=0x7f6810008040 comp rx=0 tx=0).stop 2024-09-19T09:46:26.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.832+0000 7f6826869640 1 -- 172.21.15.112:0/3919464473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200fcf80 msgr2=0x7f68201137a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:26.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.832+0000 7f6826869640 1 --2- 172.21.15.112:0/3919464473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200fcf80 0x7f68201137a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6808003080 tx=0x7f6808009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.832+0000 7f6826869640 1 -- 172.21.15.112:0/3919464473 shutdown_connections 2024-09-19T09:46:26.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.832+0000 7f6826869640 1 --2- 172.21.15.112:0/3919464473 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f680c06e530 0x7f680c0709e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.832+0000 7f6826869640 1 --2- 172.21.15.112:0/3919464473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200fcf80 0x7f68201137a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.832+0000 7f6826869640 1 --2- 172.21.15.112:0/3919464473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68200fb810 0x7f6820113260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.832+0000 7f6826869640 1 -- 172.21.15.112:0/3919464473 >> 172.21.15.112:0/3919464473 conn(0x7f68200723b0 msgr2=0x7f6820064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:26.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.832+0000 7f6826869640 1 -- 172.21.15.112:0/3919464473 shutdown_connections 2024-09-19T09:46:26.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:26.832+0000 7f6826869640 1 -- 172.21.15.112:0/3919464473 wait complete. 2024-09-19T09:46:27.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:27 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3919464473' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-19T09:46:27.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:27 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3919464473' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-19T09:46:27.573 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-19T09:46:27.573 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-19T09:46:27.825 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:28.107 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:28 smithi112 ceph-mon[97503]: pgmap v275: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:28.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:28 smithi191 ceph-mon[77624]: pgmap v275: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:29.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.517+0000 7f4206b6c640 1 -- 172.21.15.112:0/3669968928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42000fac60 msgr2=0x7f42000fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:29.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.517+0000 7f4206b6c640 1 --2- 172.21.15.112:0/3669968928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42000fac60 0x7f42000fb0b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f41f00048d0 tx=0x7f41f0009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.517+0000 7f4206b6c640 1 -- 172.21.15.112:0/3669968928 shutdown_connections 2024-09-19T09:46:29.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.517+0000 7f4206b6c640 1 --2- 172.21.15.112:0/3669968928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42000fac60 0x7f42000fb0b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.517+0000 7f4206b6c640 1 --2- 172.21.15.112:0/3669968928 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42001025f0 0x7f42001029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.517+0000 7f4206b6c640 1 -- 172.21.15.112:0/3669968928 >> 172.21.15.112:0/3669968928 conn(0x7f4200070c80 msgr2=0x7f4200071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:29.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.518+0000 7f4206b6c640 1 -- 172.21.15.112:0/3669968928 shutdown_connections 2024-09-19T09:46:29.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.518+0000 7f4206b6c640 1 -- 172.21.15.112:0/3669968928 wait complete. 2024-09-19T09:46:29.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.518+0000 7f4206b6c640 1 Processor -- start 2024-09-19T09:46:29.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.518+0000 7f4206b6c640 1 -- start start 2024-09-19T09:46:29.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.518+0000 7f4206b6c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42000fac60 0x7f4200113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:29.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.518+0000 7f4206b6c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42001025f0 0x7f4200113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:29.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.518+0000 7f4206b6c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4200113e00 con 0x7f42001025f0 2024-09-19T09:46:29.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.518+0000 7f4206b6c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420010d1b0 con 0x7f42000fac60 2024-09-19T09:46:29.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.518+0000 7f41fffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42001025f0 0x7f4200113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:29.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.519+0000 7f41fffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42001025f0 0x7f4200113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43706/0 (socket says 172.21.15.112:43706) 2024-09-19T09:46:29.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.519+0000 7f41fffff640 1 -- 172.21.15.112:0/4290593840 learned_addr learned my addr 172.21.15.112:0/4290593840 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:29.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.519+0000 7f4204908640 1 --2- 172.21.15.112:0/4290593840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42000fac60 0x7f4200113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:29.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.519+0000 7f41fffff640 1 -- 172.21.15.112:0/4290593840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42000fac60 msgr2=0x7f4200113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:29.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.519+0000 7f41fffff640 1 --2- 172.21.15.112:0/4290593840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42000fac60 0x7f4200113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.519+0000 7f41fffff640 1 -- 172.21.15.112:0/4290593840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f0005040 con 0x7f42001025f0 2024-09-19T09:46:29.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.519+0000 7f41fffff640 1 --2- 172.21.15.112:0/4290593840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42001025f0 0x7f4200113770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f41f0003080 tx=0x7f41f0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:29.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.519+0000 7f41fd7fa640 1 -- 172.21.15.112:0/4290593840 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41f0038070 con 0x7f42001025f0 2024-09-19T09:46:29.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.519+0000 7f4206b6c640 1 -- 172.21.15.112:0/4290593840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420010d430 con 0x7f42001025f0 2024-09-19T09:46:29.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.519+0000 7f41fd7fa640 1 -- 172.21.15.112:0/4290593840 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f41f00097e0 con 0x7f42001025f0 2024-09-19T09:46:29.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.519+0000 7f41fd7fa640 1 -- 172.21.15.112:0/4290593840 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41f003d420 con 0x7f42001025f0 2024-09-19T09:46:29.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.519+0000 7f4206b6c640 1 -- 172.21.15.112:0/4290593840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420010d8f0 con 0x7f42001025f0 2024-09-19T09:46:29.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.520+0000 7f4206b6c640 1 -- 172.21.15.112:0/4290593840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4200065810 con 0x7f42001025f0 2024-09-19T09:46:29.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.521+0000 7f41fd7fa640 1 -- 172.21.15.112:0/4290593840 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f41f0030020 con 0x7f42001025f0 2024-09-19T09:46:29.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.521+0000 7f41fd7fa640 1 --2- 172.21.15.112:0/4290593840 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f41e806e530 0x7f41e80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:29.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.521+0000 7f41fd7fa640 1 -- 172.21.15.112:0/4290593840 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f41f00ae830 con 0x7f42001025f0 2024-09-19T09:46:29.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.521+0000 7f4204908640 1 --2- 172.21.15.112:0/4290593840 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f41e806e530 0x7f41e80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:29.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.522+0000 7f4204908640 1 --2- 172.21.15.112:0/4290593840 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f41e806e530 0x7f41e80709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f41f4006fd0 tx=0x7f41f4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:29.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.526+0000 7f41fd7fa640 1 -- 172.21.15.112:0/4290593840 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f41f0077810 con 0x7f42001025f0 2024-09-19T09:46:29.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.726+0000 7f4206b6c640 1 -- 172.21.15.112:0/4290593840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f4200109680 con 0x7f42001025f0 2024-09-19T09:46:29.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.727+0000 7f41fd7fa640 1 -- 172.21.15.112:0/4290593840 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v36) v1 ==== 107+0+4204 (secure 0 0 0) 0x7f41f007aed0 con 0x7f42001025f0 2024-09-19T09:46:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:29.729 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"btime":"2024-09-19T09:43:37:971204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/2759077122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2759077122},{"type":"v1","addr":"172.21.15.191:6825","nonce":2759077122}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:43:37.187166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi191.qweljt","rank":0,"incarnation":23,"state":"up:reconnect","state_seq":166,"addr":"172.21.15.191:6827/1382170395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1382170395},{"type":"v1","addr":"172.21.15.191:6827","nonce":1382170395}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T09:46:29.729 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 24 2024-09-19T09:46:29.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.729+0000 7f4206b6c640 1 -- 172.21.15.112:0/4290593840 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f41e806e530 msgr2=0x7f41e80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:29.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.729+0000 7f4206b6c640 1 --2- 172.21.15.112:0/4290593840 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f41e806e530 0x7f41e80709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f41f4006fd0 tx=0x7f41f4008040 comp rx=0 tx=0).stop 2024-09-19T09:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.729+0000 7f4206b6c640 1 -- 172.21.15.112:0/4290593840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42001025f0 msgr2=0x7f4200113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.729+0000 7f4206b6c640 1 --2- 172.21.15.112:0/4290593840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42001025f0 0x7f4200113770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f41f0003080 tx=0x7f41f0009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.729+0000 7f4206b6c640 1 -- 172.21.15.112:0/4290593840 shutdown_connections 2024-09-19T09:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.729+0000 7f4206b6c640 1 --2- 172.21.15.112:0/4290593840 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f41e806e530 0x7f41e80709e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.729+0000 7f4206b6c640 1 --2- 172.21.15.112:0/4290593840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42001025f0 0x7f4200113770 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.729+0000 7f4206b6c640 1 --2- 172.21.15.112:0/4290593840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42000fac60 0x7f4200113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.729+0000 7f4206b6c640 1 -- 172.21.15.112:0/4290593840 >> 172.21.15.112:0/4290593840 conn(0x7f4200070c80 msgr2=0x7f42000f9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.730+0000 7f4206b6c640 1 -- 172.21.15.112:0/4290593840 shutdown_connections 2024-09-19T09:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:29.730+0000 7f4206b6c640 1 -- 172.21.15.112:0/4290593840 wait complete. 2024-09-19T09:46:30.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:30 smithi191 ceph-mon[77624]: pgmap v276: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:46:30.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:30 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/4290593840' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-19T09:46:30.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:30 smithi112 ceph-mon[97503]: pgmap v276: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:46:30.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:30 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/4290593840' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-19T09:46:30.529 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-19T09:46:30.529 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-19T09:46:30.776 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:32.177 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:32 smithi112 ceph-mon[97503]: pgmap v277: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:32.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:32 smithi191 ceph-mon[77624]: pgmap v277: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:32.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.364+0000 7fb740345640 1 -- 172.21.15.112:0/1652440734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb738102550 msgr2=0x7fb738102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:32.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.364+0000 7fb740345640 1 --2- 172.21.15.112:0/1652440734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb738102550 0x7fb738102920 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb7340048d0 tx=0x7fb734009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.364+0000 7fb740345640 1 -- 172.21.15.112:0/1652440734 shutdown_connections 2024-09-19T09:46:32.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.364+0000 7fb740345640 1 --2- 172.21.15.112:0/1652440734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb738102ef0 0x7fb7380fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.364+0000 7fb740345640 1 --2- 172.21.15.112:0/1652440734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb738102550 0x7fb738102920 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.364+0000 7fb740345640 1 -- 172.21.15.112:0/1652440734 >> 172.21.15.112:0/1652440734 conn(0x7fb7380f80f0 msgr2=0x7fb7380fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.364+0000 7fb740345640 1 -- 172.21.15.112:0/1652440734 shutdown_connections 2024-09-19T09:46:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.364+0000 7fb740345640 1 -- 172.21.15.112:0/1652440734 wait complete. 2024-09-19T09:46:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.365+0000 7fb740345640 1 Processor -- start 2024-09-19T09:46:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.365+0000 7fb740345640 1 -- start start 2024-09-19T09:46:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.365+0000 7fb740345640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb738102550 0x7fb73806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.365+0000 7fb740345640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb738102ef0 0x7fb73806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.365+0000 7fb740345640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb738070490 con 0x7fb738102550 2024-09-19T09:46:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.365+0000 7fb740345640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb738070600 con 0x7fb738102ef0 2024-09-19T09:46:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.365+0000 7fb73e0e1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb738102550 0x7fb73806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.365+0000 7fb73e0e1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb738102550 0x7fb73806fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43730/0 (socket says 172.21.15.112:43730) 2024-09-19T09:46:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.365+0000 7fb73e0e1640 1 -- 172.21.15.112:0/3626316626 learned_addr learned my addr 172.21.15.112:0/3626316626 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.365+0000 7fb73d8e0640 1 --2- 172.21.15.112:0/3626316626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb738102ef0 0x7fb73806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.365+0000 7fb73e0e1640 1 -- 172.21.15.112:0/3626316626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb738102ef0 msgr2=0x7fb73806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.366+0000 7fb73e0e1640 1 --2- 172.21.15.112:0/3626316626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb738102ef0 0x7fb73806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.366+0000 7fb73e0e1640 1 -- 172.21.15.112:0/3626316626 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb734005040 con 0x7fb738102550 2024-09-19T09:46:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.366+0000 7fb73e0e1640 1 --2- 172.21.15.112:0/3626316626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb738102550 0x7fb73806fa10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb734003080 tx=0x7fb734009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.366+0000 7fb72effd640 1 -- 172.21.15.112:0/3626316626 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb734038070 con 0x7fb738102550 2024-09-19T09:46:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.366+0000 7fb740345640 1 -- 172.21.15.112:0/3626316626 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb738070830 con 0x7fb738102550 2024-09-19T09:46:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.366+0000 7fb72effd640 1 -- 172.21.15.112:0/3626316626 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb7340097e0 con 0x7fb738102550 2024-09-19T09:46:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.366+0000 7fb72effd640 1 -- 172.21.15.112:0/3626316626 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb73403d420 con 0x7fb738102550 2024-09-19T09:46:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.366+0000 7fb740345640 1 -- 172.21.15.112:0/3626316626 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb738119bf0 con 0x7fb738102550 2024-09-19T09:46:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.367+0000 7fb740345640 1 -- 172.21.15.112:0/3626316626 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7380fdcd0 con 0x7fb738102550 2024-09-19T09:46:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.367+0000 7fb72effd640 1 -- 172.21.15.112:0/3626316626 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb734030020 con 0x7fb738102550 2024-09-19T09:46:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.368+0000 7fb72effd640 1 --2- 172.21.15.112:0/3626316626 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb72406e530 0x7fb7240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.368+0000 7fb72effd640 1 -- 172.21.15.112:0/3626316626 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7fb7340ae780 con 0x7fb738102550 2024-09-19T09:46:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.368+0000 7fb73d8e0640 1 --2- 172.21.15.112:0/3626316626 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb72406e530 0x7fb7240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.368+0000 7fb73d8e0640 1 --2- 172.21.15.112:0/3626316626 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb72406e530 0x7fb7240709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb738071350 tx=0x7fb728009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:32.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.372+0000 7fb72effd640 1 -- 172.21.15.112:0/3626316626 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb734077760 con 0x7fb738102550 2024-09-19T09:46:32.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.576+0000 7fb740345640 1 -- 172.21.15.112:0/3626316626 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fb7380fbd50 con 0x7fb738102550 2024-09-19T09:46:32.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.577+0000 7fb72effd640 1 -- 172.21.15.112:0/3626316626 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v36) v1 ==== 107+0+4201 (secure 0 0 0) 0x7fb73407ae20 con 0x7fb738102550 2024-09-19T09:46:32.580 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:32.580 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":25,"btime":"2024-09-19T09:43:38:972841+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/2759077122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2759077122},{"type":"v1","addr":"172.21.15.191:6825","nonce":2759077122}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:43:37.975683+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi191.qweljt","rank":0,"incarnation":23,"state":"up:rejoin","state_seq":167,"addr":"172.21.15.191:6827/1382170395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1382170395},{"type":"v1","addr":"172.21.15.191:6827","nonce":1382170395}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T09:46:32.581 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 25 2024-09-19T09:46:32.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.579+0000 7fb740345640 1 -- 172.21.15.112:0/3626316626 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb72406e530 msgr2=0x7fb7240709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:32.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.579+0000 7fb740345640 1 --2- 172.21.15.112:0/3626316626 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb72406e530 0x7fb7240709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb738071350 tx=0x7fb728009040 comp rx=0 tx=0).stop 2024-09-19T09:46:32.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.579+0000 7fb740345640 1 -- 172.21.15.112:0/3626316626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb738102550 msgr2=0x7fb73806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:32.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.579+0000 7fb740345640 1 --2- 172.21.15.112:0/3626316626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb738102550 0x7fb73806fa10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb734003080 tx=0x7fb734009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.579+0000 7fb740345640 1 -- 172.21.15.112:0/3626316626 shutdown_connections 2024-09-19T09:46:32.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.579+0000 7fb740345640 1 --2- 172.21.15.112:0/3626316626 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fb72406e530 0x7fb7240709e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.579+0000 7fb740345640 1 --2- 172.21.15.112:0/3626316626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb738102ef0 0x7fb73806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.579+0000 7fb740345640 1 --2- 172.21.15.112:0/3626316626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb738102550 0x7fb73806fa10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.579+0000 7fb740345640 1 -- 172.21.15.112:0/3626316626 >> 172.21.15.112:0/3626316626 conn(0x7fb7380f80f0 msgr2=0x7fb7380f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:32.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.579+0000 7fb740345640 1 -- 172.21.15.112:0/3626316626 shutdown_connections 2024-09-19T09:46:32.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:32.579+0000 7fb740345640 1 -- 172.21.15.112:0/3626316626 wait complete. 2024-09-19T09:46:33.266 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:33 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3626316626' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-19T09:46:33.267 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-19T09:46:33.268 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-19T09:46:33.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:33 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3626316626' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-19T09:46:33.514 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:34.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:34 smithi191 ceph-mon[77624]: pgmap v278: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:34.425 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:34 smithi112 ceph-mon[97503]: pgmap v278: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:35.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.229+0000 7f3c7e485640 1 -- 172.21.15.112:0/1391292357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c781025f0 msgr2=0x7f3c781029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:35.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.229+0000 7f3c7e485640 1 --2- 172.21.15.112:0/1391292357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c781025f0 0x7f3c781029c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3c680048d0 tx=0x7f3c68009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.229+0000 7f3c7e485640 1 -- 172.21.15.112:0/1391292357 shutdown_connections 2024-09-19T09:46:35.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.229+0000 7f3c7e485640 1 --2- 172.21.15.112:0/1391292357 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c780fac60 0x7f3c780fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.229+0000 7f3c7e485640 1 --2- 172.21.15.112:0/1391292357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c781025f0 0x7f3c781029c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.229+0000 7f3c7e485640 1 -- 172.21.15.112:0/1391292357 >> 172.21.15.112:0/1391292357 conn(0x7f3c78070c80 msgr2=0x7f3c78071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:35.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.229+0000 7f3c7e485640 1 -- 172.21.15.112:0/1391292357 shutdown_connections 2024-09-19T09:46:35.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.229+0000 7f3c7e485640 1 -- 172.21.15.112:0/1391292357 wait complete. 2024-09-19T09:46:35.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.230+0000 7f3c7e485640 1 Processor -- start 2024-09-19T09:46:35.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.230+0000 7f3c7e485640 1 -- start start 2024-09-19T09:46:35.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.230+0000 7f3c7e485640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c780fac60 0x7f3c781131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:35.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.230+0000 7f3c7e485640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c781025f0 0x7f3c78113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:35.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.230+0000 7f3c7e485640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78113d10 con 0x7f3c781025f0 2024-09-19T09:46:35.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.230+0000 7f3c7e485640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7810d150 con 0x7f3c780fac60 2024-09-19T09:46:35.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.230+0000 7f3c777fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c781025f0 0x7f3c78113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:35.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.230+0000 7f3c777fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c781025f0 0x7f3c78113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43738/0 (socket says 172.21.15.112:43738) 2024-09-19T09:46:35.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.230+0000 7f3c777fe640 1 -- 172.21.15.112:0/2935209973 learned_addr learned my addr 172.21.15.112:0/2935209973 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:35.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.230+0000 7f3c77fff640 1 --2- 172.21.15.112:0/2935209973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c780fac60 0x7f3c781131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:35.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.231+0000 7f3c777fe640 1 -- 172.21.15.112:0/2935209973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c780fac60 msgr2=0x7f3c781131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:35.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.231+0000 7f3c777fe640 1 --2- 172.21.15.112:0/2935209973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c780fac60 0x7f3c781131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.231+0000 7f3c777fe640 1 -- 172.21.15.112:0/2935209973 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c68005040 con 0x7f3c781025f0 2024-09-19T09:46:35.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.231+0000 7f3c777fe640 1 --2- 172.21.15.112:0/2935209973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c781025f0 0x7f3c78113710 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c002a50 tx=0x7f3c6c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:35.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.231+0000 7f3c74ff9640 1 -- 172.21.15.112:0/2935209973 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c6c007c30 con 0x7f3c781025f0 2024-09-19T09:46:35.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.231+0000 7f3c74ff9640 1 -- 172.21.15.112:0/2935209973 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c6c00f040 con 0x7f3c781025f0 2024-09-19T09:46:35.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.231+0000 7f3c7e485640 1 -- 172.21.15.112:0/2935209973 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7810d430 con 0x7f3c781025f0 2024-09-19T09:46:35.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.231+0000 7f3c74ff9640 1 -- 172.21.15.112:0/2935209973 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c6c00da90 con 0x7f3c781025f0 2024-09-19T09:46:35.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.231+0000 7f3c7e485640 1 -- 172.21.15.112:0/2935209973 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c7810d9d0 con 0x7f3c781025f0 2024-09-19T09:46:35.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.232+0000 7f3c7e485640 1 -- 172.21.15.112:0/2935209973 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c78065810 con 0x7f3c781025f0 2024-09-19T09:46:35.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.232+0000 7f3c74ff9640 1 -- 172.21.15.112:0/2935209973 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3c6c00dd00 con 0x7f3c781025f0 2024-09-19T09:46:35.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.233+0000 7f3c74ff9640 1 --2- 172.21.15.112:0/2935209973 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c6006e530 0x7f3c600709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:35.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.233+0000 7f3c74ff9640 1 -- 172.21.15.112:0/2935209973 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f3c6c08db90 con 0x7f3c781025f0 2024-09-19T09:46:35.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.233+0000 7f3c77fff640 1 --2- 172.21.15.112:0/2935209973 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c6006e530 0x7f3c600709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:35.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.233+0000 7f3c77fff640 1 --2- 172.21.15.112:0/2935209973 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c6006e530 0x7f3c600709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009ac0 tx=0x7f3c68035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:35.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.237+0000 7f3c74ff9640 1 -- 172.21.15.112:0/2935209973 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3c6c056b70 con 0x7f3c781025f0 2024-09-19T09:46:35.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.440+0000 7f3c7e485640 1 -- 172.21.15.112:0/2935209973 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f3c78109620 con 0x7f3c781025f0 2024-09-19T09:46:35.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.441+0000 7f3c74ff9640 1 -- 172.21.15.112:0/2935209973 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v36) v1 ==== 107+0+5057 (secure 0 0 0) 0x7f3c6c05a230 con 0x7f3c781025f0 2024-09-19T09:46:35.443 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:35.443 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"btime":"2024-09-19T09:43:39:981068+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/2759077122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2759077122},{"type":"v1","addr":"172.21.15.191:6825","nonce":2759077122}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34416,"name":"cephfs.smithi112.hcoxjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/742383802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":742383802},{"type":"v1","addr":"172.21.15.112:6829","nonce":742383802}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:43:39.981066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi191.qweljt","rank":0,"incarnation":23,"state":"up:active","state_seq":168,"addr":"172.21.15.191:6827/1382170395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1382170395},{"type":"v1","addr":"172.21.15.191:6827","nonce":1382170395}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24275,"qdb_cluster":[24275]},"id":1}]} 2024-09-19T09:46:35.444 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 26 2024-09-19T09:46:35.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.443+0000 7f3c7e485640 1 -- 172.21.15.112:0/2935209973 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c6006e530 msgr2=0x7f3c600709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:35.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.443+0000 7f3c7e485640 1 --2- 172.21.15.112:0/2935209973 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c6006e530 0x7f3c600709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009ac0 tx=0x7f3c68035040 comp rx=0 tx=0).stop 2024-09-19T09:46:35.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.443+0000 7f3c7e485640 1 -- 172.21.15.112:0/2935209973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c781025f0 msgr2=0x7f3c78113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:35.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.443+0000 7f3c7e485640 1 --2- 172.21.15.112:0/2935209973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c781025f0 0x7f3c78113710 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c002a50 tx=0x7f3c6c004600 comp rx=0 tx=0).stop 2024-09-19T09:46:35.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.444+0000 7f3c7e485640 1 -- 172.21.15.112:0/2935209973 shutdown_connections 2024-09-19T09:46:35.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.444+0000 7f3c7e485640 1 --2- 172.21.15.112:0/2935209973 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f3c6006e530 0x7f3c600709e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.444+0000 7f3c7e485640 1 --2- 172.21.15.112:0/2935209973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c781025f0 0x7f3c78113710 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.444+0000 7f3c7e485640 1 --2- 172.21.15.112:0/2935209973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c780fac60 0x7f3c781131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.444+0000 7f3c7e485640 1 -- 172.21.15.112:0/2935209973 >> 172.21.15.112:0/2935209973 conn(0x7f3c78070c80 msgr2=0x7f3c780f9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:35.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.444+0000 7f3c7e485640 1 -- 172.21.15.112:0/2935209973 shutdown_connections 2024-09-19T09:46:35.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:35.444+0000 7f3c7e485640 1 -- 172.21.15.112:0/2935209973 wait complete. 2024-09-19T09:46:36.124 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:36 smithi112 ceph-mon[97503]: pgmap v279: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:36.124 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:36 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2935209973' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-19T09:46:36.151 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-19T09:46:36.151 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-19T09:46:36.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:36 smithi191 ceph-mon[77624]: pgmap v279: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:36.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:36 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2935209973' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-19T09:46:36.398 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:38.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.080+0000 7f1ab6ec7640 1 -- 172.21.15.112:0/2773493324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab0102530 msgr2=0x7f1ab0102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:38.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.080+0000 7f1ab6ec7640 1 --2- 172.21.15.112:0/2773493324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab0102530 0x7f1ab0102900 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0048d0 tx=0x7f1aac009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:38.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.081+0000 7f1ab6ec7640 1 -- 172.21.15.112:0/2773493324 shutdown_connections 2024-09-19T09:46:38.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.081+0000 7f1ab6ec7640 1 --2- 172.21.15.112:0/2773493324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ab0102ed0 0x7f1ab00fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:38.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.081+0000 7f1ab6ec7640 1 --2- 172.21.15.112:0/2773493324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab0102530 0x7f1ab0102900 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:38.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.081+0000 7f1ab6ec7640 1 -- 172.21.15.112:0/2773493324 >> 172.21.15.112:0/2773493324 conn(0x7f1ab00f8110 msgr2=0x7f1ab00fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:38.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.081+0000 7f1ab6ec7640 1 -- 172.21.15.112:0/2773493324 shutdown_connections 2024-09-19T09:46:38.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.081+0000 7f1ab6ec7640 1 -- 172.21.15.112:0/2773493324 wait complete. 2024-09-19T09:46:38.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.081+0000 7f1ab6ec7640 1 Processor -- start 2024-09-19T09:46:38.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.081+0000 7f1ab6ec7640 1 -- start start 2024-09-19T09:46:38.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.081+0000 7f1ab6ec7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab0102530 0x7f1ab006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:38.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.081+0000 7f1ab6ec7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ab0102ed0 0x7f1ab006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:38.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.081+0000 7f1ab6ec7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab0070490 con 0x7f1ab0102530 2024-09-19T09:46:38.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.081+0000 7f1ab6ec7640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab0070600 con 0x7f1ab0102ed0 2024-09-19T09:46:38.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.082+0000 7f1ab4c63640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab0102530 0x7f1ab006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:38.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.082+0000 7f1ab4c63640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab0102530 0x7f1ab006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43762/0 (socket says 172.21.15.112:43762) 2024-09-19T09:46:38.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.082+0000 7f1ab4c63640 1 -- 172.21.15.112:0/328912355 learned_addr learned my addr 172.21.15.112:0/328912355 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:38.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.082+0000 7f1aa7fff640 1 --2- 172.21.15.112:0/328912355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ab0102ed0 0x7f1ab006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:38.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.082+0000 7f1ab4c63640 1 -- 172.21.15.112:0/328912355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ab0102ed0 msgr2=0x7f1ab006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:38.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.082+0000 7f1ab4c63640 1 --2- 172.21.15.112:0/328912355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ab0102ed0 0x7f1ab006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:38.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.082+0000 7f1ab4c63640 1 -- 172.21.15.112:0/328912355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac005040 con 0x7f1ab0102530 2024-09-19T09:46:38.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.082+0000 7f1aa7fff640 1 --2- 172.21.15.112:0/328912355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ab0102ed0 0x7f1ab006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:46:38.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.082+0000 7f1ab4c63640 1 --2- 172.21.15.112:0/328912355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab0102530 0x7f1ab006fa10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1aac000c00 tx=0x7f1aac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:38.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.082+0000 7f1aa57fa640 1 -- 172.21.15.112:0/328912355 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aac038070 con 0x7f1ab0102530 2024-09-19T09:46:38.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.082+0000 7f1aa57fa640 1 -- 172.21.15.112:0/328912355 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1aac02ade0 con 0x7f1ab0102530 2024-09-19T09:46:38.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.082+0000 7f1ab6ec7640 1 -- 172.21.15.112:0/328912355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab0070830 con 0x7f1ab0102530 2024-09-19T09:46:38.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.082+0000 7f1aa57fa640 1 -- 172.21.15.112:0/328912355 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aac02c7b0 con 0x7f1ab0102530 2024-09-19T09:46:38.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.082+0000 7f1ab6ec7640 1 -- 172.21.15.112:0/328912355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab0119870 con 0x7f1ab0102530 2024-09-19T09:46:38.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.083+0000 7f1ab6ec7640 1 -- 172.21.15.112:0/328912355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab00fdcb0 con 0x7f1ab0102530 2024-09-19T09:46:38.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.084+0000 7f1aa57fa640 1 -- 172.21.15.112:0/328912355 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1aac030020 con 0x7f1ab0102530 2024-09-19T09:46:38.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.084+0000 7f1aa57fa640 1 --2- 172.21.15.112:0/328912355 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1a9806e530 0x7f1a980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:38.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.084+0000 7f1aa57fa640 1 -- 172.21.15.112:0/328912355 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f1aac0ae730 con 0x7f1ab0102530 2024-09-19T09:46:38.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.084+0000 7f1aa7fff640 1 --2- 172.21.15.112:0/328912355 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1a9806e530 0x7f1a980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:38.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.085+0000 7f1aa7fff640 1 --2- 172.21.15.112:0/328912355 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1a9806e530 0x7f1a980709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0071350 tx=0x7f1aa000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:38.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.088+0000 7f1aa57fa640 1 -- 172.21.15.112:0/328912355 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1aac077710 con 0x7f1ab0102530 2024-09-19T09:46:38.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:38 smithi112 ceph-mon[97503]: pgmap v280: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:38.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:38 smithi191 ceph-mon[77624]: pgmap v280: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:38.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.290+0000 7f1ab6ec7640 1 -- 172.21.15.112:0/328912355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f1ab00fbd30 con 0x7f1ab0102530 2024-09-19T09:46:38.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.291+0000 7f1aa57fa640 1 -- 172.21.15.112:0/328912355 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v36) v1 ==== 107+0+4275 (secure 0 0 0) 0x7f1aac07add0 con 0x7f1ab0102530 2024-09-19T09:46:38.293 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:38.293 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":27,"btime":"2024-09-19T09:43:50:883198+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34416,"name":"cephfs.smithi112.hcoxjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/742383802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":742383802},{"type":"v1","addr":"172.21.15.112:6829","nonce":742383802}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:43:39.981066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi191.qweljt","rank":0,"incarnation":23,"state":"up:active","state_seq":168,"addr":"172.21.15.191:6827/1382170395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1382170395},{"type":"v1","addr":"172.21.15.191:6827","nonce":1382170395}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24275,"qdb_cluster":[24275]},"id":1}]} 2024-09-19T09:46:38.293 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 27 2024-09-19T09:46:38.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.293+0000 7f1ab6ec7640 1 -- 172.21.15.112:0/328912355 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1a9806e530 msgr2=0x7f1a980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:38.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.293+0000 7f1ab6ec7640 1 --2- 172.21.15.112:0/328912355 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1a9806e530 0x7f1a980709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0071350 tx=0x7f1aa000b040 comp rx=0 tx=0).stop 2024-09-19T09:46:38.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.293+0000 7f1ab6ec7640 1 -- 172.21.15.112:0/328912355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab0102530 msgr2=0x7f1ab006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:38.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.293+0000 7f1ab6ec7640 1 --2- 172.21.15.112:0/328912355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab0102530 0x7f1ab006fa10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1aac000c00 tx=0x7f1aac009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:38.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.293+0000 7f1ab6ec7640 1 -- 172.21.15.112:0/328912355 shutdown_connections 2024-09-19T09:46:38.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.293+0000 7f1ab6ec7640 1 --2- 172.21.15.112:0/328912355 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f1a9806e530 0x7f1a980709e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:38.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.294+0000 7f1ab6ec7640 1 --2- 172.21.15.112:0/328912355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ab0102ed0 0x7f1ab006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:38.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.294+0000 7f1ab6ec7640 1 --2- 172.21.15.112:0/328912355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab0102530 0x7f1ab006fa10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:38.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.294+0000 7f1ab6ec7640 1 -- 172.21.15.112:0/328912355 >> 172.21.15.112:0/328912355 conn(0x7f1ab00f8110 msgr2=0x7f1ab00f9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:38.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.294+0000 7f1ab6ec7640 1 -- 172.21.15.112:0/328912355 shutdown_connections 2024-09-19T09:46:38.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:38.294+0000 7f1ab6ec7640 1 -- 172.21.15.112:0/328912355 wait complete. 2024-09-19T09:46:38.971 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-19T09:46:38.971 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-19T09:46:39.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:39 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/328912355' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-19T09:46:39.216 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:39.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:39 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/328912355' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-19T09:46:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:40 smithi191 ceph-mon[77624]: pgmap v281: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:46:40.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:40 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:46:40.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:40 smithi112 ceph-mon[97503]: pgmap v281: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:46:40.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:40 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:46:40.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.848+0000 7fabb84b0640 1 -- 172.21.15.112:0/506409396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb00fb470 msgr2=0x7fabb00fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:40.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.848+0000 7fabb84b0640 1 --2- 172.21.15.112:0/506409396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb00fb470 0x7fabb00fb8e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faba4009c50 tx=0x7faba4004d10 comp rx=0 tx=0).stop 2024-09-19T09:46:40.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.848+0000 7fabb84b0640 1 -- 172.21.15.112:0/506409396 shutdown_connections 2024-09-19T09:46:40.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.848+0000 7fabb84b0640 1 --2- 172.21.15.112:0/506409396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb00fb470 0x7fabb00fb8e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:40.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.848+0000 7fabb84b0640 1 --2- 172.21.15.112:0/506409396 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabb01014b0 0x7fabb0101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:40.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.848+0000 7fabb84b0640 1 -- 172.21.15.112:0/506409396 >> 172.21.15.112:0/506409396 conn(0x7fabb00f7030 msgr2=0x7fabb00f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:40.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.848+0000 7fabb84b0640 1 -- 172.21.15.112:0/506409396 shutdown_connections 2024-09-19T09:46:40.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.848+0000 7fabb84b0640 1 -- 172.21.15.112:0/506409396 wait complete. 2024-09-19T09:46:40.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.848+0000 7fabb84b0640 1 Processor -- start 2024-09-19T09:46:40.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.848+0000 7fabb84b0640 1 -- start start 2024-09-19T09:46:40.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabb84b0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb00fb470 0x7fabb0112080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:40.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabb84b0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabb01014b0 0x7fabb01125c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:40.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabb84b0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0112c50 con 0x7fabb00fb470 2024-09-19T09:46:40.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabb84b0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb010c040 con 0x7fabb01014b0 2024-09-19T09:46:40.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabb624c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb00fb470 0x7fabb0112080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:40.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabb624c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb00fb470 0x7fabb0112080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35864/0 (socket says 172.21.15.112:35864) 2024-09-19T09:46:40.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabb624c640 1 -- 172.21.15.112:0/3107423121 learned_addr learned my addr 172.21.15.112:0/3107423121 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:40.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabb5a4b640 1 --2- 172.21.15.112:0/3107423121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabb01014b0 0x7fabb01125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:40.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabb624c640 1 -- 172.21.15.112:0/3107423121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabb01014b0 msgr2=0x7fabb01125c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:40.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabb624c640 1 --2- 172.21.15.112:0/3107423121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabb01014b0 0x7fabb01125c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:40.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabb624c640 1 -- 172.21.15.112:0/3107423121 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40098b0 con 0x7fabb00fb470 2024-09-19T09:46:40.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabb624c640 1 --2- 172.21.15.112:0/3107423121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb00fb470 0x7fabb0112080 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faba800b790 tx=0x7faba80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:40.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabaeffd640 1 -- 172.21.15.112:0/3107423121 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faba800c700 con 0x7fabb00fb470 2024-09-19T09:46:40.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabaeffd640 1 -- 172.21.15.112:0/3107423121 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faba800cd00 con 0x7fabb00fb470 2024-09-19T09:46:40.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabb84b0640 1 -- 172.21.15.112:0/3107423121 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb010c320 con 0x7fabb00fb470 2024-09-19T09:46:40.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabaeffd640 1 -- 172.21.15.112:0/3107423121 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faba8015e70 con 0x7fabb00fb470 2024-09-19T09:46:40.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.849+0000 7fabb84b0640 1 -- 172.21.15.112:0/3107423121 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb010c840 con 0x7fabb00fb470 2024-09-19T09:46:40.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.851+0000 7fabb84b0640 1 -- 172.21.15.112:0/3107423121 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb00fcbb0 con 0x7fabb00fb470 2024-09-19T09:46:40.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.851+0000 7fabaeffd640 1 -- 172.21.15.112:0/3107423121 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7faba8012070 con 0x7fabb00fb470 2024-09-19T09:46:40.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.851+0000 7fabaeffd640 1 --2- 172.21.15.112:0/3107423121 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fab9806e530 0x7fab980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:40.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.852+0000 7fabaeffd640 1 -- 172.21.15.112:0/3107423121 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7faba808de90 con 0x7fabb00fb470 2024-09-19T09:46:40.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.852+0000 7fabb5a4b640 1 --2- 172.21.15.112:0/3107423121 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fab9806e530 0x7fab980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:40.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.852+0000 7fabb5a4b640 1 --2- 172.21.15.112:0/3107423121 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fab9806e530 0x7fab980709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fabb010d980 tx=0x7faba4004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:40.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:40.856+0000 7fabaeffd640 1 -- 172.21.15.112:0/3107423121 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7faba8056e70 con 0x7fabb00fb470 2024-09-19T09:46:41.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:41.062+0000 7fabb84b0640 1 -- 172.21.15.112:0/3107423121 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fabb004b750 con 0x7fabb00fb470 2024-09-19T09:46:41.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:41.063+0000 7fabaeffd640 1 -- 172.21.15.112:0/3107423121 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v36) v1 ==== 107+0+5125 (secure 0 0 0) 0x7faba805a530 con 0x7fabb00fb470 2024-09-19T09:46:41.065 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:41.065 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":28,"btime":"2024-09-19T09:43:53:887618+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34416,"name":"cephfs.smithi112.hcoxjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/742383802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":742383802},{"type":"v1","addr":"172.21.15.112:6829","nonce":742383802}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44329,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/3336467092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":3336467092},{"type":"v1","addr":"172.21.15.191:6825","nonce":3336467092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:43:39.981066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi191.qweljt","rank":0,"incarnation":23,"state":"up:active","state_seq":168,"addr":"172.21.15.191:6827/1382170395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1382170395},{"type":"v1","addr":"172.21.15.191:6827","nonce":1382170395}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24275,"qdb_cluster":[24275]},"id":1}]} 2024-09-19T09:46:41.065 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 28 2024-09-19T09:46:41.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:41.065+0000 7fabb84b0640 1 -- 172.21.15.112:0/3107423121 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fab9806e530 msgr2=0x7fab980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:41.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:41.065+0000 7fabb84b0640 1 --2- 172.21.15.112:0/3107423121 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fab9806e530 0x7fab980709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fabb010d980 tx=0x7faba4004d10 comp rx=0 tx=0).stop 2024-09-19T09:46:41.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:41.065+0000 7fabb84b0640 1 -- 172.21.15.112:0/3107423121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb00fb470 msgr2=0x7fabb0112080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:41.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:41.065+0000 7fabb84b0640 1 --2- 172.21.15.112:0/3107423121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb00fb470 0x7fabb0112080 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faba800b790 tx=0x7faba80091d0 comp rx=0 tx=0).stop 2024-09-19T09:46:41.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:41.065+0000 7fabb84b0640 1 -- 172.21.15.112:0/3107423121 shutdown_connections 2024-09-19T09:46:41.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:41.065+0000 7fabb84b0640 1 --2- 172.21.15.112:0/3107423121 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fab9806e530 0x7fab980709e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:41.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:41.065+0000 7fabb84b0640 1 --2- 172.21.15.112:0/3107423121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabb01014b0 0x7fabb01125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:41.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:41.065+0000 7fabb84b0640 1 --2- 172.21.15.112:0/3107423121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb00fb470 0x7fabb0112080 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:41.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:41.065+0000 7fabb84b0640 1 -- 172.21.15.112:0/3107423121 >> 172.21.15.112:0/3107423121 conn(0x7fabb00f7030 msgr2=0x7fabb00f7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:41.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:41.065+0000 7fabb84b0640 1 -- 172.21.15.112:0/3107423121 shutdown_connections 2024-09-19T09:46:41.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:41.065+0000 7fabb84b0640 1 -- 172.21.15.112:0/3107423121 wait complete. 2024-09-19T09:46:41.756 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-19T09:46:41.756 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-19T09:46:42.003 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:42.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:42 smithi191 ceph-mon[77624]: pgmap v282: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:42.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:42 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3107423121' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-19T09:46:42.317 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:42 smithi112 ceph-mon[97503]: pgmap v282: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:42.317 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:42 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3107423121' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-19T09:46:43.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.682+0000 7fe02c9dc640 1 -- 172.21.15.112:0/3939588408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0280fb810 msgr2=0x7fe0280fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:43.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.682+0000 7fe02c9dc640 1 --2- 172.21.15.112:0/3939588408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0280fb810 0x7fe0280fbbe0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe0180048d0 tx=0x7fe018009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:43.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.682+0000 7fe02c9dc640 1 -- 172.21.15.112:0/3939588408 shutdown_connections 2024-09-19T09:46:43.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.682+0000 7fe02c9dc640 1 --2- 172.21.15.112:0/3939588408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0280fcf80 0x7fe0280fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:43.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.682+0000 7fe02c9dc640 1 --2- 172.21.15.112:0/3939588408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0280fb810 0x7fe0280fbbe0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:43.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.682+0000 7fe02c9dc640 1 -- 172.21.15.112:0/3939588408 >> 172.21.15.112:0/3939588408 conn(0x7fe0280723b0 msgr2=0x7fe0280727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:43.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.682+0000 7fe02c9dc640 1 -- 172.21.15.112:0/3939588408 shutdown_connections 2024-09-19T09:46:43.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.682+0000 7fe02c9dc640 1 -- 172.21.15.112:0/3939588408 wait complete. 2024-09-19T09:46:43.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.683+0000 7fe02c9dc640 1 Processor -- start 2024-09-19T09:46:43.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.683+0000 7fe02c9dc640 1 -- start start 2024-09-19T09:46:43.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.683+0000 7fe02c9dc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0280fb810 0x7fe02810bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:43.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.683+0000 7fe02c9dc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0280fcf80 0x7fe02810c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:43.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.683+0000 7fe02c9dc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02810ca20 con 0x7fe0280fcf80 2024-09-19T09:46:43.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.683+0000 7fe02c9dc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02810cb60 con 0x7fe0280fb810 2024-09-19T09:46:43.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.683+0000 7fe01ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0280fcf80 0x7fe02810c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:43.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.683+0000 7fe01ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0280fcf80 0x7fe02810c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35886/0 (socket says 172.21.15.112:35886) 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.683+0000 7fe01ffff640 1 -- 172.21.15.112:0/162869576 learned_addr learned my addr 172.21.15.112:0/162869576 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.684+0000 7fe02659c640 1 --2- 172.21.15.112:0/162869576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0280fb810 0x7fe02810bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.684+0000 7fe01ffff640 1 -- 172.21.15.112:0/162869576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0280fb810 msgr2=0x7fe02810bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.684+0000 7fe01ffff640 1 --2- 172.21.15.112:0/162869576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0280fb810 0x7fe02810bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.684+0000 7fe01ffff640 1 -- 172.21.15.112:0/162869576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe018005040 con 0x7fe0280fcf80 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.684+0000 7fe02659c640 1 --2- 172.21.15.112:0/162869576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0280fb810 0x7fe02810bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.684+0000 7fe01ffff640 1 --2- 172.21.15.112:0/162869576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0280fcf80 0x7fe02810c4e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe010002a50 tx=0x7fe010004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.684+0000 7fe01effd640 1 -- 172.21.15.112:0/162869576 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe010007c30 con 0x7fe0280fcf80 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.684+0000 7fe01effd640 1 -- 172.21.15.112:0/162869576 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe01000f040 con 0x7fe0280fcf80 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.684+0000 7fe02c9dc640 1 -- 172.21.15.112:0/162869576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe028119610 con 0x7fe0280fcf80 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.684+0000 7fe01effd640 1 -- 172.21.15.112:0/162869576 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe01000da90 con 0x7fe0280fcf80 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.684+0000 7fe02c9dc640 1 -- 172.21.15.112:0/162869576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0281199c0 con 0x7fe0280fcf80 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.685+0000 7fe02c9dc640 1 -- 172.21.15.112:0/162869576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0280fcbc0 con 0x7fe0280fcf80 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.686+0000 7fe01effd640 1 -- 172.21.15.112:0/162869576 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe01000dd00 con 0x7fe0280fcf80 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.686+0000 7fe01effd640 1 --2- 172.21.15.112:0/162869576 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe01406e530 0x7fe0140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:43.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.686+0000 7fe01effd640 1 -- 172.21.15.112:0/162869576 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7fe01008dae0 con 0x7fe0280fcf80 2024-09-19T09:46:43.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.686+0000 7fe02659c640 1 --2- 172.21.15.112:0/162869576 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe01406e530 0x7fe0140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:43.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.687+0000 7fe02659c640 1 --2- 172.21.15.112:0/162869576 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe01406e530 0x7fe0140709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe01800b020 tx=0x7fe018009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:43.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.691+0000 7fe01effd640 1 -- 172.21.15.112:0/162869576 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe010056ac0 con 0x7fe0280fcf80 2024-09-19T09:46:43.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.900+0000 7fe02c9dc640 1 -- 172.21.15.112:0/162869576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7fe02804b720 con 0x7fe0280fcf80 2024-09-19T09:46:43.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.901+0000 7fe01effd640 1 -- 172.21.15.112:0/162869576 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v36) v1 ==== 107+0+4321 (secure 0 0 0) 0x7fe01005a180 con 0x7fe0280fcf80 2024-09-19T09:46:43.903 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:43.903 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"btime":"2024-09-19T09:44:03:168492+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34416,"name":"cephfs.smithi112.hcoxjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/742383802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":742383802},{"type":"v1","addr":"172.21.15.112:6829","nonce":742383802}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44329,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/3336467092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":3336467092},{"type":"v1","addr":"172.21.15.191:6825","nonce":3336467092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:44:03.168489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T09:46:43.903 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 29 2024-09-19T09:46:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.903+0000 7fe02c9dc640 1 -- 172.21.15.112:0/162869576 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe01406e530 msgr2=0x7fe0140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.903+0000 7fe02c9dc640 1 --2- 172.21.15.112:0/162869576 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe01406e530 0x7fe0140709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe01800b020 tx=0x7fe018009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.903+0000 7fe02c9dc640 1 -- 172.21.15.112:0/162869576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0280fcf80 msgr2=0x7fe02810c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.903+0000 7fe02c9dc640 1 --2- 172.21.15.112:0/162869576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0280fcf80 0x7fe02810c4e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe010002a50 tx=0x7fe010004600 comp rx=0 tx=0).stop 2024-09-19T09:46:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.903+0000 7fe02c9dc640 1 -- 172.21.15.112:0/162869576 shutdown_connections 2024-09-19T09:46:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.903+0000 7fe02c9dc640 1 --2- 172.21.15.112:0/162869576 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fe01406e530 0x7fe0140709e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.903+0000 7fe02c9dc640 1 --2- 172.21.15.112:0/162869576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0280fcf80 0x7fe02810c4e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.903+0000 7fe02c9dc640 1 --2- 172.21.15.112:0/162869576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0280fb810 0x7fe02810bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.903+0000 7fe02c9dc640 1 -- 172.21.15.112:0/162869576 >> 172.21.15.112:0/162869576 conn(0x7fe0280723b0 msgr2=0x7fe0280fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.903+0000 7fe02c9dc640 1 -- 172.21.15.112:0/162869576 shutdown_connections 2024-09-19T09:46:43.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:43.903+0000 7fe02c9dc640 1 -- 172.21.15.112:0/162869576 wait complete. 2024-09-19T09:46:44.284 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:44 smithi191 ceph-mon[77624]: pgmap v283: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:44.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:44 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/162869576' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-19T09:46:44.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:44 smithi112 ceph-mon[97503]: pgmap v283: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:44.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:44 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/162869576' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-19T09:46:44.757 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-19T09:46:44.757 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-19T09:46:45.008 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:46.367 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:46 smithi112 ceph-mon[97503]: pgmap v284: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:46.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:46 smithi191 ceph-mon[77624]: pgmap v284: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:46.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.569+0000 7fac087bc640 1 -- 172.21.15.112:0/809063738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac00102550 msgr2=0x7fac00102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.569+0000 7fac087bc640 1 --2- 172.21.15.112:0/809063738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac00102550 0x7fac00102920 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0048d0 tx=0x7fabfc009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.569+0000 7fac087bc640 1 -- 172.21.15.112:0/809063738 shutdown_connections 2024-09-19T09:46:46.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.569+0000 7fac087bc640 1 --2- 172.21.15.112:0/809063738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac00102ef0 0x7fac000fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.569+0000 7fac087bc640 1 --2- 172.21.15.112:0/809063738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac00102550 0x7fac00102920 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.569+0000 7fac087bc640 1 -- 172.21.15.112:0/809063738 >> 172.21.15.112:0/809063738 conn(0x7fac000f80f0 msgr2=0x7fac000fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:46.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.569+0000 7fac087bc640 1 -- 172.21.15.112:0/809063738 shutdown_connections 2024-09-19T09:46:46.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.569+0000 7fac087bc640 1 -- 172.21.15.112:0/809063738 wait complete. 2024-09-19T09:46:46.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.569+0000 7fac087bc640 1 Processor -- start 2024-09-19T09:46:46.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.569+0000 7fac087bc640 1 -- start start 2024-09-19T09:46:46.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.569+0000 7fac087bc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac00102550 0x7fac001135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.569+0000 7fac087bc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac00102ef0 0x7fac00113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.569+0000 7fac087bc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac001141d0 con 0x7fac00102550 2024-09-19T09:46:46.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.570+0000 7fac087bc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0010d550 con 0x7fac00102ef0 2024-09-19T09:46:46.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.570+0000 7fac06558640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac00102550 0x7fac001135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.570+0000 7fac06558640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac00102550 0x7fac001135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35918/0 (socket says 172.21.15.112:35918) 2024-09-19T09:46:46.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.570+0000 7fac06558640 1 -- 172.21.15.112:0/4115861375 learned_addr learned my addr 172.21.15.112:0/4115861375 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:46.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.570+0000 7fac05d57640 1 --2- 172.21.15.112:0/4115861375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac00102ef0 0x7fac00113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.570+0000 7fac06558640 1 -- 172.21.15.112:0/4115861375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac00102ef0 msgr2=0x7fac00113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.570+0000 7fac06558640 1 --2- 172.21.15.112:0/4115861375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac00102ef0 0x7fac00113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.570+0000 7fac06558640 1 -- 172.21.15.112:0/4115861375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc005040 con 0x7fac00102550 2024-09-19T09:46:46.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.570+0000 7fac06558640 1 --2- 172.21.15.112:0/4115861375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac00102550 0x7fac001135b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fabfc000c00 tx=0x7fabfc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:46.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.570+0000 7fabf6ffd640 1 -- 172.21.15.112:0/4115861375 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabfc038070 con 0x7fac00102550 2024-09-19T09:46:46.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.570+0000 7fabf6ffd640 1 -- 172.21.15.112:0/4115861375 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fabfc033ad0 con 0x7fac00102550 2024-09-19T09:46:46.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.570+0000 7fac087bc640 1 -- 172.21.15.112:0/4115861375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0010d780 con 0x7fac00102550 2024-09-19T09:46:46.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.570+0000 7fabf6ffd640 1 -- 172.21.15.112:0/4115861375 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabfc03db70 con 0x7fac00102550 2024-09-19T09:46:46.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.570+0000 7fac087bc640 1 -- 172.21.15.112:0/4115861375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0010dca0 con 0x7fac00102550 2024-09-19T09:46:46.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.571+0000 7fac087bc640 1 -- 172.21.15.112:0/4115861375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac000fdcd0 con 0x7fac00102550 2024-09-19T09:46:46.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.572+0000 7fabf6ffd640 1 -- 172.21.15.112:0/4115861375 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fabfc030020 con 0x7fac00102550 2024-09-19T09:46:46.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.572+0000 7fabf6ffd640 1 --2- 172.21.15.112:0/4115861375 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fabec06e530 0x7fabec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.573+0000 7fac05d57640 1 --2- 172.21.15.112:0/4115861375 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fabec06e530 0x7fabec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.573+0000 7fabf6ffd640 1 -- 172.21.15.112:0/4115861375 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7fabfc0ae540 con 0x7fac00102550 2024-09-19T09:46:46.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.573+0000 7fac05d57640 1 --2- 172.21.15.112:0/4115861375 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fabec06e530 0x7fabec0709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fabf0006fd0 tx=0x7fabf0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:46.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.577+0000 7fabf6ffd640 1 -- 172.21.15.112:0/4115861375 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fabfc077520 con 0x7fac00102550 2024-09-19T09:46:46.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.780+0000 7fac087bc640 1 -- 172.21.15.112:0/4115861375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fac0004b720 con 0x7fac00102550 2024-09-19T09:46:46.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.780+0000 7fabf6ffd640 1 -- 172.21.15.112:0/4115861375 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v36) v1 ==== 107+0+4400 (secure 0 0 0) 0x7fabfc07abe0 con 0x7fac00102550 2024-09-19T09:46:46.782 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:46.782 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":30,"btime":"2024-09-19T09:44:03:173796+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi112.hcoxjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/742383802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":742383802},{"type":"v1","addr":"172.21.15.112:6829","nonce":742383802}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44329,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/3336467092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":3336467092},{"type":"v1","addr":"172.21.15.191:6825","nonce":3336467092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:44:03.173779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T09:46:46.783 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 30 2024-09-19T09:46:46.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.783+0000 7fac087bc640 1 -- 172.21.15.112:0/4115861375 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fabec06e530 msgr2=0x7fabec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.783+0000 7fac087bc640 1 --2- 172.21.15.112:0/4115861375 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fabec06e530 0x7fabec0709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fabf0006fd0 tx=0x7fabf0008040 comp rx=0 tx=0).stop 2024-09-19T09:46:46.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.783+0000 7fac087bc640 1 -- 172.21.15.112:0/4115861375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac00102550 msgr2=0x7fac001135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.783+0000 7fac087bc640 1 --2- 172.21.15.112:0/4115861375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac00102550 0x7fac001135b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fabfc000c00 tx=0x7fabfc009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.783+0000 7fac087bc640 1 -- 172.21.15.112:0/4115861375 shutdown_connections 2024-09-19T09:46:46.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.783+0000 7fac087bc640 1 --2- 172.21.15.112:0/4115861375 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fabec06e530 0x7fabec0709e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.783+0000 7fac087bc640 1 --2- 172.21.15.112:0/4115861375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac00102ef0 0x7fac00113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.783+0000 7fac087bc640 1 --2- 172.21.15.112:0/4115861375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac00102550 0x7fac001135b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.783+0000 7fac087bc640 1 -- 172.21.15.112:0/4115861375 >> 172.21.15.112:0/4115861375 conn(0x7fac000f80f0 msgr2=0x7fac000f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:46.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.783+0000 7fac087bc640 1 -- 172.21.15.112:0/4115861375 shutdown_connections 2024-09-19T09:46:46.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:46.783+0000 7fac087bc640 1 -- 172.21.15.112:0/4115861375 wait complete. 2024-09-19T09:46:47.370 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:47 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/4115861375' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-19T09:46:47.447 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-19T09:46:47.447 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-19T09:46:47.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:47 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/4115861375' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-19T09:46:47.691 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:48.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:48 smithi112 ceph-mon[97503]: pgmap v285: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:48.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:48 smithi191 ceph-mon[77624]: pgmap v285: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:49.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.294+0000 7f9b633a2640 1 -- 172.21.15.112:0/3856226845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c0fb4a0 msgr2=0x7f9b5c0fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:49.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.294+0000 7f9b633a2640 1 --2- 172.21.15.112:0/3856226845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c0fb4a0 0x7f9b5c0fb910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9b500048d0 tx=0x7f9b50009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.294+0000 7f9b633a2640 1 -- 172.21.15.112:0/3856226845 shutdown_connections 2024-09-19T09:46:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.294+0000 7f9b633a2640 1 --2- 172.21.15.112:0/3856226845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c0fb4a0 0x7f9b5c0fb910 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.294+0000 7f9b633a2640 1 --2- 172.21.15.112:0/3856226845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b5c1014e0 0x7f9b5c1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.294+0000 7f9b633a2640 1 -- 172.21.15.112:0/3856226845 >> 172.21.15.112:0/3856226845 conn(0x7f9b5c0f7060 msgr2=0x7f9b5c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.294+0000 7f9b633a2640 1 -- 172.21.15.112:0/3856226845 shutdown_connections 2024-09-19T09:46:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.294+0000 7f9b633a2640 1 -- 172.21.15.112:0/3856226845 wait complete. 2024-09-19T09:46:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.295+0000 7f9b633a2640 1 Processor -- start 2024-09-19T09:46:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.295+0000 7f9b633a2640 1 -- start start 2024-09-19T09:46:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.295+0000 7f9b633a2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b5c0fb4a0 0x7f9b5c113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.295+0000 7f9b633a2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c1014e0 0x7f9b5c113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.295+0000 7f9b633a2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c113d80 con 0x7f9b5c1014e0 2024-09-19T09:46:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.295+0000 7f9b633a2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c10d1c0 con 0x7f9b5c0fb4a0 2024-09-19T09:46:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.295+0000 7f9b6093d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c1014e0 0x7f9b5c113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.295+0000 7f9b6093d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c1014e0 0x7f9b5c113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44628/0 (socket says 172.21.15.112:44628) 2024-09-19T09:46:49.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.295+0000 7f9b6093d640 1 -- 172.21.15.112:0/1349734017 learned_addr learned my addr 172.21.15.112:0/1349734017 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:49.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.295+0000 7f9b6113e640 1 --2- 172.21.15.112:0/1349734017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b5c0fb4a0 0x7f9b5c113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.295+0000 7f9b6093d640 1 -- 172.21.15.112:0/1349734017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b5c0fb4a0 msgr2=0x7f9b5c113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:49.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.295+0000 7f9b6093d640 1 --2- 172.21.15.112:0/1349734017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b5c0fb4a0 0x7f9b5c113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.295+0000 7f9b6093d640 1 -- 172.21.15.112:0/1349734017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b50005040 con 0x7f9b5c1014e0 2024-09-19T09:46:49.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.295+0000 7f9b6093d640 1 --2- 172.21.15.112:0/1349734017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c1014e0 0x7f9b5c113780 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9b50003080 tx=0x7f9b50009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:49.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.296+0000 7f9b4dffb640 1 -- 172.21.15.112:0/1349734017 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b50038070 con 0x7f9b5c1014e0 2024-09-19T09:46:49.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.296+0000 7f9b633a2640 1 -- 172.21.15.112:0/1349734017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c10d440 con 0x7f9b5c1014e0 2024-09-19T09:46:49.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.296+0000 7f9b4dffb640 1 -- 172.21.15.112:0/1349734017 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9b500097e0 con 0x7f9b5c1014e0 2024-09-19T09:46:49.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.296+0000 7f9b4dffb640 1 -- 172.21.15.112:0/1349734017 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b5003d420 con 0x7f9b5c1014e0 2024-09-19T09:46:49.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.296+0000 7f9b633a2640 1 -- 172.21.15.112:0/1349734017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c10d900 con 0x7f9b5c1014e0 2024-09-19T09:46:49.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.297+0000 7f9b633a2640 1 -- 172.21.15.112:0/1349734017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c0fcbe0 con 0x7f9b5c1014e0 2024-09-19T09:46:49.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.297+0000 7f9b4dffb640 1 -- 172.21.15.112:0/1349734017 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9b50030020 con 0x7f9b5c1014e0 2024-09-19T09:46:49.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.298+0000 7f9b4dffb640 1 --2- 172.21.15.112:0/1349734017 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9b4806e530 0x7f9b480709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.298+0000 7f9b6113e640 1 --2- 172.21.15.112:0/1349734017 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9b4806e530 0x7f9b480709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.298+0000 7f9b4dffb640 1 -- 172.21.15.112:0/1349734017 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f9b500ae830 con 0x7f9b5c1014e0 2024-09-19T09:46:49.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.298+0000 7f9b6113e640 1 --2- 172.21.15.112:0/1349734017 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9b4806e530 0x7f9b480709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9b58004c40 tx=0x7f9b58009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:49.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.302+0000 7f9b4dffb640 1 -- 172.21.15.112:0/1349734017 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9b50077810 con 0x7f9b5c1014e0 2024-09-19T09:46:49.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.503+0000 7f9b633a2640 1 -- 172.21.15.112:0/1349734017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f9b5c108460 con 0x7f9b5c1014e0 2024-09-19T09:46:49.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.504+0000 7f9b4dffb640 1 -- 172.21.15.112:0/1349734017 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v36) v1 ==== 107+0+4404 (secure 0 0 0) 0x7f9b5007aed0 con 0x7f9b5c1014e0 2024-09-19T09:46:49.509 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:49.509 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"btime":"2024-09-19T09:44:10:821931+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi112.hcoxjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/742383802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":742383802},{"type":"v1","addr":"172.21.15.112:6829","nonce":742383802}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44329,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/3336467092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":3336467092},{"type":"v1","addr":"172.21.15.191:6825","nonce":3336467092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:44:10.597577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T09:46:49.509 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 31 2024-09-19T09:46:49.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.506+0000 7f9b633a2640 1 -- 172.21.15.112:0/1349734017 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9b4806e530 msgr2=0x7f9b480709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:49.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.506+0000 7f9b633a2640 1 --2- 172.21.15.112:0/1349734017 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9b4806e530 0x7f9b480709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9b58004c40 tx=0x7f9b58009040 comp rx=0 tx=0).stop 2024-09-19T09:46:49.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.506+0000 7f9b633a2640 1 -- 172.21.15.112:0/1349734017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c1014e0 msgr2=0x7f9b5c113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:49.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.506+0000 7f9b633a2640 1 --2- 172.21.15.112:0/1349734017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c1014e0 0x7f9b5c113780 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9b50003080 tx=0x7f9b50009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.506+0000 7f9b633a2640 1 -- 172.21.15.112:0/1349734017 shutdown_connections 2024-09-19T09:46:49.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.506+0000 7f9b633a2640 1 --2- 172.21.15.112:0/1349734017 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f9b4806e530 0x7f9b480709e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.506+0000 7f9b633a2640 1 --2- 172.21.15.112:0/1349734017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c1014e0 0x7f9b5c113780 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.506+0000 7f9b633a2640 1 --2- 172.21.15.112:0/1349734017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b5c0fb4a0 0x7f9b5c113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.506+0000 7f9b633a2640 1 -- 172.21.15.112:0/1349734017 >> 172.21.15.112:0/1349734017 conn(0x7f9b5c0f7060 msgr2=0x7f9b5c065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:49.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.506+0000 7f9b633a2640 1 -- 172.21.15.112:0/1349734017 shutdown_connections 2024-09-19T09:46:49.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:49.506+0000 7f9b633a2640 1 -- 172.21.15.112:0/1349734017 wait complete. 2024-09-19T09:46:50.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:50 smithi112 ceph-mon[97503]: pgmap v286: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:46:50.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:50 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/1349734017' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-19T09:46:50.264 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-19T09:46:50.264 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-19T09:46:50.508 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:50.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:50 smithi191 ceph-mon[77624]: pgmap v286: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:46:50.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:50 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/1349734017' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-19T09:46:52.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.089+0000 7f76e4422640 1 -- 172.21.15.112:0/2571574189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76dc102550 msgr2=0x7f76dc102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:52.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.089+0000 7f76e4422640 1 --2- 172.21.15.112:0/2571574189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76dc102550 0x7f76dc102920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f76d80048d0 tx=0x7f76d8009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:52.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.090+0000 7f76e4422640 1 -- 172.21.15.112:0/2571574189 shutdown_connections 2024-09-19T09:46:52.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.090+0000 7f76e4422640 1 --2- 172.21.15.112:0/2571574189 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76dc102ef0 0x7f76dc0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:52.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.090+0000 7f76e4422640 1 --2- 172.21.15.112:0/2571574189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76dc102550 0x7f76dc102920 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:52.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.090+0000 7f76e4422640 1 -- 172.21.15.112:0/2571574189 >> 172.21.15.112:0/2571574189 conn(0x7f76dc0f80f0 msgr2=0x7f76dc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:52.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.090+0000 7f76e4422640 1 -- 172.21.15.112:0/2571574189 shutdown_connections 2024-09-19T09:46:52.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.090+0000 7f76e4422640 1 -- 172.21.15.112:0/2571574189 wait complete. 2024-09-19T09:46:52.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.090+0000 7f76e4422640 1 Processor -- start 2024-09-19T09:46:52.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.090+0000 7f76e4422640 1 -- start start 2024-09-19T09:46:52.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.090+0000 7f76e4422640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76dc102550 0x7f76dc06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:52.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.090+0000 7f76e4422640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76dc102ef0 0x7f76dc06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:52.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.090+0000 7f76e4422640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc070520 con 0x7f76dc102550 2024-09-19T09:46:52.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.090+0000 7f76e4422640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc070690 con 0x7f76dc102ef0 2024-09-19T09:46:52.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.091+0000 7f76e21be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76dc102550 0x7f76dc06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:52.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.091+0000 7f76e21be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76dc102550 0x7f76dc06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44650/0 (socket says 172.21.15.112:44650) 2024-09-19T09:46:52.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.091+0000 7f76e21be640 1 -- 172.21.15.112:0/2778191949 learned_addr learned my addr 172.21.15.112:0/2778191949 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:52.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.091+0000 7f76e19bd640 1 --2- 172.21.15.112:0/2778191949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76dc102ef0 0x7f76dc06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:52.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.091+0000 7f76e21be640 1 -- 172.21.15.112:0/2778191949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76dc102ef0 msgr2=0x7f76dc06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:52.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.091+0000 7f76e21be640 1 --2- 172.21.15.112:0/2778191949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76dc102ef0 0x7f76dc06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:52.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.091+0000 7f76e21be640 1 -- 172.21.15.112:0/2778191949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d8005040 con 0x7f76dc102550 2024-09-19T09:46:52.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.091+0000 7f76e21be640 1 --2- 172.21.15.112:0/2778191949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76dc102550 0x7f76dc06fa10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f76d8000c00 tx=0x7f76d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:52.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.091+0000 7f76d2ffd640 1 -- 172.21.15.112:0/2778191949 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76d8038070 con 0x7f76dc102550 2024-09-19T09:46:52.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.091+0000 7f76e4422640 1 -- 172.21.15.112:0/2778191949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76dc119880 con 0x7f76dc102550 2024-09-19T09:46:52.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.091+0000 7f76d2ffd640 1 -- 172.21.15.112:0/2778191949 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f76d803daf0 con 0x7f76dc102550 2024-09-19T09:46:52.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.091+0000 7f76d2ffd640 1 -- 172.21.15.112:0/2778191949 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76d8033b20 con 0x7f76dc102550 2024-09-19T09:46:52.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.091+0000 7f76e4422640 1 -- 172.21.15.112:0/2778191949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76dc119c60 con 0x7f76dc102550 2024-09-19T09:46:52.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.092+0000 7f76e4422640 1 -- 172.21.15.112:0/2778191949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76dc0fdcd0 con 0x7f76dc102550 2024-09-19T09:46:52.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.093+0000 7f76d2ffd640 1 -- 172.21.15.112:0/2778191949 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f76d8030020 con 0x7f76dc102550 2024-09-19T09:46:52.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.093+0000 7f76d2ffd640 1 --2- 172.21.15.112:0/2778191949 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f76c806e530 0x7f76c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:52.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.093+0000 7f76d2ffd640 1 -- 172.21.15.112:0/2778191949 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f76d80ae4e0 con 0x7f76dc102550 2024-09-19T09:46:52.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.093+0000 7f76e19bd640 1 --2- 172.21.15.112:0/2778191949 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f76c806e530 0x7f76c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:52.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.094+0000 7f76e19bd640 1 --2- 172.21.15.112:0/2778191949 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f76c806e530 0x7f76c80709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f76cc006fd0 tx=0x7f76cc008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:52.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.098+0000 7f76d2ffd640 1 -- 172.21.15.112:0/2778191949 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f76d8077570 con 0x7f76dc102550 2024-09-19T09:46:52.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:52 smithi112 ceph-mon[97503]: pgmap v287: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:52.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.300+0000 7f76e4422640 1 -- 172.21.15.112:0/2778191949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f76dc0fbd50 con 0x7f76dc102550 2024-09-19T09:46:52.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.300+0000 7f76d2ffd640 1 -- 172.21.15.112:0/2778191949 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v36) v1 ==== 107+0+5251 (secure 0 0 0) 0x7f76d807ac30 con 0x7f76dc102550 2024-09-19T09:46:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:52.302 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":32,"btime":"2024-09-19T09:44:11:826571+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi112.hcoxjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/742383802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":742383802},{"type":"v1","addr":"172.21.15.112:6829","nonce":742383802}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44329,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/3336467092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":3336467092},{"type":"v1","addr":"172.21.15.191:6825","nonce":3336467092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44353,"name":"cephfs.smithi191.qweljt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6827/1878602887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1878602887},{"type":"v1","addr":"172.21.15.191:6827","nonce":1878602887}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:44:10.828115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T09:46:52.302 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 32 2024-09-19T09:46:52.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.302+0000 7f76e4422640 1 -- 172.21.15.112:0/2778191949 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f76c806e530 msgr2=0x7f76c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:52.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.302+0000 7f76e4422640 1 --2- 172.21.15.112:0/2778191949 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f76c806e530 0x7f76c80709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f76cc006fd0 tx=0x7f76cc008040 comp rx=0 tx=0).stop 2024-09-19T09:46:52.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.302+0000 7f76e4422640 1 -- 172.21.15.112:0/2778191949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76dc102550 msgr2=0x7f76dc06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:52.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.302+0000 7f76e4422640 1 --2- 172.21.15.112:0/2778191949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76dc102550 0x7f76dc06fa10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f76d8000c00 tx=0x7f76d8009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:52.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.302+0000 7f76e4422640 1 -- 172.21.15.112:0/2778191949 shutdown_connections 2024-09-19T09:46:52.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.302+0000 7f76e4422640 1 --2- 172.21.15.112:0/2778191949 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f76c806e530 0x7f76c80709e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:52.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.302+0000 7f76e4422640 1 --2- 172.21.15.112:0/2778191949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76dc102ef0 0x7f76dc06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:52.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.302+0000 7f76e4422640 1 --2- 172.21.15.112:0/2778191949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76dc102550 0x7f76dc06fa10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:52.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.302+0000 7f76e4422640 1 -- 172.21.15.112:0/2778191949 >> 172.21.15.112:0/2778191949 conn(0x7f76dc0f80f0 msgr2=0x7f76dc0f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:52.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.302+0000 7f76e4422640 1 -- 172.21.15.112:0/2778191949 shutdown_connections 2024-09-19T09:46:52.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:52.302+0000 7f76e4422640 1 -- 172.21.15.112:0/2778191949 wait complete. 2024-09-19T09:46:52.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:52 smithi191 ceph-mon[77624]: pgmap v287: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:52.993 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-19T09:46:52.993 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-19T09:46:53.240 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:53.361 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:53 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2778191949' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-19T09:46:53.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:53 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2778191949' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-19T09:46:54.340 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:54 smithi112 ceph-mon[97503]: pgmap v288: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:54.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:54 smithi191 ceph-mon[77624]: pgmap v288: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:54.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.819+0000 7f95aabd0640 1 -- 172.21.15.112:0/1992955063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a40fb490 msgr2=0x7f95a40fb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:54.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.819+0000 7f95aabd0640 1 --2- 172.21.15.112:0/1992955063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a40fb490 0x7f95a40fb900 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f95900048d0 tx=0x7f9590009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:54.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.819+0000 7f95aabd0640 1 -- 172.21.15.112:0/1992955063 shutdown_connections 2024-09-19T09:46:54.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.819+0000 7f95aabd0640 1 --2- 172.21.15.112:0/1992955063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a40fb490 0x7f95a40fb900 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:54.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.819+0000 7f95aabd0640 1 --2- 172.21.15.112:0/1992955063 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a41014d0 0x7f95a41018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:54.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.819+0000 7f95aabd0640 1 -- 172.21.15.112:0/1992955063 >> 172.21.15.112:0/1992955063 conn(0x7f95a40f7010 msgr2=0x7f95a40f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:54.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.819+0000 7f95aabd0640 1 -- 172.21.15.112:0/1992955063 shutdown_connections 2024-09-19T09:46:54.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.819+0000 7f95aabd0640 1 -- 172.21.15.112:0/1992955063 wait complete. 2024-09-19T09:46:54.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.820+0000 7f95aabd0640 1 Processor -- start 2024-09-19T09:46:54.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.820+0000 7f95aabd0640 1 -- start start 2024-09-19T09:46:54.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.820+0000 7f95aabd0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a40fb490 0x7f95a41131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:54.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.820+0000 7f95aabd0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a41014d0 0x7f95a41136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:54.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.820+0000 7f95aabd0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a4113d70 con 0x7f95a40fb490 2024-09-19T09:46:54.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.820+0000 7f95aabd0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a410d160 con 0x7f95a41014d0 2024-09-19T09:46:54.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.820+0000 7f95a896c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a40fb490 0x7f95a41131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:54.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.821+0000 7f95a896c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a40fb490 0x7f95a41131a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44670/0 (socket says 172.21.15.112:44670) 2024-09-19T09:46:54.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.821+0000 7f95a896c640 1 -- 172.21.15.112:0/2119839309 learned_addr learned my addr 172.21.15.112:0/2119839309 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:54.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.821+0000 7f95a3fff640 1 --2- 172.21.15.112:0/2119839309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a41014d0 0x7f95a41136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:54.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.821+0000 7f95a896c640 1 -- 172.21.15.112:0/2119839309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a41014d0 msgr2=0x7f95a41136e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:54.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.821+0000 7f95a896c640 1 --2- 172.21.15.112:0/2119839309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a41014d0 0x7f95a41136e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:54.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.821+0000 7f95a896c640 1 -- 172.21.15.112:0/2119839309 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9590005040 con 0x7f95a40fb490 2024-09-19T09:46:54.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.821+0000 7f95a3fff640 1 --2- 172.21.15.112:0/2119839309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a41014d0 0x7f95a41136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:46:54.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.821+0000 7f95a896c640 1 --2- 172.21.15.112:0/2119839309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a40fb490 0x7f95a41131a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f959800b790 tx=0x7f95980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:54.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.821+0000 7f95a17fa640 1 -- 172.21.15.112:0/2119839309 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959800c700 con 0x7f95a40fb490 2024-09-19T09:46:54.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.821+0000 7f95aabd0640 1 -- 172.21.15.112:0/2119839309 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a410d440 con 0x7f95a40fb490 2024-09-19T09:46:54.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.821+0000 7f95a17fa640 1 -- 172.21.15.112:0/2119839309 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f959800cd00 con 0x7f95a40fb490 2024-09-19T09:46:54.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.821+0000 7f95a17fa640 1 -- 172.21.15.112:0/2119839309 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9598015e70 con 0x7f95a40fb490 2024-09-19T09:46:54.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.821+0000 7f95aabd0640 1 -- 172.21.15.112:0/2119839309 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a410d960 con 0x7f95a40fb490 2024-09-19T09:46:54.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.822+0000 7f95aabd0640 1 -- 172.21.15.112:0/2119839309 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a40fcbd0 con 0x7f95a40fb490 2024-09-19T09:46:54.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.823+0000 7f95a17fa640 1 -- 172.21.15.112:0/2119839309 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9598012070 con 0x7f95a40fb490 2024-09-19T09:46:54.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.823+0000 7f95a17fa640 1 --2- 172.21.15.112:0/2119839309 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f959406e530 0x7f95940709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:54.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.823+0000 7f95a17fa640 1 -- 172.21.15.112:0/2119839309 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f959808de90 con 0x7f95a40fb490 2024-09-19T09:46:54.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.823+0000 7f95a3fff640 1 --2- 172.21.15.112:0/2119839309 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f959406e530 0x7f95940709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:54.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.824+0000 7f95a3fff640 1 --2- 172.21.15.112:0/2119839309 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f959406e530 0x7f95940709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f959000b020 tx=0x7f9590009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:54.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:54.828+0000 7f95a17fa640 1 -- 172.21.15.112:0/2119839309 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9598056e70 con 0x7f95a40fb490 2024-09-19T09:46:55.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:55.035+0000 7f95aabd0640 1 -- 172.21.15.112:0/2119839309 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f95a404b780 con 0x7f95a40fb490 2024-09-19T09:46:55.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:55.035+0000 7f95a17fa640 1 -- 172.21.15.112:0/2119839309 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v36) v1 ==== 107+0+5260 (secure 0 0 0) 0x7f959805a530 con 0x7f95a40fb490 2024-09-19T09:46:55.037 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:55.037 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":33,"btime":"2024-09-19T09:44:12:833714+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi112.hcoxjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/742383802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":742383802},{"type":"v1","addr":"172.21.15.112:6829","nonce":742383802}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44329,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/3336467092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":3336467092},{"type":"v1","addr":"172.21.15.191:6825","nonce":3336467092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44353,"name":"cephfs.smithi191.qweljt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6827/1878602887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1878602887},{"type":"v1","addr":"172.21.15.191:6827","nonce":1878602887}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:44:12.833710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":0,"incarnation":30,"state":"up:active","state_seq":17,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34384,"qdb_cluster":[34384]},"id":1}]} 2024-09-19T09:46:55.038 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 33 2024-09-19T09:46:55.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:55.037+0000 7f95aabd0640 1 -- 172.21.15.112:0/2119839309 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f959406e530 msgr2=0x7f95940709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:55.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:55.037+0000 7f95aabd0640 1 --2- 172.21.15.112:0/2119839309 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f959406e530 0x7f95940709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f959000b020 tx=0x7f9590009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:55.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:55.037+0000 7f95aabd0640 1 -- 172.21.15.112:0/2119839309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a40fb490 msgr2=0x7f95a41131a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:55.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:55.037+0000 7f95aabd0640 1 --2- 172.21.15.112:0/2119839309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a40fb490 0x7f95a41131a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f959800b790 tx=0x7f95980091d0 comp rx=0 tx=0).stop 2024-09-19T09:46:55.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:55.037+0000 7f95aabd0640 1 -- 172.21.15.112:0/2119839309 shutdown_connections 2024-09-19T09:46:55.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:55.037+0000 7f95aabd0640 1 --2- 172.21.15.112:0/2119839309 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f959406e530 0x7f95940709e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:55.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:55.037+0000 7f95aabd0640 1 --2- 172.21.15.112:0/2119839309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a41014d0 0x7f95a41136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:55.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:55.037+0000 7f95aabd0640 1 --2- 172.21.15.112:0/2119839309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a40fb490 0x7f95a41131a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:55.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:55.037+0000 7f95aabd0640 1 -- 172.21.15.112:0/2119839309 >> 172.21.15.112:0/2119839309 conn(0x7f95a40f7010 msgr2=0x7f95a4065a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:55.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:55.038+0000 7f95aabd0640 1 -- 172.21.15.112:0/2119839309 shutdown_connections 2024-09-19T09:46:55.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:55.038+0000 7f95aabd0640 1 -- 172.21.15.112:0/2119839309 wait complete. 2024-09-19T09:46:55.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:55 smithi112 ceph-mon[97503]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:46:55.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:55 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2119839309' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-19T09:46:55.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:55 smithi191 ceph-mon[77624]: from='mgr.34104 172.21.15.112:0/550434528' entity='mgr.smithi112.puhuua' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:46:55.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:55 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2119839309' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-19T09:46:55.748 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-19T09:46:55.748 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-19T09:46:55.994 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:46:56.383 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:56 smithi112 ceph-mon[97503]: pgmap v289: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:56.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:56 smithi191 ceph-mon[77624]: pgmap v289: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.615+0000 7f8e234c6640 1 -- 172.21.15.112:0/2577595173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c06fab0 msgr2=0x7f8e1c06fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.615+0000 7f8e234c6640 1 --2- 172.21.15.112:0/2577595173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c06fab0 0x7f8e1c06fe80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8e140048d0 tx=0x7f8e14009da0 comp rx=0 tx=0).stop 2024-09-19T09:46:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.615+0000 7f8e234c6640 1 -- 172.21.15.112:0/2577595173 shutdown_connections 2024-09-19T09:46:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.615+0000 7f8e234c6640 1 --2- 172.21.15.112:0/2577595173 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e1c0703c0 0x7f8e1c1088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.615+0000 7f8e234c6640 1 --2- 172.21.15.112:0/2577595173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c06fab0 0x7f8e1c06fe80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.615+0000 7f8e234c6640 1 -- 172.21.15.112:0/2577595173 >> 172.21.15.112:0/2577595173 conn(0x7f8e1c0f8120 msgr2=0x7f8e1c0fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:57.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.615+0000 7f8e234c6640 1 -- 172.21.15.112:0/2577595173 shutdown_connections 2024-09-19T09:46:57.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.615+0000 7f8e234c6640 1 -- 172.21.15.112:0/2577595173 wait complete. 2024-09-19T09:46:57.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.616+0000 7f8e234c6640 1 Processor -- start 2024-09-19T09:46:57.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.616+0000 7f8e234c6640 1 -- start start 2024-09-19T09:46:57.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.616+0000 7f8e234c6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e1c06fab0 0x7f8e1c1153a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:57.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.616+0000 7f8e234c6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c0703c0 0x7f8e1c1158e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:57.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.616+0000 7f8e234c6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c115ee0 con 0x7f8e1c0703c0 2024-09-19T09:46:57.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.616+0000 7f8e234c6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c116050 con 0x7f8e1c06fab0 2024-09-19T09:46:57.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.616+0000 7f8e20a61640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c0703c0 0x7f8e1c1158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:57.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.616+0000 7f8e20a61640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c0703c0 0x7f8e1c1158e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44686/0 (socket says 172.21.15.112:44686) 2024-09-19T09:46:57.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.616+0000 7f8e20a61640 1 -- 172.21.15.112:0/3542049824 learned_addr learned my addr 172.21.15.112:0/3542049824 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:46:57.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.617+0000 7f8e21262640 1 --2- 172.21.15.112:0/3542049824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e1c06fab0 0x7f8e1c1153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:57.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.617+0000 7f8e20a61640 1 -- 172.21.15.112:0/3542049824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e1c06fab0 msgr2=0x7f8e1c1153a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:57.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.617+0000 7f8e20a61640 1 --2- 172.21.15.112:0/3542049824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e1c06fab0 0x7f8e1c1153a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:57.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.617+0000 7f8e20a61640 1 -- 172.21.15.112:0/3542049824 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e14005040 con 0x7f8e1c0703c0 2024-09-19T09:46:57.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.617+0000 7f8e21262640 1 --2- 172.21.15.112:0/3542049824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e1c06fab0 0x7f8e1c1153a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:46:57.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.617+0000 7f8e20a61640 1 --2- 172.21.15.112:0/3542049824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c0703c0 0x7f8e1c1158e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000cae0 tx=0x7f8e10007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:57.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.617+0000 7f8e19ffb640 1 -- 172.21.15.112:0/3542049824 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e1000ab00 con 0x7f8e1c0703c0 2024-09-19T09:46:57.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.617+0000 7f8e19ffb640 1 -- 172.21.15.112:0/3542049824 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8e1000ac60 con 0x7f8e1c0703c0 2024-09-19T09:46:57.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.617+0000 7f8e234c6640 1 -- 172.21.15.112:0/3542049824 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1c10f4d0 con 0x7f8e1c0703c0 2024-09-19T09:46:57.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.617+0000 7f8e19ffb640 1 -- 172.21.15.112:0/3542049824 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e100115e0 con 0x7f8e1c0703c0 2024-09-19T09:46:57.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.617+0000 7f8e234c6640 1 -- 172.21.15.112:0/3542049824 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1c10f9f0 con 0x7f8e1c0703c0 2024-09-19T09:46:57.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.618+0000 7f8e234c6640 1 -- 172.21.15.112:0/3542049824 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1c0711f0 con 0x7f8e1c0703c0 2024-09-19T09:46:57.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.619+0000 7f8e19ffb640 1 -- 172.21.15.112:0/3542049824 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8e100129e0 con 0x7f8e1c0703c0 2024-09-19T09:46:57.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.619+0000 7f8e19ffb640 1 --2- 172.21.15.112:0/3542049824 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8e0406e530 0x7f8e040709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:57.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.619+0000 7f8e19ffb640 1 -- 172.21.15.112:0/3542049824 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f8e1008eb70 con 0x7f8e1c0703c0 2024-09-19T09:46:57.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.619+0000 7f8e21262640 1 --2- 172.21.15.112:0/3542049824 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8e0406e530 0x7f8e040709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:57.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.619+0000 7f8e21262640 1 --2- 172.21.15.112:0/3542049824 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8e0406e530 0x7f8e040709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8e14007ac0 tx=0x7f8e14035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:57.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.623+0000 7f8e19ffb640 1 -- 172.21.15.112:0/3542049824 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8e10057b50 con 0x7f8e1c0703c0 2024-09-19T09:46:57.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.827+0000 7f8e234c6640 1 -- 172.21.15.112:0/3542049824 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f8e1c0fbd60 con 0x7f8e1c0703c0 2024-09-19T09:46:57.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.828+0000 7f8e19ffb640 1 -- 172.21.15.112:0/3542049824 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v36) v1 ==== 107+0+5260 (secure 0 0 0) 0x7f8e1005b210 con 0x7f8e1c0703c0 2024-09-19T09:46:57.830 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:46:57.830 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":34,"btime":"2024-09-19T09:44:18:728499+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi112.hcoxjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/742383802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":742383802},{"type":"v1","addr":"172.21.15.112:6829","nonce":742383802}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44329,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/3336467092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":3336467092},{"type":"v1","addr":"172.21.15.191:6825","nonce":3336467092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44353,"name":"cephfs.smithi191.qweljt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6827/1878602887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1878602887},{"type":"v1","addr":"172.21.15.191:6827","nonce":1878602887}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:44:17.731327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":0,"incarnation":30,"state":"up:active","state_seq":17,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34384,"qdb_cluster":[34384]},"id":1}]} 2024-09-19T09:46:57.831 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 34 2024-09-19T09:46:57.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.830+0000 7f8e234c6640 1 -- 172.21.15.112:0/3542049824 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8e0406e530 msgr2=0x7f8e040709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:57.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.830+0000 7f8e234c6640 1 --2- 172.21.15.112:0/3542049824 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8e0406e530 0x7f8e040709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8e14007ac0 tx=0x7f8e14035040 comp rx=0 tx=0).stop 2024-09-19T09:46:57.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.830+0000 7f8e234c6640 1 -- 172.21.15.112:0/3542049824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c0703c0 msgr2=0x7f8e1c1158e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:57.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.830+0000 7f8e234c6640 1 --2- 172.21.15.112:0/3542049824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c0703c0 0x7f8e1c1158e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000cae0 tx=0x7f8e10007e50 comp rx=0 tx=0).stop 2024-09-19T09:46:57.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.830+0000 7f8e234c6640 1 -- 172.21.15.112:0/3542049824 shutdown_connections 2024-09-19T09:46:57.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.830+0000 7f8e234c6640 1 --2- 172.21.15.112:0/3542049824 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7f8e0406e530 0x7f8e040709e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:57.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.830+0000 7f8e234c6640 1 --2- 172.21.15.112:0/3542049824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c0703c0 0x7f8e1c1158e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:57.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.830+0000 7f8e234c6640 1 --2- 172.21.15.112:0/3542049824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e1c06fab0 0x7f8e1c1153a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:57.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.830+0000 7f8e234c6640 1 -- 172.21.15.112:0/3542049824 >> 172.21.15.112:0/3542049824 conn(0x7f8e1c0f8120 msgr2=0x7f8e1c0f9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:57.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.830+0000 7f8e234c6640 1 -- 172.21.15.112:0/3542049824 shutdown_connections 2024-09-19T09:46:57.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:46:57.830+0000 7f8e234c6640 1 -- 172.21.15.112:0/3542049824 wait complete. 2024-09-19T09:46:58.337 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:58 smithi191 ceph-mon[77624]: pgmap v290: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:58.337 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:46:58 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/3542049824' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-19T09:46:58.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:58 smithi112 ceph-mon[97503]: pgmap v290: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:46:58.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:46:58 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/3542049824' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-19T09:46:58.552 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-19T09:46:58.553 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-19T09:46:58.812 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:47:00.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:47:00 smithi112 ceph-mon[97503]: pgmap v291: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:47:00.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.428+0000 7fdee2a7f640 1 -- 172.21.15.112:0/446740327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc0fb4a0 msgr2=0x7fdedc0fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:00.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.428+0000 7fdee2a7f640 1 --2- 172.21.15.112:0/446740327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc0fb4a0 0x7fdedc0fb910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdecc0048d0 tx=0x7fdecc009da0 comp rx=0 tx=0).stop 2024-09-19T09:47:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.428+0000 7fdee2a7f640 1 -- 172.21.15.112:0/446740327 shutdown_connections 2024-09-19T09:47:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.428+0000 7fdee2a7f640 1 --2- 172.21.15.112:0/446740327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc0fb4a0 0x7fdedc0fb910 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.428+0000 7fdee2a7f640 1 --2- 172.21.15.112:0/446740327 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdedc1014e0 0x7fdedc1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.428+0000 7fdee2a7f640 1 -- 172.21.15.112:0/446740327 >> 172.21.15.112:0/446740327 conn(0x7fdedc0f7060 msgr2=0x7fdedc0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.428+0000 7fdee2a7f640 1 -- 172.21.15.112:0/446740327 shutdown_connections 2024-09-19T09:47:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.428+0000 7fdee2a7f640 1 -- 172.21.15.112:0/446740327 wait complete. 2024-09-19T09:47:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.429+0000 7fdee2a7f640 1 Processor -- start 2024-09-19T09:47:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.429+0000 7fdee2a7f640 1 -- start start 2024-09-19T09:47:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.429+0000 7fdee2a7f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdedc0fb4a0 0x7fdedc10e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.429+0000 7fdee2a7f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc1014e0 0x7fdedc10e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.429+0000 7fdee2a7f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc10ecb0 con 0x7fdedc1014e0 2024-09-19T09:47:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.429+0000 7fdee2a7f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc10ee20 con 0x7fdedc0fb4a0 2024-09-19T09:47:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.429+0000 7fdedbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc1014e0 0x7fdedc10e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.429+0000 7fdedbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc1014e0 0x7fdedc10e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33352/0 (socket says 172.21.15.112:33352) 2024-09-19T09:47:00.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.430+0000 7fdedbfff640 1 -- 172.21.15.112:0/304674233 learned_addr learned my addr 172.21.15.112:0/304674233 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:47:00.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.430+0000 7fdee081b640 1 --2- 172.21.15.112:0/304674233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdedc0fb4a0 0x7fdedc10e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:00.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.430+0000 7fdedbfff640 1 -- 172.21.15.112:0/304674233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdedc0fb4a0 msgr2=0x7fdedc10e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:00.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.430+0000 7fdedbfff640 1 --2- 172.21.15.112:0/304674233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdedc0fb4a0 0x7fdedc10e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:00.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.430+0000 7fdedbfff640 1 -- 172.21.15.112:0/304674233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc005040 con 0x7fdedc1014e0 2024-09-19T09:47:00.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.430+0000 7fdedbfff640 1 --2- 172.21.15.112:0/304674233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc1014e0 0x7fdedc10e6b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdecc000c00 tx=0x7fdecc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:00.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.430+0000 7fded97fa640 1 -- 172.21.15.112:0/304674233 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdecc038070 con 0x7fdedc1014e0 2024-09-19T09:47:00.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.430+0000 7fded97fa640 1 -- 172.21.15.112:0/304674233 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdecc02ade0 con 0x7fdedc1014e0 2024-09-19T09:47:00.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.430+0000 7fdee2a7f640 1 -- 172.21.15.112:0/304674233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc1171e0 con 0x7fdedc1014e0 2024-09-19T09:47:00.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.430+0000 7fded97fa640 1 -- 172.21.15.112:0/304674233 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdecc02c7e0 con 0x7fdedc1014e0 2024-09-19T09:47:00.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.430+0000 7fdee2a7f640 1 -- 172.21.15.112:0/304674233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc117640 con 0x7fdedc1014e0 2024-09-19T09:47:00.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.431+0000 7fdee2a7f640 1 -- 172.21.15.112:0/304674233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdedc0fcbe0 con 0x7fdedc1014e0 2024-09-19T09:47:00.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.432+0000 7fded97fa640 1 -- 172.21.15.112:0/304674233 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fdecc030020 con 0x7fdedc1014e0 2024-09-19T09:47:00.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.432+0000 7fded97fa640 1 --2- 172.21.15.112:0/304674233 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fdec806e530 0x7fdec80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:00.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.432+0000 7fded97fa640 1 -- 172.21.15.112:0/304674233 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7fdecc0adf00 con 0x7fdedc1014e0 2024-09-19T09:47:00.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.432+0000 7fdee081b640 1 --2- 172.21.15.112:0/304674233 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fdec806e530 0x7fdec80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:00.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.433+0000 7fdee081b640 1 --2- 172.21.15.112:0/304674233 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fdec806e530 0x7fdec80709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdec4007e60 tx=0x7fdec4004bb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:00.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.437+0000 7fded97fa640 1 -- 172.21.15.112:0/304674233 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fdecc076f90 con 0x7fdedc1014e0 2024-09-19T09:47:00.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:47:00 smithi191 ceph-mon[77624]: pgmap v291: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:47:00.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.638+0000 7fdee2a7f640 1 -- 172.21.15.112:0/304674233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7fdedc0fac60 con 0x7fdedc1014e0 2024-09-19T09:47:00.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.638+0000 7fded97fa640 1 -- 172.21.15.112:0/304674233 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v36) v1 ==== 107+0+5259 (secure 0 0 0) 0x7fdecc07a650 con 0x7fdedc1014e0 2024-09-19T09:47:00.641 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-19T09:47:00.641 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":35,"btime":"2024-09-19T09:44:19:730473+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi112.hcoxjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/742383802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":742383802},{"type":"v1","addr":"172.21.15.112:6829","nonce":742383802}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44329,"name":"cephfs.smithi191.jjldod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6825/3336467092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":3336467092},{"type":"v1","addr":"172.21.15.191:6825","nonce":3336467092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44353,"name":"cephfs.smithi191.qweljt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6827/1878602887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1878602887},{"type":"v1","addr":"172.21.15.191:6827","nonce":1878602887}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:32:24.989350+0000","modified":"2024-09-19T09:44:18.734148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi112.ymjyok","rank":0,"incarnation":30,"state":"up:active","state_seq":17,"addr":"172.21.15.112:6827/1711973242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1711973242},{"type":"v1","addr":"172.21.15.112:6827","nonce":1711973242}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34384,"qdb_cluster":[34384]},"id":1}]} 2024-09-19T09:47:00.641 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 35 2024-09-19T09:47:00.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.641+0000 7fdee2a7f640 1 -- 172.21.15.112:0/304674233 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fdec806e530 msgr2=0x7fdec80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:00.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.641+0000 7fdee2a7f640 1 --2- 172.21.15.112:0/304674233 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fdec806e530 0x7fdec80709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdec4007e60 tx=0x7fdec4004bb0 comp rx=0 tx=0).stop 2024-09-19T09:47:00.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.641+0000 7fdee2a7f640 1 -- 172.21.15.112:0/304674233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc1014e0 msgr2=0x7fdedc10e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:00.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.641+0000 7fdee2a7f640 1 --2- 172.21.15.112:0/304674233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc1014e0 0x7fdedc10e6b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdecc000c00 tx=0x7fdecc009da0 comp rx=0 tx=0).stop 2024-09-19T09:47:00.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.641+0000 7fdee2a7f640 1 -- 172.21.15.112:0/304674233 shutdown_connections 2024-09-19T09:47:00.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.641+0000 7fdee2a7f640 1 --2- 172.21.15.112:0/304674233 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fdec806e530 0x7fdec80709e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:00.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.641+0000 7fdee2a7f640 1 --2- 172.21.15.112:0/304674233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc1014e0 0x7fdedc10e6b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:00.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.641+0000 7fdee2a7f640 1 --2- 172.21.15.112:0/304674233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdedc0fb4a0 0x7fdedc10e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:00.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.641+0000 7fdee2a7f640 1 -- 172.21.15.112:0/304674233 >> 172.21.15.112:0/304674233 conn(0x7fdedc0f7060 msgr2=0x7fdedc0f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:00.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.641+0000 7fdee2a7f640 1 -- 172.21.15.112:0/304674233 shutdown_connections 2024-09-19T09:47:00.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:00.641+0000 7fdee2a7f640 1 -- 172.21.15.112:0/304674233 wait complete. 2024-09-19T09:47:01.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:47:01 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/304674233' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-19T09:47:01.306 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T09:47:01.320 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T09:47:01.321 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:47:01.321 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:47:01.339 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-19T09:47:01.339 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:47:01.396 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T09:47:01.534 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:47:01 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/304674233' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-19T09:47:01.679 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:47:02.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:47:02 smithi112 ceph-mon[97503]: pgmap v292: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:02.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:47:02 smithi191 ceph-mon[77624]: pgmap v292: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:03.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.291+0000 7fa7f2d14640 1 -- 172.21.15.112:0/3535521737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec0fe460 msgr2=0x7fa7ec0fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.291+0000 7fa7f2d14640 1 --2- 172.21.15.112:0/3535521737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec0fe460 0x7fa7ec0fe830 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80048d0 tx=0x7fa7e8009da0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.291+0000 7fa7f2d14640 1 -- 172.21.15.112:0/3535521737 shutdown_connections 2024-09-19T09:47:03.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.291+0000 7fa7f2d14640 1 --2- 172.21.15.112:0/3535521737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7ec064fc0 0x7fa7ec065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.291+0000 7fa7f2d14640 1 --2- 172.21.15.112:0/3535521737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec0fe460 0x7fa7ec0fe830 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.291+0000 7fa7f2d14640 1 -- 172.21.15.112:0/3535521737 >> 172.21.15.112:0/3535521737 conn(0x7fa7ec0723b0 msgr2=0x7fa7ec0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:03.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.292+0000 7fa7f2d14640 1 -- 172.21.15.112:0/3535521737 shutdown_connections 2024-09-19T09:47:03.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.292+0000 7fa7f2d14640 1 -- 172.21.15.112:0/3535521737 wait complete. 2024-09-19T09:47:03.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.292+0000 7fa7f2d14640 1 Processor -- start 2024-09-19T09:47:03.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.292+0000 7fa7f2d14640 1 -- start start 2024-09-19T09:47:03.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.292+0000 7fa7f2d14640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec064fc0 0x7fa7ec113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:03.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.292+0000 7fa7f2d14640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7ec0fe460 0x7fa7ec113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:03.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.292+0000 7fa7f2d14640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec113dd0 con 0x7fa7ec064fc0 2024-09-19T09:47:03.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.292+0000 7fa7f2d14640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec10d180 con 0x7fa7ec0fe460 2024-09-19T09:47:03.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.292+0000 7fa7f0ab0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec064fc0 0x7fa7ec113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:03.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.293+0000 7fa7f0ab0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec064fc0 0x7fa7ec113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33372/0 (socket says 172.21.15.112:33372) 2024-09-19T09:47:03.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.293+0000 7fa7f0ab0640 1 -- 172.21.15.112:0/2509519229 learned_addr learned my addr 172.21.15.112:0/2509519229 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:47:03.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.293+0000 7fa7e3fff640 1 --2- 172.21.15.112:0/2509519229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7ec0fe460 0x7fa7ec113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:03.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.293+0000 7fa7f0ab0640 1 -- 172.21.15.112:0/2509519229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7ec0fe460 msgr2=0x7fa7ec113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.293+0000 7fa7f0ab0640 1 --2- 172.21.15.112:0/2509519229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7ec0fe460 0x7fa7ec113740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.293+0000 7fa7f0ab0640 1 -- 172.21.15.112:0/2509519229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e8005040 con 0x7fa7ec064fc0 2024-09-19T09:47:03.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.293+0000 7fa7e3fff640 1 --2- 172.21.15.112:0/2509519229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7ec0fe460 0x7fa7ec113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:47:03.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.293+0000 7fa7f0ab0640 1 --2- 172.21.15.112:0/2509519229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec064fc0 0x7fa7ec113200 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8003080 tx=0x7fa7e8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:03.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.293+0000 7fa7e17fa640 1 -- 172.21.15.112:0/2509519229 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e8038070 con 0x7fa7ec064fc0 2024-09-19T09:47:03.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.293+0000 7fa7e17fa640 1 -- 172.21.15.112:0/2509519229 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa7e802ade0 con 0x7fa7ec064fc0 2024-09-19T09:47:03.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.293+0000 7fa7f2d14640 1 -- 172.21.15.112:0/2509519229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec10d400 con 0x7fa7ec064fc0 2024-09-19T09:47:03.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.293+0000 7fa7e17fa640 1 -- 172.21.15.112:0/2509519229 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e802c880 con 0x7fa7ec064fc0 2024-09-19T09:47:03.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.293+0000 7fa7f2d14640 1 -- 172.21.15.112:0/2509519229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ec10d860 con 0x7fa7ec064fc0 2024-09-19T09:47:03.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.294+0000 7fa7f2d14640 1 -- 172.21.15.112:0/2509519229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec0fdcf0 con 0x7fa7ec064fc0 2024-09-19T09:47:03.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.295+0000 7fa7e17fa640 1 -- 172.21.15.112:0/2509519229 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa7e8030020 con 0x7fa7ec064fc0 2024-09-19T09:47:03.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.295+0000 7fa7e17fa640 1 --2- 172.21.15.112:0/2509519229 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fa7d406e530 0x7fa7d40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:03.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.296+0000 7fa7e17fa640 1 -- 172.21.15.112:0/2509519229 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7fa7e80ae680 con 0x7fa7ec064fc0 2024-09-19T09:47:03.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.296+0000 7fa7e3fff640 1 --2- 172.21.15.112:0/2509519229 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fa7d406e530 0x7fa7d40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:03.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.296+0000 7fa7e3fff640 1 --2- 172.21.15.112:0/2509519229 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fa7d406e530 0x7fa7d40709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc006fd0 tx=0x7fa7dc008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:03.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.299+0000 7fa7e17fa640 1 -- 172.21.15.112:0/2509519229 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa7e8077680 con 0x7fa7ec064fc0 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.479+0000 7fa7f2d14640 1 -- 172.21.15.112:0/2509519229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa7ec072ec0 con 0x7fa7ec064fc0 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.480+0000 7fa7e17fa640 1 -- 172.21.15.112:0/2509519229 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v94) v1 ==== 81+0+2347 (secure 0 0 0) 0x7fa7e807ad40 con 0x7fa7ec064fc0 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:6827/1382170395 2024-09-20T09:44:03.168120+0000 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6828/165136062 2024-09-20T09:43:30.254271+0000 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6829/165136062 2024-09-20T09:43:30.254271+0000 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3668590033 2024-09-20T09:38:54.751348+0000 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3554743184 2024-09-20T09:38:54.751348+0000 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/2980065875 2024-09-20T09:38:54.751348+0000 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1110437156 2024-09-20T09:38:54.751348+0000 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3318399440 2024-09-20T09:26:10.763366+0000 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:6828/4211232097 2024-09-20T09:36:47.789350+0000 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/2336666418 2024-09-20T09:26:10.763366+0000 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/1627571174 2024-09-20T09:26:40.441468+0000 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/3210372910 2024-09-20T09:27:43.717543+0000 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/3210372910 2024-09-20T09:27:43.717543+0000 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1633167540 2024-09-20T09:26:40.441468+0000 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/2336666418 2024-09-20T09:26:10.763366+0000 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3555278869 2024-09-20T09:34:41.712653+0000 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1234573048 2024-09-20T09:26:10.763366+0000 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/852695113 2024-09-20T09:27:43.717543+0000 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:6829/4211232097 2024-09-20T09:36:47.789350+0000 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3962529596 2024-09-20T09:34:41.712653+0000 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/18888963 2024-09-20T09:38:54.751348+0000 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/2839937816 2024-09-20T09:26:40.441468+0000 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1621418219 2024-09-20T09:27:43.717543+0000 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/2880667232 2024-09-20T09:34:41.712653+0000 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:0/1236846199 2024-09-20T09:36:47.789350+0000 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/18888963 2024-09-20T09:38:54.751348+0000 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/616967539 2024-09-20T09:26:40.441468+0000 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:0/3738726278 2024-09-20T09:36:47.789350+0000 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:6826/1382170395 2024-09-20T09:44:03.168120+0000 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3517126379 2024-09-20T09:34:41.712653+0000 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6826/3112259740 2024-09-20T09:32:39.813865+0000 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/3495376281 2024-09-20T09:34:41.712653+0000 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6827/3112259740 2024-09-20T09:32:39.813865+0000 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/3495376281 2024-09-20T09:34:41.712653+0000 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:0/2736314700 2024-09-20T09:36:47.789350+0000 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/1627571174 2024-09-20T09:26:40.441468+0000 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:0/2944289201 2024-09-20T09:36:47.789350+0000 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/2459323098 2024-09-20T09:26:10.763366+0000 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/2752965886 2024-09-20T09:27:43.717543+0000 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:listed 39 entries 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.483+0000 7fa7f2d14640 1 -- 172.21.15.112:0/2509519229 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fa7d406e530 msgr2=0x7fa7d40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.483+0000 7fa7f2d14640 1 --2- 172.21.15.112:0/2509519229 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fa7d406e530 0x7fa7d40709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc006fd0 tx=0x7fa7dc008040 comp rx=0 tx=0).stop 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.483+0000 7fa7f2d14640 1 -- 172.21.15.112:0/2509519229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec064fc0 msgr2=0x7fa7ec113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.483+0000 7fa7f2d14640 1 --2- 172.21.15.112:0/2509519229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec064fc0 0x7fa7ec113200 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8003080 tx=0x7fa7e8009da0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.483+0000 7fa7f2d14640 1 -- 172.21.15.112:0/2509519229 shutdown_connections 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.483+0000 7fa7f2d14640 1 --2- 172.21.15.112:0/2509519229 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7fa7d406e530 0x7fa7d40709e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.483+0000 7fa7f2d14640 1 --2- 172.21.15.112:0/2509519229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7ec0fe460 0x7fa7ec113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.483+0000 7fa7f2d14640 1 --2- 172.21.15.112:0/2509519229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec064fc0 0x7fa7ec113200 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.483+0000 7fa7f2d14640 1 -- 172.21.15.112:0/2509519229 >> 172.21.15.112:0/2509519229 conn(0x7fa7ec0723b0 msgr2=0x7fa7ec105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.483+0000 7fa7f2d14640 1 -- 172.21.15.112:0/2509519229 shutdown_connections 2024-09-19T09:47:03.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:03.483+0000 7fa7f2d14640 1 -- 172.21.15.112:0/2509519229 wait complete. 2024-09-19T09:47:04.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:47:04 smithi112 ceph-mon[97503]: pgmap v293: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:04.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:47:04 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/2509519229' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:47:04.245 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:47:04.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:47:04.246 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:47:04.275 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:47:04.275 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:47:04.343 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:47:04.343 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:47:04.364 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-19T09:47:04.364 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:47:04.423 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T09:47:04.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:47:04 smithi191 ceph-mon[77624]: pgmap v293: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:04.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:47:04 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/2509519229' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:47:04.668 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/mon.smithi112/config 2024-09-19T09:47:06.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.230+0000 7ff4306f9640 1 -- 172.21.15.112:0/276485066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff428064fe0 msgr2=0x7ff428065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:06.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.230+0000 7ff4306f9640 1 --2- 172.21.15.112:0/276485066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff428064fe0 0x7ff428065430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff4180048d0 tx=0x7ff418009da0 comp rx=0 tx=0).stop 2024-09-19T09:47:06.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.230+0000 7ff4306f9640 1 -- 172.21.15.112:0/276485066 shutdown_connections 2024-09-19T09:47:06.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.230+0000 7ff4306f9640 1 --2- 172.21.15.112:0/276485066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff428064fe0 0x7ff428065430 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:06.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.230+0000 7ff4306f9640 1 --2- 172.21.15.112:0/276485066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4280fe450 0x7ff4280fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:06.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.230+0000 7ff4306f9640 1 -- 172.21.15.112:0/276485066 >> 172.21.15.112:0/276485066 conn(0x7ff4280723b0 msgr2=0x7ff4280727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:06.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.230+0000 7ff4306f9640 1 -- 172.21.15.112:0/276485066 shutdown_connections 2024-09-19T09:47:06.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.230+0000 7ff4306f9640 1 -- 172.21.15.112:0/276485066 wait complete. 2024-09-19T09:47:06.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.230+0000 7ff4306f9640 1 Processor -- start 2024-09-19T09:47:06.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.230+0000 7ff4306f9640 1 -- start start 2024-09-19T09:47:06.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.230+0000 7ff4306f9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff428064fe0 0x7ff4280fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:06.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.230+0000 7ff4306f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4280fe450 0x7ff4280fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:06.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.230+0000 7ff4306f9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280fbfe0 con 0x7ff4280fe450 2024-09-19T09:47:06.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.230+0000 7ff4306f9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280fc150 con 0x7ff428064fe0 2024-09-19T09:47:06.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.231+0000 7ff42dc94640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4280fe450 0x7ff4280fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:06.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.231+0000 7ff42dc94640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4280fe450 0x7ff4280fbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33386/0 (socket says 172.21.15.112:33386) 2024-09-19T09:47:06.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.231+0000 7ff42dc94640 1 -- 172.21.15.112:0/289276989 learned_addr learned my addr 172.21.15.112:0/289276989 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-19T09:47:06.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.231+0000 7ff42dc94640 1 -- 172.21.15.112:0/289276989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff428064fe0 msgr2=0x7ff4280fb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:06.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.231+0000 7ff42dc94640 1 --2- 172.21.15.112:0/289276989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff428064fe0 0x7ff4280fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:06.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.231+0000 7ff42dc94640 1 -- 172.21.15.112:0/289276989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff418005040 con 0x7ff4280fe450 2024-09-19T09:47:06.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.231+0000 7ff42dc94640 1 --2- 172.21.15.112:0/289276989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4280fe450 0x7ff4280fbaa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff418000c00 tx=0x7ff418009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:06.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.231+0000 7ff41effd640 1 -- 172.21.15.112:0/289276989 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff418038070 con 0x7ff4280fe450 2024-09-19T09:47:06.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.231+0000 7ff41effd640 1 -- 172.21.15.112:0/289276989 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff41802ade0 con 0x7ff4280fe450 2024-09-19T09:47:06.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.231+0000 7ff41effd640 1 -- 172.21.15.112:0/289276989 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff41802c7e0 con 0x7ff4280fe450 2024-09-19T09:47:06.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.231+0000 7ff4306f9640 1 -- 172.21.15.112:0/289276989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4280fc380 con 0x7ff4280fe450 2024-09-19T09:47:06.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.231+0000 7ff4306f9640 1 -- 172.21.15.112:0/289276989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff428119820 con 0x7ff4280fe450 2024-09-19T09:47:06.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.232+0000 7ff4306f9640 1 -- 172.21.15.112:0/289276989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4280fdce0 con 0x7ff4280fe450 2024-09-19T09:47:06.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.233+0000 7ff41effd640 1 -- 172.21.15.112:0/289276989 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff418030020 con 0x7ff4280fe450 2024-09-19T09:47:06.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.233+0000 7ff41effd640 1 --2- 172.21.15.112:0/289276989 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff41406e530 0x7ff4140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:06.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.233+0000 7ff42e495640 1 --2- 172.21.15.112:0/289276989 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff41406e530 0x7ff4140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:06.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.233+0000 7ff41effd640 1 -- 172.21.15.112:0/289276989 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6765+0+0 (secure 0 0 0) 0x7ff4180adf00 con 0x7ff4280fe450 2024-09-19T09:47:06.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.234+0000 7ff42e495640 1 --2- 172.21.15.112:0/289276989 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff41406e530 0x7ff4140709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff424004c80 tx=0x7ff424009c50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:06.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.238+0000 7ff41effd640 1 -- 172.21.15.112:0/289276989 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff418076f90 con 0x7ff4280fe450 2024-09-19T09:47:06.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.413+0000 7ff4306f9640 1 -- 172.21.15.112:0/289276989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff428072ec0 con 0x7ff4280fe450 2024-09-19T09:47:06.416 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:47:06 smithi112 ceph-mon[97503]: pgmap v294: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:06.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.414+0000 7ff41effd640 1 -- 172.21.15.112:0/289276989 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v94) v1 ==== 81+0+2347 (secure 0 0 0) 0x7ff41807a650 con 0x7ff4280fe450 2024-09-19T09:47:06.416 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:6827/1382170395 2024-09-20T09:44:03.168120+0000 2024-09-19T09:47:06.417 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6828/165136062 2024-09-20T09:43:30.254271+0000 2024-09-19T09:47:06.417 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6829/165136062 2024-09-20T09:43:30.254271+0000 2024-09-19T09:47:06.417 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3668590033 2024-09-20T09:38:54.751348+0000 2024-09-19T09:47:06.417 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3554743184 2024-09-20T09:38:54.751348+0000 2024-09-19T09:47:06.417 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/2980065875 2024-09-20T09:38:54.751348+0000 2024-09-19T09:47:06.417 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1110437156 2024-09-20T09:38:54.751348+0000 2024-09-19T09:47:06.417 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3318399440 2024-09-20T09:26:10.763366+0000 2024-09-19T09:47:06.417 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:6828/4211232097 2024-09-20T09:36:47.789350+0000 2024-09-19T09:47:06.417 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/2336666418 2024-09-20T09:26:10.763366+0000 2024-09-19T09:47:06.417 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/1627571174 2024-09-20T09:26:40.441468+0000 2024-09-19T09:47:06.417 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/3210372910 2024-09-20T09:27:43.717543+0000 2024-09-19T09:47:06.417 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/3210372910 2024-09-20T09:27:43.717543+0000 2024-09-19T09:47:06.418 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1633167540 2024-09-20T09:26:40.441468+0000 2024-09-19T09:47:06.418 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/2336666418 2024-09-20T09:26:10.763366+0000 2024-09-19T09:47:06.418 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3555278869 2024-09-20T09:34:41.712653+0000 2024-09-19T09:47:06.418 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1234573048 2024-09-20T09:26:10.763366+0000 2024-09-19T09:47:06.418 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/852695113 2024-09-20T09:27:43.717543+0000 2024-09-19T09:47:06.418 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:6829/4211232097 2024-09-20T09:36:47.789350+0000 2024-09-19T09:47:06.418 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3962529596 2024-09-20T09:34:41.712653+0000 2024-09-19T09:47:06.418 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/18888963 2024-09-20T09:38:54.751348+0000 2024-09-19T09:47:06.418 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/2839937816 2024-09-20T09:26:40.441468+0000 2024-09-19T09:47:06.418 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1621418219 2024-09-20T09:27:43.717543+0000 2024-09-19T09:47:06.418 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/2880667232 2024-09-20T09:34:41.712653+0000 2024-09-19T09:47:06.418 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:0/1236846199 2024-09-20T09:36:47.789350+0000 2024-09-19T09:47:06.418 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/18888963 2024-09-20T09:38:54.751348+0000 2024-09-19T09:47:06.419 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/616967539 2024-09-20T09:26:40.441468+0000 2024-09-19T09:47:06.419 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:0/3738726278 2024-09-20T09:36:47.789350+0000 2024-09-19T09:47:06.419 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:6826/1382170395 2024-09-20T09:44:03.168120+0000 2024-09-19T09:47:06.419 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3517126379 2024-09-20T09:34:41.712653+0000 2024-09-19T09:47:06.419 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6826/3112259740 2024-09-20T09:32:39.813865+0000 2024-09-19T09:47:06.419 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/3495376281 2024-09-20T09:34:41.712653+0000 2024-09-19T09:47:06.419 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6827/3112259740 2024-09-20T09:32:39.813865+0000 2024-09-19T09:47:06.419 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/3495376281 2024-09-20T09:34:41.712653+0000 2024-09-19T09:47:06.419 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:0/2736314700 2024-09-20T09:36:47.789350+0000 2024-09-19T09:47:06.419 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/1627571174 2024-09-20T09:26:40.441468+0000 2024-09-19T09:47:06.419 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.191:0/2944289201 2024-09-20T09:36:47.789350+0000 2024-09-19T09:47:06.420 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/2459323098 2024-09-20T09:26:10.763366+0000 2024-09-19T09:47:06.420 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/2752965886 2024-09-20T09:27:43.717543+0000 2024-09-19T09:47:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:listed 39 entries 2024-09-19T09:47:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.417+0000 7ff4306f9640 1 -- 172.21.15.112:0/289276989 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff41406e530 msgr2=0x7ff4140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.417+0000 7ff4306f9640 1 --2- 172.21.15.112:0/289276989 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff41406e530 0x7ff4140709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff424004c80 tx=0x7ff424009c50 comp rx=0 tx=0).stop 2024-09-19T09:47:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.417+0000 7ff4306f9640 1 -- 172.21.15.112:0/289276989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4280fe450 msgr2=0x7ff4280fbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.417+0000 7ff4306f9640 1 --2- 172.21.15.112:0/289276989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4280fe450 0x7ff4280fbaa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff418000c00 tx=0x7ff418009da0 comp rx=0 tx=0).stop 2024-09-19T09:47:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.417+0000 7ff4306f9640 1 -- 172.21.15.112:0/289276989 shutdown_connections 2024-09-19T09:47:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.417+0000 7ff4306f9640 1 --2- 172.21.15.112:0/289276989 >> [v2:172.21.15.112:6800/3742350100,v1:172.21.15.112:6801/3742350100] conn(0x7ff41406e530 0x7ff4140709e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.417+0000 7ff4306f9640 1 --2- 172.21.15.112:0/289276989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4280fe450 0x7ff4280fbaa0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.417+0000 7ff4306f9640 1 --2- 172.21.15.112:0/289276989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff428064fe0 0x7ff4280fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.417+0000 7ff4306f9640 1 -- 172.21.15.112:0/289276989 >> 172.21.15.112:0/289276989 conn(0x7ff4280723b0 msgr2=0x7ff428105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.418+0000 7ff4306f9640 1 -- 172.21.15.112:0/289276989 shutdown_connections 2024-09-19T09:47:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-19T09:47:06.418+0000 7ff4306f9640 1 -- 172.21.15.112:0/289276989 wait complete. 2024-09-19T09:47:06.535 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:47:06 smithi191 ceph-mon[77624]: pgmap v294: 65 pgs: 65 active+clean; 202 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:07.049 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-19T09:47:07.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:47:07.050 DEBUG:teuthology.orchestra.run.smithi191:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-19T09:47:07.086 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2024-09-19T09:47:07.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:47:07.086 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T09:47:07.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:47:07.155 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-19T09:47:07.171 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:47:07.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:47:07.172 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:47:07.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:47:07 smithi112 ceph-mon[97503]: from='client.? 172.21.15.112:0/289276989' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:47:07.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:47:07.215 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-09-19T09:47:07.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:47:07.311 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2024-09-19T09:47:07.330 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T09:47:07.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:47:07.331 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:47:07.395 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:47:07 smithi191 ceph-mon[77624]: from='client.? 172.21.15.112:0/289276989' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:47:07.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:47:07.402 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2024-09-19T09:47:07.504 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T09:47:07.517 INFO:tasks.cephadm:Teardown begin 2024-09-19T09:47:07.517 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:47:07.544 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:47:07.572 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T09:47:07.572 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:47:07.600 DEBUG:teuthology.orchestra.run.smithi191:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:47:07.627 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T09:47:07.627 INFO:tasks.cephadm.mon.smithi112:Stopping mon.smithi112... 2024-09-19T09:47:07.628 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mon.smithi112 2024-09-19T09:47:07.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:47:07 smithi112 systemd[1]: Stopping Ceph mon.smithi112 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:08.248 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:47:07 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112[97499]: 2024-09-19T09:47:07.962+0000 7fb07d058640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi112 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:47:08.249 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:47:07 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112[97499]: 2024-09-19T09:47:07.962+0000 7fb07d058640 -1 mon.smithi112@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T09:47:08.249 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:47:08 smithi112 podman[140236]: 2024-09-19 09:47:08.136059774 +0000 UTC m=+0.311593551 container died 89dfb5de44c8cedd0254cfb7e803411b4536f0d7b4eff349aedafee6b98656e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T09:47:08.797 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:47:08 smithi112 podman[140236]: 2024-09-19 09:47:08.527697382 +0000 UTC m=+0.703231149 container cleanup 89dfb5de44c8cedd0254cfb7e803411b4536f0d7b4eff349aedafee6b98656e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:47:08.797 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 19 09:47:08 smithi112 bash[140236]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi112 2024-09-19T09:47:08.957 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mon.smithi112.service' 2024-09-19T09:47:09.003 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:47:09.003 INFO:tasks.cephadm.mon.smithi112:Stopped mon.smithi112 2024-09-19T09:47:09.003 INFO:tasks.cephadm.mon.smithi191:Stopping mon.smithi191... 2024-09-19T09:47:09.003 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mon.smithi191 2024-09-19T09:47:09.285 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:47:09 smithi191 systemd[1]: Stopping Ceph mon.smithi191 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:09.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:47:09 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi191[77620]: 2024-09-19T09:47:09.326+0000 7ff0987a5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi191 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:47:09.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:47:09 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi191[77620]: 2024-09-19T09:47:09.326+0000 7ff0987a5640 -1 mon.smithi191@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:47:09.785 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:47:09 smithi191 podman[109462]: 2024-09-19 09:47:09.520012477 +0000 UTC m=+0.319885132 container died 3cab8f7cc27e658f6fe5d2125dfd05811fcc2f915a388bc15268da5ab73a3ecc (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi191, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T09:47:10.255 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:47:10 smithi191 podman[109462]: 2024-09-19 09:47:10.027322525 +0000 UTC m=+0.827195176 container cleanup 3cab8f7cc27e658f6fe5d2125dfd05811fcc2f915a388bc15268da5ab73a3ecc (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi191, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T09:47:10.255 INFO:journalctl@ceph.mon.smithi191.smithi191.stdout:Sep 19 09:47:10 smithi191 bash[109462]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-mon-smithi191 2024-09-19T09:47:10.410 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@mon.smithi191.service' 2024-09-19T09:47:10.453 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:47:10.453 INFO:tasks.cephadm.mon.smithi191:Stopped mon.smithi191 2024-09-19T09:47:10.453 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T09:47:10.454 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.0 2024-09-19T09:47:10.733 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:47:10 smithi112 systemd[1]: Stopping Ceph osd.0 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:11.189 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:47:10 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0[108640]: 2024-09-19T09:47:10.731+0000 7f821efa9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:47:11.189 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:47:10 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0[108640]: 2024-09-19T09:47:10.731+0000 7f821efa9640 -1 osd.0 94 *** Got signal Terminated *** 2024-09-19T09:47:11.189 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:47:10 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0[108640]: 2024-09-19T09:47:10.731+0000 7f821efa9640 -1 osd.0 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:47:16.535 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:47:16 smithi112 podman[140458]: 2024-09-19 09:47:16.235426972 +0000 UTC m=+5.603195360 container died 11a51e66388757b9a3eae260696481cd59ed6e2659a1d201d13687eecae633e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:47:16.926 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:47:16 smithi112 podman[140458]: 2024-09-19 09:47:16.657157517 +0000 UTC m=+6.024925904 container cleanup 11a51e66388757b9a3eae260696481cd59ed6e2659a1d201d13687eecae633e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T09:47:16.926 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:47:16 smithi112 bash[140458]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0 2024-09-19T09:47:17.189 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:47:16 smithi112 podman[140489]: 2024-09-19 09:47:16.925272179 +0000 UTC m=+0.690047633 container remove 11a51e66388757b9a3eae260696481cd59ed6e2659a1d201d13687eecae633e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:47:17.605 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:47:17 smithi112 podman[140579]: 2024-09-19 09:47:17.323374318 +0000 UTC m=+0.016594436 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:47:17.605 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:47:17 smithi112 podman[140579]: 2024-09-19 09:47:17.459659478 +0000 UTC m=+0.152879583 container create 24de627762a2636519d60bc6cffe51665d5f2b2e002d232ab2a6ea4afacf43a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T09:47:17.926 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:47:17 smithi112 podman[140579]: 2024-09-19 09:47:17.728779764 +0000 UTC m=+0.421999868 container init 24de627762a2636519d60bc6cffe51665d5f2b2e002d232ab2a6ea4afacf43a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:47:17.926 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:47:17 smithi112 podman[140579]: 2024-09-19 09:47:17.732107165 +0000 UTC m=+0.425327269 container start 24de627762a2636519d60bc6cffe51665d5f2b2e002d232ab2a6ea4afacf43a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T09:47:17.926 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:47:17 smithi112 podman[140579]: 2024-09-19 09:47:17.81201244 +0000 UTC m=+0.505232555 container attach 24de627762a2636519d60bc6cffe51665d5f2b2e002d232ab2a6ea4afacf43a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:47:18.189 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 19 09:47:17 smithi112 podman[140579]: 2024-09-19 09:47:17.925156818 +0000 UTC m=+0.618376933 container died 24de627762a2636519d60bc6cffe51665d5f2b2e002d232ab2a6ea4afacf43a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:47:18.618 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T09:47:18.660 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:47:18.660 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T09:47:18.660 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T09:47:18.660 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.1 2024-09-19T09:47:19.016 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:47:18 smithi112 systemd[1]: Stopping Ceph osd.1 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:19.438 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:47:19 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1[114288]: 2024-09-19T09:47:19.014+0000 7f54c4f4e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:47:19.439 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:47:19 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1[114288]: 2024-09-19T09:47:19.014+0000 7f54c4f4e640 -1 osd.1 94 *** Got signal Terminated *** 2024-09-19T09:47:19.439 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:47:19 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1[114288]: 2024-09-19T09:47:19.014+0000 7f54c4f4e640 -1 osd.1 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:47:24.654 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:47:24 smithi112 podman[140682]: 2024-09-19 09:47:24.357757342 +0000 UTC m=+5.478134180 container died bd616fcb189b9326ea47a8a88e3a566d191d1dbfeb15416bf11c7368555b3be7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:47:24.939 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:47:24 smithi112 podman[140682]: 2024-09-19 09:47:24.752050807 +0000 UTC m=+5.872427649 container cleanup bd616fcb189b9326ea47a8a88e3a566d191d1dbfeb15416bf11c7368555b3be7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T09:47:24.939 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:47:24 smithi112 bash[140682]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1 2024-09-19T09:47:25.397 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:47:24 smithi112 podman[140700]: 2024-09-19 09:47:24.994935265 +0000 UTC m=+0.632664529 container remove bd616fcb189b9326ea47a8a88e3a566d191d1dbfeb15416bf11c7368555b3be7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:47:25.674 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:47:25 smithi112 podman[140788]: 2024-09-19 09:47:25.298702832 +0000 UTC m=+0.016023933 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:47:25.674 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:47:25 smithi112 podman[140788]: 2024-09-19 09:47:25.404056322 +0000 UTC m=+0.121377468 container create c558730858d80e466446ab3a5a45e8fe9887bd2c78c4f0f041d9bafa676c54e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T09:47:25.674 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:47:25 smithi112 podman[140788]: 2024-09-19 09:47:25.67334069 +0000 UTC m=+0.390661800 container init c558730858d80e466446ab3a5a45e8fe9887bd2c78c4f0f041d9bafa676c54e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T09:47:25.939 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:47:25 smithi112 podman[140788]: 2024-09-19 09:47:25.676662986 +0000 UTC m=+0.393984093 container start c558730858d80e466446ab3a5a45e8fe9887bd2c78c4f0f041d9bafa676c54e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:47:25.939 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:47:25 smithi112 podman[140788]: 2024-09-19 09:47:25.773283536 +0000 UTC m=+0.490604645 container attach c558730858d80e466446ab3a5a45e8fe9887bd2c78c4f0f041d9bafa676c54e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:47:25.939 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 19 09:47:25 smithi112 podman[140788]: 2024-09-19 09:47:25.861610688 +0000 UTC m=+0.578931788 container died c558730858d80e466446ab3a5a45e8fe9887bd2c78c4f0f041d9bafa676c54e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:47:26.531 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T09:47:26.570 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:47:26.570 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T09:47:26.570 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T09:47:26.570 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.2 2024-09-19T09:47:26.923 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:47:26 smithi112 systemd[1]: Stopping Ceph osd.2 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:27.189 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:47:26 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2[119900]: 2024-09-19T09:47:26.920+0000 7f259bc8f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:47:27.189 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:47:26 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2[119900]: 2024-09-19T09:47:26.920+0000 7f259bc8f640 -1 osd.2 94 *** Got signal Terminated *** 2024-09-19T09:47:27.189 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:47:26 smithi112 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2[119900]: 2024-09-19T09:47:26.920+0000 7f259bc8f640 -1 osd.2 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:47:32.549 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:47:32 smithi112 podman[140891]: 2024-09-19 09:47:32.247893789 +0000 UTC m=+5.450117139 container died 4a651b62590fd59c8ac8ea4ac3a1464fe8742b0febf6d0daac6b900b4e61bb3a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T09:47:32.890 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:47:32 smithi112 podman[140891]: 2024-09-19 09:47:32.654862041 +0000 UTC m=+5.857085403 container cleanup 4a651b62590fd59c8ac8ea4ac3a1464fe8742b0febf6d0daac6b900b4e61bb3a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T09:47:32.890 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:47:32 smithi112 bash[140891]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2 2024-09-19T09:47:33.188 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:47:32 smithi112 podman[140907]: 2024-09-19 09:47:32.88944337 +0000 UTC m=+0.633208125 container remove 4a651b62590fd59c8ac8ea4ac3a1464fe8742b0febf6d0daac6b900b4e61bb3a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T09:47:33.502 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:47:33 smithi112 podman[140995]: 2024-09-19 09:47:33.123911107 +0000 UTC m=+0.015798398 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:47:33.502 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:47:33 smithi112 podman[140995]: 2024-09-19 09:47:33.257089808 +0000 UTC m=+0.148977138 container create b72dbbe2b4150cf09ab38f61071da9814a494e8ee6ea149c9a86013d1a0f006a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:47:33.502 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:47:33 smithi112 podman[140995]: 2024-09-19 09:47:33.501018925 +0000 UTC m=+0.392906217 container init b72dbbe2b4150cf09ab38f61071da9814a494e8ee6ea149c9a86013d1a0f006a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:47:33.939 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:47:33 smithi112 podman[140995]: 2024-09-19 09:47:33.505180899 +0000 UTC m=+0.397068192 container start b72dbbe2b4150cf09ab38f61071da9814a494e8ee6ea149c9a86013d1a0f006a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T09:47:33.939 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:47:33 smithi112 podman[140995]: 2024-09-19 09:47:33.592686114 +0000 UTC m=+0.484573407 container attach b72dbbe2b4150cf09ab38f61071da9814a494e8ee6ea149c9a86013d1a0f006a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731) 2024-09-19T09:47:33.939 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 19 09:47:33 smithi112 podman[140995]: 2024-09-19 09:47:33.690688296 +0000 UTC m=+0.582575580 container died b72dbbe2b4150cf09ab38f61071da9814a494e8ee6ea149c9a86013d1a0f006a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:47:34.328 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T09:47:34.370 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:47:34.370 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T09:47:34.370 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T09:47:34.370 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.3 2024-09-19T09:47:34.672 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:47:34 smithi191 systemd[1]: Stopping Ceph osd.3 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:35.034 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:47:34 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3[87324]: 2024-09-19T09:47:34.670+0000 7f495a02f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:47:35.035 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:47:34 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3[87324]: 2024-09-19T09:47:34.670+0000 7f495a02f640 -1 osd.3 94 *** Got signal Terminated *** 2024-09-19T09:47:35.035 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:47:34 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3[87324]: 2024-09-19T09:47:34.670+0000 7f495a02f640 -1 osd.3 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:47:38.785 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:38 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[92168]: 2024-09-19T09:47:38.480+0000 7fb7a165a640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:15.280460+0000 front 2024-09-19T09:47:15.280581+0000 (oldest deadline 2024-09-19T09:47:38.180234+0000) 2024-09-19T09:47:39.785 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:39 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[92168]: 2024-09-19T09:47:39.501+0000 7fb7a165a640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:15.280460+0000 front 2024-09-19T09:47:15.280581+0000 (oldest deadline 2024-09-19T09:47:38.180234+0000) 2024-09-19T09:47:40.356 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:47:40 smithi191 podman[109595]: 2024-09-19 09:47:40.096043726 +0000 UTC m=+5.532148198 container died 7f953c69160832b245eb2da1ddb2167ce05e7fbb4c3fb2b4cb6fc1d4aafb7815 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T09:47:40.715 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:40 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[92168]: 2024-09-19T09:47:40.459+0000 7fb7a165a640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:15.280460+0000 front 2024-09-19T09:47:15.280581+0000 (oldest deadline 2024-09-19T09:47:38.180234+0000) 2024-09-19T09:47:40.715 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:47:40 smithi191 podman[109595]: 2024-09-19 09:47:40.529224377 +0000 UTC m=+5.965328845 container cleanup 7f953c69160832b245eb2da1ddb2167ce05e7fbb4c3fb2b4cb6fc1d4aafb7815 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T09:47:40.716 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:47:40 smithi191 bash[109595]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3 2024-09-19T09:47:41.003 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:47:40 smithi191 podman[109624]: 2024-09-19 09:47:40.71424736 +0000 UTC m=+0.614590971 container remove 7f953c69160832b245eb2da1ddb2167ce05e7fbb4c3fb2b4cb6fc1d4aafb7815 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T09:47:41.260 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:41 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:41.001+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:14.176506+0000 front 2024-09-19T09:47:14.176378+0000 (oldest deadline 2024-09-19T09:47:40.076247+0000) 2024-09-19T09:47:41.260 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:47:41 smithi191 podman[109715]: 2024-09-19 09:47:41.0433654 +0000 UTC m=+0.015545875 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:47:41.260 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:47:41 smithi191 podman[109715]: 2024-09-19 09:47:41.148697318 +0000 UTC m=+0.120877782 container create 2816276f9f837845e3425f37699c3288f5ea530d3c903c60818a4ec9ed8ac0ef (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T09:47:41.535 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:41 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[92168]: 2024-09-19T09:47:41.493+0000 7fb7a165a640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:15.280460+0000 front 2024-09-19T09:47:15.280581+0000 (oldest deadline 2024-09-19T09:47:38.180234+0000) 2024-09-19T09:47:41.535 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:47:41 smithi191 podman[109715]: 2024-09-19 09:47:41.384664902 +0000 UTC m=+0.356845365 container init 2816276f9f837845e3425f37699c3288f5ea530d3c903c60818a4ec9ed8ac0ef (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T09:47:41.535 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:47:41 smithi191 podman[109715]: 2024-09-19 09:47:41.38793338 +0000 UTC m=+0.360113839 container start 2816276f9f837845e3425f37699c3288f5ea530d3c903c60818a4ec9ed8ac0ef (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:47:41.535 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:47:41 smithi191 podman[109715]: 2024-09-19 09:47:41.467805164 +0000 UTC m=+0.439985641 container attach 2816276f9f837845e3425f37699c3288f5ea530d3c903c60818a4ec9ed8ac0ef (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T09:47:41.855 INFO:journalctl@ceph.osd.3.smithi191.stdout:Sep 19 09:47:41 smithi191 podman[109715]: 2024-09-19 09:47:41.574274849 +0000 UTC m=+0.546455309 container died 2816276f9f837845e3425f37699c3288f5ea530d3c903c60818a4ec9ed8ac0ef (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:47:42.148 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:41 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:41.954+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:14.176506+0000 front 2024-09-19T09:47:14.176378+0000 (oldest deadline 2024-09-19T09:47:40.076247+0000) 2024-09-19T09:47:42.166 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T09:47:42.205 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:47:42.205 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T09:47:42.206 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T09:47:42.206 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.4 2024-09-19T09:47:42.535 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:42 smithi191 systemd[1]: Stopping Ceph osd.4 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:42.919 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:42 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[92168]: 2024-09-19T09:47:42.537+0000 7fb7a165a640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:15.280460+0000 front 2024-09-19T09:47:15.280581+0000 (oldest deadline 2024-09-19T09:47:38.180234+0000) 2024-09-19T09:47:42.920 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:42 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[92168]: 2024-09-19T09:47:42.558+0000 7fb7a5055640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:47:42.920 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:42 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[92168]: 2024-09-19T09:47:42.558+0000 7fb7a5055640 -1 osd.4 94 *** Got signal Terminated *** 2024-09-19T09:47:42.920 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:42 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[92168]: 2024-09-19T09:47:42.558+0000 7fb7a5055640 -1 osd.4 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:47:43.284 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:42 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:42.917+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:14.176506+0000 front 2024-09-19T09:47:14.176378+0000 (oldest deadline 2024-09-19T09:47:40.076247+0000) 2024-09-19T09:47:43.889 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:43 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[92168]: 2024-09-19T09:47:43.584+0000 7fb7a165a640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:15.280460+0000 front 2024-09-19T09:47:15.280581+0000 (oldest deadline 2024-09-19T09:47:38.180234+0000) 2024-09-19T09:47:44.284 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:43 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:43.887+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:14.176506+0000 front 2024-09-19T09:47:14.176378+0000 (oldest deadline 2024-09-19T09:47:40.076247+0000) 2024-09-19T09:47:44.862 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:44 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[92168]: 2024-09-19T09:47:44.602+0000 7fb7a165a640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:15.280460+0000 front 2024-09-19T09:47:15.280581+0000 (oldest deadline 2024-09-19T09:47:38.180234+0000) 2024-09-19T09:47:45.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:44 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:44.860+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:14.176506+0000 front 2024-09-19T09:47:14.176378+0000 (oldest deadline 2024-09-19T09:47:40.076247+0000) 2024-09-19T09:47:45.899 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:45 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[92168]: 2024-09-19T09:47:45.635+0000 7fb7a165a640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:15.280460+0000 front 2024-09-19T09:47:15.280581+0000 (oldest deadline 2024-09-19T09:47:38.180234+0000) 2024-09-19T09:47:46.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:45 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:45.897+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:14.176506+0000 front 2024-09-19T09:47:14.176378+0000 (oldest deadline 2024-09-19T09:47:40.076247+0000) 2024-09-19T09:47:46.930 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:46 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4[92168]: 2024-09-19T09:47:46.665+0000 7fb7a165a640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:15.280460+0000 front 2024-09-19T09:47:15.280581+0000 (oldest deadline 2024-09-19T09:47:38.180234+0000) 2024-09-19T09:47:47.284 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:46 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:46.928+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:14.176506+0000 front 2024-09-19T09:47:14.176378+0000 (oldest deadline 2024-09-19T09:47:40.076247+0000) 2024-09-19T09:47:48.244 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:47 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:47.963+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:14.176506+0000 front 2024-09-19T09:47:14.176378+0000 (oldest deadline 2024-09-19T09:47:40.076247+0000) 2024-09-19T09:47:48.244 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:47 smithi191 podman[109819]: 2024-09-19 09:47:47.928748933 +0000 UTC m=+5.495616253 container died 3cd638400a3a5dc0677005c6f53ceffde898c74e409e03aa1745e4f3d6315a28 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T09:47:48.534 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:48 smithi191 podman[109819]: 2024-09-19 09:47:48.325105404 +0000 UTC m=+5.891972724 container cleanup 3cd638400a3a5dc0677005c6f53ceffde898c74e409e03aa1745e4f3d6315a28 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T09:47:48.535 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:48 smithi191 bash[109819]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4 2024-09-19T09:47:48.870 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:48 smithi191 podman[109836]: 2024-09-19 09:47:48.551369986 +0000 UTC m=+0.615787713 container remove 3cd638400a3a5dc0677005c6f53ceffde898c74e409e03aa1745e4f3d6315a28 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:47:49.181 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:48 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:48.976+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:14.176506+0000 front 2024-09-19T09:47:14.176378+0000 (oldest deadline 2024-09-19T09:47:40.076247+0000) 2024-09-19T09:47:49.181 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:48 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:48.977+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-19T09:47:20.076757+0000 front 2024-09-19T09:47:20.076744+0000 (oldest deadline 2024-09-19T09:47:48.276942+0000) 2024-09-19T09:47:49.181 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:48 smithi191 podman[109925]: 2024-09-19 09:47:48.868919994 +0000 UTC m=+0.097016298 container create 1c81d91c17c017425ebaeabb849b1839869345638df20266e248fe48fafa195d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T09:47:49.182 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:48 smithi191 podman[109925]: 2024-09-19 09:47:48.787744313 +0000 UTC m=+0.015840626 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:47:49.182 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:49 smithi191 podman[109925]: 2024-09-19 09:47:49.0968508 +0000 UTC m=+0.324947111 container init 1c81d91c17c017425ebaeabb849b1839869345638df20266e248fe48fafa195d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T09:47:49.182 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:49 smithi191 podman[109925]: 2024-09-19 09:47:49.100200309 +0000 UTC m=+0.328296622 container start 1c81d91c17c017425ebaeabb849b1839869345638df20266e248fe48fafa195d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:47:49.182 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:49 smithi191 podman[109925]: 2024-09-19 09:47:49.179839787 +0000 UTC m=+0.407936106 container attach 1c81d91c17c017425ebaeabb849b1839869345638df20266e248fe48fafa195d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T09:47:49.535 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 19 09:47:49 smithi191 podman[109925]: 2024-09-19 09:47:49.298174403 +0000 UTC m=+0.526270721 container died 1c81d91c17c017425ebaeabb849b1839869345638df20266e248fe48fafa195d (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:47:49.972 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T09:47:50.010 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:47:50.010 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T09:47:50.011 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T09:47:50.011 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.5 2024-09-19T09:47:50.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:49 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:49.990+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:14.176506+0000 front 2024-09-19T09:47:14.176378+0000 (oldest deadline 2024-09-19T09:47:40.076247+0000) 2024-09-19T09:47:50.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:49 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:49.990+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-19T09:47:20.076757+0000 front 2024-09-19T09:47:20.076744+0000 (oldest deadline 2024-09-19T09:47:48.276942+0000) 2024-09-19T09:47:50.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:50 smithi191 systemd[1]: Stopping Ceph osd.5 for 0bd98d30-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:50.784 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:50 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:50.345+0000 7fde0fadb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:47:50.785 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:50 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:50.345+0000 7fde0fadb640 -1 osd.5 94 *** Got signal Terminated *** 2024-09-19T09:47:50.785 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:50 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:50.345+0000 7fde0fadb640 -1 osd.5 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:47:51.284 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:50 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:50.942+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:14.176506+0000 front 2024-09-19T09:47:14.176378+0000 (oldest deadline 2024-09-19T09:47:40.076247+0000) 2024-09-19T09:47:51.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:50 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:50.942+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-19T09:47:20.076757+0000 front 2024-09-19T09:47:20.076744+0000 (oldest deadline 2024-09-19T09:47:48.276942+0000) 2024-09-19T09:47:52.246 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:51 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:51.976+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:14.176506+0000 front 2024-09-19T09:47:14.176378+0000 (oldest deadline 2024-09-19T09:47:40.076247+0000) 2024-09-19T09:47:52.247 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:51 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:51.976+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-19T09:47:20.076757+0000 front 2024-09-19T09:47:20.076744+0000 (oldest deadline 2024-09-19T09:47:48.276942+0000) 2024-09-19T09:47:53.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:53 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:53.004+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:14.176506+0000 front 2024-09-19T09:47:14.176378+0000 (oldest deadline 2024-09-19T09:47:40.076247+0000) 2024-09-19T09:47:53.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:53 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:53.004+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-19T09:47:20.076757+0000 front 2024-09-19T09:47:20.076744+0000 (oldest deadline 2024-09-19T09:47:48.276942+0000) 2024-09-19T09:47:54.284 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:53 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:53.982+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:14.176506+0000 front 2024-09-19T09:47:14.176378+0000 (oldest deadline 2024-09-19T09:47:40.076247+0000) 2024-09-19T09:47:54.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:53 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:53.982+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-19T09:47:20.076757+0000 front 2024-09-19T09:47:20.076744+0000 (oldest deadline 2024-09-19T09:47:48.276942+0000) 2024-09-19T09:47:55.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:55 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:55.021+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-19T09:47:14.176506+0000 front 2024-09-19T09:47:14.176378+0000 (oldest deadline 2024-09-19T09:47:40.076247+0000) 2024-09-19T09:47:55.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:55 smithi191 ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5[97009]: 2024-09-19T09:47:55.021+0000 7fde080d8640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-19T09:47:20.076757+0000 front 2024-09-19T09:47:20.076744+0000 (oldest deadline 2024-09-19T09:47:48.276942+0000) 2024-09-19T09:47:55.956 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:55 smithi191 podman[110026]: 2024-09-19 09:47:55.675143556 +0000 UTC m=+5.450431890 container died 901aaba16a54589b205073b7555de0722ff3687282291562311b26fd0d8cd09a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:47:56.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:56 smithi191 podman[110026]: 2024-09-19 09:47:56.14563531 +0000 UTC m=+5.920923684 container cleanup 901aaba16a54589b205073b7555de0722ff3687282291562311b26fd0d8cd09a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T09:47:56.285 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:56 smithi191 bash[110026]: ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5 2024-09-19T09:47:56.765 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:56 smithi191 podman[110044]: 2024-09-19 09:47:56.405268594 +0000 UTC m=+0.730653258 container remove 901aaba16a54589b205073b7555de0722ff3687282291562311b26fd0d8cd09a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:47:57.035 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:56 smithi191 podman[110132]: 2024-09-19 09:47:56.764551544 +0000 UTC m=+0.109950005 container create d678aa9c40b71ff7b384ae05576d50e4a00173a536869a84fcd61bd2fdb85f30 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:47:57.035 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:56 smithi191 podman[110132]: 2024-09-19 09:47:56.670178662 +0000 UTC m=+0.015577088 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:47:57.035 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:56 smithi191 podman[110132]: 2024-09-19 09:47:56.97527091 +0000 UTC m=+0.320669332 container init d678aa9c40b71ff7b384ae05576d50e4a00173a536869a84fcd61bd2fdb85f30 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-19T09:47:57.035 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:56 smithi191 podman[110132]: 2024-09-19 09:47:56.979134124 +0000 UTC m=+0.324532539 container start d678aa9c40b71ff7b384ae05576d50e4a00173a536869a84fcd61bd2fdb85f30 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T09:47:57.454 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:57 smithi191 podman[110132]: 2024-09-19 09:47:57.05853766 +0000 UTC m=+0.403936084 container attach d678aa9c40b71ff7b384ae05576d50e4a00173a536869a84fcd61bd2fdb85f30 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True) 2024-09-19T09:47:57.454 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 19 09:47:57 smithi191 podman[110132]: 2024-09-19 09:47:57.169622899 +0000 UTC m=+0.515021321 container died d678aa9c40b71ff7b384ae05576d50e4a00173a536869a84fcd61bd2fdb85f30 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-0bd98d30-7669-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T09:47:57.738 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bd98d30-7669-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T09:47:57.777 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:47:57.777 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T09:47:57.777 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:48:19.844 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:48:33.041 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:48:33.074 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:48:33.101 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T09:48:33.103 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911915/remote/smithi112/crash 2024-09-19T09:48:33.104 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:48:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:tar: /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:48:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:48:33.142 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911915/remote/smithi191/crash 2024-09-19T09:48:33.143 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:48:33.167 INFO:teuthology.orchestra.run.smithi191.stderr:tar: /var/lib/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:48:33.167 INFO:teuthology.orchestra.run.smithi191.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:48:33.168 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T09:48:33.168 DEBUG:teuthology.orchestra.run.smithi112:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-19T09:48:33.224 INFO:tasks.cephadm:Compressing logs... 2024-09-19T09:48:33.225 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:48:33.267 DEBUG:teuthology.orchestra.run.smithi191:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:48:33.296 INFO:teuthology.orchestra.run.smithi191.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi191.jjldod.log 2024-09-19T09:48:33.296 INFO:teuthology.orchestra.run.smithi191.stderr:: No such file or directory 2024-09-19T09:48:33.296 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mgr.smithi191.xjpplx.log 2024-09-19T09:48:33.297 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:48:33.297 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi191.jjldod.log: /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mgr.smithi191.xjpplx.log: gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T09:48:33.297 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:48:33.297 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mon.smithi191.log 2024-09-19T09:48:33.297 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.4.log: /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:48:33.297 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mon.smithi191.log: gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi191.qweljt.log 2024-09-19T09:48:33.297 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T09:48:33.297 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi191.qweljt.log: 85.4% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:48:33.302 INFO:teuthology.orchestra.run.smithi191.stderr: 91.3% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:48:33.302 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:48:33.302 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T09:48:33.302 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.log: 92.0% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi191.jjldod.log.gz 2024-09-19T09:48:33.302 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:48:33.302 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.3.log: 87.6% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:48:33.303 INFO:teuthology.orchestra.run.smithi112.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T09:48:33.303 INFO:teuthology.orchestra.run.smithi112.stderr:: No such file or directory 2024-09-19T09:48:33.304 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi112.ymjyok.log 2024-09-19T09:48:33.304 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mgr.smithi112.puhuua.log 2024-09-19T09:48:33.304 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T09:48:33.304 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi112.ymjyok.log: /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mgr.smithi112.puhuua.log: gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:48:33.304 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:48:33.304 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.1.log: /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:48:33.304 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T09:48:33.304 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:48:33.304 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.2.log: 86.4% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:48:33.304 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi112.hcoxjz.log 2024-09-19T09:48:33.304 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.log: 91.2% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:48:33.304 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:48:33.304 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mon.smithi112.log 2024-09-19T09:48:33.304 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi112.hcoxjz.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:48:33.305 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:48:33.312 INFO:teuthology.orchestra.run.smithi191.stderr: 91.0% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:48:33.315 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mon.smithi112.log: 91.0% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:48:33.343 INFO:teuthology.orchestra.run.smithi191.stderr: 89.7% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mgr.smithi191.xjpplx.log.gz 2024-09-19T09:48:33.353 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:48:33.572 INFO:teuthology.orchestra.run.smithi191.stderr: 92.5% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mon.smithi191.log.gz 2024-09-19T09:48:33.639 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mgr.smithi112.puhuua.log.gz 2024-09-19T09:48:34.342 INFO:teuthology.orchestra.run.smithi112.stderr: 90.6% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mon.smithi112.log.gz 2024-09-19T09:48:38.029 INFO:teuthology.orchestra.run.smithi191.stderr: 93.2% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T09:48:38.387 INFO:teuthology.orchestra.run.smithi112.stderr: 93.3% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T09:48:38.619 INFO:teuthology.orchestra.run.smithi191.stderr: 94.9% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi191.qweljt.log.gz 2024-09-19T09:48:38.978 INFO:teuthology.orchestra.run.smithi191.stderr: 93.5% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T09:48:39.050 INFO:teuthology.orchestra.run.smithi112.stderr: 93.2% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T09:48:39.617 INFO:teuthology.orchestra.run.smithi191.stderr: 93.5% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T09:48:39.619 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-09-19T09:48:39.619 INFO:teuthology.orchestra.run.smithi191.stderr:real 0m6.337s 2024-09-19T09:48:39.619 INFO:teuthology.orchestra.run.smithi191.stderr:user 0m21.564s 2024-09-19T09:48:39.619 INFO:teuthology.orchestra.run.smithi191.stderr:sys 0m0.841s 2024-09-19T09:48:41.497 INFO:teuthology.orchestra.run.smithi112.stderr: 93.0% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T09:48:46.188 INFO:teuthology.orchestra.run.smithi112.stderr: 95.0% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi112.ymjyok.log.gz 2024-09-19T09:50:07.543 INFO:teuthology.orchestra.run.smithi112.stderr: 92.8% -- replaced with /var/log/ceph/0bd98d30-7669-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi112.hcoxjz.log.gz 2024-09-19T09:50:07.544 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-19T09:50:07.544 INFO:teuthology.orchestra.run.smithi112.stderr:real 1m34.263s 2024-09-19T09:50:07.544 INFO:teuthology.orchestra.run.smithi112.stderr:user 2m3.389s 2024-09-19T09:50:07.544 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m3.982s 2024-09-19T09:50:07.545 INFO:tasks.cephadm:Archiving logs... 2024-09-19T09:50:07.546 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911915/remote/smithi112/log 2024-09-19T09:50:07.748 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:50:26.606 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911915/remote/smithi191/log 2024-09-19T09:50:26.607 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:50:29.834 INFO:tasks.cephadm:Removing cluster... 2024-09-19T09:50:29.835 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 --force 2024-09-19T09:50:30.452 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0bd98d30-7669-11ef-bceb-c7b262605968 --force 2024-09-19T09:50:30.952 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T09:50:30.953 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:50:30.970 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:50:30.986 INFO:tasks.cephadm:Teardown complete 2024-09-19T09:50:30.987 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T09:50:31.001 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T09:50:31.001 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:50:31.014 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:50:31.111 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T09:50:31.121 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T09:50:31.122 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:50:31.124 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:50:31.136 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:50:31.142 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:50:31.142 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-19T09:50:31.142 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv01.front.sepia.ceph.com 3 6 377 31 +512us[ +511us] +/- 38ms 2024-09-19T09:50:31.142 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 -1887us[-1887us] +/- 72ms 2024-09-19T09:50:31.142 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +856us[ +856us] +/- 62ms 2024-09-19T09:50:31.142 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:50:31.143 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:50:31.144 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:50:31.144 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-09-19T09:50:31.144 INFO:teuthology.orchestra.run.smithi191.stdout:^* hv01.front.sepia.ceph.com 3 6 377 32 +501us[ +516us] +/- 38ms 2024-09-19T09:50:31.144 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 29 -1897us[-1897us] +/- 72ms 2024-09-19T09:50:31.144 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 +851us[ +851us] +/- 62ms 2024-09-19T09:50:31.144 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:50:31.145 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T09:50:31.156 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T09:50:31.156 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T09:50:31.167 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:50:31.262 DEBUG:teuthology.orchestra.run.smithi191:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:50:31.337 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:50:31.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:50:31.366 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:50:31.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:50:31.395 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T09:50:31.412 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T09:50:31.426 INFO:teuthology.task.internal:Duration was 1880.096615 seconds 2024-09-19T09:50:31.427 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T09:50:31.438 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T09:50:31.438 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:50:31.441 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:50:31.477 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:50:31.480 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:50:31.827 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T09:50:31.828 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-09-19T09:50:31.828 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:50:31.848 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2024-09-19T09:50:31.848 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:50:31.891 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T09:50:31.892 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:50:31.894 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:50:31.957 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T09:50:31.958 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:50:31.961 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:50:32.616 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T09:50:32.627 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T09:50:32.627 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:50:32.652 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:50:32.679 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T09:50:32.690 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:50:32.695 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:50:32.715 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-09-19T09:50:32.743 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2024-09-19T09:50:32.757 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:50:32.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:50:32.783 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:50:32.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:50:32.816 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T09:50:32.827 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T09:50:32.829 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911915/remote/smithi112 2024-09-19T09:50:32.829 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:50:32.878 DEBUG:teuthology.misc:Transferring archived files from smithi191:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911915/remote/smithi191 2024-09-19T09:50:32.878 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:50:32.915 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T09:50:32.915 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:50:32.917 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:50:32.964 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T09:50:32.977 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T09:50:32.978 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T09:50:32.990 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T09:50:32.990 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:50:32.993 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:50:33.005 INFO:teuthology.orchestra.run.smithi112.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:50 /home/ubuntu/cephtest 2024-09-19T09:50:33.018 INFO:teuthology.orchestra.run.smithi191.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:50 /home/ubuntu/cephtest 2024-09-19T09:50:33.020 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T09:50:33.032 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T09:50:33.062 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1880.096615076065 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T09:50:33.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:50:33.150 INFO:teuthology.run:pass